HDFS(4.3)

Owned by Jenni Wallin
Last updated: Sept 27, 2024 by Yuri Au Yong

This section describes the HDFS collection and forwarding agents. These agents are available in batch workflow configurations. The agents have been tested and is bundled with the Apache Hadoop jars version 3.3.4.

Kerberos Use

It is possible to use manually-created Kerberos tickets by using the kinit command. The UseGroupInformation class can access them from the ticket cache. In this case, the items cannot be auto-renewed. 

It is advised that you allow MediationZone to handle user logins and ticket renewal as we do not recommend you manually create tickets.

Prerequisites

The reader of this information must be familiar with:

  • The Apache Hadoop Project and Hadoop Distributed File System

The section contains the following subsections: