The File System Profile are used for making file system specific configurations, currently used by the Amazon S3 collection and forwarding agents.
Configuration
To create a new File System profile, click the New Configuration button in the upper left part of the Desktop window, and then select File System Profile from the menu. The configurations will vary depending on selected file system, and each file system will be described separately below.
Menus
The contents of the menus in the menu bar may change depending on which configuration type that has been opened in the currently displayed tab. The File System profile uses the standard menu items and buttons that are visible for all configurations, and these are described in 2.1 Menus and Buttons.
...
| Item | Description |
|---|---|
External References
| Select this menu item to enable the use of External References in the File System profile configuration. This can be used to configure the following fields: Amazon S3 file systems
HDFS file systems
For further information, see 8.1211.4 Using External Reference in Agent Profile Fields and 8.12 11 External Reference Profile. |
Amazon S3
When selecting Amazon S3 as file system, you will see two tabs; General and Advanced.
...
File System profile - Amazon S3 - General tab
General Tab
The following settings are available in the General tab in the File System profile (see screenshot above):
| Setting | Description |
|---|---|
File System Type | Select which file system type this profile should be applied for. Currently only Amazon S3 is available. |
| Credentials from Environment | Select this check box in order to pick up the credentials from the environment instead of entering them in this profile. If this check box is selected, the Access Key and Secret Key fields will be disabled. |
Access Key | Enter the access key for the user who owns the Amazon S3 account in this field. |
Secret Key | Enter the secret key for the stated access key in this field. |
| Region from Environment | Select this check box in order to pick up the region from the environment instead of entering the region in this profile. If this check box is selected, the Region field will be disabled. |
| Region | Enter the name of the Amazon S3 region in this field. |
Bucket | Enter the name of the Amazon S3 bucket in this field. |
| Use Amazon Profile | Select this check box if you already have an Amazon Profile set up, this will disable the the fields above and allow you to utilize the credentials that you have defined in your chosen Amazon Profile. |
Advanced Tab
In the Advanced tab, you can configure properties for the Amazon S3 File System client.
...
For information on how to configure the properties for Amazon S3 File System client, please refer to https://docs.aws.amazon.com/AmazonS3/latest/dev/acl-overview.html#canned-acl.
HDFS
When selecting HDFS as file systems, you will see two tabs; General and Advanced.
...
File System profile - HDFS General tab
The General Tab
In the General tab you can find the following settings:
| Field | Description |
|---|---|
File System Type | Select which file system type this profile should be applied for. Currently only Amazon S3 is available. |
| Version | Select a version of Hadoop from the drop-down box:
This setting only applies when you have selected Distributed File System as the File System Type. |
Host | Enter the IP address or hostname of the NameNode in this field. See the Apache Hadoop Project documentation for further information about the NameNode. |
Port | Enter the port number of the NameNode in this field. |
The Advanced Tab
The Advanced tab contains Advanced Properties for the configuration of Kerberos authentication.
...