Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

To create a new Data Hub profile configuration, click the the New Configuration in the Build view and select Data Hub Profile from the Configurations browser.

The contents of the menus in the menu bar may change depending on which configuration type that has been opened in the currently active tab. The Data Hub profile uses the standard menu items and buttons that are visible for all configurations, and these are described in Configuration [hide]mz9[/hide]Build View.

Impala Tab

The impala tab contains connections settings for the Impala database.

...

SettingDescription
HostEnter the hostname or the IP address of the Impala database.
PortEnter the port number that is configured for the connection into the Impala database.
Enable TLSAllows the user to enable the TLS functionality for the connection to the Impala database.
Allow Self Signed CertCheckbox to enable the usage of Self Signed Certificates. If this checkbox is selected, both Trust Store File Path and Trust Store Password will be disabled.
Trust Store File Path

Enter the location of the trust store file. This path is used to store certificates from other Certified Authorities. The setup is required to establish a successful connection at the client side.

Note
titleNote!

This field is enabled when the Enable TLS checkbox is selected.

However, when the Allow Self Signed Cert checkbox is selected, this field is disabled.


Trust Store Password

Enter the passphrase of the trust store file. This password is used to access the certificates stored in the trust store.

Note
titleNote!

This field is enabled when the Enable TLS checkbox is selected.

However, when the Allow Self Signed Cert checkbox is selected, this field is disabled.


Key Store File Path

Enter the location of the key store file. This path is used to store your credential. This is required when setting up the server side on the SSL. 

Note
titleNote!

This field is enabled when the Enable TLS checkbox is selected.However, when the Allow Self Signed Cert checkbox is selected, this field is disabled.


Key Store Password

Enter the passphrase of the key store file. This password is used to access the credentials stored in the key store.

Note
titleNote!

This field is enabled when the Enable TLS checkbox is selected.However, when the Allow Self Signed Cert checkbox is selected, this field is disabled.


Database NameClick the Refresh button next to Database Name to retrieve a list of available database and then select a database from the drop-down menu. The Tables Mapping tab will appear.
RefreshClick this to retrieve a list of available databases.
Test ConnectionClick to test the JDBC connection to the Impala database.

...

SettingDescription
Table

Select a database table from the drop-down list. The name of the table columns and their data type will appear.

Tip
titleHint!

You can map more than one table to a UDR type. This makes it possible to use the same profile for multiple Data Hub agents.


Note
titleNote!

If you have created a new table that appears to be missing in the drop-down list, click the Refresh button in Impala tab and then reselect the database. The table should now be listed.


UDR TypeClick the Browse button and then select a UDR type that will be routed to a Data Hub agent. For information about Ultra types that can be mapped to Impala types, see Compatible Types below.
Auto Map

Click this button to automatically map UDR fields and database columns with identical names. The automatic mapping is not case-sensitive. If a field cannot be mapped, the current value in the UDR Field column remains unchanged.

ColumnThe name of the columns in the selected table.
Type

Clicking the cell, This displays a list of valid Impala types based on the Column in the selected table. Each column must be mapped against a type.  For information about Ultra types that can be mapped to Impala types, see Compatible Types below.

UDR FieldSelect a UDR field from the drop-down list. This represents selectable fields available based on the selected UDR Type above.
Date Hint

Select the date format to be stored in the table. This is required for a partition column. A date in the Ultra format can be stored as INT, BIGINT and SMALLINT types.

When the column is a partition, you must select the corresponding date format from this drop-down list:

  • yyyyMMddHH - e g 2018123013
  • yyyyMMdd - e g 20181230
  • yyyyMM - 201812

  • yyyy - 2018

The selected format determines the granularity of date pickers in the Web UI.

When you change the Date Hint value of a partition column for an existing profile, make sure to review the settings of Data Hub task workflows that depend on the updated profile and table.

Warning

If the table already contains data when you change the Date Hint of a partition column, the Data Hub task agent will fail to delete any of the partitions. To resolve this issue you must manually delete the partitions that contain the old format, e g using Cloudera Hue.

Info
titleExample - SQL statement to partition


Code Block
alter table default.cw_carrier_voice_mis drop partition (yearmonthday=201812);




...