The SQL Loader agent is a batch processing agent designed to populate the database with data from existing files, either residing in a local directory or on the server filesystem of the database.
Data can be collected using either the Disk, FTP, or SFTP agents, and supported databases are; MySQL, Netezza, PostgreSQL SAP HANA, Sybase IQ and Vertica.
Workflow Configuration
Workflow with the SQL Loader agent
The The Route FileReferenceUDR checkbox in the configuration dialogs in the Disk, FTP and SFTP agents now have an additional check box called Route FileReferenceUDR in their configuration dialogs:
This check box should be selected when using the SQL Loader agent.
Route FileReferenceUDR checkbox
The SQL Loader agent then forwards an SQLLoaderResultUDR
containing information about loaded file, number of inserted rows, execution time and any error messages, for logging purposes.
Workflow with the SQL Loader agent
UDR Types
The UDR types used in combination with the SQL Loader agent are FileReferenceUDR
and SQLLoaderResultUDR
:
FileReferenceUDR
The FileReferenceUDR
is the UDR format used to send data from the collection agent to the SQL Loader agent.
...
Field | Description |
---|---|
directory (string) | This field states the name of the directory the data file is located in. |
filename (string) | This field states the name of the file data should be collected from. |
fullpath (string) | This field states the full path to the data file. |
OriginalData (long) | This field contains the original data in byte array format. |
SQLLoaderResultUDR
The SQLLoaderResultUDR
is the UDR that the SQL Loader agent sends out after having loaded the data into the database. This UDR contains information for logging purposes that should be handled by another agent in the workflow.
...