Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

A special table type is used to handle database table lookups with optional caching in memory. All of the following column references may be either numeric (column index, starts at 0) or string (column name).

The table lookup only supports int, string and date types.

Note
titleNote!

For MS SQL, the column type timestamp is not supported in tables accessed by Image Added. Use column type datetime instead. 

Please refer to the Notes section in the Database Functions page for details on allowed database data type.

The following functions for Database Table described here are:

Table of Contents
maxLevel1

sqlExec

The sqlExec function is used when updating and inserting data into tables. It returns an integer value stating how many rows were updated/inserted. SQL errors will cause runtime errors (the workflow aborts).

Code Block
int sqlExec (
 string dbProfile, 
 string sqlQuery )


ParameterDescription

dbProfile

Name of the database where the table resides, including folder name.

sqlQuery

SQL query to send to the database. Note that SQL statements must not end with ';'. Calls to stored procedures must be embedded in blocks.


Info
titleExamples - Valid for Oracle databases

 "<SQL query>"
"BEGIN <procedure>; END;"


Returns

An integer equaling the number of rows updated or inserted.

tableCreate

Returns a table that holds the result of a database query. SQL errors in the table lookup will cause runtime errors (workflow aborts).

Code Block
table tableCreate ( 
 string dbProfile, 
 string sqlQuery 
 boolean disableCommit)


ParameterDescription

dbProfile

Name of the database where the table resides

sqlQuery

SQL query to send to the database. Note that SQL statements must not end with ';'. Only columns of type number, date and string are supported.

disableCommit

An optional parameter to disable the commit statement from being performed at the end of every SQL transaction for this particular function. Setting this parameter to false will result in the commit statement to be performed at the end of every SQL transaction for this particular function. By default, the system has the disableCommit set to true unless otherwise changed via this parameter.

Info

It should be noted that on recent Oracle versions, the DBLink SQL transaction behaviour has changed, where every single SQL statement for remote database transaction requires a commit or rollback statement in order to close a connection.

In addition, Redshift users should set this to false as every statement needs to be committed. 


Returns

A table


Info
titleExample - Using tableCreate

To avoid performance problems, the table must be read from the database as seldom as possible. For instance, once for each workflow invocation.

Code Block
initialize {  
  table myTab = tableCreate("myFolder.myProfile", "select user from subscribers" );  
 }


kustoTableCreate

The kustoTableCreate function looks up information in Kusto databases. The resulting table is of the same type as that resulting from tableCreate, meaning that it can be used together with functions such as tableLookup, tableGet etc.


The format of this function is the following: 

Code Block
table kustoTableCreate(string profileName, string, databaseName, string query)


ParameterDescription
profileNameThe name of the profile used. This should be an Azure Profile of the type Azure Data Explorer
databaseNameThe name of the database in Azure. The cluster name is specified in the Azure profile
queryThe query to apply to the database in question. This is written in the Kusto Query Language, see example below.


Info
iconfalse
titlekustoTableCreate Example


Code Block
table result = kustoTableCreate("Default.AZDLookupDb", "lookupdb", "test  | where isnotnull(BeginLocation) | project EpisodeNarrative, EventNarrative | limit 5000");


The Kusto data types will be interpreted as the following types in the resulting table object:

Azure TypeAPL Type
boolboolean
datetimedate
dynamicstring
intint
longlong
realbigdec
stringstring
decimalbigdec
timespanstring

tableCreateIndex

Creates an index for one or several columns of a table. This will greatly increase the efficiency of subsequent tableLookup calls on these columns using the equality operator. If the column already has an index, this function has no effect.

Note
titleNote!

An index will not be created unless there are at least five rows in the table.


Code Block
void tableCreateIndex ( 
 table tableValue, 
 int|string column1, ... int|string columnN )


ParameterDescription

tableValue

A table object

columnN

A column index (starting with 0 for the first column), or name for which to create an index. At least one column must be specified.

Returns

Nothing


Info
titleExample - Using tableCreateIndex


Code Block
initialize {  
  table myTab = tableCreate("myFolder.myProfile", "select id, user from anum" );  
  tableCreateIndex( myTab, "id" );  
 }


tableGet

The tableGet function returns the value of a table entry. The value is returned as an any object, which means the returned value is of the same type as the value extracted.

Code Block
any tableGet ( 
 table tableValue, 
 int row, 
 int|string column)


ParameterDescription

tableValue

A table object

row

The row index. The first row is indexed 0 (zero).

column

Column index or name. The first column is indexed 0 (zero).

Returns

Any depending on the column type

tableLookup

The tableLookup function returns a table containing all the rows of the original table matching the specified column value(s). At least one pair of (column, operator, value) group must be specified.

Code Block
table tableLookup
( table tableValue, 
 int|string column1, 
 string operator1, 
 string|date|int value1, 
 any value1a, //Optional (used only for "between" and "not between") ... 
 int|column columnN, 
 string operatorN, 
 any valueN, 
 any valueNa ) //Optional (used only for "between" and "not between")


ParameterDescription

tableValue

A table object

columnN

Column index or name. The first column is indexed 0 (zero).

operatorN

Operator specifying the range of the requested values. Possible operators are:

  • =

  • !=

  • >

  • <

  • <=

  • >=

  • between - Requires two operands, ( valueN, valueNa ).

  • not between - Requires two operands, ( valueN, valueNa ).

  • starts with - The operator can only be applied to string columns.

valueN/ValueNa

Value(s) matching columnN and operatorN

Returns

A table matching the query


Info
titleExample - Using tableLookup

The following example looks for a specific entry in the in-memory table returned by the preceding tableCreate command.

Code Block
table myTab; 
// To avoid performance problems, the table is read 
// from the database once for each time the 
// workflow is activated. 
initialize { 
 myTab = tableCreate( "myFolder.myProfile", "select user from subscribers" ); 
}
consume {  
  table user = tableLookup( myTab, "user", "=", input.anum );  
  if ( tableRowCount( user ) > 0) {  
  // At least one entry found.  
  } else {  
  // No entry found.  
  }  
 }



Note
titleNote!

When a column is of date type, the matching values must contain date, time, and timezone, as demonstrated in the example below.


Info
titleExample - Using tableLookup when a column is of date type


Code Block
table myTab;
initialize {
 myTab = tableCreate("myFolder.myProfile","select date_field from all_dates");
}
consume { 
 date dateFilter;
 //The matching value must contain date, time, and timezone.
 strToDate(dateFilter,"01/05/2016 00:00:00","dd/MM/yyyy HH:mm:ss","CET"); 
 table myLookup = tableLookup(myTab,"date_field","=",dateFilter); 
 
 if ( tableRowCount( myLookup ) > 0) { 
 // At least one entry found. 
 } else { 
 // No entry found. 
 } 
}


tableRowCount

The tableRowCount function returns the number of rows in a table.

Code Block
int tableRowCount (table tableValue )


ParameterDescription

tableValue

Table object

Returns

An integer stating the number of rows found