Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 6 Next »

To use JavaScript in , there are some mandatory variables and APIs that you require.

Variables/FunctionsDescriptionExamples
audit

To control the custom user audit function. The supported types are:


  • count:  Increments the string key value with 1
Syntax
audit.count(key);
  • sum: Sums up the total amount
Syntax
audit.sum(key,value);
  • set: Sets an input value. Data entry using the set function can be used with any data type. The output of the sum function will show the accumulated amount. 
Syntax
audit.set(key,value);

audit.set

audit.set('Collection 1', JSON.stringify(object)): – This audit function can be used to enter any string value and save it to a specified key. 

audit.sum

audit.sum('KEY_NAME', payload.fieldName): - This function is useful when presenting amounts of data that is to be saved or forwarded to a destination source.

audit.count

audit.count('Tracking-Records-Changes'): - This function can be issued to increase the count of tracked records or a collection of data after an audit review. 

log

An object that contains logging functionality for the severity levels: info, warning, and error.

log.info("foo"); - Logs something to the log. See Logs.


Note

  • Large log messages are truncated, for example, messages that are greater than 100000 characters.
  • The object takes one or more arguments and concatenates them to a single string.
  • sprintf/printf placeholders are supported in the string for digits, json and strings.
  • If you have more arguments than placeholders, the remaining arguments are concatenated at the end of the string in the order that they are provided.

Note!

Currently, the Console object in JavaScript, which provides access to the browser's debugging console, is disabled.


Example

log.info('This is %s object: %j, it contains %d greeting phrases',"my", { greeting: 'hello', message: 'world' }, 1);

This results in the message: "This is my object: {\"greeting\": \"hello\", \"message\": \"world\"}, it contains 1 greeting phrases".

payload

The payload variable contains all the information of the current record/object. 


Example

  • payload.foo = "bar"; - Sets the property foo in the payload to the string "bar"
  • delete payload.foo; - Deletes the property foo from the payload
  • payload.baz = { a: 1, b: 2, c: 2 }; - Sets the property baz in the payload to an object

meta

The meta variable provides generic information (metadata) about a payload (record). Metadata is data that provide information about other data. Metadata summarises basic information about data, thereby making finding and working with particular instances of data easier.

Refer to Amazon S3 to know about metadata that is accessible from the Transform tab :

The following metadata is accessible using the Script Flush tab:

  • lastCall: A boolean flag set to true for the final transaction. lastCall can be used to create a summary or audit for the processed data at the final transaction.

    To initiate action(s) triggered by the recent transaction:

    if (meta.lastCall) 

{
 <action(s) needed>
}

Example using S3 Forwarder

If you choose to add properties to meta, you can do so in the Script Function and refer it to a different function, for example, Amazon S3 forwarder.

In the Script Function,

Example
const moment = require("moment");

if (!meta.simDate) 
{
 meta.simDate = moment(new Date()).format('YYYYMMDD');
}

In the Amazon S3 forwarder, add this in the Filename field: passages-${meta.simDate}.csv

For more information, please see Configuring Dynamic Naming in Fields.

push(<event>)

To send data downstream. You need to invoke this Function using await syntax.

To send data to the next Function(s) in the stream.

Example

await push(data); 

state

This is to keep the state across records. The state is only available during one stream execution. The information stored in the state variable is not persisted between executions and is cleared at the end of each stream execution.

The state variable contains two scopes:

  • node: To save the state locally for this Function. 
  • stream:  To save the state globally for the stream. 

Note

Refer to Best Practices to Avoid Stateful Stream Design for tips to not lose memory in case of any issue with stream execution or system downtime.

Example of node

state.node - This state remains across one stream execution and is only available in this Function.

const foo = state.node.foo; - Retrieves the variable foo from  Function

delete state.node.foo; - Removes the variable foo from Function

Example of stream

state.stream - This state is shared only within the Script Functions in a stream. 

const foo = state.stream.foo; - Retrieves the variable foo from the stream

delete state.stream.foo; - Removes the variable foo from the stream

store

These three operations functions as a key-value store. The key must be a string. Value can be of any type, for example: string, number, date, JSON object, and array.

You need to invoke this Function using await syntax:

  • get: To get a value

  • set: To set a value of a key 

    Syntax
    await store.set("<key>", <value>);


    And, to set the duration (in seconds) of how long the key is stored.

    Syntax
    await store.set("<key>", <value>,{ttl:<storage duration in number of seconds>});

    Note!

     Sets the value for a key for the defined duration. The ttl parameter is optional and the default value is 30 days, that is, 2 592 000 seconds. A key can be stored for a maximum of 60 days (5 184 000 seconds), however, this duration gets extended every time store.set is called within these 60 days.


Note!

If a value exceeding the maximum limit is entered, the value is automatically set to the designed maximum. 


  • del: To delete a value

    Syntax
    await store.del(<key>) 

Example

await store.get("foo") - Returns the value for the key "foo".

Example:

await store.set("foo", "hello"); - Sets the value for the key "foo" to the string "hello". The value is stored for 30 days, which is the default time for store.set.

Example:

await store.set("foo", "hello", {ttl:600000}); - Sets the value for the key "foo" to the string  "hello". The ttl for this value is 600000 seconds.

sharedStore

With shared persistent storage, streams can access the same data. For example, one stream writes data to the shared persistent storage that can be used by one or more streams. The key must be a string. Value can be of any type, for example, string, number, date, JSON object, and array.

Note!

Streams sharing data must belong to the same solution.


You must use the await syntax for the Function:

  • sharedStore.get: To get a value.

    Syntax
    await sharedStore.get("<key>");

  • sharedStore.set: To set a value of a key and the duration (in seconds) of how long the key is stored. 

    Syntax
    await sharedStore.set("<key>", <value>);


    And, to set the duration (in seconds) of how long the key is stored.

    Syntax
    await sharedStore.set("<key>", <value>,{ttl:<storage duration in number of seconds>});



Note!

If a value exceeding the maximum limit is entered, the value is automatically set to the designed maximum. 



  • sharedStore.del: To delete a value.

    Syntax
    await sharedStore.del("<key>");

Example

await sharedStore.get("foo") - Returns the value from the shared persistent storage for the key foo.

Example

await sharedStore.set("Team", "hello"); - Sets the value for key "Team" to the string "hello". The ttl for this value is set to default, 2592000 seconds.

const getVal = await sharedStore.get("Team");

await sharedStore.del("Team");

Example

await sharedStore.set("Team",{ foo: 42 }, {ttl: 6000}); - Sets the value for key "Team" to the object { foo: 42 }. The ttl for this value is 6000 seconds.

const getVal = await sharedStore.get("Team");

await sharedStore.del("Team");

Error message example

This really simplistic example shows the log when the keyword "payload" is spelled with a capital 'P'. The following example uses the Summarize Monthly Usage Data example stream.

 





  • No labels