Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

A special column in the target data table is also assigned a unique Transaction ID, generated for each batch. In relation to this, a batch status table is utilized to indicate the batch status for the unique Transaction ID.

Image Added

GCP BigQuery Agent Workflow

Note
titleNote!

Due to the nature of BigQuery, the order of insertion of the UDR data into the BigQuery table is done out of sequence and will appear as such in the target table. Sorting will have to be done from BigQuery itself.

...

Note
titleNote!

The GCP BigQuery batch forwarding agent is implemented using a streaming API called the tabledata.insertAll method. You will need to refer to the GCP Bigquery documentation to ensure it is supported for your BigQuery tier.


Scroll ignore
scroll-viewportfalse
scroll-pdftrue
scroll-officefalse
scroll-chmtrue
scroll-docbooktrue
scroll-eclipsehelptrue
scroll-epubtrue
scroll-htmlfalse

This section includes the following subsections:

...