Change Procedures

Owned by Kevin Wu
Jan 03, 2024
1 min read

This section describes Spark-related procedures that are required for configuration changes in KPI Management.

Updating the Spark Cluster- or Application Configuration

  • Stop the KPI Management workflows

  • Kill the Spark application

  • Stop the Spark cluster

  • Make whatever changes are needed

  • Start the Spark cluster

  • Submit the Spark application

  • Start the KPI Management workflows


Note!

When you have changed properties in the configuration related to the service model or Kafka, you also need to clear the check-point directory before starting the Spark cluster.

Updating the Kafka or Zookeeper Configuration

  • Stop KPI Management workflows

  • Kill the Spark application

  • Shutdown Spark, Kafka and Zookeeper

  • Clear all the runtime data.

  • Update the Kafka and/or Zookeeper configuration

  • Start Zookeeper, Kafka and Spark

  • Submit the Spark application

  • Start the KPI Management workflows