Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 2 Next »

Note!

As prerequisite, the scripts must be prepared according to Depcrecated Preparing and Creating Scripts for KPI Management.

Submitting the Spark Cluster

Use this script to submit a Spark application to the Spark workers:

$ submit.sh <kpiapp name>


For further information about the Spark command, see /wiki/spaces/MD82/pages/3785973 in the /wiki/spaces/MD82/pages/3778935.

You can now confirm the status of the application. Open a browser and go to:

http://<spark service master host>:8080


This opens the Spark Master Web UI.

Spark UI

Hint!

The Application Detail UI contains useful tools for monitoring of the submitted applications. This UI can be opened from the Spark Master Web UI by clicking the Application Name of a running application.

Click the top-level menus in the UI to monitor various aspects of the submitted applications. The Scheduling Delay and Processing Time graphs under the Streaming menu are particularly useful for monitoring the processing performance. The former displays the scheduling time of "Spark batches" and should be near 0. The latter display the processing time of these batches.

  • No labels