| Note | ||
|---|---|---|
| ||
As prerequisite, the scripts must be prepared according to Depcrecated Preparing and Creating Scripts for KPI Management. |
Submitting the Spark Cluster
Use this script to submit a Spark application to the Spark workers:
| Code Block |
|---|
$ submit.sh <kpiapp name> |
For further information about the Spark command, see /wiki/spaces/MD82/pages/3785973 in the /wiki/spaces/MD82/pages/3778935.
You can now confirm the status of the application. Open a browser and go to:
| Code Block | ||||
|---|---|---|---|---|
| ||||
http://<spark service master host>:8080 |
This opens the Spark Master Web UI.
Spark UI
| Tip | ||
|---|---|---|
| ||
The Application Detail UI contains useful tools for monitoring of the submitted applications. This UI can be opened from the Spark Master Web UI by clicking the Application Name of a running application. Click the top-level menus in the UI to monitor various aspects of the submitted applications. The Scheduling Delay and Processing Time graphs under the Streaming menu are particularly useful for monitoring the processing performance. The former displays the scheduling time of "Spark batches" and should be near 0. The latter display the processing time of these batches. |