Jobs Tab

Jobs tab in web UI shows status of all Spark jobs in a Spark application (i.e. a SparkContext).

spark webui jobs.png
Figure 1. Jobs Tab in Web UI

The Jobs tab is available under /jobs URL, i.e. http://localhost:4040/jobs.

spark webui jobs event timeline.png
Figure 2. Event Timeline in Jobs Tab

The Jobs tab consists of two pages, i.e. All Jobs and Details for Job pages.

Internally, the Jobs tab is represented by JobsTab.

Details for Job — JobPage Page

When you click a job in AllJobsPage, you see the Details for Job page.

spark webui jobs details for job.png
Figure 3. Details for Job Page

JobPage is a WebUIPage that shows statistics and stage list for a given job.

Details for Job page is registered under /job URL, i.e. http://localhost:4040/jobs/job/?id=0 and accepts one mandatory id request parameter as a job identifier.

When a job id is not found, you should see "No information to display for job ID" message.

spark webui jobs details for job no job.png
Figure 4. "No information to display for job" in Details for Job Page

JobPage displays the job’s status, group (if available), and the stages per state: active, pending, completed, skipped, and failed.

Note
A job can be in a running, succeeded, failed or unknown state.
spark webui jobs details for job active pending stages.png
Figure 5. Details for Job Page with Active and Pending Stages
spark webui jobs details for job four stages.png
Figure 6. Details for Job Page with Four Stages

results matching ""

    No results matching ""