org.apache.spark.streaming.scheduler

Class JobScheduler

Object

org.apache.spark.streaming.scheduler.JobScheduler

All Implemented Interfaces:

Logging

public class JobScheduler
extends Object
implements Logging

This class schedules jobs to be run on Spark. It uses the JobGenerator to generate the jobs and runs them using a thread pool.

Constructor Summary

Constructors

Constructor and Description
JobScheduler(StreamingContext ssc)

Method Summary

Methods

Modifier and Type	Method and Description
Clock	clock()
scala.collection.Seq<Time>	getPendingTimes()
StreamingListenerBus	listenerBus()
ReceiverTracker	receiverTracker()
void	reportError(String msg, Throwable e)
StreamingContext	ssc()
void	start()
void	stop(boolean processAllReceivedData)
void	submitJobSet(JobSet jobSet)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

JobScheduler

public JobScheduler(StreamingContext ssc)

Method Detail

ssc

public StreamingContext ssc()

clock

public Clock clock()

listenerBus

public StreamingListenerBus listenerBus()

receiverTracker

public ReceiverTracker receiverTracker()

start

public void start()

stop

public void stop(boolean processAllReceivedData)

submitJobSet

public void submitJobSet(JobSet jobSet)

getPendingTimes

public scala.collection.Seq<Time> getPendingTimes()

reportError

public void reportError(String msg,
               Throwable e)