org.cripac.isee.vpe.common

Class Stream

java.lang.Object

org.cripac.isee.vpe.common.Stream

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

DataManagingApp.AttrSavingStream, DataManagingApp.IDRankSavingStream, DataManagingApp.TrackletSavingStream, DataManagingApp.VideoCuttingStream, PedestrianAttrRecogApp.RecogStream, PedestrianReIDUsingAttrApp.ReIDStream, PedestrianTrackingApp.HDFSVideoTrackingStream

public abstract class Stream
extends Object
implements Serializable

A Stream is a flow of DStreams. Each stream outputs at most one type of data.

Created by ken.yu on 16-10-26.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Stream.Port The class Port represents an input port of a stream.

Field Summary

Fields

Modifier and Type	Field and Description
protected Singleton<Logger>	loggerSingleton
private Singleton<ByteArrayProducer>	producerSingleton
private static long	serialVersionUID
private boolean	verbose

Constructor Summary

Constructors

Constructor and Description
Stream(String appName, SystemPropertyCenter propCenter) Initialize necessary components of a Stream object.

Method Summary

Modifier and Type	Method and Description
abstract void	addToGlobalStream(Map<DataType,org.apache.spark.streaming.api.java.JavaPairDStream<UUID,TaskData>> globalStreamMap) Add streaming actions to the global TaskData stream.
protected org.apache.spark.streaming.api.java.JavaPairDStream<UUID,TaskData>	filter(Map<DataType,org.apache.spark.streaming.api.java.JavaPairDStream<UUID,TaskData>> streamMap, Stream.Port port)
abstract List<Stream.Port>	getPorts() Get input ports of the stream.
protected void	output(Collection<TaskData.ExecutionPlan.Node.Port> outputPorts, TaskData.ExecutionPlan executionPlan, Serializable result, UUID taskID)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

serialVersionUID

private static final long serialVersionUID

See Also:

Constant Field Values

producerSingleton

private final Singleton<ByteArrayProducer> producerSingleton

verbose

private final boolean verbose

loggerSingleton

protected final Singleton<Logger> loggerSingleton

Constructor Detail

Stream

public Stream(String appName,
              SystemPropertyCenter propCenter)
       throws Exception

Initialize necessary components of a Stream object.

Parameters:

appName - Enclosing application name.

propCenter - System property center.

Throws:

Exception - On failure creating singleton.

Method Detail

output

protected void output(Collection<TaskData.ExecutionPlan.Node.Port> outputPorts,
                      TaskData.ExecutionPlan executionPlan,
                      Serializable result,
                      UUID taskID)
               throws Exception

Throws:

Exception

filter

protected org.apache.spark.streaming.api.java.JavaPairDStream<UUID,TaskData> filter(Map<DataType,org.apache.spark.streaming.api.java.JavaPairDStream<UUID,TaskData>> streamMap,
                                                                                    Stream.Port port)

addToGlobalStream

public abstract void addToGlobalStream(Map<DataType,org.apache.spark.streaming.api.java.JavaPairDStream<UUID,TaskData>> globalStreamMap)

Add streaming actions to the global TaskData stream. This global stream contains pre-deserialized TaskData messages, so as to save time.

Parameters:

globalStreamMap - A map of streams. The key of an entry is the topic name, which must be one of the DataType. The value is a filtered stream.

getPorts

public abstract List<Stream.Port> getPorts()

Get input ports of the stream.

Returns:

A list of ports.