org.apache.wayang.api.sql.sources.fs

Class JavaCSVTableSource<T>

java.lang.Object

org.apache.wayang.core.plan.wayangplan.OperatorBase

org.apache.wayang.core.plan.wayangplan.UnarySource<T>

org.apache.wayang.api.sql.sources.fs.JavaCSVTableSource<T>

All Implemented Interfaces:

ActualOperator, ElementaryOperator, ExecutionOperator, Operator, org.apache.wayang.java.operators.JavaExecutionOperator

public class JavaCSVTableSource<T>
extends UnarySource<T>
implements org.apache.wayang.java.operators.JavaExecutionOperator

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

OperatorBase.GsonSerializer

Field Summary

Fields inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

inputSlots, outputSlots, STANDARD_OPERATOR_ARGS

Fields inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

FIRST_EPOCH

Constructor Summary

Constructors

Constructor and Description
JavaCSVTableSource(String sourcePath, DataSetType type, List<org.apache.calcite.rel.type.RelDataType> fieldTypes)
JavaCSVTableSource(String sourcePath, DataSetType type, List<org.apache.calcite.rel.type.RelDataType> fieldTypes, char separator) Constructor with separator

Method Summary

Modifier and Type	Method and Description
Tuple<Collection<ExecutionLineageNode>,Collection<ChannelInstance>>	evaluate(ChannelInstance[] inputs, ChannelInstance[] outputs, org.apache.wayang.java.execution.JavaExecutor javaExecutor, OptimizationContext.OperatorContext operatorContext)
List<ChannelDescriptor>	getSupportedInputChannels(int index)
List<ChannelDescriptor>	getSupportedOutputChannels(int index)

Methods inherited from class org.apache.wayang.core.plan.wayangplan.UnarySource

getOutput, getType

Methods inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

accept, addBroadcastInput, addTargetPlatform, at, collectMappedInputSlots, collectMappedOutputSlots, copy, createCopy, getAllInputs, getAllOutputs, getCardinalityEstimator, getContainer, getEpoch, getName, getOriginal, getSimpleClassName, getTargetPlatforms, isAuxiliary, isSupportingBroadcastInputs, propagateInputCardinality, propagateOutputCardinality, setAuxiliary, setCardinalityEstimator, setContainer, setEpoch, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.wayang.java.operators.JavaExecutionOperator

forward, getPlatform

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ExecutionOperator

copy, createLoadProfileEstimator, createLoadProfileEstimators, createOutputChannelInstances, getLimitBaseKey, getLoadProfileEstimatorConfigurationKey, getLoadProfileEstimatorConfigurationKeys, getOriginal, getOutputChannelDescriptor, isFiltered, modelEagerExecution, modelLazyExecution, modelQuasiEagerExecution

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ElementaryOperator

createCardinalityEstimator, getCardinalityEstimator, isAuxiliary, setAuxiliary, setCardinalityEstimator

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ActualOperator

accept

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

addBroadcastInput, addTargetPlatform, broadcastTo, broadcastTo, collectMappedInputSlots, collectMappedOutputSlots, connectTo, connectTo, getAllInputs, getAllOutputs, getCardinalityPusher, getContainer, getEffectiveOccupant, getEffectiveOccupant, getEpoch, getEstimationContextProperties, getForwards, getInnermostLoop, getInput, getInput, getLoopStack, getName, getNumBroadcastInputs, getNumInputs, getNumOutputs, getNumRegularInputs, getOuterInputSlot, getOutermostInputSlot, getOutermostOutputSlots, getOutput, getOutput, getParent, getTargetPlatforms, isAlternative, isElementary, isExecutionOperator, isFeedbackInput, isFeedforwardOutput, isLoopHead, isLoopSubplan, isOwnerOf, isReading, isSink, isSource, isSubplan, isSupportingBroadcastInputs, isUnconnected, propagateInputCardinality, propagateOutputCardinality, propagateOutputCardinality, setContainer, setEpoch, setInput, setName, setOutput

Constructor Detail

JavaCSVTableSource

public JavaCSVTableSource(String sourcePath,
                          DataSetType type,
                          List<org.apache.calcite.rel.type.RelDataType> fieldTypes)

JavaCSVTableSource

public JavaCSVTableSource(String sourcePath,
                          DataSetType type,
                          List<org.apache.calcite.rel.type.RelDataType> fieldTypes,
                          char separator)

Constructor with separator

Parameters:

sourcePath -

type -

fieldTypes -

separator -

Method Detail

evaluate

public Tuple<Collection<ExecutionLineageNode>,Collection<ChannelInstance>> evaluate(ChannelInstance[] inputs,
                                                                                    ChannelInstance[] outputs,
                                                                                    org.apache.wayang.java.execution.JavaExecutor javaExecutor,
                                                                                    OptimizationContext.OperatorContext operatorContext)

Specified by:

evaluate in interface org.apache.wayang.java.operators.JavaExecutionOperator

getSupportedInputChannels

public List<ChannelDescriptor> getSupportedInputChannels(int index)

Specified by:

getSupportedInputChannels in interface ExecutionOperator

getSupportedOutputChannels

public List<ChannelDescriptor> getSupportedOutputChannels(int index)

Specified by:

getSupportedOutputChannels in interface ExecutionOperator