Package cz.o2.proxima.beam.direct.io
Class DirectUnboundedSource
- java.lang.Object
-
- org.apache.beam.sdk.io.Source<OutputT>
-
- org.apache.beam.sdk.io.UnboundedSource<StreamElement,DirectUnboundedSource.Checkpoint>
-
- cz.o2.proxima.beam.direct.io.DirectUnboundedSource
-
- All Implemented Interfaces:
java.io.Serializable,org.apache.beam.sdk.transforms.display.HasDisplayData
class DirectUnboundedSource extends org.apache.beam.sdk.io.UnboundedSource<StreamElement,DirectUnboundedSource.Checkpoint>
AnUnboundedSourcecreated from direct operator'sCommitLogReader.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description (package private) static classDirectUnboundedSource.Checkpoint
-
Field Summary
Fields Modifier and Type Field Description private booleaneventTimeprivate RepositoryFactoryfactoryprivate longlimitprivate java.lang.Stringnameprivate Partitionpartitionprivate java.util.List<Partition>partitionsprivate Positionpositionprivate CommitLogReaderreaderprivate CommitLogReader.Factory<?>readerFactoryprivate static longserialVersionUIDprivate java.net.URIuri
-
Constructor Summary
Constructors Constructor Description DirectUnboundedSource(RepositoryFactory factory, java.lang.String name, CommitLogReader reader, Position position, boolean eventTime, long limit, Partition partition)
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description org.apache.beam.sdk.io.UnboundedSource.UnboundedReader<StreamElement>createReader(org.apache.beam.sdk.options.PipelineOptions po, DirectUnboundedSource.Checkpoint cmt)booleanequals(java.lang.Object o)org.apache.beam.sdk.coders.Coder<DirectUnboundedSource.Checkpoint>getCheckpointMarkCoder()org.apache.beam.sdk.coders.Coder<StreamElement>getOutputCoder()inthashCode()(package private) static DirectUnboundedSourceof(RepositoryFactory factory, java.lang.String name, CommitLogReader reader, Position position, boolean eventTime, long limit)private CommitLogReaderreader()booleanrequiresDeduping()java.util.List<org.apache.beam.sdk.io.UnboundedSource<StreamElement,DirectUnboundedSource.Checkpoint>>split(int desiredNumSplits, org.apache.beam.sdk.options.PipelineOptions options)
-
-
-
Field Detail
-
serialVersionUID
private static final long serialVersionUID
- See Also:
- Constant Field Values
-
factory
private final RepositoryFactory factory
-
name
@Nullable private final java.lang.String name
-
readerFactory
private final CommitLogReader.Factory<?> readerFactory
-
position
private final Position position
-
eventTime
private final boolean eventTime
-
partitions
private final java.util.List<Partition> partitions
-
limit
private final long limit
-
partition
@Nullable private final Partition partition
-
uri
private final java.net.URI uri
-
reader
@Nullable private transient CommitLogReader reader
-
-
Constructor Detail
-
DirectUnboundedSource
DirectUnboundedSource(@Nonnull RepositoryFactory factory, @Nullable java.lang.String name, @Nonnull CommitLogReader reader, @Nonnull Position position, boolean eventTime, long limit, @Nullable Partition partition)
-
-
Method Detail
-
of
static DirectUnboundedSource of(RepositoryFactory factory, java.lang.String name, CommitLogReader reader, Position position, boolean eventTime, long limit)
-
split
public java.util.List<org.apache.beam.sdk.io.UnboundedSource<StreamElement,DirectUnboundedSource.Checkpoint>> split(int desiredNumSplits, org.apache.beam.sdk.options.PipelineOptions options)
- Specified by:
splitin classorg.apache.beam.sdk.io.UnboundedSource<StreamElement,DirectUnboundedSource.Checkpoint>
-
reader
private CommitLogReader reader()
-
createReader
public org.apache.beam.sdk.io.UnboundedSource.UnboundedReader<StreamElement> createReader(org.apache.beam.sdk.options.PipelineOptions po, DirectUnboundedSource.Checkpoint cmt)
- Specified by:
createReaderin classorg.apache.beam.sdk.io.UnboundedSource<StreamElement,DirectUnboundedSource.Checkpoint>
-
getCheckpointMarkCoder
public org.apache.beam.sdk.coders.Coder<DirectUnboundedSource.Checkpoint> getCheckpointMarkCoder()
- Specified by:
getCheckpointMarkCoderin classorg.apache.beam.sdk.io.UnboundedSource<StreamElement,DirectUnboundedSource.Checkpoint>
-
getOutputCoder
public org.apache.beam.sdk.coders.Coder<StreamElement> getOutputCoder()
- Overrides:
getOutputCoderin classorg.apache.beam.sdk.io.Source<StreamElement>
-
requiresDeduping
public boolean requiresDeduping()
- Overrides:
requiresDedupingin classorg.apache.beam.sdk.io.UnboundedSource<StreamElement,DirectUnboundedSource.Checkpoint>
-
equals
public boolean equals(java.lang.Object o)
- Overrides:
equalsin classjava.lang.Object
-
hashCode
public int hashCode()
- Overrides:
hashCodein classjava.lang.Object
-
-