Package cz.o2.proxima.beam.direct.io

Class CommitLogRead

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<StreamElement>>

cz.o2.proxima.beam.direct.io.CommitLogRead

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

public class CommitLogRead
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<StreamElement>>

A PTransform that reads from a CommitLogReader using splittable DoFn.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private class	CommitLogRead.AbstractCommitLogReadFn
private class	CommitLogRead.BoundedCommitLogReadFn
private class	CommitLogRead.UnboundedCommitLogReadFn

Field Summary

Fields

Modifier and Type	Field	Description
private boolean	bounded
private long	limit
private java.lang.String	observeName
private Position	position
private CommitLogReader.Factory<?>	readerFactory
private RepositoryFactory	repoFactory

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor	Description
CommitLogRead(java.lang.String observeName, Position position, long limit, boolean bounded, RepositoryFactory repoFactory, CommitLogReader reader)

Method Summary

Modifier and Type	Method	Description
org.apache.beam.sdk.values.PCollection<StreamElement>	expand(org.apache.beam.sdk.values.PBegin input)
(package private) BlockingQueueLogObserver.CommitLogObserver	newObserver(java.lang.String name, OffsetRestrictionTracker.OffsetRange restriction)
static CommitLogRead	of(java.lang.String observeName, Position position, long limit, RepositoryFactory repositoryFactory, CommitLogReader reader)	Create the CommitLogRead transform.
static CommitLogRead	of(java.lang.String observeName, Position position, long limit, Repository repo, CommitLogReader reader)	Create the CommitLogRead transform.
static CommitLogRead	ofBounded(java.lang.String observeName, long limit, RepositoryFactory repositoryFactory, CommitLogReader reader)	Create the CommitLogRead transform.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

observeName

private final java.lang.String observeName

position

private final Position position

limit

private final long limit

bounded

private final boolean bounded

repoFactory

private final RepositoryFactory repoFactory

readerFactory

private final CommitLogReader.Factory<?> readerFactory

Constructor Detail

CommitLogRead

CommitLogRead(java.lang.String observeName,
              Position position,
              long limit,
              boolean bounded,
              RepositoryFactory repoFactory,
              CommitLogReader reader)

Method Detail

of

public static CommitLogRead of(java.lang.String observeName,
                               Position position,
                               long limit,
                               Repository repo,
                               CommitLogReader reader)

Create the CommitLogRead transform.

Parameters:

observeName - name of the observer

position - Position to read from

limit - limit (use Long.MAX_VALUE for unbounded

repo - repository

reader - the reader

Returns:

CommitLogRead transform for the commit log

of

public static CommitLogRead of(java.lang.String observeName,
                               Position position,
                               long limit,
                               RepositoryFactory repositoryFactory,
                               CommitLogReader reader)

Create the CommitLogRead transform.

Parameters:

observeName - name of the observer

position - Position to read from

limit - limit (use Long.MAX_VALUE for unbounded

repositoryFactory - repository factory

reader - the reader

Returns:

CommitLogRead transform for the commit log

ofBounded

public static CommitLogRead ofBounded(java.lang.String observeName,
                                      long limit,
                                      RepositoryFactory repositoryFactory,
                                      CommitLogReader reader)

Create the CommitLogRead transform.

Parameters:

observeName - name of the observer

limit - limit (use Long.MAX_VALUE for unbounded

repositoryFactory - repository factory

reader - the reader

Returns:

CommitLogRead transform for the commit log

expand

public org.apache.beam.sdk.values.PCollection<StreamElement> expand(org.apache.beam.sdk.values.PBegin input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<StreamElement>>

newObserver

BlockingQueueLogObserver.CommitLogObserver newObserver(@Nullable
                                                       java.lang.String name,
                                                       OffsetRestrictionTracker.OffsetRange restriction)