Package cz.o2.proxima.beam.direct.io

Class BatchLogRead

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<StreamElement>>

cz.o2.proxima.beam.direct.io.BatchLogRead

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

public class BatchLogRead
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<StreamElement>>

A PTransform that reads from a BatchLogReader using splittable DoFn.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private class	BatchLogRead.BatchLogReadFn

Field Summary

Fields

Modifier and Type	Field	Description
private java.util.List<AttributeDescriptor<?>>	attributes
private long	endStamp
private long	limit
private BatchLogReader.Factory<?>	readerFactory
private RepositoryFactory	repoFactory
private long	startStamp

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor	Description
BatchLogRead(java.util.List<AttributeDescriptor<?>> attributes, long limit, RepositoryFactory repoFactory, BatchLogReader.Factory<?> readerFactory, long startStamp, long endStamp)

Method Summary

Modifier and Type	Method	Description
org.apache.beam.sdk.values.PCollection<StreamElement>	expand(org.apache.beam.sdk.values.PBegin input)
(package private) BlockingQueueLogObserver.BatchLogObserver	newObserver(java.lang.String name, long limit)
static BatchLogRead	of(java.util.List<AttributeDescriptor<?>> attributes, long limit, RepositoryFactory repositoryFactory, BatchLogReader reader, long startStamp, long endStamp)	Create the BatchLogRead transform that reads from BatchLogReader in batch manner.
static BatchLogRead	of(java.util.List<AttributeDescriptor<?>> attributes, long limit, Repository repo, BatchLogReader reader)	Create the BatchLogRead transform that reads from BatchLogReader in batch manner.
static BatchLogRead	of(java.util.List<AttributeDescriptor<?>> attributes, long limit, Repository repo, BatchLogReader reader, long startStamp, long endStamp)	Create the BatchLogRead transform that reads from BatchLogReader in batch manner.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

attributes

private final java.util.List<AttributeDescriptor<?>> attributes

limit

private final long limit

repoFactory

private final RepositoryFactory repoFactory

readerFactory

private final BatchLogReader.Factory<?> readerFactory

startStamp

private final long startStamp

endStamp

private final long endStamp

Constructor Detail

BatchLogRead

BatchLogRead(java.util.List<AttributeDescriptor<?>> attributes,
             long limit,
             RepositoryFactory repoFactory,
             BatchLogReader.Factory<?> readerFactory,
             long startStamp,
             long endStamp)

Method Detail

of

public static BatchLogRead of(java.util.List<AttributeDescriptor<?>> attributes,
                              long limit,
                              Repository repo,
                              BatchLogReader reader)

Create the BatchLogRead transform that reads from BatchLogReader in batch manner.

Parameters:

attributes - the attributes to read

limit - limit (use Long.MAX_VALUE for unbounded

repo - repository

reader - the reader

Returns:

BatchLogRead transform for the commit log

of

public static BatchLogRead of(java.util.List<AttributeDescriptor<?>> attributes,
                              long limit,
                              Repository repo,
                              BatchLogReader reader,
                              long startStamp,
                              long endStamp)

Create the BatchLogRead transform that reads from BatchLogReader in batch manner.

Parameters:

attributes - the attributes to read

limit - limit (use Long.MAX_VALUE for unbounded

repo - repository

reader - the reader

startStamp - starting stamp (inclusive)

endStamp - ending stamp (exclusive)

Returns:

BatchLogRead transform for the commit log

of

public static BatchLogRead of(java.util.List<AttributeDescriptor<?>> attributes,
                              long limit,
                              RepositoryFactory repositoryFactory,
                              BatchLogReader reader,
                              long startStamp,
                              long endStamp)

Create the BatchLogRead transform that reads from BatchLogReader in batch manner.

Parameters:

attributes - the attributes to read

limit - limit (use Long.MAX_VALUE for unbounded

repositoryFactory - repository factory

reader - the reader

startStamp - starting stamp (inclusive)

endStamp - ending stamp (exclusive)

Returns:

CommitLogRead transform for the commit log

expand

public org.apache.beam.sdk.values.PCollection<StreamElement> expand(org.apache.beam.sdk.values.PBegin input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<StreamElement>>

newObserver

BlockingQueueLogObserver.BatchLogObserver newObserver(java.lang.String name,
                                                      long limit)