Package cz.o2.proxima.beam.direct.io

Class OffsetRestrictionTracker.OffsetRange

java.lang.Object

cz.o2.proxima.beam.direct.io.OffsetRestrictionTracker.OffsetRange

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.splittabledofn.HasDefaultTracker<OffsetRestrictionTracker.OffsetRange,OffsetRestrictionTracker>

Enclosing class:

OffsetRestrictionTracker

public static class OffsetRestrictionTracker.OffsetRange
extends java.lang.Object
implements java.io.Serializable, org.apache.beam.sdk.transforms.splittabledofn.HasDefaultTracker<OffsetRestrictionTracker.OffsetRange,OffsetRestrictionTracker>

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
private boolean	bounded
private long	consumed
private Offset	endOffsetInclusive
private boolean	extensible
private boolean	finished
private Partition	partition
private Position	position
private static long	serialVersionUID
private boolean	startInclusive
private Offset	startOffset
private long	totalLimit

Constructor Summary

Constructors

Modifier	Constructor	Description
private	OffsetRange(long limit, boolean bounded)
private	OffsetRange(Offset startExclusive, long totalLimit, boolean bounded, long consumed)
private	OffsetRange(Offset start, long totalLimit, boolean bounded, long consumed, boolean inclusive)
	OffsetRange(Offset startOffsetExclusive, Offset endOffsetInclusive, long totalLimit, boolean bounded, long consumed)
private	OffsetRange(Partition partition, Position position, long totalLimit, boolean bounded)

Method Summary

Modifier and Type	Method	Description
OffsetRestrictionTracker.OffsetRange	asPrimary()
OffsetRestrictionTracker.OffsetRange	asResidual()
(package private) boolean	claim(Offset offset)
boolean	equals(java.lang.Object o)
Partition	getPartition()
int	hashCode()
static OffsetRestrictionTracker.OffsetRange	initialRestriction(long limit, boolean bounded)
boolean	isFinished()	Verify that we have processed the whole restriction.
boolean	isInitial()
boolean	isLimitConsumed()
boolean	isSplittable()	Verify that we can split this restriction.
OffsetRestrictionTracker	newTracker()
static OffsetRestrictionTracker.OffsetRange	startingFrom(Partition partition, Position position, OffsetRestrictionTracker.OffsetRange initialRestriction)
(package private) void	terminate()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Field Detail

serialVersionUID

private static final long serialVersionUID

See Also:

Constant Field Values

partition

@Nullable
private final Partition partition

position

@Nullable
private final Position position

startOffset

@Nullable
private final Offset startOffset

startInclusive

private final boolean startInclusive

bounded

private final boolean bounded

totalLimit

private final long totalLimit

consumed

private long consumed

endOffsetInclusive

@Nullable
private Offset endOffsetInclusive

extensible

private boolean extensible

finished

private transient boolean finished

Constructor Detail

OffsetRange

private OffsetRange(Partition partition,
                    Position position,
                    long totalLimit,
                    boolean bounded)

OffsetRange

private OffsetRange(@Nullable
                    Offset start,
                    long totalLimit,
                    boolean bounded,
                    long consumed,
                    boolean inclusive)

OffsetRange

private OffsetRange(long limit,
                    boolean bounded)

OffsetRange

private OffsetRange(Offset startExclusive,
                    long totalLimit,
                    boolean bounded,
                    long consumed)

OffsetRange

public OffsetRange(Offset startOffsetExclusive,
                   Offset endOffsetInclusive,
                   long totalLimit,
                   boolean bounded,
                   long consumed)

Method Detail

initialRestriction

public static OffsetRestrictionTracker.OffsetRange initialRestriction(long limit,
                                                                      boolean bounded)

Parameters:

limit - total limit to read

bounded - true if this is bounded restriction

Returns:

initial restriction for DoFn.GetInitialRestriction.*

startingFrom

public static OffsetRestrictionTracker.OffsetRange startingFrom(Partition partition,
                                                                Position position,
                                                                OffsetRestrictionTracker.OffsetRange initialRestriction)

Returns:

restriction that reads from given offset (inclusive)

claim

boolean claim(@Nonnull
              Offset offset)

getPartition

public Partition getPartition()

isLimitConsumed

public boolean isLimitConsumed()

asPrimary

public OffsetRestrictionTracker.OffsetRange asPrimary()

Returns:

unmodifiable already processed split of the restriction

asResidual

public OffsetRestrictionTracker.OffsetRange asResidual()

Returns:

residual of not-yet processed work Note that, at all times the primary + residual should be equivalent to the original (unsplit) range.

isInitial

public boolean isInitial()

terminate

void terminate()

newTracker

public OffsetRestrictionTracker newTracker()

Specified by:

newTracker in interface org.apache.beam.sdk.transforms.splittabledofn.HasDefaultTracker<OffsetRestrictionTracker.OffsetRange,OffsetRestrictionTracker>

isSplittable

public boolean isSplittable()

Verify that we can split this restriction. A restriction is not splittable if it has not been yet started - i.e. no offset has been claimed.

isFinished

public boolean isFinished()

Verify that we have processed the whole restriction.

Returns:

true if watermark has arrived to final instant

equals

public boolean equals(java.lang.Object o)

Overrides:

equals in class java.lang.Object

hashCode

public int hashCode()

Overrides:

hashCode in class java.lang.Object