cz.o2.proxima.direct.commitlog

Class LogObservers

java.lang.Object

cz.o2.proxima.direct.commitlog.LogObservers

public class LogObservers
extends java.lang.Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	LogObservers.AbstractSortedLogObserver
private static class	LogObservers.SinglePartitionSortedLogObserver
private static class	LogObservers.SortedLogObserver

Constructor Summary

Constructors

Modifier	Constructor and Description
private	LogObservers()

Method Summary

Modifier and Type	Method and Description
private static Consumer<StreamElement>	lateDataLoggingConsumer(java.time.Duration allowedLateness)
static LogObserver	withSortBuffer(LogObserver upstream, java.time.Duration allowedLateness) Create LogObserver that observes data in event time order.
static LogObserver	withSortBuffer(LogObserver upstream, java.time.Duration allowedLateness, BiConsumer<StreamElement,LogObserver.OnNextContext> latecomerConsumer) Create LogObserver that observes data in event time order.
static LogObserver	withSortBuffer(LogObserver upstream, java.time.Duration allowedLateness, Consumer<StreamElement> latecomerConsumer) Create LogObserver that observes data in event time order.
static LogObserver	withSortBufferWithinPartition(LogObserver upstream, java.time.Duration allowedLateness) Create LogObserver that observes data in event time order per partition.
static LogObserver	withSortBufferWithinPartition(LogObserver upstream, java.time.Duration allowedLateness, BiConsumer<StreamElement,LogObserver.OnNextContext> latecomerConsumer) Create LogObserver that observes data in event time order per partition.
static LogObserver	withSortBufferWithinPartition(LogObserver upstream, java.time.Duration allowedLateness, Consumer<StreamElement> latecomerConsumer) Create LogObserver that observes data in event time order per partition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LogObservers

private LogObservers()

Method Detail

withSortBuffer

public static LogObserver withSortBuffer(LogObserver upstream,
                                         java.time.Duration allowedLateness)

Create LogObserver that observes data in event time order.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

Returns:

the observer to use for CommitLogReader.observe(String, LogObserver)

withSortBuffer

public static LogObserver withSortBuffer(LogObserver upstream,
                                         java.time.Duration allowedLateness,
                                         Consumer<StreamElement> latecomerConsumer)

Create LogObserver that observes data in event time order.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

latecomerConsumer - consumer of data that had to be dropped due to allowed lateness *

Returns:

the observer to use for CommitLogReader.observe(String, LogObserver)

withSortBuffer

public static LogObserver withSortBuffer(LogObserver upstream,
                                         java.time.Duration allowedLateness,
                                         BiConsumer<StreamElement,LogObserver.OnNextContext> latecomerConsumer)

Create LogObserver that observes data in event time order.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

latecomerConsumer - consumer of data that had to be dropped due to allowed lateness *

Returns:

the observer to use for CommitLogReader.observe(String, LogObserver)

withSortBufferWithinPartition

public static LogObserver withSortBufferWithinPartition(LogObserver upstream,
                                                        java.time.Duration allowedLateness)

Create LogObserver that observes data in event time order per partition.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

Returns:

the observer to use for CommitLogReader.observe(String, LogObserver)

withSortBufferWithinPartition

public static LogObserver withSortBufferWithinPartition(LogObserver upstream,
                                                        java.time.Duration allowedLateness,
                                                        Consumer<StreamElement> latecomerConsumer)

Create LogObserver that observes data in event time order per partition.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

latecomerConsumer - consumer of data that had to be dropped due to allowed lateness *

Returns:

the observer to use for CommitLogReader.observe(String, LogObserver)

withSortBufferWithinPartition

public static LogObserver withSortBufferWithinPartition(LogObserver upstream,
                                                        java.time.Duration allowedLateness,
                                                        BiConsumer<StreamElement,LogObserver.OnNextContext> latecomerConsumer)

Create LogObserver that observes data in event time order per partition.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

latecomerConsumer - consumer of data that had to be dropped due to allowed lateness *

Returns:

the observer to use for CommitLogReader.observe(String, LogObserver)

lateDataLoggingConsumer

private static Consumer<StreamElement> lateDataLoggingConsumer(java.time.Duration allowedLateness)