Package io.datarouter.conveyor.queue.configuration

Class BaseBatchedLossyQueueConsumerConveyorConfiguration<PK extends io.datarouter.model.key.primary.PrimaryKey<PK>,D extends io.datarouter.model.databean.Databean<PK,D>>

java.lang.Object

io.datarouter.conveyor.queue.configuration.BaseBatchedLossyQueueConsumerConveyorConfiguration<PK,D>

Type Parameters:

PK - Primary key

D - Databean

All Implemented Interfaces:

ConveyorConfiguration

public abstract class BaseBatchedLossyQueueConsumerConveyorConfiguration<PK extends io.datarouter.model.key.primary.PrimaryKey<PK>,D extends io.datarouter.model.databean.Databean<PK,D>>
extends Object
implements ConveyorConfiguration

Drains the queue and stores the data in a buffer. When the buffer hits a set limit it will trigger the processing as a batch. This implementation makes the best effort to process the buffer if the queue gets drained or it has been interrupted. NOTE: If the thread running the conveyor is killed or crashes before the processing of the buffer is completed the messages are lost forever. Along side the conveyor there must be some backup implementation that re-queues messages that are lost.

Field Summary

Fields inherited from interface io.datarouter.conveyor.ConveyorConfiguration

DEFAULT_PEEK_TIMEOUT, DEFAULT_VISIBILITY_TIMEOUT

Constructor Summary

Constructors

Constructor	Description
BaseBatchedLossyQueueConsumerConveyorConfiguration()

Method Summary

Modifier and Type	Method	Description
protected int	getBatchSize()
protected int	getMaxQuerySize()
protected Duration	getPeekTimeout()
protected abstract io.datarouter.storage.queue.consumer.BatchedQueueConsumer<PK,D>	getQueueConsumer()
void	interrupted(ConveyorRunnable conveyor)
Conveyor.ProcessResult	process(ConveyorRunnable conveyor)
protected abstract void	processBuffer(List<D> databeans)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.datarouter.conveyor.ConveyorConfiguration

compactExceptionLogging, delay, shouldRunOnShutdown

Constructor Details

BaseBatchedLossyQueueConsumerConveyorConfiguration

public BaseBatchedLossyQueueConsumerConveyorConfiguration()

Method Details

processBuffer

protected abstract void processBuffer(List<D> databeans)

getQueueConsumer

protected abstract io.datarouter.storage.queue.consumer.BatchedQueueConsumer<PK,D> getQueueConsumer()

process

public Conveyor.ProcessResult process(ConveyorRunnable conveyor)

Specified by:

process in interface ConveyorConfiguration

interrupted

public void interrupted(ConveyorRunnable conveyor)

Specified by:

interrupted in interface ConveyorConfiguration

getMaxQuerySize

protected int getMaxQuerySize()

getPeekTimeout

protected Duration getPeekTimeout()

getBatchSize

protected int getBatchSize()