Index

A B C D E F G H I J K L M N O P R S T U V W 
All Classes All Packages

A

AbstractOffsetCommitter<K,​V> - Class in io.confluent.parallelconsumer.internal
 
AbstractOffsetCommitter(ConsumerManager<K, V>, WorkManager<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
 
AbstractParallelEoSStreamProcessor<K,​V> - Class in io.confluent.parallelconsumer.internal
 
AbstractParallelEoSStreamProcessor(ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Construct the AsyncConsumer by wrapping this passed in conusmer and producer, which can be configured any which way as per normal.
addLoopEndCallBack(Runnable) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Plugin a function to run at the end of each main loop.
addToMailbox(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
addToMailBoxOnUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
addToMailBoxOnUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
With Vertx and Reactor, a function hasn't succeeded until the inner vertx function has also succeeded no op
addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
 
addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.ProcessingShard
 
addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.ShardManager
 
assignment() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
 

B

BackportUtils - Class in io.confluent.csid.utils
 
BackportUtils() - Constructor for class io.confluent.csid.utils.BackportUtils
 
batchSize(Integer) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
The maximum number of messages to attempt to pass into the user functions.
BitSet - io.confluent.parallelconsumer.offsets.OffsetEncoding
 
BitSetCompressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
 
BitSetEncoder - Class in io.confluent.parallelconsumer.offsets
Encodes a range of offsets, from an incompletes collection into a BitSet.
BitSetEncoder(int, OffsetSimultaneousEncoder) - Constructor for class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
BitSetEncoder(int, OffsetSimultaneousEncoder, OffsetEncoding.Version) - Constructor for class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
BitSetEncodingNotSupportedException - Exception in io.confluent.parallelconsumer.offsets
 
BitSetEncodingNotSupportedException(String) - Constructor for exception io.confluent.parallelconsumer.offsets.BitSetEncodingNotSupportedException
 
BitSetV2 - io.confluent.parallelconsumer.offsets.OffsetEncoding
switch from encoding bitset length as a short to an integer (length of 32,000 was reasonable too short)
BitSetV2Compressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
 
BrokerPollSystem<K,​V> - Class in io.confluent.parallelconsumer.internal
Subsystem for polling the broker for messages.
BrokerPollSystem(ConsumerManager<K, V>, WorkManager<K, V>, AbstractParallelEoSStreamProcessor<K, V>, ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.BrokerPollSystem
 
build() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
 
build() - Method in class io.confluent.parallelconsumer.RecordContext.RecordContextBuilder
 
build(KKEY, Map<KKEY, VVALUE>) - Static method in class io.confluent.csid.utils.LoopingResumingIterator
 
builder() - Static method in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
builder() - Static method in class io.confluent.parallelconsumer.RecordContext
 
ByteArray - io.confluent.parallelconsumer.offsets.OffsetEncoding
 
ByteArrayCompressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
 
ByteBufferEncoder - Class in io.confluent.parallelconsumer.offsets
 
ByteBufferEncoder(int, OffsetSimultaneousEncoder) - Constructor for class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
 

C

calculateQuantityToRequest() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
calculateSucceededActualOffsets(long) - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
canEqual(Object) - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
 
canEqual(Object) - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
 
canEqual(Object) - Method in class io.confluent.parallelconsumer.PollContext
 
canEqual(Object) - Method in class io.confluent.parallelconsumer.RecordContext
 
canEqual(Object) - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
carefullyRun(BiFunction<PARAM_ONE, PARAM_TWO, RESULT>, PARAM_ONE, PARAM_TWO) - Static method in class io.confluent.parallelconsumer.internal.UserFunctions
 
carefullyRun(Consumer<PARAM>, PARAM) - Static method in class io.confluent.parallelconsumer.internal.UserFunctions
 
carefullyRun(Function<PARAM, RESULT>, PARAM) - Static method in class io.confluent.parallelconsumer.internal.UserFunctions
 
CHARSET_TO_USE - Static variable in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
 
checkIfWorkIsStale(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
Have our partitions been revoked?
checkIfWorkIsStale(List<WorkContainer<K, V>>) - Method in class io.confluent.parallelconsumer.state.WorkManager
Have our partitions been revoked? Can a batch contain messages of different epochs?
checkPipelinePressure() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Checks the system has enough pressure in the pipeline of work, if not attempts to step up the load factor.
checkPipelinePressure() - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
 
claim() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
 
close() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Close the system, without draining.
close() - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
Close the consumer, without draining.
close(Duration) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
 
close(Duration) - Method in class io.confluent.parallelconsumer.internal.ProducerManager
Assumes the system is drained at this point, or draining is not desired.
close(Duration, DrainingCloseable.DrainingMode) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
close(Duration, DrainingCloseable.DrainingMode) - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
Close the consumer.
closeAndWait() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
 
closed - io.confluent.parallelconsumer.internal.State
 
closeDontDrainFirst() - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
 
closeDontDrainFirst(Duration) - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
 
closeDrainFirst() - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
 
closeDrainFirst(Duration) - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
 
closing - io.confluent.parallelconsumer.internal.State
 
collectCommitDataForDirtyPartitions() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
collectDirtyCommitData() - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
commitAsync(Map<TopicPartition, OffsetAndMetadata>, OffsetCommitCallback) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
 
commitMode(ParallelConsumerOptions.CommitMode) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
commitOffsets(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
 
commitOffsets(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
 
commitOffsets(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class io.confluent.parallelconsumer.internal.ProducerManager
 
CommitRequest() - Constructor for class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
 
CommitResponse(ConsumerOffsetCommitter.CommitRequest) - Constructor for class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
 
commitSync(Map<TopicPartition, OffsetAndMetadata>) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
 
compareTo(EncodedOffsetPair) - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
 
compareTo(WorkContainer) - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
COMPRESSION_FORCED_RESOURCE_LOCK - Static variable in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
Used to prevent tests running in parallel that depends on setting static state in this class.
compressionForced - Static variable in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
Force the encoder to also add the compressed versions.
ConsumeProduceResult(PollContext<K, V>, ProducerRecord<KK, VV>, RecordMetadata) - Constructor for class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
 
consumer(Consumer<K, V>) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
Required parameter for all use.
ConsumerManager<K,​V> - Class in io.confluent.parallelconsumer.internal
Delegate for KafkaConsumer
ConsumerManager(Consumer<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.ConsumerManager
 
consumerMgr - Variable in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
 
ConsumerOffsetCommitter<K,​V> - Class in io.confluent.parallelconsumer.internal
Committer that uses the Kafka Consumer to commit either synchronously or asynchronously
ConsumerOffsetCommitter(ConsumerManager<K, V>, WorkManager<K, V>, ParallelConsumerOptions) - Constructor for class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
 
ConsumerOffsetCommitter.CommitRequest - Class in io.confluent.parallelconsumer.internal
Commit request message
ConsumerOffsetCommitter.CommitResponse - Class in io.confluent.parallelconsumer.internal
Commit response message, linked to a ConsumerOffsetCommitter.CommitRequest
consumerRecord(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.RecordContext.RecordContextBuilder
 
ConsumerRecordId - Class in io.confluent.parallelconsumer.state
Useful identifier for a ConsumerRecord.
ConsumerRecordId(TopicPartition, long) - Constructor for class io.confluent.parallelconsumer.state.ConsumerRecordId
 
couldBeTakenAsWork(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
couldPerform() - Method in class io.confluent.parallelconsumer.internal.RateLimiter
 
count() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
The number of records for all topics
createEosStreamProcessor(ParallelConsumerOptions<KK, VV>) - Static method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
 
createJStreamEosStreamProcessor(ParallelConsumerOptions<?, ?>) - Static method in interface io.confluent.parallelconsumer.JStreamParallelStreamProcessor
 

D

decode(byte) - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
 
DEFAULT_MAX_CONCURRENCY - Static variable in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
DEFAULT_TIMEOUT - Static variable in interface io.confluent.parallelconsumer.internal.DrainingCloseable
 
DefaultMaxMetadataSize - Static variable in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
Maximum size of the commit offset metadata
defaultMessageRetryDelay(Duration) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
When a message fails, how long the system should wait before trying that message again.
description() - Method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
 
deserialiseIncompleteOffsetMapFromBase64(long, String) - Static method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
 
DOCS_ROOT - Static variable in class io.confluent.parallelconsumer.internal.Documentation
 
Documentation - Class in io.confluent.parallelconsumer.internal
 
Documentation() - Constructor for class io.confluent.parallelconsumer.internal.Documentation
 
DONT_DRAIN - io.confluent.parallelconsumer.internal.DrainingCloseable.DrainingMode
Stop downloading more messages, and stop procesing more messages in the queue, but finish processing messages already being processed locally.
drain() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
Will begin the shutdown process, eventually closing itself once drained
DRAIN - io.confluent.parallelconsumer.internal.DrainingCloseable.DrainingMode
Stop downloading more messages from the Broker, but finish processing what has already been queued.
draining - io.confluent.parallelconsumer.internal.State
When draining, the system will stop polling for more records, but will attempt to process all already downloaded records.
DrainingCloseable - Interface in io.confluent.parallelconsumer.internal
 
DrainingCloseable.DrainingMode - Enum in io.confluent.parallelconsumer.internal
 
dynamicExtraLoadFactor - Variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Multiple of ParallelConsumerOptions.getMaxConcurrency() to have in our processing queue, in order to make sure threads always have work to do.
DynamicLoadFactor - Class in io.confluent.parallelconsumer.internal
Controls a loading factor.
DynamicLoadFactor() - Constructor for class io.confluent.parallelconsumer.internal.DynamicLoadFactor
 

E

encodeCompletedOffset(int) - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
encodeCompletedOffset(int) - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
 
encodeCompletedOffset(int) - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
EncodedOffsetPair - Class in io.confluent.parallelconsumer.offsets
 
encodeIncompleteOffset(int) - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
encodeIncompleteOffset(int) - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
 
encodeIncompleteOffset(int) - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
EncodingNotSupportedException - Exception in io.confluent.parallelconsumer.offsets
 
EncodingNotSupportedException(String) - Constructor for exception io.confluent.parallelconsumer.offsets.EncodingNotSupportedException
 
endFlight() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
EpochAndRecordsMap<K,​V> - Class in io.confluent.parallelconsumer.internal
For tagging polled records with our epoch
EpochAndRecordsMap(ConsumerRecords<K, V>, PartitionStateManager<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
 
EpochAndRecordsMap.RecordsAndEpoch - Class in io.confluent.parallelconsumer.internal
 
equals(Object) - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
 
equals(Object) - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
 
equals(Object) - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
 
equals(Object) - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
 
equals(Object) - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
 
equals(Object) - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
 
equals(Object) - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
 
equals(Object) - Method in class io.confluent.parallelconsumer.PollContext
 
equals(Object) - Method in class io.confluent.parallelconsumer.RecordContext
 
equals(Object) - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
 
equals(Object) - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
ErrorInUserFunctionException - Exception in io.confluent.parallelconsumer
This exception is only used when there is an exception thrown from code provided by the user.
ErrorInUserFunctionException(String, Throwable) - Constructor for exception io.confluent.parallelconsumer.ErrorInUserFunctionException
 
ExternalEngine<K,​V> - Class in io.confluent.parallelconsumer.internal
Overrides key aspects required in common for other threading engines like Vert.x and Reactor
ExternalEngine(ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.ExternalEngine
 

F

forcedCodec - Static variable in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
Forces the use of a specific codec, instead of choosing the most efficient one.
forEach(Consumer<? super RecordContext<K, V>>) - Method in class io.confluent.parallelconsumer.PollContext
 
forEach(Consumer<? super RecordContext<K, V>>) - Method in class io.confluent.parallelconsumer.PollContextInternal
 

G

getAllIncompleteOffsets() - Method in class io.confluent.parallelconsumer.state.PartitionState
 
getBatchSize() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
The maximum number of messages to attempt to pass into the user functions.
getBitSet() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
getByTopicPartitionMap() - Method in class io.confluent.parallelconsumer.PollContext
 
getByTopicPartitionMap() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
getClock() - Static method in class io.confluent.csid.utils.TimeUtils
 
getCommitDataIfDirty() - Method in class io.confluent.parallelconsumer.state.PartitionState
 
getCommitMode() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
getCommitQueueSize() - Method in class io.confluent.parallelconsumer.state.PartitionState
 
getCommitQueueSize() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
getConsumer() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
Required parameter for all use.
getConsumerRecord() - Method in class io.confluent.parallelconsumer.RecordContext
 
getConsumerRecordsFlattened() - Method in class io.confluent.parallelconsumer.PollContext
 
getConsumerRecordsFlattened() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
getContextsFlattened() - Method in class io.confluent.parallelconsumer.PollContext
 
getContextsFlattened() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
getCountOfWorkAwaitingSelection() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
 
getCountOfWorkTracked() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
 
getCountWorkInFlight() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
 
getCr() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getCurrentFactor() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
 
getData() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
 
getDecodedIncompletes(long) - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
 
getDecodedString() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
 
getDefaultMessageRetryDelay() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
When a message fails, how long the system should wait before trying that message again.
getDelayUntilRetryDue() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getElapsedDuration() - Method in class io.confluent.parallelconsumer.internal.RateLimiter
 
getEncodedBytes() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
getEncodedBytes() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
 
getEncodedBytes() - Method in class io.confluent.parallelconsumer.offsets.OffsetEncoder
 
getEncodedBytes() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
getEncodedSize() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
getEncodedSize() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
 
getEncodedSize() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
getEncoding() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
 
getEncodingMap() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
Map of different encoding types for the same offset data, used for retrieving the data for the encoding type
getEncodingType() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
getEncodingType() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
 
getEncodingType() - Method in class io.confluent.parallelconsumer.offsets.OffsetEncoder
 
getEncodingType() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
getEncodingTypeCompressed() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
getEncodingTypeCompressed() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
 
getEncodingTypeCompressed() - Method in class io.confluent.parallelconsumer.offsets.OffsetEncoder
 
getEncodingTypeCompressed() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
getEntries() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
Map of offset to WorkUnits.
getEpoch() - Method in class io.confluent.parallelconsumer.state.WorkContainer
Assignment generation this record comes from.
getEpochOfPartition(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
getEpochOfPartitionAtPoll() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
 
getEpochOfPartitionForRecord(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
getFailureCause() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
getFuture() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getHighestSeenOffset() - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
The highest represented offset in this result.
getHighestSeenOffset(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
getId() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
 
getIn() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
 
getIncompleteOffsets() - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
Of the offsets encoded, the incomplete ones.
getIncompleteOffsets() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
The offsets which have not yet been fully completed and can't have their offset committed
getIncompleteOffsetsBelowHighestSucceeded() - Method in class io.confluent.parallelconsumer.state.PartitionState
 
getIncompleteOffsetsBelowHighestSucceeded() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
getIterationStartingPoint() - Method in class io.confluent.csid.utils.LoopingResumingIterator
 
getLast(List<T>) - Static method in class io.confluent.csid.utils.JavaUtils
 
getLastFailedAt() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getLastFailureAt() - Method in class io.confluent.parallelconsumer.RecordContext
 
getLastFailureReason() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getLeft() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
 
getLinkHtmlToDocSection(String) - Static method in class io.confluent.parallelconsumer.internal.Documentation
 
getLongPollTimeout() - Static method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
Note how this relates to BrokerPollSystem.getLongPollTimeout() - if longPollTimeout is high and loading factor is low, there may not be enough messages queued up to satisfy demand.
getLowestRetryTime() - Method in class io.confluent.parallelconsumer.state.ShardManager
 
getLowestRetryTime() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
getMagicByte() - Method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
 
getManagedExecutorService() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
Path to Managed executor service for Java EE
getManagedThreadFactory() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
Path to Managed thread factory for Java EE
getMaxConcurrency() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
Controls the maximum degree of concurrency to occur.
getMaxFactor() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
Upper safety cap on multiples of target queue size to reach (e.g.
getMaxFailureHistory() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
getMaybeUserFunctionSucceeded() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getMeta() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
 
getMyId() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Optional ID of this instance.
getNumberOfAssignedPartitions() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
getNumberOfEntriesInPartitionQueues() - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
getNumberOfEntriesInPartitionQueues() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
getNumberOfFailedAttempts() - Method in class io.confluent.parallelconsumer.RecordContext
 
getNumberOfFailedAttempts() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getNumberOfWorkQueuedInShardsAwaitingSelection() - Method in class io.confluent.parallelconsumer.state.ShardManager
 
getNumberOfWorkQueuedInShardsAwaitingSelection() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
getNumberRecordsOutForProcessing() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
getOffset() - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
 
getOffsetCommitTimeout() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
Controls how long to block while waiting for offsets to be committed.
getOffsetHighestSeen() - Method in class io.confluent.parallelconsumer.state.PartitionState
The highest seen offset for a partition.
getOffsetHighestSeen() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
getOffsetHighestSequentialSucceeded() - Method in class io.confluent.parallelconsumer.state.PartitionState
 
getOffsetHighestSucceeded() - Method in class io.confluent.parallelconsumer.state.PartitionState
Highest offset which has completed successfully ("succeeded").
getOffsetHighestSucceeded() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
getOffsets() - Method in class io.confluent.parallelconsumer.PollContext
Map of partitions to offsets.
getOffsets() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
getOffsetsFlattened() - Method in class io.confluent.parallelconsumer.PollContext
Get all the offsets for the records in this result set.
getOffsetsFlattened() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
getOnlyOne(Map<String, T>) - Static method in class io.confluent.csid.utils.JavaUtils
 
getOptions() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
getOptions() - Method in class io.confluent.parallelconsumer.state.ShardManager
 
getOptions() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
getOrdering() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
getOut() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
 
getPartitionState(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
getPm() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
getPollContext() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
getProducer() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
Supplying a producer is only needed if using the produce flows.
getProducerManager() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
getQueueTargetLoaded() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
getRate() - Method in class io.confluent.parallelconsumer.internal.RateLimiter
 
getRecordContext() - Method in class io.confluent.parallelconsumer.RecordContextInternal
 
getRecordId() - Method in class io.confluent.parallelconsumer.RecordContext
A useful ID class for consumer records.
getRecordMap() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
 
getRecords() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
 
getRequest() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
 
getRequestedAtMs() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
 
getRetryDelayConfig() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getRetryDelayProvider() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
When present, use this to generate the retry delay, instead of ParallelConsumerOptions.getDefaultMessageRetryDelay().
getRight() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
 
getRunLengthEncodingIntegers() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
getSendTimeout() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
Controls how long to block while waiting for the Producer.send(org.apache.kafka.clients.producer.ProducerRecord<K, V>) to complete for any ProducerRecords returned from the user-function.
getSingleConsumerRecord() - Method in class io.confluent.parallelconsumer.PollContext
Must not be using batching (ParallelConsumerOptions.batchSize).
getSingleConsumerRecord() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
getSingleRecord() - Method in class io.confluent.parallelconsumer.PollContext
Must not be using batching (ParallelConsumerOptions.batchSize).
getSingleRecord() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
getSingleton() - Static method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
getSm() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
getSortedEncodings() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
Ordered set of the different encodings, used to quickly retrieve the most compressed encoding
getSucceededAt() - Method in class io.confluent.parallelconsumer.RecordContext
 
getSucceededAt() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getSuccessfulWorkListeners() - Method in class io.confluent.parallelconsumer.state.WorkManager
Useful for testing
getTargetAmountOfRecordsInFlight() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
getTargetOutForProcessing() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
getTargetOutForProcessing() - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
 
getThresholdForTimeSpendInQueueWarning() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
Configure the amount of delay a record experiences, before a warning is logged.
getTimeBetweenCommits() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Time between commits.
getTimeInFlight() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getTopicPartition() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
getTp() - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
 
getTp() - Method in class io.confluent.parallelconsumer.state.PartitionState
 
getTp() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
getUSED_PAYLOAD_THRESHOLD_MULTIPLIER() - Static method in class io.confluent.parallelconsumer.state.PartitionStateManager
Best efforts attempt to prevent usage of offset payload beyond X% - as encoding size test is currently only done per batch, we need to leave some buffer for the required space to overrun before hitting the hard limit where we have to drop the offset payload entirely.
getWm() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
getWorkContainer() - Method in class io.confluent.parallelconsumer.RecordContext
 
getWorkContainer() - Method in class io.confluent.parallelconsumer.RecordContextInternal
 
getWorkContainers() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
getWorkForOffset(long) - Method in class io.confluent.parallelconsumer.state.ProcessingShard
 
getWorkIfAvailable() - Method in class io.confluent.parallelconsumer.state.WorkManager
Get work with no limit on quantity, useful for testing.
getWorkIfAvailable(int) - Method in class io.confluent.parallelconsumer.state.ShardManager
 
getWorkIfAvailable(int) - Method in class io.confluent.parallelconsumer.state.WorkManager
Depth first work retrieval.
getWorkMailBox() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Collection of work waiting to be
getWorkType() - Method in class io.confluent.parallelconsumer.state.WorkContainer
Simple way to differentiate treatment based on type
groupMetadata() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
 

H

handleFutureResult(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
 
hasDelayPassed() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
hashCode() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
 
hashCode() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
 
hashCode() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
 
hashCode() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
 
hashCode() - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
 
hashCode() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
 
hashCode() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
 
hashCode() - Method in class io.confluent.parallelconsumer.PollContext
 
hashCode() - Method in class io.confluent.parallelconsumer.RecordContext
 
hashCode() - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
 
hashCode() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
hasNext() - Method in class io.confluent.csid.utils.LoopingResumingIterator
 
hasPreviouslyFailed() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
hasWorkInCommitQueue() - Method in class io.confluent.parallelconsumer.state.PartitionState
 
hasWorkInCommitQueue() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
hasWorkInCommitQueues() - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
hasWorkInCommitQueues() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
hasWorkInFlight() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
headers() - Method in class io.confluent.parallelconsumer.RecordContext
 
HighestOffsetAndIncompletes(Optional<Long>, Set<Long>) - Constructor for class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
 

I

InternalRuntimeError - Exception in io.confluent.parallelconsumer.internal
 
InternalRuntimeError(String) - Constructor for exception io.confluent.parallelconsumer.internal.InternalRuntimeError
 
InternalRuntimeError(String, Throwable) - Constructor for exception io.confluent.parallelconsumer.internal.InternalRuntimeError
 
InternalRuntimeError(String, Throwable, boolean, boolean) - Constructor for exception io.confluent.parallelconsumer.internal.InternalRuntimeError
 
InternalRuntimeError(Throwable) - Constructor for exception io.confluent.parallelconsumer.internal.InternalRuntimeError
 
invoke() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
Highwater mark already encoded in string - OffsetMapCodecManager.makeOffsetMetadataPayload(long, io.confluent.parallelconsumer.state.PartitionState<K, V>) - so encoding BitSet run length may not be needed, or could be swapped
io.confluent.csid.utils - package io.confluent.csid.utils
 
io.confluent.parallelconsumer - package io.confluent.parallelconsumer
 
io.confluent.parallelconsumer.internal - package io.confluent.parallelconsumer.internal
 
io.confluent.parallelconsumer.offsets - package io.confluent.parallelconsumer.offsets
 
io.confluent.parallelconsumer.state - package io.confluent.parallelconsumer.state
 
isAllowedMoreRecords(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
isAllowedMoreRecords(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
Check we have capacity in offset storage to process more messages
isAsyncFutureWork(List<?>) - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
System dependent way for the core engine to know if an external scheduler needs to be relied on for completion, as opposed to the internal threading system in the core module.
isAvailableToTakeAsWork() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
isBlank(String) - Static method in class io.confluent.csid.utils.StringUtils
 
isBlocked() - Method in class io.confluent.parallelconsumer.state.PartitionState
Convenience method for readability
isBlocked(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
Checks if partition is blocked with back pressure.
isClosedOrFailed() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
isEmpty() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
 
isEmpty(Optional<?>) - Static method in class io.confluent.csid.utils.BackportUtils
 
isGreaterThan(Duration, Duration) - Static method in class io.confluent.csid.utils.JavaUtils
 
isInFlight() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
isMaxReached() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
 
isNoRecordsOutForProcessing() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
isNotInFlight() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
isPartitionRemovedOrNeverAssigned(ConsumerRecord<?, ?>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
isPaused() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
 
isProducerSupplied() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
isRecordPreviouslyCompleted(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
 
isRecordPreviouslyCompleted(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
isRecordPreviouslyCompleted(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
isRecordsAwaitingProcessing() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
isRecordsAwaitingToBeCommitted() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
isRemoved() - Method in class io.confluent.parallelconsumer.state.PartitionState
Has this partition been removed? No.
isRemoved() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
isSufficientlyLoaded() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
isSync() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
 
isTransactionInProgress() - Method in class io.confluent.parallelconsumer.internal.ProducerManager
 
isUserFunctionComplete() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
isUserFunctionSucceeded() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
isUsingBatching() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
isUsingTransactionalProducer() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
isWarmUpPeriodOver() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
Is the warm-up period over?
isWorkInFlightMeetingTarget() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
iterator() - Method in class io.confluent.csid.utils.LoopingResumingIterator
 
iterator() - Method in class io.confluent.csid.utils.Range
 
iterator() - Method in class io.confluent.parallelconsumer.PollContext
 
iterator() - Method in class io.confluent.parallelconsumer.PollContextInternal
 

J

Java8StreamUtils - Class in io.confluent.csid.utils
 
JavaUtils - Class in io.confluent.csid.utils
 
JStreamParallelEoSStreamProcessor<K,​V> - Class in io.confluent.parallelconsumer
 
JStreamParallelEoSStreamProcessor(ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.JStreamParallelEoSStreamProcessor
 
JStreamParallelStreamProcessor<K,​V> - Interface in io.confluent.parallelconsumer
 

K

KAFKA_OFFSET_ABSENCE - Static variable in class io.confluent.parallelconsumer.state.PartitionState
Symbolic value for a parameter which is initialised as having an offset absent (instead of using Optional or null)
KafkaUtils - Class in io.confluent.csid.utils
Simple identifier tuple for Topic Partitions
KafkaUtils() - Constructor for class io.confluent.csid.utils.KafkaUtils
 
key() - Method in class io.confluent.parallelconsumer.PollContext
For backwards compatibility with ConsumerRecord.key().
key() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
key() - Method in class io.confluent.parallelconsumer.RecordContext
 
KEY - io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
Process messages in key order.

L

LARGE_INPUT_MAP_SIZE_THRESHOLD - Static variable in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
Size threshold in bytes after which compressing the encodings will be compared, as it seems to be typically worth the extra compression step when beyond this size in the source array.
leaderEpoch() - Method in class io.confluent.parallelconsumer.RecordContext
 
list() - Method in class io.confluent.csid.utils.Range
 
loadPartitionStateForAssignment(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
Load all the previously completed offsets that were not committed
LoopingResumingIterator<KEY,​VALUE> - Class in io.confluent.csid.utils
Loop implementations that will resume from a given key.
LoopingResumingIterator(Map<KEY, VALUE>) - Constructor for class io.confluent.csid.utils.LoopingResumingIterator
 
LoopingResumingIterator(Optional<KEY>, Map<KEY, VALUE>) - Constructor for class io.confluent.csid.utils.LoopingResumingIterator
Will resume from the startingKey, if it's present

M

magicByte - Variable in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
 
makeOffsetMetadataPayload(long, PartitionState<K, V>) - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
 
managedExecutorService(String) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
Path to Managed executor service for Java EE
managedThreadFactory(String) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
Path to Managed thread factory for Java EE
max(Duration, Duration) - Static method in class io.confluent.csid.utils.JavaUtils
 
MAX_LENGTH_ENCODABLE - Static variable in class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
maxConcurrency(int) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
Controls the maximum degree of concurrency to occur.
maxFailureHistory(int) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
 
maybeStepUp() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
Try to increase the loading factor
MDC_INSTANCE_ID - Static variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
MDC_OFFSET_MARKER - Static variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
METADATA_DATA_SIZE_RESOURCE_LOCK - Static variable in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
Used to prevent tests running in parallel that depends on setting static state in this class.
msg(String, Object...) - Static method in class io.confluent.csid.utils.StringUtils
 
MSG - Static variable in class io.confluent.parallelconsumer.internal.UserFunctions
 

N

next() - Method in class io.confluent.csid.utils.LoopingResumingIterator
 
NO_OP - Static variable in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
NoEncodingPossibleException - Exception in io.confluent.parallelconsumer.offsets
 
NoEncodingPossibleException(String) - Constructor for exception io.confluent.parallelconsumer.offsets.NoEncodingPossibleException
 
notifySomethingToDo() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Early notify of work arrived.

O

of() - Static method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
 
of(long) - Static method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
 
of(long, Set<Long>) - Static method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
 
offset() - Method in class io.confluent.parallelconsumer.PollContext
For backwards compatibility with ConsumerRecord.offset().
offset() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
offset() - Method in class io.confluent.parallelconsumer.RecordContext
 
offset() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
OffsetBitSet - Class in io.confluent.parallelconsumer.offsets
Deserialisation tools for BitSetEncoder.
OffsetBitSet() - Constructor for class io.confluent.parallelconsumer.offsets.OffsetBitSet
 
OffsetCommitter - Interface in io.confluent.parallelconsumer.internal
 
offsetCommitTimeout(Duration) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
Controls how long to block while waiting for offsets to be committed.
OffsetDecodingError - Exception in io.confluent.parallelconsumer.offsets
 
OffsetDecodingError(String, IllegalArgumentException) - Constructor for exception io.confluent.parallelconsumer.offsets.OffsetDecodingError
 
OffsetEncoder - Class in io.confluent.parallelconsumer.offsets
Base OffsetEncoder
OffsetEncoder(OffsetSimultaneousEncoder) - Constructor for class io.confluent.parallelconsumer.offsets.OffsetEncoder
 
OffsetEncoding - Enum in io.confluent.parallelconsumer.offsets
 
OffsetEncoding.Version - Enum in io.confluent.parallelconsumer.offsets
 
OffsetMapCodecManager<K,​V> - Class in io.confluent.parallelconsumer.offsets
Uses multiple encodings to compare, when decided, can refactor other options out for analysis only - OffsetMapCodecManager.encodeOffsetsCompressed(long, io.confluent.parallelconsumer.state.PartitionState<K, V>)
OffsetMapCodecManager(Consumer<K, V>) - Constructor for class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
 
OffsetMapCodecManager.HighestOffsetAndIncompletes - Class in io.confluent.parallelconsumer.offsets
Decoding result for encoded offsets
OffsetRunLength - Class in io.confluent.parallelconsumer.offsets
 
OffsetSimpleSerialisation - Class in io.confluent.parallelconsumer.offsets
 
OffsetSimultaneousEncoder - Class in io.confluent.parallelconsumer.offsets
Encode with multiple strategies at the same time.
OffsetSimultaneousEncoder(long, long, Set<Long>) - Constructor for class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
 
onCommitRequested() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
 
onFailure(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.ShardManager
Idempotent - work may have not been removed, either way it's put back
onFailure(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
 
onFailure(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
onFailureResult(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
 
onOffsetCommitSuccess(Map<TopicPartition, OffsetAndMetadata>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
Truncate our tracked offsets as a commit was successful, so the low water mark rises, and we dont' need to track as much anymore.
onOffsetCommitSuccess(Map<TopicPartition, OffsetAndMetadata>) - Method in class io.confluent.parallelconsumer.state.WorkManager
Can run from controller or poller thread, depending on which is responsible for committing
onOffsetCommitSuccess(OffsetAndMetadata) - Method in class io.confluent.parallelconsumer.state.PartitionState
 
onPartitionsAssigned(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Delegate to WorkManager
onPartitionsAssigned(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
Load offset map for assigned assignedPartitions
onPartitionsAssigned(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.WorkManager
Load offset map for assigned partitions
onPartitionsLost(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Delegate to WorkManager
onPartitionsLost(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
Clear offset map for lost partitions
onPartitionsLost(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.WorkManager
Clear offset map for lost partitions
onPartitionsRemoved(ShardManager<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
 
onPartitionsRevoked(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Commit our offsets
onPartitionsRevoked(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
Clear offset map for revoked partitions
onPartitionsRevoked(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.WorkManager
Clear offset map for revoked partitions
onQueueingForExecution() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
onSuccess(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.ProcessingShard
 
onSuccess(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.ShardManager
 
onSuccess(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
 
onSuccess(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
 
onSuccess(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
 
onSuccessResult(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
 
onUserFunctionFailure(Throwable) - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
onUserFunctionSuccess() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
onUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
onUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
With Vertx and Reactor, a function hasn't succeeded until the inner vertx function has also succeeded logging
options - Variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
ordering(ParallelConsumerOptions.ProcessingOrder) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder

P

packSmallest() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
Select the smallest encoding, and pack it.
pairOf(LL, RR) - Static method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
 
ParallelConsumer<K,​V> - Interface in io.confluent.parallelconsumer
Asynchronous / concurrent message consumer for Kafka.
ParallelConsumer.Tuple<L,​R> - Class in io.confluent.parallelconsumer
A simple tuple structure.
ParallelConsumerException - Exception in io.confluent.parallelconsumer
Generic Parallel Consumer RuntimeException parent.
ParallelConsumerException(String, Throwable) - Constructor for exception io.confluent.parallelconsumer.ParallelConsumerException
 
ParallelConsumerInternalException - Exception in io.confluent.parallelconsumer.internal
Generic Parallel Consumer parent exception.
ParallelConsumerInternalException(String) - Constructor for exception io.confluent.parallelconsumer.internal.ParallelConsumerInternalException
 
ParallelConsumerOptions<K,​V> - Class in io.confluent.parallelconsumer
The options for the AbstractParallelEoSStreamProcessor system.
ParallelConsumerOptions.CommitMode - Enum in io.confluent.parallelconsumer
The type of commit to be made, with either a transactions configured Producer where messages produced are committed back to the Broker along with the offsets they originated from, or with the faster simpler Consumer offset system either synchronously or asynchronously
ParallelConsumerOptions.ParallelConsumerOptionsBuilder<K,​V> - Class in io.confluent.parallelconsumer
 
ParallelConsumerOptions.ProcessingOrder - Enum in io.confluent.parallelconsumer
The ordering guarantee to use.
ParallelEoSStreamProcessor<K,​V> - Class in io.confluent.parallelconsumer
 
ParallelEoSStreamProcessor(ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
Construct the AsyncConsumer by wrapping this passed in conusmer and producer, which can be configured any which way as per normal.
ParallelStreamProcessor<K,​V> - Interface in io.confluent.parallelconsumer
Parallel message consumer which also can optionally produce 0 or many ProducerRecord results to be published back to Kafka.
ParallelStreamProcessor.ConsumeProduceResult<K,​V,​KK,​VV> - Class in io.confluent.parallelconsumer
A simple triple structure to capture the set of coinciding data.
partition() - Method in class io.confluent.parallelconsumer.RecordContext
 
PARTITION - io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
Process messages within a partition in order, but process multiple partitions in parallel.
partitions() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
Get the partitions which have records contained in this record set.
PartitionState<K,​V> - Class in io.confluent.parallelconsumer.state
 
PartitionState(TopicPartition, OffsetMapCodecManager.HighestOffsetAndIncompletes) - Constructor for class io.confluent.parallelconsumer.state.PartitionState
 
PartitionStateManager<K,​V> - Class in io.confluent.parallelconsumer.state
In charge of managing PartitionStates.
PartitionStateManager(Consumer<K, V>, ShardManager<K, V>, ParallelConsumerOptions<K, V>, Clock) - Constructor for class io.confluent.parallelconsumer.state.PartitionStateManager
 
pause(Set<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
 
paused() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
 
performIfNotLimited(Runnable) - Method in class io.confluent.parallelconsumer.internal.RateLimiter
 
PERIODIC_CONSUMER_ASYNCHRONOUS - io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
Periodically commits offsets asynchronously.
PERIODIC_CONSUMER_SYNC - io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
Periodically synchronous commits with the Consumer.
PERIODIC_TRANSACTIONAL_PRODUCER - io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
Periodically commits through the Producer using transactions.
poll(Consumer<PollContext<K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
 
poll(Consumer<PollContext<K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
Register a function to be applied in parallel to each received message
pollAndProduce(Function<PollContext<K, V>, ProducerRecord<K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
 
pollAndProduce(Function<PollContext<K, V>, ProducerRecord<K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
Register a function to be applied in parallel to each received message, which in turn returns a ProducerRecord to be sent back to the broker.
pollAndProduce(Function<PollContext<K, V>, ProducerRecord<K, V>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
 
pollAndProduce(Function<PollContext<K, V>, ProducerRecord<K, V>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
Register a function to be applied in parallel to each received message, which in turn returns a ProducerRecord to be sent back to the broker.
pollAndProduceMany(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
 
pollAndProduceMany(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
Register a function to be applied in parallel to each received message, which in turn returns one or many ProducerRecords to be sent back to the broker.
pollAndProduceMany(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
 
pollAndProduceMany(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
Register a function to be applied in parallel to each received message, which in turn returns one or more ProducerRecords to be sent back to the broker.
PollContext<K,​V> - Class in io.confluent.parallelconsumer
Context object used to pass messages to process to users processing functions.
PollContext() - Constructor for class io.confluent.parallelconsumer.PollContext
 
PollContextInternal<K,​V> - Class in io.confluent.parallelconsumer
Internal only view on the PollContext.
PollContextInternal(List<WorkContainer<K, V>>) - Constructor for class io.confluent.parallelconsumer.PollContextInternal
 
pollProduceAndStream(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>) - Method in class io.confluent.parallelconsumer.JStreamParallelEoSStreamProcessor
 
pollProduceAndStream(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>) - Method in interface io.confluent.parallelconsumer.JStreamParallelStreamProcessor
Like AbstractParallelEoSStreamProcessor#pollAndProduceMany but instead of callbacks, streams the results instead, after the produce result is ack'd by Kafka.
postCommit() - Method in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
 
postCommit() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
 
postCommit() - Method in class io.confluent.parallelconsumer.internal.ProducerManager
 
preAcquireWork() - Method in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
 
preAcquireWork() - Method in class io.confluent.parallelconsumer.internal.ProducerManager
 
ProcessingShard<K,​V> - Class in io.confluent.parallelconsumer.state
Models the queue of work to be processed, based on the ParallelConsumerOptions.ProcessingOrder modes.
ProcessingShard(Object, ParallelConsumerOptions<?, ?>, PartitionStateManager<K, V>) - Constructor for class io.confluent.parallelconsumer.state.ProcessingShard
 
produceMessage(ProducerRecord<K, V>) - Method in class io.confluent.parallelconsumer.internal.ProducerManager
Produce a message back to the broker.
producer - Variable in class io.confluent.parallelconsumer.internal.ProducerManager
 
producer(Producer<K, V>) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
Supplying a producer is only needed if using the produce flows.
ProducerManager<K,​V> - Class in io.confluent.parallelconsumer.internal
 
ProducerManager(Producer<K, V>, ConsumerManager<K, V>, WorkManager<K, V>, ParallelConsumerOptions) - Constructor for class io.confluent.parallelconsumer.internal.ProducerManager
 

R

range(long) - Static method in class io.confluent.csid.utils.Range
Exclusive of max
Range - Class in io.confluent.csid.utils
https://stackoverflow.com/a/16570509/105741
Range(long) - Constructor for class io.confluent.csid.utils.Range
 
RateLimiter - Class in io.confluent.parallelconsumer.internal
 
RateLimiter() - Constructor for class io.confluent.parallelconsumer.internal.RateLimiter
 
RateLimiter(int) - Constructor for class io.confluent.parallelconsumer.internal.RateLimiter
 
readDataArrayForDebug() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
Copies array out of the ByteBuffer
readFully(InputStream) - Static method in class io.confluent.csid.utils.BackportUtils
 
readFully(InputStream, int, boolean) - Static method in class io.confluent.csid.utils.BackportUtils
Used in Java 8 environments (Java 9 has read all bytes)
RecordContext<K,​V> - Class in io.confluent.parallelconsumer
Context information for the wrapped ConsumerRecord.
RecordContext(WorkContainer<K, V>) - Constructor for class io.confluent.parallelconsumer.RecordContext
 
RecordContext(WorkContainer<K, V>, ConsumerRecord<K, V>) - Constructor for class io.confluent.parallelconsumer.RecordContext
 
RecordContext.RecordContextBuilder<K,​V> - Class in io.confluent.parallelconsumer
 
RecordContextInternal<K,​V> - Class in io.confluent.parallelconsumer
Internal only view of the RecordContext class.
RecordContextInternal(WorkContainer<K, V>) - Constructor for class io.confluent.parallelconsumer.RecordContextInternal
 
records - Variable in class io.confluent.parallelconsumer.PollContext
 
records(TopicPartition) - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
Get just the records for the given partition
RecordsAndEpoch(Long, List<ConsumerRecord<K, V>>) - Constructor for class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
 
registerWork(EpochAndRecordsMap<K, V>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
registerWork(EpochAndRecordsMap<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
 
remap(Map<K, V1>, Function<? super V1, ? extends V2>) - Static method in class io.confluent.csid.utils.JavaUtils
A shortcut for changing only the values of a Map.
remove(long) - Method in class io.confluent.parallelconsumer.state.ProcessingShard
 
RemovedPartitionState<K,​V> - Class in io.confluent.parallelconsumer.state
No op version of PartitionState used for when partition assignments are removed, to avoid managing null references or Optionals.
RemovedPartitionState() - Constructor for class io.confluent.parallelconsumer.state.RemovedPartitionState
 
requestCommitAsap() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Request a commit as soon as possible (ASAP), overriding other constraints.
resume(Set<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
 
retrieveOffsetsAndCommit() - Method in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
Get offsets from WorkManager that are ready to commit
retrieveOffsetsAndCommit() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
Optionally blocks.
retrieveOffsetsAndCommit() - Method in interface io.confluent.parallelconsumer.internal.OffsetCommitter
 
retryDelayProvider(Function<RecordContext<K, V>, Duration>) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
When present, use this to generate the retry delay, instead of ParallelConsumerOptions.getDefaultMessageRetryDelay().
RunLength - io.confluent.parallelconsumer.offsets.OffsetEncoding
 
RunLengthCompressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
 
RunLengthEncoder - Class in io.confluent.parallelconsumer.offsets
RunLength encoder that leverages the nature of this system.
RunLengthEncoder(OffsetSimultaneousEncoder, OffsetEncoding.Version) - Constructor for class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
RunlengthV1EncodingNotSupported - Exception in io.confluent.parallelconsumer.offsets
 
RunlengthV1EncodingNotSupported(String) - Constructor for exception io.confluent.parallelconsumer.offsets.RunlengthV1EncodingNotSupported
 
RunLengthV2 - io.confluent.parallelconsumer.offsets.OffsetEncoding
switch from encoding run lengths as Shorts to Integers
RunLengthV2Compressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
 
running - io.confluent.parallelconsumer.internal.State
 
runUserFunction(Function<PollContextInternal<K, V>, List<R>>, Consumer<R>, List<WorkContainer<K, V>>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Run the supplied function.

S

sendTimeout(Duration) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
Controls how long to block while waiting for the Producer.send(org.apache.kafka.clients.producer.ProducerRecord<K, V>) to complete for any ProducerRecords returned from the user-function.
serialise() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
 
serialise() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
 
serialise() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
 
serializedKeySize() - Method in class io.confluent.parallelconsumer.RecordContext
 
serializedValueSize() - Method in class io.confluent.parallelconsumer.RecordContext
 
setDefaultRetryDelay(Duration) - Static method in class io.confluent.parallelconsumer.state.WorkContainer
 
setFuture(Future<List<?>>) - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
setLongPollTimeout(Duration) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
setLongPollTimeout(Duration) - Static method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
Note how this relates to BrokerPollSystem.getLongPollTimeout() - if longPollTimeout is high and loading factor is low, there may not be enough messages queued up to satisfy demand.
setMyId(Optional<String>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Optional ID of this instance.
setTimeBetweenCommits(Duration) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Time between commits.
setupStreamFromDeque(ConcurrentLinkedDeque<T>) - Static method in class io.confluent.csid.utils.Java8StreamUtils
 
setupWorkerPool(int) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
setupWorkerPool(int) - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
The vert.x module doesn't use any thread pool for dispatching work, as the work is all done by the vert.x engine.
setUSED_PAYLOAD_THRESHOLD_MULTIPLIER(double) - Static method in class io.confluent.parallelconsumer.state.PartitionStateManager
Best efforts attempt to prevent usage of offset payload beyond X% - as encoding size test is currently only done per batch, we need to leave some buffer for the required space to overrun before hitting the hard limit where we have to drop the offset payload entirely.
setWorkType(String) - Method in class io.confluent.parallelconsumer.state.WorkContainer
Simple way to differentiate treatment based on type
ShardManager<K,​V> - Class in io.confluent.parallelconsumer.state
Shards are local queues of work to be processed.
ShardManager(ParallelConsumerOptions, WorkManager<K, V>, Clock) - Constructor for class io.confluent.parallelconsumer.state.ShardManager
 
shouldThrottle() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
size() - Method in class io.confluent.parallelconsumer.PollContext
 
size() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
SIZE_COMPARATOR - Static variable in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
 
spliterator() - Method in class io.confluent.parallelconsumer.PollContext
 
spliterator() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
start(String) - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
 
State - Enum in io.confluent.parallelconsumer.internal
The run state of the controller.
stream() - Method in class io.confluent.parallelconsumer.PollContext
 
stream() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
streamConsumerRecords() - Method in class io.confluent.parallelconsumer.PollContext
 
streamConsumerRecords() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
streamInternal() - Method in class io.confluent.parallelconsumer.PollContext
 
streamInternal() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
streamWorkContainers() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
StringUtils - Class in io.confluent.csid.utils
 
StringUtils() - Constructor for class io.confluent.csid.utils.StringUtils
 
submitWorkToPool(Function<PollContextInternal<K, V>, List<R>>, Consumer<R>, List<WorkContainer<K, V>>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Submit a piece of work to the processing pool.
subscribe(Collection<String>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
subscribe(Collection<String>) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
 
subscribe(Collection<String>, ConsumerRebalanceListener) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
subscribe(Collection<String>, ConsumerRebalanceListener) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
 
subscribe(Pattern) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
subscribe(Pattern) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
 
subscribe(Pattern, ConsumerRebalanceListener) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
subscribe(Pattern, ConsumerRebalanceListener) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
 
supervise() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
 
supervisorLoop(Function<PollContextInternal<K, V>, List<R>>, Consumer<R>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Supervisor loop for the main loop.

T

thresholdForTimeSpendInQueueWarning(Duration) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
Configure the amount of delay a record experiences, before a warning is logged.
time(Callable<RESULT>) - Static method in class io.confluent.csid.utils.TimeUtils
 
timestamp() - Method in class io.confluent.parallelconsumer.RecordContext
 
timestampType() - Method in class io.confluent.parallelconsumer.RecordContext
 
TimeUtils - Class in io.confluent.csid.utils
 
toBuilder() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
toBuilder() - Method in class io.confluent.parallelconsumer.RecordContext
 
topic() - Method in class io.confluent.parallelconsumer.RecordContext
 
toSeconds(Duration) - Static method in class io.confluent.csid.utils.BackportUtils
 
toStream() - Method in class io.confluent.csid.utils.Range
 
toString() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
 
toString() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
 
toString() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
 
toString() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
 
toString() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
Used for printing out the comparative map of each encoder
toString() - Method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
 
toString() - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
 
toString() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
 
toString() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
 
toString() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
toString() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
 
toString() - Method in class io.confluent.parallelconsumer.PollContext
 
toString() - Method in class io.confluent.parallelconsumer.RecordContext.RecordContextBuilder
 
toString() - Method in class io.confluent.parallelconsumer.RecordContext
 
toString() - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
 
toString() - Method in class io.confluent.parallelconsumer.state.PartitionState
 
toString() - Method in class io.confluent.parallelconsumer.state.WorkContainer
 
toTopicPartition(ConsumerRecord<?, ?>) - Static method in class io.confluent.csid.utils.KafkaUtils
 
Tuple(L, R) - Constructor for class io.confluent.parallelconsumer.ParallelConsumer.Tuple
 

U

UNORDERED - io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
No ordering is guaranteed, not even partition order.
unused - io.confluent.parallelconsumer.internal.State
 
USED_PAYLOAD_THRESHOLD_MULTIPLIER_DEFAULT - Static variable in class io.confluent.parallelconsumer.state.PartitionStateManager
 
UserFunctions - Class in io.confluent.parallelconsumer.internal
Single entry point for wrapping the actual execution of user functions

V

v1 - io.confluent.parallelconsumer.offsets.OffsetEncoding.Version
 
v2 - io.confluent.parallelconsumer.offsets.OffsetEncoding.Version
 
validate() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
 
value() - Method in class io.confluent.parallelconsumer.PollContext
For backwards compatibility with ConsumerRecord.value().
value() - Method in class io.confluent.parallelconsumer.PollContextInternal
 
value() - Method in class io.confluent.parallelconsumer.RecordContext
 
valueOf(String) - Static method in enum io.confluent.parallelconsumer.internal.DrainingCloseable.DrainingMode
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum io.confluent.parallelconsumer.internal.State
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding.Version
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
Returns the enum constant of this type with the specified name.
values() - Static method in enum io.confluent.parallelconsumer.internal.DrainingCloseable.DrainingMode
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum io.confluent.parallelconsumer.internal.State
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding.Version
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
Returns an array containing the constants of this enum type, in the order they are declared.
version - Variable in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
 

W

waitForProcessedNotCommitted(Duration) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
Deprecated.
no longer used, will be removed in next version
wakeup() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
Wakes up the consumer, but only if it's polling.
wakeupIfPaused() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
Wakeup if colling the broker
wm - Variable in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
 
wm - Variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
workContainer - Variable in class io.confluent.parallelconsumer.RecordContext
 
workContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.RecordContext.RecordContextBuilder
 
WorkContainer<K,​V> - Class in io.confluent.parallelconsumer.state
 
WorkContainer(long, ConsumerRecord<K, V>, Function<RecordContext<K, V>, Duration>, String, Clock) - Constructor for class io.confluent.parallelconsumer.state.WorkContainer
 
WorkContainer(long, ConsumerRecord<K, V>, Function<RecordContext<K, V>, Duration>, Clock) - Constructor for class io.confluent.parallelconsumer.state.WorkContainer
 
workerThreadPool - Variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
The pool which is used for running the users's supplied function
workIsWaitingToBeProcessed() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
 
workIsWaitingToBeProcessed() - Method in class io.confluent.parallelconsumer.state.ShardManager
 
workIsWaitingToBeProcessed() - Method in class io.confluent.parallelconsumer.state.WorkManager
 
WorkManager<K,​V> - Class in io.confluent.parallelconsumer.state
Sharded, prioritised, offset managed, order controlled, delayed work queue.
WorkManager(ParallelConsumerOptions<K, V>, Consumer<K, V>) - Constructor for class io.confluent.parallelconsumer.state.WorkManager
 
WorkManager(ParallelConsumerOptions<K, V>, Consumer<K, V>, DynamicLoadFactor, Clock) - Constructor for class io.confluent.parallelconsumer.state.WorkManager
 
WorkManager(ParallelConsumerOptions<K, V>, Consumer<K, V>, Clock) - Constructor for class io.confluent.parallelconsumer.state.WorkManager
Use a private DynamicLoadFactor, useful for testing.
workRemaining() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
 
workRemaining() - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
Of the records consumed from the broker, how many do we have remaining in our local queues
A B C D E F G H I J K L M N O P R S T U V W 
All Classes All Packages