Index
A B C D E F G H I J K L M N O P R S T U V W
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- AbstractOffsetCommitter<K,V> - Class in io.confluent.parallelconsumer.internal
- AbstractOffsetCommitter(ConsumerManager<K, V>, WorkManager<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
- AbstractParallelEoSStreamProcessor<K,V> - Class in io.confluent.parallelconsumer.internal
- AbstractParallelEoSStreamProcessor(ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Construct the AsyncConsumer by wrapping this passed in conusmer and producer, which can be configured any which way as per normal.
- addLoopEndCallBack(Runnable) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Plugin a function to run at the end of each main loop.
- addToMailbox(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- addToMailBoxOnUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- addToMailBoxOnUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
-
With Vertx and Reactor, a function hasn't succeeded until the inner vertx function has also succeeded no op
- addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
- addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.ProcessingShard
- addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- addWorkContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.ShardManager
- assignment() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
B
- BackportUtils - Class in io.confluent.csid.utils
- BackportUtils() - Constructor for class io.confluent.csid.utils.BackportUtils
- batchSize(Integer) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
The maximum number of messages to attempt to pass into the user functions.
- BitSet - io.confluent.parallelconsumer.offsets.OffsetEncoding
- BitSetCompressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
- BitSetEncoder - Class in io.confluent.parallelconsumer.offsets
-
Encodes a range of offsets, from an incompletes collection into a BitSet.
- BitSetEncoder(int, OffsetSimultaneousEncoder) - Constructor for class io.confluent.parallelconsumer.offsets.BitSetEncoder
- BitSetEncoder(int, OffsetSimultaneousEncoder, OffsetEncoding.Version) - Constructor for class io.confluent.parallelconsumer.offsets.BitSetEncoder
- BitSetEncodingNotSupportedException - Exception in io.confluent.parallelconsumer.offsets
- BitSetEncodingNotSupportedException(String) - Constructor for exception io.confluent.parallelconsumer.offsets.BitSetEncodingNotSupportedException
- BitSetV2 - io.confluent.parallelconsumer.offsets.OffsetEncoding
-
switch from encoding bitset length as a short to an integer (length of 32,000 was reasonable too short)
- BitSetV2Compressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
- BrokerPollSystem<K,V> - Class in io.confluent.parallelconsumer.internal
-
Subsystem for polling the broker for messages.
- BrokerPollSystem(ConsumerManager<K, V>, WorkManager<K, V>, AbstractParallelEoSStreamProcessor<K, V>, ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.BrokerPollSystem
- build() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
- build() - Method in class io.confluent.parallelconsumer.RecordContext.RecordContextBuilder
- build(KKEY, Map<KKEY, VVALUE>) - Static method in class io.confluent.csid.utils.LoopingResumingIterator
- builder() - Static method in class io.confluent.parallelconsumer.ParallelConsumerOptions
- builder() - Static method in class io.confluent.parallelconsumer.RecordContext
- ByteArray - io.confluent.parallelconsumer.offsets.OffsetEncoding
- ByteArrayCompressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
- ByteBufferEncoder - Class in io.confluent.parallelconsumer.offsets
- ByteBufferEncoder(int, OffsetSimultaneousEncoder) - Constructor for class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
C
- calculateQuantityToRequest() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- calculateSucceededActualOffsets(long) - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- canEqual(Object) - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
- canEqual(Object) - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
- canEqual(Object) - Method in class io.confluent.parallelconsumer.PollContext
- canEqual(Object) - Method in class io.confluent.parallelconsumer.RecordContext
- canEqual(Object) - Method in class io.confluent.parallelconsumer.state.WorkContainer
- carefullyRun(BiFunction<PARAM_ONE, PARAM_TWO, RESULT>, PARAM_ONE, PARAM_TWO) - Static method in class io.confluent.parallelconsumer.internal.UserFunctions
- carefullyRun(Consumer<PARAM>, PARAM) - Static method in class io.confluent.parallelconsumer.internal.UserFunctions
- carefullyRun(Function<PARAM, RESULT>, PARAM) - Static method in class io.confluent.parallelconsumer.internal.UserFunctions
- CHARSET_TO_USE - Static variable in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
- checkIfWorkIsStale(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
-
Have our partitions been revoked?
- checkIfWorkIsStale(List<WorkContainer<K, V>>) - Method in class io.confluent.parallelconsumer.state.WorkManager
-
Have our partitions been revoked? Can a batch contain messages of different epochs?
- checkPipelinePressure() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Checks the system has enough pressure in the pipeline of work, if not attempts to step up the load factor.
- checkPipelinePressure() - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
- claim() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
- close() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Close the system, without draining.
- close() - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
-
Close the consumer, without draining.
- close(Duration) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
- close(Duration) - Method in class io.confluent.parallelconsumer.internal.ProducerManager
-
Assumes the system is drained at this point, or draining is not desired.
- close(Duration, DrainingCloseable.DrainingMode) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- close(Duration, DrainingCloseable.DrainingMode) - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
-
Close the consumer.
- closeAndWait() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
- closed - io.confluent.parallelconsumer.internal.State
- closeDontDrainFirst() - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
- closeDontDrainFirst(Duration) - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
- closeDrainFirst() - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
- closeDrainFirst(Duration) - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
- closing - io.confluent.parallelconsumer.internal.State
- collectCommitDataForDirtyPartitions() - Method in class io.confluent.parallelconsumer.state.WorkManager
- collectDirtyCommitData() - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- commitAsync(Map<TopicPartition, OffsetAndMetadata>, OffsetCommitCallback) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
- commitMode(ParallelConsumerOptions.CommitMode) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
The
ParallelConsumerOptions.CommitModeto be used - commitOffsets(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
- commitOffsets(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
- commitOffsets(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class io.confluent.parallelconsumer.internal.ProducerManager
- CommitRequest() - Constructor for class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
- CommitResponse(ConsumerOffsetCommitter.CommitRequest) - Constructor for class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
- commitSync(Map<TopicPartition, OffsetAndMetadata>) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
- compareTo(EncodedOffsetPair) - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
- compareTo(WorkContainer) - Method in class io.confluent.parallelconsumer.state.WorkContainer
- COMPRESSION_FORCED_RESOURCE_LOCK - Static variable in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
-
Used to prevent tests running in parallel that depends on setting static state in this class.
- compressionForced - Static variable in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
-
Force the encoder to also add the compressed versions.
- ConsumeProduceResult(PollContext<K, V>, ProducerRecord<KK, VV>, RecordMetadata) - Constructor for class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
- consumer(Consumer<K, V>) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
Required parameter for all use.
- ConsumerManager<K,V> - Class in io.confluent.parallelconsumer.internal
-
Delegate for
KafkaConsumer - ConsumerManager(Consumer<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.ConsumerManager
- consumerMgr - Variable in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
- ConsumerOffsetCommitter<K,V> - Class in io.confluent.parallelconsumer.internal
-
Committer that uses the Kafka Consumer to commit either synchronously or asynchronously
- ConsumerOffsetCommitter(ConsumerManager<K, V>, WorkManager<K, V>, ParallelConsumerOptions) - Constructor for class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
- ConsumerOffsetCommitter.CommitRequest - Class in io.confluent.parallelconsumer.internal
-
Commit request message
- ConsumerOffsetCommitter.CommitResponse - Class in io.confluent.parallelconsumer.internal
-
Commit response message, linked to a
ConsumerOffsetCommitter.CommitRequest - consumerRecord(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.RecordContext.RecordContextBuilder
- ConsumerRecordId - Class in io.confluent.parallelconsumer.state
-
Useful identifier for a
ConsumerRecord. - ConsumerRecordId(TopicPartition, long) - Constructor for class io.confluent.parallelconsumer.state.ConsumerRecordId
- couldBeTakenAsWork(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- couldPerform() - Method in class io.confluent.parallelconsumer.internal.RateLimiter
- count() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
-
The number of records for all topics
- createEosStreamProcessor(ParallelConsumerOptions<KK, VV>) - Static method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
- createJStreamEosStreamProcessor(ParallelConsumerOptions<?, ?>) - Static method in interface io.confluent.parallelconsumer.JStreamParallelStreamProcessor
D
- decode(byte) - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
- DEFAULT_MAX_CONCURRENCY - Static variable in class io.confluent.parallelconsumer.ParallelConsumerOptions
- DEFAULT_TIMEOUT - Static variable in interface io.confluent.parallelconsumer.internal.DrainingCloseable
- DefaultMaxMetadataSize - Static variable in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
-
Maximum size of the commit offset metadata
- defaultMessageRetryDelay(Duration) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
When a message fails, how long the system should wait before trying that message again.
- description() - Method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
- deserialiseIncompleteOffsetMapFromBase64(long, String) - Static method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
- DOCS_ROOT - Static variable in class io.confluent.parallelconsumer.internal.Documentation
- Documentation - Class in io.confluent.parallelconsumer.internal
- Documentation() - Constructor for class io.confluent.parallelconsumer.internal.Documentation
- DONT_DRAIN - io.confluent.parallelconsumer.internal.DrainingCloseable.DrainingMode
-
Stop downloading more messages, and stop procesing more messages in the queue, but finish processing messages already being processed locally.
- drain() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
-
Will begin the shutdown process, eventually closing itself once drained
- DRAIN - io.confluent.parallelconsumer.internal.DrainingCloseable.DrainingMode
-
Stop downloading more messages from the Broker, but finish processing what has already been queued.
- draining - io.confluent.parallelconsumer.internal.State
-
When draining, the system will stop polling for more records, but will attempt to process all already downloaded records.
- DrainingCloseable - Interface in io.confluent.parallelconsumer.internal
- DrainingCloseable.DrainingMode - Enum in io.confluent.parallelconsumer.internal
- dynamicExtraLoadFactor - Variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Multiple of
ParallelConsumerOptions.getMaxConcurrency()to have in our processing queue, in order to make sure threads always have work to do. - DynamicLoadFactor - Class in io.confluent.parallelconsumer.internal
-
Controls a loading factor.
- DynamicLoadFactor() - Constructor for class io.confluent.parallelconsumer.internal.DynamicLoadFactor
E
- encodeCompletedOffset(int) - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
- encodeCompletedOffset(int) - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
- encodeCompletedOffset(int) - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- EncodedOffsetPair - Class in io.confluent.parallelconsumer.offsets
- encodeIncompleteOffset(int) - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
- encodeIncompleteOffset(int) - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
- encodeIncompleteOffset(int) - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- EncodingNotSupportedException - Exception in io.confluent.parallelconsumer.offsets
- EncodingNotSupportedException(String) - Constructor for exception io.confluent.parallelconsumer.offsets.EncodingNotSupportedException
- endFlight() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- EpochAndRecordsMap<K,V> - Class in io.confluent.parallelconsumer.internal
-
For tagging polled records with our epoch
- EpochAndRecordsMap(ConsumerRecords<K, V>, PartitionStateManager<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
- EpochAndRecordsMap.RecordsAndEpoch - Class in io.confluent.parallelconsumer.internal
- equals(Object) - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
- equals(Object) - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
- equals(Object) - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
- equals(Object) - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
- equals(Object) - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
- equals(Object) - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
- equals(Object) - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
- equals(Object) - Method in class io.confluent.parallelconsumer.PollContext
- equals(Object) - Method in class io.confluent.parallelconsumer.RecordContext
- equals(Object) - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
- equals(Object) - Method in class io.confluent.parallelconsumer.state.WorkContainer
- ErrorInUserFunctionException - Exception in io.confluent.parallelconsumer
-
This exception is only used when there is an exception thrown from code provided by the user.
- ErrorInUserFunctionException(String, Throwable) - Constructor for exception io.confluent.parallelconsumer.ErrorInUserFunctionException
- ExternalEngine<K,V> - Class in io.confluent.parallelconsumer.internal
-
Overrides key aspects required in common for other threading engines like Vert.x and Reactor
- ExternalEngine(ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.internal.ExternalEngine
F
- forcedCodec - Static variable in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
-
Forces the use of a specific codec, instead of choosing the most efficient one.
- forEach(Consumer<? super RecordContext<K, V>>) - Method in class io.confluent.parallelconsumer.PollContext
- forEach(Consumer<? super RecordContext<K, V>>) - Method in class io.confluent.parallelconsumer.PollContextInternal
G
- getAllIncompleteOffsets() - Method in class io.confluent.parallelconsumer.state.PartitionState
- getBatchSize() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
The maximum number of messages to attempt to pass into the user functions.
- getBitSet() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
- getByTopicPartitionMap() - Method in class io.confluent.parallelconsumer.PollContext
- getByTopicPartitionMap() - Method in class io.confluent.parallelconsumer.PollContextInternal
- getClock() - Static method in class io.confluent.csid.utils.TimeUtils
- getCommitDataIfDirty() - Method in class io.confluent.parallelconsumer.state.PartitionState
- getCommitMode() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
The
ParallelConsumerOptions.CommitModeto be used - getCommitQueueSize() - Method in class io.confluent.parallelconsumer.state.PartitionState
- getCommitQueueSize() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- getConsumer() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
Required parameter for all use.
- getConsumerRecord() - Method in class io.confluent.parallelconsumer.RecordContext
- getConsumerRecordsFlattened() - Method in class io.confluent.parallelconsumer.PollContext
- getConsumerRecordsFlattened() - Method in class io.confluent.parallelconsumer.PollContextInternal
- getContextsFlattened() - Method in class io.confluent.parallelconsumer.PollContext
- getContextsFlattened() - Method in class io.confluent.parallelconsumer.PollContextInternal
- getCountOfWorkAwaitingSelection() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
- getCountOfWorkTracked() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
- getCountWorkInFlight() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
- getCr() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getCurrentFactor() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
- getData() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
- getDecodedIncompletes(long) - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
- getDecodedString() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
- getDefaultMessageRetryDelay() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
When a message fails, how long the system should wait before trying that message again.
- getDelayUntilRetryDue() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getElapsedDuration() - Method in class io.confluent.parallelconsumer.internal.RateLimiter
- getEncodedBytes() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
- getEncodedBytes() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
- getEncodedBytes() - Method in class io.confluent.parallelconsumer.offsets.OffsetEncoder
- getEncodedBytes() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- getEncodedSize() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
- getEncodedSize() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
- getEncodedSize() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- getEncoding() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
- getEncodingMap() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
-
Map of different encoding types for the same offset data, used for retrieving the data for the encoding type
- getEncodingType() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
- getEncodingType() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
- getEncodingType() - Method in class io.confluent.parallelconsumer.offsets.OffsetEncoder
- getEncodingType() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- getEncodingTypeCompressed() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
- getEncodingTypeCompressed() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
- getEncodingTypeCompressed() - Method in class io.confluent.parallelconsumer.offsets.OffsetEncoder
- getEncodingTypeCompressed() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- getEntries() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
-
Map of offset to WorkUnits.
- getEpoch() - Method in class io.confluent.parallelconsumer.state.WorkContainer
-
Assignment generation this record comes from.
- getEpochOfPartition(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- getEpochOfPartitionAtPoll() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
- getEpochOfPartitionForRecord(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- getFailureCause() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- getFuture() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getHighestSeenOffset() - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
-
The highest represented offset in this result.
- getHighestSeenOffset(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- getId() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
- getIn() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
- getIncompleteOffsets() - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
-
Of the offsets encoded, the incomplete ones.
- getIncompleteOffsets() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
-
The offsets which have not yet been fully completed and can't have their offset committed
- getIncompleteOffsetsBelowHighestSucceeded() - Method in class io.confluent.parallelconsumer.state.PartitionState
- getIncompleteOffsetsBelowHighestSucceeded() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- getIterationStartingPoint() - Method in class io.confluent.csid.utils.LoopingResumingIterator
- getLast(List<T>) - Static method in class io.confluent.csid.utils.JavaUtils
- getLastFailedAt() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getLastFailureAt() - Method in class io.confluent.parallelconsumer.RecordContext
- getLastFailureReason() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getLeft() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
- getLinkHtmlToDocSection(String) - Static method in class io.confluent.parallelconsumer.internal.Documentation
- getLongPollTimeout() - Static method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
-
Note how this relates to
BrokerPollSystem.getLongPollTimeout()- if longPollTimeout is high and loading factor is low, there may not be enough messages queued up to satisfy demand. - getLowestRetryTime() - Method in class io.confluent.parallelconsumer.state.ShardManager
- getLowestRetryTime() - Method in class io.confluent.parallelconsumer.state.WorkManager
- getMagicByte() - Method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
- getManagedExecutorService() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
Path to Managed executor service for Java EE
- getManagedThreadFactory() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
Path to Managed thread factory for Java EE
- getMaxConcurrency() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
Controls the maximum degree of concurrency to occur.
- getMaxFactor() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
-
Upper safety cap on multiples of target queue size to reach (e.g.
- getMaxFailureHistory() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
- getMaybeUserFunctionSucceeded() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getMeta() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
- getMyId() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Optional ID of this instance.
- getNumberOfAssignedPartitions() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- getNumberOfEntriesInPartitionQueues() - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- getNumberOfEntriesInPartitionQueues() - Method in class io.confluent.parallelconsumer.state.WorkManager
- getNumberOfFailedAttempts() - Method in class io.confluent.parallelconsumer.RecordContext
- getNumberOfFailedAttempts() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getNumberOfWorkQueuedInShardsAwaitingSelection() - Method in class io.confluent.parallelconsumer.state.ShardManager
- getNumberOfWorkQueuedInShardsAwaitingSelection() - Method in class io.confluent.parallelconsumer.state.WorkManager
- getNumberRecordsOutForProcessing() - Method in class io.confluent.parallelconsumer.state.WorkManager
- getOffset() - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
- getOffsetCommitTimeout() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
Controls how long to block while waiting for offsets to be committed.
- getOffsetHighestSeen() - Method in class io.confluent.parallelconsumer.state.PartitionState
-
The highest seen offset for a partition.
- getOffsetHighestSeen() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- getOffsetHighestSequentialSucceeded() - Method in class io.confluent.parallelconsumer.state.PartitionState
- getOffsetHighestSucceeded() - Method in class io.confluent.parallelconsumer.state.PartitionState
-
Highest offset which has completed successfully ("succeeded").
- getOffsetHighestSucceeded() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- getOffsets() - Method in class io.confluent.parallelconsumer.PollContext
-
Map of partitions to offsets.
- getOffsets() - Method in class io.confluent.parallelconsumer.PollContextInternal
- getOffsetsFlattened() - Method in class io.confluent.parallelconsumer.PollContext
-
Get all the offsets for the records in this result set.
- getOffsetsFlattened() - Method in class io.confluent.parallelconsumer.PollContextInternal
- getOnlyOne(Map<String, T>) - Static method in class io.confluent.csid.utils.JavaUtils
- getOptions() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- getOptions() - Method in class io.confluent.parallelconsumer.state.ShardManager
- getOptions() - Method in class io.confluent.parallelconsumer.state.WorkManager
- getOrdering() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
The
ParallelConsumerOptions.ProcessingOrdertype to use - getOut() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
- getPartitionState(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- getPm() - Method in class io.confluent.parallelconsumer.state.WorkManager
- getPollContext() - Method in class io.confluent.parallelconsumer.PollContextInternal
- getProducer() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
Supplying a producer is only needed if using the produce flows.
- getProducerManager() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- getQueueTargetLoaded() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- getRate() - Method in class io.confluent.parallelconsumer.internal.RateLimiter
- getRecordContext() - Method in class io.confluent.parallelconsumer.RecordContextInternal
- getRecordId() - Method in class io.confluent.parallelconsumer.RecordContext
-
A useful ID class for consumer records.
- getRecordMap() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
- getRecords() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
- getRequest() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
- getRequestedAtMs() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
- getRetryDelayConfig() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getRetryDelayProvider() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
When present, use this to generate the retry delay, instead of
ParallelConsumerOptions.getDefaultMessageRetryDelay(). - getRight() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
- getRunLengthEncodingIntegers() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- getSendTimeout() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
Controls how long to block while waiting for the
Producer.send(org.apache.kafka.clients.producer.ProducerRecord<K, V>)to complete for any ProducerRecords returned from the user-function. - getSingleConsumerRecord() - Method in class io.confluent.parallelconsumer.PollContext
-
Must not be using batching (
ParallelConsumerOptions.batchSize). - getSingleConsumerRecord() - Method in class io.confluent.parallelconsumer.PollContextInternal
- getSingleRecord() - Method in class io.confluent.parallelconsumer.PollContext
-
Must not be using batching (
ParallelConsumerOptions.batchSize). - getSingleRecord() - Method in class io.confluent.parallelconsumer.PollContextInternal
- getSingleton() - Static method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- getSm() - Method in class io.confluent.parallelconsumer.state.WorkManager
- getSortedEncodings() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
-
Ordered set of the different encodings, used to quickly retrieve the most compressed encoding
- getSucceededAt() - Method in class io.confluent.parallelconsumer.RecordContext
- getSucceededAt() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getSuccessfulWorkListeners() - Method in class io.confluent.parallelconsumer.state.WorkManager
-
Useful for testing
- getTargetAmountOfRecordsInFlight() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
- getTargetOutForProcessing() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- getTargetOutForProcessing() - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
- getThresholdForTimeSpendInQueueWarning() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
-
Configure the amount of delay a record experiences, before a warning is logged.
- getTimeBetweenCommits() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Time between commits.
- getTimeInFlight() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getTopicPartition() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- getTp() - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
- getTp() - Method in class io.confluent.parallelconsumer.state.PartitionState
- getTp() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- getUSED_PAYLOAD_THRESHOLD_MULTIPLIER() - Static method in class io.confluent.parallelconsumer.state.PartitionStateManager
-
Best efforts attempt to prevent usage of offset payload beyond X% - as encoding size test is currently only done per batch, we need to leave some buffer for the required space to overrun before hitting the hard limit where we have to drop the offset payload entirely.
- getWm() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- getWorkContainer() - Method in class io.confluent.parallelconsumer.RecordContext
- getWorkContainer() - Method in class io.confluent.parallelconsumer.RecordContextInternal
- getWorkContainers() - Method in class io.confluent.parallelconsumer.PollContextInternal
- getWorkForOffset(long) - Method in class io.confluent.parallelconsumer.state.ProcessingShard
- getWorkIfAvailable() - Method in class io.confluent.parallelconsumer.state.WorkManager
-
Get work with no limit on quantity, useful for testing.
- getWorkIfAvailable(int) - Method in class io.confluent.parallelconsumer.state.ShardManager
- getWorkIfAvailable(int) - Method in class io.confluent.parallelconsumer.state.WorkManager
-
Depth first work retrieval.
- getWorkMailBox() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Collection of work waiting to be
- getWorkType() - Method in class io.confluent.parallelconsumer.state.WorkContainer
-
Simple way to differentiate treatment based on type
- groupMetadata() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
H
- handleFutureResult(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
- hasDelayPassed() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- hashCode() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
- hashCode() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
- hashCode() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
- hashCode() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
- hashCode() - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
- hashCode() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
- hashCode() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
- hashCode() - Method in class io.confluent.parallelconsumer.PollContext
- hashCode() - Method in class io.confluent.parallelconsumer.RecordContext
- hashCode() - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
- hashCode() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- hasNext() - Method in class io.confluent.csid.utils.LoopingResumingIterator
- hasPreviouslyFailed() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- hasWorkInCommitQueue() - Method in class io.confluent.parallelconsumer.state.PartitionState
- hasWorkInCommitQueue() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- hasWorkInCommitQueues() - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- hasWorkInCommitQueues() - Method in class io.confluent.parallelconsumer.state.WorkManager
- hasWorkInFlight() - Method in class io.confluent.parallelconsumer.state.WorkManager
- headers() - Method in class io.confluent.parallelconsumer.RecordContext
- HighestOffsetAndIncompletes(Optional<Long>, Set<Long>) - Constructor for class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
I
- InternalRuntimeError - Exception in io.confluent.parallelconsumer.internal
- InternalRuntimeError(String) - Constructor for exception io.confluent.parallelconsumer.internal.InternalRuntimeError
- InternalRuntimeError(String, Throwable) - Constructor for exception io.confluent.parallelconsumer.internal.InternalRuntimeError
- InternalRuntimeError(String, Throwable, boolean, boolean) - Constructor for exception io.confluent.parallelconsumer.internal.InternalRuntimeError
- InternalRuntimeError(Throwable) - Constructor for exception io.confluent.parallelconsumer.internal.InternalRuntimeError
- invoke() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
-
Highwater mark already encoded in string -
OffsetMapCodecManager.makeOffsetMetadataPayload(long, io.confluent.parallelconsumer.state.PartitionState<K, V>)- so encoding BitSet run length may not be needed, or could be swapped - io.confluent.csid.utils - package io.confluent.csid.utils
- io.confluent.parallelconsumer - package io.confluent.parallelconsumer
- io.confluent.parallelconsumer.internal - package io.confluent.parallelconsumer.internal
- io.confluent.parallelconsumer.offsets - package io.confluent.parallelconsumer.offsets
- io.confluent.parallelconsumer.state - package io.confluent.parallelconsumer.state
- isAllowedMoreRecords(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- isAllowedMoreRecords(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
-
Check we have capacity in offset storage to process more messages
- isAsyncFutureWork(List<?>) - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
-
System dependent way for the core engine to know if an external scheduler needs to be relied on for completion, as opposed to the internal threading system in the core module.
- isAvailableToTakeAsWork() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- isBlank(String) - Static method in class io.confluent.csid.utils.StringUtils
- isBlocked() - Method in class io.confluent.parallelconsumer.state.PartitionState
-
Convenience method for readability
- isBlocked(TopicPartition) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
-
Checks if partition is blocked with back pressure.
- isClosedOrFailed() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- isEmpty() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
- isEmpty(Optional<?>) - Static method in class io.confluent.csid.utils.BackportUtils
- isGreaterThan(Duration, Duration) - Static method in class io.confluent.csid.utils.JavaUtils
- isInFlight() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- isMaxReached() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
- isNoRecordsOutForProcessing() - Method in class io.confluent.parallelconsumer.state.WorkManager
- isNotInFlight() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- isPartitionRemovedOrNeverAssigned(ConsumerRecord<?, ?>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- isPaused() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
- isProducerSupplied() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
- isRecordPreviouslyCompleted(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
- isRecordPreviouslyCompleted(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- isRecordPreviouslyCompleted(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- isRecordsAwaitingProcessing() - Method in class io.confluent.parallelconsumer.state.WorkManager
- isRecordsAwaitingToBeCommitted() - Method in class io.confluent.parallelconsumer.state.WorkManager
- isRemoved() - Method in class io.confluent.parallelconsumer.state.PartitionState
-
Has this partition been removed? No.
- isRemoved() - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- isSufficientlyLoaded() - Method in class io.confluent.parallelconsumer.state.WorkManager
- isSync() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
- isTransactionInProgress() - Method in class io.confluent.parallelconsumer.internal.ProducerManager
- isUserFunctionComplete() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- isUserFunctionSucceeded() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- isUsingBatching() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
- isUsingTransactionalProducer() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
- isWarmUpPeriodOver() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
-
Is the warm-up period over?
- isWorkInFlightMeetingTarget() - Method in class io.confluent.parallelconsumer.state.WorkManager
- iterator() - Method in class io.confluent.csid.utils.LoopingResumingIterator
- iterator() - Method in class io.confluent.csid.utils.Range
- iterator() - Method in class io.confluent.parallelconsumer.PollContext
- iterator() - Method in class io.confluent.parallelconsumer.PollContextInternal
J
- Java8StreamUtils - Class in io.confluent.csid.utils
- JavaUtils - Class in io.confluent.csid.utils
- JStreamParallelEoSStreamProcessor<K,V> - Class in io.confluent.parallelconsumer
- JStreamParallelEoSStreamProcessor(ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.JStreamParallelEoSStreamProcessor
- JStreamParallelStreamProcessor<K,V> - Interface in io.confluent.parallelconsumer
K
- KAFKA_OFFSET_ABSENCE - Static variable in class io.confluent.parallelconsumer.state.PartitionState
-
Symbolic value for a parameter which is initialised as having an offset absent (instead of using Optional or null)
- KafkaUtils - Class in io.confluent.csid.utils
-
Simple identifier tuple for Topic Partitions
- KafkaUtils() - Constructor for class io.confluent.csid.utils.KafkaUtils
- key() - Method in class io.confluent.parallelconsumer.PollContext
-
For backwards compatibility with
ConsumerRecord.key(). - key() - Method in class io.confluent.parallelconsumer.PollContextInternal
- key() - Method in class io.confluent.parallelconsumer.RecordContext
- KEY - io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
-
Process messages in key order.
L
- LARGE_INPUT_MAP_SIZE_THRESHOLD - Static variable in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
-
Size threshold in bytes after which compressing the encodings will be compared, as it seems to be typically worth the extra compression step when beyond this size in the source array.
- leaderEpoch() - Method in class io.confluent.parallelconsumer.RecordContext
- list() - Method in class io.confluent.csid.utils.Range
- loadPartitionStateForAssignment(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
-
Load all the previously completed offsets that were not committed
- LoopingResumingIterator<KEY,VALUE> - Class in io.confluent.csid.utils
-
Loop implementations that will resume from a given key.
- LoopingResumingIterator(Map<KEY, VALUE>) - Constructor for class io.confluent.csid.utils.LoopingResumingIterator
- LoopingResumingIterator(Optional<KEY>, Map<KEY, VALUE>) - Constructor for class io.confluent.csid.utils.LoopingResumingIterator
-
Will resume from the startingKey, if it's present
M
- magicByte - Variable in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
- makeOffsetMetadataPayload(long, PartitionState<K, V>) - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
- managedExecutorService(String) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
Path to Managed executor service for Java EE
- managedThreadFactory(String) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
Path to Managed thread factory for Java EE
- max(Duration, Duration) - Static method in class io.confluent.csid.utils.JavaUtils
- MAX_LENGTH_ENCODABLE - Static variable in class io.confluent.parallelconsumer.offsets.BitSetEncoder
- maxConcurrency(int) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
Controls the maximum degree of concurrency to occur.
- maxFailureHistory(int) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
- maybeStepUp() - Method in class io.confluent.parallelconsumer.internal.DynamicLoadFactor
-
Try to increase the loading factor
- MDC_INSTANCE_ID - Static variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- MDC_OFFSET_MARKER - Static variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- METADATA_DATA_SIZE_RESOURCE_LOCK - Static variable in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
-
Used to prevent tests running in parallel that depends on setting static state in this class.
- msg(String, Object...) - Static method in class io.confluent.csid.utils.StringUtils
- MSG - Static variable in class io.confluent.parallelconsumer.internal.UserFunctions
N
- next() - Method in class io.confluent.csid.utils.LoopingResumingIterator
- NO_OP - Static variable in class io.confluent.parallelconsumer.state.RemovedPartitionState
- NoEncodingPossibleException - Exception in io.confluent.parallelconsumer.offsets
- NoEncodingPossibleException(String) - Constructor for exception io.confluent.parallelconsumer.offsets.NoEncodingPossibleException
- notifySomethingToDo() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Early notify of work arrived.
O
- of() - Static method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
- of(long) - Static method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
- of(long, Set<Long>) - Static method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
- offset() - Method in class io.confluent.parallelconsumer.PollContext
-
For backwards compatibility with
ConsumerRecord.offset(). - offset() - Method in class io.confluent.parallelconsumer.PollContextInternal
- offset() - Method in class io.confluent.parallelconsumer.RecordContext
- offset() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- OffsetBitSet - Class in io.confluent.parallelconsumer.offsets
-
Deserialisation tools for
BitSetEncoder. - OffsetBitSet() - Constructor for class io.confluent.parallelconsumer.offsets.OffsetBitSet
- OffsetCommitter - Interface in io.confluent.parallelconsumer.internal
- offsetCommitTimeout(Duration) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
Controls how long to block while waiting for offsets to be committed.
- OffsetDecodingError - Exception in io.confluent.parallelconsumer.offsets
- OffsetDecodingError(String, IllegalArgumentException) - Constructor for exception io.confluent.parallelconsumer.offsets.OffsetDecodingError
- OffsetEncoder - Class in io.confluent.parallelconsumer.offsets
-
Base OffsetEncoder
- OffsetEncoder(OffsetSimultaneousEncoder) - Constructor for class io.confluent.parallelconsumer.offsets.OffsetEncoder
- OffsetEncoding - Enum in io.confluent.parallelconsumer.offsets
- OffsetEncoding.Version - Enum in io.confluent.parallelconsumer.offsets
- OffsetMapCodecManager<K,V> - Class in io.confluent.parallelconsumer.offsets
-
Uses multiple encodings to compare, when decided, can refactor other options out for analysis only -
OffsetMapCodecManager.encodeOffsetsCompressed(long, io.confluent.parallelconsumer.state.PartitionState<K, V>) - OffsetMapCodecManager(Consumer<K, V>) - Constructor for class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager
- OffsetMapCodecManager.HighestOffsetAndIncompletes - Class in io.confluent.parallelconsumer.offsets
-
Decoding result for encoded offsets
- OffsetRunLength - Class in io.confluent.parallelconsumer.offsets
- OffsetSimpleSerialisation - Class in io.confluent.parallelconsumer.offsets
- OffsetSimultaneousEncoder - Class in io.confluent.parallelconsumer.offsets
-
Encode with multiple strategies at the same time.
- OffsetSimultaneousEncoder(long, long, Set<Long>) - Constructor for class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
- onCommitRequested() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
- onFailure(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.ShardManager
-
Idempotent - work may have not been removed, either way it's put back
- onFailure(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
- onFailure(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- onFailureResult(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
- onOffsetCommitSuccess(Map<TopicPartition, OffsetAndMetadata>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
-
Truncate our tracked offsets as a commit was successful, so the low water mark rises, and we dont' need to track as much anymore.
- onOffsetCommitSuccess(Map<TopicPartition, OffsetAndMetadata>) - Method in class io.confluent.parallelconsumer.state.WorkManager
-
Can run from controller or poller thread, depending on which is responsible for committing
- onOffsetCommitSuccess(OffsetAndMetadata) - Method in class io.confluent.parallelconsumer.state.PartitionState
- onPartitionsAssigned(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Delegate to
WorkManager - onPartitionsAssigned(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
-
Load offset map for assigned assignedPartitions
- onPartitionsAssigned(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.WorkManager
-
Load offset map for assigned partitions
- onPartitionsLost(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Delegate to
WorkManager - onPartitionsLost(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
-
Clear offset map for lost partitions
- onPartitionsLost(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.WorkManager
-
Clear offset map for lost partitions
- onPartitionsRemoved(ShardManager<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
- onPartitionsRevoked(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Commit our offsets
- onPartitionsRevoked(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
-
Clear offset map for revoked partitions
- onPartitionsRevoked(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.state.WorkManager
-
Clear offset map for revoked partitions
- onQueueingForExecution() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- onSuccess(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.ProcessingShard
- onSuccess(WorkContainer<?, ?>) - Method in class io.confluent.parallelconsumer.state.ShardManager
- onSuccess(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionState
- onSuccess(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.PartitionStateManager
- onSuccess(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.RemovedPartitionState
- onSuccessResult(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
- onUserFunctionFailure(Throwable) - Method in class io.confluent.parallelconsumer.state.WorkContainer
- onUserFunctionSuccess() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- onUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- onUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
-
With Vertx and Reactor, a function hasn't succeeded until the inner vertx function has also succeeded logging
- options - Variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- ordering(ParallelConsumerOptions.ProcessingOrder) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
The
ParallelConsumerOptions.ProcessingOrdertype to use
P
- packSmallest() - Method in class io.confluent.parallelconsumer.offsets.OffsetSimultaneousEncoder
-
Select the smallest encoding, and pack it.
- pairOf(LL, RR) - Static method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
- ParallelConsumer<K,V> - Interface in io.confluent.parallelconsumer
-
Asynchronous / concurrent message consumer for Kafka.
- ParallelConsumer.Tuple<L,R> - Class in io.confluent.parallelconsumer
-
A simple tuple structure.
- ParallelConsumerException - Exception in io.confluent.parallelconsumer
-
Generic Parallel Consumer
RuntimeExceptionparent. - ParallelConsumerException(String, Throwable) - Constructor for exception io.confluent.parallelconsumer.ParallelConsumerException
- ParallelConsumerInternalException - Exception in io.confluent.parallelconsumer.internal
-
Generic Parallel Consumer parent exception.
- ParallelConsumerInternalException(String) - Constructor for exception io.confluent.parallelconsumer.internal.ParallelConsumerInternalException
- ParallelConsumerOptions<K,V> - Class in io.confluent.parallelconsumer
-
The options for the
AbstractParallelEoSStreamProcessorsystem. - ParallelConsumerOptions.CommitMode - Enum in io.confluent.parallelconsumer
-
The type of commit to be made, with either a transactions configured Producer where messages produced are committed back to the Broker along with the offsets they originated from, or with the faster simpler Consumer offset system either synchronously or asynchronously
- ParallelConsumerOptions.ParallelConsumerOptionsBuilder<K,V> - Class in io.confluent.parallelconsumer
- ParallelConsumerOptions.ProcessingOrder - Enum in io.confluent.parallelconsumer
-
The ordering guarantee to use.
- ParallelEoSStreamProcessor<K,V> - Class in io.confluent.parallelconsumer
- ParallelEoSStreamProcessor(ParallelConsumerOptions<K, V>) - Constructor for class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
-
Construct the AsyncConsumer by wrapping this passed in conusmer and producer, which can be configured any which way as per normal.
- ParallelStreamProcessor<K,V> - Interface in io.confluent.parallelconsumer
-
Parallel message consumer which also can optionally produce 0 or many
ProducerRecordresults to be published back to Kafka. - ParallelStreamProcessor.ConsumeProduceResult<K,V,KK,VV> - Class in io.confluent.parallelconsumer
-
A simple triple structure to capture the set of coinciding data.
- partition() - Method in class io.confluent.parallelconsumer.RecordContext
- PARTITION - io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
-
Process messages within a partition in order, but process multiple partitions in parallel.
- partitions() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
-
Get the partitions which have records contained in this record set.
- PartitionState<K,V> - Class in io.confluent.parallelconsumer.state
- PartitionState(TopicPartition, OffsetMapCodecManager.HighestOffsetAndIncompletes) - Constructor for class io.confluent.parallelconsumer.state.PartitionState
- PartitionStateManager<K,V> - Class in io.confluent.parallelconsumer.state
-
In charge of managing
PartitionStates. - PartitionStateManager(Consumer<K, V>, ShardManager<K, V>, ParallelConsumerOptions<K, V>, Clock) - Constructor for class io.confluent.parallelconsumer.state.PartitionStateManager
- pause(Set<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
- paused() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
- performIfNotLimited(Runnable) - Method in class io.confluent.parallelconsumer.internal.RateLimiter
- PERIODIC_CONSUMER_ASYNCHRONOUS - io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
-
Periodically commits offsets asynchronously.
- PERIODIC_CONSUMER_SYNC - io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
-
Periodically synchronous commits with the Consumer.
- PERIODIC_TRANSACTIONAL_PRODUCER - io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
-
Periodically commits through the Producer using transactions.
- poll(Consumer<PollContext<K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
- poll(Consumer<PollContext<K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
-
Register a function to be applied in parallel to each received message
- pollAndProduce(Function<PollContext<K, V>, ProducerRecord<K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
- pollAndProduce(Function<PollContext<K, V>, ProducerRecord<K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
-
Register a function to be applied in parallel to each received message, which in turn returns a
ProducerRecordto be sent back to the broker. - pollAndProduce(Function<PollContext<K, V>, ProducerRecord<K, V>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
- pollAndProduce(Function<PollContext<K, V>, ProducerRecord<K, V>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
-
Register a function to be applied in parallel to each received message, which in turn returns a
ProducerRecordto be sent back to the broker. - pollAndProduceMany(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
- pollAndProduceMany(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
-
Register a function to be applied in parallel to each received message, which in turn returns one or many
ProducerRecords to be sent back to the broker. - pollAndProduceMany(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
- pollAndProduceMany(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
-
Register a function to be applied in parallel to each received message, which in turn returns one or more
ProducerRecords to be sent back to the broker. - PollContext<K,V> - Class in io.confluent.parallelconsumer
-
Context object used to pass messages to process to users processing functions.
- PollContext() - Constructor for class io.confluent.parallelconsumer.PollContext
- PollContextInternal<K,V> - Class in io.confluent.parallelconsumer
-
Internal only view on the
PollContext. - PollContextInternal(List<WorkContainer<K, V>>) - Constructor for class io.confluent.parallelconsumer.PollContextInternal
- pollProduceAndStream(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>) - Method in class io.confluent.parallelconsumer.JStreamParallelEoSStreamProcessor
- pollProduceAndStream(Function<PollContext<K, V>, List<ProducerRecord<K, V>>>) - Method in interface io.confluent.parallelconsumer.JStreamParallelStreamProcessor
-
Like
AbstractParallelEoSStreamProcessor#pollAndProduceManybut instead of callbacks, streams the results instead, after the produce result is ack'd by Kafka. - postCommit() - Method in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
- postCommit() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter
- postCommit() - Method in class io.confluent.parallelconsumer.internal.ProducerManager
- preAcquireWork() - Method in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
- preAcquireWork() - Method in class io.confluent.parallelconsumer.internal.ProducerManager
- ProcessingShard<K,V> - Class in io.confluent.parallelconsumer.state
-
Models the queue of work to be processed, based on the
ParallelConsumerOptions.ProcessingOrdermodes. - ProcessingShard(Object, ParallelConsumerOptions<?, ?>, PartitionStateManager<K, V>) - Constructor for class io.confluent.parallelconsumer.state.ProcessingShard
- produceMessage(ProducerRecord<K, V>) - Method in class io.confluent.parallelconsumer.internal.ProducerManager
-
Produce a message back to the broker.
- producer - Variable in class io.confluent.parallelconsumer.internal.ProducerManager
- producer(Producer<K, V>) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
Supplying a producer is only needed if using the produce flows.
- ProducerManager<K,V> - Class in io.confluent.parallelconsumer.internal
- ProducerManager(Producer<K, V>, ConsumerManager<K, V>, WorkManager<K, V>, ParallelConsumerOptions) - Constructor for class io.confluent.parallelconsumer.internal.ProducerManager
R
- range(long) - Static method in class io.confluent.csid.utils.Range
-
Exclusive of max
- Range - Class in io.confluent.csid.utils
-
https://stackoverflow.com/a/16570509/105741
- Range(long) - Constructor for class io.confluent.csid.utils.Range
- RateLimiter - Class in io.confluent.parallelconsumer.internal
- RateLimiter() - Constructor for class io.confluent.parallelconsumer.internal.RateLimiter
- RateLimiter(int) - Constructor for class io.confluent.parallelconsumer.internal.RateLimiter
- readDataArrayForDebug() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
-
Copies array out of the ByteBuffer
- readFully(InputStream) - Static method in class io.confluent.csid.utils.BackportUtils
- readFully(InputStream, int, boolean) - Static method in class io.confluent.csid.utils.BackportUtils
-
Used in Java 8 environments (Java 9 has read all bytes)
- RecordContext<K,V> - Class in io.confluent.parallelconsumer
-
Context information for the wrapped
ConsumerRecord. - RecordContext(WorkContainer<K, V>) - Constructor for class io.confluent.parallelconsumer.RecordContext
- RecordContext(WorkContainer<K, V>, ConsumerRecord<K, V>) - Constructor for class io.confluent.parallelconsumer.RecordContext
- RecordContext.RecordContextBuilder<K,V> - Class in io.confluent.parallelconsumer
- RecordContextInternal<K,V> - Class in io.confluent.parallelconsumer
-
Internal only view of the
RecordContextclass. - RecordContextInternal(WorkContainer<K, V>) - Constructor for class io.confluent.parallelconsumer.RecordContextInternal
- records - Variable in class io.confluent.parallelconsumer.PollContext
- records(TopicPartition) - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
-
Get just the records for the given partition
- RecordsAndEpoch(Long, List<ConsumerRecord<K, V>>) - Constructor for class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
- registerWork(EpochAndRecordsMap<K, V>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- registerWork(EpochAndRecordsMap<K, V>) - Method in class io.confluent.parallelconsumer.state.WorkManager
- remap(Map<K, V1>, Function<? super V1, ? extends V2>) - Static method in class io.confluent.csid.utils.JavaUtils
-
A shortcut for changing only the values of a Map.
- remove(long) - Method in class io.confluent.parallelconsumer.state.ProcessingShard
- RemovedPartitionState<K,V> - Class in io.confluent.parallelconsumer.state
-
No op version of
PartitionStateused for when partition assignments are removed, to avoid managing null references orOptionals. - RemovedPartitionState() - Constructor for class io.confluent.parallelconsumer.state.RemovedPartitionState
- requestCommitAsap() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Request a commit as soon as possible (ASAP), overriding other constraints.
- resume(Set<TopicPartition>) - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
- retrieveOffsetsAndCommit() - Method in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
-
Get offsets from
WorkManagerthat are ready to commit - retrieveOffsetsAndCommit() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
-
Optionally blocks.
- retrieveOffsetsAndCommit() - Method in interface io.confluent.parallelconsumer.internal.OffsetCommitter
- retryDelayProvider(Function<RecordContext<K, V>, Duration>) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
When present, use this to generate the retry delay, instead of
ParallelConsumerOptions.getDefaultMessageRetryDelay(). - RunLength - io.confluent.parallelconsumer.offsets.OffsetEncoding
- RunLengthCompressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
- RunLengthEncoder - Class in io.confluent.parallelconsumer.offsets
-
RunLength encoder that leverages the nature of this system.
- RunLengthEncoder(OffsetSimultaneousEncoder, OffsetEncoding.Version) - Constructor for class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- RunlengthV1EncodingNotSupported - Exception in io.confluent.parallelconsumer.offsets
- RunlengthV1EncodingNotSupported(String) - Constructor for exception io.confluent.parallelconsumer.offsets.RunlengthV1EncodingNotSupported
- RunLengthV2 - io.confluent.parallelconsumer.offsets.OffsetEncoding
-
switch from encoding run lengths as Shorts to Integers
- RunLengthV2Compressed - io.confluent.parallelconsumer.offsets.OffsetEncoding
- running - io.confluent.parallelconsumer.internal.State
- runUserFunction(Function<PollContextInternal<K, V>, List<R>>, Consumer<R>, List<WorkContainer<K, V>>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Run the supplied function.
S
- sendTimeout(Duration) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
Controls how long to block while waiting for the
Producer.send(org.apache.kafka.clients.producer.ProducerRecord<K, V>)to complete for any ProducerRecords returned from the user-function. - serialise() - Method in class io.confluent.parallelconsumer.offsets.BitSetEncoder
- serialise() - Method in class io.confluent.parallelconsumer.offsets.ByteBufferEncoder
- serialise() - Method in class io.confluent.parallelconsumer.offsets.RunLengthEncoder
- serializedKeySize() - Method in class io.confluent.parallelconsumer.RecordContext
- serializedValueSize() - Method in class io.confluent.parallelconsumer.RecordContext
- setDefaultRetryDelay(Duration) - Static method in class io.confluent.parallelconsumer.state.WorkContainer
- setFuture(Future<List<?>>) - Method in class io.confluent.parallelconsumer.state.WorkContainer
- setLongPollTimeout(Duration) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- setLongPollTimeout(Duration) - Static method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
-
Note how this relates to
BrokerPollSystem.getLongPollTimeout()- if longPollTimeout is high and loading factor is low, there may not be enough messages queued up to satisfy demand. - setMyId(Optional<String>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Optional ID of this instance.
- setTimeBetweenCommits(Duration) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Time between commits.
- setupStreamFromDeque(ConcurrentLinkedDeque<T>) - Static method in class io.confluent.csid.utils.Java8StreamUtils
- setupWorkerPool(int) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- setupWorkerPool(int) - Method in class io.confluent.parallelconsumer.internal.ExternalEngine
-
The vert.x module doesn't use any thread pool for dispatching work, as the work is all done by the vert.x engine.
- setUSED_PAYLOAD_THRESHOLD_MULTIPLIER(double) - Static method in class io.confluent.parallelconsumer.state.PartitionStateManager
-
Best efforts attempt to prevent usage of offset payload beyond X% - as encoding size test is currently only done per batch, we need to leave some buffer for the required space to overrun before hitting the hard limit where we have to drop the offset payload entirely.
- setWorkType(String) - Method in class io.confluent.parallelconsumer.state.WorkContainer
-
Simple way to differentiate treatment based on type
- ShardManager<K,V> - Class in io.confluent.parallelconsumer.state
-
Shards are local queues of work to be processed.
- ShardManager(ParallelConsumerOptions, WorkManager<K, V>, Clock) - Constructor for class io.confluent.parallelconsumer.state.ShardManager
- shouldThrottle() - Method in class io.confluent.parallelconsumer.state.WorkManager
- size() - Method in class io.confluent.parallelconsumer.PollContext
- size() - Method in class io.confluent.parallelconsumer.PollContextInternal
- SIZE_COMPARATOR - Static variable in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
- spliterator() - Method in class io.confluent.parallelconsumer.PollContext
- spliterator() - Method in class io.confluent.parallelconsumer.PollContextInternal
- start(String) - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
- State - Enum in io.confluent.parallelconsumer.internal
-
The run state of the controller.
- stream() - Method in class io.confluent.parallelconsumer.PollContext
- stream() - Method in class io.confluent.parallelconsumer.PollContextInternal
- streamConsumerRecords() - Method in class io.confluent.parallelconsumer.PollContext
- streamConsumerRecords() - Method in class io.confluent.parallelconsumer.PollContextInternal
- streamInternal() - Method in class io.confluent.parallelconsumer.PollContext
- streamInternal() - Method in class io.confluent.parallelconsumer.PollContextInternal
- streamWorkContainers() - Method in class io.confluent.parallelconsumer.PollContextInternal
- StringUtils - Class in io.confluent.csid.utils
- StringUtils() - Constructor for class io.confluent.csid.utils.StringUtils
- submitWorkToPool(Function<PollContextInternal<K, V>, List<R>>, Consumer<R>, List<WorkContainer<K, V>>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Submit a piece of work to the processing pool.
- subscribe(Collection<String>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- subscribe(Collection<String>) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
- subscribe(Collection<String>, ConsumerRebalanceListener) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- subscribe(Collection<String>, ConsumerRebalanceListener) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
- subscribe(Pattern) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- subscribe(Pattern) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
- subscribe(Pattern, ConsumerRebalanceListener) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- subscribe(Pattern, ConsumerRebalanceListener) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
- supervise() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
- supervisorLoop(Function<PollContextInternal<K, V>, List<R>>, Consumer<R>) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Supervisor loop for the main loop.
T
- thresholdForTimeSpendInQueueWarning(Duration) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
-
Configure the amount of delay a record experiences, before a warning is logged.
- time(Callable<RESULT>) - Static method in class io.confluent.csid.utils.TimeUtils
- timestamp() - Method in class io.confluent.parallelconsumer.RecordContext
- timestampType() - Method in class io.confluent.parallelconsumer.RecordContext
- TimeUtils - Class in io.confluent.csid.utils
- toBuilder() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
- toBuilder() - Method in class io.confluent.parallelconsumer.RecordContext
- topic() - Method in class io.confluent.parallelconsumer.RecordContext
- toSeconds(Duration) - Static method in class io.confluent.csid.utils.BackportUtils
- toStream() - Method in class io.confluent.csid.utils.Range
- toString() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitRequest
- toString() - Method in class io.confluent.parallelconsumer.internal.ConsumerOffsetCommitter.CommitResponse
- toString() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap.RecordsAndEpoch
- toString() - Method in class io.confluent.parallelconsumer.internal.EpochAndRecordsMap
- toString() - Method in class io.confluent.parallelconsumer.offsets.EncodedOffsetPair
-
Used for printing out the comparative map of each encoder
- toString() - Method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
- toString() - Method in class io.confluent.parallelconsumer.offsets.OffsetMapCodecManager.HighestOffsetAndIncompletes
- toString() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
- toString() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
- toString() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
- toString() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
- toString() - Method in class io.confluent.parallelconsumer.PollContext
- toString() - Method in class io.confluent.parallelconsumer.RecordContext.RecordContextBuilder
- toString() - Method in class io.confluent.parallelconsumer.RecordContext
- toString() - Method in class io.confluent.parallelconsumer.state.ConsumerRecordId
- toString() - Method in class io.confluent.parallelconsumer.state.PartitionState
- toString() - Method in class io.confluent.parallelconsumer.state.WorkContainer
- toTopicPartition(ConsumerRecord<?, ?>) - Static method in class io.confluent.csid.utils.KafkaUtils
- Tuple(L, R) - Constructor for class io.confluent.parallelconsumer.ParallelConsumer.Tuple
U
- UNORDERED - io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
-
No ordering is guaranteed, not even partition order.
- unused - io.confluent.parallelconsumer.internal.State
- USED_PAYLOAD_THRESHOLD_MULTIPLIER_DEFAULT - Static variable in class io.confluent.parallelconsumer.state.PartitionStateManager
- UserFunctions - Class in io.confluent.parallelconsumer.internal
-
Single entry point for wrapping the actual execution of user functions
V
- v1 - io.confluent.parallelconsumer.offsets.OffsetEncoding.Version
- v2 - io.confluent.parallelconsumer.offsets.OffsetEncoding.Version
- validate() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
- value() - Method in class io.confluent.parallelconsumer.PollContext
-
For backwards compatibility with
ConsumerRecord.value(). - value() - Method in class io.confluent.parallelconsumer.PollContextInternal
- value() - Method in class io.confluent.parallelconsumer.RecordContext
- valueOf(String) - Static method in enum io.confluent.parallelconsumer.internal.DrainingCloseable.DrainingMode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum io.confluent.parallelconsumer.internal.State
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding.Version
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum io.confluent.parallelconsumer.internal.DrainingCloseable.DrainingMode
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum io.confluent.parallelconsumer.internal.State
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum io.confluent.parallelconsumer.offsets.OffsetEncoding.Version
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder
-
Returns an array containing the constants of this enum type, in the order they are declared.
- version - Variable in enum io.confluent.parallelconsumer.offsets.OffsetEncoding
W
- waitForProcessedNotCommitted(Duration) - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
Deprecated.no longer used, will be removed in next version
- wakeup() - Method in class io.confluent.parallelconsumer.internal.ConsumerManager
-
Wakes up the consumer, but only if it's polling.
- wakeupIfPaused() - Method in class io.confluent.parallelconsumer.internal.BrokerPollSystem
-
Wakeup if colling the broker
- wm - Variable in class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter
- wm - Variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- workContainer - Variable in class io.confluent.parallelconsumer.RecordContext
- workContainer(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.RecordContext.RecordContextBuilder
- WorkContainer<K,V> - Class in io.confluent.parallelconsumer.state
- WorkContainer(long, ConsumerRecord<K, V>, Function<RecordContext<K, V>, Duration>, String, Clock) - Constructor for class io.confluent.parallelconsumer.state.WorkContainer
- WorkContainer(long, ConsumerRecord<K, V>, Function<RecordContext<K, V>, Duration>, Clock) - Constructor for class io.confluent.parallelconsumer.state.WorkContainer
- workerThreadPool - Variable in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
-
The pool which is used for running the users's supplied function
- workIsWaitingToBeProcessed() - Method in class io.confluent.parallelconsumer.state.ProcessingShard
- workIsWaitingToBeProcessed() - Method in class io.confluent.parallelconsumer.state.ShardManager
- workIsWaitingToBeProcessed() - Method in class io.confluent.parallelconsumer.state.WorkManager
- WorkManager<K,V> - Class in io.confluent.parallelconsumer.state
-
Sharded, prioritised, offset managed, order controlled, delayed work queue.
- WorkManager(ParallelConsumerOptions<K, V>, Consumer<K, V>) - Constructor for class io.confluent.parallelconsumer.state.WorkManager
- WorkManager(ParallelConsumerOptions<K, V>, Consumer<K, V>, DynamicLoadFactor, Clock) - Constructor for class io.confluent.parallelconsumer.state.WorkManager
- WorkManager(ParallelConsumerOptions<K, V>, Consumer<K, V>, Clock) - Constructor for class io.confluent.parallelconsumer.state.WorkManager
-
Use a private
DynamicLoadFactor, useful for testing. - workRemaining() - Method in class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor
- workRemaining() - Method in interface io.confluent.parallelconsumer.internal.DrainingCloseable
-
Of the records consumed from the broker, how many do we have remaining in our local queues
All Classes All Packages