Index (Confluent Parallel Consumer Core 0.3.0.1 API)

A B C D E F G H I J K L M N O P Q R S T U V W
All Classes All Packages

A

AbstractOffsetCommitter<K,V> - Class in io.confluent.parallelconsumer
AbstractOffsetCommitter(ConsumerManager<K, V>, WorkManager<K, V>) - Constructor for class io.confluent.parallelconsumer.AbstractOffsetCommitter
add(int, ConsumerRecords<K, V>) - Method in class io.confluent.parallelconsumer.CountingCRLinkedList
add(ConsumerRecords<K, V>) - Method in class io.confluent.parallelconsumer.CountingCRLinkedList
addToMailbox(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
addToMailBoxOnUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
assignment() - Method in class io.confluent.parallelconsumer.ConsumerManager

B

BackportUtils - Class in io.confluent.csid.utils
BackportUtils() - Constructor for class io.confluent.csid.utils.BackportUtils
BitSet - io.confluent.parallelconsumer.OffsetEncoding
BitSetCompressed - io.confluent.parallelconsumer.OffsetEncoding
BitSetEncodingNotSupportedException - Exception in io.confluent.parallelconsumer
BitSetEncodingNotSupportedException(String) - Constructor for exception io.confluent.parallelconsumer.BitSetEncodingNotSupportedException
BitSetV2 - io.confluent.parallelconsumer.OffsetEncoding: switch from encoding bitset length as a short to an integer (length of 32,000 was reasonable too short)
BitSetV2Compressed - io.confluent.parallelconsumer.OffsetEncoding
BrokerPollSystem<K,V> - Class in io.confluent.parallelconsumer: Subsystem for polling the broker for messages.
BrokerPollSystem(ConsumerManager<K, V>, WorkManager<K, V>, ParallelEoSStreamProcessor<K, V>, ParallelConsumerOptions) - Constructor for class io.confluent.parallelconsumer.BrokerPollSystem
build() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
build(KKEY, Map<KKEY, VVALUE>) - Static method in class io.confluent.csid.utils.LoopingResumingIterator
builder() - Static method in class io.confluent.parallelconsumer.ParallelConsumerOptions
ByteArray - io.confluent.parallelconsumer.OffsetEncoding
ByteArrayCompressed - io.confluent.parallelconsumer.OffsetEncoding

C

canEqual(Object) - Method in class io.confluent.parallelconsumer.CountingCRLinkedList
canEqual(Object) - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
canEqual(Object) - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
canEqual(Object) - Method in class io.confluent.parallelconsumer.WorkContainer
carefullyRun(BiFunction<T, U, R>, T, U) - Static method in class io.confluent.parallelconsumer.UserFunctions
carefullyRun(Consumer<A>, A) - Static method in class io.confluent.parallelconsumer.UserFunctions
carefullyRun(Function<A, B>, A) - Static method in class io.confluent.parallelconsumer.UserFunctions
CHARSET_TO_USE - Static variable in class io.confluent.parallelconsumer.OffsetMapCodecManager
claim() - Method in class io.confluent.parallelconsumer.ConsumerOffsetCommitter
close() - Method in interface io.confluent.parallelconsumer.DrainingCloseable: Close the consumer.
close() - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Close the system, without draining.
close(Duration) - Method in class io.confluent.parallelconsumer.ConsumerManager
close(Duration) - Method in class io.confluent.parallelconsumer.ProducerManager: Assumes the system is drained at this point, or draining is not desired.
close(Duration, DrainingCloseable.DrainingMode) - Method in interface io.confluent.parallelconsumer.DrainingCloseable: Close the consumer.
close(Duration, DrainingCloseable.DrainingMode) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
closeAndWait() - Method in class io.confluent.parallelconsumer.BrokerPollSystem
closeDontDrainFirst() - Method in interface io.confluent.parallelconsumer.DrainingCloseable
closeDontDrainFirst(Duration) - Method in interface io.confluent.parallelconsumer.DrainingCloseable
closeDrainFirst() - Method in interface io.confluent.parallelconsumer.DrainingCloseable
closeDrainFirst(Duration) - Method in interface io.confluent.parallelconsumer.DrainingCloseable
commitAsync(Map<TopicPartition, OffsetAndMetadata>, OffsetCommitCallback) - Method in class io.confluent.parallelconsumer.ConsumerManager
commitMode(ParallelConsumerOptions.CommitMode) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder: The ParallelConsumerOptions.CommitMode to be used
commitOffsets(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class io.confluent.parallelconsumer.AbstractOffsetCommitter
commitOffsets(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class io.confluent.parallelconsumer.ConsumerOffsetCommitter
commitOffsets(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class io.confluent.parallelconsumer.ProducerManager
commitSync(Map<TopicPartition, OffsetAndMetadata>) - Method in class io.confluent.parallelconsumer.ConsumerManager
compareTo(WorkContainer) - Method in class io.confluent.parallelconsumer.WorkContainer
compressionForced - Static variable in class io.confluent.parallelconsumer.OffsetSimultaneousEncoder: Force the encoder to also add the compressed versions.
ConsumeProduceResult(ConsumerRecord<K, V>, ProducerRecord<KK, VV>, RecordMetadata) - Constructor for class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
consumer(Consumer<K, V>) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder: Required parameter for all use.
ConsumerManager<K,V> - Class in io.confluent.parallelconsumer: Delegate for KafkaConsumer
ConsumerManager(Consumer<K, V>) - Constructor for class io.confluent.parallelconsumer.ConsumerManager
consumerMgr - Variable in class io.confluent.parallelconsumer.AbstractOffsetCommitter
ConsumerOffsetCommitter<K,V> - Class in io.confluent.parallelconsumer: Committer that uses the Kafka Consumer to commit either synchronously or asynchronously
ConsumerOffsetCommitter(ConsumerManager<K, V>, WorkManager<K, V>, ParallelConsumerOptions) - Constructor for class io.confluent.parallelconsumer.ConsumerOffsetCommitter
couldPerform() - Method in class io.confluent.parallelconsumer.RateLimiter
CountingCRLinkedList<K,V> - Class in io.confluent.parallelconsumer: Cached view of the nested number of records in this queue.
CountingCRLinkedList() - Constructor for class io.confluent.parallelconsumer.CountingCRLinkedList
createEosStreamProcessor(ParallelConsumerOptions<KK, VV>) - Static method in interface io.confluent.parallelconsumer.ParallelStreamProcessor
createJStreamEosStreamProcessor(ParallelConsumerOptions) - Static method in interface io.confluent.parallelconsumer.JStreamParallelStreamProcessor

D

decode(byte) - Static method in enum io.confluent.parallelconsumer.OffsetEncoding
DEFAULT_TIMEOUT - Static variable in interface io.confluent.parallelconsumer.DrainingCloseable
DefaultMaxMetadataSize - Static variable in class io.confluent.parallelconsumer.OffsetMapCodecManager: Maximum size of the commit offset metadata
defaultMessageRetryDelay(Duration) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder: When a message fails, how long the system should wait before trying that message again.
description() - Method in enum io.confluent.parallelconsumer.OffsetEncoding
DONT_DRAIN - io.confluent.parallelconsumer.DrainingCloseable.DrainingMode: Stop downloading more messages, and stop procesing more messages in the queue, but finish processing messages already being processed locally.
drain() - Method in class io.confluent.parallelconsumer.BrokerPollSystem: Will begin the shutdown process, eventually closing itself once drained
DRAIN - io.confluent.parallelconsumer.DrainingCloseable.DrainingMode: Stop downloading more messages from the Broker, but finish processing what has already been queued.
DrainingCloseable - Interface in io.confluent.parallelconsumer
DrainingCloseable.DrainingMode - Enum in io.confluent.parallelconsumer
DynamicLoadFactor - Class in io.confluent.parallelconsumer: Controls a loading factor.
DynamicLoadFactor() - Constructor for class io.confluent.parallelconsumer.DynamicLoadFactor

E

EncodingNotSupportedException - Exception in io.confluent.parallelconsumer
EncodingNotSupportedException(String) - Constructor for exception io.confluent.parallelconsumer.EncodingNotSupportedException
equals(Object) - Method in class io.confluent.parallelconsumer.CountingCRLinkedList
equals(Object) - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
equals(Object) - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
equals(Object) - Method in class io.confluent.parallelconsumer.WorkContainer
ErrorInUserFunctionException - Exception in io.confluent.parallelconsumer: This exception is only used when there is an exception thrown from code provided by the user.
ErrorInUserFunctionException(String, Throwable) - Constructor for exception io.confluent.parallelconsumer.ErrorInUserFunctionException

F

fail(WallClock) - Method in class io.confluent.parallelconsumer.WorkContainer
forcedCodec - Static variable in class io.confluent.parallelconsumer.OffsetMapCodecManager: Forces the use of a specific codec, instead of choosing the most efficient one.

G

getCommitMode() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions: The ParallelConsumerOptions.CommitMode to be used
getConsumer() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions: Required parameter for all use.
getCr() - Method in class io.confluent.parallelconsumer.WorkContainer
getCurrentFactor() - Method in class io.confluent.parallelconsumer.DynamicLoadFactor
getDefaultMessageRetryDelay() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions: When a message fails, how long the system should wait before trying that message again.
getDelay(WallClock) - Method in class io.confluent.parallelconsumer.WorkContainer
getElapsedDuration() - Method in class io.confluent.parallelconsumer.RateLimiter
getEncodingMap() - Method in class io.confluent.parallelconsumer.OffsetSimultaneousEncoder: Map of different encoding types for the same offset data, used for retrieving the data for the encoding type
getEpoch() - Method in class io.confluent.parallelconsumer.WorkContainer: Assignment generation this record comes from.
getFailureCause() - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
getFuture() - Method in class io.confluent.parallelconsumer.WorkContainer
getIn() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
getIncompleteOffsets() - Method in class io.confluent.parallelconsumer.OffsetSimultaneousEncoder: The offsets which have not yet been fully completed and can't have their offset committed
getIterationStartingPoint() - Method in class io.confluent.csid.utils.LoopingResumingIterator
getLast(List<T>) - Static method in class io.confluent.csid.utils.JavaUtils
getLeft() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
getLongPollTimeout() - Static method in class io.confluent.parallelconsumer.BrokerPollSystem: Note how this relates to BrokerPollSystem.getLongPollTimeout() - if longPollTimeout is high and loading factor is low, there may not be enough messages queued up to satisfy demand.
getMagicByte() - Method in enum io.confluent.parallelconsumer.OffsetEncoding
getMaxConcurrency() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions: Controls the maximum degree of concurrency to occur.
getMaxFactor() - Method in class io.confluent.parallelconsumer.DynamicLoadFactor: Upper safety cap on multiples of target queue size to reach (e.g.
getMeta() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
getNestedCount() - Method in class io.confluent.parallelconsumer.CountingCRLinkedList: The number of nested ConsumerRecord in this collection.
getNow() - Method in class io.confluent.csid.utils.WallClock
getNumberOfAssignedPartitions() - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
getNumberOfEntriesInPartitionQueues() - Method in class io.confluent.parallelconsumer.WorkManager
getNumberOfFailedAttempts() - Method in class io.confluent.parallelconsumer.WorkContainer
getNumberRecordsOutForProcessing() - Method in class io.confluent.parallelconsumer.WorkManager
getOnlyOne(Map<String, T>) - Static method in class io.confluent.csid.utils.JavaUtils
getOptions() - Method in class io.confluent.parallelconsumer.WorkManager
getOrdering() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions: The ParallelConsumerOptions.ProcessingOrder type to use
getOut() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
getProducer() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions: Supplying a producer is only needed if using the produce flows.
getRate() - Method in class io.confluent.parallelconsumer.RateLimiter
getRetryDelay() - Method in class io.confluent.parallelconsumer.WorkContainer
getRight() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
getSortedEncodings() - Method in class io.confluent.parallelconsumer.OffsetSimultaneousEncoder: Ordered set of the the different encodings, used to quickly retrieve the most compressed encoding
getTimeBetweenCommits() - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Time between commits.
getTimeInFlight() - Method in class io.confluent.parallelconsumer.WorkContainer
getTopicPartition() - Method in class io.confluent.parallelconsumer.WorkContainer
getTotalWorkWaitingProcessing() - Method in class io.confluent.parallelconsumer.WorkManager
getUserFunctionSucceeded() - Method in class io.confluent.parallelconsumer.WorkContainer
getWorkContainerForRecord(ConsumerRecord<K, V>) - Method in class io.confluent.parallelconsumer.WorkManager
getWorkQueuedInShardsCount() - Method in class io.confluent.parallelconsumer.WorkManager
getWorkType() - Method in class io.confluent.parallelconsumer.WorkContainer: Simple way to differentiate treatment based on type
groupMetadata() - Method in class io.confluent.parallelconsumer.ConsumerManager

H

handleFutureResult(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.WorkManager
hasDelayPassed(WallClock) - Method in class io.confluent.parallelconsumer.WorkContainer
hashCode() - Method in class io.confluent.parallelconsumer.CountingCRLinkedList
hashCode() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
hashCode() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
hashCode() - Method in class io.confluent.parallelconsumer.WorkContainer
hasNext() - Method in class io.confluent.csid.utils.LoopingResumingIterator
hasPreviouslyFailed() - Method in class io.confluent.parallelconsumer.WorkContainer
hasWorkInCommitQueues() - Method in class io.confluent.parallelconsumer.WorkManager
hasWorkInFlight() - Method in class io.confluent.parallelconsumer.WorkManager
hasWorkInMailboxes() - Method in class io.confluent.parallelconsumer.WorkManager

I

internalFlattenedMailQueueIsEmpty() - Method in class io.confluent.parallelconsumer.WorkMailBoxManager
internalFlattenedMailQueuePoll() - Method in class io.confluent.parallelconsumer.WorkMailBoxManager
internalFlattenedMailQueueSize() - Method in class io.confluent.parallelconsumer.WorkMailBoxManager
InternalRuntimeError - Exception in io.confluent.parallelconsumer
InternalRuntimeError(String) - Constructor for exception io.confluent.parallelconsumer.InternalRuntimeError
InternalRuntimeError(String, Throwable) - Constructor for exception io.confluent.parallelconsumer.InternalRuntimeError
InternalRuntimeError(String, Throwable, boolean, boolean) - Constructor for exception io.confluent.parallelconsumer.InternalRuntimeError
InternalRuntimeError(Throwable) - Constructor for exception io.confluent.parallelconsumer.InternalRuntimeError
invoke() - Method in class io.confluent.parallelconsumer.OffsetSimultaneousEncoder: Highwater mark already encoded in string - OffsetMapCodecManager.makeOffsetMetadataPayload(long, org.apache.kafka.common.TopicPartition, java.util.Set<java.lang.Long>) - so encoding BitSet run length may not be needed, or could be swapped
io.confluent.csid.utils - package io.confluent.csid.utils
io.confluent.parallelconsumer - package io.confluent.parallelconsumer
isBlank(String) - Static method in class io.confluent.csid.utils.StringUtils
isClean() - Method in class io.confluent.parallelconsumer.WorkManager
isClosedOrFailed() - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
isEmpty(Optional<?>) - Static method in class io.confluent.csid.utils.BackportUtils
isInFlight() - Method in class io.confluent.parallelconsumer.WorkContainer
isMaxReached() - Method in class io.confluent.parallelconsumer.DynamicLoadFactor
isNotInFlight() - Method in class io.confluent.parallelconsumer.WorkContainer
isPaused() - Method in class io.confluent.parallelconsumer.BrokerPollSystem
isProducerSupplied() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
isSync() - Method in class io.confluent.parallelconsumer.ConsumerOffsetCommitter
isTransactionInProgress() - Method in class io.confluent.parallelconsumer.ProducerManager
isUserFunctionComplete() - Method in class io.confluent.parallelconsumer.WorkContainer
isUserFunctionSucceeded() - Method in class io.confluent.parallelconsumer.WorkContainer
isUsingTransactionalProducer() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
iterator() - Method in class io.confluent.csid.utils.LoopingResumingIterator
iterator() - Method in class io.confluent.csid.utils.Range

J

Java8StreamUtils - Class in io.confluent.csid.utils
JavaUtils - Class in io.confluent.csid.utils
JavaUtils() - Constructor for class io.confluent.csid.utils.JavaUtils
JStreamParallelEoSStreamProcessor<K,V> - Class in io.confluent.parallelconsumer
JStreamParallelEoSStreamProcessor(ParallelConsumerOptions) - Constructor for class io.confluent.parallelconsumer.JStreamParallelEoSStreamProcessor
JStreamParallelStreamProcessor<K,V> - Interface in io.confluent.parallelconsumer

K

KafkaUtils - Class in io.confluent.csid.utils
KafkaUtils() - Constructor for class io.confluent.csid.utils.KafkaUtils
KEY - io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder: Process messages in key order.

L

LARGE_INPUT_MAP_SIZE_THRESHOLD - Static variable in class io.confluent.parallelconsumer.OffsetSimultaneousEncoder: Size threshold in bytes after which compressing the encodings will be compared, as it seems to be typically worth the extra compression step when beyond this size in the source array.
list() - Method in class io.confluent.csid.utils.Range
LoopingResumingIterator<KEY,VALUE> - Class in io.confluent.csid.utils: Loop implementations that will resume from a given key.
LoopingResumingIterator(Map<KEY, VALUE>) - Constructor for class io.confluent.csid.utils.LoopingResumingIterator
LoopingResumingIterator(Optional<KEY>, Map<KEY, VALUE>) - Constructor for class io.confluent.csid.utils.LoopingResumingIterator: Will resume from the startingKey, if it's present

M

magicByte - Variable in enum io.confluent.parallelconsumer.OffsetEncoding
maxConcurrency(int) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder: Controls the maximum degree of concurrency to occur.
maybeGetWork() - Method in class io.confluent.parallelconsumer.WorkManager: Get work with no limit on quantity, useful for testing.
maybeGetWork(int) - Method in class io.confluent.parallelconsumer.WorkManager: Depth first work retrieval.
maybeStepUp() - Method in class io.confluent.parallelconsumer.DynamicLoadFactor: Try to increase the loading factor
MDC_INSTANCE_ID - Static variable in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
msg(String, Object...) - Static method in class io.confluent.csid.utils.StringUtils
MSG - Static variable in class io.confluent.parallelconsumer.UserFunctions

N

next() - Method in class io.confluent.csid.utils.LoopingResumingIterator

O

offset() - Method in class io.confluent.parallelconsumer.WorkContainer
OffsetBitSet - Class in io.confluent.parallelconsumer: Deserialisation tools for BitsetEncoder.
OffsetBitSet() - Constructor for class io.confluent.parallelconsumer.OffsetBitSet
OffsetCommitter - Interface in io.confluent.parallelconsumer
OffsetDecodingError - Exception in io.confluent.parallelconsumer
OffsetDecodingError(String, IllegalArgumentException) - Constructor for exception io.confluent.parallelconsumer.OffsetDecodingError
OffsetEncoding - Enum in io.confluent.parallelconsumer
OffsetMapCodecManager<K,V> - Class in io.confluent.parallelconsumer: Uses multiple encodings to compare, when decided, can refactor other options out for analysis only - OffsetMapCodecManager.encodeOffsetsCompressed(long, org.apache.kafka.common.TopicPartition, java.util.Set<java.lang.Long>)
OffsetMapCodecManager(WorkManager<K, V>, Consumer<K, V>) - Constructor for class io.confluent.parallelconsumer.OffsetMapCodecManager
OffsetRunLength - Class in io.confluent.parallelconsumer
OffsetSimpleSerialisation - Class in io.confluent.parallelconsumer
OffsetSimultaneousEncoder - Class in io.confluent.parallelconsumer: Encode with multiple strategies at the same time.
OffsetSimultaneousEncoder(long, Long, Set<Long>) - Constructor for class io.confluent.parallelconsumer.OffsetSimultaneousEncoder
onCommitRequested() - Method in class io.confluent.parallelconsumer.ConsumerManager
onFailure(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.WorkManager
onOffsetCommitSuccess(Map<TopicPartition, OffsetAndMetadata>) - Method in class io.confluent.parallelconsumer.WorkManager: Truncate our tracked offsets as a commit was successful, so the low water mark rises, and we dont' need to track as much anymore.
onPartitionsAssigned(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Delegate to WorkManager
onPartitionsAssigned(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.WorkManager: Load offset map for assigned partitions
onPartitionsLost(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Delegate to WorkManager
onPartitionsLost(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.WorkManager: Clear offset map for lost partitions
onPartitionsRemoved(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.WorkMailBoxManager: Remove revoked work from the mailbox
onPartitionsRevoked(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Commit our offsets
onPartitionsRevoked(Collection<TopicPartition>) - Method in class io.confluent.parallelconsumer.WorkManager: Clear offset map for revoked partitions
onSuccess(WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.WorkManager
onUserFunctionFailure() - Method in class io.confluent.parallelconsumer.WorkContainer
onUserFunctionSuccess() - Method in class io.confluent.parallelconsumer.WorkContainer
onUserFunctionSuccess(WorkContainer<K, V>, List<?>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
ordering(ParallelConsumerOptions.ProcessingOrder) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder: The ParallelConsumerOptions.ProcessingOrder type to use

P

packSmallest() - Method in class io.confluent.parallelconsumer.OffsetSimultaneousEncoder: Select the smallest encoding, and pack it.
pairOf(LL, RR) - Static method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
ParallelConsumer<K,V> - Interface in io.confluent.parallelconsumer: Asynchronous / concurrent message consumer for Kafka.
ParallelConsumer.Tuple<L,R> - Class in io.confluent.parallelconsumer: A simple tuple structure.
ParallelConsumerOptions<K,V> - Class in io.confluent.parallelconsumer: The options for the ParallelEoSStreamProcessor system.
ParallelConsumerOptions.CommitMode - Enum in io.confluent.parallelconsumer: The type of commit to be made, with either a transactions configured Producer where messages produced are committed back to the Broker along with the offsets they originated from, or with the faster simpler Consumer offset system either synchronously or asynchronously
ParallelConsumerOptions.ParallelConsumerOptionsBuilder<K,V> - Class in io.confluent.parallelconsumer
ParallelConsumerOptions.ProcessingOrder - Enum in io.confluent.parallelconsumer: The ordering guarantee to use.
ParallelEoSStreamProcessor<K,V> - Class in io.confluent.parallelconsumer
ParallelEoSStreamProcessor(ParallelConsumerOptions) - Constructor for class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Construct the AsyncConsumer by wrapping this passed in conusmer and producer, which can be configured any which way as per normal.
ParallelStreamProcessor<K,V> - Interface in io.confluent.parallelconsumer: Parallel message consumer which also can optionally produce 0 or many ProducerRecord results to be published back to Kafka.
ParallelStreamProcessor.ConsumeProduceResult<K,V,KK,VV> - Class in io.confluent.parallelconsumer: A simple triple structure to capture the set of coinciding data.
PARTITION - io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder: Process messages within a partition in order, but process multiple partitions in parallel.
pause(Set<TopicPartition>) - Method in class io.confluent.parallelconsumer.ConsumerManager
paused() - Method in class io.confluent.parallelconsumer.ConsumerManager
performIfNotLimited(Runnable) - Method in class io.confluent.parallelconsumer.RateLimiter
PERIODIC_CONSUMER_ASYNCHRONOUS - io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode: Periodically commits offsets asynchronously.
PERIODIC_CONSUMER_SYNC - io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode: Periodically synchronous commits with the Consumer.
PERIODIC_TRANSACTIONAL_PRODUCER - io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode: Periodically commits through the Producer using transactions.
poll() - Method in class io.confluent.parallelconsumer.CountingCRLinkedList
poll(Consumer<ConsumerRecord<K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelConsumer: Register a function to be applied in parallel to each received message
poll(Consumer<ConsumerRecord<K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
pollAndProduce(Function<ConsumerRecord<K, V>, ProducerRecord<K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
pollAndProduce(Function<ConsumerRecord<K, V>, ProducerRecord<K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor: Register a function to be applied in parallel to each received message, which in turn returns a ProducerRecord to be sent back to the broker.
pollAndProduce(Function<ConsumerRecord<K, V>, ProducerRecord<K, V>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
pollAndProduce(Function<ConsumerRecord<K, V>, ProducerRecord<K, V>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor: Register a function to be applied in parallel to each received message, which in turn returns a ProducerRecord to be sent back to the broker.
pollAndProduceMany(Function<ConsumerRecord<K, V>, List<ProducerRecord<K, V>>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
pollAndProduceMany(Function<ConsumerRecord<K, V>, List<ProducerRecord<K, V>>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor: Register a function to be applied in parallel to each received message, which in turn returns one or many ProducerRecords to be sent back to the broker.
pollAndProduceMany(Function<ConsumerRecord<K, V>, List<ProducerRecord<K, V>>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
pollAndProduceMany(Function<ConsumerRecord<K, V>, List<ProducerRecord<K, V>>>, Consumer<ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) - Method in interface io.confluent.parallelconsumer.ParallelStreamProcessor: Register a function to be applied in parallel to each received message, which in turn returns one or more ProducerRecords to be sent back to the broker.
pollProduceAndStream(Function<ConsumerRecord<K, V>, List<ProducerRecord<K, V>>>) - Method in class io.confluent.parallelconsumer.JStreamParallelEoSStreamProcessor
pollProduceAndStream(Function<ConsumerRecord<K, V>, List<ProducerRecord<K, V>>>) - Method in interface io.confluent.parallelconsumer.JStreamParallelStreamProcessor: Like ParallelEoSStreamProcessor.pollAndProduceMany(java.util.function.Function<org.apache.kafka.clients.consumer.ConsumerRecord<K, V>, java.util.List<org.apache.kafka.clients.producer.ProducerRecord<K, V>>>, java.util.function.Consumer<io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>) but instead of callbacks, streams the results instead, after the produce result is ack'd by Kafka.
postCommit() - Method in class io.confluent.parallelconsumer.AbstractOffsetCommitter
postCommit() - Method in class io.confluent.parallelconsumer.ConsumerOffsetCommitter
postCommit() - Method in class io.confluent.parallelconsumer.ProducerManager
preAcquireWork() - Method in class io.confluent.parallelconsumer.AbstractOffsetCommitter
preAcquireWork() - Method in class io.confluent.parallelconsumer.ProducerManager
processInbox() - Method in class io.confluent.parallelconsumer.WorkMailBoxManager: Take our inbound messages from the BrokerPollSystem and add them to our registry.
producer - Variable in class io.confluent.parallelconsumer.ProducerManager
producer(Producer<K, V>) - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder: Supplying a producer is only needed if using the produce flows.
ProducerManager<K,V> - Class in io.confluent.parallelconsumer
ProducerManager(Producer<K, V>, ConsumerManager<K, V>, WorkManager<K, V>, ParallelConsumerOptions) - Constructor for class io.confluent.parallelconsumer.ProducerManager

Q

queueingForExecution() - Method in class io.confluent.parallelconsumer.WorkContainer

R

range(long) - Static method in class io.confluent.csid.utils.Range: Exclusive of max
Range - Class in io.confluent.csid.utils: https://stackoverflow.com/a/16570509/105741
Range(long) - Constructor for class io.confluent.csid.utils.Range
RateLimiter - Class in io.confluent.parallelconsumer
RateLimiter() - Constructor for class io.confluent.parallelconsumer.RateLimiter
RateLimiter(int) - Constructor for class io.confluent.parallelconsumer.RateLimiter
readFully(InputStream) - Static method in class io.confluent.csid.utils.BackportUtils
readFully(InputStream, int, boolean) - Static method in class io.confluent.csid.utils.BackportUtils: Used in Java 8 environments (Java 9 has read all bytes)
registerWork(List<ConsumerRecords<K, V>>) - Method in class io.confluent.parallelconsumer.WorkManager
registerWork(ConsumerRecords<K, V>) - Method in class io.confluent.parallelconsumer.WorkMailBoxManager: Work must be registered in offset order
registerWork(ConsumerRecords<K, V>) - Method in class io.confluent.parallelconsumer.WorkManager
requestCommitAsap() - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Request a commit as soon as possible (ASAP), overriding other constraints.
resume(Set<TopicPartition>) - Method in class io.confluent.parallelconsumer.ConsumerManager
retrieveOffsetsAndCommit() - Method in class io.confluent.parallelconsumer.AbstractOffsetCommitter: Get offsets from WorkManager that are ready to commit
retrieveOffsetsAndCommit() - Method in class io.confluent.parallelconsumer.BrokerPollSystem: Optionally blocks.
retrieveOffsetsAndCommit() - Method in interface io.confluent.parallelconsumer.OffsetCommitter
RunLength - io.confluent.parallelconsumer.OffsetEncoding
RunLengthCompressed - io.confluent.parallelconsumer.OffsetEncoding
RunlengthV1EncodingNotSupported - Exception in io.confluent.parallelconsumer
RunlengthV1EncodingNotSupported(String) - Constructor for exception io.confluent.parallelconsumer.RunlengthV1EncodingNotSupported
RunLengthV2 - io.confluent.parallelconsumer.OffsetEncoding: switch from encoding run lengths as Shorts to Integers
RunLengthV2Compressed - io.confluent.parallelconsumer.OffsetEncoding

S

setDefaultRetryDelay(Duration) - Static method in class io.confluent.parallelconsumer.WorkContainer
setFuture(Future<List<Object>>) - Method in class io.confluent.parallelconsumer.WorkContainer
setLongPollTimeout(Duration) - Static method in class io.confluent.parallelconsumer.BrokerPollSystem: Note how this relates to BrokerPollSystem.getLongPollTimeout() - if longPollTimeout is high and loading factor is low, there may not be enough messages queued up to satisfy demand.
setLongPollTimeout(Duration) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
setMyId(Optional<String>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Optioanl ID of this instance.
setTimeBetweenCommits(Duration) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Time between commits.
setupStreamFromDeque(ConcurrentLinkedDeque<T>) - Static method in class io.confluent.csid.utils.Java8StreamUtils
setUSED_PAYLOAD_THRESHOLD_MULTIPLIER(double) - Static method in class io.confluent.parallelconsumer.WorkManager: Best efforts attempt to prevent usage of offset payload beyond X% - as encoding size test is currently only done per batch, we need to leave some buffer for the required space to overrun before hitting the hard limit where we have to drop the offset payload entirely.
setWorkType(String) - Method in class io.confluent.parallelconsumer.WorkContainer: Simple way to differentiate treatment based on type
shouldThrottle() - Method in class io.confluent.parallelconsumer.WorkManager
start() - Method in class io.confluent.parallelconsumer.BrokerPollSystem
StringUtils - Class in io.confluent.csid.utils
StringUtils() - Constructor for class io.confluent.csid.utils.StringUtils
subscribe(Collection<String>) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
subscribe(Collection<String>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
subscribe(Collection<String>, ConsumerRebalanceListener) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
subscribe(Collection<String>, ConsumerRebalanceListener) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
subscribe(Pattern) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
subscribe(Pattern) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
subscribe(Pattern, ConsumerRebalanceListener) - Method in interface io.confluent.parallelconsumer.ParallelConsumer
subscribe(Pattern, ConsumerRebalanceListener) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
succeed() - Method in class io.confluent.parallelconsumer.WorkContainer
supervise() - Method in class io.confluent.parallelconsumer.BrokerPollSystem
supervisorLoop(Function<ConsumerRecord<K, V>, List<R>>, Consumer<R>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor

T

time(Callable<RESULT>) - Static method in class io.confluent.csid.utils.TimeUtils
TimeUtils - Class in io.confluent.csid.utils
toBuilder() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
toSeconds(Duration) - Static method in class io.confluent.csid.utils.BackportUtils
toStream() - Method in class io.confluent.csid.utils.Range
toString() - Method in enum io.confluent.parallelconsumer.OffsetEncoding
toString() - Method in class io.confluent.parallelconsumer.ParallelConsumer.Tuple
toString() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions.ParallelConsumerOptionsBuilder
toString() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
toString() - Method in class io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult
toString() - Method in class io.confluent.parallelconsumer.WorkContainer
toTP(ConsumerRecord) - Static method in class io.confluent.csid.utils.KafkaUtils
Tuple(L, R) - Constructor for class io.confluent.parallelconsumer.ParallelConsumer.Tuple

U

UNORDERED - io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder: No ordering is guaranteed, not even partition order.
USED_PAYLOAD_THRESHOLD_MULTIPLIER - Static variable in class io.confluent.parallelconsumer.WorkManager: Best efforts attempt to prevent usage of offset payload beyond X% - as encoding size test is currently only done per batch, we need to leave some buffer for the required space to overrun before hitting the hard limit where we have to drop the offset payload entirely.
userFunctionRunner(Function<ConsumerRecord<K, V>, List<R>>, Consumer<R>, WorkContainer<K, V>) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Run the supplied function.
UserFunctions - Class in io.confluent.parallelconsumer

V

validate() - Method in class io.confluent.parallelconsumer.ParallelConsumerOptions
valueOf(String) - Static method in enum io.confluent.parallelconsumer.DrainingCloseable.DrainingMode: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum io.confluent.parallelconsumer.OffsetEncoding: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder: Returns the enum constant of this type with the specified name.
values() - Static method in enum io.confluent.parallelconsumer.DrainingCloseable.DrainingMode: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum io.confluent.parallelconsumer.OffsetEncoding: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.CommitMode: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum io.confluent.parallelconsumer.ParallelConsumerOptions.ProcessingOrder: Returns an array containing the constants of this enum type, in the order they are declared.
version - Variable in enum io.confluent.parallelconsumer.OffsetEncoding

W

waitForProcessedNotCommitted(Duration) - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor: Block the calling thread until no more messages are being processed.
wakeup() - Method in class io.confluent.parallelconsumer.ConsumerManager: Wakes up the consumer, but only if it's polling.
wakeupIfPaused() - Method in class io.confluent.parallelconsumer.BrokerPollSystem: Wakeup if colling the broker
WallClock - Class in io.confluent.csid.utils
WallClock() - Constructor for class io.confluent.csid.utils.WallClock
wm - Variable in class io.confluent.parallelconsumer.AbstractOffsetCommitter
wm - Variable in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor
WorkContainer<K,V> - Class in io.confluent.parallelconsumer
WorkContainer(int, ConsumerRecord<K, V>) - Constructor for class io.confluent.parallelconsumer.WorkContainer
WorkContainer(int, ConsumerRecord<K, V>, String) - Constructor for class io.confluent.parallelconsumer.WorkContainer
workIsWaitingToBeProcessed() - Method in class io.confluent.parallelconsumer.WorkManager
WorkMailBoxManager<K,V> - Class in io.confluent.parallelconsumer: Handles the incoming mail for WorkManager.
WorkMailBoxManager() - Constructor for class io.confluent.parallelconsumer.WorkMailBoxManager
WorkManager<K,V> - Class in io.confluent.parallelconsumer: Sharded, prioritised, offset managed, order controlled, delayed work queue.
WorkManager(ParallelConsumerOptions, Consumer<K, V>) - Constructor for class io.confluent.parallelconsumer.WorkManager: Use a private DynamicLoadFactor, useful for testing.
WorkManager(ParallelConsumerOptions, Consumer<K, V>, DynamicLoadFactor) - Constructor for class io.confluent.parallelconsumer.WorkManager
workRemaining() - Method in interface io.confluent.parallelconsumer.DrainingCloseable: Of the records consumed from the broker, how many do we have remaining in our local queues
workRemaining() - Method in class io.confluent.parallelconsumer.ParallelEoSStreamProcessor

A B C D E F G H I J K L M N O P Q R S T U V W
All Classes All Packages