The Internals of Apache Kafka
Introduction
Overview of Kafka
Kafka Clients / Consumer API
Consumer Contract — Kafka Clients for Consuming Records
KafkaConsumer
MockConsumer
ConsumerRecord
OffsetAndMetadata
OffsetAndTimestamp
OffsetCommitCallback
ConsumerRebalanceListener
ConsumerConfig — Configuration Properties for KafkaConsumer
CommitFailedException
InvalidOffsetException
NoOffsetForPartitionException
OffsetOutOfRangeException
RetriableCommitFailedException
ConsumerInterceptor
PartitionAssignor Contract
RangeAssignor
RoundRobinAssignor
StickyAssignor
AbstractPartitionAssignor
ConsumerCoordinator
AbstractCoordinator Contract
ConsumerNetworkClient
ConsumerMetrics
Fetcher
RequestFutureListener
SubscriptionState
RequestFuture
RequestFutureAdapter Contract
CoordinatorResponseHandler Contract
FindCoordinatorResponseHandler
HeartbeatResponseHandler
JoinGroupResponseHandler
OffsetCommitResponseHandler
SyncGroupResponseHandler
Kafka Operations and Administration
ConfigCommand
ReassignPartitionsCommand — Partition Reassignment on Command Line
TopicCommand — Topic Management on Command Line
kafka-consumer-groups.sh
ConsumerGroupCommand
KafkaConsumerGroupService
ConsumerGroupService
KafkaAdminClient
AdminClient
AdminMetadataManager
AdminClientRunnable
AdminUtils
Kafka Features
Kafka Controller Election
Topic Replication
Topic Deletion
Transactional Producer
Idempotent Producer
Kafka Broker Services
Kafka Server and Periodic Tasks
AdminManager
Authorizer
DynamicBrokerConfig
DynamicLogConfig
DynamicMetricsReporters
DynamicClientQuotaCallback
ConfigHandler Contract
BrokerConfigHandler
ClientIdConfigHandler
TopicConfigHandler
UserConfigHandler
DelegationTokenManager
DynamicConfigManager
BrokerReconfigurable Contract — Reconfigurable Broker Services
DynamicThreadPool
DynamicListenerConfig
LogCleaner
GroupCoordinator
GroupMetadataManager
Kafka
KafkaApis — API Request Handler
KafkaController
KafkaHealthcheck
KafkaServerStartable — Thin Management Layer over KafkaServer
KafkaServer — Kafka Broker
KafkaConfig
KafkaMetricsReporter
KafkaRequestHandler
KafkaRequestHandlerPool — Pool of Daemon KafkaRequestHandler Threads
Log
LogCleanerManager
LogManager
ProducerStateManager
MetadataCache
OffsetConfig
ReplicaManager
ReplicaFetcherManager
AbstractFetcherManager
ReplicaFetcherThread
AbstractFetcherThread
ReplicaFetcherBlockingSend
ReplicationQuotaManager
ReplicationUtils
LogDirFailureHandler
Selector — Selectable on Socket Channels (from Java’s New IO API)
Selectable
ShutdownableThread
SocketServer
Network Processor Thread (Socket Server Request Processor)
RequestChannel
RequestChannel.Request
TransactionCoordinator
TransactionMarkerChannelManager
InterBrokerSendThread
TransactionStateManager
ZkUtils
ZKRebalancerListener
Kafka Controller
ControllerContext
ControllerEventManager
ControllerEventThread
ControllerEvent
AutoPreferredReplicaLeaderElection
Startup
Reelect
TopicDeletion
ControllerState
ControllerChannelManager
ControllerBrokerRequestBatch
TopicDeletionManager
ReplicaStateMachine
PartitionStateMachine
Kafka Cluster
Partition
Replica
Kafka Metrics
BrokerTopicStats
BrokerTopicMetrics
KafkaMetricsGroup
Kafka Clients / Producer API
Producer
KafkaProducer
Sender — Kafka Producer I/O Thread
ProducerRecord
Callback
ProducerConfig
Partitioner
DefaultPartitioner
ProducerInterceptor
TransactionManager
Kafka Architecture
Broker Nodes — Kafka Servers
Broker
Topics
Messages
Kafka Clients
Producers
Consumers
Clusters
Kafka Monitoring (Metrics)
Metrics
Sensor
MetricsReporter
ProducerMetrics
SenderMetrics
Kafka Tools
Kafka Tools
kafka-configs.sh
kafka-topics.sh
Kafka Configuration
Properties
bootstrap.servers
client.id
enable.auto.commit
group.id
retry.backoff.ms
Logging
Tips and Tricks
Gradle Tips
Zookeeper Tips
Kafka in Scala REPL for Interactive Exploration
Running Kafka Broker in Docker
Kafka Clients
KafkaClient
NetworkClient — Non-Blocking Network KafkaClient
RequestCompletionHandler Contract
MetadataUpdater
DefaultMetadataUpdater
Metadata
Listener Contract — Intercepting Metadata Updates
ClientRequest
ClientResponse
StaleMetadataException
NetworkClientUtils
Kafka Common
Cluster
Cluster (deprecated)
ClusterConnectionStates
ClusterResourceListener (and ClusterResourceListeners Collection)
NotificationHandler Contract
ZkNodeChangeNotificationListener
Configurable Contract
Reconfigurable
Kafka Common / Requests
AbstractRequestResponse Contract
AbstractRequest Contract
AbstractRequest.Builder Contract
AbstractResponse
DescribeLogDirsRequest
FindCoordinatorRequest
FindCoordinatorResponse
LeaderAndIsrRequest
MetadataRequest
MetadataResponse
UpdateMetadataRequest
RequestContext
Kafka Common / Serialization
Serializer Contract
Deserializer Contract
Serde Contract
Serdes Factory Object
Kafka Security
SimpleAclAuthorizer
Varia / Misc
KafkaScheduler
Scheduler
ZooKeeperClient
KafkaZkClient — Higher-Level Kafka-Specific ZooKeeper Client
AdminZkClient
ZkAclChangeStore
Kafka Connect
WorkerGroupMember
ConnectDistributed
Kafka Demos
Demo: Kafka Controller Election
Appendix
Further reading or watching
Published with GitBook
ReplicationQuotaManager
ReplicationQuotaManager
ReplicationQuotaManager
is…FIXME
results matching "
"
No results matching "
"