12. Administering Kafka

Source: Kafka: The Definitive Guide, 2nd Ed., Ch. 12 Scope, stated honestly: "While these tools provide basic functions, you may find they are LACKING for more complex operations or are UNWIELDY TO USE AT LARGER SCALES. This chapter will describe only the basic tools that are part of the Apache Kafka open source project."

Mechanics: "The tools are implemented in Java classes, and a set of scripts are provided natively to call those classes properly." All examples assume /usr/local/kafka/bin/ is your working directory or on $PATH.

Sections

12.0
Two warnings before you run anythingAnd later, more bluntly: "Older console consumers can potentially DAMAGE THE CLUSTER by interacting with the cluster or ZooKeeper in incorrect ways."
12.13
Topic operations — `kafka-topics.sh`Note Replicas: 0,1 but Isr: 0 — exactly at min-ISR, zero redundancy remaining.
12.2
Consumer groups — `kafka-consumer-groups.sh`That's a genuinely dangerous ergonomic: the export command and the destructive reset command differ by one flag.
12.31
Dynamic configuration changes — `kafka-configs.sh`controller_mutations_rate is the guard against the controller-overload problem from §1.7 — someone scripting mass topic creation/deletion.
12.4
Producing and consuming from the consoleConfigs via --consumer.config <file> or --consumer-property <key>=<value>.
12.55
Partition managementAlso supports --topic + --partition directly.
12.61
Dumping log segments — `kafka-dump-log.sh`💡 This output is Chapter 6 §6.5's batch header, made concrete.
12.7
Replica verification — `kafka-replica-verification.sh`
12.8
Other tools in the distribution
12.9
⚠️ Unsafe operations — "Here be dragons"
12.10Failure catalog
What actually breaks in production — Ch. 12 consolidated
12.111
Operational quick reference
12.12Self-test
Self-test