Preparing for a DevOps interview that covers Apache Kafka? These questions come up again and again - here are strong, concrete answers.
Q: What is Apache Kafka and why use it?
Kafka is a distributed log for streaming events: producers append to partitioned topics, consumers read at their own pace, and data is durably replicated - the backbone of event-driven architectures.
- High throughput with durable, replayable, ordered partitions
- Decouples producers and consumers for resilient pipelines
- A rich ecosystem (Connect, Streams, Schema Registry)
Q: What are the best practices you follow?
- Size partitions for target consumer parallelism up front
- Monitor consumer lag and set alerts on it
- Use a Schema Registry and compatibility rules
Q: What mistakes have you seen?
- Too few partitions, capping consumer parallelism
- Ignoring consumer lag until it becomes an outage
- No schema management, so producers break consumers
Q: Show a basic configuration
Produce and consume with the Python client.
from kafka import KafkaProducer, KafkaConsumer
p = KafkaProducer(bootstrap_servers='localhost:9092')
p.send('orders', b'{"id": 42}'); p.flush()
c = KafkaConsumer('orders', bootstrap_servers='localhost:9092', group_id='billing')
for msg in c:
print(msg.value)Want senior help putting Apache Kafka to work - or a team bootcamp on it? CodeWizard runs Israel's largest DevOps community and embeds named senior engineers with a transparent hours log. Book a free consult or explore the Academy.