advanced~3h
Kafka Connect
Move data in and out of Kafka using configuration instead of hand-written producers and consumers, using Kafka Connect's source and sink connector model.
Learning objectives
- Beginner: Explain what problem Kafka Connect solves and when writing a custom producer or consumer is still the better choice.
- Beginner: Distinguish a source connector from a sink connector.
- Intermediate: Configure and run a JDBC source connector pulling rows from a Postgres table into a Kafka topic.
- Intermediate: Explain the role of a Connect worker, a connector, and a task, and how tasks provide parallelism.
- Advanced: Explain how Debezium's CDC-based source connector differs from a polling JDBC source connector, and when the difference matters.
- Advanced: Reason about exactly-once delivery guarantees for sink connectors and what source/sink offset tracking actually protects against.
This is a Pro chapter
Sign in, then upgrade to Pro or Power to unlock this and the full Spring Ecosystem Mastery library.
Kafka Connect