Kafka Connect on Joel Hanson

Kafka Connector Template

joelhanson025@gmail.com (Joel Hanson) — Mon, 14 Apr 2025 00:00:00 +0000

Production-ready Kafka Connect template with Testcontainers integration tests.

SSE Kafka Connector

joelhanson025@gmail.com (Joel Hanson) — Tue, 01 Apr 2025 00:00:00 +0000

Kafka Connect source that turns Server-Sent Events streams into Kafka topics — used in Event Streams demos.

The Connector That Kept Retrying and Never Said So

joelhanson025@gmail.com (Joel Hanson) — Thu, 30 Jul 2026 10:00:00 +0530

A Kafka Connect MQ Sink looked healthy while messages never reached MQ — RetriableException loops in put() sit outside errors.retry.timeout. How we added mq.retry.timeout.ms so silent retries become visible failures.

Mastering Integration Testing for Kafka Connectors: A Complete Guide

joelhanson025@gmail.com (Joel Hanson) — Sun, 13 Jul 2025 21:40:00 +0530

Integration testing is crucial for Kafka Connectors to ensure they work correctly with external systems. This guide provides a comprehensive approach to setting up and executing integration tests for Kafka Connectors, covering everything from environment setup to best practices for testing source and sink connectors.

Build Custom Kafka Connectors Fast with This Open-Source Template

joelhanson025@gmail.com (Joel Hanson) — Mon, 14 Apr 2025 16:19:42 +0530

Apache Kafka is a powerful distributed event streaming platform, and Kafka Connect makes it easy to integrate Kafka with external systems. While many pre-built connectors exist, real-world applications often need custom connectors tailored for proprietary systems, custom logic, or advanced error handling. That’s where this production-ready template comes in—it removes the boilerplate and gives you everything you need to build, test, and deploy connectors with ease.

Filtering Tombstone Records in Kafka Connect

joelhanson025@gmail.com (Joel Hanson) — Tue, 11 Mar 2025 12:19:08 +0530

Kafka Connect provides a flexible way to process streaming data using Single Message Transforms (SMTs). If you need to filter out tombstone records (records with null values), you should use the generic Filter transformation along with the RecordIsTombstone predicate.