A RabbitMQ quorum queue deletes each message once it is acknowledged and fsyncs before accepting it; a stream keeps it for rereading. On RabbitMQ 4.3.6, with 1 KB messages, the quorum queue moved 45,156 msg/s and the stream, over its own protocol, 281,330 msg/s, using 9 KB of memory per million messages against 20.5 MB.
Redpanda promises Kafka-protocol compatibility without the JVM, without ZooKeeper, and with a thread-per-core architecture. By 2025 there are already serious production deployments. It is worth understanding where the switch pays off and where it does not.
To remove ZooKeeper from Kafka you have to go through 3.9. I migrated a three-broker Kafka 3.9.2 ZooKeeper cluster to KRaft in Docker and then upgraded it to Kafka 4.4.0: five phases with rolling restarts, the config and commands for each one, and all 100,000 messages intact at the end.
13 min278
We use first- and third-party cookies to analyze site traffic. You can accept them, reject them, or configure your choice.
Learn more about cookies
Cookie preferences
NecessaryEssential for the site to work. Always on.
AnalyticsHelp us understand how the site is used (Google Analytics).