Apache Kafka — end-to-end streaming architecture
Producers, brokers, partitions, consumer groups, Schema Registry, Connect and the sinks — a full streaming platform on one animated canvas.
The trade-off I'd flag
Partition count is a one-way door. Size it for the consumer parallelism you will need in two years, because changing it later breaks key ordering.
