Real-time data ingestion and stream processing with Apache Kafka, MQTT, and NATS JetStream. Covers producers, consumers, and stream processing patterns for data engineering pipelines.
| Feature | Apache Kafka | MQTT | NATS JetStream |
| Use Case | High-throughput event streaming | IoT, mobile, constrained devices | Cloud-native, microservices | | Throughput | Millions/sec | Thousands/sec | Hundreds of thousands/sec | | Durability | Disk-based log, replayable | Ephemeral (configurable) | Disk-based persistence | | Ordering | Per-partition | N/A (topic-based) | Per-subject |
Canalizaciones de datos en tiempo real con Apache Kafka, MQTT (IoT) y NATS JetStream. Cubre productores, consumidores, patrones de transmisión e integración con plataformas de datos. Fuente: legout/data-platform-agent-skills.