Real-time data ingestion and stream processing with Apache Kafka, MQTT, and NATS JetStream. Covers producers, consumers, and stream processing patterns for data engineering pipelines.
| Feature | Apache Kafka | MQTT | NATS JetStream |
| Use Case | High-throughput event streaming | IoT, mobile, constrained devices | Cloud-native, microservices | | Throughput | Millions/sec | Thousands/sec | Hundreds of thousands/sec | | Durability | Disk-based log, replayable | Ephemeral (configurable) | Disk-based persistence | | Ordering | Per-partition | N/A (topic-based) | Per-subject |
Pipelines de données en temps réel avec Apache Kafka, MQTT (IoT) et NATS JetStream. Couvre les producteurs, les consommateurs, les modèles de streaming et l’intégration avec les plateformes de données. Source : legout/data-platform-agent-skills.