Real-time data ingestion and stream processing with Apache Kafka, MQTT, and NATS JetStream. Covers producers, consumers, and stream processing patterns for data engineering pipelines.
| Feature | Apache Kafka | MQTT | NATS JetStream |
| Use Case | High-throughput event streaming | IoT, mobile, constrained devices | Cloud-native, microservices | | Throughput | Millions/sec | Thousands/sec | Hundreds of thousands/sec | | Durability | Disk-based log, replayable | Ephemeral (configurable) | Disk-based persistence | | Ordering | Per-partition | N/A (topic-based) | Per-subject |
Конвейеры данных в реальном времени с Apache Kafka, MQTT (IoT) и NATS JetStream. Охватывает производителей, потребителей, шаблоны потоковой передачи и интеграцию с платформами данных. Источник: legout/data-platform-agent-skills.