Design a Telemetry Pipeline for Manufacturing Sensors

Problem

Design a system that ingests and analyzes sensor telemetry from semiconductor fabrication lines to detect defects early.

Requirements

Functional:

• Ingest high-rate sensor data per tool
• Real-time anomaly detection
• Historical querying for yield analysis
• Alerting to engineers

Non-functional:

• 1000s of tools, millions of readings/sec
• Low-latency anomaly alerts
• Long retention for analysis

Discussion points

1. Ingestion and buffering (Kafka)
2. Stream processing for anomaly detection
3. Time-series storage and downsampling
4. Alerting and dashboards
5. Backfill and reprocessing