11. Batch Processing
11.11 Forward links
| Concept here | Where it's developed |
|---|---|
| Unbounded inputs; reacting in seconds instead of hours | Ch 12 — Stream Processing |
| Pushing batch output into Kafka topics | Ch 12 |
| Composing batch and stream deliberately | Ch 13 — A Philosophy of Streaming Systems |
| Columnar storage and vectorized execution | Ch 4 |
| LSM segment merging (the same algorithm as shuffle sorting) | Ch 4 §2 |
| Sharding by hash of key (how shuffle assigns reducers) | Ch 7 §3.2 |
| Star schemas — the fact/dimension join | Ch 3 §1.7 |
| Coordination services holding cluster state | Ch 10 §4 |
| Avro and Parquet as batch file formats | Ch 5 |
| Read-committed isolation (the model for hiding incomplete job output) | Ch 8 §3.1 |