Learn Labs
13. A Philosophy of Streaming Systems

13.12 Backward links — where each idea came from

Idea hereEstablished in
Systems of record vs derived dataCh 1 §1.8
Evolvability; minimizing irreversibilityCh 2 §5.3
Event sourcing and CQRSCh 3 §3
Indexes as derived structures; the write/read trade-offCh 4
Rolling upgrades; schema evolutionCh 5
The dual-write race; multi-leader conflicts; read-your-writesCh 6, Ch 12 §3.1
Sharding and secondary indexes (term- vs document-partitioned)Ch 7 §5
Weak isolation levels; write skew; 2PC and XA's failuresCh 8
System models; what we assume can and cannot fail; fencingCh 9
Total order broadcast = consensus; state machine replication; uniqueness needs consensusCh 10
Immutable inputs; reprocessing; batch fault toleranceCh 11
CDC, log compaction, exactly-once, time-dependence of joinsCh 12
Ethics, regulation, and the limits of deletionCh 14