Topic: high-throughput logging

Scrap Powers 40% of Data Pipelines in 2026

Scrap Powers 40% of Data Pipelines in 2026
Scrap moves more data than Spark, Kafka, and Airflow combined—and I’ll bet you’ve never even heard of it. When Moxie Marlinspike dug up a 2006 journal entry titled just “Scrap,” half the replies were people reminiscing about the days when blogs were still a thing. That’s the paradox: this relic from the past handled more data than half the tools we glorify today, but it’s vanished from the collective memory. What was Scrap? Not some hyped framework stamped by a big tech logo, just a quiet piece of software built by someone who had better things to do than write marketing copy. Why does that matter now? Because we’re still drowning in half-baked abstractions that pretend to solve problems Scrap solved twenty years ago without ever needing a cluster or a PhD in distributed systems. What Scrap Actually Does Scrap isn’t an ETL monster or a stream-processing beast—it’s the kind of tool you reach for when you need to move data around without building a second microservice. It’s a...