Stories and value-packed sessions from the leaders of data community. Find new trends, hot topics and industry insights.
05 Oct 2026
I think data teams have a complexity problem. We’ve spent years adding tools, layers, tests and frameworks to make data engineering more robust. Much of that has helped, but somewhere along the way complexity started to look a bit too much like progress. We can end up building technically impressive…
01 Oct 2026
I've spent years building an ingestion business. So it might sound strange for me to tell you to think about ingestion less. But that's exactly my advice. The companies I see getting the most value from their data spend almost no time thinking about how it arrives. They think about what it's for.
30 Sep 2026
If your BigQuery pipelines have ever felt the squeeze of an SLA window closing fast, this one's for you. target-bigquery now supports Arrow BATCH messages, and early benchmarks show it loading data up to 6x faster, without you touching a single config file.
30 Sep 2026
If you're syncing data out of Snowflake, extraction speed probably isn't something you think about until it becomes a problem: a sync that used to finish before your team's morning standup now bleeds into the afternoon. tap-snowflake just fixed that. It can now stream data as native Arrow batches in…
29 Sep 2026
"We'd love to move off Fivetran, but it would be a nightmare." I hear some version of that most weeks. It sounds like a sensible answer. It's usually wrong. Most teams massively overestimate what's involved in switching ingestion tools. This post breaks down what actually moves, what doesn't, and wh…
29 Sep 2026
The Fivetran renewal lands. The number has gone up again. Your data hasn't changed much, but the bill has. That's usually the moment the question comes up: what would it actually take to move? This post answers that. Why teams are leaving, what changes when you move to Meltano, and exactly how the m…
17 Sep 2026
Moving data into Microsoft SQL Server through Meltano just got a lot quicker. target-mssql now supports Arrow-based BATCH messages, and benchmarks show up to 24x faster loads compared to the previous row-by-row approach.
10 Sep 2026
For years, data platforms made the same bet: keep the work in the browser. A console, a connector catalog, a configuration wizard, a docs site open in the next tab. If it lived in the UI, anyone could do it. Your job as the analytics engineer was to translate between that interface and the pipeline …
04 Sep 2026
A failure alert usually tells you one thing: something broke. To find out what, you log in, hunt down the right pipeline in a list of twenty or thirty, and read through logs line by line. That's before you've even started the fix. Now the diagnosis beats you there. Melty AI writes up what failed and…
03 Sep 2026
Does Meltano reliably honor custom environment variable names, or does it silently fall back to defaults? Rather than assume it works-only to find out otherwise in production-we built a minimal pipeline to verify the behavior and inspected the actual runtime logs.