Deploying Meltano for Meltano
Details on how we deploy a Meltano Project to process data for MeltanoHub. We use AWS and Kubernetes (EKS) for hosting and deploy using Terraform and Helm.
How Open-Source Data Integration Will Make Your Company Future Proof
The open-source data integration space is incredible, and is changing the landscape for the future of data integration. It enables anyone to leverage a robust and production-level integration in a record amount of time, all without sacrificing the customizability of the connectors.
Our next steps for building the DataOps OS
The goal of this post is to contextualize our upcoming roadmap given the framing of our product strategy. In the previous posts in this series all about our Mission, Vision, and Strategy, we told you there would be one more post diving into some of the specific tactics of our strategy. This is that post. …
An Evolution: ETL to ELT + Operational Analytics
One of the biggest paradigm shifts in the modernizing of data processes has happened in the transition from the legacy Extract, Transform, Load (ETL) workflow to the more recent Extract, Load, Transform (ELT) approach. This evolution has also made way for another shift towards operational analytics (or “Reverse ETL” we’ll ignore the naming for now) that closes the loop by pushing data out of the warehouse and back into operational systems it came from.
Recap of Hashmap Podcast interview with Douwe Maan, Founder and CEO of Meltano
I recently had the opportunity to be a guest on the Hashmap on Tap Podcast to talk about Meltano and how we’re building a community around DataOps-driven ELT. It was a great conversation that explored Meltano’s approach to DataOps, our commitment to open source, and how Meltano is currently being used to help teams get …
Recap of Hashmap Podcast interview with Douwe Maan, Founder and CEO of Meltano Read More »
Introducing DataOps OS: our strategy for the future of data
Recently, we shared our updated mission and vision for Meltano, and now I’ll spend some time sharing how we intend to bring them to life. This post is all about our strategy. Strategy is your competitive game plan. It describes the overarching approach of how you will achieve your objectives. I want to share with …
Introducing DataOps OS: our strategy for the future of data Read More »
How we built multi-file support with the Meltano Community
One of the best parts of being an open source project with a strong supporting community is collaboration. Our community is fantastic and many of our best contributions come from community members. A recent example of this is a new feature that we launched with v1.87.0 of Meltano: support for multi-file `meltano.yml` configurations. Now, instead …
How we built multi-file support with the Meltano Community Read More »
The Latest Trend In DataOps: Meltano Environments
In a recent post, Douwe Maan (Meltano CEO), highlighted our mission and vision for Meltano. Part of that mission is our embrace of a better way of working using DataOps. At its simplest, DataOps is the application of software engineering best practices to data tooling. One of the key components of DevOps is having isolated …
The Latest Trend In DataOps: Meltano Environments Read More »
Tap-toberfest Wrap-Up
‘Tis the saison for hacking, and what better way to spend it than Tap-Toberfest? As we launched the Singer Working Group and Meltano Labs, we put a call out to the community to build taps with us using the Singer SDK from October 14th through the 21st. Thanks to you it was a big success! …
Meltano: the strategic foundation of the ideal data stack
Meltano will enable everyone to realize the full potential of their data. On top of that, we are building an open source DataOps operating system (OS) to be the foundation of every team’s ideal data stack. A lot has happened at Meltano since we’ve spun out of GitLab and started transitioning from a small project …
Meltano: the strategic foundation of the ideal data stack Read More »