Open source data integration has never been easier, or faster: with Meltano, extracting data from GitLab and loading it into PostgreSQL (or Snowflake, BigQuery, Redshift…) takes just 90 seconds from initializing a new Meltano project to viewing the loaded data: Resulting Meltano project repository: https://gitlab.com/meltano/speedrun Tools Meltano: ELT for the DataOps era – https://meltano.com/ tap-gitlab: …
An Open Source Data Stack will enable even better outcomes for more data professionals around the world.
It is now possible to run connectivity tests on any tap created in the Singer ecosystem. Previously there was no way of running simple tests on the hundreds of non-Meltano SDK taps already in existence. Even better – this test can be set as a scheduled job, giving you early notice of issues affecting your …
Testability now available for all taps in the Singer ecosystem Read More »
Why Assemble? Well, not to be too literal, but we assembled. The name Assemble is a reference to Meltano being used to assemble a data stack/pipeline. The event itself was originally inspired by GitLab’s team offsites called Contribute. At Contribute, the entire all-remote team gathers to bond and meet face-to-face. We wanted to bring our …
Today, we are excited to release Meltano version 1.79.0, which: updates the default dbt version for new installs to v0.20 updates the default Airflow version to 2.1 adds support for python 3.9 adds discovery_url_auth project setting to support endpoints requiring Authorization headers (thanks Reuben Frankel!) adds support to allow executable to be overridden through plugin inheritance …
Today, we are excited to release Meltano version 1.79.0, which: adds full support for tap selection metadata as specified by the Singer Spec, including metadata for selected, selected-by-default, and inclusion improves performance for Targets which use batched sink operations (thanks, Pat Nadolny!) fixed a bug causing targets to emit an invalid STATE payload (thanks, Pat Nadolny!) …
Another successful Demo Day on the books. If you missed it, you can watch the livestream recording on YouTube. Want to see your project listed here? Join us in #demo-day on Slack and let us know! AJ Steers, our Head of Engineering, kicked us off with opening Meltano projects directly in VS Code. Projects will …
Today, we are excited to release Meltano version 1.78.0, which adds the following bug fixes and stability improvements: improves the out-of-box experience for Meltano UI by defaulting to transform=skip in new pipelines fixes incorrect or misleading error messages when invoking Airflow fixes installation errors when running meltano add with parallel installs that depend on other files …
Today we are excited to announce the latest version of Meltano SDK for Taps and Targets! This release adds JSONPath support for for the Tap SDK, and two bug fixes for batch-based targets in the new Target SDK. JSONPath for Records and Pagination Parsing We’re always looking for ways to help developers get more done …
It’s the first Demo Day where Meltano is a separate startup and it was best one yet! If you missed it, the recording of the livestream is available on the Meltano YouTube channel. We kicked off Demo Day by recapping our big announcements on Wednesday – Meltano is officially a separate company spun out of …
Today is a big day for Meltano and open source data tooling: Three years after starting inside GitLab, and one year after pivoting to open source ELT with Singer and dbt, Meltano is now an independent startup! We have spun out of GitLab and raised a $4.2M Seed funding round led by GV to bring …
