Meltano 0.22 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our installation guide and starter tutorial to get going in minutes!

New

  • #477 Add ability for users to sign up for email newsletters
  • !580 Add sorting to plugins for improved UX, both UI via extractors/loaders/etc. and meltano discover all benefit from sorted results

Changes

  • #588 Updated core navigation and depth hierarchy styling to facilitate main user flow and improved information architecture
  • #591 Revert #484: remove meltano ui being run outside a Meltano project.
  • #584 Initial v1 for enabling user to setup ELT linearly through the UI via a guided sequence of steps

Fixes

  • #600 Fix a bug with meltano select when the extractor would output an invalid schema
  • #597 Automatically open the browser when meltano ui is run

Instructions for upgrading to the most current version of Meltano can be found in the version section of our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.21 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our installation guide and starter tutorial to get going in minutes!

New

  • #477 Add ability for users to sign up for email newsletters

Changes

  • #591 Revert #484: remove meltano ui being run outside a Meltano project.

Instructions for upgrading to the most current version of Meltano can be found in the version section of our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.20 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our installation guide and starter tutorial to get going in minutes!

New


Instructions for upgrading to the most current version of Meltano can be found in the version section of our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano Weekly Demo Day: 2019-04-12

In Friday’s Demo Day we show an end-to-end demo using Meltano to run the ETL, pulling data from several SaaS tools, and then showing what is possible with our pre-made “out of the box” transforms, which now ship with Meltano.

We also dug into a conversation exploring whether users will benefit from having separate “projects” or workspaces. This seems like an important thing for collaboration, but is also potentially a feature that is a bit too early in the lifecycle of Meltano given how few users we have.

As always, we welcome your feedback here in the comments as well as in our Meltano Slack community or as an issue in the Meltano project itself.

Meltano 0.19.1 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our installation guide and starter tutorial to get going in minutes!

New in 0.19.1

Fixes in 0.19.1

  • #576 Fix switching between designs now works
  • #555 Fix meltano discover improperly displaying plugins
  • #530 Fix query generation for star schemas

Instructions for upgrading to the most current version of Meltano can be found in the version section of our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.19 Released

We are thrilled to release so many improvements to Meltano this week, with a special focus on bringing greater feature parity between the Command Line Interface (CLI) and the User Interface (UI). Our vision for Meltano spans many roles in a company, often involving cross-team collaboration of a data engineer and a data analyst. Through these improvements, and many more coming in the next few weeks, we look forward to meeting our users where they’re already getting work done every day.

If this is your first time exploring Meltano, you can follow our installation guide and starter tutorial to get going in minutes!

What’s new in 0.19

Meltano UI

  • Users can now add new projects within the Meltano UI (previously CLI-only)
  • #513 Added initial end-to-end tests for the UI

Extract

  • !544 Add support for extracting data from CSV files by adding tap-csv to Meltano

Transform

Analyze

Orchestrate

  • #514 Add ‘airflow’ orchestrators plugin to enable scheduling

For Contributors:

  • #327 Add meltano add –custom switch to enable integration of custom plugins

Changes in 0.19

  • #455 Updated documentation about target-snowflake

Fixes in 0.19

  • #507 Ensure design name and table name don’t need to match so multiple designs can leverage a single base table
  • #551 Fix HDA queries generated when an attribute is used both as a column and as an aggregate.
  • #559 Add support for running custom transforms for taps without default dbt transforms.

Instructions for upgrading to the most current version of Meltano can be found in the version section of our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.18 Released

This week’s release includes the following changes to Meltano.

New

Changes

  • Remove Snowflake references from advanced tutorial.
  • #2 dbt-tap-zuora Remove custom SFDC related attributes from Zuora Account and Subscription Models
  • Update Contributing – Code Style documentation to including pycache troubleshooting

Fixes

  • #529 Resolve “SFDC Tutorial – ELT Fails due to invalid schema.yml” by #4 dbt-tap-salesforce removing the schema.yml files from the dbt models for tap-salesforce.
  • #502 Fix the situation where an m5o has no joins, the design still will work.

Instructions for upgrading to the most current version of Meltano can be found in the version section of our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano Weekly Demo Day: 2019-03-29

Each week on Friday morning the Meltano team holds our own “Demo Day”, where we share the improvements we’ve made and discuss the benefits to users. Many of these improvements will be further described in our upcoming Monday release, but we also share work in progress that may need a few more sprints to be completed.

In this week’s Demo Day:

  • Micael demos our MVC Airflow integration with Meltano, which will deliver “Solo Piano” orchestration capabilities outlined in our opportunity assessment (#514)
  • Yannis demos how simple it is to connect Meltano to Jupyter Notebooks (#539) + team discussion of personas who will use this and tutorial plans for Python, Scala, and R
  • Jacob demos Meltano UI supporting multiple projects in a single install (crucial for supporting collaboration user stories, as expressed in #516 and #539)
  • Discussion of step-by-step guide (wizard) for improve the new user onboarding experience of the Meltano UI

Check out our milestones to see what we’re working on, and learn about what’s coming next for Meltano. If you have suggestions, please file a new issue. Input welcome!

Meltano 0.17 Released

After last week’s feature rich release, this release was more focused on incremental fixes and improvements while we scope out new MVCs. To see a preview of new features we’re working on, check out Friday’s Meltano Demo Day video.

Several Fixes & Improvements

  • #501 Fix meltano ui crashing when the OS ran out of file watcher.
  • #510 Fix an issue when finding the current Meltano project in a multi-threaded environment.
  • #494 Fix broken links to installation requirements for Starter and Intermediate tutorials + Updated messaging around venv as requirement vs. recommendation
  • #492 A few small contextual additions to help streamline the release process
  • #283 Silence pip’s output when there is no error
  • #468 Added reminder in docs regarding the need for source venv/bin/activate in various situations and added minor copy updates
  • #485 Added various UI unit tests to the Analyze page

Instructions for upgrading to the most current version of Meltano can be found in the version section of our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG