Meltano 0.32.1 and 0.32.2 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #759 Added filtering functionality to the Analyze UI while additionally cleaning it up from a UI/UX lens

Fixes

  • #792 Fix an error when trying to schedule an extractor that didn’t expose a start_date.

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.32 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • !718 Add support for filters (WHERE and HAVING clauses) to MeltanoQuery and Meltano’s SQL generation engine
  • #748 Added the Connections plugin to move the Analyze connection settings to the system database
  • #748 Added the meltano config command to manipulate a plugin’s configuration

Fixes

!726 Fixed InputDateIso8601’s default value to align with HTML’s expected empty string default


Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.31 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #766 Add Codeowners file so that the “approvers” section on MRs is more useful for contributors
  • #750 Various UX updates (mostly tooltips) to make the configuration UI for scheduling orchestration easier to understand
  • #739 Updated discovery.yml for better consistency of UI order within each connector’s settings (authentication -> contextual -> start/end dates). Improved various settings’ kind, label, and description. Added a documentation prop to provide a documentation link for involved settings (temp until we have better first class support for more complex setting types)

Fixes

  • #737 Fixed UI flash for connector settings when installation is complete but configSettings has yet to be set
  • #751 Fixed the Orchestrations view by properly checking if Airflow is installed so the correct directions display to the user

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.30 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #736 Add “Cancel”, “Next”, and a message to the entities UI when an extractor doesn’t support discovery and thus entity selection
  • #730 Updated Analyze Models page UI with improved content organization so it is easier to use
  • #710 Updated connector (extractor and loader) settings with specific control type (text, password, email, boolean, and date) per setting, added form validation, and added an inference by default for password and token fields as a protective measure
  • #719 Added InputDateIso8601.vue component to standardize date inputs in the UI while ensuring the model data remains in Iso8601 format on the frontend.
  • #643 Updated minimallyValidated computeds so that new users are intentionally funneled through the pipelines ELT setup UI (previously they could skip past required steps)
  • #752 Fix the schedule having no start_date when the extractor didn’t expose a start_date setting

Fixes

  • !703 Fix ScheduleService instantiation due to signature refactor

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.29 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #724 Add the model-gitlab-ultimate plugin to Meltano. It includes .m5o files for analyzing data available for Gitlab Ultimate or Gitlab.com Gold accounts (e.g. Epics, Epic Issues, etc) fetched using the Gitlab API. Repository used: https://gitlab.com/meltano/model-gitlab-ultimate
  • #723 Add proper signage and dedicated sub-navigation area in views/pages. Standardized the view -> sub-view markup relationships for consistent layout. Directory refactoring for improved organization.
  • #612 Move the plugins’ configuration to the database, enabling configuration from the UI

Changes

  • #636 Refactored connector logo related logic into a ConnectorLogo component for code cleanliness, reusability, and standardization
  • #728 Change error notification button link to open the bugs issue template

Fixes

  • #718 Fix dynamically disabled transforms always running. Transforms can now be dynamically disabled inside a dbt package and Meltano will respect that. It will also respect you and your time.
  • #684 Enables WAL on SQLite to handle concurrent processes gracefully
  • #732 Fix plugin installation progress bar that wasn’t updating upon installation completion

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.28 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • !683 Add --start-date to meltano schedule to give the control over the catch up logic to the users
  • #651 Added model installation in the Analyze UI to bypass an otherwise “back to the CLI step”
  • #676 Add pipeline schedule UI for viewing and saving pipeline schedules for downstream use by Airflow/Orchestration

Changes

  • #708 Enable tap-gitlab to run using Gitlab Ultimate and Gitlab.com Gold accounts and extract Epics and Epic Issues.
  • #717 Enable dbt-tap-gitlab to run using Gitlab Ultimate and Gitlab.com Gold accounts and generate transformed tables that depend on Epics and Epic Issues.

Fixes

  • #716 Fix entities UI so only installed extractors can edit selections
  • #715 Remove reimport of Bulma in /orchestration route to fix borked styling

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano Dogfooding 2019-06-11

Each week we release on Monday, and then I update my version locally and try to run through out Getting Started Guide. I’ve decided to start doing this in the open, in the spirit of building in the open with full transparency to our process.

Dogfooding in this way is pretty humbling, and as we build out in the open I want to be able to share with our community that I am running into the same issues they are seeing and we are diligently working to fix the bugs.

I’ve embedded the dogfooding video below, and you can read the issue I created (which you can see me write up live in the video) here: https://gitlab.com/meltano/meltano/issues/699

If you have feedback for us on Meltano, you are welcome to email hello@meltano.com or even create an issue on the Meltano repo.

Meltano 0.27 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • !640 Google Analytics logo addition for recent tap-google-analytics Extractor addition
  • #671 Add the tap-google-analytics transform to Meltano. It is using the dbt package defined in https://gitlab.com/meltano/dbt-tap-google-analytics
  • #672 Add the model-google-analytics plugin to Meltano. It includes .m5o files for analyzing data fetched from the Google Analytics Reporting API. Repository used: https://gitlab.com/meltano/model-google-analytics
  • #687 Implemented a killswitch to prevent undefined behaviors when a Meltano project is not compatible with the installed meltano version

Fixes

  • #661 Fixed empty UI for extractors that lack configuration settings by providing feedback message with actionable next steps
  • #663 Fixed Airflow error when advancing to Orchestration step after installing and saving a Loader configuration
  • #254 Fixed meltano init not working on terminal with cp1252 encoding
  • #254 Fixed meltano add/install crashing on Windows
  • #664 Minor CSS fix ensuring Airflow UI height is usable (side-effect of recent reparenting)
  • #679 Fix an issue with meltano select emitting duplicate properties when the property used the anyOf type
  • #650 Add MELTANO_DISABLE_TRACKING environment variable to disable all tracking
  • #670 Update tests to not send tracking events

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG