Meltano 0.34 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #757 Update ‘meltano permissions’ to add support for GRANT ALL and FUTURE GRANTS on tables in schemas
  • #760 Update ‘meltano permissions’ to add support for granting permissions on VIEWs
  • #812 meltano ui will now stop stale Airflow workers when starting
  • #762 Added run ELT via the UI (manages multiple and simultaneous runs)
  • #232 Meltano now bundles Alembic migrations to support graceful database upgrades

Changes

  • #828 Docker installation instructions have been dogfooded, clarified, and moved to Installation section

Fixes

  • #807 Fix filter input validation when editing saved filters
  • #822 Fix pipeline schedule naming via slugify to align with Airflow DAG naming requirements
  • #820 Fix meltano select not properly connecting to the system database
  • #787 Fix results sorting to support join tables
  • #832 Fix schedule creation endpoint to return properly typed response (this became an issue as a result of our recent case conversion interceptor)
  • #819 Running the Meltano UI using gunicorn will properly update the system database

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.33 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #788 Reydrate filters in Analyze UI after loading a saved report containing filters

Changes

  • #804 Connection set in the Design view are now persistent by Design

Fixes

  • #788 Properly reset the default state of the Analyze UI so stale results aren’t displayed during a new analysis
  • !806 Fix filters editing to prevent input for is_null and is_not_null while also ensuring edits to existing filter expressions types adhere to the same preventitive input.
  • #582 Remove the export statements in the default .env initialized by meltano init.
  • #816 Fix meltano install failing when connections where specified in the meltano.yml
  • #786 Fixed an issue with the SQL engine would mixup table names with join/design names

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.32.1 and 0.32.2 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #759 Added filtering functionality to the Analyze UI while additionally cleaning it up from a UI/UX lens

Fixes

  • #792 Fix an error when trying to schedule an extractor that didn’t expose a start_date.

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.32 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • !718 Add support for filters (WHERE and HAVING clauses) to MeltanoQuery and Meltano’s SQL generation engine
  • #748 Added the Connections plugin to move the Analyze connection settings to the system database
  • #748 Added the meltano config command to manipulate a plugin’s configuration

Fixes

!726 Fixed InputDateIso8601’s default value to align with HTML’s expected empty string default


Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.31 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #766 Add Codeowners file so that the “approvers” section on MRs is more useful for contributors
  • #750 Various UX updates (mostly tooltips) to make the configuration UI for scheduling orchestration easier to understand
  • #739 Updated discovery.yml for better consistency of UI order within each connector’s settings (authentication -> contextual -> start/end dates). Improved various settings’ kind, label, and description. Added a documentation prop to provide a documentation link for involved settings (temp until we have better first class support for more complex setting types)

Fixes

  • #737 Fixed UI flash for connector settings when installation is complete but configSettings has yet to be set
  • #751 Fixed the Orchestrations view by properly checking if Airflow is installed so the correct directions display to the user

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.30 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #736 Add “Cancel”, “Next”, and a message to the entities UI when an extractor doesn’t support discovery and thus entity selection
  • #730 Updated Analyze Models page UI with improved content organization so it is easier to use
  • #710 Updated connector (extractor and loader) settings with specific control type (text, password, email, boolean, and date) per setting, added form validation, and added an inference by default for password and token fields as a protective measure
  • #719 Added InputDateIso8601.vue component to standardize date inputs in the UI while ensuring the model data remains in Iso8601 format on the frontend.
  • #643 Updated minimallyValidated computeds so that new users are intentionally funneled through the pipelines ELT setup UI (previously they could skip past required steps)
  • #752 Fix the schedule having no start_date when the extractor didn’t expose a start_date setting

Fixes

  • !703 Fix ScheduleService instantiation due to signature refactor

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.29 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #724 Add the model-gitlab-ultimate plugin to Meltano. It includes .m5o files for analyzing data available for Gitlab Ultimate or Gitlab.com Gold accounts (e.g. Epics, Epic Issues, etc) fetched using the Gitlab API. Repository used: https://gitlab.com/meltano/model-gitlab-ultimate
  • #723 Add proper signage and dedicated sub-navigation area in views/pages. Standardized the view -> sub-view markup relationships for consistent layout. Directory refactoring for improved organization.
  • #612 Move the plugins’ configuration to the database, enabling configuration from the UI

Changes

  • #636 Refactored connector logo related logic into a ConnectorLogo component for code cleanliness, reusability, and standardization
  • #728 Change error notification button link to open the bugs issue template

Fixes

  • #718 Fix dynamically disabled transforms always running. Transforms can now be dynamically disabled inside a dbt package and Meltano will respect that. It will also respect you and your time.
  • #684 Enables WAL on SQLite to handle concurrent processes gracefully
  • #732 Fix plugin installation progress bar that wasn’t updating upon installation completion

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.28 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guideto get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • !683 Add --start-date to meltano schedule to give the control over the catch up logic to the users
  • #651 Added model installation in the Analyze UI to bypass an otherwise “back to the CLI step”
  • #676 Add pipeline schedule UI for viewing and saving pipeline schedules for downstream use by Airflow/Orchestration

Changes

  • #708 Enable tap-gitlab to run using Gitlab Ultimate and Gitlab.com Gold accounts and extract Epics and Epic Issues.
  • #717 Enable dbt-tap-gitlab to run using Gitlab Ultimate and Gitlab.com Gold accounts and generate transformed tables that depend on Epics and Epic Issues.

Fixes

  • #716 Fix entities UI so only installed extractors can edit selections
  • #715 Remove reimport of Bulma in /orchestration route to fix borked styling

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG