Meltano

Meltano 0.37.2 Released

Yesterday, we encountered some issues with the release of version 0.37 and had to make some additional changes in patch releases 0.37.1 and 0.37.2

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

New

  • #763 Add inference to auto install related plugins after a user installs a specific extractor
  • #867 Add fallback values (if they aren’t set in the discovery.yml) for start date, start time, and end date for all connectors so the user has potentially one less interaction to make per connector configuration

Changes

  • #342 Swap UI app directory “webapp” and upgrade to Vue CLI 3
  • #882 Update navigation and subnavigation labels to verbs vs. nouns to inspire action and productivity when using the UI
  • #700 Update documentation to remove “$” and trim spaces to make CLI command copy/paste easier
  • #878 Write a tutorial to help users get started with PostgreSQL
  • #883 Break Extractors and Loaders sections out in the docs
  • #889 Allow for githooks to lint on commit
  • #835 Pipeline name in Schedule creation will have an automatic default

Fixes

  • #872 Updated tap-marketo and tap-stripe to leverage password input type while also improving the input type password fallback
  • #882 Fix recent minor regression regarding Dashboard routing
  • #858 Fix job_state bug so that ELT run status polling can properly resume as expected
  • #890 Fix implementation of default configuration setting to use less code
  • #894 Fix build issues with new Vue CLI 3 build process (version 0.37.1)
  • #894 Fix issue with static asset paths (version 0.37.2)

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.36 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

New

  • #793 Add introduction module to Connector Settings to allow for helper text as far as signup and documentation links
  • #796 Add dropdown option to Connector Settings to allow for more defined UI interactions
  • #802 Add support for Query Filters over columns that are not selected
  • #855 Add empty state to Dashboards and cleaned up styling for consistency with Analyze’s layout
  • #856 Add contextual information to the Analyze Connection UI to aid user understanding
  • #800 Add save success feedback for connectors, entities, and connections
  • #817 Add Meltano explainer video to the front page of Meltano.com

Changes

  • #794 Update Snowflake fields to have descriptions and utilize tooltip UI
  • #853 Improve UX for multi-attribute ordering (wider sub-UI for easier reading, clear drop target, and clearer drag animation for reenforcing sorting interaction)
  • #735 Update Entities UI to only display entity selection “Configure” CTAs for installed (vs. previously all) extractors
  • #548 Update Meltano mission, vision and path to v1 on roadmap page of Meltano.com
  • #824 Update meltano select to use the unique tap_stream_id instead of the stream property for filtering streams. This adds support for taps with multiple streams with the same name, like, for example, the ones produced by tap-postgres when tables with the same name are defined in different schemas.
  • #842 Collapse Deployment section in the docs to be under Installation

Fixes

  • #855 Fix bug that duplicated a dashboard’s reportIds that also prevented immediate UI feedback when reports were toggled (added or removed) from a dashboard via Analyze’s “Add to Dashboard” dropdown
  • #851 Fix report saving and loading to work with filters and sortBy ordering
  • #852 Update Scheduling UI to have “Run” button at all times vs conditionally to empower users to run one-off ELT pipelines even if Airflow is installed
  • #852 Update Scheduling UI “Interval” column with CTA to install Airflow while communicating why via tooltip
  • #852 Fix initial Orchestration page hydration to properly reflect Airflow installation status
  • #831 Update meltano elt to exit with 1 and report dbt’s exit code on an error message when dbt exits with a non-zero code.
  • #857 Update PluginDiscoveryService to use the cached discovery.yml when Meltano can not connect to meltano.com while trying to fetch a fresh version of the discovery file.
  • #850 Fix entities response so entities display as expected (as assumed this simple fix was due to our recent interceptor upgrade)
  • #800 Fix connector and connection settings to display saved settings by default while falling back and setting defaults if applicable

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.35 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

NEW: Watch the live stream of today’s release and product dogfooding on our YouTube channel.

New

  • !781 Add new Advanced Tutorial on how to use tap-postgres with Meltano
  • #784 Add multiple attribute ordering with drag and drop ordering in the UI

Changes

  • #784 As part of multiple attribute sorting and keeping the attributes and results sub-UIs in sync, we know autorun queries based on user interaction after the initial explicit “Run” button interaction

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano Demo Day 2019-08-02

Meltano Demo Day agenda:

  • Derek/Yannis: multi-order sorting
  • Ben: new config, settings, and docs
  • Micael: shout out to community people and the bugs we’ve fixed
  • Micael: speak about the two hotfixes
  • Danielle: How we are doing testing going forward (live dogfooding sessions starting next week) after release

Meltano 0.34 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #757 Update ‘meltano permissions’ to add support for GRANT ALL and FUTURE GRANTS on tables in schemas
  • #760 Update ‘meltano permissions’ to add support for granting permissions on VIEWs
  • #812 meltano ui will now stop stale Airflow workers when starting
  • #762 Added run ELT via the UI (manages multiple and simultaneous runs)
  • #232 Meltano now bundles Alembic migrations to support graceful database upgrades

Changes

  • #828 Docker installation instructions have been dogfooded, clarified, and moved to Installation section

Fixes

  • #807 Fix filter input validation when editing saved filters
  • #822 Fix pipeline schedule naming via slugify to align with Airflow DAG naming requirements
  • #820 Fix meltano select not properly connecting to the system database
  • #787 Fix results sorting to support join tables
  • #832 Fix schedule creation endpoint to return properly typed response (this became an issue as a result of our recent case conversion interceptor)
  • #819 Running the Meltano UI using gunicorn will properly update the system database

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.33 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

Upgrading Meltano

To upgrade Meltano run the following command:

pip install --upgrade meltano

New

  • #788 Reydrate filters in Analyze UI after loading a saved report containing filters

Changes

  • #804 Connection set in the Design view are now persistent by Design

Fixes

  • #788 Properly reset the default state of the Analyze UI so stale results aren’t displayed during a new analysis
  • !806 Fix filters editing to prevent input for is_null and is_not_null while also ensuring edits to existing filter expressions types adhere to the same preventitive input.
  • #582 Remove the export statements in the default .env initialized by meltano init.
  • #816 Fix meltano install failing when connections where specified in the meltano.yml
  • #786 Fixed an issue with the SQL engine would mixup table names with join/design names

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG