Meltano 0.40 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

New

  • #916 Add Transform step as first-class and adjacent step to Extract and Load
  • #916 Improve Create Pipeline Schedule default selection UX by leveraging “ELT recents” concept
  • #936 Add “Refresh Airflow” button in Orchestrate to bypass route change or full-page refresh when iframe doesn’t initially inflate as expected (this will likely be automated once the root cause is determined)
  • #899 Add deep linking improvements to reports and dashboards to better facilitate sharing
  • #899 Add “Edit” and “Explore” buttons to each report instance displayed in a dashboard to enable editing said report and exploring a fresh and unselected analysis of the same model and design

Changes

  • #909 Default names will be generated for Reports and Dashboards
  • #892 Improve experience for parsing Snowflake URL for ID by showing processing step
  • #935 Update Entity Selection to be nested in the Extract step so each ELT step is consecutive
  • #886 Add validation for grouping settings as the next iteration of improved form validation for generated connector settings

Fixes

  • #931 Fix Analyze Connections identifier mismatch resulting from recent linting refactor
  • #919 Fix Airflow iframe automatic UI refresh
  • #937 Fix Chart.vue prop type error

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano Demo Day 2019-08-30

Showcasing a whole bunch of new goodness:

  • Ben
    • Snowflake configuration UI improvements
    • Saved reports and dashboards have default names with timestamps
  • Derek
    • Pipeline configuration UI updated, Transform has its own step and Select is nested within Extract
    • Extractor configuration now has data validation and makes it clear what is required
    • Dashboards UI improvements
  • Danielle
    • DigitalOcean Droplet creation tutorial

Meltano 0.39 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

New

  • #838 Add indicator for speed run plugins
  • #870 Add global footer component in docs
  • #871 Add contributing link in footer of docs
  • #908 Add auto installation for Airflow Orchestrator for improved UX
  • #912 Auto run the ELT of a saved Pipeline Schedule by default
  • #907 Add auto select of “All” for Entities Selection step and removed the performance warning (a future iteration will address the “Recommended” implementation and the display of a resulting performance warning when “All” is selected and “Recommended” ignored)
  • #799 Standardized code conventions on the frontend and updated related documentation (issues related to further linting enforcement will soon follow)

Changes

  • #838 Speed run plugins prioritized to top of the list
  • #896 Add documentation for how to do patch releases
  • #885 Add docs for all extractors and loaders
  • #885 All plugin modal cards show docs text if they have docs
  • #733 Improve error feedback to be more specific when plugin installation errors occur

Fixes

  • #923 Fix contributing release docs merge conflict issue

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Using Airflow Within Meltano

With the release of Meltano v0.38, users are now able to install Apache Airflow from the Meltano UI with a single click and then utilize it’s powerful orchestration capabilities from within the Meltano UI to schedule ELT runs.

This functionality is crucial to our path to V1, which requires that we eliminate all requirements that the Meltano UI user execute commands from the command line to use our product. While all command line functionality will still work, and is documented, the goal is to make Meltano accessible to users who don’t want to (or don’t know how to) use the command line.

At this point, the final 2 command line steps for us to elimate are meltano init which creates a new instance of meltano and meltano ui which launches the Meltano UI to the browser at localhost:5000.

Next up: We are looking forward to offering one-click installs on Amazon, Dreamhost, DigitalOcean, and anywhere else users want this capability!


If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

Meltano 0.38 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

New

  • #746 Add CTA to specific dashboard in “Add to Dashboard” sub-UI
  • #746 Add toast feedback on success, update, or error for schedules, reports, and dashboards
  • #814 Install Airflow via the Orchestration UI (we may do this in the background automatically in the future)

Changes

  • #901 Update entities plugins to be alphabetically sorted for consistency with extractors ordering

Fixes

  • #746 Prevent duplicate schedule, report, and dashboard creation if there is an existing item
  • #900 Fix fallback value for Iso8601 dates/times
  • #903 Fix columns display issue for the base table in Analyze

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.37.2 Released

Yesterday, we encountered some issues with the release of version 0.37 and had to make some additional changes in patch releases 0.37.1 and 0.37.2

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

New

  • #763 Add inference to auto install related plugins after a user installs a specific extractor
  • #867 Add fallback values (if they aren’t set in the discovery.yml) for start date, start time, and end date for all connectors so the user has potentially one less interaction to make per connector configuration

Changes

  • #342 Swap UI app directory “webapp” and upgrade to Vue CLI 3
  • #882 Update navigation and subnavigation labels to verbs vs. nouns to inspire action and productivity when using the UI
  • #700 Update documentation to remove “$” and trim spaces to make CLI command copy/paste easier
  • #878 Write a tutorial to help users get started with PostgreSQL
  • #883 Break Extractors and Loaders sections out in the docs
  • #889 Allow for githooks to lint on commit
  • #835 Pipeline name in Schedule creation will have an automatic default

Fixes

  • #872 Updated tap-marketo and tap-stripe to leverage password input type while also improving the input type password fallback
  • #882 Fix recent minor regression regarding Dashboard routing
  • #858 Fix job_state bug so that ELT run status polling can properly resume as expected
  • #890 Fix implementation of default configuration setting to use less code
  • #894 Fix build issues with new Vue CLI 3 build process (version 0.37.1)
  • #894 Fix issue with static asset paths (version 0.37.2)

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG

Meltano 0.36 Released

If this is your first time exploring Meltano for your company’s data pipeline management, you can follow our Installation Guide and Getting Started Guide to get going in minutes!

New

  • #793 Add introduction module to Connector Settings to allow for helper text as far as signup and documentation links
  • #796 Add dropdown option to Connector Settings to allow for more defined UI interactions
  • #802 Add support for Query Filters over columns that are not selected
  • #855 Add empty state to Dashboards and cleaned up styling for consistency with Analyze’s layout
  • #856 Add contextual information to the Analyze Connection UI to aid user understanding
  • #800 Add save success feedback for connectors, entities, and connections
  • #817 Add Meltano explainer video to the front page of Meltano.com

Changes

  • #794 Update Snowflake fields to have descriptions and utilize tooltip UI
  • #853 Improve UX for multi-attribute ordering (wider sub-UI for easier reading, clear drop target, and clearer drag animation for reenforcing sorting interaction)
  • #735 Update Entities UI to only display entity selection “Configure” CTAs for installed (vs. previously all) extractors
  • #548 Update Meltano mission, vision and path to v1 on roadmap page of Meltano.com
  • #824 Update meltano select to use the unique tap_stream_id instead of the stream property for filtering streams. This adds support for taps with multiple streams with the same name, like, for example, the ones produced by tap-postgres when tables with the same name are defined in different schemas.
  • #842 Collapse Deployment section in the docs to be under Installation

Fixes

  • #855 Fix bug that duplicated a dashboard’s reportIds that also prevented immediate UI feedback when reports were toggled (added or removed) from a dashboard via Analyze’s “Add to Dashboard” dropdown
  • #851 Fix report saving and loading to work with filters and sortBy ordering
  • #852 Update Scheduling UI to have “Run” button at all times vs conditionally to empower users to run one-off ELT pipelines even if Airflow is installed
  • #852 Update Scheduling UI “Interval” column with CTA to install Airflow while communicating why via tooltip
  • #852 Fix initial Orchestration page hydration to properly reflect Airflow installation status
  • #831 Update meltano elt to exit with 1 and report dbt’s exit code on an error message when dbt exits with a non-zero code.
  • #857 Update PluginDiscoveryService to use the cached discovery.yml when Meltano can not connect to meltano.com while trying to fetch a fresh version of the discovery file.
  • #850 Fix entities response so entities display as expected (as assumed this simple fix was due to our recent interceptor upgrade)
  • #800 Fix connector and connection settings to display saved settings by default while falling back and setting defaults if applicable

Instructions for upgrading to the most current version of Meltano are available in our documentation.

To see the full history of improvements to Meltano, please review our CHANGELOG