Today, we are excited to release Meltano version 1.37.0, which (among other things) lets you instantly containerize your Meltano project using meltano add files docker. Adding this file bundle to your project will add the Dockerfile and .dockerignore files needed to build a project-specific Docker container image containing Meltano, your project, and all of its plugins.
If you’d like to use GitLab CI/CD to continuously build your Meltano project’s Docker image and push it to GitLab’s built-in Container Registry, you can add the appropriate .gitlab-ci.yml and .gitlab/ci/docker.gitlab-ci.yml files to your project by adding the gitlab-ci file bundle.
Learn more about containerizing your Meltano project and deployment in production.
Shortly after v1.37.0 was released, user Charles Julian Knight reported that one of the included changes introduced a bug that caused meltano invoke airflow to fail. This has been fixed in Meltano version 1.37.1. Thanks for reporting this issue, Julian!
Excited to try it out?
To upgrade Meltano and your Meltano project to the latest version, navigate to your project directory, activate the appropriate virtual environment, and run meltano upgrade. This will upgrade the meltano package and apply any necessary changes to your project.
What else is new?
The list below (copied from the changelog) covers all of the changes made to Meltano since the release of v1.36.1 on June 19:
New
- #2048 Add
dockerandgitlab-cifile bundles to allow instant containerization - #2068 Add interface to schedule new pipelines to Pipelines page
- #2081 Add
urlconfig option totarget-postgres - #2060 Add
--format=jsonoption tomeltano schedule listso that a project’s schedules can be processed programmatically