Today, we are excited to release Meltano version 1.51.0, which simplifies debugging extractor catalog generation, pipeline state lookup, and pipeline-specific configuration by letting you dump the contents of meltano elt
‘s generated catalog, state, and config files to STDOUT (or a file) using a new --dump
option with possible values catalog
, state
, extractor-config
, and loader-config
:
# Dump generated catalog in catalog.json
meltano elt <extractor> <loader> --job_id=<pipeline name> --dump=catalog > catalog.json
# Dump generated state in state.json
meltano elt <extractor> <loader> --job_id=<pipeline name> --dump=state > state.json
# View generated extractor config
meltano elt <extractor> <loader> --job_id=<pipeline name> --dump=extractor-config
# View generated loader config
meltano elt <extractor> <loader> --job_id=<pipeline name> --dump=loader-config
Excited to try it out?
To upgrade Meltano and your Meltano project to the latest version, navigate to your project directory, activate the appropriate virtual environment, and run meltano upgrade
. This will upgrade the meltano
package and apply any necessary changes to your project.
What else is new?
The list below (copied from the changelog) covers all of the changes made to Meltano since the release of v1.50.0 on September 17:
New
- #2355 Add
meltano elt
--dump
option with possible valuescatalog
,state
,extractor-config
, andloader-config
to dump content of pipeline-specific generated file
Fixes
- #2358 Don’t unintentionally deselect all attributes other than those marked
inclusion: automatic
when using extractorselect_filter
extra ormeltano elt
‘s--select <entity>
option