I want to extract data from a...
Unlock the benefits of Meltano
Largest connector library of any EL tool
Modify connectors to your liking
In-flight filtering and hashing of PII
Detailed pipeline logs and alerting
Open source and cloud-agnostic
Experience Meltano
Extract
Set up your SaaS API connection
Terminal
# Discover source connectors (aka extractors) on Meltano Hubopen https://hub.meltano.com/extractors# Add GitHub extractormeltano add extractor tap-github
meltano.yml
plugins:extractors:- name: tap-githubvariant: meltanolabspip_url: git+https://github.com/MeltanoLabs/tap-github.git
Load
Set up your destination database connection
Terminal
# Discover destination connectors (aka loaders) on Meltano Hubopen https://hub.meltano.com/loaders# Add Snowflake loadermeltano add loader target-snowflake
meltano.yml
plugins:loaders:- name: target-snowflakevariant: transferwisepip_url: pipelinewise-target-snowflake
Run
Sync data once or on a schedule
Terminal
# Create named jobmeltano job add github-to-snowflake --tasks "tap-github target-snowflake"
meltano.yml
jobs:- name: github-to-snowflaketasks:- tap-github- target-snowflake
Enjoy
Meltano is now syncing your data in production!