Meltano SDK for Taps 0.1.3 is now available!

We’ve been hard at work building in new features in the SDK and responding to developer feedback. Version 0.1.3 is an important update which includes the following updates:

  • Added a new is_sorted stream property, which allows long-running incremental streams to be resumed if interrupted.
  • Added the signpost feature to prevent bookmarks from advancing beyond the point where all records have been streamed.
  • Added get_replication_key_signpost() stream method which defaults to the current time for timestamp-based replication keys.

And the following bug fixes:

  • Fixed a scenario where unsorted incremental streams would generate incorrect STATE bookmarks. — Thanks, @Egi!
  • Fixed a problem where CI pipelines would fail when run from a fork. — Thanks, @Derek Visch!
  • Fixed fatal error when running from the cookiecutter shell script

We also have a newly updated Meltano Tutorial: “How to Create a Custom Extractor” which walks you through how to use the SDK together with Meltano. If you have been curious about building with the SDK, this is a great place to get started.

For more information or to join the conversation, find us in the #singer-sdk channel on Slack!