We’ve been hard at work building in new features in the SDK and responding to developer feedback. Version 0.1.3 is an important update which includes the following updates:
- Added a new
is_sorted
stream property, which allows long-running incremental streams to be resumed if interrupted. - Added the signpost feature to prevent bookmarks from advancing beyond the point where all records have been streamed.
- Added
get_replication_key_signpost()
stream method which defaults to the current time for timestamp-based replication keys.
And the following bug fixes:
- Fixed a scenario where unsorted incremental streams would generate incorrect STATE bookmarks. — Thanks, @Egi!
- Fixed a problem where CI pipelines would fail when run from a fork. — Thanks, @Derek Visch!
- Fixed fatal error when running from the cookiecutter shell script
We also have a newly updated Meltano Tutorial: “How to Create a Custom Extractor” which walks you through how to use the SDK together with Meltano. If you have been curious about building with the SDK, this is a great place to get started.
For more information or to join the conversation, find us in the #singer-sdk channel on Slack!