Singer JSONL is a data integration tool.

Singer JSONL is an open-source data integration tool that allows users to extract data from various sources, transform it, and load it into a destination of their choice in JSONL format. It supports a wide range of data sources and destinations, including databases, APIs, and cloud-based services, and can be easily extended with custom connectors. Singer JSONL is designed to be simple, reliable, and scalable, making it a popular choice for data integration projects of all sizes.

Settings

Source

The URL or file path to the JSONL data source.

Add Record Metadata

Whether or not to add metadata to each record, such as a timestamp and source.

Folders

A list of folders to search for JSONL files.

Recursive

Whether or not to search for JSONL files recursively within the specified folders.

Paths

A list of specific file paths to JSONL files.

Bucket

The name of the S3 bucket containing the JSONL files.

Prefix

The prefix within the S3 bucket where the JSONL files are located.

Paths

S3 file paths to singer-formatted files. Note: extension is ignored, and compression is inferred automatically by smart_open. Both s3.prefix and s3.paths can be specified together.