Parquet
P
Parquet

target-parquet (estrategiahq variant)

Parquet is a columnar storage format for Hadoop.

Parquet is a software tool that provides a columnar storage format for Hadoop, allowing for efficient and optimized processing of large datasets. It is designed to work with a variety of data processing frameworks, including Apache Spark, Apache Hive, and Apache Impala, and supports a wide range of data types and compression algorithms. Parquet is particularly useful for data analytics and business intelligence applications, as it enables fast and efficient querying of large datasets, while minimizing storage and processing costs.

Settings

Disable Collection

A setting to disable the collection of statistics during the Parquet API connection.

Logging Level

A setting to specify the level of logging for the Parquet API connection.

Destination Path

The path where the Parquet files will be saved.

Compression Method

The compression method to be used for the Parquet files.

Streams In Separate Folder

A setting to specify whether the streams should be saved in a separate folder.

File Size

The maximum size of each Parquet file.

Meltano Community Connector

Parquet connector is available on Meltano Community. It is built by our growing community of over 5000+ developers. Refer to the Install section below to verify the readiness of this connector.

Why Meltano?
Access to Meltano Slack communityJoin 5,500+ data engineers and analytics practitioners. The community is active, helpful, and always on. Good for quick questions, sharing patterns, and learning what others are building.