S3 CSV is a file format used for storing data in Amazon S3.

Amazon S3 is a cloud-based storage service that allows users to store and retrieve data from anywhere on the web. S3 CSV is a file format used for storing data in S3 that is organized in rows and columns, similar to a spreadsheet. This format is commonly used for storing large amounts of data that can be easily accessed and analyzed using various tools and applications. S3 CSV files can be easily imported and exported to other applications, making it a popular choice for data storage and analysis in the cloud.

Prerequisites

To obtain the AWS Access Key Id and AWS Secret Access Key, you need to go to the AWS Management Console, navigate to the IAM service, and create an IAM user with programmatic access. During the user creation process, you will be provided with the Access Key Id and Secret Access Key.

To obtain the S3 Bucket name, you need to navigate to the S3 service in the AWS Management Console and select the bucket that contains the CSV file you want to connect to. The name of the bucket will be displayed in the bucket details page.

Settings

AWS Access Key Id

The access key ID for the AWS account.

AWS Secret Access Key

The secret access key for the AWS account.

AWS Session token

The session token for the AWS account.

AWS endpoint URL

The endpoint URL for the S3 bucket.

AWS profile

The name of the AWS profile to use.

S3 Bucket name

The name of the S3 bucket to connect to.

S3 Key Prefix

The prefix for the S3 keys to read.

delimiter

The delimiter used in the CSV file.

Quote Char

The character used to quote fields in the CSV file.

Add Metadata Columns

Whether to add metadata columns to the output.

Encryption Type

The type of encryption used for the S3 bucket.

Compression

The compression type used for the CSV file.

Naming Convention

The naming convention used for the output files.