Write dataframe to .csv-file

Write dataframe to a .csv-file in an S3 bucket

Pandas dataframe

The following code writes a pandas dataframe to a .csv-file in an S3 bucket

import pandas as pd
import s3fs

key = 'key_name'    # name of key
bucket = 'bucket_name'    # name of bucket

# write pandas dataframe 'df' to a .csv-file in an S3-bucket
df.to_csv('s3://{}/{}'.format(bucket, key))

Dask dataframe

The following code writes a dask dataframe to a .csv-file in an S3 bucket

import dask.dataframe as dd

key = 'key_name'    # name of key
bucket = 'bucket_name'    # name of bucket

# write dask dataframe 'ddf' to a .csv-file in an S3-bucket
ddf.to_csv('s3://{}/{}'.format(bucket, key))