import boto3 s3 = boto3.client('s3') s3.download_file('my-bucket-name', 'path/in/s3/data.csv', 'local-filename.csv') Use code with caution.
This is useful for streaming data into a buffer like io.BytesIO or an already open file handle.
response = s3.get_object(Bucket='my-bucket-name', Key='data.json') content = response['Body'].read().decode('utf-8') print(content) Use code with caution. C. Download to File-like Object ( download_fileobj ) download s3 data python
Use this when you want to process data in Python without saving it to disk first (e.g., reading a JSON or CSV into a variable).
: Bucket (name), Key (S3 path), and Filename (local destination). B. Download to Memory ( get_object ) import boto3 s3 = boto3
This is the most common method for saving an object directly to your hard drive.
Boto3 provides three main ways to retrieve data from S3, depending on where you want the data to go. A. Download to Local File ( download_file ) Key (S3 path)
import os bucket_name = 'my-bucket' prefix = 'my-folder/' # The "folder" path in S3 bucket = boto3.resource('s3').Bucket(bucket_name) for obj in bucket.objects.filter(Prefix=prefix): # Ensure local directory exists target = obj.key if not os.path.exists(os.path.dirname(target)): os.makedirs(os.path.dirname(target), exist_ok=True) # Download the file bucket.download_file(obj.key, target) Use code with caution. Downloading files - Boto3 1.43.5 documentation
S3 uses a "flat" structure, so there is no single download_folder command. Instead, you must list the objects and download them individually while recreating the folder structure locally.
To start, you must install the Boto3 library and configure your AWS credentials. : Use pip to install the package: pip install boto3 Use code with caution.