Search code examples
pythonpython-3.xgoogle-cloud-storagebotogoogle-cloud-platform

How to upload a file to Google Cloud Storage on Python 3?


How can I upload a file to Google Cloud Storage from Python 3? Eventually Python 2, if it's infeasible from Python 3.

I've looked and looked, but haven't found a solution that actually works. I tried boto, but when I try to generate the necessary .boto file through gsutil config -e, it keeps saying that I need to configure authentication through gcloud auth login. However, I have done the latter a number of times, without it helping.


Solution

  • Use the standard gcloud library, which supports both Python 2 and Python 3.

    Example of Uploading File to Cloud Storage

    from gcloud import storage
    from oauth2client.service_account import ServiceAccountCredentials
    import os
    
    
    credentials_dict = {
        'type': 'service_account',
        'client_id': os.environ['BACKUP_CLIENT_ID'],
        'client_email': os.environ['BACKUP_CLIENT_EMAIL'],
        'private_key_id': os.environ['BACKUP_PRIVATE_KEY_ID'],
        'private_key': os.environ['BACKUP_PRIVATE_KEY'],
    }
    credentials = ServiceAccountCredentials.from_json_keyfile_dict(
        credentials_dict
    )
    client = storage.Client(credentials=credentials, project='myproject')
    bucket = client.get_bucket('mybucket')
    blob = bucket.blob('myfile')
    blob.upload_from_filename('myfile')