Python - download entire directory from Google Cloud Storage(Python - 从 Google Cloud Storage 下载整个目录)
问题描述
在下一页
https://googlecloudplatform.github.io/google-cloud-python/latest/storage/blob.html
有所有可用于 Python & 的 API 调用.谷歌云存储.即使在 github 上的官方"示例中
there are all the API calls which can be used for Python & Google Cloud storage. Even in the "official" samples on github
https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/storage/cloud-client/snippets.py
没有相关的例子.
最后,用与下载文件相同的方法下载目录会报错
Finally, downloading a directory with the same method used for download files gives the error
Error: [Errno 21] Is a directory:
推荐答案
你只需要先列出一个目录下的所有文件,然后一个一个下载:
You just have to first list all the files in a directory and then download them one by one:
bucket_name = 'your-bucket-name'
prefix = 'your-bucket-directory/'
dl_dir = 'your-local-directory/'
storage_client = storage.Client()
bucket = storage_client.get_bucket(bucket_name=bucket_name)
blobs = bucket.list_blobs(prefix=prefix) # Get list of files
for blob in blobs:
filename = blob.name.replace('/', '_')
blob.download_to_filename(dl_dir + filename) # Download
blob.name
包括整个目录结构+文件名,所以如果你想要和bucket中相同的文件名,你可能想先提取它(而不是替换/
与 _
)
blob.name
includes the entire directory structure + filename, so if you want the same file name as in the bucket, you might want to extract it first (instead of replacing /
with _
)
这篇关于Python - 从 Google Cloud Storage 下载整个目录的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持编程学习网!
本文标题为:Python - 从 Google Cloud Storage 下载整个目录


- 如何将一个类的函数分成多个文件? 2022-01-01
- 如何在 python3 中将 OrderedDict 转换为常规字典 2022-01-01
- python-m http.server 443--使用SSL? 2022-01-01
- python check_output 失败,退出状态为 1,但 Popen 适用于相同的命令 2022-01-01
- 使用Heroku上托管的Selenium登录Instagram时,找不到元素';用户名'; 2022-01-01
- padding='same' 转换为 PyTorch padding=# 2022-01-01
- 沿轴计算直方图 2022-01-01
- 分析异常:路径不存在:dbfs:/databricks/python/lib/python3.7/site-packages/sampleFolder/data; 2022-01-01
- pytorch 中的自适应池是如何工作的? 2022-07-12
- 如何在 Python 的元组列表中对每个元组中的第一个值求和? 2022-01-01