google-cloud-storage - 如何在tensorflow模型中使用python访问google云存储桶中最新上传的对象

Question

我正在使用 tensorflow 模型，我想使用最新的 ulpoad 对象，以便从上传的对象中获取输出。有没有办法使用Python访问上传到Google云存储桶的最新对象。

Answer 1

下面是我用来抓取最新更新的对象的内容。

实例化您的客户端

from google.cloud import storage
# first establish your client
storage_client = storage.Client()

通过前缀定义bucket_name和任何其他路径

# get your blobs
bucket_name = 'your-glorious-bucket-name'
prefix = 'special-directory/within/your/bucket' # optional

迭代客户端返回的blob

将这些存储为元组记录既快速又高效。

blobs = [(blob, blob.updated) for blob in storage_client.list_blobs(
    bucket_name,
    prefix = prefix,
)]

按第二个元组值对列表进行排序

# sort and grab the latest value, based on the updated key
latest = sorted(blobs, key=lambda tup: tup[1])[-1][0]
string_data = latest.download_as_string()

Metadata key docs and Google Cloud Storage Python client docs.

One-liner

# assumes storage_client as above
# latest is a string formatted response of the blob's data
latest = sorted([(blob, blob.updated) for blob in storage_client.list_blobs(bucket_name, prefix=prefix)], key=lambda tup: tup[1])[-1][0].download_as_string()