gpt4 book ai didi

azure - 我可以复制azure blob文件夹而不遍历每个blob文件吗?

转载 作者:行者123 更新时间:2023-12-01 22:17:27 25 4
gpt4 key购买 nike

当前,我使用golang实施从一个存储帐户到另一个存储帐户的复制文件。

例如:

https://storage1.blob.core.windows.net/container/A/B/file1.mp4
https://storage1.blob.core.windows.net/container/A/B/file2.mp4
https://storage1.blob.core.windows.net/container/A/B/file3.mp4


Copy from

https://storage1.blob.core.windows.net/container/A/B/
to
https://storage2.blob.core.windows.net/container/A/B/

我可以复制整个文件夹而不遍历文件夹A / B中的所有文件吗?

这是我的示例代码



func (css StorageOperator) NestedListBlobs(ctx context.Context, srcFolderPath string) ([]azblob.BlobURL, error) {

containerName, folderPath := css.getContainerNameAndPath(srcFolderPath)
containerRawUrl := "https://" + css.StorageName + "." + lib.AzureBlobUrl + "/" + containerName
containerUrl, _ := url.Parse(containerRawUrl)
po := azblob.NewPipeline(css.sharedKeyCredential, css.createPipelineOptions())
container := azblob.NewContainerURL(*containerUrl, po)

var blobUrls []azblob.BlobURL

// List the blob(s) in our container; since a container may hold millions of blobs, this is done 1 segment at a time.
for marker := (azblob.Marker{}); marker.NotDone(); {
// The parens around Marker{} are required to avoid compiler error.
// Get a result segment starting with the blob indicated by the current Marker.
listBlob, err := container.ListBlobsFlatSegment(ctx, marker, azblob.ListBlobsSegmentOptions{
Prefix: folderPath,
})
if err != nil {
return nil, err
}
// IMPORTANT: ListBlobs returns the start of the next segment; you MUST use this to get
// the next segment (after processing the current result segment).
marker = listBlob.NextMarker

// Process the blobs returned in this result segment (if the segment is empty, the loop body won't execute)
for _, blobInfo := range listBlob.Segment.BlobItems {
css.logger.Debugf("Blob name: " + containerRawUrl + "/" + blobInfo.Name)

blobUrl, _ := url.Parse(containerRawUrl + "/" + blobInfo.Name)
blobUrls = append(blobUrls, azblob.NewBlobURL(*blobUrl, po))
}
}

return blobUrls, nil
}

func (css StorageOperator) parallelCopyFileToDst(ctx context.Context, po pipeline.Pipeline, dstRawUrl string, srcBlobs []azblob.BlobURL) error {


for _, srcBlob := range srcBlobs {


dstUrl, _ := url.Parse(dstRawUrl + css.extractBlobPath(srcBlob))

dstBlobURL := azblob.NewBlobURL(*dstUrl, po)
srcSASUrl, err := css.createSASURL(css.lukeSharedKeyCredential, srcBlob.String())
if err != nil {
css.logger.Errorf("createSASURL fail:%v", err)
return
}
startCopy, err := dstBlobURL.StartCopyFromURL(ctx,
*srcSASUrl,
azblob.Metadata{},
azblob.ModifiedAccessConditions{},
azblob.BlobAccessConditions{})

if err != nil {
css.logger.Errorf("startCopy fail:%v", err)
return
}

if err = css.checkCopyStatus(ctx, dstBlobURL, startCopy); err != nil {
css.logger.Errorf("checkCopyStatus fail:%v", err)
return
}


}//for
return nil
}

最佳答案

天蓝色blob内的文件夹结构不存在,而是使用路径名,因此,如果要在“虚拟文件夹”中复制blob,您所需要做的就是使用路径,以下是python列出blob的示例:

  ['Virtual-Folder/Boards.png', 'storage2.gif']

因此,为了传输Boards.png Blob,您必须在文件夹名称之前附加文件夹名称,而不要在文件夹中查找。我用python写了一些与此示例/问题有关的教程: https://github.com/adamsmith0016/Azure-storage

关于azure - 我可以复制azure blob文件夹而不遍历每个blob文件吗?,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/58691342/

25 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com