python - 如何通过 .py 运行 blob 数据传输

Question

我尝试创建一个在我的虚拟机中运行的程序，以便我可以将数据从目录传输到我的 azure blob 存储帐户。每当我在程序外部(在命令行上)运行该命令时，它都会起作用，但是，如果我运行包含运行该命令的子进程的程序，它就不起作用。

这是我通过命令行发送的有效内容:

sudo ./azcopy cp "/directory/subdirectory" "https://myblob.blob.core.windows.net/container[SAS]" --recursive=true

数据传输完毕。

当我把它放入程序中时，我遇到了很多问题。

当前代码:

import subprocess
import os
import sys
try:
    key = ('SAS')
    file_path = ('/directory/subdirectory')
    full_link = ('"https://myblob.blob.core.windows.net/' + key + '"')
    transfer = subprocess.check_output(['azcopy', 'cp', file_path,
                                        full_link,
                                        '--recursive=true'], stderr=subprocess.STDOUT)
    print('Transfer Complete.')
# except subprocess.CalledProcessError as e:
#     raise RuntimeError("command '{}' return with error (code {}): {}".format(e.cmd, e.returncode, e.output))
except EOFError as error:
    #Output for EOF error, would be caused by missing SAS
    print('Error with SAS')
except Exception as e:
    #When an unexpected error has occured.
    print(str(e) + 'Unknown error has occured')
exit(0)

输出:

Command '['azcopy', 'cp', '/directory/subdirectory', '"https://myblob.blob.core.windows.net/[SAS]"', '--recursive=true']' 
returned non-zero exit status 1Unknown error has occured

如果我重新添加当前注释掉的代码中的 except 语句，则会收到此错误:

Traceback (most recent call last):
  File "data_transfer.py", line 11, in <module>
    '--recursive=true'], stderr=subprocess.STDOUT)
  File "/usr/lib/python3.5/subprocess.py", line 626, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.5/subprocess.py", line 708, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['azcopy', 'cp', 'datadrive/peeled-images', '"https://myblob.blob.core.windows.net[SAS]"', '--recursive=true']' returned non-zero exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "data_transfer.py", line 14, in <module>
    raise RuntimeError("command '{}' return with error (code {}): {}".format(e.cmd, e.returncode, e.output))
RuntimeError: command '['azcopy', 'cp', '/directory/subdirectory', '"https://myblob.blob.core.windows.net/[SAS]"', '--recursive=true']' return with error (code 1): b'\nfailed to parse user input due to error: the inferred source/destination combination is currently not supported. Please post an issue on Github if support for this scenario is desired\n'

非常感谢所有帮助

Answer 1

对此的答案是更改以下行:

subprocess.check_output(['azcopy', 'cp', '/directory/subdirectory',
                 full_link, '--recursive=true'], stderr=subprocess.STDOUT)

需要的改变是:

subprocess.call(['azcopy', 'cp', '/directory/subdirectory',
                 full_link, '--recursive=true'], stderr=subprocess.STDOUT)

这是因为这是为了运行和执行程序，不一定提供特定的输出。