python - Azure ML 错误 : NotImplementedError: Linux distribution debian 11. 没有自动支持

Question

我正在尝试将我的模型训练为 Azure ML 作业。我将模型训练为 Docker 容器。但是，在执行 Azure ML 作业时，我不断收到此错误:

Warning: Falling back to use azure cli login credentials.
If you run your code in unattended mode, i.e., where you can't give a user input, then we recommend to use ServicePrincipalAuthentication or MsiAuthentication.
Please refer to aka.ms/aml-notebook-auth for different authentication mechanisms in azureml-sdk.
2022-10-24 13:01:49.839951 | ActivityCompleted: Activity=_dataflow, HowEnded=Failure, Duration=903.73 [ms], Info = {'activity_id': '9a734e5b-752b-4f5d-bcc3-682eee0346eb', 'activity_name': '_dataflow', 'activity_type': 'InternalCall', 'app_name': 'dataset', 'source': 'azureml.dataset', 'version': '1.46.0', 'dataprepVersion': '4.5.7', 'sparkVersion': '', 'subscription': '308339c6-d455-4395-ae62-5de2a35792e6', 'run_id': 'experiment-niels-i4t_1666616328_bd67e032', 'resource_group': 'i4talent_mlops', 'workspace_name': 'mlops_template', 'experiment_id': '0e131a58-b02e-471f-bf9f-e8c12dfc045f', 'location': 'germanywestcentral', 'completionStatus': 'Success', 'durationMs': 364.36}, Exception=NotImplementedError; Linux distribution debian 11. does not have automatic support. 
Missing packages: {'liblttng-ust.so.0', 'libcurl.so.4'}
.NET Core 3.1 can still be used via `dotnetcore2` if the required dependencies are installed.
Visit https://aka.ms/dotnet-install-linux for Linux distro specific .NET Core install instructions.
Follow your distro specific instructions to install `dotnet-runtime-*` and replace `*` with `3.1.23`.

2022-10-24 13:01:49.839875 | ActivityCompleted: Activity=to_pandas_dataframe, HowEnded=Failure, Duration=904.0 [ms], Info = {'activity_id': '043091e8-2c47-4a1d-be34-72200a827822', 'activity_name': 'to_pandas_dataframe', 'activity_type': 'PublicApi', 'app_name': 'TabularDataset', 'source': 'azureml.dataset', 'version': '1.46.0', 'dataprepVersion': '4.5.7', 'sparkVersion': '', 'subscription': '308339c6-d455-4395-ae62-5de2a35792e6', 'run_id': 'experiment-niels-i4t_1666616328_bd67e032', 'resource_group': 'i4talent_mlops', 'workspace_name': 'mlops_template', 'experiment_id': '0e131a58-b02e-471f-bf9f-e8c12dfc045f', 'location': 'germanywestcentral', 'completionStatus': 'Success', 'durationMs': 364.36}, Exception=NotImplementedError; Linux distribution debian 11. does not have automatic support. 
Missing packages: {'liblttng-ust.so.0', 'libcurl.so.4'}
.NET Core 3.1 can still be used via `dotnetcore2` if the required dependencies are installed.
Visit https://aka.ms/dotnet-install-linux for Linux distro specific .NET Core install instructions.
Follow your distro specific instructions to install `dotnet-runtime-*` and replace `*` with `3.1.23`.

Cleaning up all outstanding Run operations, waiting 300.0 seconds
1 items cleaning up...
Cleanup took 0.08137202262878418 seconds
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dotnetcore2/runtime.py", line 271, in attempt_get_deps
    blob_deps_to_file()
  File "/usr/local/lib/python3.9/site-packages/dotnetcore2/runtime.py", line 263, in blob_deps_to_file
    blob = request.urlopen(deps_url, context=ssl_context)
  File "/usr/local/lib/python3.9/urllib/request.py", line 214, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/local/lib/python3.9/urllib/request.py", line 523, in open
    response = meth(req, response)
  File "/usr/local/lib/python3.9/urllib/request.py", line 632, in http_response
    response = self.parent.error(
  File "/usr/local/lib/python3.9/urllib/request.py", line 561, in error
    return self._call_chain(*args)
  File "/usr/local/lib/python3.9/urllib/request.py", line 494, in _call_chain
    result = func(*args)
  File "/usr/local/lib/python3.9/urllib/request.py", line 641, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "train.py", line 5, in <module>
    train()
  File "/usr/local/lib/python3.9/site-packages/mlops_i4t/machine_learning/model_utils.py", line 56, in train
    df = dataset.to_pandas_dataframe()
  File "/usr/local/lib/python3.9/site-packages/azureml/data/_loggerfactory.py", line 132, in wrapper
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/azureml/data/tabular_dataset.py", line 168, in to_pandas_dataframe
    dataflow = get_dataflow_for_execution(self._dataflow, 'to_pandas_dataframe', 'TabularDataset')
  File "/usr/local/lib/python3.9/site-packages/azureml/data/_loggerfactory.py", line 132, in wrapper
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/azureml/data/abstract_dataset.py", line 221, in _dataflow
    dataprep().api._datastore_helper._set_auth_type(self._registration.workspace)
  File "/usr/local/lib/python3.9/site-packages/azureml/dataprep/api/_datastore_helper.py", line 177, in _set_auth_type
    get_engine_api().set_aml_auth(SetAmlAuthMessageArgument(auth_type, json.dumps(auth_value)))
  File "/usr/local/lib/python3.9/site-packages/azureml/dataprep/api/engineapi/api.py", line 19, in get_engine_api
    _engine_api = EngineAPI()
  File "/usr/local/lib/python3.9/site-packages/azureml/dataprep/api/engineapi/api.py", line 102, in __init__
    self._message_channel = launch_engine()
  File "/usr/local/lib/python3.9/site-packages/azureml/dataprep/api/engineapi/engine.py", line 333, in launch_engine
    dependencies_path = runtime.ensure_dependencies()
  File "/usr/local/lib/python3.9/site-packages/dotnetcore2/runtime.py", line 285, in ensure_dependencies
    if not attempt_get_deps(missing_pkgs):
  File "/usr/local/lib/python3.9/site-packages/dotnetcore2/runtime.py", line 279, in attempt_get_deps
    raise NotImplementedError(err_msg + '\n' + _unsupported_help_msg)
NotImplementedError: Linux distribution debian 11. does not have automatic support. 
Missing packages: {'liblttng-ust.so.0', 'libcurl.so.4'}
.NET Core 3.1 can still be used via `dotnetcore2` if the required dependencies are installed.
Visit https://aka.ms/dotnet-install-linux for Linux distro specific .NET Core install instructions.
Follow your distro specific instructions to install `dotnet-runtime-*` and replace `*` with `3.1.23`.

运行此作业的集群是 STANDARD_DS3_V2。

此外，我的 Dockerfile 如下所示:

FROM python:3.9-slim

RUN pip install azure-cli
RUN az login --service-principal -u "xxxxxxxx"  -p "xxxxxx" --tenant "xxxxxx"
COPY requirements.txt .
RUN pip install --no-cache-dir -r requirements.txt
COPY . .
RUN pip install . --use-feature=fast-deps
RUN echo "Finished installing packages."

我迷路了......有人经历过同样的事情吗？
如何更改 Docker 中的 dot net core 版本？

Answer 1

Debian 并不支持所有 .net 版本。 Debian 11 将与 .Net core 3.1 和 .Net 6 一起运行。

不再支持以下版本的 .NET:

• .NET 5

• .NET Core 3.0

• .NET Core 2.2

• .NET Core 2.1

• .NET Core 2.0

在安装 .Net 之前，运行下面提到的命令将 Microsoft 包签名 key 添加到您的受信任 key 列表中。

wget https://packages.microsoft.com/config/debian/11/packages-microsoft-prod.deb -O packages-microsoft-prod.deb
sudo dpkg -i packages-microsoft-prod.deb
rm packages-microsoft-prod.deb

安装 .Net SDK 允许您安装 .Net 6.0。

sudo apt-get update && \
  sudo apt-get install -y dotnet-sdk-6.0

使用以下命令我们可以使用 Debian 11 连接。