python - 错误导入 awswrangler : AttributeError: module 'multiprocessing' has no attribute 'connection'

Question

我有一个使用 lib awswrangler 的 python 脚本。今天我的 scrpit 开始在导入库时出错，我不知道发生了什么。我在带有图像 python 的 docker 容器中运行脚本:3.8

例子:

import awswrangler as wr

print(wr.__version__)

错误:

Traceback (most recent call last):
  File "src/avec/automation/TaskBaseUserPass.py", line 1, in <module>
    from awswrangler.pandas import Pandas
  File "/usr/local/lib/python3.8/site-packages/awswrangler/__init__.py", line 17, in <module>
    from awswrangler.pandas import Pandas  # noqa
  File "/usr/local/lib/python3.8/site-packages/awswrangler/pandas.py", line 45, in <module>
    class Pandas:
  File "/usr/local/lib/python3.8/site-packages/awswrangler/pandas.py", line 273, in Pandas
    def _read_csv_once_remote(send_pipe: mp.connection.Connection, session_primitives: "SessionPrimitives",
AttributeError: module 'multiprocessing' has no attribute 'connection'

Answer 1

我今天在尝试导入 awswrangler 时遇到了同样的问题。对我来说，降级以下依赖项有帮助:

pip install fsspec==0.6.3 PyAthena==1.10.2 s3fs==0.4.0

似乎是其中一个或多个导致了问题。