mysql - 如何使用 Pyenv virtualenv 在 Mac 上的 Python3.7.4 上安装 Apache Airflow

Question

我正在使用 Pyenv 在 Mac Catalina 上工作，目标是安装 apache-airflow[all]。我失败了，特别是 apache-airflow[mysql]这是我的食谱:

pyenv virtualenv 3.7.4 test
pyenv activate  test
pip install --upgrade pip
pip install Cython

pip install 'apache-airflow[mysql]'
pip install 'apache-airflow[all]'

我尝试了很多不同的堆栈溢出补救措施来安装 apache-airflow[mysql]，包括

brew upgrade mysql
brew install mysql-connector-c

如何安装MYSQL客户端？如何在 virtualenv 上安装完整的 apache airflow？

这是使用 pyenv virtualenv 的错误

(tst) ➜  ~ python -V
Python 3.7.4
(tst) ➜  ~ pip install mysqlclient
Collecting mysqlclient
  Using cached     https://files.pythonhosted.org/packages/d0/97/7326248ac8d5049968bf4ec708a5d3d4806e412a42e74160d7f266a3e03a/mysqlclient-1.4.6.tar.gz
Installing collected packages: mysqlclient
Running setup.py install for mysqlclient ... error
ERROR: Command errored out with exit status 1:
 command: /Users/gideonbar/.pyenv/versions/3.7.4/envs/tst/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/t_/ccp4hjg92rzbpjrc4d3cnpm00000gn/T/pip-install-dy9_xr4y/mysqlclient/setup.py'"'"'; __file__='"'"'/private/var/folders/t_/ccp4hjg92rzbpjrc4d3cnpm00000gn/T/pip-install-dy9_xr4y/mysqlclient/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/t_/ccp4hjg92rzbpjrc4d3cnpm00000gn/T/pip-record-pdn28c7j/install-record.txt --single-version-externally-managed --compile --install-headers /Users/gideonbar/.pyenv/versions/3.7.4/envs/tst/include/site/python3.7/mysqlclient
     cwd: /private/var/folders/t_/ccp4hjg92rzbpjrc4d3cnpm00000gn/T/pip-install-dy9_xr4y/mysqlclient/
Complete output (30 lines):
running install
running build
running build_py
creating build
creating build/lib.macosx-10.15-x86_64-3.7
creating build/lib.macosx-10.15-x86_64-3.7/MySQLdb
copying MySQLdb/__init__.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb
copying MySQLdb/_exceptions.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb
copying MySQLdb/compat.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb
copying MySQLdb/connections.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb
copying MySQLdb/converters.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb
copying MySQLdb/cursors.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb
copying MySQLdb/release.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb
copying MySQLdb/times.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb
creating build/lib.macosx-10.15-x86_64-3.7/MySQLdb/constants
copying MySQLdb/constants/__init__.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb/constants
copying MySQLdb/constants/CLIENT.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb/constants
copying MySQLdb/constants/CR.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb/constants
copying MySQLdb/constants/ER.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb/constants
copying MySQLdb/constants/FIELD_TYPE.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb/constants
copying MySQLdb/constants/FLAG.py -> build/lib.macosx-10.15-x86_64-3.7/MySQLdb/constants
running build_ext
building 'MySQLdb._mysql' extension
creating build/temp.macosx-10.15-x86_64-3.7
creating build/temp.macosx-10.15-x86_64-3.7/MySQLdb
clang -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -Dversion_info=(1,4,6,'final',0) -D__version__=1.4.6 -I/usr/local/Cellar/mysql/8.0.18_1/include/mysql -I/Users/gideonbar/.pyenv/versions/3.7.4/envs/tst/include -I/Users/gideonbar/.pyenv/versions/3.7.4/include/python3.7m -c MySQLdb/_mysql.c -o build/temp.macosx-10.15-x86_64-3.7/MySQLdb/_mysql.o
clang -bundle -undefined dynamic_lookup -L/usr/local/opt/readline/lib -L/usr/local/opt/readline/lib -L/Users/gideonbar/.pyenv/versions/3.7.4/lib -L/usr/local/opt/readline/lib -L/usr/local/opt/readline/lib -L/Users/gideonbar/.pyenv/versions/3.7.4/lib build/temp.macosx-10.15-x86_64-3.7/MySQLdb/_mysql.o -L/usr/local/Cellar/mysql/8.0.18_1/lib -lmysqlclient -lssl -lcrypto -o build/lib.macosx-10.15-x86_64-3.7/MySQLdb/_mysql.cpython-37m-darwin.so
ld: library not found for -lssl
clang: error: linker command failed with exit code 1 (use -v to see invocation)
error: command 'clang' failed with exit status 1
----------------------------------------
ERROR: Command errored out with exit status 1: /Users/gideonbar/.pyenv/versions/3.7.4/envs/tst/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/t_/ccp4hjg92rzbpjrc4d3cnpm00000gn/T/pip-install-dy9_xr4y/mysqlclient/setup.py'"'"'; __file__='"'"'/private/var/folders/t_/ccp4hjg92rzbpjrc4d3cnpm00000gn/T/pip-install-dy9_xr4y/mysqlclient/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/t_/ccp4hjg92rzbpjrc4d3cnpm00000gn/T/pip-record-pdn28c7j/install-record.txt --single-version-externally-managed --compile --install-headers /Users/gideonbar/.pyenv/versions/3.7.4/envs/tst/include/site/python3.7/mysqlclient Check the logs for full command output.
(tst) ➜  ~

我尝试点击此链接

https://github.com/JudgeGirl/Judge-sender/issues/4

brew install mysql # install mysql
brew unlink mysql
brew install mysql-connector-c

# 在 ~/.zshrc 中更新路径并将 mysql bin 文件夹设置为路径

MYSQL_VER=8.0.18_1
export PATH=/usr/local/Cellar/mysql/$MYSQL_VER/bin:$PATH
sudo ln -s /usr/local/Cellar/mysql/$MYSQL_VER/lib/libmysqlclient.21.dylib /usr/local/Cellar/mysql-client/8.0.18/lib/libmysqlclient.21.dylib # create symlink

在终端中:

pyenv activate tst
pip install mysqlclient # install mysql-client finally

Answer 1

如果您在 Mac 中安装 Airflow 时遇到以下错误 Invalid active developer path error after upgrading to El Capitan

尝试以下方法修复依赖关系

xcode-select --install

安装apache Airflow

pip install apache-airflow