gpt4 book ai didi

ssh - 创建spark集群,无需ssh无密码访问

转载 作者:行者123 更新时间:2023-12-03 03:49:02 34 4
gpt4 key购买 nike

如何设置 Spark 集群而不使用无密码访问设置 ssh,因为 document提到:

If you do not have a password-less setup, you can set the environment variable SPARK_SSH_FOREGROUND and serially provide a password for each worker.

我想知道如何使用 SPARK_SSH_FOREGROUND 变量??

最佳答案

环境变量SPARK_SSH_FOREGROUND可以设置为yesy之类的东西,以在前台执行ssh

正如您在源代码中看到的:

https://github.com/apache/spark/pull/2444/commits/1bba8a959ea9ecf21eb0783d3ce302065bf1a154

if [ "${SPARK_SSH_FOREGROUND}" = "y" ] || [ "${SPARK_SSH_FOREGROUND}" = "yes" ]; then
ssh $SPARK_SSH_OPTS "$slave" $"${@// /\\ }" \

关于ssh - 创建spark集群,无需ssh无密码访问,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/37246119/

34 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com