gpt4 book ai didi

apache-spark - Apache Spark "Py4JError: Answer from Java side is empty"

转载 作者:行者123 更新时间:2023-12-04 16:07:04 33 4
gpt4 key购买 nike

我每次都收到这个错误...
我用苏打水...
我的配置文件:

***"spark.driver.memory 65g
spark.python.worker.memory 65g
spark.master local[*]"***

数据量约为5 Gb。
没有关于此错误的其他信息...
有人知道为什么会这样吗?谢谢!
***"ERROR:py4j.java_gateway:Error while sending or receiving.
Traceback (most recent call last):
File "/data/analytics/Spark1.6.1/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 746, in send_command
raise Py4JError("Answer from Java side is empty")
Py4JError: Answer from Java side is empty
ERROR:py4j.java_gateway:An error occurred while trying to connect to the Java server
Traceback (most recent call last):
File "/data/analytics/Spark1.6.1/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 690, in start
self.socket.connect((self.address, self.port))
File "/usr/local/anaconda/lib/python2.7/socket.py", line 228, in meth
return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused
ERROR:py4j.java_gateway:An error occurred while trying to connect to the Java server
Traceback (most recent call last):
File "/data/analytics/Spark1.6.1/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 690, in start
self.socket.connect((self.address, self.port))
File "/usr/local/anaconda/lib/python2.7/socket.py", line 228, in meth
return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused
ERROR:py4j.java_gateway:An error occurred while trying to connect to the Java server
Traceback (most recent call last):
File "/data/analytics/Spark1.6.1/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 690, in start
self.socket.connect((self.address, self.port))
File "/usr/local/anaconda/lib/python2.7/socket.py", line 228, in meth
return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused"***

最佳答案

您是否尝试过设置 spark.executor.memoryspark.driver.memory在您的 Spark 配置文件中?

https://stackoverflow.com/a/22742982/5453184了解更多信息。

关于apache-spark - Apache Spark "Py4JError: Answer from Java side is empty",我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/37252809/

33 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com