windows - 为什么 Zeppelin 0.6.2 笔记本在 Windows 上使用 Spark 2.0 失败并显示 "The input line is too long"？

Question

我在带有 Spark 2.0 的 Windows 中运行 Zeppelin 0.6.2

SPARK_HOME=C:\Users\anbarasu.r\Desktop\Archive\spark-2.0.0-bin-hadoop2.6
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m;support was removed in 8.0
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/C:/Users/anbarasu.r/Desktop/Archive/zeppelin-0.6.2-bin-all/zeppelin 0.6.2-bin-all/lib/slf4j-log4j12         1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/C:/Users/anbarasu.r/Desktop/Archive/zeppelin-0.6.2-bin-all/zeppelin-0.6.2-bin-all/lib/zeppelin-interpreter-0.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Nov 19, 2016 1:48:15 PM com.sun.jersey.api.core.PackagesResourceConfig init INFO: Scanning for root resource and provider classes in the packages:  org.apache.zeppelin.rest
Nov 19, 2016 1:48:15 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.zeppelin.rest.ZeppelinRestApi
class org.apache.zeppelin.rest.ConfigurationsRestApi
class org.apache.zeppelin.rest.CredentialRestApi
class org.apache.zeppelin.rest.NotebookRestApi
class org.apache.zeppelin.rest.LoginRestApi
class org.apache.zeppelin.rest.InterpreterRestApi
class org.apache.zeppelin.rest.SecurityRestApi`
Nov 19, 2016 1:48:15 PM com.sun.jersey.api.core.ScanningResourceConfig init
INFO: No provider classes found.
Nov 19, 2016 1:48:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.13 06/29/2012 05:14 PM'
Nov 19, 2016 1:48:18 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.InterpreterRestApi.listInterpreter(java.lang.String), should not consume any entity.
WARNING: A sub-resource method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.NotebookRestApi.createNote(java.lang.String) throws java.io.IOException, with URI template, "/", is treated as a resource method
WARNING: A sub-resource method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.NotebookRestApi.getNotebookList() throws java.io.IOException, with URI template, "/", is treated as a resource method
SPARK_HOME=C:\Users\anbarasu.r\Desktop\Archive\spark-2.0.0-bin-hadoop2.6
The input line is too long.

错误

The input line is too long

当我在笔记本上运行任何命令时出现在命令行中。

但 Zeppelin 0.6.2 与 Spark 1.6.2 完美配合

请建议一种使 Zeppelin 0.6.2 与 Spark 2.0.0 一起工作的方法。

Answer 1

错误的原因在于让人们如此“喜欢”Windows 的“细节”:) 它过去对命令行的支持非常差。

(我说“曾经有”，因为最近有了 bash 和 Docker 支持，情况发生了变化)

我强烈建议将 Spark 和 Zeppelin 安装在路径较短的目录中，比如:

1. c:\spark 用于 Apache Spark
2. c:\zeppelin 用于 Apache Zeppelin

然后重新开始。

此外，您无需单独安装 Spark 即可使用 Zeppelin，因为它预装/捆绑了 Spark。这让您不用担心，即不需要 SPARK_HOME。

你得到它们如下:

1. Apache Spark 的 C:\Users\anbarasu.r\Desktop\Archive\spark-2.0.0-bin-hadoop2.6
2. C:/Users/anbarasu.r/Desktop/Archive/zeppelin-0.6.2-bin-all/zeppelin-0.6.2-bin-all 用于 Apache Zepplin

这(正如我刚刚经历的那样)在 Windows 上的可用路径空间中占用了太多空间。