windows - rhdfs没有建立连接

Question

我已经设置了 HADOOP_CMD (hadoop路径)变量，但是它没有采用该路径，因为未找到

library("rhdfs")
hdfs.init()
Sys.setenv(HADOOP_CMD="C:/cygwin64/usr/local/hadoop/bin/hadoop") 
Error in system(command, intern = TRUE) : 
'C:/cygwin64/usr/local/hadoop/bin/hadoop' not found

我也已经在系统环境变量以及cygwin中定义了HADOOP_CMD

export HADOOP_CMD="C:/cygwin64/usr/local/hadoop/bin/hadoop"

我在哪里错了，对此方向的任何帮助，谢谢。

Answer 1

在调用HADOOP_HOME之前，应在R session 中设置HADOOP_CMD和hdfs.init()
还记得在盯着RHadoop之前遵循检查点

R-Hadoop依赖项

rmr2 -RCpp, RJSONIO, digest, functional, stringr, plyr

rhdfs -rJava

在运行init()之前在R session 中导出环境变量
# requied

Sys.setenv(HADOOP_HOME="/home/trendwise/apache/hadoop-1.0.4");
Sys.setenv(HADOOP_CMD="/home/trendwise/apache/hadoop-1.0.4/bin/hadoop");
Sys.setenv(HADOOP_STREAMING='/home/trendwise/apache/hadoop-1.0.4/contrib/streaming/hadoop-streaming-1.0.4.jar')
#optional

Sys.setenv(HADOOP_BIN="/home/trendwise/apache/hadoop-1.0.4/bin");
Sys.setenv(HADOOP_CONF_DIR="/home/trendwise/apache/hadoop-1.0.4/conf");
Sys.setenv(HIVE_HOME="/home/trendwise/apache/hive-0.10.0");
Sys.setenv(HBASE_HOME="/home/trendwise/apache/hbase-0.94.3");
# Library Path
Sys.setenv(LD_LIBRARY_PATH="/lib:/lib/x86_64-linux-gnu:/lib64:/usr/lib:/usr/lib64:/usr/local/lib:/usr/local/lib64:/usr/lib/jvm/jdk1.7.0_10/lib:/usr/lib/jvm/jdk1.7.0_10/jre/lib:/usr/lib/jvm/jdk1.7.0_10/jre/lib/amd64:/usr/lib/jvm/jdk1.7.0_10/jre/lib/amd64/server");
# Loading library

library(rmr2)

library(rhdfs)
# initializing

hdfs.init()