hadoop - 使用 ant 构建 hadoop

Question

我尝试使用 ant 构建 hadoop-mapreduce-project。我尝试使用 maven 成功，但我需要使用 ant 构建它。或者他们是 maven build 中“ant compile-mapred-test”的替代品吗？
发生的错误是:

io problem while parsing ivy file: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-yarn-server-common/0.24.0-SNAPSHOT/hadoop-yarn-server-common-0.24.0-20110914.035045-1.pom: Impossible to load parent for file:/home/mohyt/.ivy2/cache/org.apache.hadoop/hadoop-yarn-server-common/ivy-0.24.0-SNAPSHOT.xml.original. Parent=org.apache.hadoop#hadoop-yarn-server;${yarn.version}
[ivy:resolve]       module not found: org.apache.hadoop#hadoop-yarn-server-common;0.24.0-SNAPSHOT
[ivy:resolve]   ==== apache-snapshot: tried
[ivy:resolve]     https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-yarn- server/${yarn.version}/hadoop-yarn-server-${yarn.version}.pom
[ivy:resolve]     -- artifact org.apache.hadoop#hadoop-yarn-server;${yarn.version}!hadoop-yarn-server.jar:
[ivy:resolve]     https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-yarn-server/${yarn.version}/hadoop-yarn-server-${yarn.version}.jar
[ivy:resolve]   ==== maven2: tried
[ivy:resolve]     http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-yarn-server-common/0.24.0-SNAPSHOT/hadoop-yarn-server-common-0.24.0-SNAPSHOT.pom
[ivy:resolve]     -- artifact org.apache.hadoop#hadoop-yarn-server-common;0.24.0-SNAPSHOT!hadoop-yarn-server-common.jar:
[ivy:resolve]     http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-yarn-server-common/0.24.0-SNAPSHOT/hadoop-yarn-server-common-0.24.0-SNAPSHOT.jar
[ivy:resolve]   io problem while parsing ivy file: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapreduce-client-core/0.24.0-SNAPSHOT/hadoop-mapreduce-client-core-0.24.0-20110914.035126-1.pom: Impossible to load parent for file:/home/mohyt/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-core/ivy-0.24.0-SNAPSHOT.xml.original. Parent=org.apache.hadoop#hadoop-mapreduce-client;${hadoop-mapreduce.version}
[ivy:resolve]       module not found: org.apache.hadoop#hadoop-mapreduce-client-core;0.24.0-SNAPSHOT
[ivy:resolve]   ==== apache-snapshot: tried
[ivy:resolve]     https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapreduce-client/${hadoop-mapreduce.version}/hadoop-mapreduce-client-${hadoop-mapreduce.version}.pom
[ivy:resolve]     -- artifact org.apache.hadoop#hadoop-mapreduce-client;${hadoop-mapreduce.version}!hadoop-mapreduce-client.jar:
[ivy:resolve]     https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapreduce-client/${hadoop-mapreduce.version}/hadoop-mapreduce-client-${hadoop-mapreduce.version}.jar
[ivy:resolve]   ==== maven2: tried
[ivy:resolve]     http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapreduce-client-core/0.24.0-SNAPSHOT/hadoop-mapreduce-client-core-0.24.0-SNAPSHOT.pom
[ivy:resolve]     -- artifact org.apache.hadoop#hadoop-mapreduce-client-core;0.24.0-SNAPSHOT!hadoop-mapreduce-client-core.jar:
[ivy:resolve]     http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapreduce-client-core/0.24.0-SNAPSHOT/hadoop-mapreduce-client-core-0.24.0-SNAPSHOT.jar
[ivy:resolve]   io problem while parsing ivy file: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-yarn-common/0.24.0-SNAPSHOT/hadoop-yarn-common-0.24.0-20110914.034958-1.pom: Impossible to load parent for file:/home/mohyt/.ivy2/cache/org.apache.hadoop/hadoop-yarn-common/ivy-0.24.0-SNAPSHOT.xml.original. Parent=org.apache.hadoop#hadoop-yarn;${yarn.version}
[ivy:resolve]       module not found: org.apache.hadoop#hadoop-yarn-common;0.24.0-SNAPSHOT
[ivy:resolve]   ==== apache-snapshot: tried
[ivy:resolve]     https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-yarn/${yarn.version}/hadoop-yarn-${yarn.version}.pom
[ivy:resolve]     -- artifact org.apache.hadoop#hadoop-yarn;${yarn.version}!hadoop-yarn.jar:
[ivy:resolve]     https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-yarn/${yarn.version}/hadoop-yarn-${yarn.version}.jar
[ivy:resolve]   ==== maven2: tried
[ivy:resolve]     http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-yarn-common/0.24.0-SNAPSHOT/hadoop-yarn-common-0.24.0-SNAPSHOT.pom
[ivy:resolve]     -- artifact org.apache.hadoop#hadoop-yarn-common;0.24.0-SNAPSHOT!hadoop-yarn-common.jar:
[ivy:resolve]     http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-yarn-common/0.24.0-SNAPSHOT/hadoop-yarn-common-0.24.0-SNAPSHOT.jar
[ivy:resolve]       ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]       ::          UNRESOLVED DEPENDENCIES         ::
[ivy:resolve]       ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]       :: org.apache.hadoop#hadoop-yarn-server-common;0.24.0-SNAPSHOT: not found
[ivy:resolve]       :: org.apache.hadoop#hadoop-mapreduce-client-core;0.24.0-SNAPSHOT: not found
[ivy:resolve]       :: org.apache.hadoop#hadoop-yarn-common;0.24.0-SNAPSHOT: not found
[ivy:resolve]       ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] 
[ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS

Answer 1

Hadoop 正在从分支 0.23 和主干中的 ant 走向 maven。到目前为止，像 MRv1 这样的一些模块必须经过 mavenized。分支 0.23 和主干不支持 Ant 构建。 ant 和 maven 构建产生的工件应该或多或少相同。使用 ant 没有任何意义，除非有特定的理由使用它。

Here是构建 Hadoop 的不同 Maven 选项。