gpt4 book ai didi

hadoop - Hadoop 3.2 HDFS 客户端能否用于与 Hadoop 2.x HDFS 节点一起工作?

转载 作者:可可西里 更新时间:2023-11-01 15:07:55 25 4
gpt4 key购买 nike

我正在尝试使用 Hadoop 3.2 客户端构建 Java 程序。它能与 Hadoop 2.x 集群一起工作吗?或者,它不被支持吗?感谢您分享您的经验。

最佳答案

与 Hadoop 和大多数 Apache 许可项目的兼容性仅在次要版本号之间得到保证。因此,您不应期望 3.2 客户端与 2.x Hadoop 集群一起工作。

Cloudera 的博客 Upgrading your clusters and workloads from Apache Hadoop 2 to Apache Hadoop 3 Suma Shivaprasad 撰写的文章还提到了以下内容:

Compatibility with Hadoop 2

Wire compatibility

  • Hadoop 3 preserves wire compatibility with Hadoop 2 clients
  • Distcp/WebHDFS compatibility is preserved

API compatibility

Hadoop 3 doesn’t preserve full API level compatibility due to the following changes

  • Classpath – Dependency version bumps like guava
  • Removal of deprecated APIs and tools
  • Shell script rewrites
  • Incompatible bug fixes

但也指出:

Migrating Workloads

MapReduce applications

MapReduce is fully binary compatible and workloads should run as is without any changes required.

关于hadoop - Hadoop 3.2 HDFS 客户端能否用于与 Hadoop 2.x HDFS 节点一起工作?,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/57581636/

25 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com