hadoop - 通过 '1 Click Installer'更新Community Edition中的各个CDH组件

Question

有人可以让我知道是否可以通过Community Edition的“1单击安装程序”将单个CDH组件从5.7更新到5.13吗？

例如，假设我只想将hadoop-hdfs-datanode更新为服务器中的最新版本。如果我执行sudo apt-get install hadoop-hdfs-datanode，它将更新也在该节点上运行的其他CDH组件(例如resource-manager，node-manager等)。

正如here所讨论的，如果我尝试升级hadoop-yarn-resourcemanager，它将升级几乎所有的cdh hadoop组件。

support@platform1:~$ sudo apt-get install hadoop-yarn-resourcemanager
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following extra packages will be installed:
  hadoop hadoop-0.20-mapreduce hadoop-client hadoop-conf-pseudo hadoop-hdfs
  hadoop-hdfs-datanode hadoop-hdfs-journalnode hadoop-hdfs-namenode
  hadoop-hdfs-secondarynamenode hadoop-hdfs-zkfc hadoop-mapreduce
  hadoop-mapreduce-historyserver hadoop-yarn hadoop-yarn-nodemanager
The following packages will be upgraded:
  hadoop hadoop-0.20-mapreduce hadoop-client hadoop-conf-pseudo hadoop-hdfs
  hadoop-hdfs-datanode hadoop-hdfs-journalnode hadoop-hdfs-namenode
  hadoop-hdfs-secondarynamenode hadoop-hdfs-zkfc hadoop-mapreduce
  hadoop-mapreduce-historyserver hadoop-yarn hadoop-yarn-nodemanager
  hadoop-yarn-resourcemanager
15 upgraded, 0 newly installed, 0 to remove and 16 not upgraded.

Answer 1

it is updating other CDH component also running in that node

我怀疑它是升级节点中的所有内容，只是升级hadoop客户端的依赖服务。

如果要单独安装Hadoop，则它包括HDFS，MapReduce，YARN和Hadoop客户端库。因此，有意义的是，升级datanode软件包将尝试获取这些软件包，而不是HBase，Hive，Pig，Spark，Oozie等软件包。

本质上，您需要确保所有Hadoop客户端库都是相同的版本。尽管CDH本身已在该基本版本中添加了补丁程序，但它们在这两个版本之间并未脱离Hadoop 2.6.0。因此，升级可能很好。

但是，让我们以HBase为例。 From the documentation，表示支持Hadoop 2.6.0、2.7.0或Hadoop 2.8.x； Hadoop 3.x未经过测试；仅支持2.6.1+或2.7.1+。

并继续说

In distributed mode, it is critical that the version of Hadoop that is out on your cluster match what is under HBase... Make sure you replace the jar in HBase across your whole cluster. Hadoop version mismatch issues have various manifestations but often all look like its hung

应该进行所有组件升级，Cloudera会努力确保单个发行版的所有组件一起工作，而不是跨发行版混合使用。