hadoop - Cloudera 支持 docker 容器或 Docker 支持 CM 5 图像

Question

最近我的组织正在考虑使用 Docker。我们组使用的是cloudera CDH 5.1.2。

1) cloudera 是否与 Docker 容器兼容？2) docker 和cloudera 组合是否存在已知问题？

我在这个论坛上找不到任何关于 docker 的话题。

任何指针都会有所帮助。

谢谢，阿米特

Answer 1

已发布 Cloudera 的官方答复 here :

I read through what docker is, yesterday. I do not think this has been tested, there are a number of platform virtualization projects in progress, but I did not see this on the list.

Lookt at its intent, it might work but you would definately want to test. The thing I'm concearned about is the level of effort to normalize between distribution types as there are a large volume of subcomponents that are brought directly into the CDH "Parcel" that are platform specific.

You might be able to get a CM server and agents deployed in a generic way, but then you would want CM to manage the deployment of CDH parcel across the target "cluster" once it was online, rather than abstracting that install as well.

最重要的是，在 Docker 容器中安装 Cloudera Manager 似乎不是一条简单的路线，因为 CM 需要管理其他 Hadoop 组件的安装。

其他选项包括:

• 使用 Vagrant 通过 Cloudera Manager 创建 CDH 虚拟机 (Cloudera Documentation Link)
• 在没有 cloudera Manager 的情况下手动管理 CDH 组件 ( Cloudera Documentation Link )