Hadoop-3.1.2 : Datanode and Nodemanager shuts down-6ren

Hadoop-3.1.2 : Datanode and Nodemanager shuts down

转载作者：可可西里更新时间：2023-11-01 14:50:57

我正在尝试在 Windows-10 上安装 Hadoop(3.1.2)，但数据节点和节点管理器关闭。

我尝试下载 winutils.exe 和 hadoop.dll 文件并将其放在 bin 目录下。我也试过更改文件的权限并以管理员身份运行。但它并没有修复错误

Datanode 关闭错误

2019-02-12 12:01:30,856 INFO checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/D:/Installs/IT/hadoop-3.1.2/data/datanode
2019-02-12 12:01:30,888 WARN checker.StorageLocationChecker: Exception checking StorageLocation [DISK]file:/D:/Installs/IT/hadoop-3.1.2/data/datanode
java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:455)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:796)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:710)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:678)
        at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:233)
        at org.apache.hadoop.util.DiskChecker.checkDirInternal(DiskChecker.java:141)
        at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:116)
        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:239)
        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:52)
        at org.apache.hadoop.hdfs.server.datanode.checker.ThrottledAsyncChecker$1.call(ThrottledAsyncChecker.java:142)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:30,888 ERROR datanode.DataNode: Exception in secureMain
org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0
        at org.apache.hadoop.hdfs.server.datanode.checker.StorageLocationChecker.check(StorageLocationChecker.java:231)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2776)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2691)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2733)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2877)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2901)
2019-02-12 12:01:30,888 INFO util.ExitUtil: Exiting with status 1: org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

节点管理器关闭错误

2019-02-12 12:01:28,091 WARN localizer.ResourceLocalizationService: Failed to rename the local file under /tmp/hadoop-Deepb/nm-local-dir/filecache
2019-02-12 12:01:28,185 ERROR nodemanager.NodeManager: Error starting NodeManager
java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:455)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:796)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:710)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:678)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.initializeLocalDir(ResourceLocalizationService.java:1435)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.initializeLocalDirs(ResourceLocalizationService.java:1405)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceInit(ResourceLocalizationService.java:260)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:318)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:477)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:933)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:1013)
2019-02-12 12:01:28,201 INFO service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService failed in state STOPPED
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 WARN service.CompositeService: When stopping the service org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 INFO service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl failed in state STOPPED
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 WARN service.CompositeService: When stopping the service org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 INFO service.AbstractService: Service NodeManager failed in state STOPPED
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 WARN service.AbstractService: When stopping the service NodeManager
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 INFO nodemanager.NodeManager: SHUTDOWN_MSG:

我知道由于安装 hadoop 的繁琐任务，这个问题太多了，但我们将不胜感激

最佳答案

我用these files覆盖了bin目录下的所有文件一切都按预期开始工作

关于Hadoop-3.1.2 : Datanode and Nodemanager shuts down，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/54644231/

文章推荐： html - 将样式表与重叠样式相结合？

文章推荐： scala - 使用Spark在hdfs中递归搜索所有文件名

hadoop - 到 hadoop 还是不到 hadoop
我们有数据(此时未分配)要转换/聚合/透视到 wazoo。我在 www 上看了看，我问的所有答案都指向 hadoop 可扩展、运行便宜(没有 SQL 服务器机器和许可证)、快速(如果你有足够的数据)
hadoop - 什么是 "Hadoop"- Hadoop 的定义？
这很明显，我们都同意我们可以将 HDFS + YARN + MapReduce 称为 Hadoop。但是，Hadoop 生态系统中的其他不同组合和其他产品会怎样？例如，HDFS + YARN + S
hadoop - es-hadoop(ElasticSearch-Hadoop)是如何做Hadoop的？
如果 es-hadoop 只是连接到 HDFS 的 Hadoop 连接器，它如何支持 Hadoop 分析？最佳答案我假设您指的是 this project .在这种情况下，ES Hadoop 项目
hadoop - Hadoop 中的 JoGL？用于图形的 Hadoop？
看完this和 this论文，我决定我想在 MapReduce 上为大型数据集实现分布式体积渲染设置作为我的本科论文工作。 Hadoop 是一个合理的选择吗？ Java 不会扼杀一些性能提升或使与 C
hadoop - 在命令行上通过 Hadoop 作业客户端提交 Hadoop 作业
我一直在尝试查找有关如何通过命令行提交 hadoop 作业的信息。我知道命令 - hadoop jar jar-file 主类输入输出还有另一个命令，我正在尝试查找有关它的信息，但未能找到 - h
hadoop - 我无法从 Hadoop 客户端连接到 Hadoop 服务器
Hadoop 服务器在 Kubernetes 中。而Hadoop客户端位于外网。所以我尝试使用 kubernetes-service 来使用 Hadoop 服务器。但是 hadoop fs -put
hadoop - sudo hadoop 与 su hadoop
有没有人遇到奇怪的环境问题，在调用 hadoop 命令时被迫使用 SU 而不是 SUDO？ sudo su -c 'hadoop fs -ls /' hdfs Found 4 itemsdrwxr-x
hadoop - 以压缩文件作为输入运行 hadoop。 hadoop 读取的数据输入不按顺序。数字格式异常
在更改 mapred-site.xml 中的属性后，我给出了一个 tar.bz2 文件、.gz 和 tar.gz 文件作为输入。以上似乎都没有奏效。我假设这里发生的是 hadoop 作为输入读取的记录
hadoop - 使用 Hadoop 管道获取 Hadoop 映射器中的文件名
如何在 Hadoop Pipes 中获取正在 hadoop 映射器中执行的输入文件名称？我可以很容易地在基于 java 的 map reducer 中获取文件名，比如 FileSplit fil
hadoop - 流数据和 Hadoop？ (不是 Hadoop 流)
我想使用 MapReduce 方法分析连续的数据流(通过 HTTP 访问)，因此我一直在研究 Apache Hadoop。不幸的是，Hadoop 似乎期望以固定大小的输入文件开始作业，而不是能够在新数
hadoop - Hadoop-名称节点可以执行任务吗？
名称节点可以执行任务吗？默认情况下，任务在集群的数据节点上执行。最佳答案假设您正在询问MapReduce ... 使用YARN，MapReduce任务在应用程序主数据库中执行，而不是在nameno
hadoop - Hadoop Pig技术按功能分组
我有一个关系A包含 (zip-code). 我还有另一个关系B包含 (name:gender:zip-code) (x:m:1234) (y:f:1234) (z:m:1245) (s:f:1235)
hadoop - Hadoop:排序和混排
我是hadoop地区的新手。您能帮我负责(k2,list[v2,v2,v2...])形式的输出(意味着将键及其所有关联值组合在一起)的责任是吗？谢谢。最佳答案这是Hadoop的MapReduce
hadoop - Hadoop Map程序以打印输入文件
因此，我一直在尝试编写一个hadoop程序，该程序将输入作为一个包含许多文件的文件，并且我希望hadoop程序的输出仅是输入文件的一行。但是我还没有做到这一点。我也不想去 reducer 课。如果有人
hadoop - Hadoop> Mapper类输入错误
我使用的输入文本文件的内容是 1 "Come 1 "Defects," 1 "I 1 "Information 1 "J" 2 "Plain 5 "Project 1
hadoop - hadoop grep命令
谁能告诉我以下grep命令的作用: $ bin/hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+' 最佳答案 http:/
hadoop - hadoop map减少功能
我不了解mapreducer的基本功能，mapreducer是否有助于将文件放入HDFS 或mapreducer仅有助于分析HDFS中现有文件中的内容我对hadoop非常陌生，任何人都可以指导我理解
hadoop - Hadoop put和copyfromlocal之间的区别
CopyFromLocal将从本地文件系统上载数据。不要放会从任何文件上传数据，例如。本地FS，亚马逊S3 或仅来自本地fs ??? 最佳答案请找到两个命令的用法。 put ======= Usa
hadoop - hadoop mapreduce如何在云中内部工作？
我开始研究hadoop mapreduce。我是Java和hadoop的初学者，并且了解hadoop mapreduce的编码，但是有兴趣了解它在云中的内部工作方式。您能否分享一些很好的链接来说明
hadoop - hadoop mapreduce的类路径在哪里？
我一直在寻找Hadoop mapreduce类的类路径。我正在使用Hortonworks 2.2.4版沙箱。我需要这样的类路径来运行我的javac编译器: javac -cp (CLASS_PATH)

可可西里

个人简介

我是一名优秀的程序员,十分优秀！

作者热门文章

滴滴打车优惠券免费领取

全站热门文章

首页

博学

6Ren·AI

商城

Hadoop-3.1.2 : Datanode and Nodemanager shuts down