gpt4 book ai didi

org.apache.hadoop.dynamodb.util.YarnContainerAllocator类的使用及代码示例

转载 作者:知者 更新时间:2024-03-18 20:01:31 28 4
gpt4 key购买 nike

本文整理了Java中org.apache.hadoop.dynamodb.util.YarnContainerAllocator类的一些代码示例,展示了YarnContainerAllocator类的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnContainerAllocator类的具体详情如下:
包路径:org.apache.hadoop.dynamodb.util.YarnContainerAllocator
类名称:YarnContainerAllocator

YarnContainerAllocator介绍

暂无

代码示例

代码示例来源:origin: com.amazon.emr/emr-dynamodb-hadoop

int mappers = yarnContainerAllocator.getMaxMappers(nodes, reducers, nodeSlots,
  appMasterSlots, mapSlots, reduceSlots);

代码示例来源:origin: awslabs/emr-dynamodb-connector

int mappers = yarnContainerAllocator.getMaxMappers(nodes, reducers, nodeSlots,
  appMasterSlots, mapSlots, reduceSlots);

代码示例来源:origin: awslabs/emr-dynamodb-connector

@Test
public void calcMaxMapTasks_m3xlargeConsistent_correctAllocatorCallMade() throws IOException {
 when(nodeCapacityProvider.getCoreNodeMemoryMB()).thenReturn(11520); // 8 slots
 conf.setInt("yarn.scheduler.minimum-allocation-mb", 1440); // 1 slot
 conf.setInt("yarn.app.mapreduce.am.resource.mb", 2880); // 2 slots
 conf.setInt("mapreduce.map.memory.mb", 1440); // 1 slot
 conf.setInt("mapreduce.reduce.memory.mb", 2880); // 2 slots
 taskCalculator.getMaxMapTasks();
 verify(yarnContainerAllocator).getMaxMappers(NODES, REDUCERS, 8 /* node slots */, 2 /* app
 master slots */, 1 /* map slots */, 2 /* reduce slots */);
}

代码示例来源:origin: awslabs/emr-dynamodb-connector

@Test
public void calcMaxMapTasks_m3xlargeInconsistent_correctAllocatorCallMade() throws IOException {
 when(nodeCapacityProvider.getCoreNodeMemoryMB()).thenReturn(11520); // 45 slots
 conf.setInt("yarn.scheduler.minimum-allocation-mb", 256); // 1 slot
 conf.setInt("yarn.app.mapreduce.am.resource.mb", 2880); // 12 slots
 conf.setInt("mapreduce.map.memory.mb", 1440); // 6 slots
 conf.setInt("mapreduce.reduce.memory.mb", 2880); // 12 slots
 taskCalculator.getMaxMapTasks();
 verify(yarnContainerAllocator).getMaxMappers(NODES, REDUCERS, 45 /* node slots */, 12 /* app
 master slots */, 6 /* map slots */, 12 /* reduce slots */);
}

28 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com