作者热门文章
- 使用 Spring Initializr 创建 Spring Boot 应用程序
- 在Spring Boot中配置Cassandra
- 在 Spring Boot 上配置 Tomcat 连接池
- 将Camel消息路由到嵌入WildFly的Artemis上
本文整理了Java中org.apache.hadoop.dynamodb.util.YarnContainerAllocator
类的一些代码示例,展示了YarnContainerAllocator
类的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnContainerAllocator
类的具体详情如下:
包路径:org.apache.hadoop.dynamodb.util.YarnContainerAllocator
类名称:YarnContainerAllocator
暂无
代码示例来源:origin: com.amazon.emr/emr-dynamodb-hadoop
int mappers = yarnContainerAllocator.getMaxMappers(nodes, reducers, nodeSlots,
appMasterSlots, mapSlots, reduceSlots);
代码示例来源:origin: awslabs/emr-dynamodb-connector
int mappers = yarnContainerAllocator.getMaxMappers(nodes, reducers, nodeSlots,
appMasterSlots, mapSlots, reduceSlots);
代码示例来源:origin: awslabs/emr-dynamodb-connector
@Test
public void calcMaxMapTasks_m3xlargeConsistent_correctAllocatorCallMade() throws IOException {
when(nodeCapacityProvider.getCoreNodeMemoryMB()).thenReturn(11520); // 8 slots
conf.setInt("yarn.scheduler.minimum-allocation-mb", 1440); // 1 slot
conf.setInt("yarn.app.mapreduce.am.resource.mb", 2880); // 2 slots
conf.setInt("mapreduce.map.memory.mb", 1440); // 1 slot
conf.setInt("mapreduce.reduce.memory.mb", 2880); // 2 slots
taskCalculator.getMaxMapTasks();
verify(yarnContainerAllocator).getMaxMappers(NODES, REDUCERS, 8 /* node slots */, 2 /* app
master slots */, 1 /* map slots */, 2 /* reduce slots */);
}
代码示例来源:origin: awslabs/emr-dynamodb-connector
@Test
public void calcMaxMapTasks_m3xlargeInconsistent_correctAllocatorCallMade() throws IOException {
when(nodeCapacityProvider.getCoreNodeMemoryMB()).thenReturn(11520); // 45 slots
conf.setInt("yarn.scheduler.minimum-allocation-mb", 256); // 1 slot
conf.setInt("yarn.app.mapreduce.am.resource.mb", 2880); // 12 slots
conf.setInt("mapreduce.map.memory.mb", 1440); // 6 slots
conf.setInt("mapreduce.reduce.memory.mb", 2880); // 12 slots
taskCalculator.getMaxMapTasks();
verify(yarnContainerAllocator).getMaxMappers(NODES, REDUCERS, 45 /* node slots */, 12 /* app
master slots */, 6 /* map slots */, 12 /* reduce slots */);
}
我是一名优秀的程序员,十分优秀!