- 使用 Spring Initializr 创建 Spring Boot 应用程序
- 在Spring Boot中配置Cassandra
- 在 Spring Boot 上配置 Tomcat 连接池
- 将Camel消息路由到嵌入WildFly的Artemis上
本文整理了Java中org.apache.hadoop.yarn.client.api.YarnClient.start()
方法的一些代码示例,展示了YarnClient.start()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnClient.start()
方法的具体详情如下:
包路径:org.apache.hadoop.yarn.client.api.YarnClient
类名称:YarnClient
方法名:start
暂无
代码示例来源:origin: apache/incubator-gobblin
@VisibleForTesting
void startYarnClient() {
this.yarnClient.start();
}
代码示例来源:origin: apache/drill
public YarnRMClient(YarnConfiguration conf) {
this.conf = conf;
yarnClient = YarnClient.createYarnClient();
yarnClient.init(conf);
yarnClient.start();
}
代码示例来源:origin: apache/hive
/**
* Kills all jobs tagged with the given tag that have been started after the
* given timestamp.
*/
@Override
public void killJobs(String tag, long timestamp) {
try {
LOG.info("Looking for jobs to kill...");
Set<ApplicationId> childJobs = getYarnChildJobs(tag, timestamp);
if (childJobs.isEmpty()) {
LOG.info("No jobs found from");
return;
} else {
LOG.info(String.format("Found MR jobs count: %d", childJobs.size()));
LOG.info("Killing all found jobs");
YarnClient yarnClient = YarnClient.createYarnClient();
yarnClient.init(conf);
yarnClient.start();
for (ApplicationId app: childJobs) {
LOG.info(String.format("Killing job: %s ...", app));
yarnClient.killApplication(app);
LOG.info(String.format("Job %s killed", app));
}
}
} catch (YarnException ye) {
throw new RuntimeException("Exception occurred while killing child job(s)", ye);
} catch (IOException ioe) {
throw new RuntimeException("Exception occurred while killing child job(s)", ioe);
}
}
代码示例来源:origin: apache/flink
private AbstractYarnClusterDescriptor getClusterDescriptor(
Configuration configuration,
YarnConfiguration yarnConfiguration,
String configurationDirectory) {
final YarnClient yarnClient = YarnClient.createYarnClient();
yarnClient.init(yarnConfiguration);
yarnClient.start();
return new YarnClusterDescriptor(
configuration,
yarnConfiguration,
configurationDirectory,
yarnClient,
false);
}
}
代码示例来源:origin: apache/hive
public static void killChildYarnJobs(Configuration conf, String tag) {
try {
if (tag == null) {
return;
}
LOG.info("Killing yarn jobs using query tag:" + tag);
Set<ApplicationId> childYarnJobs = getChildYarnJobs(conf, tag);
if (!childYarnJobs.isEmpty()) {
YarnClient yarnClient = YarnClient.createYarnClient();
yarnClient.init(conf);
yarnClient.start();
for (ApplicationId app : childYarnJobs) {
yarnClient.killApplication(app);
}
}
} catch (IOException | YarnException ye) {
LOG.warn("Exception occurred while killing child job({})", ye);
}
}
代码示例来源:origin: apache/hive
public boolean isApplicationAccepted(HiveConf conf, String applicationId) {
if (applicationId == null) {
return false;
}
YarnClient yarnClient = null;
try {
LOG.info("Trying to find " + applicationId);
ApplicationId appId = getApplicationIDFromString(applicationId);
yarnClient = YarnClient.createYarnClient();
yarnClient.init(conf);
yarnClient.start();
ApplicationReport appReport = yarnClient.getApplicationReport(appId);
return appReport != null && appReport.getYarnApplicationState() == YarnApplicationState.ACCEPTED;
} catch (Exception ex) {
LOG.error("Failed getting application status for: " + applicationId + ": " + ex, ex);
return false;
} finally {
if (yarnClient != null) {
try {
yarnClient.stop();
} catch (Exception ex) {
LOG.error("Failed to stop yarn client: " + ex, ex);
}
}
}
}
}
代码示例来源:origin: apache/hive
public static boolean isApplicationAccepted(HiveConf conf, String applicationId) {
if (applicationId == null) {
return false;
}
YarnClient yarnClient = null;
try {
ApplicationId appId = getApplicationIDFromString(applicationId);
yarnClient = YarnClient.createYarnClient();
yarnClient.init(conf);
yarnClient.start();
ApplicationReport appReport = yarnClient.getApplicationReport(appId);
return appReport != null && appReport.getYarnApplicationState() == YarnApplicationState.ACCEPTED;
} catch (Exception ex) {
LOG.error("Failed getting application status for: " + applicationId + ": " + ex, ex);
return false;
} finally {
if (yarnClient != null) {
try {
yarnClient.stop();
} catch (Exception ex) {
LOG.error("Failed to stop yarn client: " + ex, ex);
}
}
}
}
代码示例来源:origin: alibaba/jstorm
jstormClientContext.yarnClient.start();
代码示例来源:origin: apache/flink
@BeforeClass
public static void setupClass() {
yarnConfiguration = new YarnConfiguration();
yarnClient = YarnClient.createYarnClient();
yarnClient.init(yarnConfiguration);
yarnClient.start();
}
代码示例来源:origin: Qihoo360/XLearning
yarnClient.start();
LOG.info("Requesting a new application from cluster with " + yarnClient.getYarnClusterMetrics().getNumNodeManagers() + " NodeManagers");
newAPP = yarnClient.createApplication();
代码示例来源:origin: apache/flink
@Before
public void checkClusterEmpty() {
if (yarnClient == null) {
yarnClient = YarnClient.createYarnClient();
yarnClient.init(getYarnConfiguration());
yarnClient.start();
}
flinkConfiguration = new org.apache.flink.configuration.Configuration(globalConfiguration);
}
代码示例来源:origin: apache/flink
YarnClient yc = YarnClient.createYarnClient();
yc.init(YARN_CONFIGURATION);
yc.start();
List<ApplicationReport> apps = yc.getApplications(EnumSet.of(YarnApplicationState.RUNNING));
Assert.assertEquals(1, apps.size()); // Only one running
代码示例来源:origin: apache/drill
@Override
public void start(CallbackHandler resourceCallback,
org.apache.hadoop.yarn.client.api.async.NMClientAsync.CallbackHandler nodeCallback ) {
conf = new YarnConfiguration();
resourceMgr = AMRMClientAsync.createAMRMClientAsync(pollPeriodMs, resourceCallback);
resourceMgr.init(conf);
resourceMgr.start();
// Create the asynchronous node manager client
nodeMgr = NMClientAsync.createNMClientAsync(nodeCallback);
nodeMgr.init(conf);
nodeMgr.start();
client = YarnClient.createYarnClient();
client.init(conf);
client.start();
String appIdStr = System.getenv(DrillOnYarnConfig.APP_ID_ENV_VAR);
if (appIdStr != null) {
appId = ConverterUtils.toApplicationId(appIdStr);
try {
appReport = client.getApplicationReport(appId);
} catch (YarnException | IOException e) {
LOG.error(
"Failed to get YARN applicaiton report for App ID: " + appIdStr, e);
}
}
}
代码示例来源:origin: apache/ignite
YarnClient yarnClient = YarnClient.createYarnClient();
yarnClient.init(conf);
yarnClient.start();
代码示例来源:origin: apache/incubator-gobblin
this.yarnClient.start();
代码示例来源:origin: apache/flink
/**
* Tests that the cluster retrieval of a finished YARN application fails.
*/
@Test(expected = ClusterRetrieveException.class)
public void testClusterClientRetrievalOfFinishedYarnApplication() throws Exception {
final ApplicationId applicationId = ApplicationId.newInstance(System.currentTimeMillis(), 42);
final ApplicationReport applicationReport = createApplicationReport(
applicationId,
YarnApplicationState.FINISHED,
FinalApplicationStatus.SUCCEEDED);
final YarnClient yarnClient = new TestingYarnClient(Collections.singletonMap(applicationId, applicationReport));
final YarnConfiguration yarnConfiguration = new YarnConfiguration();
yarnClient.init(yarnConfiguration);
yarnClient.start();
final TestingAbstractYarnClusterDescriptor clusterDescriptor = new TestingAbstractYarnClusterDescriptor(
new Configuration(),
yarnConfiguration,
temporaryFolder.newFolder().getAbsolutePath(),
yarnClient,
false);
try {
clusterDescriptor.retrieve(applicationId);
} finally {
clusterDescriptor.close();
}
}
代码示例来源:origin: apache/flink
closableYarnClient.start();
代码示例来源:origin: uber/AthenaX
ClusterInfo(String name, YarnClusterConfiguration conf) {
this.name = name;
this.client = YarnClient.createYarnClient();
client.init(conf.conf());
client.start();
this.conf = conf;
}
代码示例来源:origin: uber/AthenaX
YarnConfiguration conf = cluster.getYarnConfiguration();
client.init(conf);
client.start();
UUID jobUUID = UUID.randomUUID();
try (InstanceManager manager = new InstanceManager(
代码示例来源:origin: uber/AthenaX
@Test
public void testCreateAthenaXCluster() throws Exception {
ScheduledExecutorService executor = Executors.newScheduledThreadPool(1);
Configuration flinkConf = new Configuration();
flinkConf.setString(JobManagerOptions.ADDRESS, "localhost");
try (MiniAthenaXCluster cluster = new MiniAthenaXCluster(JobDeployerITest.class.getSimpleName())) {
cluster.start();
YarnConfiguration conf = cluster.getYarnConfiguration();
YarnClusterConfiguration clusterConf = cluster.getYarnClusterConf();
final ApplicationId appId;
try (YarnClient client = YarnClient.createYarnClient()) {
client.init(conf);
client.start();
JobDeployer deployer = new JobDeployer(clusterConf, client, executor, flinkConf);
appId = deployer.createApplication();
InstanceMetadata md = new InstanceMetadata(UUID.randomUUID(), UUID.randomUUID());
JobDefinitionResource resource = new JobDefinitionResource()
.queue(null).vCores(1L).executionSlots(1L).memory(2048L);
JobConf jobConf = new JobConf(appId, "test", Collections.emptyList(), resource, md);
deployer.start(JobITestUtil.trivialJobGraph(), jobConf);
YarnApplicationState state = MiniAthenaXCluster.pollFinishedApplicationState(client, appId);
assertEquals(FINISHED, state);
}
}
}
}
我尝试理解[c代码 -> 汇编]代码 void node::Check( data & _data1, vector& _data2) { -> push ebp -> mov ebp,esp ->
我需要在当前表单(代码)的上下文中运行文本文件中的代码。其中一项要求是让代码创建新控件并将其添加到当前窗体。 例如,在Form1.cs中: using System.Windows.Forms; ..
我有此 C++ 代码并将其转换为 C# (.net Framework 4) 代码。有没有人给我一些关于 malloc、free 和 sprintf 方法的提示? int monate = ee; d
我的网络服务器代码有问题 #include #include #include #include #include #include #include int
给定以下 html 代码,将列表中的第三个元素(即“美丽”一词)以斜体显示的 CSS 代码是什么?当然,我可以给这个元素一个 id 或一个 class,但 html 代码必须保持不变。谢谢
关闭。这个问题不符合Stack Overflow guidelines .它目前不接受答案。 我们不允许提问寻求书籍、工具、软件库等的推荐。您可以编辑问题,以便用事实和引用来回答。 关闭 7 年前。
我试图制作一个宏来避免重复代码和注释。 我试过这个: #define GrowOnPage(any Page, any Component) Component.Width := Page.Surfa
我正在尝试将我的旧 C++ 代码“翻译”成头条新闻所暗示的 C# 代码。问题是我是 C# 中的新手,并不是所有的东西都像 C++ 中那样。在 C++ 中这些解决方案运行良好,但在 C# 中只是不能。我
在 Windows 10 上工作,R 语言的格式化程序似乎没有在 Visual Studio Code 中完成它的工作。我试过R support for Visual Studio Code和 R-T
我正在处理一些报告(计数),我必须获取不同参数的计数。非常简单但乏味。 一个参数的示例查询: qCountsEmployee = ( "select count(*) from %s wher
最近几天我尝试从 d00m 调试网络错误。我开始用尽想法/线索,我希望其他 SO 用户拥有可能有用的宝贵经验。我希望能够提供所有相关信息,但我个人无法控制服务器环境。 整个事情始于用户注意到我们应用程
我有一个 app.js 文件,其中包含如下 dojo amd 模式代码: require(["dojo/dom", ..], function(dom){ dom.byId('someId').i
我对“-gencode”语句中的“code=sm_X”选项有点困惑。 一个例子:NVCC 编译器选项有什么作用 -gencode arch=compute_13,code=sm_13 嵌入库中? 只有
我为我的表格使用 X-editable 框架。 但是我有一些问题。 $(document).ready(function() { $('.access').editable({
我一直在通过本教程学习 flask/python http://blog.miguelgrinberg.com/post/the-flask-mega-tutorial-part-i-hello-wo
我想将 Vim 和 EMACS 用于 CNC、G 代码和 M 代码。 Vim 或 EMACS 是否有任何语法或模式来处理这种类型的代码? 最佳答案 一些快速搜索使我找到了 this vim 和 thi
关闭。这个问题不符合Stack Overflow guidelines .它目前不接受答案。 想改进这个问题?更新问题,使其成为 on-topic对于堆栈溢出。 7年前关闭。 Improve this
这个问题在这里已经有了答案: Enabling markdown highlighting in Vim (5 个回答) 6年前关闭。 当我在 Vim 中编辑包含 Markdown 代码的 READM
我正在 Swift3 iOS 中开发视频应用程序。基本上我必须将视频 Assets 和音频与淡入淡出效果合并为一个并将其保存到 iPhone 画廊。为此,我使用以下方法: private func d
pipeline { agent any stages { stage('Build') { steps { e
我是一名优秀的程序员,十分优秀!