gpt4 book ai didi

org.apache.flink.yarn.YarnClusterDescriptor.addShipFiles()方法的使用及代码示例

转载 作者:知者 更新时间:2024-03-14 03:22:49 25 4
gpt4 key购买 nike

本文整理了Java中org.apache.flink.yarn.YarnClusterDescriptor.addShipFiles()方法的一些代码示例,展示了YarnClusterDescriptor.addShipFiles()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnClusterDescriptor.addShipFiles()方法的具体详情如下:
包路径:org.apache.flink.yarn.YarnClusterDescriptor
类名称:YarnClusterDescriptor
方法名:addShipFiles

YarnClusterDescriptor.addShipFiles介绍

暂无

代码示例

代码示例来源:origin: apache/flink

@Nonnull
YarnClusterDescriptor createYarnClusterDescriptor(org.apache.flink.configuration.Configuration flinkConfiguration) {
  final YarnClusterDescriptor yarnClusterDescriptor = new YarnClusterDescriptor(
    flinkConfiguration,
    YARN_CONFIGURATION,
    CliFrontend.getConfigurationDirectoryFromEnv(),
    yarnClient,
    true);
  yarnClusterDescriptor.setLocalJarPath(new Path(flinkUberjar.toURI()));
  yarnClusterDescriptor.addShipFiles(Collections.singletonList(flinkLibFolder));
  return yarnClusterDescriptor;
}

代码示例来源:origin: apache/flink

shipFiles.add(libFolder);
descriptor.addShipFiles(shipFiles);

代码示例来源:origin: apache/flink

@Test
public void testJobRecoversAfterKillingTaskManager() throws Exception {
  final YarnClusterDescriptor yarnClusterDescriptor = setupYarnClusterDescriptor();
  yarnClusterDescriptor.addShipFiles(Arrays.asList(flinkShadedHadoopDir.listFiles()));
  final RestClusterClient<ApplicationId> restClusterClient = deploySessionCluster(yarnClusterDescriptor);
  try {
    final JobID jobId = submitJob(restClusterClient);
    waitUntilJobIsRunning(restClusterClient, jobId);
    stopTaskManagerContainer();
    waitUntilJobIsRestarted(restClusterClient, jobId, 1);
    waitForJobTermination(restClusterClient, jobId);
    killApplicationAndWait(restClusterClient.getClusterId());
  } finally {
    restClusterClient.shutdown();
  }
}

代码示例来源:origin: apache/flink

yarnClusterDescriptor.addShipFiles(Arrays.asList(flinkLibFolder.listFiles()));
yarnClusterDescriptor.addShipFiles(Arrays.asList(flinkShadedHadoopDir.listFiles()));

代码示例来源:origin: apache/flink

clusterDescriptor.addShipFiles(Arrays.asList(flinkLibFolder.listFiles()));
clusterDescriptor.addShipFiles(Arrays.asList(flinkShadedHadoopDir.listFiles()));

代码示例来源:origin: apache/flink

/**
 * Tests that Yarn will restart a killed {@link YarnSessionClusterEntrypoint} which will then resume
 * a persisted {@link JobGraph}.
 */
@Test
public void testKillYarnSessionClusterEntrypoint() throws Exception {
  assumeTrue(
    "This test kills processes via the pkill command. Thus, it only runs on Linux, Mac OS, Free BSD and Solaris.",
    OperatingSystem.isLinux() || OperatingSystem.isMac() || OperatingSystem.isFreeBSD() || OperatingSystem.isSolaris());
  final YarnClusterDescriptor yarnClusterDescriptor = setupYarnClusterDescriptor();
  yarnClusterDescriptor.addShipFiles(Arrays.asList(flinkShadedHadoopDir.listFiles()));
  final RestClusterClient<ApplicationId> restClusterClient = deploySessionCluster(yarnClusterDescriptor);
  try {
    final JobID jobId = submitJob(restClusterClient);
    final ApplicationId id = restClusterClient.getClusterId();
    waitUntilJobIsRunning(restClusterClient, jobId);
    killApplicationMaster(yarnClusterDescriptor.getYarnSessionClusterEntrypoint());
    waitForApplicationAttempt(id, 2);
    waitForJobTermination(restClusterClient, jobId);
    killApplicationAndWait(id);
  } finally {
    restClusterClient.shutdown();
  }
}

25 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com