gpt4 book ai didi

org.apache.samza.config.YarnConfig.getYarnJobStagingDirectory()方法的使用及代码示例

转载 作者:知者 更新时间:2024-03-19 01:17:31 26 4
gpt4 key购买 nike

本文整理了Java中org.apache.samza.config.YarnConfig.getYarnJobStagingDirectory()方法的一些代码示例,展示了YarnConfig.getYarnJobStagingDirectory()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnConfig.getYarnJobStagingDirectory()方法的具体详情如下:
包路径:org.apache.samza.config.YarnConfig
类名称:YarnConfig
方法名:getYarnJobStagingDirectory

YarnConfig.getYarnJobStagingDirectory介绍

暂无

代码示例

代码示例来源:origin: org.apache.samza/samza-yarn

/**
 * Cleans up the staging directory of the job. All exceptions during the cleanup
 * are swallowed.
 */
private void cleanupStagingDir() {
 String yarnJobStagingDirectory = yarnConfig.getYarnJobStagingDirectory();
 if(yarnJobStagingDirectory != null) {
  JobContext context = new JobContext();
  context.setAppStagingDir(new Path(yarnJobStagingDirectory));
  FileSystem fs = null;
  try {
   fs = FileSystem.get(yarnConfiguration);
  } catch (IOException e) {
   log.error("Unable to clean up file system: {}", e);
   return;
  }
  if(fs != null) {
   YarnJobUtil.cleanupStagingDir(context, fs);
  }
 }
}

代码示例来源:origin: org.apache.samza/samza-yarn_2.11

/**
 * Cleans up the staging directory of the job. All exceptions during the cleanup
 * are swallowed.
 */
private void cleanupStagingDir() {
 String yarnJobStagingDirectory = yarnConfig.getYarnJobStagingDirectory();
 if(yarnJobStagingDirectory != null) {
  JobContext context = new JobContext();
  context.setAppStagingDir(new Path(yarnJobStagingDirectory));
  FileSystem fs = null;
  try {
   fs = FileSystem.get(yarnConfiguration);
  } catch (IOException e) {
   log.error("Unable to clean up file system: {}", e);
   return;
  }
  if(fs != null) {
   YarnJobUtil.cleanupStagingDir(context, fs);
  }
 }
}

26 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com