gpt4 book ai didi

org.apache.flink.yarn.highavailability.YarnIntraNonHaMasterServices.()方法的使用及代码示例

转载 作者:知者 更新时间:2024-03-16 13:53:31 26 4
gpt4 key购买 nike

本文整理了Java中org.apache.flink.yarn.highavailability.YarnIntraNonHaMasterServices.<init>()方法的一些代码示例,展示了YarnIntraNonHaMasterServices.<init>()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnIntraNonHaMasterServices.<init>()方法的具体详情如下:
包路径:org.apache.flink.yarn.highavailability.YarnIntraNonHaMasterServices
类名称:YarnIntraNonHaMasterServices
方法名:<init>

YarnIntraNonHaMasterServices.<init>介绍

[英]Creates new YarnIntraNonHaMasterServices for the given Flink and YARN configuration.

This constructor initializes access to the HDFS to store recovery data, and creates the embedded leader election services through which ResourceManager and JobManager find and confirm each other.
[中]为给定的Flink和Thread配置创建新的YarnitranonHamasterServices。
此构造函数初始化对HDFS的访问以存储恢复数据,并创建嵌入式领导人选举服务,ResourceManager和JobManager通过这些服务查找并确认彼此。

代码示例

代码示例来源:origin: apache/flink

/**
 * Creates the high-availability services for a single-job Flink YARN application, to be
 * used in the Application Master that runs both ResourceManager and JobManager.
 *
 * @param flinkConfig  The Flink configuration.
 * @param hadoopConfig The Hadoop configuration for the YARN cluster.
 *
 * @return The created high-availability services.
 *
 * @throws IOException Thrown, if the high-availability services could not be initialized.
 */
public static YarnHighAvailabilityServices forSingleJobAppMaster(
    Configuration flinkConfig,
    org.apache.hadoop.conf.Configuration hadoopConfig) throws IOException {
  checkNotNull(flinkConfig, "flinkConfig");
  checkNotNull(hadoopConfig, "hadoopConfig");
  final HighAvailabilityMode mode = HighAvailabilityMode.fromConfig(flinkConfig);
  switch (mode) {
    case NONE:
      return new YarnIntraNonHaMasterServices(flinkConfig, hadoopConfig);
    case ZOOKEEPER:
      throw  new UnsupportedOperationException("to be implemented");
    default:
      throw new IllegalConfigurationException("Unrecognized high availability mode: " + mode);
  }
}

代码示例来源:origin: apache/flink

@Test
public void testRepeatedClose() throws Exception {
  final Configuration flinkConfig = new Configuration();
  final YarnHighAvailabilityServices services = new YarnIntraNonHaMasterServices(flinkConfig, hadoopConfig);
  services.closeAndCleanupAllData();
  // this should not throw an exception
  services.close();
}

代码示例来源:origin: apache/flink

@Test
public void testClosingReportsToLeader() throws Exception {
  final Configuration flinkConfig = new Configuration();
  try (YarnHighAvailabilityServices services = new YarnIntraNonHaMasterServices(flinkConfig, hadoopConfig)) {
    final LeaderElectionService elector = services.getResourceManagerLeaderElectionService();
    final LeaderRetrievalService retrieval = services.getResourceManagerLeaderRetriever();
    final LeaderContender contender = mockContender(elector);
    final LeaderRetrievalListener listener = mock(LeaderRetrievalListener.class);
    elector.start(contender);
    retrieval.start(listener);
    // wait until the contender has become the leader
    verify(listener, timeout(1000L).times(1)).notifyLeaderAddress(anyString(), any(UUID.class));
    // now we can close the election service
    services.close();
    verify(contender, timeout(1000L).times(1)).handleError(any(Exception.class));
  }
}

代码示例来源:origin: org.apache.flink/flink-yarn_2.11

/**
 * Creates the high-availability services for a single-job Flink YARN application, to be
 * used in the Application Master that runs both ResourceManager and JobManager.
 *
 * @param flinkConfig  The Flink configuration.
 * @param hadoopConfig The Hadoop configuration for the YARN cluster.
 *
 * @return The created high-availability services.
 *
 * @throws IOException Thrown, if the high-availability services could not be initialized.
 */
public static YarnHighAvailabilityServices forSingleJobAppMaster(
    Configuration flinkConfig,
    org.apache.hadoop.conf.Configuration hadoopConfig) throws IOException {
  checkNotNull(flinkConfig, "flinkConfig");
  checkNotNull(hadoopConfig, "hadoopConfig");
  final HighAvailabilityMode mode = HighAvailabilityMode.fromConfig(flinkConfig);
  switch (mode) {
    case NONE:
      return new YarnIntraNonHaMasterServices(flinkConfig, hadoopConfig);
    case ZOOKEEPER:
      throw  new UnsupportedOperationException("to be implemented");
    default:
      throw new IllegalConfigurationException("Unrecognized high availability mode: " + mode);
  }
}

代码示例来源:origin: org.apache.flink/flink-yarn

/**
 * Creates the high-availability services for a single-job Flink YARN application, to be
 * used in the Application Master that runs both ResourceManager and JobManager.
 *
 * @param flinkConfig  The Flink configuration.
 * @param hadoopConfig The Hadoop configuration for the YARN cluster.
 *
 * @return The created high-availability services.
 *
 * @throws IOException Thrown, if the high-availability services could not be initialized.
 */
public static YarnHighAvailabilityServices forSingleJobAppMaster(
    Configuration flinkConfig,
    org.apache.hadoop.conf.Configuration hadoopConfig) throws IOException {
  checkNotNull(flinkConfig, "flinkConfig");
  checkNotNull(hadoopConfig, "hadoopConfig");
  final HighAvailabilityMode mode = HighAvailabilityMode.fromConfig(flinkConfig);
  switch (mode) {
    case NONE:
      return new YarnIntraNonHaMasterServices(flinkConfig, hadoopConfig);
    case ZOOKEEPER:
      throw  new UnsupportedOperationException("to be implemented");
    default:
      throw new IllegalConfigurationException("Unrecognized high availability mode: " + mode);
  }
}

26 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com