gpt4 book ai didi

org.apache.flink.runtime.checkpoint.ZooKeeperCompletedCheckpointStore.tryRemoveCompletedCheckpoint()方法的使用及代码示例

转载 作者:知者 更新时间:2024-03-17 03:35:31 31 4
gpt4 key购买 nike

本文整理了Java中org.apache.flink.runtime.checkpoint.ZooKeeperCompletedCheckpointStore.tryRemoveCompletedCheckpoint()方法的一些代码示例,展示了ZooKeeperCompletedCheckpointStore.tryRemoveCompletedCheckpoint()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。ZooKeeperCompletedCheckpointStore.tryRemoveCompletedCheckpoint()方法的具体详情如下:
包路径:org.apache.flink.runtime.checkpoint.ZooKeeperCompletedCheckpointStore
类名称:ZooKeeperCompletedCheckpointStore
方法名:tryRemoveCompletedCheckpoint

ZooKeeperCompletedCheckpointStore.tryRemoveCompletedCheckpoint介绍

暂无

代码示例

代码示例来源:origin: org.apache.flink/flink-runtime_2.11

/**
 * Synchronously writes the new checkpoints to ZooKeeper and asynchronously removes older ones.
 *
 * @param checkpoint Completed checkpoint to add.
 */
@Override
public void addCheckpoint(final CompletedCheckpoint checkpoint) throws Exception {
  checkNotNull(checkpoint, "Checkpoint");
  final String path = checkpointIdToPath(checkpoint.getCheckpointID());
  // Now add the new one. If it fails, we don't want to loose existing data.
  checkpointsInZooKeeper.addAndLock(path, checkpoint);
  completedCheckpoints.addLast(checkpoint);
  // Everything worked, let's remove a previous checkpoint if necessary.
  while (completedCheckpoints.size() > maxNumberOfCheckpointsToRetain) {
    final CompletedCheckpoint completedCheckpoint = completedCheckpoints.removeFirst();
    tryRemoveCompletedCheckpoint(completedCheckpoint, CompletedCheckpoint::discardOnSubsume);
  }
  LOG.debug("Added {} to {}.", checkpoint, path);
}

代码示例来源:origin: org.apache.flink/flink-runtime

/**
 * Synchronously writes the new checkpoints to ZooKeeper and asynchronously removes older ones.
 *
 * @param checkpoint Completed checkpoint to add.
 */
@Override
public void addCheckpoint(final CompletedCheckpoint checkpoint) throws Exception {
  checkNotNull(checkpoint, "Checkpoint");
  final String path = checkpointIdToPath(checkpoint.getCheckpointID());
  // Now add the new one. If it fails, we don't want to loose existing data.
  checkpointsInZooKeeper.addAndLock(path, checkpoint);
  completedCheckpoints.addLast(checkpoint);
  // Everything worked, let's remove a previous checkpoint if necessary.
  while (completedCheckpoints.size() > maxNumberOfCheckpointsToRetain) {
    final CompletedCheckpoint completedCheckpoint = completedCheckpoints.removeFirst();
    tryRemoveCompletedCheckpoint(completedCheckpoint, CompletedCheckpoint::discardOnSubsume);
  }
  LOG.debug("Added {} to {}.", checkpoint, path);
}

代码示例来源:origin: org.apache.flink/flink-runtime_2.11

@Override
public void shutdown(JobStatus jobStatus) throws Exception {
  if (jobStatus.isGloballyTerminalState()) {
    LOG.info("Shutting down");
    for (CompletedCheckpoint checkpoint : completedCheckpoints) {
      tryRemoveCompletedCheckpoint(
        checkpoint,
        completedCheckpoint -> completedCheckpoint.discardOnShutdown(jobStatus));
    }
    completedCheckpoints.clear();
    String path = "/" + client.getNamespace();
    LOG.info("Removing {} from ZooKeeper", path);
    ZKPaths.deleteChildren(client.getZookeeperClient().getZooKeeper(), path, true);
  } else {
    LOG.info("Suspending");
    // Clear the local handles, but don't remove any state
    completedCheckpoints.clear();
    // Release the state handle locks in ZooKeeper such that they can be deleted
    checkpointsInZooKeeper.releaseAll();
  }
}

代码示例来源:origin: org.apache.flink/flink-runtime

@Override
public void shutdown(JobStatus jobStatus) throws Exception {
  if (jobStatus.isGloballyTerminalState()) {
    LOG.info("Shutting down");
    for (CompletedCheckpoint checkpoint : completedCheckpoints) {
      tryRemoveCompletedCheckpoint(
        checkpoint,
        completedCheckpoint -> completedCheckpoint.discardOnShutdown(jobStatus));
    }
    completedCheckpoints.clear();
    String path = "/" + client.getNamespace();
    LOG.info("Removing {} from ZooKeeper", path);
    ZKPaths.deleteChildren(client.getZookeeperClient().getZooKeeper(), path, true);
  } else {
    LOG.info("Suspending");
    // Clear the local handles, but don't remove any state
    completedCheckpoints.clear();
    // Release the state handle locks in ZooKeeper such that they can be deleted
    checkpointsInZooKeeper.releaseAll();
  }
}

31 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com