gpt4 book ai didi

com.uber.hoodie.common.minicluster.ZookeeperTestService类的使用及代码示例

转载 作者:知者 更新时间:2024-03-13 11:08:06 27 4
gpt4 key购买 nike

本文整理了Java中com.uber.hoodie.common.minicluster.ZookeeperTestService类的一些代码示例,展示了ZookeeperTestService类的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。ZookeeperTestService类的具体详情如下:
包路径:com.uber.hoodie.common.minicluster.ZookeeperTestService
类名称:ZookeeperTestService

ZookeeperTestService介绍

[英]A Zookeeper minicluster service implementation.

This class was ripped from MiniZooKeeperCluster from the HBase tests. Changes made include:

  1. It will now only launch 1 zookeeper server.

  2. It will only attempt to bind to the port specified, and will fail if it can't.

  3. The startup method now takes a bindAddress, which allows us to configure which IP the ZK server binds to. This was not configurable in the original class.

  4. The ZK cluster will re-use a data dir on the local filesystem if it already exists instead of blowing it away.
    [中]Zookeeper小型集群服务实现。
    该类是从HBase测试中的MiniZooKeeperCluster中提取的。所做的修改包括:
    1.它现在只会启动1个zookeeper服务器。
    2.它只会尝试绑定到指定的端口,如果无法绑定,则会失败。
    3.启动方法现在采用bindAddress,这允许我们配置ZK服务器绑定到哪个IP。这在最初的类中是不可配置的。
    4.如果本地文件系统上已经存在数据目录,ZK集群将重新使用该目录,而不是将其删除。

代码示例

代码示例来源:origin: uber/hudi

public static void setUp() throws IOException, InterruptedException {
 if (dfsCluster == null) {
  HdfsTestService service = new HdfsTestService();
  dfsCluster = service.start(true);
  configuration = service.getHadoopConf();
 }
 if (zkServer == null) {
  ZookeeperTestService zkService = new ZookeeperTestService(configuration);
  zkServer = zkService.start();
 }
 fileSystem = FileSystem.get(configuration);
}

代码示例来源:origin: uber/hudi

public void stop() throws IOException {
 if (!started) {
  return;
 }
 standaloneServerFactory.shutdown();
 if (!waitForServerDown(clientPort, CONNECTION_TIMEOUT)) {
  throw new IOException("Waiting for shutdown of standalone server");
 }
 // clear everything
 started = false;
 standaloneServerFactory = null;
 zooKeeperServer = null;
 logger.info("Zookeeper Minicluster service shut down.");
}

代码示例来源:origin: uber/hudi

public ZooKeeperServer start() throws IOException, InterruptedException {
 Preconditions.checkState(workDir != null, "The localBaseFsLocation must be set before starting cluster.");
 setupTestEnv();
 stop();
 recreateDir(dir, clean);
 int tickTimeToUse;
 if (this.tickTime > 0) {
  serverHostname = bindIP;
 if (!waitForServerUp(serverHostname, clientPort, CONNECTION_TIMEOUT)) {
  throw new IOException("Waiting for startup of standalone server");

代码示例来源:origin: uber/hudi

public static void setUp() throws IOException, InterruptedException, URISyntaxException {
 if (dfsCluster == null) {
  HdfsTestService service = new HdfsTestService();
  dfsCluster = service.start(true);
  configuration = service.getHadoopConf();
 }
 if (zkServer == null) {
  ZookeeperTestService zkService = new ZookeeperTestService(configuration);
  zkServer = zkService.start();
 }
 if (hiveServer == null) {
  HiveTestService hiveService = new HiveTestService(configuration);
  hiveServer = hiveService.start();
 }
 fileSystem = FileSystem.get(configuration);
 hiveSyncConfig = new HiveSyncConfig();
 hiveSyncConfig.jdbcUrl = "jdbc:hive2://127.0.0.1:9999/";
 hiveSyncConfig.databaseName = "hdrone_test";
 hiveSyncConfig.hiveUser = "";
 hiveSyncConfig.hivePass = "";
 hiveSyncConfig.databaseName = "testdb";
 hiveSyncConfig.tableName = "test1";
 hiveSyncConfig.basePath = "/tmp/hdfs/HiveSyncToolTest/";
 hiveSyncConfig.assumeDatePartitioning = true;
 hiveSyncConfig.partitionFields = Lists.newArrayList("datestr");
 dtfOut = DateTimeFormat.forPattern("yyyy/MM/dd");
 clear();
}

27 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com