- 使用 Spring Initializr 创建 Spring Boot 应用程序
- 在Spring Boot中配置Cassandra
- 在 Spring Boot 上配置 Tomcat 连接池
- 将Camel消息路由到嵌入WildFly的Artemis上
本文整理了Java中org.apache.twill.yarn.YarnTwillRunnerService.<init>()
方法的一些代码示例,展示了YarnTwillRunnerService.<init>()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnTwillRunnerService.<init>()
方法的具体详情如下:
包路径:org.apache.twill.yarn.YarnTwillRunnerService
类名称:YarnTwillRunnerService
方法名:<init>
[英]Creates an instance with a FileContextLocationFactory created base on the given configuration with the user home directory as the location factory namespace.
[中]使用基于给定配置创建的FileContextLocationFactory创建实例,并将用户主目录作为位置工厂命名空间。
代码示例来源:origin: apache/incubator-rya
/**
*
* @param yarnZookeepers - The zookeeper connect string used by the Hadoop YARN cluster.
* @param configFile - The config file used by {@link PeriodicNotificationTwillApp}. Typically notification.properties.
*/
public PeriodicNotificationTwillRunner(final String yarnZookeepers, final File configFile) {
Preconditions.checkArgument(configFile.exists(), "Config File must exist");
Objects.requireNonNull(yarnZookeepers, "YARN Zookeepers must not be null.");
this.configFile = configFile;
yarnConfiguration = new YarnConfiguration();
twillRunner = new YarnTwillRunnerService(yarnConfiguration, yarnZookeepers);
twillRunner.start();
// sleep to give the YarnTwillRunnerService time to retrieve state from zookeeper
try {
Thread.sleep(1000);
} catch (final InterruptedException e) {
throw new IllegalStateException(e);
}
}
代码示例来源:origin: dremio/dremio-oss
public TwillRunnerService startTwillRunner(YarnConfiguration yarnConfiguration) {
String zkStr = dremioConfig.getString(DremioConfig.ZOOKEEPER_QUORUM);
String clusterId = yarnConfiguration.get(YARN_CLUSTER_ID);
Preconditions.checkNotNull(clusterId, "Cluster ID can not be null");
TwillRunnerService twillRunner = new YarnTwillRunnerService(yarnConfiguration, zkStr);
TwillRunnerService previousOne = twillRunners.putIfAbsent(new ClusterId(clusterId), twillRunner);
if (previousOne == null) {
// start one we are planning to add - if it is already in collection it should be started
twillRunner.start();
return twillRunner;
}
return previousOne;
}
代码示例来源:origin: org.apache.fluo/fluo-cluster
private synchronized TwillRunnerService getTwillRunner(FluoConfiguration config) {
if (!twillRunners.containsKey(config.getApplicationName())) {
YarnConfiguration yarnConfig = new YarnConfiguration();
yarnConfig.addResource(new Path(hadoopPrefix + "/etc/hadoop/core-site.xml"));
yarnConfig.addResource(new Path(hadoopPrefix + "/etc/hadoop/yarn-site.xml"));
TwillRunnerService twillRunner =
new YarnTwillRunnerService(yarnConfig, config.getAppZookeepers() + ZookeeperPath.TWILL);
twillRunner.start();
twillRunners.put(config.getApplicationName(), twillRunner);
// sleep to give twill time to retrieve state from zookeeper
try {
Thread.sleep(1000);
} catch (InterruptedException e) {
throw new IllegalStateException(e);
}
}
return twillRunners.get(config.getApplicationName());
}
代码示例来源:origin: apache/fluo
private synchronized TwillRunnerService getTwillRunner(FluoConfiguration config) {
if (!twillRunners.containsKey(config.getApplicationName())) {
YarnConfiguration yarnConfig = new YarnConfiguration();
yarnConfig.addResource(new Path(hadoopPrefix + "/etc/hadoop/core-site.xml"));
yarnConfig.addResource(new Path(hadoopPrefix + "/etc/hadoop/yarn-site.xml"));
TwillRunnerService twillRunner =
new YarnTwillRunnerService(yarnConfig, config.getAppZookeepers() + ZookeeperPath.TWILL);
twillRunner.start();
twillRunners.put(config.getApplicationName(), twillRunner);
// sleep to give twill time to retrieve state from zookeeper
try {
Thread.sleep(1000);
} catch (InterruptedException e) {
throw new IllegalStateException(e);
}
}
return twillRunners.get(config.getApplicationName());
}
代码示例来源:origin: io.fluo/fluo-cluster
private synchronized TwillRunnerService getTwillRunner(FluoConfiguration config) {
if (!twillRunners.containsKey(config.getApplicationName())) {
YarnConfiguration yarnConfig = new YarnConfiguration();
yarnConfig.addResource(new Path(hadoopPrefix + "/etc/hadoop/core-site.xml"));
yarnConfig.addResource(new Path(hadoopPrefix + "/etc/hadoop/yarn-site.xml"));
TwillRunnerService twillRunner =
new YarnTwillRunnerService(yarnConfig, config.getAppZookeepers() + ZookeeperPath.TWILL);
twillRunner.start();
twillRunners.put(config.getApplicationName(), twillRunner);
// sleep to give twill time to retrieve state from zookeeper
try {
Thread.sleep(1000);
} catch (InterruptedException e) {
throw new IllegalStateException(e);
}
}
return twillRunners.get(config.getApplicationName());
}
代码示例来源:origin: apache/twill
Preconditions.checkState(jarFile.canRead());
final TwillRunnerService twillRunner = new YarnTwillRunnerService(new YarnConfiguration(), zkStr);
twillRunner.start();
代码示例来源:origin: apache/twill
final TwillRunnerService twillRunner = new YarnTwillRunnerService(yarnConfiguration, zkStr);
twillRunner.start();
代码示例来源:origin: co.cask.tigon/tigon-yarn
/**
* Provider method for instantiating {@link org.apache.twill.yarn.YarnTwillRunnerService}.
*/
@Singleton
@Provides
private YarnTwillRunnerService provideYarnTwillRunnerService(CConfiguration configuration,
YarnConfiguration yarnConfiguration,
LocationFactory locationFactory) {
String zkConnectStr = configuration.get(Constants.Zookeeper.QUORUM) +
configuration.get(Constants.CFG_TWILL_ZK_NAMESPACE);
// Copy the yarn config and set the max heap ratio.
YarnConfiguration yarnConfig = new YarnConfiguration(yarnConfiguration);
yarnConfig.set(Constants.CFG_TWILL_RESERVED_MEMORY_MB, configuration.get(Constants.CFG_TWILL_RESERVED_MEMORY_MB));
YarnTwillRunnerService runner = new YarnTwillRunnerService(yarnConfig,
zkConnectStr,
LocationFactories.namespace(locationFactory, "twill"));
// Set JVM options based on configuration
runner.setJVMOptions(configuration.get(Constants.Container.PROGRAM_JVM_OPTS));
return runner;
}
}
代码示例来源:origin: apache/twill
/**
* Creates an unstarted instance of {@link org.apache.twill.api.TwillRunnerService}.
*/
public TwillRunnerService createTwillRunnerService() throws IOException {
YarnTwillRunnerService runner = new YarnTwillRunnerService(config, zkServer.getConnectionStr() + "/twill",
createLocationFactory());
// disable tests stealing focus
runner.setJVMOptions("-Djava.awt.headless=true");
return runner;
}
代码示例来源:origin: co.cask.cdap/cdap-app-fabric
@Override
public TwillRunnerService get() {
String zkConnectStr = cConf.get(Constants.Zookeeper.QUORUM) + cConf.get(Constants.CFG_TWILL_ZK_NAMESPACE);
// Copy the yarn config and setup twill configs
YarnConfiguration yarnConfig = new YarnConfiguration(yarnConf);
// Always disable the location delegation update from twill, as we always do it from CDAP side
yarnConfig.setBoolean(Configs.Keys.SECURE_STORE_UPDATE_LOCATION_ENABLED, false);
YarnTwillRunnerService runner = new YarnTwillRunnerService(yarnConfig,
zkConnectStr,
LocationFactories.namespace(locationFactory, "twill"));
// Set JVM options based on configuration
String jvmOpts = cConf.get(Constants.AppFabric.PROGRAM_JVM_OPTS);
runner.setJVMOptions(jvmOpts);
return new ImpersonatedTwillRunnerService(yarnConf, runner, impersonator, secureStoreRenewer);
}
}
代码示例来源:origin: cdapio/cdap
@Override
public TwillRunnerService get() {
String zkConnectStr = cConf.get(Constants.Zookeeper.QUORUM) + cConf.get(Constants.CFG_TWILL_ZK_NAMESPACE);
// Copy the yarn config and setup twill configs
YarnConfiguration yarnConfig = new YarnConfiguration(yarnConf);
// Always disable the location delegation update from twill, as we always do it from CDAP side
yarnConfig.setBoolean(Configs.Keys.SECURE_STORE_UPDATE_LOCATION_ENABLED, false);
YarnTwillRunnerService runner = new YarnTwillRunnerService(yarnConfig,
zkConnectStr,
LocationFactories.namespace(locationFactory, "twill"));
// Set JVM options based on configuration
String jvmOpts = cConf.get(Constants.AppFabric.PROGRAM_JVM_OPTS);
runner.setJVMOptions(jvmOpts);
return new ImpersonatedTwillRunnerService(yarnConf, runner, impersonator, secureStoreRenewer);
}
}
我尝试创建一个斜纹测试来更改 2 个不同测试的代理服务器设置。我需要在运行时触发此更改,而无需重新启动测试脚本。 我尝试通过设置 os.environ["HTTP_PROXY"] 来使用“http_p
我目前正在使用 urllib2 和 BeautifulSoup 打开和解析 html 数据。但是,我遇到了一个网站问题,该网站在呈现页面后使用 javascript 加载图像(我试图在页面上找到特定图
我正在尝试使用 python 和 Twill 运行一些自动化功能测试。这些测试验证我的应用程序的 OAuth 登录和连接端点是否正常工作。 幸运的是,Twitter 并不介意 Twill/Mechan
我正在尝试使用 apache twill构建 YARN 应用程序。来自 twill presentation 的幻灯片,他们说的是使用maven-bundle-plugin来打包hello world
我刚刚成功安装TWILL在“StackOverflow”的一位非常支持的成员的帮助下(你可以查看 HERE)在我的电脑上运行,并尝试运行斜纹文档页面上的一个简单示例(你可以看到该页面 HERE) .这
本文整理了Java中org.apache.twill.discovery.ZKDiscoveryService类的一些代码示例,展示了ZKDiscoveryService类的具体用法。这些代码示例主要
本文整理了Java中org.apache.twill.yarn.YarnTwillRunnerService类的一些代码示例,展示了YarnTwillRunnerService类的具体用法。这些代码示
本文整理了Java中org.apache.twill.zookeeper.ZKClients类的一些代码示例,展示了ZKClients类的具体用法。这些代码示例主要来源于Github/Stackove
本文整理了Java中org.apache.twill.zookeeper.ZKClientService类的一些代码示例,展示了ZKClientService类的具体用法。这些代码示例主要来源于Git
本文整理了Java中org.apache.twill.zookeeper.ZKClient类的一些代码示例,展示了ZKClient类的具体用法。这些代码示例主要来源于Github/Stackoverf
本文整理了Java中org.apache.twill.zookeeper.ZKOperations类的一些代码示例,展示了ZKOperations类的具体用法。这些代码示例主要来源于Github/St
本文整理了Java中org.apache.twill.zookeeper.ZKClientServices类的一些代码示例,展示了ZKClientServices类的具体用法。这些代码示例主要来源于G
我正在尝试从网站提取信息,这样做需要我登录该网站。一切顺利,直到我到达提交按钮: MissingSchema: Invalid URL u'/index.php?r=site/login': No s
我打算使用 twill 在一页上填写表单,点击提交按钮,然后使用 BeautifulSoup 解析生成的页面。如何向 BeautifulSoup 提供 HTML 页面?我假设我必须阅读当前的网址,但我
我刚刚拿到 Twill 并正在使用它,它似乎在 HTTPS 网站上遇到了问题。例如,命令 go(' http://boston.craigslist.org/ ') 可以正常连接,但 go(' htt
如果我运行 twill 脚本来下载网页,twill 脚本会在页面上运行任何 javascript(内联或其他方式)吗?它会正确地做吗? twill官方网站好像没有说明twill是否支持js(我猜是不支
本文整理了Java中org.apache.twill.internal.yarn.YarnUtils类的一些代码示例,展示了YarnUtils类的具体用法。这些代码示例主要来源于Github/Stac
本文整理了Java中org.apache.twill.internal.yarn.YarnAppClient类的一些代码示例,展示了YarnAppClient类的具体用法。这些代码示例主要来源于Git
当集群负载过重时,Yarn 会杀死容器。当容器中运行的其中一个 runnablse 被杀死时,Apache Twill 会如何 react ?它是在减少可运行实例数量的情况下运行还是重新启动它? 最佳
我正在测试我的 Flask 应用程序。 总之,这是我的问题: 1) 下面代码块中我的最终 url 断言失败。根据 Twill 的说法,它失败是因为实际的 url 是“/auth/login”。换句话说
我是一名优秀的程序员,十分优秀!