gpt4 book ai didi

org.archive.io.warc.WARCReader.getReaderIdentifier()方法的使用及代码示例

转载 作者:知者 更新时间:2024-03-27 13:59:05 27 4
gpt4 key购买 nike

本文整理了Java中org.archive.io.warc.WARCReader.getReaderIdentifier()方法的一些代码示例,展示了WARCReader.getReaderIdentifier()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。WARCReader.getReaderIdentifier()方法的具体详情如下:
包路径:org.archive.io.warc.WARCReader
类名称:WARCReader
方法名:getReaderIdentifier

WARCReader.getReaderIdentifier介绍

暂无

代码示例

代码示例来源:origin: internetarchive/heritrix3

public void transform(final File warc, final File dir, final String prefix,
    final String suffix, final boolean force)
throws IOException, java.text.ParseException {
  FileUtils.assertReadable(warc);
  FileUtils.assertReadable(dir);
  WARCReader reader = WARCReaderFactory.get(warc);
  List<String> metadata =  new ArrayList<String>();
  metadata.add("Made from " + reader.getReaderIdentifier() + " by " +
    this.getClass().getName() + "/" + getRevision());
  ARCWriter writer = 
    new ARCWriter(
        new AtomicInteger(),
        new WriterPoolSettingsData(
            prefix, 
            suffix, 
            -12, 
            reader.isCompressed(), 
            Arrays.asList(new File [] {dir}), 
            metadata));
  transform(reader, writer);
}

代码示例来源:origin: org.archive.heritrix/heritrix-commons

public void transform(final File warc, final File dir, final String prefix,
    final String suffix, final boolean force)
throws IOException, java.text.ParseException {
  FileUtils.assertReadable(warc);
  FileUtils.assertReadable(dir);
  WARCReader reader = WARCReaderFactory.get(warc);
  List<String> metadata =  new ArrayList<String>();
  metadata.add("Made from " + reader.getReaderIdentifier() + " by " +
    this.getClass().getName() + "/" + getRevision());
  ARCWriter writer = 
    new ARCWriter(
        new AtomicInteger(),
        new WriterPoolSettingsData(
            prefix, 
            suffix, 
            -12, 
            reader.isCompressed(), 
            Arrays.asList(new File [] {dir}), 
            metadata));
  transform(reader, writer);
}

代码示例来源:origin: org.netpreserve.commons/webarchive-commons

/**
 * Create new WARC record.
 * Encapsulate housekeeping that has to do w/ creating new Record.
 * @param is InputStream to use.
 * @param offset Absolute offset into WARC file.
 * @return A WARCRecord.
 * @throws IOException
 */
protected WARCRecord createArchiveRecord(InputStream is, long offset)
throws IOException {
  return (WARCRecord)currentRecord(new WARCRecord(is,
    getReaderIdentifier(), offset, isDigest(), isStrict()));
}

代码示例来源:origin: org.netpreserve.commons/commons-web

/**
 * Create new WARC record.
 * Encapsulate housekeeping that has to do w/ creating new Record.
 * @param is InputStream to use.
 * @param offset Absolute offset into WARC file.
 * @return A WARCRecord.
 * @throws IOException
 */
protected WARCRecord createArchiveRecord(InputStream is, long offset)
throws IOException {
  return (WARCRecord)currentRecord(new WARCRecord(is,
    getReaderIdentifier(), offset, isDigest(), isStrict()));
}

代码示例来源:origin: iipc/webarchive-commons

/**
 * Create new WARC record.
 * Encapsulate housekeeping that has to do w/ creating new Record.
 * @param is InputStream to use.
 * @param offset Absolute offset into WARC file.
 * @return A WARCRecord.
 * @throws IOException
 */
protected WARCRecord createArchiveRecord(InputStream is, long offset)
throws IOException {
  return (WARCRecord)currentRecord(new WARCRecord(is,
    getReaderIdentifier(), offset, isDigest(), isStrict()));
}

27 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com