java - HTMLStripCharFilter 在自定义分析器的 createComponent 实现中不起作用

Question

我在自定义分析器实现的 createComponents 实现中使用了 HTMLStripCharFilter，但 HTML 并未从内容中剥离。请在下面找到代码。

@Override
    protected TokenStreamComponents createComponents(String fieldName) 
    {
        StandardTokenizer source = new StandardTokenizer();
        source.setReader(mStripHTML ? new HTMLStripCharFilter(getReader()) : getReader());
        source.setMaxTokenLength(maxTokenLength);
        TokenStream result = new StandardFilter(source);
        result = new LowerCaseFilter(result);
        return new TokenStreamComponents(source, result);
    }

Answer 1

您的 CharFilter 不应在 createComponents 方法中定义，而应在 initReader 中定义:

@Override
protected Reader initReader(String fieldName, Reader reader) {
    return mStripHTML ? new HTMLStripCharFilter(reader) : reader;
}

@Override
protected TokenStreamComponents createComponents(String fieldName) 
{
    StandardTokenizer source = new StandardTokenizer();
    source.setMaxTokenLength(maxTokenLength);
    TokenStream result = new StandardFilter(source);
    result = new LowerCaseFilter(result);
    return new TokenStreamComponents(source, result);
}