text - 查找最长可能重复字符串的实用程序

Question

是否有任何工具或实用程序或 perl/python 脚本可以在大型文本文件中找到最长的重复子字符串并打印这些模式以及每个模式出现的次数？

Answer 1

http://en.wikipedia.org/wiki/Longest_repeated_substring_problem :

The longest repeated substring problem is finding the longest substring of a string that occurs at least twice. This problem can be solved in linear time and space by building a suffix tree for the string, and finding the deepest internal node in the tree

python 中的后缀树(有点过时，但..):http://hkn.eecs.berkeley.edu/~dyoo/python/suffix_trees/

带有进一步说明的 Javascript 实现:http://www.allisons.org/ll/AlgDS/Tree/Suffix/