hadoop - 从 pig 中的单行输入生成多行输出

Question

我的要求是通过在 pig 脚本中使用单行输入来生成多行输出。有哪些可能的解决方案？

Answer 1

这个想法是将您输入的行转换成一个包，然后将其展平。这可能是 2 种情况:

阅读文本:

txt = load '/pig_fun/input/text.txt' using TextLoader();
words = foreach txt generate TOKENIZE($0);
pivoted = foreach words generate FLATTEN($0);
dump pivoted;

输入:

My requirement is to generate multiple lines of output by using single line of input in pig scripting.
What are the possible solutions?

输出:

(My)
(requirement)
(is)
(to)
(generate)
(multiple)
(lines)
(of)
(output)
(by)
(using)
(single)
(line)
(of)
(input)
(in)
(pig)
(scripting.)
(What)
(are)
(the)
(possible)
(solutions?)

阅读列然后旋转它们请参阅 Pivot table with Apache Pig