java - Apache Pig 分配和解析计数问题

Question

目前正在使用 Hadoop 学习 Apache Pig，并使用 6200 万的庞大数据集。只是尝试执行正常的 COUNT 函数并不断出现错误。我分配了 8G 的 RAM，我可以轻松地使用 HIVE 来完成，但似乎遇到解析问题或堆分配问题，每次都不同。我在虚拟机上使用hadoop。

错误是:

file script.pig, line 3, column 39> Failed to generate logical plan. Nested exception: org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

ERROR org.apache.pig.PigServer - exception during parsing: Error during parsing. Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

ERROR 1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

我的 pig 代码

a = LOAD 'bigData_orc' using org.apache.hive.hcatalog.pig.HCatLoader();
b = group a ALL;
c = foreach b generate group as rap, count(a) as counter;
dump c;`

Answer 1

Could not resolve count

尝试将 COUNT() Pig 函数大写