hadoop - 用avro模式编写时如何在拉丁 pig 中创建复杂记录

Question

我在拉丁 pig 中有以下关系，我需要将其存储到avro-schema文件中:

    data = load 'data.dat' as (a: long, b: chararray, c: long);
...
    STORE data INTO 'file' USING avroStorage();

但是我需要数据的格式为:

Record 1:
{
  "a" : {
    "long" : 2
  },
  "complex" : {
      "b" : {
        "string" : "abc"
      },
      "c" : {
        "long" : 3
      }
   }
}
...

Answer 1

我尚未测试此代码以查看如何将其转换为avro模式，但尝试从此代码开始

data = load 'data.dat' as (a: long, b: chararray, c: long);    
transformed = foreach data generate a, TOTUPLE(b, c);        
STORE transformed INTO 'file' USING avroStorage();

TOTUPLE的文档- http://pig.apache.org/docs/r0.11.1/func.html#totuple