gpt4 book ai didi

hadoop - 无法描述使用 avro serde 创建的 Hive 表

转载 作者:可可西里 更新时间:2023-11-01 16:52:42 26 4
gpt4 key购买 nike

我已经使用 Avro serde 创建了一个 Hive 表。下面是我从网站上复制来创建表格的代码。

create table NEW_TABLE
row format serde 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
stored as inputformat 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
outputformat 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
tblproperties ('avro.schema.literal'='{
"name": "my_record",
"type": "record",
"fields": [
{"name":"boolean1", "type":"boolean"},
{"name":"int1", "type":"int"},
{"name":"long1", "type":"long"},
{"name":"float1", "type":"float"},
{"name":"double1", "type":"double"},
{"name":"string1", "type":"string"},
{"name": "nullable_int", "type": ["int", "null"]]}');

当我发出描述表的命令时,我收到以下错误:

hive> describe new_table;
OK
error_error_error_error_error_error_error string from deserializer
cannot_determine_schema string from deserializer
check string from deserializer
schema string from deserializer
url string from deserializer
and string from deserializer
literal string from deserializer
Time taken: 0.15 seconds, Fetched: 7 row(s)

最佳答案

后来我发现avro schema中的字段是用tab分隔的。我在记事本中复制了代码并删除了选项卡并重新运行命令。成功了!!!

关于hadoop - 无法描述使用 avro serde 创建的 Hive 表,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/31452112/

26 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com