gpt4 book ai didi

hadoop - 将路径文件加载到分区表

转载 作者:可可西里 更新时间:2023-11-01 14:30:20 27 4
gpt4 key购买 nike

我正在尝试通过运行以下命令将文件本地加载到 Hive 中:

LOAD DATA INPATH '/data/work/hive/staging/ExampleData.csv' INTO TABLE 表名;

这给了我错误:

SemanticException [Error 10062]: Need to specify partition columns because the destination table is partitioned (state=42000,code=10062)

An answer I found建议创建一个中间表,然后让动态分区启动以加载到分区表中。

我创建了一个匹配数据的表并将其截断:

create table temptablename as select * from tablename;
truncate table temptablename

然后使用以下方式加载数据:

LOAD DATA INPATH '/data/work/hive/staging/ExampleData.csv' INTO TABLE temptablename;

如何“启动”动态分区?

最佳答案

1.Load data into temptablename(without partition)
create table temptablename(col1,col2..);
LOAD DATA INPATH '/data/work/hive/staging/ExampleData.csv' INTO TABLE
temptablename;

now once you have data in intermediate table ,you can kick in dynamic
partitioning using following command.

2.INSERT into tablename PARTITION(partition_column) select * from
temptablename;

关于hadoop - 将路径文件加载到分区表,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/45214291/

27 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com