gpt4 book ai didi

Snowflake: How to find all errors records while loading parquet data files from aws s3 to snowflake tables(雪花:如何在将镶木地板数据文件从AWS S3加载到雪花表时查找所有错误记录)

转载 作者:bug小助手 更新时间:2023-10-25 21:51:09 26 4
gpt4 key购买 nike



copy into db.schema.ZDATA_4 
from @stage/load/zdata_4/
file_format=(TYPE=parquet )
ON_ERROR=CONTINUE
Force=TRUE
MATCH_BY_COLUMN_NAME =
CASE_INSENSITIVE
validation_mode
=return_all_errors;

While running above load command getting below error message:

MATCH_BY_COLUMN NAME cannot be used with the VALIDATION.MODE because
VALIDATION_MODE does not support COPY with transform

运行上述LOAD命令时,出现以下错误消息:MATCH_BY_COLUMN NAME不能与VALIDATION.MODE一起使用,因为VALIFICATION_MODE不支持COPY WITH Transform


In Snowflake, can we load parquet files without match_by_column_name when in validation mode?

在Snowflake中,当处于验证模式时,我们是否可以加载没有Match_by_Column_Name的拼图文件?


更多回答

So what happened when you tried it?

那么当你尝试的时候发生了什么呢?

got error message : MATCH_BY_COLUMN NAME cannot be used with the VALIDATION.MODE because VALIDATION_MODE does not support COPY with transform

收到错误消息:MATCH_BY_COLUMN名称不能与VALIDATION.MODE一起使用,因为VALIDATION_MODE不支持COPY WITH TRANSFER

I meant what happened when you tried the approach you are asking about: “load parquet files without match_by_column_name when in validation mode”

我的意思是,当您尝试您正在询问的方法时会发生什么:“在验证模式下加载不带Match_by_Column_NAME的拼图文件”

优秀答案推荐

After loading the parquet data files to Snowflake tables, you will get errors_seen. SQL minus query can be used to find out the records which are not loaded.

将拼图数据文件加载到Snowflake表后,您将看到Errors_Seed。可以使用SQL减去查询来找出未加载的记录。


select col1 || col2 || col3 
from @stage_path
minus
select col1 || col2 || col3
trgt_table

Here you wont be able to find the error message or line no.

在这里,您将无法找到错误消息或行号。


更多回答

26 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com