hadoop - Hive-> Kafka:插入Hive Kafka集成外部表失败

Question

#Exception I got:
Caused by: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.io.ParquetHiveRecord cannot be cast to org.apache.hadoop.hive.kafka.KafkaWritable

    #create non-native external hive table    
    CREATE EXTERNAL TABLE IF NOT EXISTS weatherHive(lng DOUBLE, lat DOUBLE, avg_tmpr_f DOUBLE, avg_tmpr_c DOUBLE, wthr_date STRING) PARTITIONED BY (year INT, month INT, day INT) TBLPROPERTIES ('kafka.topic' = 'weatherHive', 'kafka.bootstrap.servers'='sandbox-hdp:6667', "kafka.serde.class"="org.apache.hadoop.hive.serde2.avro.AvroSerDe" );
    #insert test data 
    INSERT INTO TABLE weatherHive VALUES (-111,22,80,23,'2016-10-01',2020, 10 ,1 );

然后我得到一个异常(exception)，我该怎么办，我需要对处理程序jar做些什么？
我加载到 hive 中:

add add jar hdfs://sandbox-hdp.hortonworks.com:8020/sandbox/jars/kafka-handler-3.1.2000.7.0.3.0-79.jar;

Answer 1

您可能缺少类“org.apache.hadoop.hive.kafka.KafkaSerDe”。 checkout this answer。