hadoop - pig : filtering out empty string

Question

我正在尝试从我的数据中过滤掉 NULL 和空字符串

data_filtered = FILTER raw_data by COLUMN_NAME is not null and COLUMN_NAME != '' ;

当我运行它时，出现以下错误:

ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1200: <file jhoughton/temp/temp_script.pig, line 43, column 46>  Unexpected character ' '

如何解决此错误并过滤掉 NULLS 和空白字符串？

Answer 1

可以使用TRIM函数过滤空格

data_filtered = FILTER raw_data by ( COLUMN_NAME is not null and TRIM(COLUMN_NAME) != '' );