Spark : error: is not abstract and does not override abstract method call(String) in FlatMapFunction 中的 Java FlatMapFunction

Question

我试图运行第一个 example .

源代码是:

/*keyWordCount.java */
            import org.apache.spark.*;
            import org.apache.spark.api.java.*;
            import org.apache.spark.api.java.function.*;
            import org.apache.spark.rdd.*;
            import org.apache.spark.api.java.JavaRDD;
            import java.util.*;

            public class keyWordCount {

                public static void main(String[] args) {
                    SparkConf conf = new SparkConf().setAppName("keyWordCount");
                    JavaSparkContext sc = new JavaSparkContext(conf);
                    JavaRDD<String> textFile = sc.textFile("output");
                    JavaRDD<String> dictFile = sc.textFile("keyword");
                    JavaRDD<String> words = textFile.flatMap(new FlatMapFunction<String, String>() {
                        @Override public Iterable<String> call(String s) { return Arrays.asList(s.split(" ")); }
                    });
                }
            }

当我使用mvn compile package编译时，不断出现以下错误:

[ERROR] COMPILATION ERROR : [INFO] ------------------------------------------------------------- [ERROR] /home/cyberliem/TestSpark/src/main/java/keyWordCount.java:[16,81] error: is not abstract and does not override abstract method call(String) in FlatMapFunction

[ERROR] /home/cyberliem/TestSpark/src/main/java/keyWordCount.java:[17,39] error: call(String) in cannot implement call(T) in FlatMapFunction

[ERROR] T extends Object declared in interface FlatMapFunction R extends Object declared in interface FlatMapFunction /home/cyberliem/TestSpark/src/main/java/keyWordCount.java:[17,5] error: method does not override or implement a method from a supertype

我不确定如何解决这个问题，谁能给我一个理想的出错原因？

Answer 1

试试这个:

JavaRDD<String> words = textFile.flatMap(new FlatMapFunction<String, String>() {
    @Override public Iterator<String> call(String s) { return Arrays.asList(s.split(" ")).iterator(); }
});

或者使用 lambdas 更简单:

JavaRDD<String> words = textFile.flatMap(l -> Arrays.asList(l.split(" ")).iterator());