Question

eclipse运行wordcount程序出错

16/05/20 16:13:51 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/05/20 16:13:51 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
16/05/20 16:13:51 INFO input.FileInputFormat: Total input paths to process : 1
16/05/20 16:13:51 WARN snappy.LoadSnappy: Snappy native library not loaded
16/05/20 16:13:52 FATAL conf.Configuration: error parsing conf file: com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: 2 字节的 UTF-8 序列的字节 2 无效。
16/05/20 16:13:52 INFO mapred.JobClient: Cleaning up the staging area file:/tmp/hadoop-紫/mapred/staging/×?317742089/.staging/job_local_0001
Exception in thread "main" java.lang.RuntimeException: com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: 2 字节的 UTF-8 序列的字节 2 无效。

Answer 1

1.classpath下面是否放置hadoop conf下面的*-site.xml文件
2.执行程序的主机是否配置了hadoop集群的hosts
3.是否把该程序打包放在Hadoop lib 下并且重启了集群，如果不想打包，可以设置conf.setJarClass(Map.class) 该包会被分发到集群。