windows 上运行 spark 程序异常

windows 上运行 spark 程序出现
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries

解决办法

1. Download winutils.exe from http://public-repo-1.hortonworks.com/hdp-win-alpha/winutils.exe.

2. SetUp your HADOOP_HOME environment variable on the OS level or programmatically:

   System.setProperty("hadoop.home.dir", "full path to the bin folder with winutils");

3. Enjoy

备注：
winutils.exe 要放到 bin 文件夹下

参考
https://stackoverflow.com/questions/35652665/java-io-ioexception-could-not-locate-executable-null-bin-winutils-exe-in-the-ha