Thursday, September 17, 2015

Spring YARN and Hortonworks Sandbox

Spring YARN and Hortonworks Sandbox

after much trial and error, here's some notes on getting Spring YARN to submit a remote job to Hortonworks sandbox...
  1. if working "remotely" (launching YARN job from one machine into the sandbox) make sure your local /etc/hosts is set to resolve on your target machine IP
  2. the ResourceManager port on HDP is 8050, not the default 8032 (spring.hadoop.resourceManagerPort: 8050)
  3. when running the job, use "HADOOP_USER_NAME=hdfs java -jar [your jar file]

No comments:

Post a Comment