Saturday, May 6, 2017

hadoop: hadoop auxservice: mapreduce_shuffle does not exist

Please use this in yarn-site.xml; when you set the framework to use as yarn, it starts to look for these values.
<configuration>
  <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
  </property>
  <property>
    <name>yarn.nodemanager.aux-services.mapreduce_shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
  </property>
</configuration>

No comments:

Post a Comment