问题描述
下面内容是我执行命令输出的内容:-----------------------------------------------------------------------------[root@ikaixin01hadoop-2.7.0]#hadoopjar/cloud/hadoop-2.7.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jarwordcount/words/countJavaHotSpot(TM)ClientVMwarning:Youhaveloadedlibrary/cloud/hadoop-2.7.0/lib/native/libhadoop.so.1.0.0whichmighthavedisabledstackguard.TheVMwilltrytofixthestackguardnow.It'shighlyrecommendedthatyoufixthelibrarywith'execstack-c<libfile>',orlinkitwith'-znoexecstack'.15/06/0202:19:13WARNutil.NativeCodeLoader:Unabletoloadnative-hadooplibraryforyourplatform...usingbuiltin-javaclasseswhereapplicable15/06/0202:19:14INFOclient.RMProxy:ConnectingtoResourceManageratikaixin01/192.168.137.88:803215/06/0202:19:16INFOinput.FileInputFormat:Totalinputpathstoprocess:115/06/0202:19:16INFOmapreduce.JobSubmitter:numberofsplits:115/06/0202:19:16INFOmapreduce.JobSubmitter:Submittingtokensforjob:job_1433170139587_000515/06/0202:19:17INFOimpl.YarnClientImpl:Submittedapplicationapplication_1433170139587_000515/06/0202:19:17INFOmapreduce.Job:Theurltotrackthejob:http://ikaixin01:8088/proxy/application_1433170139587_0005/15/06/0202:19:17INFOmapreduce.Job:Runningjob:job_1433170139587_000515/06/0202:19:28INFOmapreduce.Job:Jobjob_1433170139587_0005runninginubermode:false15/06/0202:19:28INFOmapreduce.Job:map0%reduce0%15/06/0202:19:29INFOmapreduce.Job:TaskId:attempt_1433170139587_0005_m_000000_0,Status:FAILEDContainerlaunchfailedforcontainer_1433170139587_0005_01_000002:org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException:TheauxService:mapreduce_shuffledoesnotexistatsun.reflect.NativeConstructorAccessorImpl.newInstance0(NativeMethod)atsun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)atsun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)atjava.lang.reflect.Constructor.newInstance(Constructor.java:526)atorg.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)atorg.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)atorg.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)atorg.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:375)atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)atjava.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)atjava.lang.Thread.run(Thread.java:745)15/06/0202:19:31INFOmapreduce.Job:TaskId:attempt_1433170139587_0005_m_000000_1,Status:FAILEDContainerlaunchfailedforcontainer_1433170139587_0005_01_000003:org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException:TheauxService:mapreduce_shuffledoesnotexistatsun.reflect.NativeConstructorAccessorImpl.newInstance0(NativeMethod)atsun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)atsun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)atjava.lang.reflect.Constructor.newInstance(Constructor.java:526)atorg.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)atorg.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)atorg.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)atorg.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:375)atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)atjava.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)atjava.lang.Thread.run(Thread.java:745)15/06/0202:19:33INFOmapreduce.Job:TaskId:attempt_1433170139587_0005_m_000000_2,Status:FAILEDContainerlaunchfailedforcontainer_1433170139587_0005_01_000004:org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException:TheauxService:mapreduce_shuffledoesnotexistatsun.reflect.NativeConstructorAccessorImpl.newInstance0(NativeMethod)atsun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)atsun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)atjava.lang.reflect.Constructor.newInstance(Constructor.java:526)atorg.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)atorg.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)atorg.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)atorg.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:375)atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)atjava.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)atjava.lang.Thread.run(Thread.java:745)15/06/0202:19:37INFOmapreduce.Job:map100%reduce100%15/06/0202:19:38INFOmapreduce.Job:Jobjob_1433170139587_0005failedwithstateFAILEDdueto:Taskfailedtask_1433170139587_0005_m_000000Jobfailedastasksfailed.failedMaps:1failedReduces:015/06/0202:19:38INFOmapreduce.Job:Counters:4JobCountersOtherlocalmaptasks=3Data-localmaptasks=1Totaltimespentbyallmapsinoccupiedslots(ms)=0Totaltimespentbyallreducesinoccupiedslots(ms)=0[root@ikaixin01hadoop-2.7.0]#------------------------------------------------------网上查,都描述的是yarn-site.xml缺少了aux-service的配置。我的配置:<property><name>yarn.nodemanager.aux-service</name><value>mapreduce_shuffle</value></property>麻烦大拿们帮忙看看是什么问题导致。
解决方案
解决方案二:
<name>yarn.nodemanager.aux-service</name>这个写错了,应该是:<name>yarn.nodemanager.aux-services</name>编码要认真啊。
解决方案三:
编码要认真啊。
解决方案四:
谢谢分享..........
解决方案五:
大神,我的配置没问题,也出现这个错误,请教。。。。
解决方案六:
解决方案七:
请问大神你是如何配置好的,我用之前旧的版本的搭建方式换到hadoop2.7上,各种不成功呢。请问主要要配置哪些文件?求解。。。。
解决方案八:
请问楼主你在修改yarn配置之后再怎么做呢,直接又运行一次hadoopjar/cloud/hadoop-2.7.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jarwordcount/words/count呢,还是需要再重新格式阿虎集群呢