请教大神：spark1.6.2编译到core时出错

问题描述

下载了spark1.6.2版本，安装hadoop2.6，按照build/mvn-Pyarn-Phadoop-2.6-Pspark-ganglia-lgpl-Pkinesis-asl-Phive-DskipTestscleanpackage进行编译，在编译到spark-core时，提示如下错误：[INFO][INFO]---maven-remote-resources-plugin:1.5:process(default)@spark-core_2.10---[WARNING]InvalidPOMforcom.typesafe.akka:akka-remote_2.10:jar:2.3.11,transitivedependencies(ifany)willnotbeavailable,enabledebugloggingformoredetails[WARNING]InvalidPOMforcom.typesafe.akka:akka-slf4j_2.10:jar:2.3.11,transitivedependencies(ifany)willnotbeavailable,enabledebugloggingformoredetails[WARNING]InvalidPOMforcom.typesafe.akka:akka-testkit_2.10:jar:2.3.11,transitivedependencies(ifany)willnotbeavailable,enabledebugloggingformoredetails[WARNING]InvalidPOMfororg.json4s:json4s-jackson_2.10:jar:3.2.10,transitivedependencies(ifany)willnotbeavailable,enabledebugloggingformoredetails[WARNING]Invalidprojectmodelforartifact[akka-slf4j_2.10:com.typesafe.akka:2.3.11].ItwillbeignoredbytheremoteresourcesMojo.[WARNING]Invalidprojectmodelforartifact[json4s-jackson_2.10:org.json4s:3.2.10].ItwillbeignoredbytheremoteresourcesMojo.[WARNING]Invalidprojectmodelforartifact[akka-remote_2.10:com.typesafe.akka:2.3.11].ItwillbeignoredbytheremoteresourcesMojo.[INFO][INFO]---maven-resources-plugin:2.6:resources(default-resources)@spark-core_2.10---[INFO]Using'UTF-8'encodingtocopyfilteredresources.[INFO]Copying21resources[INFO]Copying3resources[INFO][INFO]---scala-maven-plugin:3.2.2:compile(scala-compile-first)@spark-core_2.10---[INFO]Usingzincserverforincrementalcompilation[info]Compiling486Scalasourcesand76Javasourcesto/code/spark-1.6.2/core/target/scala-2.10/classes...[error]/code/spark-1.6.2/core/src/main/scala/org/apache/spark/SSLOptions.scala:26:objecttypesafeisnotamemberofpackagecom[error]importcom.typesafe.config.{Config,ConfigFactory,ConfigValueFactory}[error]^[error]/code/spark-1.6.2/core/src/main/scala/org/apache/spark/SSLOptions.scala:83:notfound:typeConfig[error]defcreateAkkaConfig:Option[Config]={[error]^[error]/code/spark-1.6.2/core/src/main/scala/org/apache/spark/SSLOptions.scala:85:notfound:valueConfigFactory[error]Some(ConfigFactory.empty()[error]/code/spark-1.6.2/core/src/main/scala/org/apache/spark/SparkEnv.scala:255:notfound:typeActorSystem[error]/code/spark-1.6.2/core/src/main/scala/org/apache/spark/rpc/akka/AkkaRpcEnv.scala:320:objectErrorisnotacasecla[error]/code/spark-1.6.2/core/src/main/scala/org/apache/spark/util/AkkaUtils.scala:210:notfound:typeActorSystem[error]actorSystem:ActorSystem):ActorRef={[error]^[error]/code/spark-1.6.2/core/src/main/scala/org/apache/spark/util/JsonProtocol.scala:27:objectDefaultFormatsisnotamemberofpackageorg.json4s[error]importorg.json4s.DefaultFormats[error]^[error]/code/spark-1.6.2/core/src/main/scala/org/apache/spark/util/JsonProtocol.scala:55:notfound:valueDefaultFormats[error]privateimplicitvalformat=DefaultFormats[error]^[warn]twowarningsfound[error]248errorsfound[error]Compilefailedat2016-6-2911:42:42[1:07.227s][INFO]------------------------------------------------------------------------[INFO]ReactorSummary:[INFO][INFO]SparkProjectParentPOM...........................SUCCESS[10.842s][INFO]SparkProjectTestTags............................SUCCESS[6.612s][INFO]SparkProjectLauncher.............................SUCCESS[01:03min][INFO]SparkProjectNetworking...........................SUCCESS[20.415s][INFO]SparkProjectShuffleStreamingService............SUCCESS[11.025s][INFO]SparkProjectUnsafe...............................SUCCESS[29.591s][INFO]SparkProjectCore.................................FAILURE[01:53min][INFO]SparkProjectBagel................................SKIPPED[INFO]SparkProjectGraphX...............................SKIPPED[INFO]SparkProjectStreaming............................SKIPPED[INFO]SparkProjectCatalyst.............................SKIPPED[INFO]SparkProjectSQL..................................SKIPPED[INFO]SparkProjectMLLibrary...........................SKIPPED[INFO]SparkProjectTools................................SKIPPED[INFO]SparkProjectHive.................................SKIPPED[INFO]SparkProjectDockerIntegrationTests.............SKIPPED[INFO]SparkProjectREPL.................................SKIPPED[INFO]SparkProjectYARNShuffleService.................SKIPPED[INFO]SparkProjectYARN.................................SKIPPED[INFO]SparkGangliaIntegration..........................SKIPPED[INFO]SparkProjectAssembly.............................SKIPPED[INFO]SparkProjectExternalTwitter.....................SKIPPED[INFO]SparkProjectExternalFlumeSink..................SKIPPED[INFO]SparkProjectExternalFlume.......................SKIPPED[INFO]SparkProjectExternalFlumeAssembly..............SKIPPED[INFO]SparkProjectExternalMQTT........................SKIPPED[INFO]SparkProjectExternalMQTTAssembly...............SKIPPED[INFO]SparkProjectExternalZeroMQ......................SKIPPED[INFO]SparkProjectExternalKafka.......................SKIPPED[INFO]SparkKinesisIntegration..........................SKIPPED[INFO]SparkProjectExamples.............................SKIPPED[INFO]SparkProjectExternalKafkaAssembly..............SKIPPED[INFO]SparkProjectKinesisAssembly.....................SKIPPED[INFO]------------------------------------------------------------------------[INFO]BUILDFAILURE[INFO]------------------------------------------------------------------------[INFO]Totaltime:04:19min[INFO]Finishedat:2016-06-29T11:42:42+08:00[INFO]FinalMemory:59M/588M[INFO]------------------------------------------------------------------------[ERROR]Failedtoexecutegoalnet.alchim31.maven:scala-maven-plugin:3.2.2:compile(scala-compile-first)onprojectspark-core_2.10:Executionscala-compile-firstofgoalnet.alchim31.maven:scala-maven-plugin:3.2.2:compilefailed.CompileFailed->[Help1][ERROR][ERROR]Toseethefullstacktraceoftheerrors,re-runMavenwiththe-eswitch.[ERROR]Re-runMavenusingthe-Xswitchtoenablefulldebuglogging.[ERROR][ERROR]Formoreinformationabouttheerrorsandpossiblesolutions,pleasereadthefollowingarticles:[ERROR][Help1]http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException[ERROR][ERROR]Aftercorrectingtheproblems,youcanresumethebuildwiththecommand[ERROR]mvn<goals>-rf:spark-core_2.10

解决方案

解决方案二：
已搞定，com.typesafe.akka的mvn版本太低，更改为高版本就行

时间： 2024-08-18 10:55:02

请教大神：spark1.6.2编译到core时出错的相关文章

补丁-本人linux小白，请教大神

问题描述 本人linux小白,请教大神 在ubuntu系统安装gcc时,如果要使编写的程序同时能在windows运行,需要安装几个补丁(如下),找到一个英文指导书,但里面有个地方不理解,截图如下: 这些图片中的'~/tools/mingw32/'.'~/tools/mingw32-binutils/'. '~/tools/mingw32-runtime/' 这三个文件夹在哪儿啊?是要自己创建吗? 解决方案 图片中的'~/tools/mingw32/'.'~/tools/mingw32-binut

c++-请教大神！ 这个程序出现的问题怎解决？

问题描述 请教大神! 这个程序出现的问题怎解决? class CMessage { private: char* m_pmessage; public: CMessage (const char* text="Default message") { size_t len=(strlen(text)+1); m_pmessage=new char[len]; strcpy_s(m_pmessage,len,text); } CMessage (const CMessage & A

java多线程问题，请教大神，多谢

问题描述 java多线程问题,请教大神,多谢 class Res{ String name; String sex;}class Input implements Runnable{ private Res r;//这句是什么意思?跟Res r = new Res();有什么区别? Input(Res r) { this.r=r; } public void run() { int x = 0; while(true) { if(x==0) { r.name=""mike"&

java-刚学JAVA有个小问题请教大神~

问题描述 刚学JAVA有个小问题请教大神~ public class Demo2 { public static Void main(String []args) { int a=12; if(a>18) { System.out.println("a>18"); }else if(a>10&&a<=18) { System.out.println("a>10 && a<=18"); }else {

html-本人菜鸟一枚，请教大神一个关于CSS中ID和类选择器不能用，而标签选择器能用的问题

问题描述 本人菜鸟一枚,请教大神一个关于CSS中ID和类选择器不能用,而标签选择器能用的问题 FIREFOX浏览器,代码如下: HTML代码片段: <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> @import url(template/default/styl

求各位大神帮忙做一下编译原理程序设计

问题描述 求各位大神帮忙做一下编译原理程序设计 1．设计词法分析器 设计各单词的状态转换图,并为不同的单词设计种别码.将词法分析器设计成供语 法分析器调用的子程序.功能包括:具备预处理功能.将不翻译的注释等符号先滤掉,只保留要翻译的符号串,即要求设计一个供词法分析调用的预处理子程序:能够拼出语言中的各个单词:http://ask.csdn.net/#将拼出的标识符填入符号表:返回(种别码, 属性值).2．目标代码生成器c. 能完成指定寄存器个数的情况下将一中间代码程序段翻译成汇编语言目标代码(汇

通讯录-新手请教大神们一个问题。

问题描述 新手请教大神们一个问题. 刚学习android,想做一个关于短信的小应用,我想在通讯录获得联系人,但是不是获得一个联系人,也不是全部的,就想调用那个短信群发的时候会跳转到的可以多选联系人界面上,如果是普通的通讯录我会调用: Intent intent = new Intent(Intent.ACTION_PICK ContactsContract.Contacts.CONTENT_URI); 但是调用那个多选联系人的通讯录界面我就不会了.百度也没找到有关的资料,所以请教一下各位大神!谢

hyper v-Hyper-v远程连接问题，请教大神。

问题描述 Hyper-v远程连接问题,请教大神. #define CHK_HRES(op) { HRESULT tmp_hresult___ = op; if (FAILED(tmp_hresult___)) throw CAtlException(tmp_hresult___); } void CChildDlg7::OnHyper_v(){ //CHK_HRES(pObject->Method()); CComBSTR namespacePath = L"\\"; CStri

HttpURLConnection异常 请教大神

问题描述 HttpURLConnection异常 请教大神 URL url = new URL(strUrl); HttpURLConnection connection = (HttpURLConnection) url.openConnection(); connection.setDoOutput(true); connection.setRequestMethod("POST");DataOutputStream out = new DataOutputStream( conn