| 
  • If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

  • You already know Dokkio is an AI-powered assistant to organize & manage your digital files & messages. Very soon, Dokkio will support Outlook as well as One Drive. Check it out today!

View
 

FrontPage

Page history last edited by doug chang 9 years, 8 months ago

Apache BigTop Build Notes

 

Building bigtop-0.8.0 on CentOS 6.4/Ubuntu 14.02

Let's focus on the components we need for doing a Spark POC first...

 

 

Spark-0.9.1

Not all of the jars under spark-0.9.1 distribution are included in the bigtop distribution. To build a spark pipeline you will need the external, graphx and potentially the mllib directories. For jars under external like the twitter libs you can build those jars separately and import them into your local maven cache using mvn install. Other jars like Spark-SQL which are in 1.0.0 require you to modify the install script in bigtop because these jars are required for the spark runtime and have to be placed in /usr/lib/spark to be installed in the class path for the Spark Shell CLI. 

 

There are 4 directories under external. There is no parent pom which would  make this step a 1 line command. cd into each of the subdirectories {flume, kafka, mqtt, twitter, zeromq} and run mvn package. Install the jars under /target. For the twitter subdirectory:

 mvn install:install-file -Dfile=/home/dc/spark-0.9.1/external/twitter/target/spark-streaming-twitter_2.10-0.9.1.jar -DgroupId=org.apache.spark -DartifactId=spark-streaming-twitter -Dversion=0.9.1 -Dpackaging=jar 

Repeat above command for the other components if needed. 

 

 

Flume-0.5.0.1

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile (default-testCompile) on project flume-ng-hbase-sink: Compilation failure

[ERROR] /home/dc/bigtop-master/build/flume/rpm/BUILD/apache-flume-1.5.0.1-src/flume-ng-sinks/flume-ng-hbase-sink/src/test/java/org/apache/flume/sink/hbase/TestAsyncHBaseSink.java:[69,15] error: cannot access HBaseCommonTestingUtility. 

 

The class HBaseCommonTestingUtility exists in the later distributions but Flume uses an earlier version of the class called HBaesTestingUtility. This class exists in .92 and .94. 

 

The build command uses a Hadoop-2 and HBase-.98 profile. The Flume test classes TestAsyncHBaseSink.java here: https://github.com/apache/flume/blob/master/flume-ng-sinks/flume-ng-hbase-sink/src/test/java/org/apache/flume/sink/hbase/TestAsyncHBaseSink.java

 and TestHBaseSink.java here: https://github.com/apache/flume/blob/master/flume-ng-sinks/flume-ng-hbase-sink/src/test/java/org/apache/flume/sink/hbase/TestAsyncHBaseSink.java use class HBaseTestingUtility which no longer exists in HBase 0.98. Delete these 2 files from the Flume source code tar.gz file bigtop placed in dl/.  Recreate the apache-flume-1.5.0.1-src.tar.gz without these 2 files, copy into dl/ and rerun make rpm. In the old days we would use #ifdefs, probably better to use Maven exclude/include tags in the HBase-.98 profile settings under the flume-ng-hbase-sink pom..  

 

Apache Crunch 0.10.0 

 

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.1:site (default-cli) on project crunch-parent: Execution default-cli of goal org.apache.maven.plugins:maven-site-plugin:3.1:site failed: A required class was missing while executing org.apache.maven.plugins:maven-site-plugin:3.1:site: org/sonatype/aether/graph/DependencyFilter

[ERROR] -----------------------------------------------------

[ERROR] realm =    plugin>org.apache.maven.plugins:maven-site-plugin:3.1

[ERROR] strategy = org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy

[ERROR] urls[0] = file:/home/dc/.m2/repository/org/apache/maven/plugins/maven-site-plugin/3.1/maven-site-plugin-3.1.jar

[ERROR] urls[1] = file:/home/dc/.m2/repository/org/apache/maven/wagon/wagon-ssh/1.0/wagon-ssh-1.0.jar

[ERROR] urls[2] = file:/home/dc/.m2/repository/com/jcraft/jsch/0.1.44-1/jsch-0.1.44-1.jar

[ERROR] urls[3] = file:/home/dc/.m2/repository/org/apache/maven/wagon/wagon-ssh-common/1.0/wagon-ssh-common-1.0.jar

[ERROR] urls[4] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-interactivity-api/1.0-alpha-6/plexus-interactivity-api-1.0-alpha-6.jar

[ERROR] urls[5] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-module-markdown/1.3/doxia-module-markdown-1.3.jar

[ERROR] urls[6] = file:/home/dc/.m2/repository/org/pegdown/pegdown/1.0.2/pegdown-1.0.2.jar

[ERROR] urls[7] = file:/home/dc/.m2/repository/org/parboiled/parboiled-core/1.0.1/parboiled-core-1.0.1.jar

[ERROR] urls[8] = file:/home/dc/.m2/repository/org/parboiled/parboiled-java/1.0.1/parboiled-java-1.0.1.jar

[ERROR] urls[9] = file:/home/dc/.m2/repository/asm/asm-tree/3.3.1/asm-tree-3.3.1.jar

[ERROR] urls[10] = file:/home/dc/.m2/repository/asm/asm-util/3.3.1/asm-util-3.3.1.jar

[ERROR] urls[11] = file:/home/dc/.m2/repository/asm/asm-analysis/3.3.1/asm-analysis-3.3.1.jar

[ERROR] urls[12] = file:/home/dc/.m2/repository/asm/asm/3.3.1/asm-3.3.1.jar

[ERROR] urls[13] = file:/home/dc/.m2/repository/org/apache/maven/reporting/maven-reporting-exec/1.0.2/maven-reporting-exec-1.0.2.jar

[ERROR] urls[14] = file:/home/dc/.m2/repository/org/apache/maven/reporting/maven-reporting-api/3.0/maven-reporting-api-3.0.jar

[ERROR] urls[15] = file:/home/dc/.m2/repository/org/apache/velocity/velocity/1.5/velocity-1.5.jar

[ERROR] urls[16] = file:/home/dc/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar

[ERROR] urls[17] = file:/home/dc/.m2/repository/velocity/velocity/1.5/velocity-1.5.jar

[ERROR] urls[18] = file:/home/dc/.m2/repository/org/sonatype/aether/aether-util/1.7/aether-util-1.7.jar

[ERROR] urls[19] = file:/home/dc/.m2/repository/org/sonatype/sisu/sisu-inject-bean/1.4.2/sisu-inject-bean-1.4.2.jar

[ERROR] urls[20] = file:/home/dc/.m2/repository/org/sonatype/sisu/sisu-guice/2.1.7/sisu-guice-2.1.7-noaop.jar

[ERROR] urls[21] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-interpolation/1.14/plexus-interpolation-1.14.jar

[ERROR] urls[22] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar

[ERROR] urls[23] = file:/home/dc/.m2/repository/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.jar

[ERROR] urls[24] = file:/home/dc/.m2/repository/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.jar

[ERROR] urls[25] = file:/home/dc/.m2/repository/org/apache/maven/maven-archiver/2.4.2/maven-archiver-2.4.2.jar

[ERROR] urls[26] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-sink-api/1.3/doxia-sink-api-1.3.jar

[ERROR] urls[27] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-logging-api/1.3/doxia-logging-api-1.3.jar

[ERROR] urls[28] = file:/home/dc/.m2/repository/junit/junit/3.8.1/junit-3.8.1.jar

[ERROR] urls[29] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-core/1.3/doxia-core-1.3.jar

[ERROR] urls[30] = file:/home/dc/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar

[ERROR] urls[31] = file:/home/dc/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar

[ERROR] urls[32] = file:/home/dc/.m2/repository/org/apache/httpcomponents/httpclient/4.0.2/httpclient-4.0.2.jar

[ERROR] urls[33] = file:/home/dc/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar

[ERROR] urls[34] = file:/home/dc/.m2/repository/commons-codec/commons-codec/1.3/commons-codec-1.3.jar

[ERROR] urls[35] = file:/home/dc/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar

[ERROR] urls[36] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-module-xhtml/1.3/doxia-module-xhtml-1.3.jar

[ERROR] urls[37] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-module-apt/1.3/doxia-module-apt-1.3.jar

[ERROR] urls[38] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-module-xdoc/1.3/doxia-module-xdoc-1.3.jar

[ERROR] urls[39] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-module-fml/1.3/doxia-module-fml-1.3.jar

[ERROR] urls[40] = file:/home/dc/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar

[ERROR] urls[41] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-decoration-model/1.3/doxia-decoration-model-1.3.jar

[ERROR] urls[42] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-site-renderer/1.3/doxia-site-renderer-1.3.jar

[ERROR] urls[43] = file:/home/dc/.m2/repository/org/apache/velocity/velocity-tools/2.0/velocity-tools-2.0.jar

[ERROR] urls[44] = file:/home/dc/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar

[ERROR] urls[45] = file:/home/dc/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar

[ERROR] urls[46] = file:/home/dc/.m2/repository/commons-chain/commons-chain/1.1/commons-chain-1.1.jar

[ERROR] urls[47] = file:/home/dc/.m2/repository/commons-validator/commons-validator/1.3.1/commons-validator-1.3.1.jar

[ERROR] urls[48] = file:/home/dc/.m2/repository/dom4j/dom4j/1.1/dom4j-1.1.jar

[ERROR] urls[49] = file:/home/dc/.m2/repository/sslext/sslext/1.2-0/sslext-1.2-0.jar

[ERROR] urls[50] = file:/home/dc/.m2/repository/org/apache/struts/struts-core/1.3.8/struts-core-1.3.8.jar

[ERROR] urls[51] = file:/home/dc/.m2/repository/antlr/antlr/2.7.2/antlr-2.7.2.jar

[ERROR] urls[52] = file:/home/dc/.m2/repository/org/apache/struts/struts-taglib/1.3.8/struts-taglib-1.3.8.jar

[ERROR] urls[53] = file:/home/dc/.m2/repository/org/apache/struts/struts-tiles/1.3.8/struts-tiles-1.3.8.jar

[ERROR] urls[54] = file:/home/dc/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar

[ERROR] urls[55] = file:/home/dc/.m2/repository/org/apache/maven/shared/maven-doxia-tools/1.4/maven-doxia-tools-1.4.jar

[ERROR] urls[56] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-archiver/1.0/plexus-archiver-1.0.jar

[ERROR] urls[57] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-io/1.0/plexus-io-1.0.jar

[ERROR] urls[58] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-i18n/1.0-beta-7/plexus-i18n-1.0-beta-7.jar

[ERROR] urls[59] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-velocity/1.1.8/plexus-velocity-1.1.8.jar

[ERROR] urls[60] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.10/plexus-utils-1.5.10.jar

[ERROR] urls[61] = file:/home/dc/.m2/repository/org/mortbay/jetty/jetty/6.1.25/jetty-6.1.25.jar

[ERROR] urls[62] = file:/home/dc/.m2/repository/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.jar

[ERROR] urls[63] = file:/home/dc/.m2/repository/org/mortbay/jetty/jetty-util/6.1.25/jetty-util-6.1.25.jar

[ERROR] urls[64] = file:/home/dc/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar

[ERROR] urls[65] = file:/home/dc/.m2/repository/commons-io/commons-io/1.4/commons-io-1.4.jar

[ERROR] Number of foreign imports: 1

[ERROR] import: Entry[import  from realm ClassRealm[maven.api, parent: null]]

[ERROR] 

[ERROR] -----------------------------------------------------: org.sonatype.aether.graph.DependencyFilter

 

This error is identical to the similar to this: Hadoop maven-site-plugin version error

 

 

Change the maven-site-plugin from version 3.1 to 3.3 This has to be changed in 2 places in the Crunch parent pom.  Use a text editor to search for maven-site-plugin. Add a 3.3 version tag to below:

 

After:

 

 

 

In the second location change the version from 3.1 to 3.3. 

Before: 

 


 

 

After:

 

 

Sqoop-1.99.2

Same bug as above with maven-site-plugin. 

[WARNING] Error injecting: org.apache.maven.plugins.site.DefaultMavenReportExecutor

java.lang.NoClassDefFoundError: org/sonatype/aether/graph/DependencyFilter{removed the DI error messages}

[INFO] ------------------------------------------------------------------------

[INFO] Reactor Summary:

[INFO] 

[INFO] Sqoop ............................................. SUCCESS [  4.614 s]

[INFO] Sqoop Common ...................................... SUCCESS [  7.750 s]

[INFO] Sqoop SPI ......................................... SUCCESS [  1.254 s]

[INFO] Sqoop Core ........................................ SUCCESS [  2.257 s]

[INFO] Sqoop Repository .................................. SUCCESS [  0.087 s]

[INFO] Sqoop Derby Repository ............................ SUCCESS [  2.012 s]

[INFO] Sqoop Execution Engines ........................... SUCCESS [  0.081 s]

[INFO] Sqoop Mapreduce Execution Engine .................. SUCCESS [  5.580 s]

[INFO] Sqoop Submission Engines .......................... SUCCESS [  0.183 s]

[INFO] Sqoop Mapreduce Submission Engine ................. SUCCESS [  1.045 s]

[INFO] Sqoop Connectors .................................. SUCCESS [  0.088 s]

[INFO] Sqoop Generic JDBC Connector ...................... SUCCESS [  1.626 s]

[INFO] Sqoop Server ...................................... SUCCESS [  2.645 s]

[INFO] Sqoop Client ...................................... SUCCESS [  5.525 s]

[INFO] Sqoop Documentation ............................... FAILURE [  3.730 s]

[INFO] Sqoop Distribution ................................ SKIPPED

[INFO] Sqoop Integration Tests ........................... SKIPPED

[INFO] ------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------------------

[INFO] Total time: 38.962 s

[INFO] Finished at: 2014-06-26T09:54:14-08:00

[INFO] Final Memory: 88M/282M

[INFO] ------------------------------------------------------------------------

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.0-beta-3:site (packaging-documentation) on project sqoop-docs: Execution packaging-documentation of goal org.apache.maven.plugins:maven-site-plugin:3.0-beta-3:site failed: A required class was missing while executing org.apache.maven.plugins:maven-site-plugin:3.0-beta-3:site: org/sonatype/aether/graph/DependencyFilter

[ERROR] -----------------------------------------------------

[ERROR] realm =    plugin>org.apache.maven.plugins:maven-site-plugin:3.0-beta-3

 

modify docs/pom.xml version from 3.0-beta-3 to 3.3 

 

This error is probably for my experience only. The maven-project-info-reports-plugin version 2.2 wasn't available in my m2 repo. And.. the sonatype url specified in the Sqoop docs/pom.xml didn't have it either. 

 

[INFO] ------------------------------------------------------------------------

[INFO] Reactor Summary:

[INFO] 

[INFO] Sqoop ............................................. SUCCESS [  1.478 s]

[INFO] Sqoop Common ...................................... SUCCESS [  5.649 s]

[INFO] Sqoop SPI ......................................... SUCCESS [  0.747 s]

[INFO] Sqoop Core ........................................ SUCCESS [  1.815 s]

[INFO] Sqoop Repository .................................. SUCCESS [  0.063 s]

[INFO] Sqoop Derby Repository ............................ SUCCESS [  1.786 s]

[INFO] Sqoop Execution Engines ........................... SUCCESS [  0.061 s]

[INFO] Sqoop Mapreduce Execution Engine .................. SUCCESS [  4.010 s]

[INFO] Sqoop Submission Engines .......................... SUCCESS [  0.081 s]

[INFO] Sqoop Mapreduce Submission Engine ................. SUCCESS [  0.940 s]

[INFO] Sqoop Connectors .................................. SUCCESS [  0.055 s]

[INFO] Sqoop Generic JDBC Connector ...................... SUCCESS [  1.570 s]

[INFO] Sqoop Server ...................................... SUCCESS [  1.983 s]

[INFO] Sqoop Client ...................................... SUCCESS [  2.842 s]

[INFO] Sqoop Documentation ............................... FAILURE [ 11.882 s]

[INFO] Sqoop Distribution ................................ SKIPPED

[INFO] Sqoop Integration Tests ........................... SKIPPED

[INFO] ------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------------------

[INFO] Total time: 35.388 s

[INFO] Finished at: 2014-06-26T10:14:22-08:00

[INFO] Final Memory: 91M/281M

[INFO] ------------------------------------------------------------------------

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.3:site (packaging-documentation) on project sqoop-docs: failed to get report for org.apache.maven.plugins:maven-project-info-reports-plugin: Plugin org.apache.maven.plugins:maven-project-info-reports-plugin:2.2 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.apache.maven.plugins:maven-project-info-reports-plugin:jar:2.2: Could not transfer artifact org.apache.maven.plugins:maven-project-info-reports-plugin:pom:2.2 from/to oss.sonatype.org (https://oss.sonatype.org/content/groups/public): oss.sonatype.org: Unknown host oss.sonatype.org -> [Help 1]

[ERROR] 

 

There is no maven projectx-info-reports-plugin jar or pom here!!! Sonatype url: 

 

 

In contrast our friendly maven central repo looks like: 

 

Download the jar, install into your local maven repo: 

mvn install:install-file -Dfile=/home/dc/Downloads/maven-project-info-reports-plugin-2.2.jar -DgroupId=org.apache.maven.plugins -DartifactId=maven-project-info-reports-plugin -Dversion=2.2 -Dpackaging=jar

 

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.3:site (packaging-documentation) on project sqoop-docs: failed to get report for org.tomdz.maven:sphinx-maven-plugin: Plugin org.tomdz.maven:sphinx-maven-plugin:1.0.2 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.tomdz.maven:sphinx-maven-plugin:jar:1.0.2: Could not transfer artifact org.tomdz.maven:sphinx-maven-plugin:pom:1.0.2 from/to central (http://repo.maven.apache.org/maven2): repo.maven.apache.org: Unknown host repo.maven.apache.org -> [Help 1]

 

Download the org.tomdz.maven.sphinx-maven-plugin jar and install into local repo using:  

mvn install:install-file -Dfile=/home/dc/Downloads/sphinx-maven-plugin-1.0.2.jar -DgroupId=org.tomdz.maven -DartifactId=sphinx-maven-plugin -Dversion=1.0.2 -Dpackaging=jar

 

 

Whirr 0.8.2

INFO] --- maven-site-plugin:3.0:site (default-site) @ whirr ---
[WARNING] Error injecting: org.apache.maven.reporting.exec.DefaultMavenReportExecutor
java.lang.NoClassDefFoundError: org/sonatype/aether/graph/DependencyFilter
    at java.lang.Class.getDeclaredConstructors0(Native Method)
    at java.lang.Class.privateGetDeclaredConstructors(Class.java:2389)
    at java.lang.Class.getDeclaredConstructors(Class.java:1836)
    at com.google.inject.spi.InjectionPoint.forConstructorOf(InjectionPoint.java:245)
    at com.google.inject.internal.ConstructorBindingImpl.create(ConstructorBindingImpl.java:99)
    at com.google.inject.internal.InjectorImpl.createUninitializedBinding(InjectorImpl.java:653)
    at com.google.inject.internal.InjectorImpl.createJustInTimeBinding(InjectorImpl.java:863)
    at com.google.inject.internal.InjectorImpl.createJustInTimeBindingRecursive(InjectorImpl.java:790)
    at com.google.inject.internal.InjectorImpl.getJustInTimeBinding(InjectorImpl.java:278)
    at com.google.inject.internal.InjectorImpl.getBindingOrThrow(InjectorImpl.java:210)
    at com.google.inject.internal.InjectorImpl.getProviderOrThrow(InjectorImpl.java:986)
    at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:1019)
    at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:982)
    at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1032)
    at org.eclipse.sisu.space.AbstractDeferredClass.get(AbstractDeferredClass.java:48)
    at com.google.inject.internal.ProviderInternalFactory.provision(ProviderInternalFactory.java:86)
    at com.google.inject.internal.InternalFactoryToInitializableAdapter.provision(InternalFactoryToInitializableAdapter.java:55)
    at com.google.inject.internal.ProviderInternalFactory$1.call(ProviderInternalFactory.java:70)
    at com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision(ProvisionListenerStackCallback.java:100)
    at org.eclipse.sisu.plexus.PlexusLifecycleManager.onProvision(PlexusLifecycleManager.java:133)
    at com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision(ProvisionListenerStackCallback.java:109)
    at com.google.inject.internal.ProvisionListenerStackCallback.provision(ProvisionListenerStackCallback.java:55)
    at com.google.inject.internal.ProviderInternalFactory.circularGet(ProviderInternalFactory.java:68)
    at com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:47)
    at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
    at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1054)
    at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
    at com.google.inject.Scopes$1$1.get(Scopes.java:59)
    at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
    at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:997)
    at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1047)
    at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:993)
    at org.eclipse.sisu.inject.LazyBeanEntry.getValue(LazyBeanEntry.java:82)
    at org.eclipse.sisu.plexus.LazyPlexusBean.getValue(LazyPlexusBean.java:51)
    at org.codehaus.plexus.DefaultPlexusContainer.lookup(DefaultPlexusContainer.java:260)
    at org.codehaus.plexus.DefaultPlexusContainer.lookup(DefaultPlexusContainer.java:240)
    at org.codehaus.plexus.DefaultPlexusContainer.lookup(DefaultPlexusContainer.java:234)
    at org.apache.maven.plugins.site.AbstractSiteRenderingMojo.getReports(AbstractSiteRenderingMojo.java:234)
    at org.apache.maven.plugins.site.SiteMojo.execute(SiteMojo.java:121)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
    at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
    at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
    at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
    at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
    at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: java.lang.ClassNotFoundException: org.sonatype.aether.graph.DependencyFilter
    at org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy.loadClass(SelfFirstStrategy.java:50)
    at org.codehaus.plexus.classworlds.realm.ClassRealm.unsynchronizedLoadClass(ClassRealm.java:259)
    at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass(ClassRealm.java:242)
    at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass(ClassRealm.java:227)
    ... 60 more
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Whirr
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Whirr Build Tools ........................... SUCCESS [  1.486 s]
[INFO] Whirr .............................................. FAILURE [  0.419 s]
[INFO] Apache Whirr Core .................................. SKIPPED
[INFO] Apache Whirr Cassandra ............................. SKIPPED
[INFO] Apache Whirr Ganglia ............................... SKIPPED
[INFO] Apache Whirr Hadoop ................................ SKIPPED
[INFO] Apache Whirr ZooKeeper ............................. SKIPPED
[INFO] Apache Whirr HBase ................................. SKIPPED
[INFO] Apache Whirr YARN .................................. SKIPPED
[INFO] Apache Whirr CDH ................................... SKIPPED
[INFO] Apache Whirr Mahout ................................ SKIPPED
[INFO] Apache Whirr Pig ................................... SKIPPED
[INFO] Apache Whirr ElasticSearch ......................... SKIPPED
[INFO] Apache Whirr Hama .................................. SKIPPED
[INFO] Apache Whirr Puppet ................................ SKIPPED
[INFO] Apache Whirr Chef .................................. SKIPPED
[INFO] Apache Whirr Solr .................................. SKIPPED
[INFO] Apache Whirr Kerberos .............................. SKIPPED
[INFO] Apache Whirr CLI ................................... SKIPPED
[INFO] Apache Whirr Examples .............................. SKIPPED
[INFO] Apache Whirr CDH Old Tests ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3.006 s
[INFO] Finished at: 2014-07-18T12:35:16-07:00
[INFO] Final Memory: 30M/341M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.0:site (default-site) on project whirr: Execution default-site of goal org.apache.maven.plugins:maven-site-plugin:3.0:site failed: A required class was missing while executing org.apache.maven.plugins:maven-site-plugin:3.0:site: org/sonatype/aether/graph/DependencyFilter
[ERROR] -----------------------------------------------------
[ERROR] realm =    plugin>org.apache.maven.plugins:maven-site-plugin:3.0--487550925
[ERROR] strategy = org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy
[ERROR] urls[0] = file:/home/dc/.m2/repository/org/apache/maven/plugins/maven-site-plugin/3.0/maven-site-plugin-3.0.jar
[ERROR] urls[1] = file:/home/dc/.m2/repository/org/apache/maven/reporting/maven-reporting-exec/1.0.1/maven-reporting-exec-1.0.1.jar
[ERROR] urls[2] = file:/home/dc/.m2/repository/org/apache/maven/reporting/maven-reporting-api/3.0/maven-reporting-api-3.0.jar
[ERROR] urls[3] = file:/home/dc/.m2/repository/org/apache/velocity/velocity/1.5/velocity-1.5.jar
[ERROR] urls[4] = file:/home/dc/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar
[ERROR] urls[5] = file:/home/dc/.m2/repository/velocity/velocity/1.5/velocity-1.5.jar
[ERROR] urls[6] = file:/home/dc/.m2/repository/org/sonatype/aether/aether-util/1.7/aether-util-1.7.jar
[ERROR] urls[7] = file:/home/dc/.m2/repository/org/sonatype/sisu/sisu-inject-bean/1.4.2/sisu-inject-bean-1.4.2.jar
[ERROR] urls[8] = file:/home/dc/.m2/repository/org/sonatype/sisu/sisu-guice/2.1.7/sisu-guice-2.1.7-noaop.jar
[ERROR] urls[9] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-interpolation/1.14/plexus-interpolation-1.14.jar
[ERROR] urls[10] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar
[ERROR] urls[11] = file:/home/dc/.m2/repository/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.jar
[ERROR] urls[12] = file:/home/dc/.m2/repository/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.jar
[ERROR] urls[13] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-sink-api/1.2/doxia-sink-api-1.2.jar
[ERROR] urls[14] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-logging-api/1.2/doxia-logging-api-1.2.jar
[ERROR] urls[15] = file:/home/dc/.m2/repository/junit/junit/3.8.1/junit-3.8.1.jar
[ERROR] urls[16] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-core/1.2/doxia-core-1.2.jar
[ERROR] urls[17] = file:/home/dc/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar
[ERROR] urls[18] = file:/home/dc/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar
[ERROR] urls[19] = file:/home/dc/.m2/repository/org/apache/httpcomponents/httpclient/4.0.2/httpclient-4.0.2.jar
[ERROR] urls[20] = file:/home/dc/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar
[ERROR] urls[21] = file:/home/dc/.m2/repository/commons-codec/commons-codec/1.3/commons-codec-1.3.jar
[ERROR] urls[22] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-module-xhtml/1.2/doxia-module-xhtml-1.2.jar
[ERROR] urls[23] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-module-apt/1.2/doxia-module-apt-1.2.jar
[ERROR] urls[24] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-module-xdoc/1.2/doxia-module-xdoc-1.2.jar
[ERROR] urls[25] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-module-fml/1.2/doxia-module-fml-1.2.jar
[ERROR] urls[26] = file:/home/dc/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar
[ERROR] urls[27] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-decoration-model/1.2/doxia-decoration-model-1.2.jar
[ERROR] urls[28] = file:/home/dc/.m2/repository/org/apache/maven/doxia/doxia-site-renderer/1.2/doxia-site-renderer-1.2.jar
[ERROR] urls[29] = file:/home/dc/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar
[ERROR] urls[30] = file:/home/dc/.m2/repository/org/apache/maven/shared/maven-doxia-tools/1.4/maven-doxia-tools-1.4.jar
[ERROR] urls[31] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-archiver/1.0/plexus-archiver-1.0.jar
[ERROR] urls[32] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-io/1.0/plexus-io-1.0.jar
[ERROR] urls[33] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-i18n/1.0-beta-7/plexus-i18n-1.0-beta-7.jar
[ERROR] urls[34] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-velocity/1.1.8/plexus-velocity-1.1.8.jar
[ERROR] urls[35] = file:/home/dc/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.10/plexus-utils-1.5.10.jar
[ERROR] urls[36] = file:/home/dc/.m2/repository/org/mortbay/jetty/jetty/6.1.25/jetty-6.1.25.jar
[ERROR] urls[37] = file:/home/dc/.m2/repository/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.jar
[ERROR] urls[38] = file:/home/dc/.m2/repository/org/mortbay/jetty/jetty-util/6.1.25/jetty-util-6.1.25.jar
[ERROR] urls[39] = file:/home/dc/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar
[ERROR] urls[40] = file:/home/dc/.m2/repository/commons-io/commons-io/1.4/commons-io-1.4.jar
[ERROR] Number of foreign imports: 1
[ERROR] import: Entry[import  from realm ClassRealm[project>org.apache.whirr:whirr:0.8.2, parent: ClassRealm[maven.api, parent: null]]]
[ERROR]
[ERROR] -----------------------------------------------------: org.sonatype.aether.graph.DependencyFilter
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/AetherClassNotFound
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :whirr
make[1]: *** [override_dh_auto_build] Error 1
make[1]: Leaving directory `/home/dc/bigtop/output/whirr/whirr-0.8.2'
make: *** [build] Error 2
dpkg-buildpackage: error: debian/rules build gave error exit status 2
debuild: fatal error at line 1364:
dpkg-buildpackage -rfakeroot -D -us -uc -b failed
make: *** [/home/dc/bigtop/build/whirr//.deb] Error 29

Same solution, change the whirr maven-site-plugin version to 3.3

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Comments (0)

You don't have permission to comment on this page.