You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@servicemix.apache.org by "Claus Ibsen (JIRA)" <ji...@apache.org> on 2012/05/25 10:58:23 UTC
[jira] [Created] (SMX4-1147) Hadoop 1.0.3 osgi bundle
Claus Ibsen created SMX4-1147:
---------------------------------
Summary: Hadoop 1.0.3 osgi bundle
Key: SMX4-1147
URL: https://issues.apache.org/jira/browse/SMX4-1147
Project: ServiceMix 4
Issue Type: Task
Components: Bundles
Reporter: Claus Ibsen
Hadoop 1.0.3 has been released.
It would be nice with an osgi bundle for that
http://search.maven.org/#artifactdetails%7Corg.apache.hadoop%7Chadoop-core%7C1.0.3%7Cjar
We currently have in progress a 1.0.0 osgi bundle
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (SMX4-1147) Hadoop 1.0.3 osgi bundle
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SMX4-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen reassigned SMX4-1147:
---------------------------------
Assignee: Freeman Fang
Freeman do you mind looking into this?
> Hadoop 1.0.3 osgi bundle
> ------------------------
>
> Key: SMX4-1147
> URL: https://issues.apache.org/jira/browse/SMX4-1147
> Project: ServiceMix 4
> Issue Type: Task
> Components: Bundles
> Reporter: Claus Ibsen
> Assignee: Freeman Fang
>
> Hadoop 1.0.3 has been released.
> It would be nice with an osgi bundle for that
> http://search.maven.org/#artifactdetails%7Corg.apache.hadoop%7Chadoop-core%7C1.0.3%7Cjar
> We currently have in progress a 1.0.0 osgi bundle
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SMX4-1147) Hadoop 1.0.3 osgi bundle
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SMX4-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284856#comment-13284856 ]
Claus Ibsen commented on SMX4-1147:
-----------------------------------
Okay the issue is the bundle using hadoop, need to use dynamic import, eg
{code:xml}
<!-- to generate the MANIFEST-FILE of the bundle -->
<plugin>
<groupId>org.apache.felix</groupId>
<artifactId>maven-bundle-plugin</artifactId>
<version>2.3.4</version>
<extensions>true</extensions>
<configuration>
<instructions>
<Bundle-SymbolicName>test-hadoop_incoming</Bundle-SymbolicName>
<Import-Package>*</Import-Package>
<DynamicImport-Package>*</DynamicImport-Package>
</instructions>
</configuration>
</plugin>
{code}
> Hadoop 1.0.3 osgi bundle
> ------------------------
>
> Key: SMX4-1147
> URL: https://issues.apache.org/jira/browse/SMX4-1147
> Project: ServiceMix 4
> Issue Type: Task
> Components: Bundles
> Reporter: Claus Ibsen
> Assignee: Freeman Fang
>
> Hadoop 1.0.3 has been released.
> It would be nice with an osgi bundle for that
> http://search.maven.org/#artifactdetails%7Corg.apache.hadoop%7Chadoop-core%7C1.0.3%7Cjar
> We currently have in progress a 1.0.0 osgi bundle
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SMX4-1147) Hadoop 1.0.3 osgi bundle
Posted by "Freeman Fang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SMX4-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285294#comment-13285294 ]
Freeman Fang commented on SMX4-1147:
------------------------------------
track this issue also on hadoop side[1]
[1]https://issues.apache.org/jira/browse/HADOOP-8446
> Hadoop 1.0.3 osgi bundle
> ------------------------
>
> Key: SMX4-1147
> URL: https://issues.apache.org/jira/browse/SMX4-1147
> Project: ServiceMix 4
> Issue Type: Task
> Components: Bundles
> Reporter: Claus Ibsen
> Assignee: Freeman Fang
>
> Hadoop 1.0.3 has been released.
> It would be nice with an osgi bundle for that
> http://search.maven.org/#artifactdetails%7Corg.apache.hadoop%7Chadoop-core%7C1.0.3%7Cjar
> We currently have in progress a 1.0.0 osgi bundle
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (SMX4-1147) Hadoop 1.0.3 osgi bundle
Posted by "Freeman Fang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SMX4-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on SMX4-1147 started by Freeman Fang.
> Hadoop 1.0.3 osgi bundle
> ------------------------
>
> Key: SMX4-1147
> URL: https://issues.apache.org/jira/browse/SMX4-1147
> Project: ServiceMix 4
> Issue Type: Task
> Components: Bundles
> Reporter: Claus Ibsen
> Assignee: Freeman Fang
>
> Hadoop 1.0.3 has been released.
> It would be nice with an osgi bundle for that
> http://search.maven.org/#artifactdetails%7Corg.apache.hadoop%7Chadoop-core%7C1.0.3%7Cjar
> We currently have in progress a 1.0.0 osgi bundle
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SMX4-1147) Hadoop 1.0.3 osgi bundle
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SMX4-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284850#comment-13284850 ]
Claus Ibsen commented on SMX4-1147:
-----------------------------------
There is something wrong with the 1.0.0_2 bundle meta data, we get this kind of exception when using it
{code}
[ 227] [Installed ] [ ] [ ] [ 60] Hadoop Incoming Bundle (1.0.0)
Karaf:karaf@root> osgi:start 227
Karaf:karaf@root> Exception in thread "SpringOsgiExtenderThread-2" org.apache.camel.FailedToCreateProducerException: Failed to create Producer for endpoint: Endpoint[hdfs://localhost:9000/simple-file?splitStrategy=IDLE%3A1000%2CBYTES%3A5]. Reason: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.security.ShellBasedUnixGroupsMapping not found from bundle [test-hadoop_incoming]
at org.apache.camel.impl.ProducerCache.doGetProducer(ProducerCache.java:381)
at org.apache.camel.impl.ProducerCache.acquireProducer(ProducerCache.java:108)
at org.apache.camel.impl.ProducerCache.startProducer(ProducerCache.java:139)
at org.apache.camel.processor.SendProcessor.doStart(SendProcessor.java:168)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:70)
at org.apache.camel.processor.DelegateAsyncProcessor.doStart(DelegateAsyncProcessor.java:78)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:70)
at org.apache.camel.processor.DelegateAsyncProcessor.doStart(DelegateAsyncProcessor.java:78)
at org.apache.camel.processor.interceptor.TraceInterceptor.doStart(TraceInterceptor.java:358)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:70)
at org.apache.camel.processor.DelegateAsyncProcessor.doStart(DelegateAsyncProcessor.java:78)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:70)
at org.apache.camel.processor.RedeliveryErrorHandler.doStart(RedeliveryErrorHandler.java:1040)
at org.apache.camel.support.ChildServiceSupport.start(ChildServiceSupport.java:41)
at org.apache.camel.support.ChildServiceSupport.start(ChildServiceSupport.java:28)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:70)
at org.apache.camel.processor.interceptor.DefaultChannel.doStart(DefaultChannel.java:151)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:82)
at org.apache.camel.processor.MulticastProcessor.doStart(MulticastProcessor.java:934)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:70)
at org.apache.camel.processor.DelegateAsyncProcessor.doStart(DelegateAsyncProcessor.java:78)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:70)
at org.apache.camel.processor.DelegateAsyncProcessor.doStart(DelegateAsyncProcessor.java:78)
at org.apache.camel.processor.UnitOfWorkProcessor.doStart(UnitOfWorkProcessor.java:88)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:70)
at org.apache.camel.processor.DelegateAsyncProcessor.doStart(DelegateAsyncProcessor.java:78)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:49)
at org.apache.camel.util.ServiceHelper.startServices(ServiceHelper.java:70)
at org.apache.camel.processor.DelegateAsyncProcessor.doStart(DelegateAsyncProcessor.java:78)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.impl.RouteService.startChildService(RouteService.java:323)
at org.apache.camel.impl.RouteService.warmUp(RouteService.java:152)
at org.apache.camel.impl.DefaultCamelContext.doWarmUpRoutes(DefaultCamelContext.java:1921)
at org.apache.camel.impl.DefaultCamelContext.safelyStartRouteServices(DefaultCamelContext.java:1849)
at org.apache.camel.impl.DefaultCamelContext.doStartOrResumeRoutes(DefaultCamelContext.java:1642)
at org.apache.camel.impl.DefaultCamelContext.doStartCamel(DefaultCamelContext.java:1531)
at org.apache.camel.impl.DefaultCamelContext.doStart(DefaultCamelContext.java:1413)
at org.apache.camel.spring.SpringCamelContext.doStart(SpringCamelContext.java:181)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.impl.DefaultCamelContext.start(DefaultCamelContext.java:1381)
at org.apache.camel.spring.SpringCamelContext.maybeStart(SpringCamelContext.java:230)
at org.apache.camel.spring.SpringCamelContext.onApplicationEvent(SpringCamelContext.java:120)
at org.apache.camel.spring.CamelContextFactoryBean.onApplicationEvent(CamelContextFactoryBean.java:242)
at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:97)
at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:303)
at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:911)
at org.springframework.osgi.context.support.AbstractOsgiBundleApplicationContext.finishRefresh(AbstractOsgiBundleApplicationContext.java:235)
at org.springframework.osgi.context.support.AbstractDelegatedExecutionApplicationContext$4.run(AbstractDelegatedExecutionApplicationContext.java:358)
at org.springframework.osgi.util.internal.PrivilegedUtils.executeWithCustomTCCL(PrivilegedUtils.java:85)
at org.springframework.osgi.context.support.AbstractDelegatedExecutionApplicationContext.completeRefresh(AbstractDelegatedExecutionApplicationContext.java:320)
at org.springframework.osgi.extender.internal.dependencies.startup.DependencyWaiterApplicationContextExecutor$CompleteRefreshTask.run(DependencyWaiterApplicationContextExecutor.java:132)
at java.lang.Thread.run(Thread.java:680)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.security.ShellBasedUnixGroupsMapping not found from bundle [test-hadoop_incoming]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:898)
at org.apache.hadoop.security.Groups.<init>(Groups.java:48)
at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:137)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:198)
at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:177)
at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:229)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:432)
at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:418)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.camel.component.hdfs.HdfsInfo.<init>(HdfsInfo.java:34)
at org.apache.camel.component.hdfs.HdfsOutputStream.createOutputStream(HdfsOutputStream.java:48)
at org.apache.camel.component.hdfs.HdfsProducer.doStart(HdfsProducer.java:93)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:60)
at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:59)
at org.apache.camel.impl.ProducerCache.doGetProducer(ProducerCache.java:379)
... 80 more
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.security.ShellBasedUnixGroupsMapping not found from bundle [test-hadoop_incoming]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:866)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:890)
... 96 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.security.ShellBasedUnixGroupsMapping not found from bundle [test-hadoop_incoming]
at org.springframework.osgi.util.BundleDelegatingClassLoader.findClass(BundleDelegatingClassLoader.java:103)
at org.springframework.osgi.util.BundleDelegatingClassLoader.loadClass(BundleDelegatingClassLoader.java:156)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:819)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:864)
... 97 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.security.ShellBasedUnixGroupsMapping not found by test-hadoop_incoming [227]
at org.apache.felix.framework.BundleWiringImpl.findClassOrResourceByDelegation(BundleWiringImpl.java:1467)
at org.apache.felix.framework.BundleWiringImpl.access$400(BundleWiringImpl.java:73)
at org.apache.felix.framework.BundleWiringImpl$BundleClassLoader.loadClass(BundleWiringImpl.java:1850)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at org.apache.felix.framework.Felix.loadBundleClass(Felix.java:1745)
at org.apache.felix.framework.BundleImpl.loadClass(BundleImpl.java:929)
at org.springframework.osgi.util.BundleDelegatingClassLoader.findClass(BundleDelegatingClassLoader.java:99)
... 103 more
{code}
> Hadoop 1.0.3 osgi bundle
> ------------------------
>
> Key: SMX4-1147
> URL: https://issues.apache.org/jira/browse/SMX4-1147
> Project: ServiceMix 4
> Issue Type: Task
> Components: Bundles
> Reporter: Claus Ibsen
> Assignee: Freeman Fang
>
> Hadoop 1.0.3 has been released.
> It would be nice with an osgi bundle for that
> http://search.maven.org/#artifactdetails%7Corg.apache.hadoop%7Chadoop-core%7C1.0.3%7Cjar
> We currently have in progress a 1.0.0 osgi bundle
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (SMX4-1147) Hadoop 1.0.3 osgi bundle
Posted by "Freeman Fang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SMX4-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Freeman Fang resolved SMX4-1147.
--------------------------------
Resolution: Fixed
commit fix
http://svn.apache.org/viewvc?rev=1344051&view=rev
> Hadoop 1.0.3 osgi bundle
> ------------------------
>
> Key: SMX4-1147
> URL: https://issues.apache.org/jira/browse/SMX4-1147
> Project: ServiceMix 4
> Issue Type: Task
> Components: Bundles
> Reporter: Claus Ibsen
> Assignee: Freeman Fang
>
> Hadoop 1.0.3 has been released.
> It would be nice with an osgi bundle for that
> http://search.maven.org/#artifactdetails%7Corg.apache.hadoop%7Chadoop-core%7C1.0.3%7Cjar
> We currently have in progress a 1.0.0 osgi bundle
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SMX4-1147) Hadoop 1.0.3 osgi bundle
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SMX4-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284851#comment-13284851 ]
Claus Ibsen commented on SMX4-1147:
-----------------------------------
Notice the ClassNotFoundException from the hadoop bundle
> Hadoop 1.0.3 osgi bundle
> ------------------------
>
> Key: SMX4-1147
> URL: https://issues.apache.org/jira/browse/SMX4-1147
> Project: ServiceMix 4
> Issue Type: Task
> Components: Bundles
> Reporter: Claus Ibsen
> Assignee: Freeman Fang
>
> Hadoop 1.0.3 has been released.
> It would be nice with an osgi bundle for that
> http://search.maven.org/#artifactdetails%7Corg.apache.hadoop%7Chadoop-core%7C1.0.3%7Cjar
> We currently have in progress a 1.0.0 osgi bundle
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SMX4-1147) Hadoop 1.0.3 osgi bundle
Posted by "Ioannis Canellos (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SMX4-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285053#comment-13285053 ]
Ioannis Canellos commented on SMX4-1147:
----------------------------------------
I've encountered this issue myself. You don't need to use dynamic imports. Just import the org.apache.hadoop.security package and you will be fine.
> Hadoop 1.0.3 osgi bundle
> ------------------------
>
> Key: SMX4-1147
> URL: https://issues.apache.org/jira/browse/SMX4-1147
> Project: ServiceMix 4
> Issue Type: Task
> Components: Bundles
> Reporter: Claus Ibsen
> Assignee: Freeman Fang
>
> Hadoop 1.0.3 has been released.
> It would be nice with an osgi bundle for that
> http://search.maven.org/#artifactdetails%7Corg.apache.hadoop%7Chadoop-core%7C1.0.3%7Cjar
> We currently have in progress a 1.0.0 osgi bundle
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira