You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@predictionio.apache.org by "Stephan Volkeri (JIRA)" <ji...@apache.org> on 2017/05/31 12:53:04 UTC
[jira] [Updated] (PIO-91) hadoop-hdfs artifact missing when
creating binary version of PredictionIO
[ https://issues.apache.org/jira/browse/PIO-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephan Volkeri updated PIO-91:
-------------------------------
Description:
I tried to upgrade from Version 0.10.0-incubating to 0.11.0-incubating.
After I created the binary version with:
./make-distribution.sh -Dscala.version=2.10.5 -Dspark.version=1.6.3 -Delasticsearch.version=1.7.5
I copied the config files from my 0.10.0-incubating conf folder.
During the test with "pio status" I got following error:
2017-05-31 13:08:46,819 ERROR org.apache.predictionio.data.storage.Storage$ [main] - Error initializing storage client for source HDFS
java.io.IOException: No FileSystem for scheme: hdfs
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2586)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2593)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2632)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2614)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
at org.apache.predictionio.data.storage.hdfs.StorageClient.<init>(StorageClient.scala:32)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.predictionio.data.storage.Storage$.getClient(Storage.scala:223)
at org.apache.predictionio.data.storage.Storage$.org$apache$predictionio$data$storage$Storage$$updateS2CM(Storage.scala:254)
at org.apache.predictionio.data.storage.Storage$$anonfun$sourcesToClientMeta$1.apply(Storage.scala:215)
at org.apache.predictionio.data.storage.Storage$$anonfun$sourcesToClientMeta$1.apply(Storage.scala:215)
at scala.collection.mutable.MapLike$class.getOrElseUpdate(MapLike.scala:189)
at scala.collection.mutable.AbstractMap.getOrElseUpdate(Map.scala:91)
at org.apache.predictionio.data.storage.Storage$.sourcesToClientMeta(Storage.scala:215)
at org.apache.predictionio.data.storage.Storage$.getDataObject(Storage.scala:284)
at org.apache.predictionio.data.storage.Storage$.getDataObjectFromRepo(Storage.scala:269)
at org.apache.predictionio.data.storage.Storage$.getModelDataModels(Storage.scala:411)
at org.apache.predictionio.data.storage.Storage$.verifyAllDataObjects(Storage.scala:350)
at org.apache.predictionio.tools.commands.Management$.status(Management.scala:156)
at org.apache.predictionio.tools.console.Pio$.status(Pio.scala:144)
at org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:663)
at org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:611)
at scala.Option.map(Option.scala:145)
at org.apache.predictionio.tools.console.Console$.main(Console.scala:611)
at org.apache.predictionio.tools.console.Console.main(Console.scala)
2017-05-31 13:08:46,826 ERROR org.apache.predictionio.tools.commands.Management$ [main] - Unable to connect to all storage backends successfully.
was:
I tried to upgrade from Version 0.10.0-incubating to 0.11.0-incubating.
After I created the binary version with:
./make-distribution.sh -Dscala.version=2.10.5 -Dspark.version=1.6.3 -Delasticsearch.version=1.7.5
I copied the config files from my 0.10.0-incubating conf folder.
During the test with "pio status" I got follwing error:
2017-05-31 13:08:46,819 ERROR org.apache.predictionio.data.storage.Storage$ [main] - Error initializing storage client for source HDFS
java.io.IOException: No FileSystem for scheme: hdfs
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2586)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2593)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2632)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2614)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
at org.apache.predictionio.data.storage.hdfs.StorageClient.<init>(StorageClient.scala:32)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.predictionio.data.storage.Storage$.getClient(Storage.scala:223)
at org.apache.predictionio.data.storage.Storage$.org$apache$predictionio$data$storage$Storage$$updateS2CM(Storage.scala:254)
at org.apache.predictionio.data.storage.Storage$$anonfun$sourcesToClientMeta$1.apply(Storage.scala:215)
at org.apache.predictionio.data.storage.Storage$$anonfun$sourcesToClientMeta$1.apply(Storage.scala:215)
at scala.collection.mutable.MapLike$class.getOrElseUpdate(MapLike.scala:189)
at scala.collection.mutable.AbstractMap.getOrElseUpdate(Map.scala:91)
at org.apache.predictionio.data.storage.Storage$.sourcesToClientMeta(Storage.scala:215)
at org.apache.predictionio.data.storage.Storage$.getDataObject(Storage.scala:284)
at org.apache.predictionio.data.storage.Storage$.getDataObjectFromRepo(Storage.scala:269)
at org.apache.predictionio.data.storage.Storage$.getModelDataModels(Storage.scala:411)
at org.apache.predictionio.data.storage.Storage$.verifyAllDataObjects(Storage.scala:350)
at org.apache.predictionio.tools.commands.Management$.status(Management.scala:156)
at org.apache.predictionio.tools.console.Pio$.status(Pio.scala:144)
at org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:663)
at org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:611)
at scala.Option.map(Option.scala:145)
at org.apache.predictionio.tools.console.Console$.main(Console.scala:611)
at org.apache.predictionio.tools.console.Console.main(Console.scala)
2017-05-31 13:08:46,826 ERROR org.apache.predictionio.tools.commands.Management$ [main] - Unable to connect to all storage backends successfully.
> hadoop-hdfs artifact missing when creating binary version of PredictionIO
> -------------------------------------------------------------------------
>
> Key: PIO-91
> URL: https://issues.apache.org/jira/browse/PIO-91
> Project: PredictionIO
> Issue Type: Bug
> Components: Build
> Affects Versions: 0.11.0-incubating
> Environment: Spark: 1.6.3 for Hadoop 2.6
> Hadoop: 2.6.5
> Elasticsearch: 1.7.3
> Hbase: 1.2.5
> Scala: 2.10.6
> Reporter: Stephan Volkeri
>
> I tried to upgrade from Version 0.10.0-incubating to 0.11.0-incubating.
> After I created the binary version with:
> ./make-distribution.sh -Dscala.version=2.10.5 -Dspark.version=1.6.3 -Delasticsearch.version=1.7.5
> I copied the config files from my 0.10.0-incubating conf folder.
> During the test with "pio status" I got following error:
> 2017-05-31 13:08:46,819 ERROR org.apache.predictionio.data.storage.Storage$ [main] - Error initializing storage client for source HDFS
> java.io.IOException: No FileSystem for scheme: hdfs
> at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2586)
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2593)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
> at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2632)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2614)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
> at org.apache.predictionio.data.storage.hdfs.StorageClient.<init>(StorageClient.scala:32)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at org.apache.predictionio.data.storage.Storage$.getClient(Storage.scala:223)
> at org.apache.predictionio.data.storage.Storage$.org$apache$predictionio$data$storage$Storage$$updateS2CM(Storage.scala:254)
> at org.apache.predictionio.data.storage.Storage$$anonfun$sourcesToClientMeta$1.apply(Storage.scala:215)
> at org.apache.predictionio.data.storage.Storage$$anonfun$sourcesToClientMeta$1.apply(Storage.scala:215)
> at scala.collection.mutable.MapLike$class.getOrElseUpdate(MapLike.scala:189)
> at scala.collection.mutable.AbstractMap.getOrElseUpdate(Map.scala:91)
> at org.apache.predictionio.data.storage.Storage$.sourcesToClientMeta(Storage.scala:215)
> at org.apache.predictionio.data.storage.Storage$.getDataObject(Storage.scala:284)
> at org.apache.predictionio.data.storage.Storage$.getDataObjectFromRepo(Storage.scala:269)
> at org.apache.predictionio.data.storage.Storage$.getModelDataModels(Storage.scala:411)
> at org.apache.predictionio.data.storage.Storage$.verifyAllDataObjects(Storage.scala:350)
> at org.apache.predictionio.tools.commands.Management$.status(Management.scala:156)
> at org.apache.predictionio.tools.console.Pio$.status(Pio.scala:144)
> at org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:663)
> at org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:611)
> at scala.Option.map(Option.scala:145)
> at org.apache.predictionio.tools.console.Console$.main(Console.scala:611)
> at org.apache.predictionio.tools.console.Console.main(Console.scala)
> 2017-05-31 13:08:46,826 ERROR org.apache.predictionio.tools.commands.Management$ [main] - Unable to connect to all storage backends successfully.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)