You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/04/30 22:41:01 UTC
[GitHub] [incubator-hudi] tooptoop4 opened a new issue #1579: [SUPPORT] https://github.com/YotpoLtd/metorikku/issues/290
tooptoop4 opened a new issue #1579:
URL: https://github.com/apache/incubator-hudi/issues/1579
pls help with https://github.com/YotpoLtd/metorikku/issues/290
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-hudi] tooptoop4 commented on issue #1579: [SUPPORT] https://github.com/YotpoLtd/metorikku/issues/290
Posted by GitBox <gi...@apache.org>.
tooptoop4 commented on issue #1579:
URL: https://github.com/apache/incubator-hudi/issues/1579#issuecomment-624364902
@bvaradar format("com.uber.hoodie") is not an option that can be specified in metorikku (Exception in thread "main" com.uber.hoodie.exception.HoodieException: 'path' must be specified.
at com.uber.hoodie.DefaultSource.createRelation(DefaultSource.scala:57)
at com.uber.hoodie.DefaultSource.createRelation(DefaultSource.scala:46)), from spark-shell it works
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-hudi] bvaradar commented on issue #1579: [SUPPORT] https://github.com/YotpoLtd/metorikku/issues/290
Posted by GitBox <gi...@apache.org>.
bvaradar commented on issue #1579:
URL: https://github.com/apache/incubator-hudi/issues/1579#issuecomment-622764285
@tooptoop4 : Did you try the blob pattern as described in https://hudi.apache.org/docs/quick-start-guide.html#query-data
For 0.4.6, it should be something like :
val tripsSnapshotDF = spark.
read.
format("com.uber.hoodie").
load(basePath + "/*/*/*/*")
BTW, 0.4.6 is really old version of hudi. Is it possible to use 0.5.x version of hudi ?
I would suggest testing the spark data-source query directly to isolate the problem between hudi and metorikku,
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-hudi] bvaradar commented on issue #1579: [SUPPORT] https://github.com/YotpoLtd/metorikku/issues/290
Posted by GitBox <gi...@apache.org>.
bvaradar commented on issue #1579:
URL: https://github.com/apache/incubator-hudi/issues/1579#issuecomment-626308701
@tooptoop4 : I am not sure how metorikku has integrated with Hudi but if they use Hudi's Spark datasource support, HoodieROTablePathFilter would be set already. If your question was different, please elaborate.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org