You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2019/05/27 01:43:26 UTC

[GitHub] [incubator-hudi] eisig opened a new issue #695: quickstart demo stock_ticks_mor and stock_ticks_mor_rt return the same result

eisig opened a new issue #695: quickstart demo stock_ticks_mor and stock_ticks_mor_rt return the same result
URL: https://github.com/apache/incubator-hudi/issues/695
 
 
   I follow https://hudi.incubator.apache.org/docker_demo.html
   Step 6(a): Run Hive Queries
   The docs say that` ReadOptimized view will still return “10:29 am” as it will only read from the Parquet file. Realtime View will do on-the-fly merge and return latest committed data which is “10:59 a.m”.`
   But I get the same result.
   
   latest master brach(commit d0d2fa03379525e8156d5dc0adae9eb852603899)
   
   
   ```
   0: jdbc:hive2://hiveserver:10000>  select symbol, max(ts) from stock_ticks_mor group by symbol HAVING symbol = 'GOOG';
   WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
   +---------+----------------------+--+
   | symbol  |         _c1          |
   +---------+----------------------+--+
   | GOOG    | 2018-08-31 10:59:00  |
   +---------+----------------------+--+
   1 row selected (1.779 seconds)
   0: jdbc:hive2://hiveserver:10000> select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor where  symbol = 'GOOG';
   +----------------------+---------+----------------------+---------+------------+-----------+--+
   | _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
   +----------------------+---------+----------------------+---------+------------+-----------+--+
   | 20190527012650       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
   | 20190527013023       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
   +----------------------+---------+----------------------+---------+------------+-----------+--+
   2 rows selected (0.334 seconds)
   0: jdbc:hive2://hiveserver:10000> select symbol, max(ts) from stock_ticks_mor_rt group by symbol HAVING symbol = 'GOOG';
   WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
   +---------+----------------------+--+
   | symbol  |         _c1          |
   +---------+----------------------+--+
   | GOOG    | 2018-08-31 10:59:00  |
   +---------+----------------------+--+
   1 row selected (1.99 seconds)
   0: jdbc:hive2://hiveserver:10000> select `_hoodie_commit_time`, symbol, ts, volume, open, close  from stock_ticks_mor_rt where  symbol = 'GOOG';
   +----------------------+---------+----------------------+---------+------------+-----------+--+
   | _hoodie_commit_time  | symbol  |          ts          | volume  |    open    |   close   |
   +----------------------+---------+----------------------+---------+------------+-----------+--+
   | 20190527012650       | GOOG    | 2018-08-31 09:59:00  | 6330    | 1230.5     | 1230.02   |
   | 20190527013023       | GOOG    | 2018-08-31 10:59:00  | 9021    | 1227.1993  | 1227.215  |
   +----------------------+---------+----------------------+---------+------------+-----------+--+
   2 rows selected (0.434 seconds)
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services