You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/03/06 18:56:51 UTC

[GitHub] [hudi] fedsp commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

fedsp commented on pull request #4720:
URL: https://github.com/apache/hudi/pull/4720#issuecomment-1060018898


   Hi @xushiyan! Sorry for the long response, I had some trouble building the .jar (not used to do it)
   
   Anyways, I'm receiving a error from a straight sql statement running from AwsAthena (no problem creating the table on aws glue using spark 3 tho)
   
   This is the error:
   ![image](https://user-images.githubusercontent.com/22076750/156937853-50cf73b1-85dc-429b-a3e5-05dd037027da.png)
   
   And this is the query that I used on athena:
   `select * from hudi_0_11_tst TIMESTAMP AS OF '2022-03-06 15:30:58'`
   
   and this is the DDL of the table creation (I created the table by hand, not on the spark write operation):
   ```
   CREATE EXTERNAL TABLE hudi_0_11_tst(
       `tpep_pickup_datetime` timestamp,
       `tpep_dropoff_datetime` timestamp,
       `passenger_count` int,
       `trip_distance` double,
       `ratecodeid` int,
       `store_and_fwd_flag` string,
       `pulocationid` int,
       `dolocationid` int,
       `payment_type` int,
       `fare_amount` double,
       `extra` double,
       `mta_tax` double,
       `tip_amount` double,
       `tolls_amount` double,
       `improvement_surcharge` double,
       `total_amount` double,
       `congestion_surcharge` double,
       `pk_col` bigint
   )
   PARTITIONED BY (
       `vendorid` string)
   ROW FORMAT SERDE
       'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe'
   WITH SERDEPROPERTIES ( 
       'path'='s3://mybuckethudi_0_11_tst')
   STORED AS INPUTFORMAT
       'org.apache.hudi.hadoop.HoodieParquetInputFormat'
   OUTPUTFORMAT
       'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat'
   LOCATION
       's3://mybucket/hudi_0_11_tst'
   ```
   
   
   Did I did something wrong?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org