You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Sowjanya Kakarala <so...@agrible.com> on 2018/04/30 15:53:35 UTC
ACID transactions table data not getting inserted
Hi all,
I am using S3 location to store data in ORC table and I am not seeing any
data from it any help here?
Even I used default location which is HDFS it results the same in ORC 'no
data'.
hive> *create* *table* test_S3_*text*(cell_id int, run_date string,
init_hour double, pet array<double>, rainfall array<double>, rhmax
array<double>,rhmin array<double>, solar array<double>, tmax array<double>,
tmin array<double>, windspeedmax array<double>, windspeedmean
array<double>) clustered by (cell_id) into 10 buckets row format delimited
fields terminated by ',' collection items terminated by '$' stored as
textfile location 's3://agrible-weather/monolith/test_S3_text';
OK
Time taken: 3.313 seconds
hive> *load* data local inpath
'/tmp/sowjanya_files/asperitas/gfshourly/gfstest.csv' overwrite into table
test_S3_text;
Loading data to table monolith.test_s3_text
OK
Time taken: 2.704 seconds
hive> select * from *test_s3_text*;
OK
1 2018-04-05 0.0 [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07]
[0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07]
[0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07] [0.03,0.04,0.05,0.07]
[0.03,0.04,0.05,0.07]
Time taken: 0.187 seconds, Fetched: 1 row(s)
hive>* create table test_S3_orc*(cell_id int, run_date string, init_hour
double, pet array<double>, rainfall array<double>, rhmax
array<double>,rhmin array<double>, solar array<double>, tmax array<double>,
tmin array<double>, windspeedmax array<double>, windspeedmean array<double>)
clustered by (cell_id) into 10 buckets row format delimited fields
terminated by ',' collection items terminated by '$' stored as orc location
's3://agrible-weather/monolith/test_S3_orc' TBLPROPERTIES
('transactional'='true');
OK
Time taken: 3.209 seconds
hive> *insert into* table test_S3_orc select * from test_S3_text;
Query ID = hadoop_20180430154640_71a46667-9f8f-41d3-93a6-c9360d0fbabb
Total jobs = 1
Launching Job 1 out of 1
Status: Running (Executing on YARN cluster with App id
application_1524689752360_0094)
----------------------------------------------------------------------------------------------
* VERTICES MODE STATUS TOTAL COMPLETED RUNNING
PENDING FAILED KILLED *
----------------------------------------------------------------------------------------------
Map 1 .......... container SUCCEEDED 1 1 0 0
0 0
----------------------------------------------------------------------------------------------
*VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 11.09
s *
----------------------------------------------------------------------------------------------
Loading data to table monolith.test_s3_orc
OK
Time taken: 24.364 seconds
*hive> select * from test_S3_orc;*
*OK*
*Time taken: 0.219 seconds*
Any suggestions what todo?