You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/07/22 02:17:58 UTC

[GitHub] [hudi] paul8263 opened a new issue, #6177: [SUPPORT] Hudi cli got empty result for command show fsview all

paul8263 opened a new issue, #6177:
URL: https://github.com/apache/hudi/issues/6177

   **Describe the problem you faced**
   
   Hudi cli got empty result after running command show fsview all.
   
   ![image](https://user-images.githubusercontent.com/7007327/180346750-6a55f472-45ac-46cf-8185-3c4fc4c76434.png)
   
   The type of table t1 is  COW and I am sure that the parquet file is actually generated inside data folder. Also, the parquet files are not damaged as the data could be retrieved correctly by reading as Hudi table or directly reading each parquet file(using Spark).
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   1. Enter Flink SQL client.
   2. Execute the SQL and check the data was written successfully.
   ```sql
   CREATE TABLE t1(
     uuid VARCHAR(20),
     name VARCHAR(10),
     age INT,
     ts TIMESTAMP(3),
     `partition` VARCHAR(20)
   )
   PARTITIONED BY (`partition`)
   WITH (
     'connector' = 'hudi',
     'path' = 'hdfs:///path/to/table/',
     'table.type' = 'COPY_ON_WRITE'
   );
   
   -- insert data using values
   INSERT INTO t1 VALUES
     ('id1','Danny',23,TIMESTAMP '1970-01-01 00:00:01','par1'),
     ('id2','Stephen',33,TIMESTAMP '1970-01-01 00:00:02','par1'),
     ('id3','Julian',53,TIMESTAMP '1970-01-01 00:00:03','par2'),
     ('id4','Fabian',31,TIMESTAMP '1970-01-01 00:00:04','par2'),
     ('id5','Sophia',18,TIMESTAMP '1970-01-01 00:00:05','par3'),
     ('id6','Emma',20,TIMESTAMP '1970-01-01 00:00:06','par3'),
     ('id7','Bob',44,TIMESTAMP '1970-01-01 00:00:07','par4'),
     ('id8','Han',56,TIMESTAMP '1970-01-01 00:00:08','par4');
   ```
   3. Enter Hudi cli and execute `show fsview all`
   
   **Expected behavior**
   
   `show fsview all` in Hudi cli should return all file slices.
   
   **Environment Description**
   
   * Hudi version : 0.11.1
   
   * Spark version : 3.1.1
   
   * Hive version : 3.1.0
   
   * Hadoop version : 3.1.1
   
   * Storage (HDFS/S3/GCS..) : HDFS
   
   * Running on Docker? (yes/no) : no
   
   
   **Additional context**
   
   No.
   
   **Stacktrace**
   
   N/A
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] paul8263 commented on issue #6177: [SUPPORT] Hudi cli got empty result for command show fsview all

Posted by GitBox <gi...@apache.org>.
paul8263 commented on issue #6177:
URL: https://github.com/apache/hudi/issues/6177#issuecomment-1196188224

   Hi @xushiyan ,
   Finally I got where the problem locates. Could you please assign this issue to me? 
   Thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on issue #6177: [SUPPORT] Hudi cli got empty result for command show fsview all

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #6177:
URL: https://github.com/apache/hudi/issues/6177#issuecomment-1210106924

   cool. I have created a [jira](https://issues.apache.org/jira/browse/HUDI-4589). Let me know your apache id. I can assign the jira to you. and we can close out the github issuue. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] paul8263 commented on issue #6177: [SUPPORT] Hudi cli got empty result for command show fsview all

Posted by GitBox <gi...@apache.org>.
paul8263 commented on issue #6177:
URL: https://github.com/apache/hudi/issues/6177#issuecomment-1217309084

   Hi @nsivabalan ,
   Sorry for my late response.
   I have created the issue in jira [HUDI-4485](https://issues.apache.org/jira/projects/HUDI/issues/HUDI-4485?filter=allissues).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on issue #6177: [SUPPORT] Hudi cli got empty result for command show fsview all

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #6177:
URL: https://github.com/apache/hudi/issues/6177#issuecomment-1216273745

   @paul8263 : gentle ping. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan closed issue #6177: [SUPPORT] Hudi cli got empty result for command show fsview all

Posted by GitBox <gi...@apache.org>.
nsivabalan closed issue #6177: [SUPPORT] Hudi cli got empty result for command show fsview all
URL: https://github.com/apache/hudi/issues/6177


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on issue #6177: [SUPPORT] Hudi cli got empty result for command show fsview all

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #6177:
URL: https://github.com/apache/hudi/issues/6177#issuecomment-1216660679

   @paul8263 : another ping. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org