You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/04/13 07:17:25 UTC

[GitHub] [hudi] zymap opened a new issue, #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

zymap opened a new issue, #5313:
URL: https://github.com/apache/hudi/issues/5313

   
   **Describe the problem you faced**
   
   We want to leverage the Hudi as a storage layer, now we have java writer to write the data into the table, but we still need a java reader client to read out the records from hudi. 
   I want to know if there has any plan to support java reader?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] nsivabalan commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1102602829

   thanks! 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] simonsssu commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
simonsssu commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1100803165

   @nsivabalan hi nsivabalan, my jira id is HUDI-3877, thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] nsivabalan commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1100577433

   @hangc0276 : We can definitely take this up. excited for hudi used as tiered storage :) 
   As @simonsssu showed interest to work on it, I will coordinate w/ him/her and get this going. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hangc0276 commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
hangc0276 commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1108021769

   > @hangc0276 : We can definitely take this up. excited for hudi used as tiered storage :) As @simonsssu showed interest to work on it, I will coordinate w/ him/her and get this going.
   
   @nsivabalan @simonsssu Thank you very much for your support. Looking forward this feature.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] TyrantLucifer commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by "TyrantLucifer (via GitHub)" <gi...@apache.org>.
TyrantLucifer commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1418806126

   Hey guys, How's it going about this feature? [Apache SeaTunnel](https://github.com/apache/incubator-seatunnel) is doing integration with Hudi, the underlying data of SeaTunnel is accessed and exported using pure java. However hudi doesn't support read mor table using java api. Does the community have any plans to continue this task?
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] simonsssu commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
simonsssu commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1098639926

   IMO, both streaming way or batch should be supported , just like using a option 'read.streaming.enabled'


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hangc0276 commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
hangc0276 commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1248288196

   This feature doesn't support yet, maybe we need to reopen this issue @nsivabalan 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] nsivabalan commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1100577200

   cool. @simonsssu : I have created a tracking jira [here](https://issues.apache.org/jira/browse/HUDI-3892). Can you let me know your jira id. I can assign it to you. Also, this might be time sensitive, since its blocking pulsar integration. Just wanted to send out a gentle reminder. 
   Once you have the patch, do ping me. I can help review it. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hangc0276 commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
hangc0276 commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1201036210

   > > @hangc0276 : We can definitely take this up. excited for hudi used as tiered storage :) As @simonsssu showed interest to work on it, I will coordinate w/ him/her and get this going.
   > 
   > @nsivabalan @simonsssu Thank you very much for your support. Looking forward this feature.
   
   Hi @nsivabalan  @simonsssu, Are there any updates for this feature? we are waiting for the java reader support.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] simonsssu commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
simonsssu commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1098627779

   Hi all, I'm interested in this issue. I will open a JIRA to track this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
danny0405 commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1098633232

   > Hi all, I'm interested in this issue. I will open a JIRA to track this.
   
   That's cool. Sounds like the Java reader should read in streaming way ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hangc0276 commented on issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
hangc0276 commented on issue #5313:
URL: https://github.com/apache/hudi/issues/5313#issuecomment-1097658762

   ### Motivation
   [Apache Pulsar](https://github.com/apache/pulsar) is doing integration with Hudi, and take Hudi as tiered storage to offload topic cold data into Hudi. When consumers fetch cold data from topic, Pulsar broker will locate the target data is stored in Pulsar or not. If the target data stored in tiered storage (Hudi), Pulsar broker will fetch data from Hudi by Java API, and package them into Pulsar format and dispatch to consumer side.
   
   However, we found current Hudi implementation doesn't support read Hudi table records by Java API, and we couldn't read the target data out from Hudi into Pulsar Broker, which will block the Pulsar & Hudi integration.
   
   ### What we need
   1. We need Hudi to support reading records by Java API
   2. We need Hudi to support read records out which keep the writer order, or support order by specific fields.
   
   Does the Hudi community has plan to support this feature?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] nsivabalan closed issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?

Posted by GitBox <gi...@apache.org>.
nsivabalan closed issue #5313: [SUPPORT] Do we have plan to support java reader for Hudi?
URL: https://github.com/apache/hudi/issues/5313


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org