You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "bobcortera (via GitHub)" <gi...@apache.org> on 2023/04/21 19:37:35 UTC

[GitHub] [hop] bobcortera opened a new issue, #2839: [Bug]: JSON Output step only consumes rows equal to it's bloc size setting or greater

bobcortera opened a new issue, #2839:
URL: https://github.com/apache/hop/issues/2839

   ### Apache Hop version?
   
   2.4 Release
   
   ### Java version?
   
   OJDK 11
   
   ### Operating system
   
   Windows
   
   ### What happened?
   
   While trying to feed a web service with batches of JSON formatted rows and the bloc size set to 500 the pipeline transformation only processed batches of rows where the number of rows left were >= to the bloc size.  Thus for an input of 600 blocks to above JSON Output step, only 500 were processed, the rest were ignored.  The transform works fine as long as the number of input rows is a multiple of the bloc size (such as the default of 1).
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: Transforms


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hop] hansva commented on issue #2839: [Bug]: JSON Output step only consumes rows equal to its bloc size setting or greater

Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva commented on issue #2839:
URL: https://github.com/apache/hop/issues/2839#issuecomment-1525131499

   .take-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hop] bobcortera commented on issue #2839: [Bug]: JSON Output step only consumes rows equal to it's bloc size setting or greater

Posted by "bobcortera (via GitHub)" <gi...@apache.org>.
bobcortera commented on issue #2839:
URL: https://github.com/apache/hop/issues/2839#issuecomment-1518261129

   I've also found that it won't write any data if the number of input rows is less than the bloc size.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hop] bobcortera commented on issue #2839: [Bug]: JSON Output step only consumes rows equal to it's bloc size setting or greater

Posted by "bobcortera (via GitHub)" <gi...@apache.org>.
bobcortera commented on issue #2839:
URL: https://github.com/apache/hop/issues/2839#issuecomment-1518263800

   [broken_json_output.txt](https://github.com/apache/hop/files/11298789/broken_json_output.txt)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hop] hansva closed issue #2839: [Bug]: JSON Output step only consumes rows equal to its bloc size setting or greater

Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva closed issue #2839: [Bug]: JSON Output step only consumes rows equal to its bloc size setting or greater
URL: https://github.com/apache/hop/issues/2839


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org