You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by GitBox <gi...@apache.org> on 2021/09/05 16:30:20 UTC

[GitHub] [systemds] ilovemesomeramen opened a new pull request #1383: [SYSTEMDS-2972] Transformencode sparse improvements

ilovemesomeramen opened a new pull request #1383:
URL: https://github.com/apache/systemds/pull/1383


   This PR introduces the sparse implementations for Binning, Passthrough, Recode and FeatureHashing. Statistics and Debug output.
   
   Further, row partitioning was fully implemented which is controlled by the variables `APPLY_ROW_BLOCKS_PER_COLUMN` and `BUILD_ROW_BLOCKS_PER_COLUMN` in the `ColumnEncoder` class for testing purposes.
   The Multithrerading was also enabled for the `transformencode` instruction.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [systemds] phaniarnab commented on pull request #1383: [SYSTEMDS-2972] Transformencode sparse improvements

Posted by GitBox <gi...@apache.org>.
phaniarnab commented on pull request #1383:
URL: https://github.com/apache/systemds/pull/1383#issuecomment-915453541


   Thanks for the changes @ilovemesomeramen.
   I added a new flag, `parallel.encode`, in the config file to programmatically enable/disable multithreaded transforms. Other than that, I fixed a few syntax issues before merging.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [systemds] phaniarnab closed pull request #1383: [SYSTEMDS-2972] Transformencode sparse improvements

Posted by GitBox <gi...@apache.org>.
phaniarnab closed pull request #1383:
URL: https://github.com/apache/systemds/pull/1383


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org