You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Matthias Boehm (JIRA)" <ji...@apache.org> on 2017/11/30 22:36:00 UTC

[jira] [Closed] (SYSTEMML-1906) Slow codegen row operations over compressed data

     [ https://issues.apache.org/jira/browse/SYSTEMML-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthias Boehm closed SYSTEMML-1906.
------------------------------------
       Resolution: Fixed
         Assignee: Matthias Boehm
    Fix Version/s: SystemML 1.0

> Slow codegen row operations over compressed data
> ------------------------------------------------
>
>                 Key: SYSTEMML-1906
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1906
>             Project: SystemML
>          Issue Type: Bug
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>             Fix For: SystemML 1.0
>
>
> Despite previous improvements to codegen row operations over compressed data, the performance is not yet competitive. The challenge is due to row-wise access over column-wise compressed data. 
> For example, recent experiments over the dense Airline78 (compressed) showed the following results, where the last column shows codegen operations:
> {code}
> codegen.Experiment5: 375.922413 493.010656 4454.854838
> codegen.Experiment5: 372.49865 356.360481 4027.055731
> codegen.Experiment5: 392.70993 411.45972 4024.717366
> codegen.Experiment5: 362.232105 379.929685 4064.909038
> codegen.Experiment5: 348.231497 409.064944 4088.016386
> codegen.Experiment5: 326.48536 409.311073 4147.657623
> codegen.Experiment5: 385.63351 391.528045 4003.624347
> codegen.Experiment5: 364.701519 451.546031 4053.855223
> codegen.Experiment5: 385.613323 383.600952 4321.492514
> codegen.Experiment5: 499.032415 406.496815 4152.271301
> codegen.Experiment5: 449.385382 436.278214 4034.216778
> codegen.Experiment5: 362.208891 467.055278 4392.978871
> codegen.Experiment5: 380.12149 351.335 4259.480368
> codegen.Experiment5: 408.066566 337.801059 4268.923694
> codegen.Experiment5: 390.642335 387.889392 4178.020609
> codegen.Experiment5: 405.724009 418.096892 4226.759174
> codegen.Experiment5: 389.837952 469.873278 4208.987971
> codegen.Experiment5: 385.084077 458.136199 3971.852021
> codegen.Experiment5: 449.622388 461.645296 4128.829424
> codegen.Experiment5: 434.442843 393.385774 4350.31459
> {code}
> Similarly, the same experiment over the sparse Mnist8m (compressed) showed the following results
> {code}
> codegen.Experiment5: 2086.639353 2102.07509 66398.837701
> codegen.Experiment5: 2031.632887 1865.078801 66411.617426
> codegen.Experiment5: 1965.660671 1951.702067 67005.141958
> codegen.Experiment5: 1986.203115 1935.408375 67191.00898
> codegen.Experiment5: 1908.019522 2110.527745 66898.423384
> codegen.Experiment5: 2133.889418 1996.002736 67140.489795
> codegen.Experiment5: 2124.78694 1960.742883 66828.374397
> codegen.Experiment5: 2131.077188 2146.423403 66800.984041
> codegen.Experiment5: 2259.718694 2133.771833 66927.743748
> codegen.Experiment5: 2184.72028 1991.324151 65525.366494
> codegen.Experiment5: 1884.825264 1869.590621 65557.023881
> codegen.Experiment5: 1990.109355 2233.858887 67177.792293
> codegen.Experiment5: 2050.992504 1809.59564 66543.725909
> codegen.Experiment5: 2132.455256 2176.164228 66954.400906
> codegen.Experiment5: 2172.735023 2182.052528 66921.510286
> codegen.Experiment5: 2092.554763 2127.864808 67335.947001
> codegen.Experiment5: 2106.621765 1972.034093 66817.709411
> codegen.Experiment5: 1818.935779 1873.261603 67020.50054
> codegen.Experiment5: 2094.426711 1911.01054 66089.29852
> codegen.Experiment5: 1819.874197 2019.061886 66725.927399
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)