You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Sergiy Matusevych (Jira)" <ji...@apache.org> on 2020/02/01 23:14:00 UTC

[jira] [Created] (REEF-2060) Upgrade Parquet from 1.9.0 to 1.11 and update unit tests

Sergiy Matusevych created REEF-2060:
---------------------------------------

             Summary: Upgrade Parquet from 1.9.0 to 1.11 and update unit tests
                 Key: REEF-2060
                 URL: https://issues.apache.org/jira/browse/REEF-2060
             Project: REEF
          Issue Type: Improvement
          Components: REEF Experimental
            Reporter: Sergiy Matusevych


We're stuck with parquet-avro v1.9.0 and cannot upgrade the dependency to a newer version because unit tests depend on parquet files written in older format. In order to upgrade parquet, we need not only switch to the newer version of the parquet-avro package, but update the test file, and, ideally, get rid of deprecated parquet API calls. We also need to add to our codebase the tool to create test parquet files so that subsequent upgrades can be more smooth



--
This message was sent by Atlassian Jira
(v8.3.4#803005)