[jira] [Updated] (PARQUET-529) Avoid evoking job.toString() in ParquetLoader

["Gabor Szadovszky (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PARQUET-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gabor Szadovszky updated PARQUET-529:
-------------------------------------
    Fix Version/s: 1.8.2

> Avoid evoking job.toString() in ParquetLoader
> ---------------------------------------------
>
>                 Key: PARQUET-529
>                 URL: https://issues.apache.org/jira/browse/PARQUET-529
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-pig
>    Affects Versions: 1.8.0, 1.8.1
>            Reporter: Liwei Lin(Inactive)
>            Assignee: Liwei Lin(Inactive)
>            Priority: Major
>             Fix For: 1.9.0, 1.8.2
>
>
> When ran under hadoop2 environment and log level setting to _DEBUG_, _ParquetLoader_ would evoke _job.toString()_ in several methods, which might cause the whole application to stop due to :
> {quote}
> java.lang.IllegalStateException: Job in state DEFINE instead of RUNNING
>     at org.apache.hadoop.mapreduce.Job.ensureState(Job.java:283)
>     at org.apache.hadoop.mapreduce.Job.toString(Job.java:452)
>     at java.lang.String.valueOf(String.java:2847)
>     at java.lang.StringBuilder.append(StringBuilder.java:128)
>     at org.apache.parquet.pig.ParquetLoader.getSchema(ParquetLoader.java:260)
>     at org.apache.parquet.pig.TestParquetLoader.testSchema(TestParquetLoader.java:54)
>     ...
> {quote}
> The reason is that in the hadoop 2.x branch, _org.apache.hadoop.mapreduce.Job.toString()_ has added an _ensureState(JobState.RUNNING)_ check; see map-reduce: Job.java#452. In contrast, the hadoop 1.x branch does not contain such checks, so _ParquetLoader_ works well.
> This ticket simply avoids evoking _job.toString()_ in _ParquetLoader_.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)