You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Ning Zhang <nz...@fb.com> on 2011/07/05 23:33:10 UTC

Review Request: HIVE-2252. Display a sample of partitions created when Fatal Error occurred due to too many partitioned created

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1013/
-----------------------------------------------------------

Review request for hive.


Summary
-------

In dynamic partition inserts, if a mapper created too many partitions, a fatal error is raised and the job got killed. Sometimes the error is caused by data error and it will be helpful for users to debug if we display a sample of dynamic partitions generated.


This addresses bug HIVE-2252.
    https://issues.apache.org/jira/browse/HIVE-2252


Diffs
-----

  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java 1141747 

Diff: https://reviews.apache.org/r/1013/diff


Testing
-------

passed all unit tests. 


Thanks,

Ning


Re: Review Request: HIVE-2252. Display a sample of partitions created when Fatal Error occurred due to too many partitioned created

Posted by Ning Zhang <nz...@fb.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1013/
-----------------------------------------------------------

(Updated 2011-07-15 18:20:41.419263)


Review request for hive.


Changes
-------

rebased on the current trunk


Summary
-------

In dynamic partition inserts, if a mapper created too many partitions, a fatal error is raised and the job got killed. Sometimes the error is caused by data error and it will be helpful for users to debug if we display a sample of dynamic partitions generated.


This addresses bug HIVE-2252.
    https://issues.apache.org/jira/browse/HIVE-2252


Diffs (updated)
-----

  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java 1147261 

Diff: https://reviews.apache.org/r/1013/diff


Testing
-------

passed all unit tests. 


Thanks,

Ning