Problem INSERT-ing with org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe

[Jamie Olson <ja...@gmail.com>]

I seem to be unable to insert data into (or overwrite-ing) a table with the
TypedBytesSerDe.  For now, I'm just trying to create a single column of
ints:

CREATE TABLE tmp_serde (val1 int) ROW FORMAT SERDE
'org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe' STORED AS
SEQUENCEFILE;

which works fine, but when I try to insert:
hive> SELECT * FROM tmp;
OK
1 1 1
2 2 2
3 3 3
4 4 4
Time taken: 0.157 seconds


INSERT OVERWRITE TABLE tmp_serde SELECT val1 FROM tmp;

I get a NullPointerException.  From the job log:

MapAttempt TASK_TYPE="MAP" TASKID="task_201209190114_0031_m_000000"
TASK_ATTEMPT_ID="attempt_201209190114_0031_m_000000_2"
START_TIME="1348101450948"
TRACKER_NAME="tracker_10\.88\.105\.21:localhost/127\.0\.0\.1:54166"
HTTP_PORT="9103" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201209190114_0031_m_000000"
TASK_ATTEMPT_ID="attempt_201209190114_0031_m_000000_2" TASK_STATUS="FAILED"
FINISH_TIME="1348101457626" HOSTNAME="10\.88\.105\.21"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:437)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:377)
at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255)
at java\.security\.AccessController\.doPrivileged(Native Method)
at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)
at
org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1059)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 9 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 14 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 17 more
Caused by: java\.lang\.RuntimeException: Map operator initialization failed
at
org\.apache\.hadoop\.hive\.ql\.exec\.ExecMapper\.configure(ExecMapper\.java:121)
\.\.\. 22 more
Caused by: org\.apache\.hadoop\.hive\.ql\.metadata\.HiveException:
java\.lang\.NullPointerException
at
org\.apache\.hadoop\.hive\.ql\.exec\.FileSinkOperator\.initializeOp(FileSinkOperator\.java:366)
at
org\.apache\.hadoop\.hive\.ql\.exec\.Operator\.initialize(Operator\.java:357)
at
org\.apache\.hadoop\.hive\.ql\.exec\.Operator\.initialize(Operator\.java:433)
at
org\.apache\.hadoop\.hive\.ql\.exec\.Operator\.initializeChildren(Operator\.java:389)
at
org\.apache\.hadoop\.hive\.ql\.exec\.SelectOperator\.initializeOp(SelectOperator\.java:62)
at
org\.apache\.hadoop\.hive\.ql\.exec\.Operator\.initialize(Operator\.java:357)
at
org\.apache\.hadoop\.hive\.ql\.exec\.Operator\.initialize(Operator\.java:433)
at
org\.apache\.hadoop\.hive\.ql\.exec\.Operator\.initializeChildren(Operator\.java:389)
at
org\.apache\.hadoop\.hive\.ql\.exec\.TableScanOperator\.initializeOp(TableScanOperator\.java:166)
at
org\.apache\.hadoop\.hive\.ql\.exec\.Operator\.initialize(Operator\.java:357)
at
org\.apache\.hadoop\.hive\.ql\.exec\.MapOperator\.initializeOp(MapOperator\.java:427)
at
org\.apache\.hadoop\.hive\.ql\.exec\.Operator\.initialize(Operator\.java:357)
at
org\.apache\.hadoop\.hive\.ql\.exec\.ExecMapper\.configure(ExecMapper\.java:98)
\.\.\. 22 more
Caused by: java\.lang\.NullPointerException
at
org\.apache\.hadoop\.hive\.ql\.exec\.FileSinkOperator\.initializeOp(FileSinkOperator\.java:314)
\.\.\. 34 more


Thoughts?

Jamie Olson