You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "xushiyong (JIRA)" <ji...@apache.org> on 2016/06/24 02:56:16 UTC

[jira] [Created] (SQOOP-2974) datas from oracle import to hive,when the file format is parquet,error

xushiyong created SQOOP-2974:
--------------------------------

             Summary: datas from oracle import to hive,when the file format is parquet,error
                 Key: SQOOP-2974
                 URL: https://issues.apache.org/jira/browse/SQOOP-2974
             Project: Sqoop
          Issue Type: Bug
          Components: connectors/oracle, sqoop2-build, sqoop2-kite-connector
    Affects Versions: 1.99.6
            Reporter: xushiyong
             Fix For: 1.99.6


use sqoop-1.99.6 from oracle import data to hive-1.2.1,when "file format" select 2(parquet),Prompt the following error message:
2016-06-24 10:25:55,530 DEBUG [communication thread] org.apache.hadoop.ipc.RPC: Call: ping 10
2016-06-24 10:25:57,236 ERROR [OutputFormatLoader-consumer] org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor: Error while loading data out of MR job.
java.lang.NoSuchMethodError: parquet.bytes.CapacityByteArrayOutputStream.<init>(II)V
	at parquet.column.values.rle.RunLengthBitPackingHybridEncoder.<init>(RunLengthBitPackingHybridEncoder.java:128)
	at parquet.column.values.rle.RunLengthBitPackingHybridValuesWriter.<init>(RunLengthBitPackingHybridValuesWriter.java:36)
	at parquet.column.ParquetProperties.getColumnDescriptorValuesWriter(ParquetProperties.java:88)
	at parquet.column.impl.ColumnWriterV1.<init>(ColumnWriterV1.java:81)
	at parquet.column.impl.ColumnWriteStoreV1.newMemColumn(ColumnWriteStoreV1.java:68)
	at parquet.column.impl.ColumnWriteStoreV1.getColumnWriter(ColumnWriteStoreV1.java:56)
	at parquet.io.MessageColumnIO$MessageColumnIORecordConsumer.<init>(MessageColumnIO.java:183)
	at parquet.io.MessageColumnIO.getRecordWriter(MessageColumnIO.java:375)
	at parquet.hadoop.InternalParquetRecordWriter.initStore(InternalParquetRecordWriter.java:109)
	at parquet.hadoop.InternalParquetRecordWriter.<init>(InternalParquetRecordWriter.java:99)
	at parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:217)
	at parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:175)
	at parquet.avro.AvroParquetWriter.<init>(AvroParquetWriter.java:93)
	at org.kitesdk.data.spi.filesystem.ParquetAppender.open(ParquetAppender.java:66)
	at org.kitesdk.data.spi.filesystem.FileSystemWriter.initialize(FileSystemWriter.java:135)
	at org.kitesdk.data.spi.filesystem.FileSystemView.newWriter(FileSystemView.java:101)
	at org.kitesdk.data.spi.AbstractDataset.newWriter(AbstractDataset.java:58)
	at org.apache.sqoop.connector.kite.KiteDatasetExecutor.getOrNewWriter(KiteDatasetExecutor.java:91)
	at org.apache.sqoop.connector.kite.KiteDatasetExecutor.writeRecord(KiteDatasetExecutor.java:86)
	at org.apache.sqoop.connector.kite.KiteLoader.load(KiteLoader.java:72)
	at org.apache.sqoop.connector.kite.KiteLoader.load(KiteLoader.java:36)
	at org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$ConsumerThread.run(SqoopOutputFormatLoadExecutor.java:250)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
2016-06-24 10:25:57,276 INFO [main] org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor: SqoopOutputFormatLoadExecutor::SqoopRecordWriter is about to be closed 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)