You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2014/11/03 02:31:34 UTC

[jira] [Commented] (SQOOP-1391) Compression codec handling

    [ https://issues.apache.org/jira/browse/SQOOP-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194161#comment-14194161 ] 

Jarek Jarcec Cecho commented on SQOOP-1391:
-------------------------------------------

I'm seeing one test failure in {{TestHiveImport}}:

{code}
Testcase: testNormalHiveImportAsParquet took 0.665 sec
	Caused an ERROR
Failure during job; return status 1
java.io.IOException: Failure during job; return status 1
	at com.cloudera.sqoop.testutil.ImportJobTestCase.runImport(ImportJobTestCase.java:228)
	at com.cloudera.sqoop.hive.TestHiveImport.runImportTest(TestHiveImport.java:214)
	at com.cloudera.sqoop.hive.TestHiveImport.testNormalHiveImportAsParquet(TestHiveImport.java:278)
{code}

With stack trace:

{code}
Got exception running Sqoop: java.lang.IllegalArgumentException: Missing Hive MetaStore connection URI
java.lang.IllegalArgumentException: Missing Hive MetaStore connection URI
	at org.kitesdk.data.spi.hive.MetaStoreUtil.<init>(MetaStoreUtil.java:78)
	at org.kitesdk.data.spi.hive.HiveAbstractMetadataProvider.getMetaStoreUtil(HiveAbstractMetadataProvider.java:56)
	at org.kitesdk.data.spi.hive.HiveAbstractMetadataProvider.resolveNamespace(HiveAbstractMetadataProvider.java:237)
	at org.kitesdk.data.spi.hive.HiveManagedMetadataProvider.create(HiveManagedMetadataProvider.java:43)
	at org.kitesdk.data.spi.hive.HiveManagedDatasetRepository.create(HiveManagedDatasetRepository.java:77)
	at org.kitesdk.data.Datasets.create(Datasets.java:166)
	at org.kitesdk.data.Datasets.create(Datasets.java:206)
	at org.apache.sqoop.mapreduce.ParquetJob.createDataset(ParquetJob.java:102)
	at org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:89)
	at org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:112)
	at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:260)
	at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:665)
	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
	at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
	at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:45)
	at com.cloudera.sqoop.testutil.ImportJobTestCase.runImport(ImportJobTestCase.java:219)
	at com.cloudera.sqoop.hive.TestHiveImport.runImportTest(TestHiveImport.java:214)
	at com.cloudera.sqoop.hive.TestHiveImport.testNormalHiveImportAsParquet(TestHiveImport.java:278)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:176)
	at junit.framework.TestCase.runBare(TestCase.java:141)
	at junit.framework.TestResult$1.protect(TestResult.java:122)
	at junit.framework.TestResult.runProtected(TestResult.java:142)
	at junit.framework.TestResult.run(TestResult.java:125)
	at junit.framework.TestCase.run(TestCase.java:129)
	at junit.framework.TestSuite.runTest(TestSuite.java:255)
	at junit.framework.TestSuite.run(TestSuite.java:250)
	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:532)
	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1179)
	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:1030)
{code}

Could you take a look [~stanleyxu2005]?

> Compression codec handling
> --------------------------
>
>                 Key: SQOOP-1391
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1391
>             Project: Sqoop
>          Issue Type: Improvement
>          Components: tools
>            Reporter: Qian Xu
>            Assignee: Qian Xu
>         Attachments: SQOOP-1391.2.patch, SQOOP-1391.patch
>
>
> Add supports for different compression codecs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)