Export from Parquet Files .metadata error?

["Rendon, Carlos (KBB - Irvine)" <Ca...@kbb.com>]

Hi,

I'm trying to export from a directory of Parquet files to MySQL and I'm getting an error about a ".metadata" file not existing in HDFS.
Reading https://issues.apache.org/jira/browse/SQOOP-1394 I see that KiteSDK requires the ".metadata" file. How do I create this .metadata file?

Alternatively, is it possible for me to export the table from Hive instead of from HDFS?

Error message below

Thanks,
Carlos

./sqoop-export -connect jdbc:mysql://10.228.151.58:3306/pi_viz -table offers --username piuser -P --export-dir /user/hadoopdev/testparquet
Warning: /home/hadoopdev/sqoop/bin/../../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /home/hadoopdev/sqoop/bin/../../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoopdev/sqoop/bin/../../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Warning: /home/hadoopdev/sqoop/bin/../../zookeeper does not exist! Accumulo imports will fail.
Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
16/03/02 17:04:33 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
Enter password:
16/03/02 17:04:36 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
16/03/02 17:04:36 INFO tool.CodeGenTool: Beginning code generation
16/03/02 17:04:36 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `offers` AS t LIMIT 1
16/03/02 17:04:36 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `offers` AS t LIMIT 1
16/03/02 17:04:36 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce
Note: /tmp/sqoop-hadoopdev/compile/edb010c587691e7baa05aab7a5093066/offers.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/03/02 17:04:37 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoopdev/compile/edb010c587691e7baa05aab7a5093066/offers.jar
16/03/02 17:04:37 INFO mapreduce.ExportJobBase: Beginning export of offers
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
16/03/02 17:04:37 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
16/03/02 17:04:38 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `offers` AS t LIMIT 1
16/03/02 17:04:38 ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetNotFoundException: Descriptor location does not exist: hdfs://localhost.localdomain:8020/user/hadoopdev/testparquet/.metadata
org.kitesdk.data.DatasetNotFoundException: Descriptor location does not exist: hdfs://localhost.localdomain:8020/user/hadoopdev/testparquet/.metadata
        at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.checkExists(FileSystemMetadataProvider.java:562)
        at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.find(FileSystemMetadataProvider.java:605)
        at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.load(FileSystemMetadataProvider.java:114)
        at org.kitesdk.data.spi.filesystem.FileSystemDatasetRepository.load(FileSystemDatasetRepository.java:192)
        at org.kitesdk.data.Datasets.load(Datasets.java:108)
        at org.kitesdk.data.Datasets.load(Datasets.java:140)
        at org.kitesdk.data.mapreduce.DatasetKeyInputFormat$ConfigBuilder.readFrom(DatasetKeyInputFormat.java:86)
        at org.kitesdk.data.mapreduce.DatasetKeyInputFormat$ConfigBuilder.readFrom(DatasetKeyInputFormat.java:123)
        at org.apache.sqoop.mapreduce.JdbcExportJob.configureInputFormat(JdbcExportJob.java:84)
        at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:424)
        at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:912)
        at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:81)
        at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:236)