"sqoop import-mainframe" fails with " No sequential datasets retrieved"

[Dima Fadeyev <df...@pragsis.com>]

Hello, everone,

I'm trying to test "import-mainframe" sqoop command added with this 
patch: https://issues.apache.org/jira/browse/SQOOP-1272. It is not yet 
available in any sqoop releases, so I've compiled sqoop from trunk.

As far as I understand, I could test import-mainframe using a normal ftp 
server. So, I've installed one, created a directory 'empleados' and 
copied some text files in it. I was hoping sqoop would download the 
files from my ftp server.

Here is the command I launch and the result:

sqoop import-mainframe --connect 192.168.10.210:21 --dataset empleados 
--username user1234 --password pass1234 --verbose

5/02/03 15:30:10 INFO mainframe.MainframeDatasetInputFormat: Datasets to 
transfer from: empleados
15/02/03 15:30:10 DEBUG db.DBConfiguration: Fetching password from job 
credentials store
220 (vsFTPd 2.2.2)
15/02/03 15:30:10 INFO util.MainframeFTPClientUtils: Connected to 
192.168.10.210 on 21
USER *******
331 Please specify the password.
PASS *******
230 Login successful.
TYPE A
200 Switching to ASCII mode.
CWD 'empleados'
250 Directory successfully changed.
PASV
227 Entering Passive Mode (192,168,10,210,251,170).
LIST
150 Here comes the directory listing.
226 Directory send OK.
NOOP
200 NOOP ok.
QUIT
221 Goodbye.
15/02/03 15:30:10 INFO mapreduce.JobSubmitter: Cleaning up the staging 
area /user/root/.staging/job_1422968174081_0008
15/02/03 15:30:10 WARN security.UserGroupInformation: 
PriviledgedActionException as:root (auth:SIMPLE) 
cause:java.io.IOException: No sequential datasets retrieved from empleados
15/02/03 15:30:10 DEBUG util.ClassLoaderStack: Restoring classloader: 
sun.misc.Launcher$AppClassLoader@530f243b
15/02/03 15:30:10 ERROR tool.ImportTool: Encountered IOException running 
import job: java.io.IOException: No sequential datasets retrieved from 
empleados
at 
org.apache.sqoop.mapreduce.mainframe.MainframeDatasetInputFormat.getSplits(MainframeDatasetInputFormat.java:65)
at 
org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493)
at 
org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:510)
at 
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:394)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1295)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1292)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1292)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1313)
at 
org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:186)
at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:159)
at 
org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:247)
at 
org.apache.sqoop.manager.MainframeManager.importTable(MainframeManager.java:97)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

I could check with tcpdump that my ftp sends a list of files from 
directory 'empleados' to sqoop. However sqoop somehow sees an empty list.

If anyone has sqoop import-mainframe working, please help me resolve this.

Thanks in advance
-- 

AVISO CONFIDENCIAL\nEste correo y la información contenida o adjunta al mismo es privada y confidencial y va dirigida exclusivamente a su destinatario. Pragsis informa a quien pueda haber recibido este correo por error que contiene información confidencial cuyo uso, copia, reproducción o distribución está expresamente prohibida. Si no es Vd. el destinatario del mismo y recibe este correo por error, le rogamos lo ponga en conocimiento del emisor y proceda a su eliminación sin copiarlo, imprimirlo o utilizarlo de ningún modo.\nCONFIDENTIALITY WARNING.\nThis message and the information contained in or attached to it are private and confidential and intended exclusively for the addressee. Pragsis informs to whom it may receive it in error that it contains privileged information and its use, copy, reproduction or distribution is prohibited. If you are not an intended recipient of this E-mail, please notify the sender, delete it and do not read, act upon, print, disclose, copy, reta
 in or redistribute any portion of this E-mail.