You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Bruce Bian <we...@gmail.com> on 2012/03/01 08:22:14 UTC

problems importing from oracle

Hi there,
When I'm using sqoop free-form query import to import the data from Oracle
to HDFS with some ETL process in the query, the results in HDFS contains
nothing.
The query is as follows:

SELECT a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND \$CONDITIONS

The same query has been executed successfully in oracle(without the
$CONDITIONS of course). Is it because the query contains sub-query in it?

Thanks&Regards,
Bruce

Re: problems importing from oracle\

Posted by Kathleen Ting <ka...@apache.org>.
Bruce, FYI, this issue is now documented in the Sqoop Troubleshooting
Guide: https://issues.apache.org/jira/browse/SQOOP-461

Regards, Kathleen

On Wed, Mar 7, 2012 at 4:28 PM, Arvind Prabhakar <ar...@apache.org> wrote:

> Hi Bruce,
>
> On Mon, Mar 5, 2012 at 6:50 PM, Bruce Bian <we...@gmail.com> wrote:
> > any feedback on this?Shall I create a jira issue on this?
> >
> >
> > On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <we...@gmail.com>
> wrote:
> >>
> >> Hi Jarcec,
> >> After looking at the code of sqoop, my previous split-by problem is
> caused
> >> by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command,
> and
> >> the following code in org.apache.sqoop.manager.DefaultManagerFactory
> >> initialized a GenericJdbcManager instead of OracleManager even after
> >> --connection-manager OracleManager is specified
> >>
> >>     SqoopOptions options = data.getSqoopOptions();
> >>     String manualDriver = options.getDriverClassName();
> >>     if (manualDriver != null) {
> >>       // User has manually specified JDBC implementation with --driver.
> >>       // Just use GenericJdbcManager.
> >>       return new GenericJdbcManager(manualDriver, options);
> >>     }
> >> Any reason why the code above appears before initializing the connection
> >> manager specified by the user?Shouldn't it be put even after the
> connection
> >> scheme is judged?
>
> This is by design of the current implementation. When you specify an
> explicit driver, the builtin connection manager selection defaults to
> the generic connection manager. This allows you to use Sqoop with
> databases that have compliant JDBC drivers but are not directly
> supported by Sqoop.
>
> Is there any particular reason why you must specify the --driver
> option? By default the built in Oracle connection manager will chose
> the very driver you are trying to pass in.
>
> Thanks,
> Arvind
>
>
> >>
> >>
> >> On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>
> >> wrote:
> >>>
> >>> Ignored :-)
> >>>
> >>> I do not believe that you're hitting exactly SQOOP-204. It seems that
> >>> SQOOP-204 has failed during creating Input Splits for your job. But
> you seem
> >>> to be dying after your job is being executed on hadoop cluster.
> >>>
> >>> I'm afraid that I do not know how to help you at the moment. Would you
> >>> mind upgrading on current 1.4.1 version?
> >>>
> >>> Jarcec
> >>>
> >>> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> >>> > Hi Jarek ,
> >>> > Please ignore my first problem for getting no hdfs results as it
> turns
> >>> > out
> >>> > to be my silly mistake during copying of the query. sorry for the
> >>> > annoyance.
> >>> > The second problem of adding --split-by turns out to be SQOOP-204,
> but
> >>> > it
> >>> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is
> it?
> >>> >
> >>> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
> >>> > wrote:
> >>> >
> >>> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
> >>> > > command as
> >>> > > in:
> >>> > > QUERY="SELECT a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND \$CONDITIONS"
> >>> > > sqoop import \
> >>> > > --verbose \
> >>> > > --driver oracle.jdbc.OracleDriver \
> >>> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> >>> > > --username *** \
> >>> > > --password ****** \
> >>> > > --query "$QUERY" \
> >>> > > --split-by a.prod_inst_id \
> >>> > > --target-dir /home/wbian/test
> >>> > >
> >>> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> >>> > > properly
> >>> > > ended"   Exception is threw.
> >>> > > And I'm testing this sqoop command on a stand-alone hadoop node.
> >>> > > The output when adding the split-by is as follows:
> >>> > >
> >>> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> >>> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
> >>> > > the
> >>> > > command-line is insecure. Consider using -P instead.
> >>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> >>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> >>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> >>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> >>> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize
> of
> >>> > > 1000
> >>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> >>> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> >>> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> >>> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection
> paramenters
> >>> > > specified. Using regular API for making connection.
> >>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for
> next
> >>> > > query: 1000
> >>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> >>> > > SELECT
> >>> > > a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND  (1 = 0)
> >>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for
> next
> >>> > > query: 1000
> >>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> >>> > > SELECT
> >>> > > a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND  (1 = 0)
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:
> SALE_POLICY_CONST_START_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> >>> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> >>> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> >>> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> >>> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12,
> >>> > > CARRIER_PROD_INST_NUM:12,
> >>> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> >>> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
> >>> > > GH_INSTALL_TP:12,
> >>> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12,
> DATA_PORTA_NUM:12,
> >>> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> >>> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
> >>> > > DATA_INTERNET_FLG:12,
> >>> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> >>> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> >>> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
> >>> > > SUB_AGR_ID:2,
> >>> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
> >>> > > AGR_END_DT:93,
> >>> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
> >>> > > DEV_GRID_ID:2,
> >>> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> >>> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> >>> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> >>> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> >>> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> >>> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> >>> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> >>> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> >>> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> >>> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> >>> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> >>> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> >>> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> >>> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> >>> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
> >>> > > CREATE_BY:12,
> >>> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
> >>> > > PI_SUB_STAT_TP:12,
> >>> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12,
> IMSI:12,
> >>> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> >>> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> >>> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> >>> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> >>> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> >>> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
> >>> > > A_ACCESS_MODE:12,
> >>> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12,
> >>> > > A_ATTR_USE:12,
> >>> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> >>> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> >>> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> >>> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> >>> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> >>> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> >>> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> >>> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> >>> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> >>> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
> >>> > > QueryResult.java
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> >>> > > /usr/lib/hadoop
> >>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core
> jar
> >>> > > at:
> >>> > > /usr/lib/hadoop/hadoop-core.jar
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
> >>> > > args:
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >>> > >
> >>> > >
> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > Note:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >>> > > uses or overrides a deprecated API.
> >>> > > Note: Recompile with -Xlint:deprecation for details.
> >>> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> >>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
> >>> > > files
> >>> > > in directory:
> >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> >>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> >>> > > -> QueryResult.class
> >>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing
> jar
> >>> > > file
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> >>> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
> >>> > > import.
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for
> existing
> >>> > > class: QueryResult
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load
> jar
> >>> > > through URL:
> >>> > >
> >>> > >
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader
> >>> > > is
> >>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in
> jar:
> >>> > > QueryResult
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into
> >>> > > current
> >>> > > JVM:
> >>> > >
> >>> > >
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader
> for
> >>> > > jar
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> >>> > > java.net.FactoryURLClassLoader@1638fff7
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
> >>> > > class:
> >>> > > QueryResult
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
> >>> > > InputFormat:
> >>> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > >
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > >
> >>> > >
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> >>> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics
> with
> >>> > > processName=JobTracker, sessionId=
> >>> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
> >>> > > native-hadoop
> >>> > > library for your platform... using builtin-java classes where
> >>> > > applicable
> >>> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job:
> job_local_0001
> >>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db
> >>> > > record
> >>> > > reader for db product: ORACLE
> >>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
> >>> > > SELECT
> >>> > > a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> >>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
> >>> > > query:
> >>> > > 1000
> >>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
> >>> > > a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> >>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> >>> > > auto-progress thread to quit.
> >>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
> >>> > > progress
> >>> > > thread shutdown...
> >>> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
> >>> > > thread
> >>> > > is finished. keepGoing=false
> >>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress
> thread
> >>> > > shutdown detected.
> >>> > > 12/03/01 15:24:32 INFO mapred.Task:
> >>> > > Task:attempt_local_0001_m_000000_0 is
> >>> > > done. And is in the process of commiting
> >>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> >>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> >>> > > attempt_local_0001_m_000000_0 is
> >>> > > allowed to commit now
> >>> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
> >>> > > task
> >>> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> >>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> >>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> >>> > > 'attempt_local_0001_m_000000_0'
> >>> > > done.
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete:
> job_local_0001
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:
> FILE_BYTES_WRITTEN=96083
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> >>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes
> >>> > > in
> >>> > > 2.9865 seconds (0 bytes/sec)
> >>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0
> records.
> >>> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring
> classloader:
> >>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> >>> > >
> >>> > > Thanks&Regards,
> >>> > > Bruce
> >>> > >
> >>> > >
> >>> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho
> >>> > > <ja...@apache.org>wrote:
> >>> > >
> >>> > >> Hi Bruce,
> >>> > >> would you mind sending entire sqoop command that you've used as
> well
> >>> > >> as
> >>> > >> entire output that it generates with "--verbose" flag?
> >>> > >>
> >>> > >> Jarcec
> >>> > >>
> >>> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> >>> > >> > Hi there,
> >>> > >> > When I'm using sqoop free-form query import to import the data
> >>> > >> > from
> >>> > >> Oracle
> >>> > >> > to HDFS with some ETL process in the query, the results in HDFS
> >>> > >> > contains
> >>> > >> > nothing.
> >>> > >> > The query is as follows:
> >>> > >> >
> >>> > >> > SELECT a.*,
> >>> > >> >
> >>> > >> >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > >> > c.cust_code,c.root_cust_code,
> >>> > >> >
> >>> > >>
> >>> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > >> > FROM prc_idap_pi_root a
> >>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > >> etl.etl_para_cfg_detail
> >>> > >> > WHERE para_id=84) AND \$CONDITIONS
> >>> > >> >
> >>> > >> > The same query has been executed successfully in oracle(without
> >>> > >> > the
> >>> > >> > $CONDITIONS of course). Is it because the query contains
> sub-query
> >>> > >> > in
> >>> > >> it?
> >>> > >> >
> >>> > >> > Thanks&Regards,
> >>> > >> > Bruce
> >>> > >>
> >>> > >
> >>> > >
> >>
> >>
> >
>

Re: problems importing from oracle\

Posted by Kathleen Ting <ka...@apache.org>.
Bruce, FYI, this issue is now documented in the Sqoop Troubleshooting
Guide: https://issues.apache.org/jira/browse/SQOOP-461

Regards, Kathleen

On Wed, Mar 7, 2012 at 4:28 PM, Arvind Prabhakar <ar...@apache.org> wrote:

> Hi Bruce,
>
> On Mon, Mar 5, 2012 at 6:50 PM, Bruce Bian <we...@gmail.com> wrote:
> > any feedback on this?Shall I create a jira issue on this?
> >
> >
> > On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <we...@gmail.com>
> wrote:
> >>
> >> Hi Jarcec,
> >> After looking at the code of sqoop, my previous split-by problem is
> caused
> >> by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command,
> and
> >> the following code in org.apache.sqoop.manager.DefaultManagerFactory
> >> initialized a GenericJdbcManager instead of OracleManager even after
> >> --connection-manager OracleManager is specified
> >>
> >>     SqoopOptions options = data.getSqoopOptions();
> >>     String manualDriver = options.getDriverClassName();
> >>     if (manualDriver != null) {
> >>       // User has manually specified JDBC implementation with --driver.
> >>       // Just use GenericJdbcManager.
> >>       return new GenericJdbcManager(manualDriver, options);
> >>     }
> >> Any reason why the code above appears before initializing the connection
> >> manager specified by the user?Shouldn't it be put even after the
> connection
> >> scheme is judged?
>
> This is by design of the current implementation. When you specify an
> explicit driver, the builtin connection manager selection defaults to
> the generic connection manager. This allows you to use Sqoop with
> databases that have compliant JDBC drivers but are not directly
> supported by Sqoop.
>
> Is there any particular reason why you must specify the --driver
> option? By default the built in Oracle connection manager will chose
> the very driver you are trying to pass in.
>
> Thanks,
> Arvind
>
>
> >>
> >>
> >> On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>
> >> wrote:
> >>>
> >>> Ignored :-)
> >>>
> >>> I do not believe that you're hitting exactly SQOOP-204. It seems that
> >>> SQOOP-204 has failed during creating Input Splits for your job. But
> you seem
> >>> to be dying after your job is being executed on hadoop cluster.
> >>>
> >>> I'm afraid that I do not know how to help you at the moment. Would you
> >>> mind upgrading on current 1.4.1 version?
> >>>
> >>> Jarcec
> >>>
> >>> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> >>> > Hi Jarek ,
> >>> > Please ignore my first problem for getting no hdfs results as it
> turns
> >>> > out
> >>> > to be my silly mistake during copying of the query. sorry for the
> >>> > annoyance.
> >>> > The second problem of adding --split-by turns out to be SQOOP-204,
> but
> >>> > it
> >>> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is
> it?
> >>> >
> >>> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
> >>> > wrote:
> >>> >
> >>> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
> >>> > > command as
> >>> > > in:
> >>> > > QUERY="SELECT a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND \$CONDITIONS"
> >>> > > sqoop import \
> >>> > > --verbose \
> >>> > > --driver oracle.jdbc.OracleDriver \
> >>> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> >>> > > --username *** \
> >>> > > --password ****** \
> >>> > > --query "$QUERY" \
> >>> > > --split-by a.prod_inst_id \
> >>> > > --target-dir /home/wbian/test
> >>> > >
> >>> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> >>> > > properly
> >>> > > ended"   Exception is threw.
> >>> > > And I'm testing this sqoop command on a stand-alone hadoop node.
> >>> > > The output when adding the split-by is as follows:
> >>> > >
> >>> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> >>> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
> >>> > > the
> >>> > > command-line is insecure. Consider using -P instead.
> >>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> >>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> >>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> >>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> >>> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize
> of
> >>> > > 1000
> >>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> >>> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> >>> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> >>> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection
> paramenters
> >>> > > specified. Using regular API for making connection.
> >>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for
> next
> >>> > > query: 1000
> >>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> >>> > > SELECT
> >>> > > a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND  (1 = 0)
> >>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for
> next
> >>> > > query: 1000
> >>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> >>> > > SELECT
> >>> > > a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND  (1 = 0)
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:
> SALE_POLICY_CONST_START_DT
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> >>> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> >>> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> >>> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> >>> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12,
> >>> > > CARRIER_PROD_INST_NUM:12,
> >>> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> >>> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
> >>> > > GH_INSTALL_TP:12,
> >>> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12,
> DATA_PORTA_NUM:12,
> >>> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> >>> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
> >>> > > DATA_INTERNET_FLG:12,
> >>> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> >>> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> >>> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
> >>> > > SUB_AGR_ID:2,
> >>> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
> >>> > > AGR_END_DT:93,
> >>> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
> >>> > > DEV_GRID_ID:2,
> >>> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> >>> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> >>> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> >>> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> >>> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> >>> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> >>> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> >>> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> >>> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> >>> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> >>> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> >>> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> >>> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> >>> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> >>> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
> >>> > > CREATE_BY:12,
> >>> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
> >>> > > PI_SUB_STAT_TP:12,
> >>> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12,
> IMSI:12,
> >>> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> >>> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> >>> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> >>> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> >>> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> >>> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
> >>> > > A_ACCESS_MODE:12,
> >>> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12,
> >>> > > A_ATTR_USE:12,
> >>> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> >>> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> >>> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> >>> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> >>> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> >>> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> >>> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> >>> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> >>> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> >>> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
> >>> > > QueryResult.java
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> >>> > > /usr/lib/hadoop
> >>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core
> jar
> >>> > > at:
> >>> > > /usr/lib/hadoop/hadoop-core.jar
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
> >>> > > args:
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >>> > >
> >>> > >
> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > Note:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >>> > > uses or overrides a deprecated API.
> >>> > > Note: Recompile with -Xlint:deprecation for details.
> >>> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> >>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
> >>> > > files
> >>> > > in directory:
> >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> >>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> >>> > > -> QueryResult.class
> >>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing
> jar
> >>> > > file
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> >>> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
> >>> > > import.
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for
> existing
> >>> > > class: QueryResult
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load
> jar
> >>> > > through URL:
> >>> > >
> >>> > >
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader
> >>> > > is
> >>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in
> jar:
> >>> > > QueryResult
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into
> >>> > > current
> >>> > > JVM:
> >>> > >
> >>> > >
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader
> for
> >>> > > jar
> >>> > >
> >>> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> >>> > > java.net.FactoryURLClassLoader@1638fff7
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
> >>> > > class:
> >>> > > QueryResult
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
> >>> > > InputFormat:
> >>> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > >
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > >
> >>> > >
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> >>> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics
> with
> >>> > > processName=JobTracker, sessionId=
> >>> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
> >>> > > native-hadoop
> >>> > > library for your platform... using builtin-java classes where
> >>> > > applicable
> >>> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job:
> job_local_0001
> >>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db
> >>> > > record
> >>> > > reader for db product: ORACLE
> >>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
> >>> > > SELECT
> >>> > > a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> >>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
> >>> > > query:
> >>> > > 1000
> >>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
> >>> > > a.*,
> >>> > >
> >>> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > > c.cust_code,c.root_cust_code,
> >>> > >
> >>> > >
> >>> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > > FROM prc_idap_pi_root a
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > > etl.etl_para_cfg_detail
> >>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> >>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> >>> > > auto-progress thread to quit.
> >>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
> >>> > > progress
> >>> > > thread shutdown...
> >>> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
> >>> > > thread
> >>> > > is finished. keepGoing=false
> >>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress
> thread
> >>> > > shutdown detected.
> >>> > > 12/03/01 15:24:32 INFO mapred.Task:
> >>> > > Task:attempt_local_0001_m_000000_0 is
> >>> > > done. And is in the process of commiting
> >>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> >>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> >>> > > attempt_local_0001_m_000000_0 is
> >>> > > allowed to commit now
> >>> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
> >>> > > task
> >>> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> >>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> >>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> >>> > > 'attempt_local_0001_m_000000_0'
> >>> > > done.
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >>> > > Deleted
> >>> > > path
> >>> > >
> >>> > >
> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete:
> job_local_0001
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:
> FILE_BYTES_WRITTEN=96083
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> >>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> >>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes
> >>> > > in
> >>> > > 2.9865 seconds (0 bytes/sec)
> >>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0
> records.
> >>> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring
> classloader:
> >>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> >>> > >
> >>> > > Thanks&Regards,
> >>> > > Bruce
> >>> > >
> >>> > >
> >>> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho
> >>> > > <ja...@apache.org>wrote:
> >>> > >
> >>> > >> Hi Bruce,
> >>> > >> would you mind sending entire sqoop command that you've used as
> well
> >>> > >> as
> >>> > >> entire output that it generates with "--verbose" flag?
> >>> > >>
> >>> > >> Jarcec
> >>> > >>
> >>> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> >>> > >> > Hi there,
> >>> > >> > When I'm using sqoop free-form query import to import the data
> >>> > >> > from
> >>> > >> Oracle
> >>> > >> > to HDFS with some ETL process in the query, the results in HDFS
> >>> > >> > contains
> >>> > >> > nothing.
> >>> > >> > The query is as follows:
> >>> > >> >
> >>> > >> > SELECT a.*,
> >>> > >> >
> >>> > >> >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >>> > >> > c.cust_code,c.root_cust_code,
> >>> > >> >
> >>> > >>
> >>> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >>> > >> > FROM prc_idap_pi_root a
> >>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >>> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >>> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >>> > >> etl.etl_para_cfg_detail
> >>> > >> > WHERE para_id=84) AND \$CONDITIONS
> >>> > >> >
> >>> > >> > The same query has been executed successfully in oracle(without
> >>> > >> > the
> >>> > >> > $CONDITIONS of course). Is it because the query contains
> sub-query
> >>> > >> > in
> >>> > >> it?
> >>> > >> >
> >>> > >> > Thanks&Regards,
> >>> > >> > Bruce
> >>> > >>
> >>> > >
> >>> > >
> >>
> >>
> >
>

Re: problems importing from oracle\

Posted by Arvind Prabhakar <ar...@apache.org>.
Hi Bruce,

On Mon, Mar 5, 2012 at 6:50 PM, Bruce Bian <we...@gmail.com> wrote:
> any feedback on this?Shall I create a jira issue on this?
>
>
> On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <we...@gmail.com> wrote:
>>
>> Hi Jarcec,
>> After looking at the code of sqoop, my previous split-by problem is caused
>> by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
>> the following code in org.apache.sqoop.manager.DefaultManagerFactory
>> initialized a GenericJdbcManager instead of OracleManager even after
>> --connection-manager OracleManager is specified
>>
>>     SqoopOptions options = data.getSqoopOptions();
>>     String manualDriver = options.getDriverClassName();
>>     if (manualDriver != null) {
>>       // User has manually specified JDBC implementation with --driver.
>>       // Just use GenericJdbcManager.
>>       return new GenericJdbcManager(manualDriver, options);
>>     }
>> Any reason why the code above appears before initializing the connection
>> manager specified by the user?Shouldn't it be put even after the connection
>> scheme is judged?

This is by design of the current implementation. When you specify an
explicit driver, the builtin connection manager selection defaults to
the generic connection manager. This allows you to use Sqoop with
databases that have compliant JDBC drivers but are not directly
supported by Sqoop.

Is there any particular reason why you must specify the --driver
option? By default the built in Oracle connection manager will chose
the very driver you are trying to pass in.

Thanks,
Arvind


>>
>>
>> On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>
>> wrote:
>>>
>>> Ignored :-)
>>>
>>> I do not believe that you're hitting exactly SQOOP-204. It seems that
>>> SQOOP-204 has failed during creating Input Splits for your job. But you seem
>>> to be dying after your job is being executed on hadoop cluster.
>>>
>>> I'm afraid that I do not know how to help you at the moment. Would you
>>> mind upgrading on current 1.4.1 version?
>>>
>>> Jarcec
>>>
>>> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
>>> > Hi Jarek ,
>>> > Please ignore my first problem for getting no hdfs results as it turns
>>> > out
>>> > to be my silly mistake during copying of the query. sorry for the
>>> > annoyance.
>>> > The second problem of adding --split-by turns out to be SQOOP-204, but
>>> > it
>>> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
>>> >
>>> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
>>> > wrote:
>>> >
>>> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
>>> > > command as
>>> > > in:
>>> > > QUERY="SELECT a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND \$CONDITIONS"
>>> > > sqoop import \
>>> > > --verbose \
>>> > > --driver oracle.jdbc.OracleDriver \
>>> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
>>> > > --username *** \
>>> > > --password ****** \
>>> > > --query "$QUERY" \
>>> > > --split-by a.prod_inst_id \
>>> > > --target-dir /home/wbian/test
>>> > >
>>> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
>>> > > properly
>>> > > ended"   Exception is threw.
>>> > > And I'm testing this sqoop command on a stand-alone hadoop node.
>>> > > The output when adding the split-by is as follows:
>>> > >
>>> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
>>> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
>>> > > the
>>> > > command-line is insecure. Consider using -P instead.
>>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
>>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
>>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>>> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
>>> > > 1000
>>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
>>> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
>>> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
>>> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
>>> > > specified. Using regular API for making connection.
>>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>>> > > query: 1000
>>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>>> > > SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND  (1 = 0)
>>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>>> > > query: 1000
>>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>>> > > SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND  (1 = 0)
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
>>> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
>>> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
>>> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
>>> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12,
>>> > > CARRIER_PROD_INST_NUM:12,
>>> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
>>> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
>>> > > GH_INSTALL_TP:12,
>>> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
>>> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
>>> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
>>> > > DATA_INTERNET_FLG:12,
>>> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
>>> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
>>> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
>>> > > SUB_AGR_ID:2,
>>> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
>>> > > AGR_END_DT:93,
>>> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
>>> > > DEV_GRID_ID:2,
>>> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
>>> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
>>> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
>>> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
>>> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
>>> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
>>> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
>>> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
>>> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
>>> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
>>> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
>>> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
>>> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
>>> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
>>> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
>>> > > CREATE_BY:12,
>>> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
>>> > > PI_SUB_STAT_TP:12,
>>> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
>>> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
>>> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
>>> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
>>> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
>>> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
>>> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
>>> > > A_ACCESS_MODE:12,
>>> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12,
>>> > > A_ATTR_USE:12,
>>> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
>>> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
>>> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
>>> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
>>> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
>>> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
>>> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
>>> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
>>> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
>>> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
>>> > > QueryResult.java
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
>>> > > /usr/lib/hadoop
>>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
>>> > > at:
>>> > > /usr/lib/hadoop/hadoop-core.jar
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
>>> > > args:
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>>> > >
>>> > > /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > Note:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>>> > > uses or overrides a deprecated API.
>>> > > Note: Recompile with -Xlint:deprecation for details.
>>> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
>>> > > files
>>> > > in directory:
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
>>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
>>> > > -> QueryResult.class
>>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
>>> > > file
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>>> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
>>> > > import.
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
>>> > > class: QueryResult
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
>>> > > through URL:
>>> > >
>>> > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader
>>> > > is
>>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
>>> > > QueryResult
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into
>>> > > current
>>> > > JVM:
>>> > >
>>> > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
>>> > > jar
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
>>> > > java.net.FactoryURLClassLoader@1638fff7
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
>>> > > class:
>>> > > QueryResult
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
>>> > > InputFormat:
>>> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > >
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>>> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
>>> > > processName=JobTracker, sessionId=
>>> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
>>> > > native-hadoop
>>> > > library for your platform... using builtin-java classes where
>>> > > applicable
>>> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
>>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db
>>> > > record
>>> > > reader for db product: ORACLE
>>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
>>> > > SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
>>> > > query:
>>> > > 1000
>>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
>>> > > auto-progress thread to quit.
>>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
>>> > > progress
>>> > > thread shutdown...
>>> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
>>> > > thread
>>> > > is finished. keepGoing=false
>>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
>>> > > shutdown detected.
>>> > > 12/03/01 15:24:32 INFO mapred.Task:
>>> > > Task:attempt_local_0001_m_000000_0 is
>>> > > done. And is in the process of commiting
>>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>>> > > attempt_local_0001_m_000000_0 is
>>> > > allowed to commit now
>>> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
>>> > > task
>>> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
>>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>>> > > 'attempt_local_0001_m_000000_0'
>>> > > done.
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
>>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes
>>> > > in
>>> > > 2.9865 seconds (0 bytes/sec)
>>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
>>> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
>>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>>> > >
>>> > > Thanks&Regards,
>>> > > Bruce
>>> > >
>>> > >
>>> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho
>>> > > <ja...@apache.org>wrote:
>>> > >
>>> > >> Hi Bruce,
>>> > >> would you mind sending entire sqoop command that you've used as well
>>> > >> as
>>> > >> entire output that it generates with "--verbose" flag?
>>> > >>
>>> > >> Jarcec
>>> > >>
>>> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
>>> > >> > Hi there,
>>> > >> > When I'm using sqoop free-form query import to import the data
>>> > >> > from
>>> > >> Oracle
>>> > >> > to HDFS with some ETL process in the query, the results in HDFS
>>> > >> > contains
>>> > >> > nothing.
>>> > >> > The query is as follows:
>>> > >> >
>>> > >> > SELECT a.*,
>>> > >> >
>>> > >> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > >> > c.cust_code,c.root_cust_code,
>>> > >> >
>>> > >>
>>> > >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > >> > FROM prc_idap_pi_root a
>>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > >> etl.etl_para_cfg_detail
>>> > >> > WHERE para_id=84) AND \$CONDITIONS
>>> > >> >
>>> > >> > The same query has been executed successfully in oracle(without
>>> > >> > the
>>> > >> > $CONDITIONS of course). Is it because the query contains sub-query
>>> > >> > in
>>> > >> it?
>>> > >> >
>>> > >> > Thanks&Regards,
>>> > >> > Bruce
>>> > >>
>>> > >
>>> > >
>>
>>
>

Re: problems importing from oracle\

Posted by Arvind Prabhakar <ar...@apache.org>.
Hi Bruce,

On Mon, Mar 5, 2012 at 6:50 PM, Bruce Bian <we...@gmail.com> wrote:
> any feedback on this?Shall I create a jira issue on this?
>
>
> On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <we...@gmail.com> wrote:
>>
>> Hi Jarcec,
>> After looking at the code of sqoop, my previous split-by problem is caused
>> by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
>> the following code in org.apache.sqoop.manager.DefaultManagerFactory
>> initialized a GenericJdbcManager instead of OracleManager even after
>> --connection-manager OracleManager is specified
>>
>>     SqoopOptions options = data.getSqoopOptions();
>>     String manualDriver = options.getDriverClassName();
>>     if (manualDriver != null) {
>>       // User has manually specified JDBC implementation with --driver.
>>       // Just use GenericJdbcManager.
>>       return new GenericJdbcManager(manualDriver, options);
>>     }
>> Any reason why the code above appears before initializing the connection
>> manager specified by the user?Shouldn't it be put even after the connection
>> scheme is judged?

This is by design of the current implementation. When you specify an
explicit driver, the builtin connection manager selection defaults to
the generic connection manager. This allows you to use Sqoop with
databases that have compliant JDBC drivers but are not directly
supported by Sqoop.

Is there any particular reason why you must specify the --driver
option? By default the built in Oracle connection manager will chose
the very driver you are trying to pass in.

Thanks,
Arvind


>>
>>
>> On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>
>> wrote:
>>>
>>> Ignored :-)
>>>
>>> I do not believe that you're hitting exactly SQOOP-204. It seems that
>>> SQOOP-204 has failed during creating Input Splits for your job. But you seem
>>> to be dying after your job is being executed on hadoop cluster.
>>>
>>> I'm afraid that I do not know how to help you at the moment. Would you
>>> mind upgrading on current 1.4.1 version?
>>>
>>> Jarcec
>>>
>>> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
>>> > Hi Jarek ,
>>> > Please ignore my first problem for getting no hdfs results as it turns
>>> > out
>>> > to be my silly mistake during copying of the query. sorry for the
>>> > annoyance.
>>> > The second problem of adding --split-by turns out to be SQOOP-204, but
>>> > it
>>> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
>>> >
>>> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
>>> > wrote:
>>> >
>>> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
>>> > > command as
>>> > > in:
>>> > > QUERY="SELECT a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND \$CONDITIONS"
>>> > > sqoop import \
>>> > > --verbose \
>>> > > --driver oracle.jdbc.OracleDriver \
>>> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
>>> > > --username *** \
>>> > > --password ****** \
>>> > > --query "$QUERY" \
>>> > > --split-by a.prod_inst_id \
>>> > > --target-dir /home/wbian/test
>>> > >
>>> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
>>> > > properly
>>> > > ended"   Exception is threw.
>>> > > And I'm testing this sqoop command on a stand-alone hadoop node.
>>> > > The output when adding the split-by is as follows:
>>> > >
>>> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
>>> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
>>> > > the
>>> > > command-line is insecure. Consider using -P instead.
>>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
>>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
>>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>>> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
>>> > > 1000
>>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
>>> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
>>> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
>>> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
>>> > > specified. Using regular API for making connection.
>>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>>> > > query: 1000
>>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>>> > > SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND  (1 = 0)
>>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>>> > > query: 1000
>>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>>> > > SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND  (1 = 0)
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
>>> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
>>> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
>>> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
>>> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12,
>>> > > CARRIER_PROD_INST_NUM:12,
>>> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
>>> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
>>> > > GH_INSTALL_TP:12,
>>> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
>>> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
>>> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
>>> > > DATA_INTERNET_FLG:12,
>>> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
>>> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
>>> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
>>> > > SUB_AGR_ID:2,
>>> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
>>> > > AGR_END_DT:93,
>>> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
>>> > > DEV_GRID_ID:2,
>>> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
>>> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
>>> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
>>> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
>>> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
>>> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
>>> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
>>> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
>>> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
>>> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
>>> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
>>> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
>>> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
>>> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
>>> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
>>> > > CREATE_BY:12,
>>> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
>>> > > PI_SUB_STAT_TP:12,
>>> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
>>> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
>>> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
>>> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
>>> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
>>> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
>>> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
>>> > > A_ACCESS_MODE:12,
>>> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12,
>>> > > A_ATTR_USE:12,
>>> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
>>> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
>>> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
>>> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
>>> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
>>> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
>>> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
>>> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
>>> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
>>> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
>>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
>>> > > QueryResult.java
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
>>> > > /usr/lib/hadoop
>>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
>>> > > at:
>>> > > /usr/lib/hadoop/hadoop-core.jar
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
>>> > > args:
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
>>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>>> > >
>>> > > /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > Note:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>>> > > uses or overrides a deprecated API.
>>> > > Note: Recompile with -Xlint:deprecation for details.
>>> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
>>> > > files
>>> > > in directory:
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
>>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
>>> > > -> QueryResult.class
>>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
>>> > > file
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>>> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
>>> > > import.
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
>>> > > class: QueryResult
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
>>> > > through URL:
>>> > >
>>> > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader
>>> > > is
>>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
>>> > > QueryResult
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into
>>> > > current
>>> > > JVM:
>>> > >
>>> > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
>>> > > jar
>>> > >
>>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
>>> > > java.net.FactoryURLClassLoader@1638fff7
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
>>> > > class:
>>> > > QueryResult
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
>>> > > InputFormat:
>>> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > >
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>>> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
>>> > > processName=JobTracker, sessionId=
>>> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
>>> > > native-hadoop
>>> > > library for your platform... using builtin-java classes where
>>> > > applicable
>>> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
>>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db
>>> > > record
>>> > > reader for db product: ORACLE
>>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
>>> > > SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
>>> > > query:
>>> > > 1000
>>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
>>> > > a.*,
>>> > >
>>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > > c.cust_code,c.root_cust_code,
>>> > >
>>> > >
>>> > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > > FROM prc_idap_pi_root a
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > > etl.etl_para_cfg_detail
>>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
>>> > > auto-progress thread to quit.
>>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
>>> > > progress
>>> > > thread shutdown...
>>> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
>>> > > thread
>>> > > is finished. keepGoing=false
>>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
>>> > > shutdown detected.
>>> > > 12/03/01 15:24:32 INFO mapred.Task:
>>> > > Task:attempt_local_0001_m_000000_0 is
>>> > > done. And is in the process of commiting
>>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>>> > > attempt_local_0001_m_000000_0 is
>>> > > allowed to commit now
>>> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
>>> > > task
>>> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
>>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>>> > > 'attempt_local_0001_m_000000_0'
>>> > > done.
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>>> > > Deleted
>>> > > path
>>> > >
>>> > > /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
>>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
>>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes
>>> > > in
>>> > > 2.9865 seconds (0 bytes/sec)
>>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
>>> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
>>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>>> > >
>>> > > Thanks&Regards,
>>> > > Bruce
>>> > >
>>> > >
>>> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho
>>> > > <ja...@apache.org>wrote:
>>> > >
>>> > >> Hi Bruce,
>>> > >> would you mind sending entire sqoop command that you've used as well
>>> > >> as
>>> > >> entire output that it generates with "--verbose" flag?
>>> > >>
>>> > >> Jarcec
>>> > >>
>>> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
>>> > >> > Hi there,
>>> > >> > When I'm using sqoop free-form query import to import the data
>>> > >> > from
>>> > >> Oracle
>>> > >> > to HDFS with some ETL process in the query, the results in HDFS
>>> > >> > contains
>>> > >> > nothing.
>>> > >> > The query is as follows:
>>> > >> >
>>> > >> > SELECT a.*,
>>> > >> >
>>> > >> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>>> > >> > c.cust_code,c.root_cust_code,
>>> > >> >
>>> > >>
>>> > >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>>> > >> > FROM prc_idap_pi_root a
>>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>>> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>>> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>>> > >> etl.etl_para_cfg_detail
>>> > >> > WHERE para_id=84) AND \$CONDITIONS
>>> > >> >
>>> > >> > The same query has been executed successfully in oracle(without
>>> > >> > the
>>> > >> > $CONDITIONS of course). Is it because the query contains sub-query
>>> > >> > in
>>> > >> it?
>>> > >> >
>>> > >> > Thanks&Regards,
>>> > >> > Bruce
>>> > >>
>>> > >
>>> > >
>>
>>
>

Re: problems importing from oracle

Posted by Bruce Bian <we...@gmail.com>.
Created SQOOP-455

On Tue, Mar 6, 2012 at 2:43 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:

> Hi Bruce,
> I'm sorry but I did not yet looked on your issue as I'm short of time at
> the moment. Please feel free to report it as an JIRA issue.
>
> Jarcec
>
> On Tue, Mar 06, 2012 at 10:50:57AM +0800, Bruce Bian wrote:
> > any feedback on this?Shall I create a jira issue on this?
> >
> > On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <we...@gmail.com>
> wrote:
> >
> > > Hi Jarcec,
> > > After looking at the code of sqoop, my previous split-by problem is
> caused
> > > by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop
> command, and
> > > the following code in org.apache.sqoop.manager.DefaultManagerFactory
> > > initialized a GenericJdbcManager instead of OracleManager even after
> > > --connection-manager OracleManager is specified
> > >
> > >     SqoopOptions options = data.getSqoopOptions();
> > >     String manualDriver = options.getDriverClassName();
> > >     if (manualDriver != null) {
> > >       // User has manually specified JDBC implementation with --driver.
> > >       // Just use GenericJdbcManager.
> > >       return new GenericJdbcManager(manualDriver, options);
> > >     }
> > > Any reason why the code above appears before initializing the
> connection
> > > manager specified by the user?Shouldn't it be put even after the
> connection
> > > scheme is judged?
> > >
> > >
> > > On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <jarcec@apache.org
> >wrote:
> > >
> > >> Ignored :-)
> > >>
> > >> I do not believe that you're hitting exactly SQOOP-204. It seems that
> > >> SQOOP-204 has failed during creating Input Splits for your job. But
> you
> > >> seem to be dying after your job is being executed on hadoop cluster.
> > >>
> > >> I'm afraid that I do not know how to help you at the moment. Would you
> > >> mind upgrading on current 1.4.1 version?
> > >>
> > >> Jarcec
> > >>
> > >> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> > >> > Hi Jarek ,
> > >> > Please ignore my first problem for getting no hdfs results as it
> turns
> > >> out
> > >> > to be my silly mistake during copying of the query. sorry for the
> > >> annoyance.
> > >> > The second problem of adding --split-by turns out to be SQOOP-204,
> but
> > >> it
> > >> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is
> it?
> > >> >
> > >> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
> > >> wrote:
> > >> >
> > >> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
> > >> command as
> > >> > > in:
> > >> > > QUERY="SELECT a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND \$CONDITIONS"
> > >> > > sqoop import \
> > >> > > --verbose \
> > >> > > --driver oracle.jdbc.OracleDriver \
> > >> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> > >> > > --username *** \
> > >> > > --password ****** \
> > >> > > --query "$QUERY" \
> > >> > > --split-by a.prod_inst_id \
> > >> > > --target-dir /home/wbian/test
> > >> > >
> > >> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> > >> properly
> > >> > > ended"   Exception is threw.
> > >> > > And I'm testing this sqoop command on a stand-alone hadoop node.
> > >> > > The output when adding the split-by is as follows:
> > >> > >
> > >> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> > >> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password
> on
> > >> the
> > >> > > command-line is insecure. Consider using -P instead.
> > >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> > >> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> > >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> > >> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> > >> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default
> fetchSize of
> > >> 1000
> > >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated
> ConnManager
> > >> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> > >> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> > >> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection
> paramenters
> > >> > > specified. Using regular API for making connection.
> > >> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for
> next
> > >> > > query: 1000
> > >> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL
> statement:
> > >> SELECT
> > >> > > a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND  (1 = 0)
> > >> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for
> next
> > >> > > query: 1000
> > >> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL
> statement:
> > >> SELECT
> > >> > > a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND  (1 = 0)
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:
> SALE_POLICY_CONST_START_DT
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> > >> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12,
> STD_PRD_CD:12,
> > >> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> > >> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> > >> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12,
> CARRIER_PROD_INST_NUM:12,
> > >> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> > >> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
> > >> GH_INSTALL_TP:12,
> > >> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12,
> DATA_PORTA_NUM:12,
> > >> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> > >> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
> > >> DATA_INTERNET_FLG:12,
> > >> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> > >> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> > >> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
> > >> SUB_AGR_ID:2,
> > >> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
> > >> AGR_END_DT:93,
> > >> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
> > >> DEV_GRID_ID:2,
> > >> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> > >> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> > >> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> > >> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> > >> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> > >> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> > >> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> > >> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> > >> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> > >> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> > >> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> > >> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> > >> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> > >> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> > >> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
> > >> CREATE_BY:12,
> > >> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
> > >> PI_SUB_STAT_TP:12,
> > >> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12,
> IMSI:12,
> > >> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> > >> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> > >> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> > >> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> > >> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> > >> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
> > >> A_ACCESS_MODE:12,
> > >> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12,
> A_ATTR_USE:12,
> > >> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> > >> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93,
> CHURN_DT:93,
> > >> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> > >> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> > >> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> > >> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> > >> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12,
> POSTCODE:12,
> > >> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> > >> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> > >> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> > >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
> > >> QueryResult.java
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> > >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > >> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> > >> > > /usr/lib/hadoop
> > >> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core
> jar
> > >> at:
> > >> > > /usr/lib/hadoop/hadoop-core.jar
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source
> file:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac
> with
> > >> args:
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> > >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > >> > >
> > >>
> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > Note:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > >> > > uses or overrides a deprecated API.
> > >> > > Note: Recompile with -Xlint:deprecation for details.
> > >> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for
> .class
> > >> files
> > >> > > in directory:
> > >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> > >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> > >> > > -> QueryResult.class
> > >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing
> jar
> > >> file
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > >> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
> > >> import.
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for
> existing
> > >> > > class: QueryResult
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load
> jar
> > >> > > through URL:
> > >> > >
> > >>
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous
> classloader is
> > >> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in
> jar:
> > >> > > QueryResult
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into
> current
> > >> > > JVM:
> > >> > >
> > >>
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader
> for
> > >> jar
> > >> > >
> > >>
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> > >> > > java.net.FactoryURLClassLoader@1638fff7
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
> > >> class:
> > >> > > QueryResult
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
> > >> InputFormat:
> > >> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > >
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > >
> > >>
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job
> classpath:
> > >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > >> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics
> with
> > >> > > processName=JobTracker, sessionId=
> > >> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
> > >> native-hadoop
> > >> > > library for your platform... using builtin-java classes where
> > >> applicable
> > >> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job:
> job_local_0001
> > >> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db
> record
> > >> > > reader for db product: ORACLE
> > >> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
> > >> SELECT
> > >> > > a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > >> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for
> next
> > >> query:
> > >> > > 1000
> > >> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
> > >> a.*,
> > >> > >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > > c.cust_code,c.root_cust_code,
> > >> > >
> > >> > >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > > FROM prc_idap_pi_root a
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> > >> > > auto-progress thread to quit.
> > >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
> > >> progress
> > >> > > thread shutdown...
> > >> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
> > >> thread
> > >> > > is finished. keepGoing=false
> > >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress
> thread
> > >> > > shutdown detected.
> > >> > > 12/03/01 15:24:32 INFO mapred.Task:
> > >> Task:attempt_local_0001_m_000000_0 is
> > >> > > done. And is in the process of commiting
> > >> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > >> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> > >> attempt_local_0001_m_000000_0 is
> > >> > > allowed to commit now
> > >> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
> > >> task
> > >> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> > >> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > >> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> > >> 'attempt_local_0001_m_000000_0'
> > >> > > done.
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> > >> Deleted
> > >> > > path
> > >> > >
> > >>
> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete:
> job_local_0001
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:
> FILE_BYTES_WRITTEN=96083
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> > >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> > >> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0
> bytes in
> > >> > > 2.9865 seconds (0 bytes/sec)
> > >> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0
> records.
> > >> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring
> classloader:
> > >> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> > >> > >
> > >> > > Thanks&Regards,
> > >> > > Bruce
> > >> > >
> > >> > >
> > >> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <
> jarcec@apache.org
> > >> >wrote:
> > >> > >
> > >> > >> Hi Bruce,
> > >> > >> would you mind sending entire sqoop command that you've used as
> well
> > >> as
> > >> > >> entire output that it generates with "--verbose" flag?
> > >> > >>
> > >> > >> Jarcec
> > >> > >>
> > >> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> > >> > >> > Hi there,
> > >> > >> > When I'm using sqoop free-form query import to import the data
> from
> > >> > >> Oracle
> > >> > >> > to HDFS with some ETL process in the query, the results in HDFS
> > >> contains
> > >> > >> > nothing.
> > >> > >> > The query is as follows:
> > >> > >> >
> > >> > >> > SELECT a.*,
> > >> > >> >
> > >> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > >> > c.cust_code,c.root_cust_code,
> > >> > >> >
> > >> > >>
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > >> > FROM prc_idap_pi_root a
> > >> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> > >> etl.etl_para_cfg_detail
> > >> > >> > WHERE para_id=84) AND \$CONDITIONS
> > >> > >> >
> > >> > >> > The same query has been executed successfully in
> oracle(without the
> > >> > >> > $CONDITIONS of course). Is it because the query contains
> sub-query
> > >> in
> > >> > >> it?
> > >> > >> >
> > >> > >> > Thanks&Regards,
> > >> > >> > Bruce
> > >> > >>
> > >> > >
> > >> > >
> > >>
> > >
> > >
>

Re: problems importing from oracle

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Hi Bruce,
I'm sorry but I did not yet looked on your issue as I'm short of time at the moment. Please feel free to report it as an JIRA issue.

Jarcec

On Tue, Mar 06, 2012 at 10:50:57AM +0800, Bruce Bian wrote:
> any feedback on this?Shall I create a jira issue on this?
> 
> On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <we...@gmail.com> wrote:
> 
> > Hi Jarcec,
> > After looking at the code of sqoop, my previous split-by problem is caused
> > by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
> > the following code in org.apache.sqoop.manager.DefaultManagerFactory
> > initialized a GenericJdbcManager instead of OracleManager even after
> > --connection-manager OracleManager is specified
> >
> >     SqoopOptions options = data.getSqoopOptions();
> >     String manualDriver = options.getDriverClassName();
> >     if (manualDriver != null) {
> >       // User has manually specified JDBC implementation with --driver.
> >       // Just use GenericJdbcManager.
> >       return new GenericJdbcManager(manualDriver, options);
> >     }
> > Any reason why the code above appears before initializing the connection
> > manager specified by the user?Shouldn't it be put even after the connection
> > scheme is judged?
> >
> >
> > On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:
> >
> >> Ignored :-)
> >>
> >> I do not believe that you're hitting exactly SQOOP-204. It seems that
> >> SQOOP-204 has failed during creating Input Splits for your job. But you
> >> seem to be dying after your job is being executed on hadoop cluster.
> >>
> >> I'm afraid that I do not know how to help you at the moment. Would you
> >> mind upgrading on current 1.4.1 version?
> >>
> >> Jarcec
> >>
> >> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> >> > Hi Jarek ,
> >> > Please ignore my first problem for getting no hdfs results as it turns
> >> out
> >> > to be my silly mistake during copying of the query. sorry for the
> >> annoyance.
> >> > The second problem of adding --split-by turns out to be SQOOP-204, but
> >> it
> >> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
> >> >
> >> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
> >> wrote:
> >> >
> >> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
> >> command as
> >> > > in:
> >> > > QUERY="SELECT a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND \$CONDITIONS"
> >> > > sqoop import \
> >> > > --verbose \
> >> > > --driver oracle.jdbc.OracleDriver \
> >> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> >> > > --username *** \
> >> > > --password ****** \
> >> > > --query "$QUERY" \
> >> > > --split-by a.prod_inst_id \
> >> > > --target-dir /home/wbian/test
> >> > >
> >> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> >> properly
> >> > > ended"   Exception is threw.
> >> > > And I'm testing this sqoop command on a stand-alone hadoop node.
> >> > > The output when adding the split-by is as follows:
> >> > >
> >> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> >> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
> >> the
> >> > > command-line is insecure. Consider using -P instead.
> >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> >> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> >> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> >> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
> >> 1000
> >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> >> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> >> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> >> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
> >> > > specified. Using regular API for making connection.
> >> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> >> > > query: 1000
> >> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> >> SELECT
> >> > > a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND  (1 = 0)
> >> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> >> > > query: 1000
> >> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> >> SELECT
> >> > > a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND  (1 = 0)
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> >> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> >> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> >> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> >> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
> >> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> >> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
> >> GH_INSTALL_TP:12,
> >> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
> >> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> >> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
> >> DATA_INTERNET_FLG:12,
> >> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> >> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> >> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
> >> SUB_AGR_ID:2,
> >> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
> >> AGR_END_DT:93,
> >> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
> >> DEV_GRID_ID:2,
> >> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> >> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> >> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> >> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> >> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> >> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> >> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> >> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> >> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> >> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> >> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> >> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> >> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> >> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> >> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
> >> CREATE_BY:12,
> >> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
> >> PI_SUB_STAT_TP:12,
> >> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
> >> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> >> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> >> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> >> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> >> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> >> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
> >> A_ACCESS_MODE:12,
> >> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
> >> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> >> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> >> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> >> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> >> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> >> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> >> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> >> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> >> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> >> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
> >> QueryResult.java
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> >> > > /usr/lib/hadoop
> >> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
> >> at:
> >> > > /usr/lib/hadoop/hadoop-core.jar
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
> >> args:
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >> > >
> >> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > Note:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >> > > uses or overrides a deprecated API.
> >> > > Note: Recompile with -Xlint:deprecation for details.
> >> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
> >> files
> >> > > in directory:
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> >> > > -> QueryResult.class
> >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
> >> file
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> >> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
> >> import.
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
> >> > > class: QueryResult
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
> >> > > through URL:
> >> > >
> >> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
> >> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
> >> > > QueryResult
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
> >> > > JVM:
> >> > >
> >> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
> >> jar
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> >> > > java.net.FactoryURLClassLoader@1638fff7
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
> >> class:
> >> > > QueryResult
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
> >> InputFormat:
> >> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > >
> >> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> >> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> >> > > processName=JobTracker, sessionId=
> >> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
> >> native-hadoop
> >> > > library for your platform... using builtin-java classes where
> >> applicable
> >> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
> >> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
> >> > > reader for db product: ORACLE
> >> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
> >> SELECT
> >> > > a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> >> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
> >> query:
> >> > > 1000
> >> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
> >> a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> >> > > auto-progress thread to quit.
> >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
> >> progress
> >> > > thread shutdown...
> >> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
> >> thread
> >> > > is finished. keepGoing=false
> >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
> >> > > shutdown detected.
> >> > > 12/03/01 15:24:32 INFO mapred.Task:
> >> Task:attempt_local_0001_m_000000_0 is
> >> > > done. And is in the process of commiting
> >> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> >> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> >> attempt_local_0001_m_000000_0 is
> >> > > allowed to commit now
> >> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
> >> task
> >> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> >> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> >> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> >> 'attempt_local_0001_m_000000_0'
> >> > > done.
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> >> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
> >> > > 2.9865 seconds (0 bytes/sec)
> >> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
> >> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
> >> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> >> > >
> >> > > Thanks&Regards,
> >> > > Bruce
> >> > >
> >> > >
> >> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jarcec@apache.org
> >> >wrote:
> >> > >
> >> > >> Hi Bruce,
> >> > >> would you mind sending entire sqoop command that you've used as well
> >> as
> >> > >> entire output that it generates with "--verbose" flag?
> >> > >>
> >> > >> Jarcec
> >> > >>
> >> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> >> > >> > Hi there,
> >> > >> > When I'm using sqoop free-form query import to import the data from
> >> > >> Oracle
> >> > >> > to HDFS with some ETL process in the query, the results in HDFS
> >> contains
> >> > >> > nothing.
> >> > >> > The query is as follows:
> >> > >> >
> >> > >> > SELECT a.*,
> >> > >> >
> >> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > >> > c.cust_code,c.root_cust_code,
> >> > >> >
> >> > >>
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > >> > FROM prc_idap_pi_root a
> >> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> > >> etl.etl_para_cfg_detail
> >> > >> > WHERE para_id=84) AND \$CONDITIONS
> >> > >> >
> >> > >> > The same query has been executed successfully in oracle(without the
> >> > >> > $CONDITIONS of course). Is it because the query contains sub-query
> >> in
> >> > >> it?
> >> > >> >
> >> > >> > Thanks&Regards,
> >> > >> > Bruce
> >> > >>
> >> > >
> >> > >
> >>
> >
> >

Re: problems importing from oracle

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Hi Bruce,
I'm sorry but I did not yet looked on your issue as I'm short of time at the moment. Please feel free to report it as an JIRA issue.

Jarcec

On Tue, Mar 06, 2012 at 10:50:57AM +0800, Bruce Bian wrote:
> any feedback on this?Shall I create a jira issue on this?
> 
> On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <we...@gmail.com> wrote:
> 
> > Hi Jarcec,
> > After looking at the code of sqoop, my previous split-by problem is caused
> > by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
> > the following code in org.apache.sqoop.manager.DefaultManagerFactory
> > initialized a GenericJdbcManager instead of OracleManager even after
> > --connection-manager OracleManager is specified
> >
> >     SqoopOptions options = data.getSqoopOptions();
> >     String manualDriver = options.getDriverClassName();
> >     if (manualDriver != null) {
> >       // User has manually specified JDBC implementation with --driver.
> >       // Just use GenericJdbcManager.
> >       return new GenericJdbcManager(manualDriver, options);
> >     }
> > Any reason why the code above appears before initializing the connection
> > manager specified by the user?Shouldn't it be put even after the connection
> > scheme is judged?
> >
> >
> > On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:
> >
> >> Ignored :-)
> >>
> >> I do not believe that you're hitting exactly SQOOP-204. It seems that
> >> SQOOP-204 has failed during creating Input Splits for your job. But you
> >> seem to be dying after your job is being executed on hadoop cluster.
> >>
> >> I'm afraid that I do not know how to help you at the moment. Would you
> >> mind upgrading on current 1.4.1 version?
> >>
> >> Jarcec
> >>
> >> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> >> > Hi Jarek ,
> >> > Please ignore my first problem for getting no hdfs results as it turns
> >> out
> >> > to be my silly mistake during copying of the query. sorry for the
> >> annoyance.
> >> > The second problem of adding --split-by turns out to be SQOOP-204, but
> >> it
> >> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
> >> >
> >> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
> >> wrote:
> >> >
> >> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
> >> command as
> >> > > in:
> >> > > QUERY="SELECT a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND \$CONDITIONS"
> >> > > sqoop import \
> >> > > --verbose \
> >> > > --driver oracle.jdbc.OracleDriver \
> >> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> >> > > --username *** \
> >> > > --password ****** \
> >> > > --query "$QUERY" \
> >> > > --split-by a.prod_inst_id \
> >> > > --target-dir /home/wbian/test
> >> > >
> >> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> >> properly
> >> > > ended"   Exception is threw.
> >> > > And I'm testing this sqoop command on a stand-alone hadoop node.
> >> > > The output when adding the split-by is as follows:
> >> > >
> >> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> >> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
> >> the
> >> > > command-line is insecure. Consider using -P instead.
> >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> >> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> >> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> >> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
> >> 1000
> >> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> >> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> >> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> >> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
> >> > > specified. Using regular API for making connection.
> >> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> >> > > query: 1000
> >> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> >> SELECT
> >> > > a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND  (1 = 0)
> >> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> >> > > query: 1000
> >> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> >> SELECT
> >> > > a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND  (1 = 0)
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> >> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> >> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> >> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> >> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
> >> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> >> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
> >> GH_INSTALL_TP:12,
> >> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
> >> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> >> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
> >> DATA_INTERNET_FLG:12,
> >> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> >> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> >> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
> >> SUB_AGR_ID:2,
> >> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
> >> AGR_END_DT:93,
> >> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
> >> DEV_GRID_ID:2,
> >> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> >> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> >> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> >> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> >> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> >> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> >> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> >> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> >> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> >> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> >> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> >> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> >> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> >> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> >> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
> >> CREATE_BY:12,
> >> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
> >> PI_SUB_STAT_TP:12,
> >> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
> >> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> >> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> >> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> >> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> >> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> >> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
> >> A_ACCESS_MODE:12,
> >> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
> >> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> >> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> >> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> >> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> >> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> >> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> >> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> >> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> >> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> >> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> >> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
> >> QueryResult.java
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> >> > > /usr/lib/hadoop
> >> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
> >> at:
> >> > > /usr/lib/hadoop/hadoop-core.jar
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
> >> args:
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> >> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> >> > >
> >> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > Note:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> >> > > uses or overrides a deprecated API.
> >> > > Note: Recompile with -Xlint:deprecation for details.
> >> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
> >> files
> >> > > in directory:
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> >> > > -> QueryResult.class
> >> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
> >> file
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> >> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
> >> import.
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
> >> > > class: QueryResult
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
> >> > > through URL:
> >> > >
> >> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
> >> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
> >> > > QueryResult
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
> >> > > JVM:
> >> > >
> >> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> >> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
> >> jar
> >> > >
> >> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> >> > > java.net.FactoryURLClassLoader@1638fff7
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
> >> class:
> >> > > QueryResult
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
> >> InputFormat:
> >> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > >
> >> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> >> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> >> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> >> > > processName=JobTracker, sessionId=
> >> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
> >> native-hadoop
> >> > > library for your platform... using builtin-java classes where
> >> applicable
> >> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
> >> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
> >> > > reader for db product: ORACLE
> >> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
> >> SELECT
> >> > > a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> >> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
> >> query:
> >> > > 1000
> >> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
> >> a.*,
> >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > > c.cust_code,c.root_cust_code,
> >> > >
> >> > >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > > FROM prc_idap_pi_root a
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> >> > > auto-progress thread to quit.
> >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
> >> progress
> >> > > thread shutdown...
> >> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
> >> thread
> >> > > is finished. keepGoing=false
> >> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
> >> > > shutdown detected.
> >> > > 12/03/01 15:24:32 INFO mapred.Task:
> >> Task:attempt_local_0001_m_000000_0 is
> >> > > done. And is in the process of commiting
> >> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> >> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> >> attempt_local_0001_m_000000_0 is
> >> > > allowed to commit now
> >> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
> >> task
> >> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> >> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> >> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> >> 'attempt_local_0001_m_000000_0'
> >> > > done.
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> >> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> >> Deleted
> >> > > path
> >> > >
> >> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> >> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> >> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
> >> > > 2.9865 seconds (0 bytes/sec)
> >> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
> >> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
> >> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> >> > >
> >> > > Thanks&Regards,
> >> > > Bruce
> >> > >
> >> > >
> >> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jarcec@apache.org
> >> >wrote:
> >> > >
> >> > >> Hi Bruce,
> >> > >> would you mind sending entire sqoop command that you've used as well
> >> as
> >> > >> entire output that it generates with "--verbose" flag?
> >> > >>
> >> > >> Jarcec
> >> > >>
> >> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> >> > >> > Hi there,
> >> > >> > When I'm using sqoop free-form query import to import the data from
> >> > >> Oracle
> >> > >> > to HDFS with some ETL process in the query, the results in HDFS
> >> contains
> >> > >> > nothing.
> >> > >> > The query is as follows:
> >> > >> >
> >> > >> > SELECT a.*,
> >> > >> >
> >> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > >> > c.cust_code,c.root_cust_code,
> >> > >> >
> >> > >>
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > >> > FROM prc_idap_pi_root a
> >> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> > >> etl.etl_para_cfg_detail
> >> > >> > WHERE para_id=84) AND \$CONDITIONS
> >> > >> >
> >> > >> > The same query has been executed successfully in oracle(without the
> >> > >> > $CONDITIONS of course). Is it because the query contains sub-query
> >> in
> >> > >> it?
> >> > >> >
> >> > >> > Thanks&Regards,
> >> > >> > Bruce
> >> > >>
> >> > >
> >> > >
> >>
> >
> >

Re: problems importing from oracle\

Posted by Bruce Bian <we...@gmail.com>.
any feedback on this?Shall I create a jira issue on this?

On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <we...@gmail.com> wrote:

> Hi Jarcec,
> After looking at the code of sqoop, my previous split-by problem is caused
> by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
> the following code in org.apache.sqoop.manager.DefaultManagerFactory
> initialized a GenericJdbcManager instead of OracleManager even after
> --connection-manager OracleManager is specified
>
>     SqoopOptions options = data.getSqoopOptions();
>     String manualDriver = options.getDriverClassName();
>     if (manualDriver != null) {
>       // User has manually specified JDBC implementation with --driver.
>       // Just use GenericJdbcManager.
>       return new GenericJdbcManager(manualDriver, options);
>     }
> Any reason why the code above appears before initializing the connection
> manager specified by the user?Shouldn't it be put even after the connection
> scheme is judged?
>
>
> On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:
>
>> Ignored :-)
>>
>> I do not believe that you're hitting exactly SQOOP-204. It seems that
>> SQOOP-204 has failed during creating Input Splits for your job. But you
>> seem to be dying after your job is being executed on hadoop cluster.
>>
>> I'm afraid that I do not know how to help you at the moment. Would you
>> mind upgrading on current 1.4.1 version?
>>
>> Jarcec
>>
>> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
>> > Hi Jarek ,
>> > Please ignore my first problem for getting no hdfs results as it turns
>> out
>> > to be my silly mistake during copying of the query. sorry for the
>> annoyance.
>> > The second problem of adding --split-by turns out to be SQOOP-204, but
>> it
>> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
>> >
>> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
>> wrote:
>> >
>> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
>> command as
>> > > in:
>> > > QUERY="SELECT a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND \$CONDITIONS"
>> > > sqoop import \
>> > > --verbose \
>> > > --driver oracle.jdbc.OracleDriver \
>> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
>> > > --username *** \
>> > > --password ****** \
>> > > --query "$QUERY" \
>> > > --split-by a.prod_inst_id \
>> > > --target-dir /home/wbian/test
>> > >
>> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
>> properly
>> > > ended"   Exception is threw.
>> > > And I'm testing this sqoop command on a stand-alone hadoop node.
>> > > The output when adding the split-by is as follows:
>> > >
>> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
>> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
>> the
>> > > command-line is insecure. Consider using -P instead.
>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
>> 1000
>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
>> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
>> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
>> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
>> > > specified. Using regular API for making connection.
>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>> > > query: 1000
>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>> SELECT
>> > > a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND  (1 = 0)
>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>> > > query: 1000
>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>> SELECT
>> > > a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND  (1 = 0)
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
>> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
>> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
>> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
>> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
>> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
>> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
>> GH_INSTALL_TP:12,
>> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
>> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
>> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
>> DATA_INTERNET_FLG:12,
>> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
>> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
>> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
>> SUB_AGR_ID:2,
>> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
>> AGR_END_DT:93,
>> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
>> DEV_GRID_ID:2,
>> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
>> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
>> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
>> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
>> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
>> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
>> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
>> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
>> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
>> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
>> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
>> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
>> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
>> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
>> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
>> CREATE_BY:12,
>> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
>> PI_SUB_STAT_TP:12,
>> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
>> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
>> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
>> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
>> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
>> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
>> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
>> A_ACCESS_MODE:12,
>> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
>> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
>> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
>> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
>> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
>> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
>> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
>> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
>> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
>> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
>> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
>> QueryResult.java
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
>> > > /usr/lib/hadoop
>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
>> at:
>> > > /usr/lib/hadoop/hadoop-core.jar
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
>> args:
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>> > >
>> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > Note:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>> > > uses or overrides a deprecated API.
>> > > Note: Recompile with -Xlint:deprecation for details.
>> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
>> files
>> > > in directory:
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
>> > > -> QueryResult.class
>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
>> file
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
>> import.
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
>> > > class: QueryResult
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
>> > > through URL:
>> > >
>> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
>> > > QueryResult
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
>> > > JVM:
>> > >
>> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
>> jar
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
>> > > java.net.FactoryURLClassLoader@1638fff7
>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
>> class:
>> > > QueryResult
>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
>> InputFormat:
>> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > >
>> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
>> > > processName=JobTracker, sessionId=
>> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop
>> > > library for your platform... using builtin-java classes where
>> applicable
>> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
>> > > reader for db product: ORACLE
>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
>> SELECT
>> > > a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
>> query:
>> > > 1000
>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
>> a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
>> > > auto-progress thread to quit.
>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
>> progress
>> > > thread shutdown...
>> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
>> thread
>> > > is finished. keepGoing=false
>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
>> > > shutdown detected.
>> > > 12/03/01 15:24:32 INFO mapred.Task:
>> Task:attempt_local_0001_m_000000_0 is
>> > > done. And is in the process of commiting
>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>> attempt_local_0001_m_000000_0 is
>> > > allowed to commit now
>> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
>> task
>> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>> 'attempt_local_0001_m_000000_0'
>> > > done.
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
>> > > 2.9865 seconds (0 bytes/sec)
>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
>> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>> > >
>> > > Thanks&Regards,
>> > > Bruce
>> > >
>> > >
>> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jarcec@apache.org
>> >wrote:
>> > >
>> > >> Hi Bruce,
>> > >> would you mind sending entire sqoop command that you've used as well
>> as
>> > >> entire output that it generates with "--verbose" flag?
>> > >>
>> > >> Jarcec
>> > >>
>> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
>> > >> > Hi there,
>> > >> > When I'm using sqoop free-form query import to import the data from
>> > >> Oracle
>> > >> > to HDFS with some ETL process in the query, the results in HDFS
>> contains
>> > >> > nothing.
>> > >> > The query is as follows:
>> > >> >
>> > >> > SELECT a.*,
>> > >> >
>> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > >> > c.cust_code,c.root_cust_code,
>> > >> >
>> > >>
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > >> > FROM prc_idap_pi_root a
>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> > >> etl.etl_para_cfg_detail
>> > >> > WHERE para_id=84) AND \$CONDITIONS
>> > >> >
>> > >> > The same query has been executed successfully in oracle(without the
>> > >> > $CONDITIONS of course). Is it because the query contains sub-query
>> in
>> > >> it?
>> > >> >
>> > >> > Thanks&Regards,
>> > >> > Bruce
>> > >>
>> > >
>> > >
>>
>
>

Re: problems importing from oracle\

Posted by Bruce Bian <we...@gmail.com>.
any feedback on this?Shall I create a jira issue on this?

On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian <we...@gmail.com> wrote:

> Hi Jarcec,
> After looking at the code of sqoop, my previous split-by problem is caused
> by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
> the following code in org.apache.sqoop.manager.DefaultManagerFactory
> initialized a GenericJdbcManager instead of OracleManager even after
> --connection-manager OracleManager is specified
>
>     SqoopOptions options = data.getSqoopOptions();
>     String manualDriver = options.getDriverClassName();
>     if (manualDriver != null) {
>       // User has manually specified JDBC implementation with --driver.
>       // Just use GenericJdbcManager.
>       return new GenericJdbcManager(manualDriver, options);
>     }
> Any reason why the code above appears before initializing the connection
> manager specified by the user?Shouldn't it be put even after the connection
> scheme is judged?
>
>
> On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:
>
>> Ignored :-)
>>
>> I do not believe that you're hitting exactly SQOOP-204. It seems that
>> SQOOP-204 has failed during creating Input Splits for your job. But you
>> seem to be dying after your job is being executed on hadoop cluster.
>>
>> I'm afraid that I do not know how to help you at the moment. Would you
>> mind upgrading on current 1.4.1 version?
>>
>> Jarcec
>>
>> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
>> > Hi Jarek ,
>> > Please ignore my first problem for getting no hdfs results as it turns
>> out
>> > to be my silly mistake during copying of the query. sorry for the
>> annoyance.
>> > The second problem of adding --split-by turns out to be SQOOP-204, but
>> it
>> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
>> >
>> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
>> wrote:
>> >
>> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
>> command as
>> > > in:
>> > > QUERY="SELECT a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND \$CONDITIONS"
>> > > sqoop import \
>> > > --verbose \
>> > > --driver oracle.jdbc.OracleDriver \
>> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
>> > > --username *** \
>> > > --password ****** \
>> > > --query "$QUERY" \
>> > > --split-by a.prod_inst_id \
>> > > --target-dir /home/wbian/test
>> > >
>> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
>> properly
>> > > ended"   Exception is threw.
>> > > And I'm testing this sqoop command on a stand-alone hadoop node.
>> > > The output when adding the split-by is as follows:
>> > >
>> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
>> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on
>> the
>> > > command-line is insecure. Consider using -P instead.
>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
>> > > com.cloudera.sqoop.manager.DefaultManagerFactory
>> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
>> 1000
>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
>> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
>> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
>> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
>> > > specified. Using regular API for making connection.
>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>> > > query: 1000
>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>> SELECT
>> > > a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND  (1 = 0)
>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
>> > > query: 1000
>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
>> SELECT
>> > > a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND  (1 = 0)
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
>> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
>> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
>> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
>> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
>> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
>> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
>> GH_INSTALL_TP:12,
>> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
>> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
>> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
>> DATA_INTERNET_FLG:12,
>> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
>> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
>> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
>> SUB_AGR_ID:2,
>> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93,
>> AGR_END_DT:93,
>> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
>> DEV_GRID_ID:2,
>> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
>> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
>> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
>> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
>> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
>> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
>> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
>> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
>> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
>> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
>> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
>> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
>> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
>> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
>> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93,
>> CREATE_BY:12,
>> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
>> PI_SUB_STAT_TP:12,
>> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
>> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
>> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
>> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
>> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
>> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
>> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12,
>> A_ACCESS_MODE:12,
>> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
>> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
>> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
>> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
>> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
>> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
>> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
>> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
>> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
>> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
>> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
>> QueryResult.java
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
>> > > /usr/lib/hadoop
>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
>> at:
>> > > /usr/lib/hadoop/hadoop-core.jar
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
>> args:
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
>> > >
>> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > Note:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
>> > > uses or overrides a deprecated API.
>> > > Note: Recompile with -Xlint:deprecation for details.
>> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
>> files
>> > > in directory:
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
>> > > -> QueryResult.class
>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
>> file
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
>> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query
>> import.
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
>> > > class: QueryResult
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
>> > > through URL:
>> > >
>> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
>> > > QueryResult
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
>> > > JVM:
>> > >
>> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
>> jar
>> > >
>> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
>> > > java.net.FactoryURLClassLoader@1638fff7
>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
>> class:
>> > > QueryResult
>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
>> InputFormat:
>> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > >
>> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
>> > > processName=JobTracker, sessionId=
>> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop
>> > > library for your platform... using builtin-java classes where
>> applicable
>> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
>> > > reader for db product: ORACLE
>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
>> SELECT
>> > > a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
>> query:
>> > > 1000
>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT
>> a.*,
>> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > > c.cust_code,c.root_cust_code,
>> > >
>> > >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > > FROM prc_idap_pi_root a
>> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
>> > > auto-progress thread to quit.
>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
>> progress
>> > > thread shutdown...
>> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
>> thread
>> > > is finished. keepGoing=false
>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
>> > > shutdown detected.
>> > > 12/03/01 15:24:32 INFO mapred.Task:
>> Task:attempt_local_0001_m_000000_0 is
>> > > done. And is in the process of commiting
>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>> attempt_local_0001_m_000000_0 is
>> > > allowed to commit now
>> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of
>> task
>> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
>> > > 12/03/01 15:24:32 INFO mapred.Task: Task
>> 'attempt_local_0001_m_000000_0'
>> > > done.
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
>> Deleted
>> > > path
>> > >
>> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
>> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
>> > > 2.9865 seconds (0 bytes/sec)
>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
>> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
>> > > sun.misc.Launcher$AppClassLoader@28df6ccd
>> > >
>> > > Thanks&Regards,
>> > > Bruce
>> > >
>> > >
>> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jarcec@apache.org
>> >wrote:
>> > >
>> > >> Hi Bruce,
>> > >> would you mind sending entire sqoop command that you've used as well
>> as
>> > >> entire output that it generates with "--verbose" flag?
>> > >>
>> > >> Jarcec
>> > >>
>> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
>> > >> > Hi there,
>> > >> > When I'm using sqoop free-form query import to import the data from
>> > >> Oracle
>> > >> > to HDFS with some ETL process in the query, the results in HDFS
>> contains
>> > >> > nothing.
>> > >> > The query is as follows:
>> > >> >
>> > >> > SELECT a.*,
>> > >> >
>> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > >> > c.cust_code,c.root_cust_code,
>> > >> >
>> > >>
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > >> > FROM prc_idap_pi_root a
>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> > >> etl.etl_para_cfg_detail
>> > >> > WHERE para_id=84) AND \$CONDITIONS
>> > >> >
>> > >> > The same query has been executed successfully in oracle(without the
>> > >> > $CONDITIONS of course). Is it because the query contains sub-query
>> in
>> > >> it?
>> > >> >
>> > >> > Thanks&Regards,
>> > >> > Bruce
>> > >>
>> > >
>> > >
>>
>
>

Re: problems importing from oracle\

Posted by Bruce Bian <we...@gmail.com>.
Hi Jarcec,
After looking at the code of sqoop, my previous split-by problem is caused
by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
the following code in org.apache.sqoop.manager.DefaultManagerFactory
initialized a GenericJdbcManager instead of OracleManager even after
--connection-manager OracleManager is specified

    SqoopOptions options = data.getSqoopOptions();
    String manualDriver = options.getDriverClassName();
    if (manualDriver != null) {
      // User has manually specified JDBC implementation with --driver.
      // Just use GenericJdbcManager.
      return new GenericJdbcManager(manualDriver, options);
    }
Any reason why the code above appears before initializing the connection
manager specified by the user?Shouldn't it be put even after the connection
scheme is judged?


On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:

> Ignored :-)
>
> I do not believe that you're hitting exactly SQOOP-204. It seems that
> SQOOP-204 has failed during creating Input Splits for your job. But you
> seem to be dying after your job is being executed on hadoop cluster.
>
> I'm afraid that I do not know how to help you at the moment. Would you
> mind upgrading on current 1.4.1 version?
>
> Jarcec
>
> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> > Hi Jarek ,
> > Please ignore my first problem for getting no hdfs results as it turns
> out
> > to be my silly mistake during copying of the query. sorry for the
> annoyance.
> > The second problem of adding --split-by turns out to be SQOOP-204, but it
> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
> >
> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
> wrote:
> >
> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
> command as
> > > in:
> > > QUERY="SELECT a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND \$CONDITIONS"
> > > sqoop import \
> > > --verbose \
> > > --driver oracle.jdbc.OracleDriver \
> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> > > --username *** \
> > > --password ****** \
> > > --query "$QUERY" \
> > > --split-by a.prod_inst_id \
> > > --target-dir /home/wbian/test
> > >
> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> properly
> > > ended"   Exception is threw.
> > > And I'm testing this sqoop command on a stand-alone hadoop node.
> > > The output when adding the split-by is as follows:
> > >
> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on the
> > > command-line is insecure. Consider using -P instead.
> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
> 1000
> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
> > > specified. Using regular API for making connection.
> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> > > query: 1000
> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> SELECT
> > > a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND  (1 = 0)
> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> > > query: 1000
> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> SELECT
> > > a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND  (1 = 0)
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
> GH_INSTALL_TP:12,
> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
> DATA_INTERNET_FLG:12,
> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
> SUB_AGR_ID:2,
> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:93,
> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
> DEV_GRID_ID:2,
> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:12,
> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
> PI_SUB_STAT_TP:12,
> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:12,
> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
> QueryResult.java
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> > > /usr/lib/hadoop
> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
> at:
> > > /usr/lib/hadoop/hadoop-core.jar
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
> args:
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > >
> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > Note:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > > uses or overrides a deprecated API.
> > > Note: Recompile with -Xlint:deprecation for details.
> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
> files
> > > in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> > > -> QueryResult.class
> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
> file
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query import.
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
> > > class: QueryResult
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
> > > through URL:
> > >
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
> > > QueryResult
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
> > > JVM:
> > >
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
> jar
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> > > java.net.FactoryURLClassLoader@1638fff7
> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
> class:
> > > QueryResult
> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
> InputFormat:
> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > >
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> > > processName=JobTracker, sessionId=
> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
> native-hadoop
> > > library for your platform... using builtin-java classes where
> applicable
> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
> > > reader for db product: ORACLE
> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
> SELECT
> > > a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
> query:
> > > 1000
> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> > > auto-progress thread to quit.
> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
> progress
> > > thread shutdown...
> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
> thread
> > > is finished. keepGoing=false
> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
> > > shutdown detected.
> > > 12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_0
> is
> > > done. And is in the process of commiting
> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > > 12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_0
> is
> > > allowed to commit now
> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of task
> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> 'attempt_local_0001_m_000000_0'
> > > done.
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
> > > 2.9865 seconds (0 bytes/sec)
> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> > >
> > > Thanks&Regards,
> > > Bruce
> > >
> > >
> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jarcec@apache.org
> >wrote:
> > >
> > >> Hi Bruce,
> > >> would you mind sending entire sqoop command that you've used as well
> as
> > >> entire output that it generates with "--verbose" flag?
> > >>
> > >> Jarcec
> > >>
> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> > >> > Hi there,
> > >> > When I'm using sqoop free-form query import to import the data from
> > >> Oracle
> > >> > to HDFS with some ETL process in the query, the results in HDFS
> contains
> > >> > nothing.
> > >> > The query is as follows:
> > >> >
> > >> > SELECT a.*,
> > >> >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > c.cust_code,c.root_cust_code,
> > >> >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > FROM prc_idap_pi_root a
> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > WHERE para_id=84) AND \$CONDITIONS
> > >> >
> > >> > The same query has been executed successfully in oracle(without the
> > >> > $CONDITIONS of course). Is it because the query contains sub-query
> in
> > >> it?
> > >> >
> > >> > Thanks&Regards,
> > >> > Bruce
> > >>
> > >
> > >
>

Re: problems importing from oracle\

Posted by Bruce Bian <we...@gmail.com>.
Hi Jarcec,
After looking at the code of sqoop, my previous split-by problem is caused
by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and
the following code in org.apache.sqoop.manager.DefaultManagerFactory
initialized a GenericJdbcManager instead of OracleManager even after
--connection-manager OracleManager is specified

    SqoopOptions options = data.getSqoopOptions();
    String manualDriver = options.getDriverClassName();
    if (manualDriver != null) {
      // User has manually specified JDBC implementation with --driver.
      // Just use GenericJdbcManager.
      return new GenericJdbcManager(manualDriver, options);
    }
Any reason why the code above appears before initializing the connection
manager specified by the user?Shouldn't it be put even after the connection
scheme is judged?


On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:

> Ignored :-)
>
> I do not believe that you're hitting exactly SQOOP-204. It seems that
> SQOOP-204 has failed during creating Input Splits for your job. But you
> seem to be dying after your job is being executed on hadoop cluster.
>
> I'm afraid that I do not know how to help you at the moment. Would you
> mind upgrading on current 1.4.1 version?
>
> Jarcec
>
> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> > Hi Jarek ,
> > Please ignore my first problem for getting no hdfs results as it turns
> out
> > to be my silly mistake during copying of the query. sorry for the
> annoyance.
> > The second problem of adding --split-by turns out to be SQOOP-204, but it
> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
> >
> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com>
> wrote:
> >
> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop
> command as
> > > in:
> > > QUERY="SELECT a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND \$CONDITIONS"
> > > sqoop import \
> > > --verbose \
> > > --driver oracle.jdbc.OracleDriver \
> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> > > --username *** \
> > > --password ****** \
> > > --query "$QUERY" \
> > > --split-by a.prod_inst_id \
> > > --target-dir /home/wbian/test
> > >
> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> properly
> > > ended"   Exception is threw.
> > > And I'm testing this sqoop command on a stand-alone hadoop node.
> > > The output when adding the split-by is as follows:
> > >
> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on the
> > > command-line is insecure. Consider using -P instead.
> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of
> 1000
> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
> > > specified. Using regular API for making connection.
> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> > > query: 1000
> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> SELECT
> > > a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND  (1 = 0)
> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> > > query: 1000
> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement:
> SELECT
> > > a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND  (1 = 0)
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12,
> GH_INSTALL_TP:12,
> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12,
> DATA_INTERNET_FLG:12,
> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2,
> SUB_AGR_ID:2,
> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:93,
> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2,
> DEV_GRID_ID:2,
> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:12,
> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12,
> PI_SUB_STAT_TP:12,
> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:12,
> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is
> QueryResult.java
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> > > /usr/lib/hadoop
> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar
> at:
> > > /usr/lib/hadoop/hadoop-core.jar
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with
> args:
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > >
> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > Note:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > > uses or overrides a deprecated API.
> > > Note: Recompile with -Xlint:deprecation for details.
> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class
> files
> > > in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> > > -> QueryResult.class
> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar
> file
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query import.
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
> > > class: QueryResult
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
> > > through URL:
> > >
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
> > > QueryResult
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
> > > JVM:
> > >
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for
> jar
> > >
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> > > java.net.FactoryURLClassLoader@1638fff7
> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table
> class:
> > > QueryResult
> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using
> InputFormat:
> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > >
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> > > processName=JobTracker, sessionId=
> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load
> native-hadoop
> > > library for your platform... using builtin-java classes where
> applicable
> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
> > > reader for db product: ORACLE
> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query:
> SELECT
> > > a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next
> query:
> > > 1000
> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.*,
> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > > c.cust_code,c.root_cust_code,
> > >
> > >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > > FROM prc_idap_pi_root a
> > >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> > > auto-progress thread to quit.
> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for
> progress
> > > thread shutdown...
> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress
> thread
> > > is finished. keepGoing=false
> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
> > > shutdown detected.
> > > 12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_0
> is
> > > done. And is in the process of commiting
> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > > 12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_0
> is
> > > allowed to commit now
> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of task
> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > > 12/03/01 15:24:32 INFO mapred.Task: Task
> 'attempt_local_0001_m_000000_0'
> > > done.
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager:
> Deleted
> > > path
> > >
> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> > > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
> > > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> > > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
> > > 2.9865 seconds (0 bytes/sec)
> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
> > > sun.misc.Launcher$AppClassLoader@28df6ccd
> > >
> > > Thanks&Regards,
> > > Bruce
> > >
> > >
> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jarcec@apache.org
> >wrote:
> > >
> > >> Hi Bruce,
> > >> would you mind sending entire sqoop command that you've used as well
> as
> > >> entire output that it generates with "--verbose" flag?
> > >>
> > >> Jarcec
> > >>
> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> > >> > Hi there,
> > >> > When I'm using sqoop free-form query import to import the data from
> > >> Oracle
> > >> > to HDFS with some ETL process in the query, the results in HDFS
> contains
> > >> > nothing.
> > >> > The query is as follows:
> > >> >
> > >> > SELECT a.*,
> > >> >
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > >> > c.cust_code,c.root_cust_code,
> > >> >
> > >>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > >> > FROM prc_idap_pi_root a
> > >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> > >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> > >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> > >> etl.etl_para_cfg_detail
> > >> > WHERE para_id=84) AND \$CONDITIONS
> > >> >
> > >> > The same query has been executed successfully in oracle(without the
> > >> > $CONDITIONS of course). Is it because the query contains sub-query
> in
> > >> it?
> > >> >
> > >> > Thanks&Regards,
> > >> > Bruce
> > >>
> > >
> > >
>

Re: problems importing from oracle\

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Ignored :-)

I do not believe that you're hitting exactly SQOOP-204. It seems that SQOOP-204 has failed during creating Input Splits for your job. But you seem to be dying after your job is being executed on hadoop cluster.

I'm afraid that I do not know how to help you at the moment. Would you mind upgrading on current 1.4.1 version?

Jarcec

On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote:
> Hi Jarek ,
> Please ignore my first problem for getting no hdfs results as it turns out
> to be my silly mistake during copying of the query. sorry for the annoyance.
> The second problem of adding --split-by turns out to be SQOOP-204, but it
> should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?
> 
> On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com> wrote:
> 
> > also when I'm adding the --split-by a.prod_inst_id to the sqoop command as
> > in:
> > QUERY="SELECT a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND \$CONDITIONS"
> > sqoop import \
> > --verbose \
> > --driver oracle.jdbc.OracleDriver \
> > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> > --username *** \
> > --password ****** \
> > --query "$QUERY" \
> > --split-by a.prod_inst_id \
> > --target-dir /home/wbian/test
> >
> > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly
> > ended"   Exception is threw.
> > And I'm testing this sqoop command on a stand-alone hadoop node.
> > The output when adding the split-by is as follows:
> >
> > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on the
> > command-line is insecure. Consider using -P instead.
> > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> > com.cloudera.sqoop.manager.DefaultManagerFactory
> > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> > com.cloudera.sqoop.manager.DefaultManagerFactory
> > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of 1000
> > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
> > specified. Using regular API for making connection.
> > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> > query: 1000
> > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> > a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND  (1 = 0)
> > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> > query: 1000
> > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> > a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND  (1 = 0)
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
> > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12, GH_INSTALL_TP:12,
> > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
> > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12, DATA_INTERNET_FLG:12,
> > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2, SUB_AGR_ID:2,
> > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:93,
> > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2, DEV_GRID_ID:2,
> > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:12,
> > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12, PI_SUB_STAT_TP:12,
> > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
> > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:12,
> > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
> > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is QueryResult.java
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> > /usr/lib/hadoop
> > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar at:
> > /usr/lib/hadoop/hadoop-core.jar
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with args:
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> > 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> > /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > Note:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> > uses or overrides a deprecated API.
> > Note: Recompile with -Xlint:deprecation for details.
> > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class files
> > in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> > -> QueryResult.class
> > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar file
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query import.
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
> > class: QueryResult
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
> > through URL:
> > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
> > sun.misc.Launcher$AppClassLoader@28df6ccd
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
> > QueryResult
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
> > JVM:
> > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for jar
> > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> > java.net.FactoryURLClassLoader@1638fff7
> > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table class:
> > QueryResult
> > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
> > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> > processName=JobTracker, sessionId=
> > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load native-hadoop
> > library for your platform... using builtin-java classes where applicable
> > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
> > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
> > reader for db product: ORACLE
> > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query: SELECT
> > a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next query:
> > 1000
> > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> > auto-progress thread to quit.
> > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for progress
> > thread shutdown...
> > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress thread
> > is finished. keepGoing=false
> > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
> > shutdown detected.
> > 12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is
> > done. And is in the process of commiting
> > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > 12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_0 is
> > allowed to commit now
> > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of task
> > 'attempt_local_0001_m_000000_0' to /home/wbian/test
> > 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> > 12/03/01 15:24:32 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0'
> > done.
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> > path
> > /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> > 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
> > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> > 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> > 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
> > 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> > 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> > 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> > 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> > 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
> > 2.9865 seconds (0 bytes/sec)
> > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
> > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
> > sun.misc.Launcher$AppClassLoader@28df6ccd
> >
> > Thanks&Regards,
> > Bruce
> >
> >
> > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:
> >
> >> Hi Bruce,
> >> would you mind sending entire sqoop command that you've used as well as
> >> entire output that it generates with "--verbose" flag?
> >>
> >> Jarcec
> >>
> >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> >> > Hi there,
> >> > When I'm using sqoop free-form query import to import the data from
> >> Oracle
> >> > to HDFS with some ETL process in the query, the results in HDFS contains
> >> > nothing.
> >> > The query is as follows:
> >> >
> >> > SELECT a.*,
> >> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> >> > c.cust_code,c.root_cust_code,
> >> >
> >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> >> > FROM prc_idap_pi_root a
> >> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> >> etl.etl_para_cfg_detail
> >> > WHERE para_id=84) AND \$CONDITIONS
> >> >
> >> > The same query has been executed successfully in oracle(without the
> >> > $CONDITIONS of course). Is it because the query contains sub-query in
> >> it?
> >> >
> >> > Thanks&Regards,
> >> > Bruce
> >>
> >
> >

Re: problems importing from oracle

Posted by Bruce Bian <we...@gmail.com>.
Hi Jarek ,
Please ignore my first problem for getting no hdfs results as it turns out
to be my silly mistake during copying of the query. sorry for the annoyance.
The second problem of adding --split-by turns out to be SQOOP-204, but it
should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it?

On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <we...@gmail.com> wrote:

> also when I'm adding the --split-by a.prod_inst_id to the sqoop command as
> in:
> QUERY="SELECT a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND \$CONDITIONS"
> sqoop import \
> --verbose \
> --driver oracle.jdbc.OracleDriver \
> --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
> --username *** \
> --password ****** \
> --query "$QUERY" \
> --split-by a.prod_inst_id \
> --target-dir /home/wbian/test
>
> A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly
> ended"   Exception is threw.
> And I'm testing this sqoop command on a stand-alone hadoop node.
> The output when adding the split-by is as follows:
>
> 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on the
> command-line is insecure. Consider using -P instead.
> 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
> com.cloudera.sqoop.manager.DefaultManagerFactory
> 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> com.cloudera.sqoop.manager.DefaultManagerFactory
> 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of 1000
> 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
> 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
> 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
> specified. Using regular API for making connection.
> 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> query: 1000
> 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND  (1 = 0)
> 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next
> query: 1000
> 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND  (1 = 0)
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
> CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
> STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
> INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
> BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
> COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
> WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12, GH_INSTALL_TP:12,
> GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
> DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
> DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12, DATA_INTERNET_FLG:12,
> PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
> PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
> PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2, SUB_AGR_ID:2,
> AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:93,
> INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2, DEV_GRID_ID:2,
> DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
> SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
> SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
> SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
> SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
> SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
> SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
> SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
> SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
> SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
> SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
> PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
> DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
> PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
> SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:12,
> LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12, PI_SUB_STAT_TP:12,
> PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
> SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
> SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
> VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
> BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
> ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
> WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:12,
> A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
> A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
> RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
> SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
> GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
> DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
> MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
> SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
> ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
> ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
> ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
> 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is QueryResult.java
> 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
> /usr/lib/hadoop
> 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar at:
> /usr/lib/hadoop/hadoop-core.jar
> 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with args:
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
> 12/03/01 15:24:28 DEBUG orm.CompilationManager:
> /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> Note:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
> uses or overrides a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class files
> in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
> 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
> -> QueryResult.class
> 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar file
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
> 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query import.
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing
> class: QueryResult
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
> through URL:
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
> sun.misc.Launcher$AppClassLoader@28df6ccd
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
> QueryResult
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current
> JVM:
> jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
> 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for jar
> /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
> java.net.FactoryURLClassLoader@1638fff7
> 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table class:
> QueryResult
> 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
> class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
> file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
> 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
> reader for db product: ORACLE
> 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query: SELECT
> a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next query:
> 1000
> 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
>
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
> 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
> auto-progress thread to quit.
> 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for progress
> thread shutdown...
> 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress thread
> is finished. keepGoing=false
> 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
> shutdown detected.
> 12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is
> done. And is in the process of commiting
> 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> 12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_0 is
> allowed to commit now
> 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of task
> 'attempt_local_0001_m_000000_0' to /home/wbian/test
> 12/03/01 15:24:32 INFO mapred.LocalJobRunner:
> 12/03/01 15:24:32 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0'
> done.
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
> 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
> path
> /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
> 12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
> 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
> 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
> 12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
> 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
> 12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
> 12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
> 12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
> 12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
> 12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
> 12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
> 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
> 2.9865 seconds (0 bytes/sec)
> 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
> 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
> sun.misc.Launcher$AppClassLoader@28df6ccd
>
> Thanks&Regards,
> Bruce
>
>
> On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:
>
>> Hi Bruce,
>> would you mind sending entire sqoop command that you've used as well as
>> entire output that it generates with "--verbose" flag?
>>
>> Jarcec
>>
>> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
>> > Hi there,
>> > When I'm using sqoop free-form query import to import the data from
>> Oracle
>> > to HDFS with some ETL process in the query, the results in HDFS contains
>> > nothing.
>> > The query is as follows:
>> >
>> > SELECT a.*,
>> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
>> > c.cust_code,c.root_cust_code,
>> >
>> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
>> > FROM prc_idap_pi_root a
>> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
>> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
>> etl.etl_para_cfg_detail
>> > WHERE para_id=84) AND \$CONDITIONS
>> >
>> > The same query has been executed successfully in oracle(without the
>> > $CONDITIONS of course). Is it because the query contains sub-query in
>> it?
>> >
>> > Thanks&Regards,
>> > Bruce
>>
>
>

Re: problems importing from oracle

Posted by Bruce Bian <we...@gmail.com>.
also when I'm adding the --split-by a.prod_inst_id to the sqoop command as
in:
QUERY="SELECT a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND \$CONDITIONS"
sqoop import \
--verbose \
--driver oracle.jdbc.OracleDriver \
--connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
--username *** \
--password ****** \
--query "$QUERY" \
--split-by a.prod_inst_id \
--target-dir /home/wbian/test

A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly
ended"   Exception is threw.
And I'm testing this sqoop command on a stand-alone hadoop node.
The output when adding the split-by is as follows:

14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on the
command-line is insecure. Consider using -P instead.
12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.cloudera.sqoop.manager.DefaultManagerFactory
12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of 1000
12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
specified. Using regular API for making connection.
12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next query:
1000
12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND  (1 = 0)
12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next query:
1000
12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND  (1 = 0)
12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12, GH_INSTALL_TP:12,
GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12, DATA_INTERNET_FLG:12,
PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2, SUB_AGR_ID:2,
AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:93,
INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2, DEV_GRID_ID:2,
DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:12,
LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12, PI_SUB_STAT_TP:12,
PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:12,
A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is QueryResult.java
12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
/usr/lib/hadoop
12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar at:
/usr/lib/hadoop/hadoop-core.jar
12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with args:
12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
12/03/01 15:24:28 DEBUG orm.CompilationManager:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
12/03/01 15:24:28 DEBUG orm.CompilationManager:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
12/03/01 15:24:28 DEBUG orm.CompilationManager:
/usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
Note:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class files
in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
-> QueryResult.class
12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar file
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query import.
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing class:
QueryResult
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
through URL:
jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
sun.misc.Launcher$AppClassLoader@28df6ccd
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
QueryResult
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current JVM:
jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for jar
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
java.net.FactoryURLClassLoader@1638fff7
12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table class:
QueryResult
12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=
12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
reader for db product: ORACLE
12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query: SELECT
a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next query:
1000
12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
auto-progress thread to quit.
12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for progress
thread shutdown...
12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress thread
is finished. keepGoing=false
12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
shutdown detected.
12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is
done. And is in the process of commiting
12/03/01 15:24:32 INFO mapred.LocalJobRunner:
12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_0 is
allowed to commit now
12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of task
'attempt_local_0001_m_000000_0' to /home/wbian/test
12/03/01 15:24:32 INFO mapred.LocalJobRunner:
12/03/01 15:24:32 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0'
done.
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
2.9865 seconds (0 bytes/sec)
12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
sun.misc.Launcher$AppClassLoader@28df6ccd

Thanks&Regards,
Bruce


On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:

> Hi Bruce,
> would you mind sending entire sqoop command that you've used as well as
> entire output that it generates with "--verbose" flag?
>
> Jarcec
>
> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> > Hi there,
> > When I'm using sqoop free-form query import to import the data from
> Oracle
> > to HDFS with some ETL process in the query, the results in HDFS contains
> > nothing.
> > The query is as follows:
> >
> > SELECT a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > WHERE para_id=84) AND \$CONDITIONS
> >
> > The same query has been executed successfully in oracle(without the
> > $CONDITIONS of course). Is it because the query contains sub-query in it?
> >
> > Thanks&Regards,
> > Bruce
>

Re: problems importing from oracle

Posted by Bruce Bian <we...@gmail.com>.
Hi Jarek,
the sqoop command is:

QUERY="SELECT a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND \$CONDITIONS"
sqoop import \
--verbose \
--driver oracle.jdbc.OracleDriver \
--connect jdbc:oracle:thin:@10.239.47.36:1521/dx \
--username **** \
--password ****** \
--query "$QUERY" \
--target-dir /home/wbian/test \
-m 1

the verbose output is:
14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging.
12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on the
command-line is insecure. Consider using -P instead.
12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.cloudera.sqoop.manager.DefaultManagerFactory
12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of 1000
12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1
12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation
12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters
specified. Using regular API for making connection.
12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next query:
1000
12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND  (1 = 0)
12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next query:
1000
12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT
a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND  (1 = 0)
12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns:
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_INST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CRM_ASSET_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   INTEGRATION_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   STD_PRD_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROD_SPEC_CODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PREPAY_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   STOP_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   UNINSTALL_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_ASSET_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BILL_PROD_INST_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_ASSET_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CARRIER_PROD_INST_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   COMP_PAR_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CENTREX_SUB_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_ACCESS_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_MONTHLY_HOURS
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_INSTALL_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_INSTALL_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_WATCH_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_PHONE_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_SPEED_RATE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_INTERNET_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ITEM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_GROUP_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_START_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_END_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONTINUE_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_YEAR_PAY_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ITEM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEXT_PROM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_AGR_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_START_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGR_END_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   INSTALL_ADDR_POSTCODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_AREA_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_BUREAU_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   AGENT_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_001_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_002_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_003_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_004_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_005_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_006_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_007_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_008_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_009_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_010_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_011_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_012_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_013_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_014_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_015_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_016_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_017_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_018_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_019_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_020_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_021_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_022_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_023_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_024_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_025_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_026_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_027_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_028_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_029_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_030_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_031_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_032_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_033_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_034_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_035_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_036_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_037_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_038_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_039_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_040_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GH_TELEPHONE_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_UN_ACTIVE_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_ACTIVE_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PAY_CUST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   OWN_CUST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   USE_CUST_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_STAT_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_041_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_042_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   FREE_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SERV_043_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   QUERY_PHONE_NUMBER_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_TMP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CREATE_BY
12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_TMP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   LST_UPD_BY
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUSI_KEY
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SRC_SYS
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PI_SUB_STAT_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_PACK_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   NEW_CUST_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_SEG_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   UIM_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   IMSI
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_START_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_END_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_EXP_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   VPN_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_BUREAU_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_GROUP_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   EJ_T_PROM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUILDING_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   IVPN_NUM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_ID_CRM
12/03/01 15:24:28 DEBUG orm.ClassWriter:   USER_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADD_GROUP_IID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CDMA_PROD_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACT_OP_RATE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DEV_GRID_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_UP_RATE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_EXPERIENCE_DOWN_RATE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_A
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_MODE_B
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_BUSI_TYPE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ATTR_USE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_163_ONLINENET
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ISP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   WB_SPEED_RATE_AVL
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   RESTRICT_CHURN_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PHS_SERIES_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   OPEN_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CHURN_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_ACTION_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   A_ACCESS_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_CONT_SYSAUTO_FLG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   GUANGWANG_FLAG
12/03/01 15:24:28 DEBUG orm.ClassWriter:   IPTV_PROM_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTA_ADDR
12/03/01 15:24:28 DEBUG orm.ClassWriter:   DATA_PORTB_ADDR
12/03/01 15:24:28 DEBUG orm.ClassWriter:   MOBILE_TERM_TYPE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PROM_INTG_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_INTG_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SALE_POLICY_CONST_START_DT
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_NO
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADDR_ID
12/03/01 15:24:28 DEBUG orm.ClassWriter:   POSTCODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ACNT_RMND_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   PRINT_TP
12/03/01 15:24:28 DEBUG orm.ClassWriter:   MEDIA_TYPE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   CUST_CODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ROOT_CUST_CODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   MDF_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   SUB_BUREAU_CODE
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_CD
12/03/01 15:24:28 DEBUG orm.ClassWriter:   ADM_SUB_BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter:   BUREAU_NAME
12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null
12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12,
CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12,
STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12,
INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12,
BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12,
COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12,
WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12, GH_INSTALL_TP:12,
GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12,
DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12,
DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12, DATA_INTERNET_FLG:12,
PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12,
PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12,
PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2, SUB_AGR_ID:2,
AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:93,
INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2, DEV_GRID_ID:2,
DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12,
SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1,
SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1,
SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1,
SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1,
SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1,
SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1,
SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1,
SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1,
SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1,
SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1,
PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12,
DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12,
PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12,
SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:12,
LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12, PI_SUB_STAT_TP:12,
PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12,
SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93,
SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12,
VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2,
BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12,
ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12,
WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:12,
A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12,
A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12,
RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93,
SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12,
GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12,
DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12,
MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12,
SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12,
ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12,
ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12,
ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12,
12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is QueryResult.java
12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is
/usr/lib/hadoop
12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar at:
/usr/lib/hadoop/hadoop-core.jar
12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with args:
12/03/01 15:24:28 DEBUG orm.CompilationManager:   -sourcepath
12/03/01 15:24:28 DEBUG orm.CompilationManager:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
12/03/01 15:24:28 DEBUG orm.CompilationManager:   -d
12/03/01 15:24:28 DEBUG orm.CompilationManager:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/
12/03/01 15:24:28 DEBUG orm.CompilationManager:   -classpath
12/03/01 15:24:28 DEBUG orm.CompilationManager:
/usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
Note:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java
uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class files
in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae
12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile:
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class
-> QueryResult.class
12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar file
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar
12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query import.
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing class:
QueryResult
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar
through URL:
jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is
sun.misc.Launcher$AppClassLoader@28df6ccd
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar:
QueryResult
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current JVM:
jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/
12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for jar
/tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar:
java.net.FactoryURLClassLoader@1638fff7
12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table class:
QueryResult
12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=
12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001
12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record
reader for db product: ORACLE
12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query: SELECT
a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next query:
1000
12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.*,
b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
c.cust_code,c.root_cust_code,
d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
FROM prc_idap_pi_root a
 LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
 LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
 LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 )
12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing
auto-progress thread to quit.
12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for progress
thread shutdown...
12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress thread
is finished. keepGoing=false
12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread
shutdown detected.
12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is
done. And is in the process of commiting
12/03/01 15:24:32 INFO mapred.LocalJobRunner:
12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_0 is
allowed to commit now
12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of task
'attempt_local_0001_m_000000_0' to /home/wbian/test
12/03/01 15:24:32 INFO mapred.LocalJobRunner:
12/03/01 15:24:32 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0'
done.
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar
12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted
path
/tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar
12/03/01 15:24:33 INFO mapred.JobClient:  map 100% reduce 0%
12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001
12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6
12/03/01 15:24:33 INFO mapred.JobClient:   FileSystemCounters
12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_READ=37482
12/03/01 15:24:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=96083
12/03/01 15:24:33 INFO mapred.JobClient:   Map-Reduce Framework
12/03/01 15:24:33 INFO mapred.JobClient:     Map input records=0
12/03/01 15:24:33 INFO mapred.JobClient:     Spilled Records=0
12/03/01 15:24:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=87
12/03/01 15:24:33 INFO mapred.JobClient:     Map output records=0
12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
2.9865 seconds (0 bytes/sec)
12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader:
sun.misc.Launcher$AppClassLoader@28df6ccd


On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <ja...@apache.org>wrote:

> Hi Bruce,
> would you mind sending entire sqoop command that you've used as well as
> entire output that it generates with "--verbose" flag?
>
> Jarcec
>
> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> > Hi there,
> > When I'm using sqoop free-form query import to import the data from
> Oracle
> > to HDFS with some ETL process in the query, the results in HDFS contains
> > nothing.
> > The query is as follows:
> >
> > SELECT a.*,
> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> > c.cust_code,c.root_cust_code,
> >
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> > FROM prc_idap_pi_root a
> >  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
> >  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
> >  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM
> etl.etl_para_cfg_detail
> > WHERE para_id=84) AND \$CONDITIONS
> >
> > The same query has been executed successfully in oracle(without the
> > $CONDITIONS of course). Is it because the query contains sub-query in it?
> >
> > Thanks&Regards,
> > Bruce
>

Re: problems importing from oracle

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Hi Bruce,
would you mind sending entire sqoop command that you've used as well as entire output that it generates with "--verbose" flag?

Jarcec

On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote:
> Hi there,
> When I'm using sqoop free-form query import to import the data from Oracle
> to HDFS with some ETL process in the query, the results in HDFS contains
> nothing.
> The query is as follows:
> 
> SELECT a.*,
> b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type,
> c.cust_code,c.root_cust_code,
> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name
> FROM prc_idap_pi_root a
>  LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id
>  LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id
>  LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id
> WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail
> WHERE para_id=84) AND \$CONDITIONS
> 
> The same query has been executed successfully in oracle(without the
> $CONDITIONS of course). Is it because the query contains sub-query in it?
> 
> Thanks&Regards,
> Bruce