Re: [sqoop-user] Re: Sqoop to avro and null string fields - NPE

["arvind@cloudera.com" <ar...@cloudera.com>]

[Moving the thread to sqoop-user@incubator.apache.org. Please subscribe to
that list.]

We don't have a release time line for  1.4 setup yet. We will soon start a
discussion on that to help finalize the plans. In the meantime, if you would
like to use this, I recommend that you build the trunk directly.

Thanks,
Arvind

On Thu, Oct 13, 2011 at 12:35 PM, Miki <mi...@gmail.com> wrote:

> Looks like it's related to https://issues.apache.org/jira/browse/SQOOP-358
> ,
> what's the time frame for sqoop-1.4?
>
> On Oct 13, 11:30 am, Miki <mi...@gmail.com> wrote:
> > I'm trying to sqoop a table to avro, but I get the exception below.
> > Any ideas on how to solve this?
> >
> > 11/10/13 11:26:59 INFO mapred.JobClient: Task Id :
> > attempt_201110101839_0013_m_000000_0, Status : FAILED
> > java.lang.NullPointerException: null of string in field
> > advertiser_account_country of dimension_creative
> >         at
> > org.apache.avro.generic.GenericDatumWriter.npe(GenericDatumWriter.java:
> > 92)
> >         at
> > org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:
> > 86)
> >         at
> > org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:
> > 57)
> >         at
> org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:
> > 244)
> >         at com.cloudera.sqoop.mapreduce.AvroOutputFormat
> > $1.write(AvroOutputFormat.java:55)
> >         at com.cloudera.sqoop.mapreduce.AvroOutputFormat
> > $1.write(AvroOutputFormat.java:51)
> >         at org.apache.hadoop.mapred.MapTask
> > $NewDirectOutputCollector.write(MapTask.java:530)
> >         at
> >
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:
> > 80)
> >         at
> > com.cloudera.sqoop.mapreduce.AvroImportMapper.map(AvroImportMapper.java:
> > 59)
> >         at
> > com.cloudera.sqoop.mapreduce.AvroImportMapper.map(AvroImportMapper.java:
> > 42)
> >         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> >         at
> >
> com.cloudera.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:
> > 187)
> >         at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:646)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
> >         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:396)
> >         at
> >
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:
> > 1115)
> >         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > Caused by: java.lang.NullPointerException
> >         at org.apache.avro.io.Encoder.writeString(Encoder.java:121)
> >         at
> >
> org.apache.avro.generic.GenericDatumWriter.writeString(GenericDatumWriter.java:
> > 186)
> >         at
> >
> org.apache.avro.generic.GenericDatumWriter.writeString(GenericDatumWriter.java:
> > 181)
> >         at
> > org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:
> > 75)
> >         at
> >
> org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:
> > 104)
> >         at
> > org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:
> > 65)
> >         ... 17 more
> >
> > sqoop version is 1.3.0-cdh3u1
> > The command:
> > sqoop import --connect jdbc:postgresql://localhost/dds_sep --username
> > dds --password dds --as-avrodatafile --target-dir /user/miki/
> > 2011/10/13/dimension_creative --table dimension_creative --columns
> >
> "acamp_id,creative_id,network_id,advertiser_id,advertiser_name,advertiser_freq_cap,advertiser_account_id,advertiser_account_name,advertiser_account_country,advertiser_account_region,advertiser_category_id,advertiser_category_name,adtype_id,adtype_name,aorder_id,aorder_name,aorder_overall_cap_i,aorder_overall_cap_uc,aorder_overall_cap_rc,aorder_overall_cap_r,aorder_overall_cap_m,aorder_freq_cap,aorder_daily_cap_i,aorder_daily_cap_uc,aorder_daily_cap_rc,aorder_daily_cap_r,aorder_daily_cap_m,aorder_ref_id,acamp_name,acamp_daily_cap_i,acamp_daily_cap_uc,acamp_daily_cap_rc,acamp_daily_cap_r,acamp_daily_cap_m,acamp_freq_period_mins,acamp_freq_cap,acamp_target_price,acamp_start_date,acamp_end_date,acamp_overall_cap_i,acamp_overall_cap_uc,acamp_overall_cap_rc,acamp_overall_cap_r,acamp_overall_cap_m,acamp_delivery_type,acamp_priority,acamp_weight,acamp_audience_targeting,conv_type,conv_type_click_hours,conv_type_view_hours,creative_name,creative_ref_id,creative_pop_behavior,agency_id,agency_name,creative_active,acamp_active,aorder_active,advertiser_active,agency_active,advertiser_account_active,adtype_active,active,io_item_id"
> > --class-name dimension_creative
>
> --
> NOTE: The mailing list sqoop-user@cloudera.org is deprecated in favor of
> Apache Sqoop mailing list sqoop-user@incubator.apache.org. Please
> subscribe to it by sending an email to
> incubator-sqoop-user-subscribe@apache.org.
>