You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by "flo @" <xx...@gmail.com> on 2013/12/30 10:59:43 UTC
Unknown column 'Infinity' in 'field list'
When I crawl with nutch 2.2.1 (mysql backend) the exception : "Unknown
column 'Infinity' in 'field list'" sometimes occurs. Does somebody know
what is this about?
java.io.IOException: java.sql.BatchUpdateException: Unknown column
'Infinity' in 'field list'
at org.apache.gora.sql.store.SqlStore.flush(SqlStore.java:340)
at
org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:65)
at
org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.crawl.DbUpdateReducer.reduce(DbUpdateReducer.java:202)
at org.apache.nutch.crawl.DbUpdateReducer.reduce(DbUpdateReducer.java:39)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:177)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:418)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:398)
Caused by: java.sql.BatchUpdateException: Unknown column 'Infinity' in
'field list'
at
com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:2028)
at
com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1451)
at org.apache.gora.sql.store.SqlStore.flush(SqlStore.java:328)
... 9 more
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException:
Unknown column 'Infinity' in 'field list'
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3609)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3541)
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2002)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2163)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2624)
at
com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2127)
at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2427)
at
com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1980)
... 11 more
Re: Unknown column 'Infinity' in 'field list'
Posted by "flo @" <xx...@gmail.com>.
The problem is, that mysql disallows to store Double.POSITIVE_INFINITY or
Double.NEGATIVE_INFINITY values.
But how can I fix it? I didn't do any special configuration in nutch.
Does anybody have the same problem?
2013/12/30 flo @ <xx...@gmail.com>
> When I crawl with nutch 2.2.1 (mysql backend) the exception : "Unknown
> column 'Infinity' in 'field list'" sometimes occurs. Does somebody know
> what is this about?
>
>
> java.io.IOException: java.sql.BatchUpdateException: Unknown column
> 'Infinity' in 'field list'
> at org.apache.gora.sql.store.SqlStore.flush(SqlStore.java:340)
> at
> org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:65)
> at
> org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
> at
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> at org.apache.nutch.crawl.DbUpdateReducer.reduce(DbUpdateReducer.java:202)
> at org.apache.nutch.crawl.DbUpdateReducer.reduce(DbUpdateReducer.java:39)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:177)
> at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:418)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:398)
> Caused by: java.sql.BatchUpdateException: Unknown column 'Infinity' in
> 'field list'
> at
> com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:2028)
> at
> com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1451)
> at org.apache.gora.sql.store.SqlStore.flush(SqlStore.java:328)
> ... 9 more
> Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException:
> Unknown column 'Infinity' in 'field list'
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
> at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
> at com.mysql.jdbc.Util.getInstance(Util.java:386)
> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3609)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3541)
> at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2002)
> at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2163)
> at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2624)
> at
> com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2127)
> at
> com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2427)
> at
> com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1980)
> ... 11 more
>