You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@uniffle.apache.org by "sunshineJK (via GitHub)" <gi...@apache.org> on 2023/11/29 10:18:49 UTC
[I] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
sunshineJK opened a new issue, #1341:
URL: https://github.com/apache/incubator-uniffle/issues/1341
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.
### Describe the bug
Test wordcount to specify combine on the master branch，Report an error：
java.lang.ArrayIndexOutOfBoundsException: 3075
at org.apache.hadoop.io.DataInputBuffer$Buffer.read(DataInputBuffer.java:80)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.hadoop.io.IntWritable.readFields(IntWritable.java:47)
at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71)
at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42)
at org.apache.hadoop.mapreduce.task.ReduceContextImpl.nextKeyValue(ReduceContextImpl.java:146)
at org.apache.hadoop.mapreduce.task.ReduceContextImpl$ValueIterator.next(ReduceContextImpl.java:239)
at org.apache.hadoop.examples.WordCount$IntSumReducer.reduce(WordCount.java:60)
at org.apache.hadoop.examples.WordCount$IntSumReducer.reduce(WordCount.java:52)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:183)
at org.apache.hadoop.mapred.Task$NewCombinerRunner.combine(Task.java:1923)
at org.apache.hadoop.mapred.SortWriteBufferManager.combineBuffer(SortWriteBufferManager.java:268)
at org.apache.hadoop.mapred.SortWriteBufferManager.prepareBufferForSend(SortWriteBufferManager.java:241)
at org.apache.hadoop.mapred.SortWriteBufferManager.sendBufferToServers(SortWriteBufferManager.java:209)
at org.apache.hadoop.mapred.SortWriteBufferManager.addRecord(SortWriteBufferManager.java:194)
at org.apache.hadoop.mapred.RssMapOutputCollector.collect(RssMapOutputCollector.java:216)
at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:745)
at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
at org.apache.hadoop.examples.WordCount$TokenizerMapper.map(WordCount.java:47)
at org.apache.hadoop.examples.WordCount$TokenizerMapper.map(WordCount.java:36)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:155)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:819)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
### Affects Version(s)
0.9.0-SNAPSHOT
### Uniffle Server Log Output
_No response_
### Uniffle Engine Log Output
_No response_
### Uniffle Server Configurations
_No response_
### Uniffle Engine Configurations
_No response_
### Additional context
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [I] [Bug] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
Posted by "sunshineJK (via GitHub)" <gi...@apache.org>.
sunshineJK commented on issue #1341:
URL: https://github.com/apache/incubator-uniffle/issues/1341#issuecomment-1911675580
Thank you. Do you have any ideas so far? We can do some communication
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [I] [Bug] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
Posted by "jerqi (via GitHub)" <gi...@apache.org>.
jerqi commented on issue #1341:
URL: https://github.com/apache/incubator-uniffle/issues/1341#issuecomment-1831631179
@qijiale76 Could you take a look at this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [I] [Bug] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
Posted by "qijiale76 (via GitHub)" <gi...@apache.org>.
qijiale76 commented on issue #1341:
URL: https://github.com/apache/incubator-uniffle/issues/1341#issuecomment-1869229480
> @qijiale76 Hello, is there a repair plan？
Thank you for your patience. I plan to submit a PR with the solution by the end of this week.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [I] [Bug] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
Posted by "sunshineJK (via GitHub)" <gi...@apache.org>.
sunshineJK commented on issue #1341:
URL: https://github.com/apache/incubator-uniffle/issues/1341#issuecomment-1868946649
@qijiale76 Hello, is there a repair plan？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [I] [Bug] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
Posted by "qijiale76 (via GitHub)" <gi...@apache.org>.
qijiale76 commented on issue #1341:
URL: https://github.com/apache/incubator-uniffle/issues/1341#issuecomment-1914114058
> Thank you. Do you have any ideas so far? We can do some communication
I am still having difficulty reproducing this issue in my environment. Could you please provide me a stable way to reproduce?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [I] [Bug] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
Posted by "jerqi (via GitHub)" <gi...@apache.org>.
jerqi closed issue #1341: [Bug] java.lang.ArrayIndexOutOfBoundsException
URL: https://github.com/apache/incubator-uniffle/issues/1341
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [I] [Bug] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
Posted by "sunshineJK (via GitHub)" <gi...@apache.org>.
sunshineJK commented on issue #1341:
URL: https://github.com/apache/incubator-uniffle/issues/1341#issuecomment-1831655591
Uniffle：0.9.0-SNAPSHOT（master branch）
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [I] [Bug] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
Posted by "qijiale76 (via GitHub)" <gi...@apache.org>.
qijiale76 commented on issue #1341:
URL: https://github.com/apache/incubator-uniffle/issues/1341#issuecomment-1831647243
@sunshineJK Could you provide information such as the specific Hadoop version and test data to reproduce this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [I] [Bug] java.lang.ArrayIndexOutOfBoundsException [incubator-uniffle]
Posted by "sunshineJK (via GitHub)" <gi...@apache.org>.
sunshineJK commented on issue #1341:
URL: https://github.com/apache/incubator-uniffle/issues/1341#issuecomment-1911676509
> > @qijiale76 Hello, is there a repair plan？
>
> Thank you for your patience. I plan to submit a PR with the solution by the end of this week.
Thank you. Do you have any ideas so far? We can do some communication
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org