You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@solr.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2022/01/20 18:33:00 UTC

[jira] [Commented] (SOLR-15405) Make HDFS handle little endian LUCENE-9047

    [ https://issues.apache.org/jira/browse/SOLR-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479583#comment-17479583 ] 

ASF subversion and git services commented on SOLR-15405:
--------------------------------------------------------

Commit 64c02c05667aabf163665e656709a81926964d1a in solr's branch refs/heads/main from Kevin Risden
[ https://gitbox.apache.org/repos/asf?p=solr.git;h=64c02c0 ]

SOLR-15405: Make HDFS handle little endian LUCENE-9047

Uses Lucene `ByteArrayDataInput` and `ByeBuffersDataInput` as inspiration.
* https://github.com/apache/lucene/blob/main/lucene/core/src/java/org/apache/lucene/store/ByteArrayDataInput.java
* https://github.com/apache/lucene/blob/releases/lucene%2F9.0.0/lucene/core/src/java/org/apache/lucene/store/ByteBuffersDataInput.java#L212

`CustomBufferedIndexInput` needs to ensure that
it handles LUCNE-9047 changes for little
endianess. This replaces the existing methods
with little endian implementations.


> Make HDFS handle little endian LUCENE-9047
> ------------------------------------------
>
>                 Key: SOLR-15405
>                 URL: https://issues.apache.org/jira/browse/SOLR-15405
>             Project: Solr
>          Issue Type: Bug
>          Components: hdfs
>    Affects Versions: 9.0
>            Reporter: Gus Heck
>            Assignee: Kevin Risden
>            Priority: Blocker
>             Fix For: 9.0
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> HDFS tests are failing very frequently and one example that seems to reproduce reliably. One seed that seems to reproduce reliably is 
> {code:java}
> gradlew :solr:core:test --tests "org.apache.solr.index.hdfs.CheckHdfsIndexTest.testChecksumsOnly" -Ptests.jvms=30 -Ptests.jvmargs=-XX:TieredStopAtLevel=1 -Ptests.seed=566ED88C9109BEFC -Ptests.file.encoding=US-ASCII
> {code}
> This may have been broken due by LUCENE-9047
> Marking as a blocker because clearly something isn't working at all here and we shouldn't release broken code. The effort to move the deprecated HDFS code to a package in SOLR-14660 is also relevant



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org