You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Sergei Lebedev (JIRA)" <ji...@apache.org> on 2018/06/17 22:32:00 UTC
[jira] [Comment Edited] (HAWQ-1624) Make libhdfs3 binary compatible
with libhdfs
[ https://issues.apache.org/jira/browse/HAWQ-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16515185#comment-16515185 ]
Sergei Lebedev edited comment on HAWQ-1624 at 6/17/18 10:31 PM:
----------------------------------------------------------------
Hmm... looking at the source, the JVM library [seems to|https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/BlockReaderRemote.java#L243] read-and-discard on skip. However, I failed to measure this linear-time seek behaviour in practice.
was (Author: lebedev):
Answering the question above, yes the JVM library [seems to|https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/BlockReaderRemote.java#L243] read-and-discard on skip.
> Make libhdfs3 binary compatible with libhdfs
> --------------------------------------------
>
> Key: HAWQ-1624
> URL: https://issues.apache.org/jira/browse/HAWQ-1624
> Project: Apache HAWQ
> Issue Type: Improvement
> Components: libhdfs
> Reporter: Sergei Lebedev
> Assignee: Radar Lei
> Priority: Minor
>
> libhdfs3 is almost binary compatible with libhdfs. The missing bits are:
> * libhdfs3 does not define hdfsPread which nonetheless can be implemented in terms of hdfsTell, hdfsSeek and hdfsRead;
> * hdfsSync is called hdfsHSync in libhdfs3;
> * In libhdfs hdfsFlush flushes the internal buffer of the BufferedInputStream; in libhdfs3 it always flushes to HDFS, i.e. it does what hdfsHFlush should do.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)