You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ozone.apache.org by "Michael Smith (Jira)" <ji...@apache.org> on 2023/03/07 17:06:00 UTC

[jira] [Created] (HDDS-8095) Unbuffer not supported in TDE buckets

Michael Smith created HDDS-8095:
-----------------------------------

             Summary: Unbuffer not supported in TDE buckets
                 Key: HDDS-8095
                 URL: https://issues.apache.org/jira/browse/HDDS-8095
             Project: Apache Ozone
          Issue Type: Bug
    Affects Versions: 1.3.0
            Reporter: Michael Smith


Reading data (with Impala using file handle caching) from a bucket with transparent data encryption (TDE) enabled fails to unbuffer the input stream after read is complete.

Impala attempts hdfsUnbufferFile on cached file handles after reading is done. Previous tickets (HDDS-4320, HDDS-7135) have addressed issues with this, and been tested to work correctly. However when we enable TDE, unbuffering stops working again.

Enabling debug logging on org.apache.hadoop shows
{quote}I0307 09:00:58.513293 31969 StreamCapabilitiesPolicy.java:50] 4c4de8d99785e5c8:a97f7edb00000000] org.apache.hadoop.ozone.client.io.KeyInputStream: does not implement StreamCapabilities and the unbuffer capability
{quote}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org