[jira] [Created] (NIFI-11434) Error with UnpackContent

["Rafael Fracasso Gomes (Jira)" <ji...@apache.org>]

Rafael Fracasso Gomes created NIFI-11434:
--------------------------------------------

             Summary: Error with UnpackContent
                 Key: NIFI-11434
                 URL: https://issues.apache.org/jira/browse/NIFI-11434
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
    Affects Versions: 1.18.0
         Environment: OS Ubuntu 20.04.5, running in a K8S cluster but as standalone node, limited to 8gb, free on cpu usage.
            Reporter: Rafael Fracasso Gomes
         Attachments: 58174fd0-750e-4e45-89bf-c43d9ab01b98.zip

I posted in NiFi discussion group about a error that occurred in UnpackContent processor, I will paste it here:




{panel:title=Error with UnpackContent}
I'm trying to unzip some files with NiFi and getting this errors:


{code:java}
UnpackContent[id=5c38660b-0187-1000-52a2-0b71f8e868c0] Unable to unpack FlowFile[filename=58174fd0-750e-4e45-89bf-c43d9ab01b98]; routing to failure: org.apache.nifi.processor.exception.ProcessException: IOException thrown from UnpackContent[id=5c38660b-0187-1000-52a2-0b71f8e868c0]: org.apache.commons.compress.archivers.zip.UnsupportedZipFeatureException: Unsupported feature data descriptor used in entry files/20230228_131431_84_24c8_3B_udm2_clip.tif - Caused by: org.apache.commons.compress.archivers.zip.UnsupportedZipFeatureException: Unsupported feature data descriptor used in entry files/20230228_131431_84_24c8_3B_udm2_clip.tif{code}

I found some workaround in the link below but it doesn't suits me because i need to keep my attributes in the flowfiles:
[https://community.cloudera.com/t5/Support-Questions/Unzip-file-containing-log-gz-files-with-nifi/m-p/304042]

And found some help in stackoverflow about this problem but it doesn't fit on NiFi processor: (
[https://stackoverflow.com/questions/15738312/how-to-fix-org-apache-commons-compress-archivers-zip-unsupportedzipfeatureexcept]
){panel}
 
David Handermann replyed me:
{panel}
As indicated by the error message, the Zip file in question includes a specialized data descriptor feature that is not supported in the default configuration of the UnpackContent Processor.
 
The UnpackContent Processor relies on Apache Commons Compress for extraction, which has optional support for handling this feature. The feature is disabled by default, which is the reason for the error.
 
Apache Commons Compress issue COMPRESS-555 [1] provides some additional background on why this feature is disabled by default, but it sounds like something that could be evaluated for adjustment in Apache NiFi.
[1] [https://issues.apache.org/jira/projects/COMPRESS/issues/COMPRESS-555]{panel}
 
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)