You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Rafael Fracasso Gomes (Jira)" <ji...@apache.org> on 2023/04/11 19:28:00 UTC

[jira] [Updated] (NIFI-11434) Error with UnpackContent

     [ https://issues.apache.org/jira/browse/NIFI-11434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rafael Fracasso Gomes updated NIFI-11434:
-----------------------------------------
    Description: 
I posted in NiFi discussion group about a error that occurred in UnpackContent processor, I will paste it here:
{panel:title=Error with UnpackContent}
I'm trying to unzip some files with NiFi and getting this errors:
{code:java}
UnpackContent[id=5c38660b-0187-1000-52a2-0b71f8e868c0] Unable to unpack FlowFile[filename=58174fd0-750e-4e45-89bf-c43d9ab01b98]; routing to failure: org.apache.nifi.processor.exception.ProcessException: IOException thrown from UnpackContent[id=5c38660b-0187-1000-52a2-0b71f8e868c0]: org.apache.commons.compress.archivers.zip.UnsupportedZipFeatureException: Unsupported feature data descriptor used in entry files/20230228_131431_84_24c8_3B_udm2_clip.tif - Caused by: org.apache.commons.compress.archivers.zip.UnsupportedZipFeatureException: Unsupported feature data descriptor used in entry files/20230228_131431_84_24c8_3B_udm2_clip.tif{code}
I found some workaround in the link below but it doesn't suits me because i need to keep my attributes in the flowfiles:
[https://community.cloudera.com/t5/Support-Questions/Unzip-file-containing-log-gz-files-with-nifi/m-p/304042]

And found some help in stackoverflow about this problem but it doesn't fit on NiFi processor: (
[https://stackoverflow.com/questions/15738312/how-to-fix-org-apache-commons-compress-archivers-zip-unsupportedzipfeatureexcept]
)


I attached a sample file that I downloaded from nifi content.{panel}
 
David Handermann replyed me:
{panel}
As indicated by the error message, the Zip file in question includes a specialized data descriptor feature that is not supported in the default configuration of the UnpackContent Processor.
 
The UnpackContent Processor relies on Apache Commons Compress for extraction, which has optional support for handling this feature. The feature is disabled by default, which is the reason for the error.
 
Apache Commons Compress issue COMPRESS-555 [1] provides some additional background on why this feature is disabled by default, but it sounds like something that could be evaluated for adjustment in Apache NiFi.
[1] [https://issues.apache.org/jira/projects/COMPRESS/issues/COMPRESS-555]
{panel}
 
 

  was:
I posted in NiFi discussion group about a error that occurred in UnpackContent processor, I will paste it here:




{panel:title=Error with UnpackContent}
I'm trying to unzip some files with NiFi and getting this errors:


{code:java}
UnpackContent[id=5c38660b-0187-1000-52a2-0b71f8e868c0] Unable to unpack FlowFile[filename=58174fd0-750e-4e45-89bf-c43d9ab01b98]; routing to failure: org.apache.nifi.processor.exception.ProcessException: IOException thrown from UnpackContent[id=5c38660b-0187-1000-52a2-0b71f8e868c0]: org.apache.commons.compress.archivers.zip.UnsupportedZipFeatureException: Unsupported feature data descriptor used in entry files/20230228_131431_84_24c8_3B_udm2_clip.tif - Caused by: org.apache.commons.compress.archivers.zip.UnsupportedZipFeatureException: Unsupported feature data descriptor used in entry files/20230228_131431_84_24c8_3B_udm2_clip.tif{code}

I found some workaround in the link below but it doesn't suits me because i need to keep my attributes in the flowfiles:
[https://community.cloudera.com/t5/Support-Questions/Unzip-file-containing-log-gz-files-with-nifi/m-p/304042]

And found some help in stackoverflow about this problem but it doesn't fit on NiFi processor: (
[https://stackoverflow.com/questions/15738312/how-to-fix-org-apache-commons-compress-archivers-zip-unsupportedzipfeatureexcept]
){panel}
 
David Handermann replyed me:
{panel}
As indicated by the error message, the Zip file in question includes a specialized data descriptor feature that is not supported in the default configuration of the UnpackContent Processor.
 
The UnpackContent Processor relies on Apache Commons Compress for extraction, which has optional support for handling this feature. The feature is disabled by default, which is the reason for the error.
 
Apache Commons Compress issue COMPRESS-555 [1] provides some additional background on why this feature is disabled by default, but it sounds like something that could be evaluated for adjustment in Apache NiFi.
[1] [https://issues.apache.org/jira/projects/COMPRESS/issues/COMPRESS-555]{panel}
 
 


> Error with UnpackContent
> ------------------------
>
>                 Key: NIFI-11434
>                 URL: https://issues.apache.org/jira/browse/NIFI-11434
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 1.18.0
>         Environment: OS Ubuntu 20.04.5, running in a K8S cluster but as standalone node, limited to 8gb, free on cpu usage.
>            Reporter: Rafael Fracasso Gomes
>            Priority: Blocker
>         Attachments: 58174fd0-750e-4e45-89bf-c43d9ab01b98.zip
>
>
> I posted in NiFi discussion group about a error that occurred in UnpackContent processor, I will paste it here:
> {panel:title=Error with UnpackContent}
> I'm trying to unzip some files with NiFi and getting this errors:
> {code:java}
> UnpackContent[id=5c38660b-0187-1000-52a2-0b71f8e868c0] Unable to unpack FlowFile[filename=58174fd0-750e-4e45-89bf-c43d9ab01b98]; routing to failure: org.apache.nifi.processor.exception.ProcessException: IOException thrown from UnpackContent[id=5c38660b-0187-1000-52a2-0b71f8e868c0]: org.apache.commons.compress.archivers.zip.UnsupportedZipFeatureException: Unsupported feature data descriptor used in entry files/20230228_131431_84_24c8_3B_udm2_clip.tif - Caused by: org.apache.commons.compress.archivers.zip.UnsupportedZipFeatureException: Unsupported feature data descriptor used in entry files/20230228_131431_84_24c8_3B_udm2_clip.tif{code}
> I found some workaround in the link below but it doesn't suits me because i need to keep my attributes in the flowfiles:
> [https://community.cloudera.com/t5/Support-Questions/Unzip-file-containing-log-gz-files-with-nifi/m-p/304042]
> And found some help in stackoverflow about this problem but it doesn't fit on NiFi processor: (
> [https://stackoverflow.com/questions/15738312/how-to-fix-org-apache-commons-compress-archivers-zip-unsupportedzipfeatureexcept]
> )
> I attached a sample file that I downloaded from nifi content.{panel}
>  
> David Handermann replyed me:
> {panel}
> As indicated by the error message, the Zip file in question includes a specialized data descriptor feature that is not supported in the default configuration of the UnpackContent Processor.
>  
> The UnpackContent Processor relies on Apache Commons Compress for extraction, which has optional support for handling this feature. The feature is disabled by default, which is the reason for the error.
>  
> Apache Commons Compress issue COMPRESS-555 [1] provides some additional background on why this feature is disabled by default, but it sounds like something that could be evaluated for adjustment in Apache NiFi.
> [1] [https://issues.apache.org/jira/projects/COMPRESS/issues/COMPRESS-555]
> {panel}
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)