You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@metron.apache.org by "Ali Nazemian (JIRA)" <ji...@apache.org> on 2018/04/24 06:47:00 UTC

[jira] [Commented] (METRON-1103) HdfsWirter outputPathFunction should support time based partitioning

    [ https://issues.apache.org/jira/browse/METRON-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16449397#comment-16449397 ] 

Ali Nazemian commented on METRON-1103:
--------------------------------------

Looks like this issue is caused by source.type registration map exceeding 500 entries.

> HdfsWirter outputPathFunction should support time based partitioning
> --------------------------------------------------------------------
>
>                 Key: METRON-1103
>                 URL: https://issues.apache.org/jira/browse/METRON-1103
>             Project: Metron
>          Issue Type: Improvement
>            Reporter: David M. Lyle
>            Priority: Major
>
> Currently, outputPath Functions that partition by time will eventually lead to a 'Too many HDFS files open' IllegalStateException once maxOpenFiles is exceeded. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)