[jira] [Created] (NIFI-6148) RunMongoAggregation - Add support for allowDiskUse option

["Craig Davidson (JIRA)" <ji...@apache.org>]

Craig Davidson created NIFI-6148:
------------------------------------

             Summary: RunMongoAggregation - Add support for allowDiskUse option
                 Key: NIFI-6148
                 URL: https://issues.apache.org/jira/browse/NIFI-6148
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Core Framework
    Affects Versions: 1.9.0
         Environment: All
            Reporter: Craig Davidson


Currently the RunMongoAggregation processor does not allow the use of the 'allowDiskUse' aggregation option. This is required when aggregation pipeline stages exceed the maximum memory use limit (100MB) and is typically exceeded when working with large datasets particularly when executing $group or $sort operations.

 

Pull Request will submitted in due course to add a mandatory property on the RunMongoAggregation processor (defaulting to false).

 

[https://docs.mongodb.com/manual/reference/command/aggregate/#aggregate-data-using-external-sort]

[http://mongodb.github.io/mongo-java-driver/3.10/javadoc/com/mongodb/client/AggregateIterable.html#allowDiskUse-java.lang.Boolean-]

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)