[jira] [Commented] (NIFI-13869) Enhance QuerySalesforceObject Processor to Support Querying Deleted Records

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-13869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17891927#comment-17891927 ] 

ASF subversion and git services commented on NIFI-13869:
--------------------------------------------------------

Commit 35219052e13c9a2a2f3a40e125832a872067d1b1 in nifi's branch refs/heads/main from Nicolae Puica
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=35219052e1 ]

NIFI-13869: Enhance QuerySalesforceObject Processor to Support Querying Deleted Records

- Added a new boolean property `Include Deleted Records` to allow users to include deleted (soft-deleted) records in Salesforce queries.
- Modified the query construction to include the `IsDeleted` field and use the `queryAll` API endpoint when `Include Deleted Records` is enabled.
- Updated `SalesforceRestClient` to support the `queryAll` API by adding a new `queryAll` method.
- Ensured backward compatibility by defaulting `Include Deleted Records` to `false`, maintaining existing behavior unless explicitly enabled.
- Updated processor documentation and annotations to reflect the new functionality.
- Adjusted state management to reset state when `Include Deleted Records` property is modified.

Signed-off-by: Pierre Villard <pi...@gmail.com>

This closes #9434.


> Enhance QuerySalesforceObject Processor to Support Querying Deleted Records
> ---------------------------------------------------------------------------
>
>                 Key: NIFI-13869
>                 URL: https://issues.apache.org/jira/browse/NIFI-13869
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>    Affects Versions: 1.25.0
>            Reporter: Nicolae Puica
>            Assignee: Nicolae Puica
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Currently, the {{QuerySalesforceObject}} processor in NiFi is capable of querying active records from Salesforce. However, it lacks the functionality to retrieve deleted records, which is critical for scenarios where we need to track changes or removals of records, especially for audit and compliance purposes. This improvement will add support for querying deleted records (soft deletes in Salesforce), leveraging the {{isDeleted}} field in Salesforce's SOQL queries.
> *Requirements:*
>  # *New Processor Property:*
>  ** Add a Boolean property: {{{}Include Deleted Records{}}}.
>  ** When set to {{{}true{}}}, the processor should include records where the {{isDeleted}} field is {{{}true{}}}.
>  # *SOQL Query Modification:*
>  ** Modify the query structure to include the {{isDeleted}} field in the WHERE clause when querying the object. For example:
>  *** {{{}SELECT Id, Name, IsDeleted FROM ContentVersion WHERE IsDeleted = true{}}}.
>  # *Backward Compatibility:*
>  ** Ensure backward compatibility by keeping the default behavior of excluding deleted records unless the new property is enabled.
> *Acceptance Criteria:*
>  * Users should be able to enable or disable the querying of deleted records via a new processor property.
>  * The processor should return both deleted and non-deleted records when appropriate.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)