You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "devmadhuu (via GitHub)" <gi...@apache.org> on 2025/02/13 14:25:23 UTC

[PR] HDDS-12325. Initial commit. Ozone Recon - OM DB Incremental update events are not processed correctly. [ozone]

devmadhuu opened a new pull request, #7868:
URL: https://github.com/apache/ozone/pull/7868

   ## What changes were proposed in this pull request?
   This PR is to fix the processing and consume of OM DB events by Recon when Recon was syncing with OM continuously in while loop.
   
   When Recon sync with OM for incremental DB updates in a while loop continuously, It had a bug where OMDBUpdates handler was not clearing the DB update events consumed already in previous iteration in while loop.
   
   ## What is the link to the Apache JIRA
   https://issues.apache.org/jira/browse/HDDS-12325
   
   ## How was this patch tested?
   Patch is tested by running existing Junit and integration tests and running following freon test:
   
   ```
   ozone sh volume create volume1
   ozone sh bucket create --layout FILE_SYSTEM_OPTIMIZED volume1/fso-bucket
   ozone freon omkg -n=200000 -v=volume1 -b=fso-bucket
   ```
   
   **After running above freon load, verified the OM DB `fileTable` count :**
   
   `ozone debug ldb --db=/data/metadata/om.db scan --column_family=fileTable —count  --> 200000`
   <img width="1041" alt="image" src="https://github.com/user-attachments/assets/ebf13966-bcd4-4086-bca5-8f8dca2206f9" />
   
   **Then Verified the Recon OM DB `fileTable` count :**
   `ozone debug ldb --db=/data/metadata/om.db scan --column_family=fileTable —count  --> 200000`
   <img width="1290" alt="image" src="https://github.com/user-attachments/assets/6c22941c-8583-4625-83f8-91fd0f6cb165" />
   
   <img width="1723" alt="image" src="https://github.com/user-attachments/assets/8a60b664-b022-46d9-a833-469cdc2677c4" />
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org


Re: [PR] HDDS-12325. Recon OM DB Incremental update events are not processed correctly. [ozone]

Posted by "adoroszlai (via GitHub)" <gi...@apache.org>.
adoroszlai commented on PR #7868:
URL: https://github.com/apache/ozone/pull/7868#issuecomment-2657161391

   Whoever merges this, please make sure to edit the commit message to match PR title if necessary (because GitHub uses the message from commit by default if the PR has a single one).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org


Re: [PR] HDDS-12325. Recon OM DB Incremental update events are not processed correctly. [ozone]

Posted by "ArafatKhan2198 (via GitHub)" <gi...@apache.org>.
ArafatKhan2198 merged PR #7868:
URL: https://github.com/apache/ozone/pull/7868


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org