You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "swwapnily4io (via GitHub)" <gi...@apache.org> on 2024/02/14 10:49:14 UTC
[I] [Bug]: Exception handling on MongoDB output doesnot works & hop server crashes (hop)
swwapnily4io opened a new issue, #3626:
URL: https://github.com/apache/hop/issues/3626
### Apache Hop version?
2.7.0
### Java version?
17
### Operating system
Windows
### What happened?
Adding exception handling on the mongodb output results in server crash.
I tried with 10 inputs, batch size as 1, standard DB configurations and i purposefully connected to read only DB to reproduce the scenario.
The hop GUI / Server Hangs while repeating the below mentioned logs,
2024/02/14 14:52:22 - ID_NumberToString 2.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:22 - CreatePartyCustomerBillingAccount - Pipeline has allocated 17 threads and 14 rowsets.
2024/02/14 14:52:22 - RelatedParty.0 - Starting to run...
2024/02/14 14:52:22 - ID_NumberToString 2.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2024/02/14 14:52:22 - RatingType.0 - Starting to run...
2024/02/14 14:52:22 - MongoDB_customer.0 - Starting to run...
2024/02/14 14:52:22 - ReferredType.0 - Starting to run...
2024/02/14 14:52:22 - Account State.0 - Starting to run...
2024/02/14 14:52:22 - MongoDB_billingAccounts.0 - Starting to run...
2024/02/14 14:52:22 - FailedIndividualRecords.0 - Starting to run...
2024/02/14 14:52:22 - MongoDB_customer.0 - Signaling 'output done' to 0 output rowsets.
2024/02/14 14:52:22 - FailedAccountRecords.0 - Starting to run...
2024/02/14 14:52:22 - AddressLines.0 - Starting to run...
2024/02/14 14:52:22 - MongoDB_customer.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2024/02/14 14:52:22 - MongoDB_individual.0 - Starting to run...
2024/02/14 14:52:22 - IsResponsible.0 - Starting to run...
2024/02/14 14:52:22 - FailedCustomerRecords.0 - Starting to run...
2024/02/14 14:52:22 - RatingType.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:22 - RatingType.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2024/02/14 14:52:22 - Account State.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:22 - Account State.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2024/02/14 14:52:22 - FailedCustomerRecords.0 - Signaling 'output done' to 0 output rowsets.
2024/02/14 14:52:22 - FailedCustomerRecords.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2024/02/14 14:52:22 - IsResponsible.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:22 - IsResponsible.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2024/02/14 14:52:22 - MongoDB_billingAccounts.0 - Signaling 'output done' to 0 output rowsets.
2024/02/14 14:52:22 - MongoDB_billingAccounts.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2024/02/14 14:52:22 - FailedAccountRecords.0 - Signaling 'output done' to 0 output rowsets.
2024/02/14 14:52:22 - FailedAccountRecords.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
2024/02/14 14:52:23 - MongoDB_individual.0 - The following incoming fields will not be inserted/upserted: 'groupType', '@referredType', 'accountName', 'dealerCode', '@type', 'externalID', 'referredTypeIndividual', 'language', 'href_holder', 'billCycleID', 'billingAddress1', 'R_P_type', 'billingType', 'responsible', 'state', 'accountRole', 'CustomerHref_holder', 'billingAccountHref_holder', 'creditCategory', 'taxAuthority', 'accountType', 'addressLineOne', 'href_customer', 'billingAccountType', 'CustomerType', 'referredTypeCustomer', 'discountClass', 'addressLineTwo', 'isRef', 'CustomerStatus', 'name', 'id_num', 'href_billingAccount', 'addressLineThree',
2024/02/14 14:52:23 - MongoDB_individual.0 - Committing a batch...
2024/02/14 14:52:23 - MongoDB_individual.0 - ERROR: An error occurred during write: com.mongodb.MongoSocketOpenException: Exception opening socket
2024/02/14 14:52:23 - MongoDB_individual.0 - Retrying write to mongodb in 10 seconds...
2024/02/14 14:52:23 - AccountTable.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:23 - AccountTable.0 - Finished reading query, closing connection.
2024/02/14 14:52:23 - GenerateID.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:23 - GenerateID.0 - Finished processing (I=0, O=0, R=10, W=10, U=0, E=0)
2024/02/14 14:52:23 - NFT_BSS - Commit on database connection [NFT_BSS]
2024/02/14 14:52:23 - ID_NumberToString.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:23 - ID_NumberToString.0 - Finished processing (I=0, O=0, R=10, W=10, U=0, E=0)
2024/02/14 14:52:23 - manipulate_href_field.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:23 - manipulate_href_field.0 - Finished processing (I=0, O=0, R=10, W=10, U=0, E=0)
2024/02/14 14:52:23 - RelatedParty.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:23 - RelatedParty.0 - Finished processing (I=0, O=0, R=10, W=10, U=0, E=0)
2024/02/14 14:52:23 - ReferredType.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:23 - ReferredType.0 - Finished processing (I=0, O=0, R=10, W=10, U=0, E=0)
2024/02/14 14:52:23 - AddressLines.0 - Signaling 'output done' to 1 output rowsets.
2024/02/14 14:52:23 - AddressLines.0 - Finished processing (I=0, O=0, R=10, W=10, U=0, E=0)
2024/02/14 14:52:23 - NFT_BSS - Connection to database closed!
2024/02/14 14:52:23 - AccountTable.0 - Finished processing (I=10, O=0, R=0, W=10, U=0, E=0)
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 1
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - FailedIndividualRecords.0 - Parent folder exists [file:///C:/Migration]!
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - FailedIndividualRecords.0 - Opening output stream using provider: None
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - FailedIndividualRecords.0 - Opening output stream in encoding: windows-1252
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - FailedIndividualRecords.0 - Opened new file with name [file:///C:/Migration/FailedIndividualRecords_20240214_145233.txt]
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
2024/02/14 14:52:33 - MongoDB_individual.0 - Saving individual documents in current batch...
2024/02/14 14:52:33 - MongoDB_individual.0 - Current batch size: 0
2024/02/14 14:52:33 - MongoDB_individual.0 - Successfully saved 0 documents from the current batch
### Issue Priority
Priority: 3
### Issue Component
Component: Database, Component: Other
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Exception handling on MongoDB output doesnot works & hop server crashes (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva closed issue #3626: [Bug]: Exception handling on MongoDB output doesnot works & hop server crashes
URL: https://github.com/apache/hop/issues/3626
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Exception handling on MongoDB output doesnot works & hop server crashes (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva commented on issue #3626:
URL: https://github.com/apache/hop/issues/3626#issuecomment-5000596650
This has probably been resolved along the way
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org