You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hugegraph.apache.org by GitBox <gi...@apache.org> on 2022/07/22 06:43:46 UTC

[GitHub] [incubator-hugegraph-toolchain] simon824 opened a new pull request, #312: fix: too many vertices for one time post in SparkLoader

simon824 opened a new pull request, #312:
URL: https://github.com/apache/incubator-hugegraph-toolchain/pull/312

   
   The option `batch.max_vertices_per_batch` default value is 500, if spark/flink default value of `batch_size` is bigger than 500 ,will cause the below exception.
   
   ``` shell
   class java.lang.IllegalArgumentException: Too many vertices for one time post, the maximum number is '500'
     at com.baidu.hugegraph.exception.ServerException.fromResponse(ServerException.java:47)
     at com.baidu.hugegraph.client.RestClient.checkStatus(RestClient.java:93)
     at com.baidu.hugegraph.rest.AbstractRestClient.post(AbstractRestClient.java:231)
     at com.baidu.hugegraph.rest.AbstractRestClient.post(AbstractRestClient.java:211)
     at com.baidu.hugegraph.api.graph.VertexAPI.create(VertexAPI.java:58)
     at com.baidu.hugegraph.driver.GraphManager.addVertices(GraphManager.java:96)
     at com.baidu.hugegraph.loader.spark.HugeGraphSparkLoader.flush(HugeGraphSparkLoader.java:253)
     at com.baidu.hugegraph.loader.spark.HugeGraphSparkLoader.loadRow(HugeGraphSparkLoader.java:150)
     at com.baidu.hugegraph.loader.spark.HugeGraphSparkLoader.lambda$null$0(HugeGraphSparkLoader.java:111)
   ```
   
   closed #311 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hugegraph.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-hugegraph-toolchain] codecov[bot] commented on pull request #312: fix: too many vertices for one time post in SparkLoader

Posted by GitBox <gi...@apache.org>.
codecov[bot] commented on PR #312:
URL: https://github.com/apache/incubator-hugegraph-toolchain/pull/312#issuecomment-1192262178

   # [Codecov](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
   > Merging [#312](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (a2905c7) into [master](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/commit/a5942545fabef0fad46342e2f3370b72a984997c?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (a594254) will **decrease** coverage by `0.33%`.
   > The diff coverage is `2.85%`.
   
   ```diff
   @@             Coverage Diff              @@
   ##             master     #312      +/-   ##
   ============================================
   - Coverage     67.83%   67.49%   -0.34%     
     Complexity      877      877              
   ============================================
     Files            86       86              
     Lines          4004     4024      +20     
     Branches        474      475       +1     
   ============================================
     Hits           2716     2716              
   - Misses         1084     1104      +20     
     Partials        204      204              
   ```
   
   
   | [Impacted Files](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
   |---|---|---|
   | [.../hugegraph/loader/flink/HugeGraphOutputFormat.java](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVnZWdyYXBoLWxvYWRlci9zcmMvbWFpbi9qYXZhL2NvbS9iYWlkdS9odWdlZ3JhcGgvbG9hZGVyL2ZsaW5rL0h1Z2VHcmFwaE91dHB1dEZvcm1hdC5qYXZh) | `0.00% <0.00%> (ø)` | |
   | [...u/hugegraph/loader/spark/HugeGraphSparkLoader.java](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVnZWdyYXBoLWxvYWRlci9zcmMvbWFpbi9qYXZhL2NvbS9iYWlkdS9odWdlZ3JhcGgvbG9hZGVyL3NwYXJrL0h1Z2VHcmFwaFNwYXJrTG9hZGVyLmphdmE=) | `0.00% <0.00%> (ø)` | |
   | [...baidu/hugegraph/loader/mapping/ElementMapping.java](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVnZWdyYXBoLWxvYWRlci9zcmMvbWFpbi9qYXZhL2NvbS9iYWlkdS9odWdlZ3JhcGgvbG9hZGVyL21hcHBpbmcvRWxlbWVudE1hcHBpbmcuamF2YQ==) | `87.83% <100.00%> (ø)` | |
   
   Help us with your feedback. Take ten seconds to tell us [how you rate us](https://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hugegraph.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-hugegraph-toolchain] imbajin merged pull request #312: fix: too many vertices for one time post in spark-loader

Posted by GitBox <gi...@apache.org>.
imbajin merged PR #312:
URL: https://github.com/apache/incubator-hugegraph-toolchain/pull/312


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hugegraph.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org