You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hugegraph.apache.org by GitBox <gi...@apache.org> on 2022/07/22 06:43:46 UTC
[GitHub] [incubator-hugegraph-toolchain] simon824 opened a new pull request, #312: fix: too many vertices for one time post in SparkLoader
simon824 opened a new pull request, #312:
URL: https://github.com/apache/incubator-hugegraph-toolchain/pull/312
The option `batch.max_vertices_per_batch` default value is 500, if spark/flink default value of `batch_size` is bigger than 500 ,will cause the below exception.
``` shell
class java.lang.IllegalArgumentException: Too many vertices for one time post, the maximum number is '500'
at com.baidu.hugegraph.exception.ServerException.fromResponse(ServerException.java:47)
at com.baidu.hugegraph.client.RestClient.checkStatus(RestClient.java:93)
at com.baidu.hugegraph.rest.AbstractRestClient.post(AbstractRestClient.java:231)
at com.baidu.hugegraph.rest.AbstractRestClient.post(AbstractRestClient.java:211)
at com.baidu.hugegraph.api.graph.VertexAPI.create(VertexAPI.java:58)
at com.baidu.hugegraph.driver.GraphManager.addVertices(GraphManager.java:96)
at com.baidu.hugegraph.loader.spark.HugeGraphSparkLoader.flush(HugeGraphSparkLoader.java:253)
at com.baidu.hugegraph.loader.spark.HugeGraphSparkLoader.loadRow(HugeGraphSparkLoader.java:150)
at com.baidu.hugegraph.loader.spark.HugeGraphSparkLoader.lambda$null$0(HugeGraphSparkLoader.java:111)
```
closed #311
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-hugegraph-toolchain] codecov[bot] commented on pull request #312: fix: too many vertices for one time post in SparkLoader
Posted by GitBox <gi...@apache.org>.
codecov[bot] commented on PR #312:
URL: https://github.com/apache/incubator-hugegraph-toolchain/pull/312#issuecomment-1192262178
# [Codecov](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#312](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (a2905c7) into [master](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/commit/a5942545fabef0fad46342e2f3370b72a984997c?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (a594254) will **decrease** coverage by `0.33%`.
> The diff coverage is `2.85%`.
```diff
@@ Coverage Diff @@
## master #312 +/- ##
============================================
- Coverage 67.83% 67.49% -0.34%
Complexity 877 877
============================================
Files 86 86
Lines 4004 4024 +20
Branches 474 475 +1
============================================
Hits 2716 2716
- Misses 1084 1104 +20
Partials 204 204
```
| [Impacted Files](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../hugegraph/loader/flink/HugeGraphOutputFormat.java](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVnZWdyYXBoLWxvYWRlci9zcmMvbWFpbi9qYXZhL2NvbS9iYWlkdS9odWdlZ3JhcGgvbG9hZGVyL2ZsaW5rL0h1Z2VHcmFwaE91dHB1dEZvcm1hdC5qYXZh) | `0.00% <0.00%> (ø)` | |
| [...u/hugegraph/loader/spark/HugeGraphSparkLoader.java](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVnZWdyYXBoLWxvYWRlci9zcmMvbWFpbi9qYXZhL2NvbS9iYWlkdS9odWdlZ3JhcGgvbG9hZGVyL3NwYXJrL0h1Z2VHcmFwaFNwYXJrTG9hZGVyLmphdmE=) | `0.00% <0.00%> (ø)` | |
| [...baidu/hugegraph/loader/mapping/ElementMapping.java](https://codecov.io/gh/apache/incubator-hugegraph-toolchain/pull/312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVnZWdyYXBoLWxvYWRlci9zcmMvbWFpbi9qYXZhL2NvbS9iYWlkdS9odWdlZ3JhcGgvbG9hZGVyL21hcHBpbmcvRWxlbWVudE1hcHBpbmcuamF2YQ==) | `87.83% <100.00%> (ø)` | |
Help us with your feedback. Take ten seconds to tell us [how you rate us](https://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-hugegraph-toolchain] imbajin merged pull request #312: fix: too many vertices for one time post in spark-loader
Posted by GitBox <gi...@apache.org>.
imbajin merged PR #312:
URL: https://github.com/apache/incubator-hugegraph-toolchain/pull/312
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org