You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@graphar.apache.org by "DancyHuang (via GitHub)" <gi...@apache.org> on 2024/10/12 07:00:25 UTC
[D] Edge count num doesnot equals the edge_df.count? [incubator-graphar]
GitHub user DancyHuang created a discussion: Edge count num doesnot equals the edge_df.count?
I read three columns from orc files, and construct a edge_df use: orcfiles_df.select("src", "dst", "attr"), and use GraphWrite to write a graphdata , use putEdgeData(tag, edge_df) to write . but when write successfully, I read the write data with EdgeReader，the edge_count files read num is more bigger than the edge_df.count(). By the way , the vertex_df.count() equals the vertex_count file numbers.
Is there any method that requires special attention when using it, which I might have overlooked?
GitHub link: https://github.com/apache/incubator-graphar/discussions/644
----
This is an automatically sent email for commits@graphar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@graphar.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [D] Edge count num doesnot equals the edge_df.count? [incubator-graphar]
Posted by "DancyHuang (via GitHub)" <gi...@apache.org>.
GitHub user DancyHuang added a comment to the discussion: Edge count num doesnot equals the edge_df.count?
I just use the test file that the column value cannot be null, the edge_df.count equals the edge_count. But when the column values in Edge_df may have some NULL values, occurs the error above.
GitHub link: https://github.com/apache/incubator-graphar/discussions/644#discussioncomment-10921471
----
This is an automatically sent email for commits@graphar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@graphar.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [D] Edge count num doesnot equals the edge_df.count? [incubator-graphar]
Posted by "DancyHuang (via GitHub)" <gi...@apache.org>.
GitHub user DancyHuang closed a discussion: Edge count num doesnot equals the edge_df.count?
I read three columns from orc files, and construct a edge_df use: orcfiles_df.select("src", "dst", "attr"), and use GraphWrite to write a graphdata , use putEdgeData(tag, edge_df) to write . but when write successfully, I read the write data with EdgeReader，the edge_count files read num is more bigger than the edge_df.count(). By the way , the vertex_df.count() equals the numbers in vertex_count file .
Is there any method that requires special attention when using it, which I might have overlooked?
GitHub link: https://github.com/apache/incubator-graphar/discussions/644
----
This is an automatically sent email for commits@graphar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@graphar.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [D] Edge count num doesnot equals the edge_df.count? [incubator-graphar]
Posted by "DancyHuang (via GitHub)" <gi...@apache.org>.
GitHub user DancyHuang closed the discussion with a comment: Edge count num doesnot equals the edge_df.count?
After debugging the write process, it was found that duplicate vertex primary keys (PK) occurred during the definition of the Vertex_DF, leading to duplicate PKs in the vertex indexing. This caused duplicate edges when the internal edge_df joined the edge table with the vertex mapping, resulting in an increased edge count.
It is OK now.
GitHub link: https://github.com/apache/incubator-graphar/discussions/644#discussioncomment-10921721
----
This is an automatically sent email for commits@graphar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@graphar.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [D] Edge count num doesnot equals the edge_df.count? [incubator-graphar]
Posted by "DancyHuang (via GitHub)" <gi...@apache.org>.
GitHub user DancyHuang edited a discussion: Edge count num doesnot equals the edge_df.count?
I read three columns from orc files, and construct a edge_df use: orcfiles_df.select("src", "dst", "attr"), and use GraphWrite to write a graphdata , use putEdgeData(tag, edge_df) to write . but when write successfully, I read the write data with EdgeReader，the edge_count files read num is more bigger than the edge_df.count(). By the way , the vertex_df.count() equals the numbers in vertex_count file .
Is there any method that requires special attention when using it, which I might have overlooked?
GitHub link: https://github.com/apache/incubator-graphar/discussions/644
----
This is an automatically sent email for commits@graphar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@graphar.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [D] Edge count num doesnot equals the edge_df.count? [incubator-graphar]
Posted by "DancyHuang (via GitHub)" <gi...@apache.org>.
GitHub user DancyHuang deleted a comment on the discussion: Edge count num doesnot equals the edge_df.count?
I just use the test file that the column value cannot be null, the edge_df.count equals the edge_count. But when the column values in Edge_df may have some NULL values, occurs the error above.
GitHub link: https://github.com/apache/incubator-graphar/discussions/644#discussioncomment-10921471
----
This is an automatically sent email for commits@graphar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@graphar.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [D] Edge count num doesnot equals the edge_df.count? [incubator-graphar]
Posted by "DancyHuang (via GitHub)" <gi...@apache.org>.
GitHub user DancyHuang closed the discussion with a comment: Edge count num doesnot equals the edge_df.count?
After debugging the write process, it was found that duplicate vertex primary keys (PK) occurred during the definition of the Vertex_DF, leading to duplicate PKs in the vertex indexing. This caused duplicate edges when the internal edge_df joined the edge table with the vertex mapping, resulting in an increased edge count.
It is OK now.
GitHub link: https://github.com/apache/incubator-graphar/discussions/644#discussioncomment-11001866
----
This is an automatically sent email for commits@graphar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@graphar.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [D] Edge count num doesnot equals the edge_df.count? [incubator-graphar]
Posted by "DancyHuang (via GitHub)" <gi...@apache.org>.
GitHub user DancyHuang deleted a comment on the discussion: Edge count num doesnot equals the edge_df.count?
After debugging the write process, it was found that duplicate vertex primary keys (PK) occurred during the definition of the Vertex_DF, leading to duplicate PKs in the vertex indexing. This caused duplicate edges when the internal edge_df joined the edge table with the vertex mapping, resulting in an increased edge count.
It is OK now.
GitHub link: https://github.com/apache/incubator-graphar/discussions/644#discussioncomment-11001866
----
This is an automatically sent email for commits@graphar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@graphar.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org