You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@graphar.apache.org by "Elssky (via GitHub)" <gi...@apache.org> on 2024/10/11 08:44:47 UTC
[PR] feat(docs) how to process graph data with labels [incubator-graphar]
Elssky opened a new pull request, #643:
URL: https://github.com/apache/incubator-graphar/pull/643
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [PR] feat(docs) how to process graph data with labels [incubator-graphar]
Posted by "lixueclaire (via GitHub)" <gi...@apache.org>.
lixueclaire merged PR #643:
URL: https://github.com/apache/incubator-graphar/pull/643
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [PR] feat(docs) how to process graph data with labels [incubator-graphar]
Posted by "Elssky (via GitHub)" <gi...@apache.org>.
Elssky commented on code in PR #643:
URL: https://github.com/apache/incubator-graphar/pull/643#discussion_r1818310654
##########
docs/libraries/cpp/getting-started.md:
##########
@@ -277,6 +277,96 @@ is used to write the results to new generated data chunks.
Please refer to [more examples](examples/out-of-core.md) to learn
about the other available case studies utilizing GraphAr.
+### Processing Graph Data with Labels
+
+As GraphAr supports LPG data, users can add labels for vertices and use related label filtering functions to obtain specified vertices.
+The standard csv format of graph data with labels supported by GraphAr is `id|:LABEL|property_1|property_2`, if a vertex has multiple labels, use ; to separate them. Here is an example.
+
+```csv
+id|:LABEL|name|url
+0|company;public|Kam_Air|http://dbpedia.org/resource/Kam_Air
+1|company|Balkh_Airlines|http://dbpedia.org/resource/Balkh_Airlines
+2|company|Khyber_Afghan_Airlines|http://dbpedia.org/resource/Khyber_Afghan_Airlines
+
+```
+
+When you have the data ready, you can read the file into `arrow::Table` by using arrow IO function.
+
+``` cpp
+ arrow::csv::ReadOptions read_options{};
+ arrow::csv::ParseOptions parse_options{};
+ arrow::csv::ConvertOptions convert_options{};
+
+ parse_options.delimiter = '|';
+
+ auto input = arrow::io::ReadableFile::Open(test_data_dir + "/ldbc/organisation_0_0.csv", arrow::default_memory_pool()).ValueOrDie();
+
+ auto reader = arrow::csv::TableReader::Make(
+ arrow::io::default_io_context(),
+ input,
+ read_options,
+ parse_options,
+ convert_options).ValueOrDie();
+
+ std::shared_ptr<arrow::Table> table;
+ table = reader->Read().ValueOrDie();
+```
+Exporting data to disk is easier.s
Review Comment:
corrected
##########
docs/libraries/cpp/getting-started.md:
##########
@@ -277,6 +277,96 @@ is used to write the results to new generated data chunks.
Please refer to [more examples](examples/out-of-core.md) to learn
about the other available case studies utilizing GraphAr.
+### Processing Graph Data with Labels
+
+As GraphAr supports LPG data, users can add labels for vertices and use related label filtering functions to obtain specified vertices.
+The standard csv format of graph data with labels supported by GraphAr is `id|:LABEL|property_1|property_2`, if a vertex has multiple labels, use ; to separate them. Here is an example.
+
+```csv
+id|:LABEL|name|url
+0|company;public|Kam_Air|http://dbpedia.org/resource/Kam_Air
+1|company|Balkh_Airlines|http://dbpedia.org/resource/Balkh_Airlines
+2|company|Khyber_Afghan_Airlines|http://dbpedia.org/resource/Khyber_Afghan_Airlines
+
+```
+
+When you have the data ready, you can read the file into `arrow::Table` by using arrow IO function.
+
+``` cpp
+ arrow::csv::ReadOptions read_options{};
+ arrow::csv::ParseOptions parse_options{};
+ arrow::csv::ConvertOptions convert_options{};
+
+ parse_options.delimiter = '|';
+
+ auto input = arrow::io::ReadableFile::Open(test_data_dir + "/ldbc/organisation_0_0.csv", arrow::default_memory_pool()).ValueOrDie();
+
+ auto reader = arrow::csv::TableReader::Make(
+ arrow::io::default_io_context(),
+ input,
+ read_options,
+ parse_options,
+ convert_options).ValueOrDie();
+
+ std::shared_ptr<arrow::Table> table;
+ table = reader->Read().ValueOrDie();
+```
+Exporting data to disk is easier.s
+``` cpp
+// write arrow table as chunk parquet
Review Comment:
yes, corrected
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org
Re: [PR] feat(docs) how to process graph data with labels [incubator-graphar]
Posted by "lixueclaire (via GitHub)" <gi...@apache.org>.
lixueclaire commented on code in PR #643:
URL: https://github.com/apache/incubator-graphar/pull/643#discussion_r1818259049
##########
docs/libraries/cpp/getting-started.md:
##########
@@ -277,6 +277,96 @@ is used to write the results to new generated data chunks.
Please refer to [more examples](examples/out-of-core.md) to learn
about the other available case studies utilizing GraphAr.
+### Processing Graph Data with Labels
+
+As GraphAr supports LPG data, users can add labels for vertices and use related label filtering functions to obtain specified vertices.
+The standard csv format of graph data with labels supported by GraphAr is `id|:LABEL|property_1|property_2`, if a vertex has multiple labels, use ; to separate them. Here is an example.
+
+```csv
+id|:LABEL|name|url
+0|company;public|Kam_Air|http://dbpedia.org/resource/Kam_Air
+1|company|Balkh_Airlines|http://dbpedia.org/resource/Balkh_Airlines
+2|company|Khyber_Afghan_Airlines|http://dbpedia.org/resource/Khyber_Afghan_Airlines
+
+```
+
+When you have the data ready, you can read the file into `arrow::Table` by using arrow IO function.
+
+``` cpp
+ arrow::csv::ReadOptions read_options{};
+ arrow::csv::ParseOptions parse_options{};
+ arrow::csv::ConvertOptions convert_options{};
+
+ parse_options.delimiter = '|';
+
+ auto input = arrow::io::ReadableFile::Open(test_data_dir + "/ldbc/organisation_0_0.csv", arrow::default_memory_pool()).ValueOrDie();
+
+ auto reader = arrow::csv::TableReader::Make(
+ arrow::io::default_io_context(),
+ input,
+ read_options,
+ parse_options,
+ convert_options).ValueOrDie();
+
+ std::shared_ptr<arrow::Table> table;
+ table = reader->Read().ValueOrDie();
+```
+Exporting data to disk is easier.s
+``` cpp
+// write arrow table as chunk parquet
+ auto maybe_writer =
+ VertexPropertyWriter::Make(vertex_info, test_data_dir + "/ldbc/parquet/");
+ REQUIRE(!maybe_writer.has_error());
+ auto writer = maybe_writer.value();
+ REQUIRE(writer->WriteTable(table, 0).ok());
+ REQUIRE(writer->WriteVerticesNum(table->num_rows()).ok());
+```
+### Using Label Filtering Functions
+
+By calling the `graphar::VerticesCollection::verticesWithLabel` or `graphar::VerticesCollection::verticesWithMultipleLabels` API, we can specify a certain type of vertices on a certain graph, then filter out all vertices that match one or more labels. Here we introduce several examples of using label filtering.
+
+
+
+```cpp
+ graph_info = ...
+ auto vertex_info = graph_info->GetVertexInfo("organisation");
+ auto labels = vertex_info->GetLabels();
+
+ // query vertices with a specific label
+ auto maybe_filter_vertices_collection =
+ graphar::VerticesCollection::verticesWithLabel(std::string("company"), graph_info, type);
+ ASSERT(!maybe_filter_vertices_collection.has_error());
+ auto filter_vertices = maybe_filter_vertices_collection.value();
+
+ // iterate vertices with label "company"
+ for (auto it = filter_vertices->begin(); it != filter_vertices->end();
+ ++it) {
+ // get a node's all labels
+ auto label_result = it.label();
+ std::cout << "id: " << it.id() << " ";
+ if (!label_result.has_error()) {
+ for (auto label : label_result.value()) {
+ std::cout << label << " ";
+ }
+ }
+ // ...
+ }
+
+ // query vertices based on a query result
Review Comment:
ditto
##########
docs/libraries/cpp/getting-started.md:
##########
@@ -277,6 +277,96 @@ is used to write the results to new generated data chunks.
Please refer to [more examples](examples/out-of-core.md) to learn
about the other available case studies utilizing GraphAr.
+### Processing Graph Data with Labels
+
+As GraphAr supports LPG data, users can add labels for vertices and use related label filtering functions to obtain specified vertices.
+The standard csv format of graph data with labels supported by GraphAr is `id|:LABEL|property_1|property_2`, if a vertex has multiple labels, use ; to separate them. Here is an example.
+
+```csv
+id|:LABEL|name|url
+0|company;public|Kam_Air|http://dbpedia.org/resource/Kam_Air
+1|company|Balkh_Airlines|http://dbpedia.org/resource/Balkh_Airlines
+2|company|Khyber_Afghan_Airlines|http://dbpedia.org/resource/Khyber_Afghan_Airlines
+
+```
+
+When you have the data ready, you can read the file into `arrow::Table` by using arrow IO function.
+
+``` cpp
+ arrow::csv::ReadOptions read_options{};
+ arrow::csv::ParseOptions parse_options{};
+ arrow::csv::ConvertOptions convert_options{};
+
+ parse_options.delimiter = '|';
+
+ auto input = arrow::io::ReadableFile::Open(test_data_dir + "/ldbc/organisation_0_0.csv", arrow::default_memory_pool()).ValueOrDie();
+
+ auto reader = arrow::csv::TableReader::Make(
+ arrow::io::default_io_context(),
+ input,
+ read_options,
+ parse_options,
+ convert_options).ValueOrDie();
+
+ std::shared_ptr<arrow::Table> table;
+ table = reader->Read().ValueOrDie();
+```
+Exporting data to disk is easier.s
Review Comment:
Exporting data to disk is easier.
##########
docs/libraries/cpp/getting-started.md:
##########
@@ -277,6 +277,96 @@ is used to write the results to new generated data chunks.
Please refer to [more examples](examples/out-of-core.md) to learn
about the other available case studies utilizing GraphAr.
+### Processing Graph Data with Labels
+
+As GraphAr supports LPG data, users can add labels for vertices and use related label filtering functions to obtain specified vertices.
+The standard csv format of graph data with labels supported by GraphAr is `id|:LABEL|property_1|property_2`, if a vertex has multiple labels, use ; to separate them. Here is an example.
+
+```csv
+id|:LABEL|name|url
+0|company;public|Kam_Air|http://dbpedia.org/resource/Kam_Air
+1|company|Balkh_Airlines|http://dbpedia.org/resource/Balkh_Airlines
+2|company|Khyber_Afghan_Airlines|http://dbpedia.org/resource/Khyber_Afghan_Airlines
+
+```
+
+When you have the data ready, you can read the file into `arrow::Table` by using arrow IO function.
+
+``` cpp
+ arrow::csv::ReadOptions read_options{};
+ arrow::csv::ParseOptions parse_options{};
+ arrow::csv::ConvertOptions convert_options{};
+
+ parse_options.delimiter = '|';
+
+ auto input = arrow::io::ReadableFile::Open(test_data_dir + "/ldbc/organisation_0_0.csv", arrow::default_memory_pool()).ValueOrDie();
+
+ auto reader = arrow::csv::TableReader::Make(
+ arrow::io::default_io_context(),
+ input,
+ read_options,
+ parse_options,
+ convert_options).ValueOrDie();
+
+ std::shared_ptr<arrow::Table> table;
+ table = reader->Read().ValueOrDie();
+```
+Exporting data to disk is easier.s
+``` cpp
+// write arrow table as chunk parquet
Review Comment:
Could you please format the code in the document, particularly the alignment?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org