You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "eldenmoon (via GitHub)" <gi...@apache.org> on 2023/10/10 08:34:48 UTC

[PR] [Fix](row store) Real default value should be used instead of default… [doris]

eldenmoon opened a new pull request, #25230:
URL: https://github.com/apache/doris/pull/25230

   … value in IColumn
   
   Before this PR the default value is not correct, we should we default value in Frontend schema
   ## Proposed changes
   
   Issue Number: close #xxx
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1764355847

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on code in PR #25230:
URL: https://github.com/apache/doris/pull/25230#discussion_r1353990502


##########
gensrc/thrift/Descriptors.thrift:
##########
@@ -62,6 +62,7 @@ struct TSlotDescriptor {
   14: optional bool is_auto_increment = false;
   // subcolumn path info list for semi structure column(variant)
   15: optional list<string> column_paths
+  16: optional string col_default_value

Review Comment:
   variant fields is used which is `column_paths `



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1754697878

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1764372760

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1757181590

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1764562797

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 45.27 seconds
    stream load tsv:          551 seconds loaded 74807831229 Bytes, about 129 MB/s
    stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
    stream load orc:          64 seconds loaded 1101869774 Bytes, about 16 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.8 seconds inserted 10000000 Rows, about 347K ops/s
    storage size: 17162012547 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1767454589

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye merged PR #25230:
URL: https://github.com/apache/doris/pull/25230


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1757647393

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on code in PR #25230:
URL: https://github.com/apache/doris/pull/25230#discussion_r1353991012


##########
be/src/vec/jsonb/serialize.cpp:
##########
@@ -98,11 +102,20 @@ void JsonbSerializeUtil::jsonb_to_block(const DataTypeSerDeSPtrs& serdes, const
     }
     if (filled_columns < dst.columns()) {
         // fill missing slot
-        for (auto& column_type_name : dst) {
+        for (int i = 0; i < dst.columns(); ++i) {
+            const auto& column_type_name = dst.get_by_position(i);
             MutableColumnPtr col = column_type_name.column->assume_mutable();
             if (col->size() < num_rows + 1) {
                 DCHECK(col->size() == num_rows);
-                col->insert_default();
+                if (default_values[i].empty()) {
+                    col->insert_default();
+                } else {
+                    // col->insert_default();
+                    ReadBuffer value(
+                            reinterpret_cast<const unsigned char*>(default_values[i].data()),
+                            default_values[i].size());
+                    static_cast<void>(column_type_name.type->from_string(value, col.get()));

Review Comment:
   from_string is still used in many codes



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1758812169

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1758856989

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 45.38 seconds
    stream load tsv:          555 seconds loaded 74807831229 Bytes, about 128 MB/s
    stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
    stream load orc:          64 seconds loaded 1101869774 Bytes, about 16 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.8 seconds inserted 10000000 Rows, about 347K ops/s
    storage size: 17162002315 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1767454554

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1763892526

   TeamCity be ut coverage result:
    Function Coverage: 36.70% (8229/22425) 
    Line Coverage: 28.84% (65941/228634)
    Region Coverage: 27.55% (34204/124160)
    Branch Coverage: 24.25% (17407/71778)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/16c733f50ec7901415bcff0eb46c7b6de7120311_16c733f50ec7901415bcff0eb46c7b6de7120311/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1757312914

   TeamCity be ut coverage result:
    Function Coverage: 36.24% (8150/22488) 
    Line Coverage: 28.35% (65175/229872)
    Region Coverage: 27.29% (33785/123810)
    Branch Coverage: 23.99% (17215/71770)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/77cd6cb2e2dbed934ec60eda3d0b9aa76fa4b55c_77cd6cb2e2dbed934ec60eda3d0b9aa76fa4b55c/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1757698138

   TeamCity be ut coverage result:
    Function Coverage: 36.23% (8153/22502) 
    Line Coverage: 28.35% (65210/229994)
    Region Coverage: 27.28% (33796/123907)
    Branch Coverage: 23.97% (17214/71804)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/81dd49de55cabf7a392e9fc5d8b694d34e96ecc1_81dd49de55cabf7a392e9fc5d8b694d34e96ecc1/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on code in PR #25230:
URL: https://github.com/apache/doris/pull/25230#discussion_r1353990022


##########
regression-test/suites/point_query_p0/test_point_query.groovy:
##########
@@ -188,10 +188,10 @@ suite("test_point_query") {
       qe_point_select stmt
       qe_point_select stmt
 
-      // sql """
-      //   ALTER table ${tableName} ADD COLUMN new_column1 INT default "0";
-      // """
-      // qe_point_select stmt 
+      sql """
+        ALTER table ${tableName} ADD COLUMN new_column1 INT default "0";

Review Comment:
   it's not deleted, but used



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1754836712

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 45.5 seconds
    stream load tsv:          559 seconds loaded 74807831229 Bytes, about 127 MB/s
    stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
    stream load orc:          64 seconds loaded 1101869774 Bytes, about 16 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.8 seconds inserted 10000000 Rows, about 347K ops/s
    storage size: 17162332201 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on code in PR #25230:
URL: https://github.com/apache/doris/pull/25230#discussion_r1351875381


##########
be/src/service/point_query_executor.h:
##########
@@ -82,6 +82,8 @@ class Reusable {
         return _col_uid_to_idx;
     }
 
+    const std::vector<std::string>& get_col_default_values() const { return _col_default_values; }

Review Comment:
   warning: function 'get_col_default_values' should be marked [[nodiscard]] [modernize-use-nodiscard]
   
   ```suggestion
       [[nodiscard]] const std::vector<std::string>& get_col_default_values() const { return _col_default_values; }
   ```
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on code in PR #25230:
URL: https://github.com/apache/doris/pull/25230#discussion_r1353991012


##########
be/src/vec/jsonb/serialize.cpp:
##########
@@ -98,11 +102,20 @@ void JsonbSerializeUtil::jsonb_to_block(const DataTypeSerDeSPtrs& serdes, const
     }
     if (filled_columns < dst.columns()) {
         // fill missing slot
-        for (auto& column_type_name : dst) {
+        for (int i = 0; i < dst.columns(); ++i) {
+            const auto& column_type_name = dst.get_by_position(i);
             MutableColumnPtr col = column_type_name.column->assume_mutable();
             if (col->size() < num_rows + 1) {
                 DCHECK(col->size() == num_rows);
-                col->insert_default();
+                if (default_values[i].empty()) {
+                    col->insert_default();
+                } else {
+                    // col->insert_default();
+                    ReadBuffer value(
+                            reinterpret_cast<const unsigned char*>(default_values[i].data()),
+                            default_values[i].size());
+                    static_cast<void>(column_type_name.type->from_string(value, col.get()));

Review Comment:
   from_string is still used in many codes



##########
be/src/vec/jsonb/serialize.cpp:
##########
@@ -98,11 +102,20 @@ void JsonbSerializeUtil::jsonb_to_block(const DataTypeSerDeSPtrs& serdes, const
     }
     if (filled_columns < dst.columns()) {
         // fill missing slot
-        for (auto& column_type_name : dst) {
+        for (int i = 0; i < dst.columns(); ++i) {
+            const auto& column_type_name = dst.get_by_position(i);
             MutableColumnPtr col = column_type_name.column->assume_mutable();
             if (col->size() < num_rows + 1) {
                 DCHECK(col->size() == num_rows);
-                col->insert_default();
+                if (default_values[i].empty()) {
+                    col->insert_default();
+                } else {
+                    // col->insert_default();
+                    ReadBuffer value(
+                            reinterpret_cast<const unsigned char*>(default_values[i].data()),
+                            default_values[i].size());
+                    static_cast<void>(column_type_name.type->from_string(value, col.get()));

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1754892056

   TeamCity be ut coverage result:
    Function Coverage: 36.29% (8152/22462) 
    Line Coverage: 28.43% (65190/229304)
    Region Coverage: 27.36% (33786/123480)
    Branch Coverage: 24.03% (17211/71618)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/cb6e6fb1029dd67ea91b8c256c2aca1d54a96cd1_cb6e6fb1029dd67ea91b8c256c2aca1d54a96cd1/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1754951190

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 45.35 seconds
    stream load tsv:          554 seconds loaded 74807831229 Bytes, about 128 MB/s
    stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
    stream load orc:          64 seconds loaded 1101869774 Bytes, about 16 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          29.0 seconds inserted 10000000 Rows, about 344K ops/s
    storage size: 17162311152 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1754854506

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1757722529

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 45.67 seconds
    stream load tsv:          556 seconds loaded 74807831229 Bytes, about 128 MB/s
    stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
    stream load orc:          64 seconds loaded 1101869774 Bytes, about 16 MB/s
    stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
    insert into select:          28.9 seconds inserted 10000000 Rows, about 346K ops/s
    storage size: 17162298360 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1758856076

   TeamCity be ut coverage result:
    Function Coverage: 36.24% (8157/22509) 
    Line Coverage: 28.36% (65309/230275)
    Region Coverage: 27.07% (33828/124944)
    Branch Coverage: 23.90% (17257/72202)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/f76f1385ce8af46c5617514228bb38005cfd08fe_f76f1385ce8af46c5617514228bb38005cfd08fe/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang commented on code in PR #25230:
URL: https://github.com/apache/doris/pull/25230#discussion_r1353981226


##########
regression-test/suites/point_query_p0/test_point_query.groovy:
##########
@@ -188,10 +188,10 @@ suite("test_point_query") {
       qe_point_select stmt
       qe_point_select stmt
 
-      // sql """
-      //   ALTER table ${tableName} ADD COLUMN new_column1 INT default "0";
-      // """
-      // qe_point_select stmt 
+      sql """
+        ALTER table ${tableName} ADD COLUMN new_column1 INT default "0";

Review Comment:
   why delete this SQL



##########
be/src/vec/jsonb/serialize.cpp:
##########
@@ -98,11 +102,20 @@ void JsonbSerializeUtil::jsonb_to_block(const DataTypeSerDeSPtrs& serdes, const
     }
     if (filled_columns < dst.columns()) {
         // fill missing slot
-        for (auto& column_type_name : dst) {
+        for (int i = 0; i < dst.columns(); ++i) {
+            const auto& column_type_name = dst.get_by_position(i);
             MutableColumnPtr col = column_type_name.column->assume_mutable();
             if (col->size() < num_rows + 1) {
                 DCHECK(col->size() == num_rows);
-                col->insert_default();
+                if (default_values[i].empty()) {
+                    col->insert_default();
+                } else {
+                    // col->insert_default();
+                    ReadBuffer value(
+                            reinterpret_cast<const unsigned char*>(default_values[i].data()),
+                            default_values[i].size());
+                    static_cast<void>(column_type_name.type->from_string(value, col.get()));

Review Comment:
   I remember that from_string is deprecated by amorynan.



##########
gensrc/thrift/Descriptors.thrift:
##########
@@ -62,6 +62,7 @@ struct TSlotDescriptor {
   14: optional bool is_auto_increment = false;
   // subcolumn path info list for semi structure column(variant)
   15: optional list<string> column_paths
+  16: optional string col_default_value

Review Comment:
   Will it conflict with variant fields?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1757309027

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 45.34 seconds
    stream load tsv:          560 seconds loaded 74807831229 Bytes, about 127 MB/s
    stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
    stream load orc:          64 seconds loaded 1101869774 Bytes, about 16 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.9 seconds inserted 10000000 Rows, about 346K ops/s
    storage size: 17162429913 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1764494886

   TeamCity be ut coverage result:
    Function Coverage: 36.76% (8219/22359) 
    Line Coverage: 28.85% (65883/228359)
    Region Coverage: 27.57% (34206/124055)
    Branch Coverage: 24.25% (17401/71760)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/f95003cf0bffa35c86cf206d2f884000594db926_f95003cf0bffa35c86cf206d2f884000594db926/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](row store) Real default value should be used instead of default… [doris]

Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #25230:
URL: https://github.com/apache/doris/pull/25230#issuecomment-1763796513

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org