You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "liugddx (via GitHub)" <gi...@apache.org> on 2023/11/18 14:42:03 UTC
[PR] [regression test](routine load) Add case for `partial_columns` [doris]
liugddx opened a new pull request, #27234:
URL: https://github.com/apache/doris/pull/27234
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression test](routine load) Add case for `partial_columns` [doris]
Posted by "liugddx (via GitHub)" <gi...@apache.org>.
liugddx commented on PR #27234:
URL: https://github.com/apache/doris/pull/27234#issuecomment-1817526804
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression test](routine load) Add case for `partial_columns` [doris]
Posted by "liugddx (via GitHub)" <gi...@apache.org>.
liugddx commented on code in PR #27234:
URL: https://github.com/apache/doris/pull/27234#discussion_r1426247891
##########
regression-test/suites/load_p0/routine_load/test_routine_load.groovy:
##########
@@ -1168,4 +1168,53 @@ suite("test_routine_load","p0") {
j++
}
}
+
+ // partial
+ if (enabled != null && enabled.equalsIgnoreCase("true")) {
+ try {
+
+ sql new File("""${context.file.parent}/ddl/uniq_tbl_partial_drop.sql""").text
+ sql new File("""${context.file.parent}/ddl/uniq_tbl_partial_create.sql""").text
+ sql new File("""${context.file.parent}/ddl/uniq_tbl_partial_init.sql""").text
+
+ sql """
+ CREATE ROUTINE LOAD job_uniq_tbl_partial ON routine_load_uniq_tbl_partial
+ COLUMNS(k00,k01,k02,k03,k04,k05,k06,k07,k08,k09,k10,k11,k12,k13,k14,k15,k16,k17,k18),
Review Comment:
> source
In fact, There are as many fields in the table as there are in the file, I just want to provide a subset of the columns so that partial column updates can be done. I configured it like this, but it will be abnormal. How do I configure the update of some columns?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression test](routine load) Add case for `partial_columns` [doris]
Posted by "CalvinKirs (via GitHub)" <gi...@apache.org>.
CalvinKirs commented on code in PR #27234:
URL: https://github.com/apache/doris/pull/27234#discussion_r1426289727
##########
regression-test/suites/load_p0/routine_load/test_routine_load.groovy:
##########
@@ -1168,4 +1168,53 @@ suite("test_routine_load","p0") {
j++
}
}
+
+ // partial
+ if (enabled != null && enabled.equalsIgnoreCase("true")) {
+ try {
+
+ sql new File("""${context.file.parent}/ddl/uniq_tbl_partial_drop.sql""").text
+ sql new File("""${context.file.parent}/ddl/uniq_tbl_partial_create.sql""").text
+ sql new File("""${context.file.parent}/ddl/uniq_tbl_partial_init.sql""").text
+
+ sql """
+ CREATE ROUTINE LOAD job_uniq_tbl_partial ON routine_load_uniq_tbl_partial
+ COLUMNS(k00,k01,k02,k03,k04,k05,k06,k07,k08,k09,k10,k11,k12,k13,k14,k15,k16,k17,k18),
Review Comment:
I can't see the latest exception, but the error with this Commit is due to a problem with the column mapping. https://github.com/apache/doris/pull/27234/commits/e1cbcdca43de2b35466032e571cd09c3ffe95e3a
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression test](routine load) Add case for `partial_columns` [doris]
Posted by "liugddx (via GitHub)" <gi...@apache.org>.
liugddx commented on PR #27234:
URL: https://github.com/apache/doris/pull/27234#issuecomment-1817745282
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression test](routine load) Add case for `partial_columns` [doris]
Posted by "CalvinKirs (via GitHub)" <gi...@apache.org>.
CalvinKirs commented on code in PR #27234:
URL: https://github.com/apache/doris/pull/27234#discussion_r1426127120
##########
regression-test/suites/load_p0/routine_load/test_routine_load.groovy:
##########
@@ -1168,4 +1168,53 @@ suite("test_routine_load","p0") {
j++
}
}
+
+ // partial
+ if (enabled != null && enabled.equalsIgnoreCase("true")) {
+ try {
+
+ sql new File("""${context.file.parent}/ddl/uniq_tbl_partial_drop.sql""").text
+ sql new File("""${context.file.parent}/ddl/uniq_tbl_partial_create.sql""").text
+ sql new File("""${context.file.parent}/ddl/uniq_tbl_partial_init.sql""").text
+
+ sql """
+ CREATE ROUTINE LOAD job_uniq_tbl_partial ON routine_load_uniq_tbl_partial
+ COLUMNS(k00,k01,k02,k03,k04,k05,k06,k07,k08,k09,k10,k11,k12,k13,k14,k15,k16,k17,k18),
Review Comment:
Please check your column mapping, the number of columns in the source file is greater than the actual number of table columns https://doris.apache.org/docs/data-operate/import/import-scenes/load-data-convert/#:~:text=There%20are%20more%20columns%20in%20the%20source%20file%20than%20in%20the%20table
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org