You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/03/24 03:13:19 UTC
[GitHub] [incubator-doris] trueeyu opened a new issue #3183: It's dangerous
to convert from segmentV1 to v2 when create bitmap index
trueeyu opened a new issue #3183: It's dangerous to convert from segmentV1 to v2 when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183
Current create bitmap index on table with segment v1 format，will auto convert the storage format from v1 to v2, and not notify user 。
If one table has massive data of TB or PB level，It's dangerous，because it will convert all the data。
Current the segment v1 doesn't support bitmapIndex. So i proposal restrict create bitmap index on table with v1 format;
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] trueeyu edited a comment on issue #3183: It's
dangerous to convert from segmentV1 to v2 automatic when create bitmap index
Posted by GitBox <gi...@apache.org>.
trueeyu edited a comment on issue #3183: It's dangerous to convert from segmentV1 to v2 automatic when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183#issuecomment-603162512
> > Nice.
> > FE may not know the segment format of a table. So maybe you need just let the alter task send
> > to BE. And BE will deny to do the alter task if it find that the segment format is v1.
> > After the alter task failed more than 3 times, the job will be cancelled automatically.
>
> It's better to put the storage format as a property in the metadata of the table
#3082 We can think of the storage format as an attribute of the table
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #3183: It's
dangerous to convert from segmentV1 to v2 automatic when create bitmap index
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #3183: It's dangerous to convert from segmentV1 to v2 automatic when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183#issuecomment-603155030
Nice.
FE may not know the segment format of a table. So maybe you need just let the alter task send
to BE. And BE will deny to do the alter task if it find that the segment format is v1.
After the alter task failed more than 3 times, the job will be cancelled automatically.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #3183: It's
dangerous to convert from segmentV1 to v2 automatic when create bitmap index
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #3183: It's dangerous to convert from segmentV1 to v2 automatic when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183#issuecomment-603164500
Yes，But currently there is a transition state and a `__doris_v2` type schema change job, so it may not be easy to make a uniform identification at the table level.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #3183: It's
dangerous to convert from segmentV1 to v2 automatic when create bitmap index
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #3183: It's dangerous to convert from segmentV1 to v2 automatic when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183#issuecomment-603139652
@trueeyu Hi, are you willing to submit a PR for this?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] trueeyu commented on issue #3183: It's dangerous
to convert from segmentV1 to v2 automatic when create bitmap index
Posted by GitBox <gi...@apache.org>.
trueeyu commented on issue #3183: It's dangerous to convert from segmentV1 to v2 automatic when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183#issuecomment-603162512
> > Nice.
> > FE may not know the segment format of a table. So maybe you need just let the alter task send
> > to BE. And BE will deny to do the alter task if it find that the segment format is v1.
> > After the alter task failed more than 3 times, the job will be cancelled automatically.
>
> It's better to put the storage format as a property in the metadata of the table
#3082
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] trueeyu commented on issue #3183: It's dangerous
to convert from segmentV1 to v2 automatic when create bitmap index
Posted by GitBox <gi...@apache.org>.
trueeyu commented on issue #3183: It's dangerous to convert from segmentV1 to v2 automatic when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183#issuecomment-603144189
> @trueeyu Hi, are you willing to submit a PR for this?
OK! I will fix it
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] trueeyu commented on issue #3183: It's dangerous
to convert from segmentV1 to v2 automatic when create bitmap index
Posted by GitBox <gi...@apache.org>.
trueeyu commented on issue #3183: It's dangerous to convert from segmentV1 to v2 automatic when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183#issuecomment-603161581
> Nice.
> FE may not know the segment format of a table. So maybe you need just let the alter task send
> to BE. And BE will deny to do the alter task if it find that the segment format is v1.
> After the alter task failed more than 3 times, the job will be cancelled automatically.
It's better to put the storage format as a property in the metadata of the table
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] trueeyu commented on issue #3183: It's dangerous
to convert from segmentV1 to v2 automatic when create bitmap index
Posted by GitBox <gi...@apache.org>.
trueeyu commented on issue #3183: It's dangerous to convert from segmentV1 to v2 automatic when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183#issuecomment-603169443
> Yes，But currently there is a transition state and a `__doris_v2` type schema change job, so it may not be easy to make a uniform identification at the table level.
This is really a problem，the FE don't know the storage format of the table already created. Let me think about it;
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] gaodayue commented on issue #3183: It's dangerous
to convert from segmentV1 to v2 automatic when create bitmap index
Posted by GitBox <gi...@apache.org>.
gaodayue commented on issue #3183: It's dangerous to convert from segmentV1 to v2 automatic when create bitmap index
URL: https://github.com/apache/incubator-doris/issues/3183#issuecomment-603078922
+1 It makes sense to report error when creating bitmap index on v1 table.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org