You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/03/21 05:52:01 UTC
[GitHub] [airflow] kurtqq opened a new issue #14919: HiveHook doesn't scale up to tables with more than 32,767 partitions
kurtqq opened a new issue #14919:
URL: https://github.com/apache/airflow/issues/14919
I don't know why previous issue was closed https://github.com/apache/airflow/issues/7963
it wasn't fixed yet
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] kurtqq edited a comment on issue #14919: HiveHook doesn't scale up to tables with more than 32,767 partitions
Posted by GitBox <gi...@apache.org>.
kurtqq edited a comment on issue #14919:
URL: https://github.com/apache/airflow/issues/14919#issuecomment-923243100
> @kurtqq, would you be interested in opening a PR for this? If not, would you be willing to test it (assuming you have an easy way to reproduce it)?
I no longer work with hive but this limitation should be changed.
In general fixing it shouldn't cause any trouble for anyone because this is just about allowing to pass `-1`. So in the worst case the -1 won't work. I think it's safe to just fix it.
I would have done it myself but can't due to working on some other stuff.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal commented on issue #14919: HiveHook doesn't scale up to tables with more than 32,767 partitions
Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #14919:
URL: https://github.com/apache/airflow/issues/14919#issuecomment-1035946210
@pingzh maybe you can help with that issue as you are familiar with partitions in hive
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] jedcunningham commented on issue #14919: HiveHook doesn't scale up to tables with more than 32,767 partitions
Posted by GitBox <gi...@apache.org>.
jedcunningham commented on issue #14919:
URL: https://github.com/apache/airflow/issues/14919#issuecomment-818993172
@kurtqq, would you be interested in opening a PR for this? If not, would you be willing to test it (assuming you have an easy way to reproduce it)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] kurtqq commented on issue #14919: HiveHook doesn't scale up to tables with more than 32,767 partitions
Posted by GitBox <gi...@apache.org>.
kurtqq commented on issue #14919:
URL: https://github.com/apache/airflow/issues/14919#issuecomment-923243100
> @kurtqq, would you be interested in opening a PR for this? If not, would you be willing to test it (assuming you have an easy way to reproduce it)?
I no longer work with hive but this limitation should be removed.
In general fixing it shouldn't cause any trouble for anyone because this is just about allowing to pass `-1`. So in the worst case the -1 won't work. I think it's safe to just fix it.
I would have done it myself but can't due to working on some other stuff.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org