You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/04/21 16:57:41 UTC
[GitHub] [arrow] raulcd opened a new pull request, #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
raulcd opened a new pull request, #12947:
URL: https://github.com/apache/arrow/pull/12947
As discussed on https://github.com/apache/arrow/pull/12902#issuecomment-1102750381 there is an issue on the Kartothek integration https://github.com/JDASoftwareGroup/kartothek/issues/515
This PR aims to skip the failing tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] ursabot commented on pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
ursabot commented on PR #12947:
URL: https://github.com/apache/arrow/pull/12947#issuecomment-1108322905
Benchmark runs are scheduled for baseline = 65e8863052ec1fea4ff92d0cf54ea0602ac8eebc and contender = a6296cb53d2a2a05d3dac49152a2db7aee8953ba. a6296cb53d2a2a05d3dac49152a2db7aee8953ba is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished :arrow_down:0.0% :arrow_up:0.0%] [ec2-t3-xlarge-us-east-2](https://conbench.ursa.dev/compare/runs/0e427c0222c942108545fd9c5c2e2845...6078fffdad204ac3a9a4c692b9bd299c/)
[Failed] [test-mac-arm](https://conbench.ursa.dev/compare/runs/b2f5c77e76cc4afc9877d4e7a8b0b59c...a3363e99659b423fa87128e97fdf7c1f/)
[Failed :arrow_down:0.0% :arrow_up:0.0%] [ursa-i9-9960x](https://conbench.ursa.dev/compare/runs/5c0e2a47d77a41ee8d1f3022055f518c...31b1f0171e9e479286b9ee282b691eee/)
[Finished :arrow_down:1.01% :arrow_up:0.0%] [ursa-thinkcentre-m75q](https://conbench.ursa.dev/compare/runs/a84a8fb6f55348c799b079e16c1a4ef6...5fa54bd5bf124681a161ce9b6b28d190/)
Buildkite builds:
[Finished] <https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ec2-t3-xlarge-us-east-2/builds/583| `a6296cb5` ec2-t3-xlarge-us-east-2>
[Failed] <https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/builds/571| `a6296cb5` test-mac-arm>
[Failed] <https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-i9-9960x/builds/569| `a6296cb5` ursa-i9-9960x>
[Finished] <https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-thinkcentre-m75q/builds/581| `a6296cb5` ursa-thinkcentre-m75q>
[Finished] <https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ec2-t3-xlarge-us-east-2/builds/582| `65e88630` ec2-t3-xlarge-us-east-2>
[Failed] <https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/builds/570| `65e88630` test-mac-arm>
[Failed] <https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-i9-9960x/builds/568| `65e88630` ursa-i9-9960x>
[Finished] <https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-thinkcentre-m75q/builds/580| `65e88630` ursa-thinkcentre-m75q>
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche closed pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
jorisvandenbossche closed pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
URL: https://github.com/apache/arrow/pull/12947
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #12947:
URL: https://github.com/apache/arrow/pull/12947#issuecomment-1105689319
```
Failed to push updated references, potentially because of credential issues: ['refs/heads/actions-1899-github-test-conda-python-3.7-kartothek-latest', 'refs/tags/actions-1899-github-test-conda-python-3.7-kartothek-latest', 'refs/heads/actions-1899']
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/2203241219```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #12947:
URL: https://github.com/apache/arrow/pull/12947#issuecomment-1105471610
@github-actions crossbow submit test-conda-python-3.7-kartothek-latest
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #12947:
URL: https://github.com/apache/arrow/pull/12947#issuecomment-1105688557
https://issues.apache.org/jira/browse/ARROW-16262
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #12947:
URL: https://github.com/apache/arrow/pull/12947#issuecomment-1105488174
The list of failed tests previous to the PR:
```
=========================== short test summary info ============================
FAILED tests/io/dask/bag/test_read.py::test_datetime_predicate_with_dates_as_object[4-dataframe-==-date-partition_on0]
FAILED tests/io/dask/bag/test_read.py::test_datetime_predicate_with_dates_as_object[4-dataframe->=-date-partition_on0]
FAILED tests/io/dask/bag/test_read.py::test_datetime_predicate_with_dates_as_object[4-metapartition-==-date-partition_on0]
FAILED tests/io/dask/bag/test_read.py::test_datetime_predicate_with_dates_as_object[4-metapartition->=-date-partition_on0]
FAILED tests/io/dask/dataframe/test_read.py::test_datetime_predicate_with_dates_as_object[4-==-date-partition_on0]
FAILED tests/io/dask/dataframe/test_read.py::test_datetime_predicate_with_dates_as_object[4->=-date-partition_on0]
FAILED tests/io/dask/delayed/test_read.py::test_datetime_predicate_with_dates_as_object[4-dataframe-==-date-partition_on0]
FAILED tests/io/dask/delayed/test_read.py::test_datetime_predicate_with_dates_as_object[4-dataframe->=-date-partition_on0]
FAILED tests/io/dask/delayed/test_read.py::test_datetime_predicate_with_dates_as_object[4-metapartition-==-date-partition_on0]
FAILED tests/io/dask/delayed/test_read.py::test_datetime_predicate_with_dates_as_object[4-metapartition->=-date-partition_on0]
FAILED tests/io/dask/delayed/test_read.py::test_datetime_predicate_with_dates_as_object[4-table-==-date-partition_on0]
FAILED tests/io/dask/delayed/test_read.py::test_datetime_predicate_with_dates_as_object[4-table->=-date-partition_on0]
FAILED tests/io/eager/test_read.py::test_datetime_predicate_with_dates_as_object[4-dataframe-==-date-partition_on0]
FAILED tests/io/eager/test_read.py::test_datetime_predicate_with_dates_as_object[4-dataframe->=-date-partition_on0]
FAILED tests/io/eager/test_read.py::test_datetime_predicate_with_dates_as_object[4-metapartition-==-date-partition_on0]
FAILED tests/io/eager/test_read.py::test_datetime_predicate_with_dates_as_object[4-metapartition->=-date-partition_on0]
FAILED tests/io/eager/test_read.py::test_datetime_predicate_with_dates_as_object[4-table-==-date-partition_on0]
FAILED tests/io/eager/test_read.py::test_datetime_predicate_with_dates_as_object[4-table->=-date-partition_on0]
FAILED tests/io/iter/test_read.py::test_datetime_predicate_with_dates_as_object[4-dataframe-==-date-partition_on0]
FAILED tests/io/iter/test_read.py::test_datetime_predicate_with_dates_as_object[4-dataframe->=-date-partition_on0]
FAILED tests/io/iter/test_read.py::test_datetime_predicate_with_dates_as_object[4-metapartition-==-date-partition_on0]
FAILED tests/io/iter/test_read.py::test_datetime_predicate_with_dates_as_object[4-metapartition->=-date-partition_on0]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser0-df3-read_kwargs3]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser0-df4-read_kwargs4]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser1-df3-read_kwargs3]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser1-df4-read_kwargs4]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser2-df3-read_kwargs3]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser2-df4-read_kwargs4]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser3-df3-read_kwargs3]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser3-df4-read_kwargs4]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser6-df3-read_kwargs3]
FAILED tests/serialization/test_dataframe.py::test_predicate_pushdown[True-serialiser6-df4-read_kwargs4]
FAILED tests/serialization/test_parquet.py::test_predicate_evaluation_date[1-input_values0-date]
FAILED tests/serialization/test_parquet.py::test_predicate_evaluation_date[1-input_values1-date]
FAILED tests/serialization/test_parquet.py::test_predicate_evaluation_date[1-input_values2-date]
FAILED tests/serialization/test_parquet.py::test_predicate_evaluation_date[5-input_values0-date]
FAILED tests/serialization/test_parquet.py::test_predicate_evaluation_date[5-input_values1-date]
FAILED tests/serialization/test_parquet.py::test_predicate_evaluation_date[5-input_values2-date]
FAILED tests/serialization/test_parquet.py::test_predicate_evaluation_date[None-input_values0-date]
FAILED tests/serialization/test_parquet.py::test_predicate_evaluation_date[None-input_values1-date]
FAILED tests/serialization/test_parquet.py::test_predicate_evaluation_date[None-input_values2-date]
FAILED tests/serialization/test_parquet.py::test_date_as_object[None] - TypeE...
FAILED tests/serialization/test_parquet.py::test_date_as_object[1] - TypeErro...
= 43 failed, 5243 passed, 416 skipped, 1 deselected, 41 xfailed, 1 xpassed, 72895 warnings in 1067.10s (0:17:47) =
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #12947:
URL: https://github.com/apache/arrow/pull/12947#issuecomment-1106182160
@github-actions crossbow submit test-conda-python-3.7-kartothek-latest
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #12947:
URL: https://github.com/apache/arrow/pull/12947#issuecomment-1106196484
Revision: 8ccdbe2ff162f1e7dedbf07f536c829c59ac8bb1
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1903](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1903)
|Task|Status|
|----|------|
|test-conda-python-3.7-kartothek-latest|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1903-github-test-conda-python-3.7-kartothek-latest)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #12947:
URL: https://github.com/apache/arrow/pull/12947#issuecomment-1105503700
I have just validated locally while the CI gets available jobs:
```
$ time docker-compose run --rm conda-python-kartothek
...
tests/utils/test_ktk_adapters.py::test_get_partition_dataframe[False-False]
tests/utils/test_ktk_adapters.py::test_get_partition_dataframe[False-True]
/kartothek/tests/utils/test_ktk_adapters.py:165: DeprecatedWarning: load_partition_indices is deprecated as of 5.3 and will be removed in 6.0. The `load_partition_indices` keyword is deprecated and will be removed.
ds = ds.load_partition_indices()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
===================== 4680 passed, 408 skipped, 615 deselected, 41 xfailed, 1 xpassed, 801777 warnings in 903.95s (0:15:03) ======================
real 18m33.827s
user 0m0.338s
sys 0m0.359s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #12947: ARROW-16262: [CI][Integration] Skip failing tests from kartothek integration
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #12947:
URL: https://github.com/apache/arrow/pull/12947#issuecomment-1106366838
@jorisvandenbossche even though we are skipping more tests than the ones that failed (as seen on the logs) I think this is better than fully removing the kartothek integration. There are some job failures but don't seem to be related to the change. Let me know how can I trigger a new run of the failed jobs if you think it's necessary.
I think this is ready for review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org