You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ahmet Altay (Jira)" <ji...@apache.org> on 2019/09/13 16:30:00 UTC
[jira] [Commented] (BEAM-8197) test_big_query_write_without_schema
might be flaky?
[ https://issues.apache.org/jira/browse/BEAM-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929342#comment-16929342 ]
Ahmet Altay commented on BEAM-8197:
-----------------------------------
Another similar issue on `test_big_query_write_new_types` (https://builds.apache.org/job/beam_PostCommit_Python37_PR/30/console)
19:02:42
19:02:42 ======================================================================
19:02:42 FAIL: test_big_query_write_new_types (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests)
19:02:42 ----------------------------------------------------------------------
19:02:42 Traceback (most recent call last):
19:02:42 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/apache_beam/io/gcp/bigquery_write_it_test.py", line 229, in test_big_query_write_new_types
19:02:42 write_disposition=beam.io.BigQueryDisposition.WRITE_EMPTY))
19:02:42 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/apache_beam/pipeline.py", line 427, in __exit__
19:02:42 self.run().wait_until_finish()
19:02:42 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/apache_beam/pipeline.py", line 407, in run
19:02:42 self._options).run(False)
19:02:42 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/apache_beam/pipeline.py", line 420, in run
19:02:42 return self.runner.run_pipeline(self, self._options)
19:02:42 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/apache_beam/runners/direct/test_direct_runner.py", line 51, in run_pipeline
19:02:42 hc_assert_that(self.result, pickler.loads(on_success_matcher))
19:02:42 AssertionError:
19:02:42 Expected: (Expected data is [(0.33, Decimal('10'), b'\xab\xac', datetime.date(3000, 12, 31), datetime.time(23, 59, 59), datetime.datetime(2018, 12, 31, 12, 44, 31), datetime.datetime(2018, 12, 31, 12, 44, 31, 744957, tzinfo=<UTC>), 'POINT(30 10)'), (0.33, None, None, None, None, None, None, None), (None, Decimal('10'), None, None, None, None, None, None), (None, None, b'\xab\xac', None, None, None, None, None), (None, None, None, datetime.date(3000, 12, 31), None, None, None, None), (None, None, None, None, datetime.time(23, 59, 59), None, None, None), (None, None, None, None, None, datetime.datetime(2018, 12, 31, 12, 44, 31), None, None), (None, None, None, None, None, None, datetime.datetime(2018, 12, 31, 12, 44, 31, 744957, tzinfo=<UTC>), None), (None, None, None, None, None, None, None, 'POINT(30 10)')])
19:02:42 but: Expected data is [(0.33, Decimal('10'), b'\xab\xac', datetime.date(3000, 12, 31), datetime.time(23, 59, 59), datetime.datetime(2018, 12, 31, 12, 44, 31), datetime.datetime(2018, 12, 31, 12, 44, 31, 744957, tzinfo=<UTC>), 'POINT(30 10)'), (0.33, None, None, None, None, None, None, None), (None, Decimal('10'), None, None, None, None, None, None), (None, None, b'\xab\xac', None, None, None, None, None), (None, None, None, datetime.date(3000, 12, 31), None, None, None, None), (None, None, None, None, datetime.time(23, 59, 59), None, None, None), (None, None, None, None, None, datetime.datetime(2018, 12, 31, 12, 44, 31), None, None), (None, None, None, None, None, None, datetime.datetime(2018, 12, 31, 12, 44, 31, 744957, tzinfo=<UTC>), None), (None, None, None, None, None, None, None, 'POINT(30 10)')] Actual data is []
19:02:42
> test_big_query_write_without_schema might be flaky?
> ---------------------------------------------------
>
> Key: BEAM-8197
> URL: https://issues.apache.org/jira/browse/BEAM-8197
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-py-core, testing
> Reporter: Ahmet Altay
> Assignee: Pablo Estrada
> Priority: Critical
>
> This failed in py 3.6 post commit test: https://builds.apache.org/job/beam_PostCommit_Python36/434/console
> 18:14:58 ======================================================================
> 18:14:58 FAIL: test_big_query_write_without_schema (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests)
> 18:14:58 ----------------------------------------------------------------------
> 18:14:58 Traceback (most recent call last):
> 18:14:58 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python36/src/sdks/python/apache_beam/io/gcp/bigquery_write_it_test.py", line 269, in test_big_query_write_without_schema
> 18:14:58 write_disposition=beam.io.BigQueryDisposition.WRITE_APPEND))
> 18:14:58 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python36/src/sdks/python/apache_beam/pipeline.py", line 427, in __exit__
> 18:14:58 self.run().wait_until_finish()
> 18:14:58 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python36/src/sdks/python/apache_beam/pipeline.py", line 407, in run
> 18:14:58 self._options).run(False)
> 18:14:58 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python36/src/sdks/python/apache_beam/pipeline.py", line 420, in run
> 18:14:58 return self.runner.run_pipeline(self, self._options)
> 18:14:58 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python36/src/sdks/python/apache_beam/runners/direct/test_direct_runner.py", line 51, in run_pipeline
> 18:14:58 hc_assert_that(self.result, pickler.loads(on_success_matcher))
> 18:14:58 AssertionError:
> 18:14:58 Expected: (Expected data is [(b'xyw', datetime.date(2011, 1, 1), datetime.time(23, 59, 59, 999999)), (b'abc', datetime.date(2000, 1, 1), datetime.time(0, 0)), (b'\xe4\xbd\xa0\xe5\xa5\xbd', datetime.date(3000, 12, 31), datetime.time(23, 59, 59)), (b'\xab\xac\xad', datetime.date(2000, 1, 1), datetime.time(0, 0))])
> 18:14:58 but: Expected data is [(b'xyw', datetime.date(2011, 1, 1), datetime.time(23, 59, 59, 999999)), (b'abc', datetime.date(2000, 1, 1), datetime.time(0, 0)), (b'\xe4\xbd\xa0\xe5\xa5\xbd',
--
This message was sent by Atlassian Jira
(v8.3.2#803003)