[jira] [Commented] (ASTERIXDB-3340) Incorrect assignment of runtime partition when mixing external-internal data scans with UNION ALL

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ASTERIXDB-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808763#comment-17808763 ] 

ASF subversion and git services commented on ASTERIXDB-3340:
------------------------------------------------------------

Commit 6308c3716b20e9cf91a9c641f92fe0004d67d150 in asterixdb's branch refs/heads/master from Ali Alsuliman
[ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=6308c3716b ]

[ASTERIXDB-3340][EXT] Use sorted cluster locations for external data sources

- user model changes: no
- storage format changes: no
- interface changes: yes

Details:
When specifying the constraints (cluster locations) of
an external data source, use a constraints that is sorted on the node
names (sorted cluster locations) so that it matches the constraints used
when creating an internal dataset. Otherwise, when an internal dataset
is used with an external dataset (e.g. UNION ALL), the query will fail
due to incorrect partition assignment.

Change-Id: I5c7753d53c377d0c5e286b3bfea6b2358abf6d66
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18099
Tested-by: Jenkins <je...@fulliautomatix.ics.uci.edu>
Integration-Tests: Ian Maxon <im...@uci.edu>
Reviewed-by: Ali Alsuliman <al...@gmail.com>
Reviewed-by: Michael Blow <mb...@apache.org>


> Incorrect assignment of runtime partition when mixing external-internal data scans with UNION ALL
> -------------------------------------------------------------------------------------------------
>
>                 Key: ASTERIXDB-3340
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-3340
>             Project: Apache AsterixDB
>          Issue Type: Bug
>          Components: EXT - External data
>            Reporter: Ali Alsuliman
>            Assignee: Ali Alsuliman
>            Priority: Major
>
> To reproduce:
> 1- Create an external link
> 2- Create an external dataset: ext_dataset
> 3- Create an internal dataset: int_dataset
> 4- Create the following view:
> {noformat}
> CREATE OR REPLACE VIEW `view1` (`city` STRING, `country` STRING, `lat` DOUBLE, `lon` DOUBLE, `name` STRING, `type` STRING)
> DEFAULT NULL PRIMARY KEY ( `name` ) NOT ENFORCED AS 
> SELECT name, city, country, geo.lat, geo.lon
> FROM ext_dataset
> WHERE `type` = "br" and geo.lat IS NOT NULL and geo.lon IS NOT NULL
> UNION ALL
> SELECT name, city, country, geo.lat, geo.lon
> FROM int_dataset
> {noformat}
> 5- run the following query:
> {noformat}
> SELECT *
> FROM view1 m, int_dataset h
> WHERE m.x /*+hash-bcast*/ = h.x
> {noformat}
> The query will fail with an internal error.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)