You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@asterixdb.apache.org by AsterixDB Code Review <do...@asterix-gerrit.ics.uci.edu> on 2025/06/24 21:52:50 UTC
Change in asterixdb[ionic]: [NO ISSUE][EXT] Query fails on GCS external delta table
From Peeyush Gupta <pe...@couchbase.com>:
Peeyush Gupta has uploaded this change for review. ( https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19984 )
Change subject: [NO ISSUE][EXT] Query fails on GCS external delta table
......................................................................
[NO ISSUE][EXT] Query fails on GCS external delta table
- user model changes: no
- storage format changes: no
- interface changes: no
Change-Id: Ibd700a0c4e740139630869d98ce7cf52389ea5cf
---
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java
1 file changed, 14 insertions(+), 1 deletion(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/84/19984/1
diff --git a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java
index 10a527e..8328ec3 100644
--- a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java
+++ b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java
@@ -100,6 +100,7 @@
throws AlgebricksException, HyracksDataException {
JobConf conf = new JobConf();
ICcApplicationContext appCtx = (ICcApplicationContext) serviceCtx.getApplicationContext();
+ locationConstraints = getPartitions(appCtx);
configureJobConf(appCtx, conf, configuration);
confFactory = new ConfFactory(conf);
String tableMetadataPath = getTablePath(configuration);
@@ -156,7 +157,6 @@
scanFiles = getScanFiles(scan, engine);
}
LOGGER.info("Number of delta table parquet data files to scan: {}", scanFiles.size());
- locationConstraints = getPartitions(appCtx);
configuration.put(ExternalDataConstants.KEY_PARSER, ExternalDataConstants.FORMAT_DELTA);
distributeFiles(scanFiles, getPartitionConstraint().getLocations().length);
issueWarnings(warnings, warningCollector);
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19984
To unsubscribe, or for help writing mail filters, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-Project: asterixdb
Gerrit-Branch: ionic
Gerrit-Change-Id: Ibd700a0c4e740139630869d98ce7cf52389ea5cf
Gerrit-Change-Number: 19984
Gerrit-PatchSet: 1
Gerrit-Owner: Peeyush Gupta <pe...@couchbase.com>
Gerrit-MessageType: newchange