You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by sn...@apache.org on 2023/02/24 04:47:01 UTC
[pinot] 01/02: Fix the issue with ADLSGen2 connector when writing a file
This is an automated email from the ASF dual-hosted git repository.
snlee pushed a commit to branch 0.10.0-adls-fix
in repository https://gitbox.apache.org/repos/asf/pinot.git
commit a05453fb8affcce0a377f156e3fe19df0b195abc
Author: Seunghyun Lee <sn...@apache.org>
AuthorDate: Sun Feb 5 14:31:25 2023 -0800
Fix the issue with ADLSGen2 connector when writing a file
412 error has been introduced after the client version bump.
This is because the behavior change from the ADLSGen2 client.
For more context, please check:
https://github.com/Azure/azure-sdk-for-java/issues/31248
---
.../main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java b/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java
index 06fb122042..e0cd783b56 100644
--- a/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java
+++ b/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java
@@ -572,7 +572,7 @@ public class ADLSGen2PinotFS extends BasePinotFS {
totalBytesRead += bytesRead;
}
// Call flush on ADLS Gen 2
- fileClient.flush(totalBytesRead);
+ fileClient.flush(totalBytesRead, true);
return true;
} catch (DataLakeStorageException | NoSuchAlgorithmException e) {
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org