You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@asterixdb.apache.org by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org> on 2016/08/14 11:10:22 UTC
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Wenhai Li has uploaded a new change for review.
https://asterix-gerrit.ics.uci.edu/1077
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch for the remaning issue inconsistent with UTF8.
commit 02bed994f57c6cccc026a058a1d0e9b1e6320bc9
Author: Michael <lw...@yahoo.com>
Date: Sun Aug 14 04:08:46 2016 -0700
Fix the issure-1478.
commit 098e7e55806d372e60c018f5c451a66871f3cde4
Author: Michael <lw...@yahoo.com>
Date: Fri Aug 12 08:04:21 2016 -0700
Add a testCases for issue-1478
The following commits from your working branch will be included:
commit 59f33057a840cb67d2cfef5a8e730a515dca7322
Merge: a253268 bd3a535
Author: Michael <lw...@yahoo.com>
Date: Fri Aug 12 07:46:47 2016 -0700
Merge branch 'master' into chinese
commit a253268e9ded282a8508c4d977b5dab6351408f2
Author: Michael <lw...@yahoo.com>
Date: Fri Aug 12 07:43:45 2016 -0700
Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
7 files changed, 197 insertions(+), 1 deletion(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/1
diff --git a/asterixdb/asterix-app/data/adm-load/utf8.adm b/asterixdb/asterix-app/data/adm-load/utf8.adm
new file mode 100644
index 0000000..2621bc4
--- /dev/null
+++ b/asterixdb/asterix-app/data/adm-load/utf8.adm
@@ -0,0 +1,100 @@
+{"id":"1","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"2","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"3","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"4","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"5","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"6","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"7","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"8","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"9","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"10","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"11","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"12","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"13","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"14","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"15","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"16","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"17","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"18","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"19","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"20","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"21","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"22","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"23","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"24","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"25","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"26","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"27","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"28","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"29","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"30","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"31","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"32","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"33","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"34","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"35","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"36","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"37","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"38","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"39","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"40","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"41","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"42","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"43","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"44","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"45","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"46","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"47","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"48","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"49","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"50","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"51","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"52","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"53","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"54","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"55","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"56","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"57","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"58","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"59","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"60","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"61","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"62","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"63","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"64","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"65","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"66","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"67","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"68","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"69","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"70","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"71","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"72","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"73","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"74","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"75","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"76","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"77","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"78","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"79","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"80","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"81","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"82","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"83","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"84","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"85","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"86","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"87","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"88","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"89","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"90","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"91","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"92","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"93","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"94","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"95","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"96","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"97","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"98","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"99","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"100","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
new file mode 100644
index 0000000..bcd3d46
--- /dev/null
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
@@ -0,0 +1,29 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+drop dataverse test if exists;
+create dataverse test
+use dataverse test;
+
+create type DocType as open {
+ id: string,
+ description: string?
+};
+
+create dataset Doc (DocType)
+primary key id;
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
new file mode 100644
index 0000000..4d4f4e5
--- /dev/null
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
@@ -0,0 +1,30 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+/**
+ *
+ * CSV file loading utf8
+ * Expected result: success
+ *
+ */
+
+use dataverse test;
+
+load dataset Doc
+using localfs
+(("path"="asterix_nc1://data/adm-load/utf8.adm"),("format"="adm"));
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
new file mode 100644
index 0000000..95507bf
--- /dev/null
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+use dataverse test;
+
+let $s := count(
+for $i in dataset Doc
+return $i)
+return $s
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm b/asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
new file mode 100644
index 0000000..29d6383
--- /dev/null
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
@@ -0,0 +1 @@
+100
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml b/asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
index 862ca26..5ee2bb5 100644
--- a/asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
@@ -6555,6 +6555,11 @@
<output-dir compare="Text">adm_binary</output-dir>
</compilation-unit>
</test-case>
+ <test-case FilePath="load">
+ <compilation-unit name="utf8">
+ <output-dir compare="Text">utf8</output-dir>
+ </compilation-unit>
+ </test-case>
</test-group>
<test-group name="hints">
<test-case FilePath="hints">
diff --git a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
index 94333d1..8e166c0 100644
--- a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
+++ b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
@@ -38,6 +38,7 @@
private CharBuffer charBuffer = CharBuffer.allocate(ExternalDataConstants.DEFAULT_BUFFER_SIZE);
private CharsetDecoder decoder;
private boolean done = false;
+ private boolean remaining = false;
public AsterixInputStreamReader(AsterixInputStream in) {
this.in = in;
@@ -75,6 +76,7 @@
charBuffer.clear();
while (charBuffer.position() == 0) {
if (byteBuffer.hasRemaining()) {
+ remaining = true;
decoder.decode(byteBuffer, charBuffer, false);
System.arraycopy(charBuffer.array(), 0, cbuf, offset, charBuffer.position());
if (charBuffer.position() > 0) {
@@ -97,8 +99,13 @@
done = true;
return len;
}
- byteBuffer.position(len);
+ if (remaining) {
+ byteBuffer.position(len + byteBuffer.position());
+ } else {
+ byteBuffer.position(len);
+ }
byteBuffer.flip();
+ remaining = false;
decoder.decode(byteBuffer, charBuffer, false);
System.arraycopy(charBuffer.array(), 0, cbuf, offset, charBuffer.position());
}
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.-> ASTER...
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 5:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2236/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 5
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Michael Blow (Code Review)" <do...@asterixdb.incubator.apache.org>.
Michael Blow has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 8: Code-Review+2
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#4).
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch for the remaning issue inconsistent with UTF8.
1. Fix the issure-1478.
2. Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/4
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 3: Integration-Tests-1
Integration Tests Timed Out
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/315/ : ABORTED
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 1:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2215/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Yingyi Bu (Code Review)" <do...@asterixdb.incubator.apache.org>.
Yingyi Bu has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 4:
(1 comment)
https://asterix-gerrit.ics.uci.edu/#/c/1077/4//COMMIT_MSG
Commit Message:
Line 9: 1. Fix the issure-1478.
"Patch for the remaning issue inconsistent with UTF8." -> "ASTERIXDB-1478: fix the utf8 reader."
"issure-1478" -> "ASTERIXDB-1478".
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: Yes
Change in asterixdb[master]: Patch for the remaining issue inconsistent with UTF8 fields ...
Posted by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#2).
Change subject: Patch for the remaining issue inconsistent with UTF8 fields loading..
......................................................................
Patch for the remaining issue inconsistent with UTF8 fields loading..
commit 02bed994f57c6cccc026a058a1d0e9b1e6320bc9
Author: Michael <lw...@yahoo.com>
Date: Sun Aug 14 04:08:46 2016 -0700
Fix the issure-1478.
commit 098e7e55806d372e60c018f5c451a66871f3cde4
Author: Michael <lw...@yahoo.com>
Date: Fri Aug 12 08:04:21 2016 -0700
Add a testCases for issue-1478
The following commits from your working branch will be included:
commit 59f33057a840cb67d2cfef5a8e730a515dca7322
Merge: a253268 bd3a535
Author: Michael <lw...@yahoo.com>
Date: Fri Aug 12 07:46:47 2016 -0700
Merge branch 'master' into chinese
commit a253268e9ded282a8508c4d977b5dab6351408f2
Author: Michael <lw...@yahoo.com>
Date: Fri Aug 12 07:43:45 2016 -0700
Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
7 files changed, 197 insertions(+), 1 deletion(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/2
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 11:
Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/367/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 11
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "abdullah alamoudi (Code Review)" <do...@asterixdb.incubator.apache.org>.
abdullah alamoudi has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7: Code-Review+2
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#3).
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch for the remaning issue inconsistent with UTF8.
commit 02bed994f57c6cccc026a058a1d0e9b1e6320bc9
Author: Michael <lw...@yahoo.com>
Date: Sun Aug 14 04:08:46 2016 -0700
Fix the issure-1478.
commit 098e7e55806d372e60c018f5c451a66871f3cde4
Author: Michael <lw...@yahoo.com>
Date: Fri Aug 12 08:04:21 2016 -0700
Add a testCases for issue-1478
The following commits from your working branch will be included:
commit 59f33057a840cb67d2cfef5a8e730a515dca7322
Merge: a253268 bd3a535
Author: Michael <lw...@yahoo.com>
Date: Fri Aug 12 07:46:47 2016 -0700
Merge branch 'master' into chinese
commit a253268e9ded282a8508c4d977b5dab6351408f2
Author: Michael <lw...@yahoo.com>
Date: Fri Aug 12 07:43:45 2016 -0700
Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/3
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.-> ASTER...
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 5:
Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/333/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 5
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "abdullah alamoudi (Code Review)" <do...@asterixdb.incubator.apache.org>.
abdullah alamoudi has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7:
Wenhai (or anyone in the review),
What is the code path that the existing code didn't take care of? I am trying to figure that out. I am very interested.
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.-> ASTER...
Posted by "Jianfeng Jia (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jianfeng Jia has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 5:
(1 comment)
https://asterix-gerrit.ics.uci.edu/#/c/1077/5/asterixdb/asterix-external-data/src/test/resources/results/beer.txt
File asterixdb/asterix-external-data/src/test/resources/results/beer.txt:
Line 1453: { "name": "Basil T's Brew Pub and Italian Grill", "city": "Toms River", "state": "New Jersey", "code": "8753", "country": "United States", "phone": "1-732-244-7566", "website": "", "type": "brewery", "updated": "2010-07-22 20:00:20", "description": "", "address": [ "1171 Hooper Avenue" ], "geo": { "accuracy": "RANGE_INTERPOLATED", "lat": 39.9767, "lon": -74.1829 } }
why do we change this file?
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 5
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: Yes
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 3:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2217/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 8:
Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/364/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaining issue inconsistent with UTF8 fields ...
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaining issue inconsistent with UTF8 fields loading..
......................................................................
Patch Set 2:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2216/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello abdullah alamoudi, Michael Blow, Yingyi Bu, Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#11).
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
ASTERIXDB-1478: fix the utf8 reader.
1. Fix the ASTERIXDB-1478.
2. Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/11
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 11
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7: Integration-Tests+1
Integration Tests Successful
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/357/ : SUCCESS
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "abdullah alamoudi (Code Review)" <do...@asterixdb.incubator.apache.org>.
abdullah alamoudi has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 5:
(1 comment)
https://asterix-gerrit.ics.uci.edu/#/c/1077/5/asterixdb/asterix-external-data/src/test/resources/results/beer.txt
File asterixdb/asterix-external-data/src/test/resources/results/beer.txt:
Line 1453: { "name": "Basil T's Brew Pub and Italian Grill", "city": "Toms River", "state": "New Jersey", "code": "8753", "country": "United States", "phone": "1-732-244-7566", "website": "", "type": "brewery", "updated": "2010-07-22 20:00:20", "description": "", "address": [ "1171 Hooper Avenue" ], "geo": { "accuracy": "RANGE_INTERPOLATED", "lat": 39.9767, "lon": -74.1829 } }
> why do we change this file?
I have the same question
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 5
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: Yes
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.-> ASTER...
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 6:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2238/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Jianfeng Jia (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jianfeng Jia has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 3:
(1 comment)
https://asterix-gerrit.ics.uci.edu/#/c/1077/3/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
File asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java:
Line 102: if (remaining) {
I feel add extra if else could solve the problem but still error-prone.
The ideal case may simplify all these `if,else, while` condition to no more than two levels to avoid these kind of problems thoroughly?
Just a thought.
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: Yes
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 8: Integration-Tests+1
Integration Tests Successful
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/364/ : SUCCESS
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 4: Integration-Tests-1
Integration Tests Timed Out
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/317/ : ABORTED
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7: Integration-Tests-1
Integration Tests Timed Out
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/345/ : ABORTED
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Till Westmann (Code Review)" <do...@asterixdb.incubator.apache.org>.
Till Westmann has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 3:
(1 comment)
https://asterix-gerrit.ics.uci.edu/#/c/1077/3//COMMIT_MSG
Commit Message:
Line 7: Patch for the remaning issue inconsistent with UTF8.
Please reduce the message to a single massage for the whole change.
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: Yes
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7:
Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/357/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 9:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2287/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 4:
Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/317/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 11:
Integration Tests Successful
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/367/ : SUCCESS
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 11
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7:
Integration Tests Timed Out
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/354/ : ABORTED
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#7).
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
ASTERIXDB-1478: fix the utf8 reader.
1. Fix the issue-1478.
2. Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/7
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.-> ASTER...
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 6: Integration-Tests-1
Integration Tests Timed Out
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/335/ : ABORTED
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Michael Blow (Code Review)" <do...@asterixdb.incubator.apache.org>.
Michael Blow has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7:
I am retriggering the integration tests on a known-good box- but it looks like there might be failures (or changes in expected results needed) with this change.
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Yingyi Bu (Code Review)" <do...@asterixdb.incubator.apache.org>.
Yingyi Bu has submitted this change and it was merged.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
ASTERIXDB-1478: fix the utf8 reader.
1. Fix the ASTERIXDB-1478.
2. Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1077
Sonar-Qube: Jenkins <je...@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <je...@fulliautomatix.ics.uci.edu>
Reviewed-by: Yingyi Bu <bu...@gmail.com>
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
Approvals:
Yingyi Bu: Looks good to me, approved
Jenkins: Verified; No violations found
diff --git a/asterixdb/asterix-app/data/adm-load/utf8.adm b/asterixdb/asterix-app/data/adm-load/utf8.adm
new file mode 100644
index 0000000..2621bc4
--- /dev/null
+++ b/asterixdb/asterix-app/data/adm-load/utf8.adm
@@ -0,0 +1,100 @@
+{"id":"1","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"2","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"3","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"4","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"5","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"6","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"7","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"8","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"9","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"10","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"11","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"12","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"13","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"14","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"15","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"16","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"17","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"18","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"19","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"20","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"21","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"22","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"23","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"24","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"25","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"26","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"27","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"28","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"29","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"30","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"31","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"32","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"33","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"34","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"35","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"36","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"37","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"38","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"39","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"40","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"41","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"42","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"43","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"44","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"45","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"46","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"47","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"48","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"49","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"50","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"51","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"52","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"53","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"54","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"55","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"56","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"57","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"58","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"59","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"60","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"61","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"62","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"63","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"64","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"65","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"66","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"67","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"68","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"69","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"70","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"71","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"72","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"73","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"74","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"75","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"76","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"77","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"78","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"79","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"80","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"81","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"82","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"83","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"84","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"85","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"86","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"87","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"88","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"89","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"90","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"91","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"92","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"93","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"94","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"95","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"96","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"97","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"98","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"99","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
+{"id":"100","description":"\u968f\u7740\u4eba\u4eec\u4fe1\u7528\u6d3b\u52a8\u7684\u7e41\u8363\u3001\u793e\u4f1a\u5bf9\u4fe1\u7528\u670d\u52a1\u9700\u6c42\u7684\u6fc0\u589e\uff0c\u6784\u5efa\u4e00\u4e2a\u5b8c\u6574"}
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
new file mode 100644
index 0000000..bcd3d46
--- /dev/null
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
@@ -0,0 +1,29 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+drop dataverse test if exists;
+create dataverse test
+use dataverse test;
+
+create type DocType as open {
+ id: string,
+ description: string?
+};
+
+create dataset Doc (DocType)
+primary key id;
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
new file mode 100644
index 0000000..4d4f4e5
--- /dev/null
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
@@ -0,0 +1,30 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+/**
+ *
+ * CSV file loading utf8
+ * Expected result: success
+ *
+ */
+
+use dataverse test;
+
+load dataset Doc
+using localfs
+(("path"="asterix_nc1://data/adm-load/utf8.adm"),("format"="adm"));
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
new file mode 100644
index 0000000..95507bf
--- /dev/null
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+use dataverse test;
+
+let $s := count(
+for $i in dataset Doc
+return $i)
+return $s
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm b/asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
new file mode 100644
index 0000000..29d6383
--- /dev/null
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
@@ -0,0 +1 @@
+100
diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml b/asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
index cf5bda3..749965e 100644
--- a/asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
+++ b/asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
@@ -6560,6 +6560,11 @@
<output-dir compare="Text">adm_binary</output-dir>
</compilation-unit>
</test-case>
+ <test-case FilePath="load">
+ <compilation-unit name="utf8">
+ <output-dir compare="Text">utf8</output-dir>
+ </compilation-unit>
+ </test-case>
</test-group>
<test-group name="hints">
<test-case FilePath="hints">
diff --git a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
index 94333d1..8e166c0 100644
--- a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
+++ b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
@@ -38,6 +38,7 @@
private CharBuffer charBuffer = CharBuffer.allocate(ExternalDataConstants.DEFAULT_BUFFER_SIZE);
private CharsetDecoder decoder;
private boolean done = false;
+ private boolean remaining = false;
public AsterixInputStreamReader(AsterixInputStream in) {
this.in = in;
@@ -75,6 +76,7 @@
charBuffer.clear();
while (charBuffer.position() == 0) {
if (byteBuffer.hasRemaining()) {
+ remaining = true;
decoder.decode(byteBuffer, charBuffer, false);
System.arraycopy(charBuffer.array(), 0, cbuf, offset, charBuffer.position());
if (charBuffer.position() > 0) {
@@ -97,8 +99,13 @@
done = true;
return len;
}
- byteBuffer.position(len);
+ if (remaining) {
+ byteBuffer.position(len + byteBuffer.position());
+ } else {
+ byteBuffer.position(len);
+ }
byteBuffer.flip();
+ remaining = false;
decoder.decode(byteBuffer, charBuffer, false);
System.arraycopy(charBuffer.array(), 0, cbuf, offset, charBuffer.position());
}
diff --git a/asterixdb/asterix-external-data/src/test/resources/results/beer.txt b/asterixdb/asterix-external-data/src/test/resources/results/beer.txt
index bcb3631..5a7983d 100644
--- a/asterixdb/asterix-external-data/src/test/resources/results/beer.txt
+++ b/asterixdb/asterix-external-data/src/test/resources/results/beer.txt
@@ -1450,7 +1450,7 @@
{ "name": "Baron Helles Bock", "abv": 6.4, "ibu": 0.0, "srm": 0.0, "upc": 0, "type": "beer", "brewery_id": "baron_brewing_company", "updated": "2010-07-22 20:00:20", "description": "The Helles-Bock is similar to a traditional Maibock. Bocks are traditionally brewed in the winter / early spring months and are served during the spring / early summer months. The Helles Bock has a copper golden color with a brilliant white head. The body showcases a clean sweet maltiness that is offset by just enough hops to balance it. Very smooth and easy, drinkable yet deceptive at 6.4%.\r\n\r\nAll ingredients for the beer are imported from Germany. Brewed in accordance to the German Beer Purity Law (Reinheitsgebot) of 1516.", "style": "German-Style Heller Bock/Maibock", "category": "German Lager" }
{ "id": "baron_brewing_company-baron_helles_bock", "flags": 0, "expiration": 0, "cas": 244367687683, "rev": 1, "vbid": 27, "dtype": 1 }
"baron_brewing_company-baron_helles_bock"
-{ "name": "Basil T's Brew Pub and Italian Grill", "city": "Toms River", "state": "New Jersey", "code": "8753", "country": "United States", "phone": "1-732-244-7566", "website": "", "type": "rewery", "updated": "2010-07-22 20:00:20", "description": "", "address": [ "1171 Hooper Avenue" ], "geo": { "accuracy": "RANGE_INTERPOLATED", "lat": 39.9767, "lon": -74.1829 } }
+{ "name": "Basil T's Brew Pub and Italian Grill", "city": "Toms River", "state": "New Jersey", "code": "8753", "country": "United States", "phone": "1-732-244-7566", "website": "", "type": "brewery", "updated": "2010-07-22 20:00:20", "description": "", "address": [ "1171 Hooper Avenue" ], "geo": { "accuracy": "RANGE_INTERPOLATED", "lat": 39.9767, "lon": -74.1829 } }
{ "id": "basil_t_s_brew_pub_and_italian_grill", "flags": 0, "expiration": 0, "cas": 244364410882, "rev": 1, "vbid": 20, "dtype": 1 }
"basil_t_s_brew_pub_and_italian_grill"
{ "name": "Nieuw Ligt Grand Cru 2006", "abv": 12.0, "ibu": 0.0, "srm": 0.0, "upc": 0, "type": "beer", "brewery_id": "stadsbrouwerij_de_hemel", "updated": "2010-07-22 20:00:20", "description": "" }
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 12
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7:
Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/354/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Yingyi Bu (Code Review)" <do...@asterixdb.incubator.apache.org>.
Yingyi Bu has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 11: Code-Review+2
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 11
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello abdullah alamoudi, Michael Blow, Yingyi Bu, Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#9).
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
ASTERIXDB-1478: fix the utf8 reader.
1. Fix the issue-1478.
2. Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/9
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.-> ASTER...
Posted by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#5).
Change subject: Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
issue-1478 -> ASTERIXDB-1478.
1. Fix the issue-1478.
2. Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/5
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 5
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7:
Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/345/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello abdullah alamoudi, Michael Blow, Yingyi Bu, Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#10).
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
ASTERIXDB-1478: fix the utf8 reader.
1. Fix the ASTERIXDB-1478.
2. Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/10
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 10
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "abdullah alamoudi (Code Review)" <do...@asterixdb.incubator.apache.org>.
abdullah alamoudi has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7:
(1 comment)
https://asterix-gerrit.ics.uci.edu/#/c/1077/7/asterixdb/asterix-external-data/src/test/resources/results/beer.txt
File asterixdb/asterix-external-data/src/test/resources/results/beer.txt:
What is the difference in this file?
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: Yes
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 11:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2289/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 11
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 10:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2288/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 10
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.-> ASTER...
Posted by "Wenhai Li (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#6).
Change subject: Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
1. Fix the issue-1478.
2. Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/6
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 3:
Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/315/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Yingyi Bu (Code Review)" <do...@asterixdb.incubator.apache.org>.
Hello abdullah alamoudi, Michael Blow, Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/1077
to look at the new patch set (#8).
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
ASTERIXDB-1478: fix the utf8 reader.
1. Fix the issue-1478.
2. Add the utf8 testCases.
Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
---
A asterixdb/asterix-app/data/adm-load/utf8.adm
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/load/utf8/utf8.3.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/results/load/utf8/utf8.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M asterixdb/asterix-external-data/src/test/resources/results/beer.txt
8 files changed, 198 insertions(+), 2 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/1077/8
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.
......................................................................
Patch Set 4:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2219/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 8:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2284/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Michael Blow (Code Review)" <do...@asterixdb.incubator.apache.org>.
Michael Blow has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7: Code-Review+2
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Michael Blow <mb...@apache.org>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Yingyi Bu (Code Review)" <do...@asterixdb.incubator.apache.org>.
Yingyi Bu has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7:
(1 comment)
https://asterix-gerrit.ics.uci.edu/#/c/1077/7/asterixdb/asterix-external-data/src/test/resources/results/beer.txt
File asterixdb/asterix-external-data/src/test/resources/results/beer.txt:
> What is the difference in this file?
@Abdullah, I think the old result is wrong.
In this change, "rewery" is changed to "brewery".
This reminds me ASTERIXDB-1334 where "color" is parsed into "coor".
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: Yes
Change in asterixdb[master]: ASTERIXDB-1478: fix the utf8 reader.
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 7:
Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2256/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No
Change in asterixdb[master]: Patch for the remaning issue inconsistent with UTF8.-> ASTER...
Posted by "Jenkins (Code Review)" <do...@asterixdb.incubator.apache.org>.
Jenkins has posted comments on this change.
Change subject: Patch for the remaning issue inconsistent with UTF8.-> ASTERIXDB-1478: fix the utf8 reader.
......................................................................
Patch Set 6:
Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/335/
--
To view, visit https://asterix-gerrit.ics.uci.edu/1077
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li <lw...@yahoo.com>
Gerrit-Reviewer: Chen Li <ch...@gmail.com>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <ji...@gmail.com>
Gerrit-Reviewer: Till Westmann <ti...@apache.org>
Gerrit-Reviewer: Wail Alkowaileet <wa...@gmail.com>
Gerrit-Reviewer: Yingyi Bu <bu...@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <ba...@gmail.com>
Gerrit-HasComments: No