You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Vova Vysotskyi (Jira)" <ji...@apache.org> on 2020/05/18 10:18:00 UTC
[jira] [Created] (DRILL-7741) Columns are missing when using
convert_from function
Vova Vysotskyi created DRILL-7741:
-------------------------------------
Summary: Columns are missing when using convert_from function
Key: DRILL-7741
URL: https://issues.apache.org/jira/browse/DRILL-7741
Project: Apache Drill
Issue Type: Bug
Affects Versions: 1.13.0
Reporter: Vova Vysotskyi
Assignee: Vova Vysotskyi
Fix For: 1.18.0
The query returns wrong results when {{convert_from}} function and additional columns may appear in new batches. Here is a simple test case for this issue:
{code:java}
@Test
public void testConvertFromJson() throws Exception {
String fileName = "table.tsv";
try (BufferedWriter writer = new BufferedWriter(new FileWriter(new File(dirTestWatcher.getRootDir(), fileName)))) {
for (int i = 0; i < JSONRecordReader.DEFAULT_ROWS_PER_BATCH; i++) {
writer.write("{\"id\":\"1\"}\n");
}
writer.write("{\"id\":\"2\",\"v\":[\"abc\"]}");
}
String sql = "SELECT t.m.id AS id, t.m.v[0] v FROM \n" +
"(SELECT convert_from(columns[0], 'json') AS m FROM dfs.`%s`) t\n" +
"where t.m.id='2'";
testBuilder()
.sqlQuery(sql, fileName)
.unOrdered()
.baselineColumns("id", "v")
.baselineValues("2", "abc")
.go();
}
{code}
Currently, theĀ {{"v"}} column is null since {{OK_NEW_SCHEMA}} wasn't returned from the project when the complex writer was used.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)