You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Rahul Challapalli (JIRA)" <ji...@apache.org> on 2015/09/23 01:03:04 UTC
[jira] [Created] (DRILL-3821) refresh table metadata command is
updating the cache every single time
Rahul Challapalli created DRILL-3821:
----------------------------------------
Summary: refresh table metadata command is updating the cache every single time
Key: DRILL-3821
URL: https://issues.apache.org/jira/browse/DRILL-3821
Project: Apache Drill
Issue Type: Bug
Components: Metadata
Reporter: Rahul Challapalli
Assignee: Mehant Baid
Fix For: 1.2.0
git.commit.id.abbrev=3c89b30
The lineitem folder used below contains 50K parquet files. I ran the refresh table metadata command multiple times. After the first run, I expected all subsequent runs to come back very fast since there is nothing to update. But the below times suggest that drill might be actually updating the cache file every single time
{code}
0: jdbc:drill:zk=10.10.100.190:5181> refresh table metadata dfs.`/drill/testdata/tpch100_50000files/lineitem`;
+-------+---------------------------------------------------------------------------------------+
| ok | summary |
+-------+---------------------------------------------------------------------------------------+
| true | Successfully updated metadata for table /drill/testdata/tpch100_50000files/lineitem. |
+-------+---------------------------------------------------------------------------------------+
1 row selected (14.108 seconds)
0: jdbc:drill:zk=10.10.100.190:5181> refresh table metadata dfs.`/drill/testdata/tpch100_50000files/lineitem`;
+-------+---------------------------------------------------------------------------------------+
| ok | summary |
+-------+---------------------------------------------------------------------------------------+
| true | Successfully updated metadata for table /drill/testdata/tpch100_50000files/lineitem. |
+-------+---------------------------------------------------------------------------------------+
1 row selected (11.372 seconds)
0: jdbc:drill:zk=10.10.100.190:5181> refresh table metadata dfs.`/drill/testdata/tpch100_50000files/lineitem`;
+-------+---------------------------------------------------------------------------------------+
| ok | summary |
+-------+---------------------------------------------------------------------------------------+
| true | Successfully updated metadata for table /drill/testdata/tpch100_50000files/lineitem. |
+-------+---------------------------------------------------------------------------------------+
1 row selected (11.177 seconds)
{code}
When I checked the last modified time on the cache file on maprfs, it does indicate that the cache is touched every time the "refresh table metadata" command is run
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)