You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by blrunner <gi...@git.apache.org> on 2015/07/16 07:44:15 UTC
[GitHub] tajo pull request: TAJO-1685: Query fails when using table data wh...
GitHub user blrunner opened a pull request:
https://github.com/apache/tajo/pull/631
TAJO-1685: Query fails when using table data which located on local file system occasionally on fully distributed mode.
I added a message for avoiding users confusion as follows.
```
default> \admin -cluster
Query Master
============
Live Dead Tasks
----- ----- -----
3 0 0
Live QueryMasters
=================
QueryMaster Port Query Heap Status
------------------------- ----- ----- ---------- ----------
tajo-04:28093 28092 0 16000 MB RUNNING
tajo-03:28093 28092 0 16000 MB RUNNING
tajo-05:28093 28092 0 16000 MB RUNNING
Worker
======
Live Dead
----- -----
3 0
Live Workers
============
Worker Port Tasks Mem Disk Heap Status
------------------------- ----- ----- ---------- ---------- ------------ ----------
tajo-04:28091 53960 0 0/1024 0.00/2.00 427/16000 MB RUNNING
tajo-03:28091 34833 0 0/1024 0.00/2.00 418/16000 MB RUNNING
tajo-05:28091 40578 0 0/1024 0.00/2.00 412/16000 MB RUNNING
Dead Workers
============
No Dead Workers
default> \d table1;
table name: default.table1
table uri: file:/home/tajo/hadoop/data.csv
store type: text
number of rows: unknown
volume: 60 B
Options:
'text.delimiter'='|'
schema:
id INT4
name TEXT
score FLOAT4
type TEXT
default> select * from table1;
id, name, score, type
-------------------------------
1, abc, 1.1, a
2, def, 2.3, b
3, ghi, 3.4, c
4, jkl, 4.5, d
5, mno, 5.6, e
(5 rows, 0.029 sec, 60 B selected)
default> select count(*) from table1;
ERROR: The table data should be on all hosts to run TajoWorker or be on distributed file system. : file:/home/tajo/hadoop/data.csv
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/blrunner/tajo TAJO-1685
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tajo/pull/631.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #631
----
commit 351c5aa59650eda0ef4c6f04e13bd6fe3d3590e5
Author: JaeHwa Jung <bl...@apache.org>
Date: 2015-07-16T05:37:22Z
TAJO-1685: Query fails when using table data which located on local file system occasionally on fully distributed mode.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] tajo pull request: TAJO-1685: Print enhanced message when using ta...
Posted by blrunner <gi...@git.apache.org>.
Github user blrunner closed the pull request at:
https://github.com/apache/tajo/pull/631
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] tajo pull request: TAJO-1685: Query fails when using table data wh...
Posted by blrunner <gi...@git.apache.org>.
Github user blrunner commented on the pull request:
https://github.com/apache/tajo/pull/631#issuecomment-122186801
Hi @jihoonson
Replicating local data to all worker don't look well. So I updated the message for exception.
And I also think that supporting local file system is a fundamental solution. But we need to put more efforts to implement it and this patch would be a temporary work before providing local file system.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] tajo pull request: TAJO-1685: Query fails when using table data wh...
Posted by jihoonson <gi...@git.apache.org>.
Github user jihoonson commented on the pull request:
https://github.com/apache/tajo/pull/631#issuecomment-122133119
Rather than doing that, I think the query should be processed by a single machine, mostly tajo master, if we should support local file system as our storage.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] tajo pull request: TAJO-1685: Query fails when using table data wh...
Posted by jihoonson <gi...@git.apache.org>.
Github user jihoonson commented on the pull request:
https://github.com/apache/tajo/pull/631#issuecomment-122132883
I think that replicating local data on ever worker is not a good solution. Users may suffer invalid result.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---