You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by vikramahuja1001 <vi...@gmail.com> on 2019/11/26 13:46:12 UTC
[DISCUSSION]: Changes to SHOW METACACHE command
Current result of Show Metacache command:
<http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png>
Proposed result of Show metacache command for the Driver and the Index
Server:
<http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png>
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [DISCUSSION]: Changes to SHOW METACACHE command
Posted by Vikram Ahuja <vi...@gmail.com>.
Hi All,
Please find the attached design document for the same.
Thanks
Vikram Ahuja
On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <ku...@gmail.com>
wrote:
> Hi Vikram,
> What is the background for these changes and what are the benefits this
> will add to carbondata?
> Better to add a detailed design document in this thread.
>
> Thanks
> Kunal Kapoor
>
> On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <vikramahuja8803@gmail.com
> >
> wrote:
>
> > Current result of Show Metacache command:
> > <
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> >
> >
> >
> > Proposed result of Show metacache command for the Driver and the Index
> > Server:
> > <
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> >
> >
> >
> >
> >
> > --
> > Sent from:
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> >
>
Re: [DISCUSSION]: Changes to SHOW METACACHE command
Posted by Vikram Ahuja <vi...@gmail.com>.
Hi Manish,
The default behaviour currently is to only show the details of the database
in which the user is currently logged into. That behavior will remain
unchanged.
Regards
Vikram Ahuja
On Wed, Dec 18, 2019 at 7:25 PM manish gupta <to...@gmail.com>
wrote:
> Hi Vikram
>
> Is the behavior for Show Metacache generic irrespective of database user is
> into? i.e every time user executes this command all database details are
> displayed OR only specific to DB user is currently logged in.
> If it displays for all databases by default, then as a suggestion there
> should be some segregation (can be an option in DDL command) and default
> behavior should display details only for the logged in database.
>
> Regards
> Manish Gupta
>
> On Tue, Dec 17, 2019 at 5:25 PM Vikram Ahuja <vi...@gmail.com>
> wrote:
>
> > Hi All,
> > Please find the attached design document for the same.
> >
> >
> >
> https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing
> >
> > On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <ku...@gmail.com>
> > wrote:
> >
> > > Hi Vikram,
> > > What is the background for these changes and what are the benefits this
> > > will add to carbondata?
> > > Better to add a detailed design document in this thread.
> > >
> > > Thanks
> > > Kunal Kapoor
> > >
> > > On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <
> > vikramahuja8803@gmail.com
> > > >
> > > wrote:
> > >
> > > > Current result of Show Metacache command:
> > > > <
> > > >
> > >
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> > > >
> > > >
> > > >
> > > > Proposed result of Show metacache command for the Driver and the
> Index
> > > > Server:
> > > > <
> > > >
> > >
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sent from:
> > > >
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> > > >
> > >
> >
>
Re: [DISCUSSION]: Changes to SHOW METACACHE command
Posted by manish gupta <to...@gmail.com>.
Hi Vikram
Is the behavior for Show Metacache generic irrespective of database user is
into? i.e every time user executes this command all database details are
displayed OR only specific to DB user is currently logged in.
If it displays for all databases by default, then as a suggestion there
should be some segregation (can be an option in DDL command) and default
behavior should display details only for the logged in database.
Regards
Manish Gupta
On Tue, Dec 17, 2019 at 5:25 PM Vikram Ahuja <vi...@gmail.com>
wrote:
> Hi All,
> Please find the attached design document for the same.
>
>
> https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing
>
> On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <ku...@gmail.com>
> wrote:
>
> > Hi Vikram,
> > What is the background for these changes and what are the benefits this
> > will add to carbondata?
> > Better to add a detailed design document in this thread.
> >
> > Thanks
> > Kunal Kapoor
> >
> > On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <
> vikramahuja8803@gmail.com
> > >
> > wrote:
> >
> > > Current result of Show Metacache command:
> > > <
> > >
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> > >
> > >
> > >
> > > Proposed result of Show metacache command for the Driver and the Index
> > > Server:
> > > <
> > >
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> > >
> > >
> > >
> > >
> > >
> > > --
> > > Sent from:
> > >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> > >
> >
>
Re: [DISCUSSION]: Changes to SHOW METACACHE command
Posted by Kunal Kapoor <ku...@gmail.com>.
Hi Vikram,
I think the proposed change will bring more clarity to the show cache
output.
I have a suggestion, let us have a command which can show the cache
occupied by each of the executors(only applicable for index server).
Something like *show executor metacache*, where the "executor" keyword is
optional.
This command will not show per table, only per node
Example:
Driver - X bytes
Executor1 - Y bytes
Executor2 - Z bytes
Thanks
Kunal Kapoor
On Fri, Jan 3, 2020 at 11:11 AM Akash Nilugal <ak...@gmail.com>
wrote:
> hi,
>
> +1,
> Looks good.
> Can you please update the document with more clear explanation.
>
> Regards,
> Akash
>
> On 2019/12/17 11:55:30, Vikram Ahuja <vi...@gmail.com> wrote:
> > Hi All,
> > Please find the attached design document for the same.
> >
> >
> https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing
> >
> > On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <ku...@gmail.com>
> > wrote:
> >
> > > Hi Vikram,
> > > What is the background for these changes and what are the benefits this
> > > will add to carbondata?
> > > Better to add a detailed design document in this thread.
> > >
> > > Thanks
> > > Kunal Kapoor
> > >
> > > On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <
> vikramahuja8803@gmail.com
> > > >
> > > wrote:
> > >
> > > > Current result of Show Metacache command:
> > > > <
> > > >
> > >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> > > >
> > > >
> > > >
> > > > Proposed result of Show metacache command for the Driver and the
> Index
> > > > Server:
> > > > <
> > > >
> > >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sent from:
> > > >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> > > >
> > >
> >
>
Re: [DISCUSSION]: Changes to SHOW METACACHE command
Posted by Akash Nilugal <ak...@gmail.com>.
hi,
+1,
Looks good.
Can you please update the document with more clear explanation.
Regards,
Akash
On 2019/12/17 11:55:30, Vikram Ahuja <vi...@gmail.com> wrote:
> Hi All,
> Please find the attached design document for the same.
>
> https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing
>
> On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <ku...@gmail.com>
> wrote:
>
> > Hi Vikram,
> > What is the background for these changes and what are the benefits this
> > will add to carbondata?
> > Better to add a detailed design document in this thread.
> >
> > Thanks
> > Kunal Kapoor
> >
> > On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <vikramahuja8803@gmail.com
> > >
> > wrote:
> >
> > > Current result of Show Metacache command:
> > > <
> > >
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> > >
> > >
> > >
> > > Proposed result of Show metacache command for the Driver and the Index
> > > Server:
> > > <
> > >
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> > >
> > >
> > >
> > >
> > >
> > > --
> > > Sent from:
> > > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> > >
> >
>
Re: [DISCUSSION]: Changes to SHOW METACACHE command
Posted by Vikram Ahuja <vi...@gmail.com>.
Hi All,
Please find the attached design document for the same.
https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing
On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <ku...@gmail.com>
wrote:
> Hi Vikram,
> What is the background for these changes and what are the benefits this
> will add to carbondata?
> Better to add a detailed design document in this thread.
>
> Thanks
> Kunal Kapoor
>
> On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <vikramahuja8803@gmail.com
> >
> wrote:
>
> > Current result of Show Metacache command:
> > <
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> >
> >
> >
> > Proposed result of Show metacache command for the Driver and the Index
> > Server:
> > <
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> >
> >
> >
> >
> >
> > --
> > Sent from:
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> >
>
Re: [DISCUSSION]: Changes to SHOW METACACHE command
Posted by Kunal Kapoor <ku...@gmail.com>.
Hi Vikram,
What is the background for these changes and what are the benefits this
will add to carbondata?
Better to add a detailed design document in this thread.
Thanks
Kunal Kapoor
On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <vi...@gmail.com>
wrote:
> Current result of Show Metacache command:
> <
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png>
>
>
> Proposed result of Show metacache command for the Driver and the Index
> Server:
> <
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png>
>
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>