You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by Jhon Anderson Cardenas Diaz <jh...@gmail.com> on 2018/07/04 21:56:03 UTC
Zeppelin starting time - tied to the load of notebooks loading
Hi!.
Right now the Zeppelin starting time depends directly on the time it takes
to load the notebooks from the repository. If the user has a lot of
notebooks (ex more than 1000), the starting time starts to be too long.
Is there some plan to re implement this notebooks loading so that it is
done asynchronously?. Or this is not a problem for zeppelin users.
Thanks.
Re: [EXTERNAL] Re: Zeppelin starting time - tied to the load of
notebooks loading
Posted by Steven Kirtzic <st...@statefarm.com>.
Thanks Paul. I was unaware that there was an actual process for getting off it and have been asking for quite a while how to get off it and you are the first person to provide me with that info, so you can imagine my frustration. Apologies to Moon on this. Thanks!
From: Paul Brenner <pb...@placeiq.com>
Reply-To: "users@zeppelin.apache.org" <us...@zeppelin.apache.org>
Date: Monday, July 9, 2018 at 10:23 AM
To: "users@zeppelin.apache.org" <us...@zeppelin.apache.org>
Subject: Re: [EXTERNAL] Re: Zeppelin starting time - tied to the load of notebooks loading
[https://share.polymail.io/v2/z/a/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi2jHeAv9osgw1nZo9oSrPFctNa5Q3A7sW63FNS-B9O0sobSETrHIABe7DNpFAXJOO6mLDAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4qaYeO_qg9SrlSN3u8fkTco=.png]
Incase anyone else is trying to leave the mailing list, the way to do it is to go to this page:
http://zeppelin.apache.org/community.html<https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPpF-oJ8FbqEEcN_nYw9EuVolm4Cq1hb9klPLo-A3yZ-W-hJCApTNQPcwPr7YI1CLK1u8=>
Then on the right where it has mailing lists find "unsubscribe" right after "Users". Click that unsubscribe link and send the email it pre-populates for you. Yelling at Moon is not the preferred approach.
[https://ci3.googleusercontent.com/proxy/tFn1I-GEOnccUtv8DHHEc49-6g3x3CbuQKzbfl2Z1BObEy0Qz6QebJimpP96TK3Za5MXwXTuwBZaobKp22nYAG3NdxAC0Q=s0-d-e1-ft#https://marketing.placeiq.net/images/placeiq.png]<https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPqU2vedRboExXP_iXw9YmV439U_iUy2Jvmj5KloMGp_w=>
Paul Brenner
[https://ci4.googleusercontent.com/proxy/490PXYv9O6OiIp_DL4vuabJqVn53fMon5xNYZdftCVea9ySR2LcFDHe6Cdntb2G68uDAuA6FgLny8wKWLFWpsrPAt_FtLaE=s0-d-e1-ft#https://marketing.placeiq.net/images/twitter1.png]<https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U6vPtBDpF0cNebUj8knGYVx7nQH--s44p3fdzk5nUPkq_w2>
[https://ci3.googleusercontent.com/proxy/fztHf1lRKLQYcAxebqfp2PYXCwVap3GobHVIbyp0j3NcuJOY16bUAZBibVOFf-fd1GsiuhrOfYy6dSwhlCwWU8ZUlw9OX5I=s0-d-e1-ft#https://marketing.placeiq.net/images/facebook.png]<https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpRoExXNObWy5coF4s712m3ibdAsKAAGANb8_iidW0-hmfthQo=>
[https://ci5.googleusercontent.com/proxy/H26ThD7R6DOqxoLTgzi6k5SMrHoF2Tj44xI_7XlD9KfOIiGwe1WIMc5iQBxUBA9EuIyJMdaRXrhZTOrnkrn8O9Rf1FP9UQU=s0-d-e1-ft#https://marketing.placeiq.net/images/linkedin.png]<https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpbqEFZM-3QzpcoF4s75Gq7mrNnmLPx4BW_aviiu3WvdLha9f__odR294zZfQ==>
SR. DATA SCIENTIST
(217) 390-3033
[PlaceIQ:CES 2018]<https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrlu_MtcZsUNTNezQ0ZcoF4s7tTXn3f9Aj-jk6wa9e_S3xdSlhgbaC5L6ZpVruSeONLbGyeyXT6_WrBLpSkD21aWJMGCfHRX8ol2fzL0H1ZNvYIbF5__y>
On Mon, Jul 9th, 2018 at 10:57 AM, Steven Kirtzic <st...@statefarm.com> wrote:
Moon,
For the love of God, I have been requesting to be deleted from this mailing list for over a year now. PLEASE get me off this list.
-Steven
From: moon soo Lee <le...@gmail.com>>
Reply-To: "users@zeppelin.apache.org<ma...@zeppelin.apache.org>" <us...@zeppelin.apache.org>>
Date: Thursday, July 5, 2018 at 5:08 AM
To: "users@zeppelin.apache.org<ma...@zeppelin.apache.org>" <us...@zeppelin.apache.org>>
Subject: [EXTERNAL] Re: Zeppelin starting time - tied to the load of notebooks loading
I also prefer approach 1 more.
https://issues.apache.org/jira/browse/ZEPPELIN-2619 is a related issue.
Thanks,
moon
On Thu, Jul 5, 2018 at 9:40 AM Jeff Zhang <zj...@gmail.com>> wrote:
This is a known issue. I also thought about it for a while. Actually, starting zeppelin don't need to load all notes, just loading the metadata (note name) is enough. However, the note metadata is stored in note file if you using filesystem to store notes. So whatever, you have to read the note.json for the metadata. I have 2 approaches in my mind for this issue.
1. Use the note name as the note file name instead of using note.json for all notes. This require changes in the notebookrepo, also cause effort and risk when user upgrade zeppelin.
2. Store the metadata in another place. So user can just read the metadata when restarting zeppelin. But in this case we have to make sure the consistency between the notebookrepp and metadata store.
Personally I prefer using approach 1 as long term solution. Welcome any comments.
Mohit Jaggi <mo...@gmail.com>>于2018年7月5日周四 上午6:32写道：
I have noticed it too and it is annoying. However, asynchronous loading might not be the solution you want. I want to choose the notebook to open from the list Z shows me. So I am blocked on it anyway. I think that the loading is asynchronous anyway because several times I have seen that I have to keep reloading my page until my notebook list appears.
What we need is for Z to load the metadata for notebooks (like names etc) quickly. Optimizing that code might help.
> On Jul 4, 2018, at 2:56 PM, Jhon Anderson Cardenas Diaz <jh...@gmail.com>> wrote:
>
> Hi!.
>
> Right now the Zeppelin starting time depends directly on the time it takes to load the notebooks from the repository. If the user has a lot of notebooks (ex more than 1000), the starting time starts to be too long.
>
> Is there some plan to re implement this notebooks loading so that it is done asynchronously?. Or this is not a problem for zeppelin users.
>
> Thanks.
Re: [EXTERNAL] Re: Zeppelin starting time - tied to the load of
notebooks loading
Posted by Paul Brenner <pb...@placeiq.com>.
Incase anyone else is trying to leave the mailing list, the way to do it is to go to this page:
http://zeppelin.apache.org/community.html ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPpF-oJ8FbqEEcN_nYw9EuVolm4Cq1hb9klPLo-A3yZ-W-hJCApTNQPcwPr7YI1CLK1u8= )
Then on the right where it has mailing lists find "unsubscribe" right after "Users". Click that unsubscribe link and send the email it pre-populates for you. Yelling at Moon is not the preferred approach.
( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPqU2vedRboExXP_iXw9YmV439U_iUy2Jvmj5KloMGp_w= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPqU2vedRboExXP_iXw9YmV439U_iUy2Jvmj5KloMGp_w= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPqU2vedRboExXP_iXw9YmV439U_iUy2Jvmj5KloMGp_w= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U6vPtBDpF0cNebUj8knGYVx7nQH--s44p3fdzk5nUPkq_w2 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U6vPtBDpF0cNebUj8knGYVx7nQH--s44p3fdzk5nUPkq_w2 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U6vPtBDpF0cNebUj8knGYVx7nQH--s44p3fdzk5nUPkq_w2 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpRoExXNObWy5coF4s712m3ibdAsKAAGANb8_iidW0-hmfthQo= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpRoExXNObWy5coF4s712m3ibdAsKAAGANb8_iidW0-hmfthQo= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpbqEFZM-3QzpcoF4s75Gq7mrNnmLPx4BW_aviiu3WvdLha9f__odR294zZfQ== ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpbqEFZM-3QzpcoF4s75Gq7mrNnmLPx4BW_aviiu3WvdLha9f__odR294zZfQ== ) SR. DATA SCIENTIST (217) 390-3033
( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPqU2vedRboExXP_iXw9YmV9QktjD52ucm06qu_Bi9bPS6mbSqlQDaG9bjaNZStDzXPqCKyfuAY5fvlD_pSF23iPTcKyWEAhjJuoQZ3-7QBLmgw3U_msVxS9jsn2kH3p3Uh7uoBqNXvVCNU9fa4XJHkSpSO7hA ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TckltSrn0v1ogv_0_hW_drylm7S0hgjcFoj9btYRuCDXPanE2P2Mf42rlzfyXAP316XAaW2JGRfLpM7GhTPEK5ZwW3DH468Mhelg ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TckltSrn0v1ogv_0_hW_drylm7S0hgjcFoj9btYRuCDXPanE2P2Mf42rlzfyXAP316XAaW2JGRfLpM7GhTPEK5ZwW3DH468Mhelg ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TckltSrn0v1ogv_0_hW_drylm7S0hgjcFoj9btYRuCDXPanE2P2Mf42rlzfyXAP316XAaW2JGRfLpM7GhTPEK5ZwW3DH468Mhelg ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TckltSrn0v1ogv_0_hW_drylm7S0hgjcFoj9btYRuCDXPanE2P2Mf42rlzfyXAP316XAaW2JGRfLpM7GhTPEK5ZwW3DH468Mhelg ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TskktCrm0v1khP3y-Qa1Yfb-if2ghgjMDJr2bd0RpTjXMqfKyeiMd4313j_1EED1zemdcXuYGRvGs851t08wpqUxk0E-EPQa7aMm ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6Tskksyrn2f15jf3i6R2tIvu8gfe32RnXGtb6ZMxLvjyRfKfDz-yXZIr1mjjhEEf007CEf3yCBhyHuIBdlu7XSKXzn24i04V1Rc7gmyfhwUP8VcbxH-0yp5LLCNX5 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6Tskksyrn2f15jf3i6R2tIvu8gfe32RnXGtb6ZMxLvjyRfKfDz-yXZIr1mjjhEEf007CEf3yCBhyHuIBdlu7XSKXzn24i04V1Rc7gmyfhwUP8VcbxH-0yp5LLCNX5 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6Tskksyrn2f15jf3i6R2tIvu8gfe32RnXGtb6ZMxLvjyRfKfDz-yXZIr1mjjhEEf007CEf3yCBhyHuIBdlu7XSKXzn24i04V1Rc7gmyfhwUP8VcbxH-0yp5LLCNX5 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6Tskksyrn2f15jf3i6R2tIvu8gfe32RnXGtb6ZMxLvjyRfKfDz-yXZIr1mjjhEEf007CEf3yCBhyHuIBdlu7XSKXzn24i04V1Rc7gmyfhwUP8VcbxH-0yp5LLCNX5 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6Tskksyrn2f15jf3i6R2tIvu8gfe32RnXGtb6ZMxLvjyRfKfDz-yXZIr1mjjhEEf007CEf3yCBhyHuIBdlu7XSKXzn24i04V1Rc7gmyfhwUP8VcbxH-0yp5LLCNX5 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrlu_MtcZsUNTNezQ0ZcoF4s7y2q1i6ZgjvKsyBWobrySi_qxhgzcBtbDadFItD6bIaPVlM2KZ43qnDfiE0bu16jSa3yGLwrFo5NX3rL3DPOtzm4_jI02XdjotmUW39nAneefD-33D8RWZdkSQnMZWsxBvGM5Q6Ie59kMsogTP80fZkmr0bzA58xDqPFralQ= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6Tskkvyrm2f15jf3i6R2tIvO8hOqwkR_MUpf7YtlIuCGUfK_JzeyJfIrhljjlWAPq1qWZeGeZHVTdv5VcluLFFuCm3XkrjIw9QcL2gG8bz8OaJ5qhn6-EoUresPiVN1XkiA== ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6Tskltyrk3P19ifms4RW3Zv-0xfai2QySE5T3YMxVviDXNafT2KSMfofzgCL0RAP306iIbXyEHhyFXhLBjnX94j3zIwn-V_Bc9A== ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TskltSrm3f15jf3i6R2tIvi9nOurkBjcGoi5bdlStSObI62K2KSCYozznTLkT0v70a2DeSWEFh_PpIha3KLQDfW3gn4vkoFmTd72xGkQ2NXGg_euDaHqC4cOed0qSXcHXoBZrmxoa7UEv8cCspAwBrXBhKHig-6aGu95hIk5vmDhHqsH3OWTb9GhvsRB-XAoSYRCE8dKicImLWo55U2RbENCP9qayWh-UcNZkE6sM1pN9iHzHIexequsNwg= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TskltSrm3f15jf3i6R2tIvi9nOurkBjcGoi5bdlStSObI62K2KSCYozznTLkT0v70a2DeSWEFh_PpIha3KLQDfW3gn4vkoFmTd72xGkQ2NXGg_euDaHqC4cOed0qSXcHXoBZrmxoa7UEv8cCspAwBrXBhKHig-6aGu95hIk5vmDhHqsH3OWTb9GhvsRB-XAoSYRCE8dKicImLWo55U2RbENCP9qayWh-UcNZkE6sM1pN9iHzHIexequsNwg= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpHrU5RM-DIjtokFckmtzThxeI8zuzt7Re5ZuCgxfWlmgnSHon_LMhTpiuIIuvL1uqEZIrpnXvkXF3_3umEcHuCFxHe-4ha1eDSBOCqwHRnmIdiBc3rmmER19WYl6muFKH2ApRCYpkgRHYdS4Bcs2gpb6QZ-8pAupgwDLLKx-jimeuaEe95zM9vnynufB3z2MWrEc0vWsSm ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrlu_MtcZsUNTNezQ0ZcoF4s7xECF2OI42cPM6RGoZv-0uvy1gQjMC9X8ddVQquQs2fHgGUyxB3OKStgTIA== ) PlaceIQ:CES 2018 ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrlu_MtcZsUNTNezQ0ZcoF4s7tTXn3f9Aj-jk6wa9e_S3xdSlhgbaC5L6ZpVruSeONLbGyeyXT6_WrBLpSkD21aWJMGCfHRX8ol2fzL0H1ZNvYIbF5__y )
On Mon, Jul 9th, 2018 at 10:57 AM, Steven Kirtzic <st...@statefarm.com> wrote:
>
>
>
> Moon,
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> For the love of God, I have been requesting to be deleted from this
> mailing list for over a year now. PLEASE get me off this list.
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> -Steven
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *From:* moon soo Lee < leemoonsoo@gmail.com >
> *Reply-To:* " users@zeppelin.apache.org " < users@zeppelin.apache.org >
> *Date:* Thursday, July 5, 2018 at 5:08 AM
> *To:* " users@zeppelin.apache.org " < users@zeppelin.apache.org >
> *Subject:* [EXTERNAL] Re: Zeppelin starting time - tied to the load of
> notebooks loading
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> I also prefer approach 1 more.
>
>
>
>
>
>
>
> https://issues.apache.org/jira/browse/ZEPPELIN-2619 is a related issue.
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> Thanks,
>
>
>
>
>
>
>
>
> moon
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> On Thu, Jul 5, 2018 at 9:40 AM Jeff Zhang < zjffdu@gmail.com > wrote:
>
>
>
>
>
>
>
>>
>>
>> This is a known issue. I also thought about it for a while. Actually,
>> starting zeppelin don't need to load all notes, just loading the metadata
>> (note name) is enough. However, the note metadata is stored in note file
>> if you using filesystem to store notes. So whatever, you have to read the
>> note.json for the metadata. I have 2 approaches in my mind for this issue.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> 1. Use the note name as the note file name instead of using note.json for
>> all notes. This require changes in the notebookrepo, also cause effort and
>> risk when user upgrade zeppelin.
>>
>>
>>
>>
>>
>>
>>
>>
>> 2. Store the metadata in another place. So user can just read the metadata
>> when restarting zeppelin. But in this case we have to make sure the
>> consistency between the notebookrepp and metadata store.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Personally I prefer using approach 1 as long term solution. Welcome any
>> comments.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Mohit Jaggi < mohitjaggi@gmail.com > 于 2018 年 7 月 5 日周四 上午 6:32 写道：
>>
>>
>>
>>
>>
>>
>>
>>>
>>>
>>> I have noticed it too and it is annoying. However, asynchronous loading
>>> might not be the solution you want. I want to choose the notebook to open
>>> from the list Z shows me. So I am blocked on it anyway. I think that the
>>> loading is asynchronous anyway because several times I have seen that I
>>> have to keep reloading my page until my notebook list appears.
>>>
>>> What we need is for Z to load the metadata for notebooks (like names etc)
>>> quickly. Optimizing that code might help.
>>>
>>> > On Jul 4, 2018, at 2:56 PM, Jhon Anderson Cardenas Diaz < jhonderson2007@gmail.com
>>> > wrote:
>>> >
>>> > Hi!.
>>> >
>>> > Right now the Zeppelin starting time depends directly on the time it
>>> takes to load the notebooks from the repository. If the user has a lot of
>>> notebooks (ex more than 1000), the starting time starts to be too long.
>>> >
>>> > Is there some plan to re implement this notebooks loading so that it is
>>> done asynchronously?. Or this is not a problem for zeppelin users.
>>> >
>>> > Thanks.
>>>
>>>
>>>
>>>
>>>
>>>
>>
>>
>>
>
>
Re: [EXTERNAL] Re: Zeppelin starting time - tied to the load of
notebooks loading
Posted by Steven Kirtzic <st...@statefarm.com>.
Moon,
For the love of God, I have been requesting to be deleted from this mailing list for over a year now. PLEASE get me off this list.
-Steven
From: moon soo Lee <le...@gmail.com>
Reply-To: "users@zeppelin.apache.org" <us...@zeppelin.apache.org>
Date: Thursday, July 5, 2018 at 5:08 AM
To: "users@zeppelin.apache.org" <us...@zeppelin.apache.org>
Subject: [EXTERNAL] Re: Zeppelin starting time - tied to the load of notebooks loading
I also prefer approach 1 more.
https://issues.apache.org/jira/browse/ZEPPELIN-2619 is a related issue.
Thanks,
moon
On Thu, Jul 5, 2018 at 9:40 AM Jeff Zhang <zj...@gmail.com>> wrote:
This is a known issue. I also thought about it for a while. Actually, starting zeppelin don't need to load all notes, just loading the metadata (note name) is enough. However, the note metadata is stored in note file if you using filesystem to store notes. So whatever, you have to read the note.json for the metadata. I have 2 approaches in my mind for this issue.
1. Use the note name as the note file name instead of using note.json for all notes. This require changes in the notebookrepo, also cause effort and risk when user upgrade zeppelin.
2. Store the metadata in another place. So user can just read the metadata when restarting zeppelin. But in this case we have to make sure the consistency between the notebookrepp and metadata store.
Personally I prefer using approach 1 as long term solution. Welcome any comments.
Mohit Jaggi <mo...@gmail.com>>于2018年7月5日周四 上午6:32写道：
I have noticed it too and it is annoying. However, asynchronous loading might not be the solution you want. I want to choose the notebook to open from the list Z shows me. So I am blocked on it anyway. I think that the loading is asynchronous anyway because several times I have seen that I have to keep reloading my page until my notebook list appears.
What we need is for Z to load the metadata for notebooks (like names etc) quickly. Optimizing that code might help.
> On Jul 4, 2018, at 2:56 PM, Jhon Anderson Cardenas Diaz <jh...@gmail.com>> wrote:
>
> Hi!.
>
> Right now the Zeppelin starting time depends directly on the time it takes to load the notebooks from the repository. If the user has a lot of notebooks (ex more than 1000), the starting time starts to be too long.
>
> Is there some plan to re implement this notebooks loading so that it is done asynchronously?. Or this is not a problem for zeppelin users.
>
> Thanks.
Re: Zeppelin starting time - tied to the load of notebooks loading
Posted by moon soo Lee <le...@gmail.com>.
I also prefer approach 1 more.
https://issues.apache.org/jira/browse/ZEPPELIN-2619 is a related issue.
Thanks,
moon
On Thu, Jul 5, 2018 at 9:40 AM Jeff Zhang <zj...@gmail.com> wrote:
> This is a known issue. I also thought about it for a while. Actually,
> starting zeppelin don't need to load all notes, just loading the metadata
> (note name) is enough. However, the note metadata is stored in note file if
> you using filesystem to store notes. So whatever, you have to read the
> note.json for the metadata. I have 2 approaches in my mind for this issue.
>
> 1. Use the note name as the note file name instead of using note.json for
> all notes. This require changes in the notebookrepo, also cause effort and
> risk when user upgrade zeppelin.
> 2. Store the metadata in another place. So user can just read the metadata
> when restarting zeppelin. But in this case we have to make sure the
> consistency between the notebookrepp and metadata store.
>
> Personally I prefer using approach 1 as long term solution. Welcome any
> comments.
>
>
>
> Mohit Jaggi <mo...@gmail.com>于2018年7月5日周四 上午6:32写道：
>
>> I have noticed it too and it is annoying. However, asynchronous loading
>> might not be the solution you want. I want to choose the notebook to open
>> from the list Z shows me. So I am blocked on it anyway. I think that the
>> loading is asynchronous anyway because several times I have seen that I
>> have to keep reloading my page until my notebook list appears.
>>
>> What we need is for Z to load the metadata for notebooks (like names etc)
>> quickly. Optimizing that code might help.
>>
>> > On Jul 4, 2018, at 2:56 PM, Jhon Anderson Cardenas Diaz <
>> jhonderson2007@gmail.com> wrote:
>> >
>> > Hi!.
>> >
>> > Right now the Zeppelin starting time depends directly on the time it
>> takes to load the notebooks from the repository. If the user has a lot of
>> notebooks (ex more than 1000), the starting time starts to be too long.
>> >
>> > Is there some plan to re implement this notebooks loading so that it is
>> done asynchronously?. Or this is not a problem for zeppelin users.
>> >
>> > Thanks.
>>
>>
Re: Zeppelin starting time - tied to the load of notebooks loading
Posted by Jeff Zhang <zj...@gmail.com>.
This is a known issue. I also thought about it for a while. Actually,
starting zeppelin don't need to load all notes, just loading the metadata
(note name) is enough. However, the note metadata is stored in note file if
you using filesystem to store notes. So whatever, you have to read the
note.json for the metadata. I have 2 approaches in my mind for this issue.
1. Use the note name as the note file name instead of using note.json for
all notes. This require changes in the notebookrepo, also cause effort and
risk when user upgrade zeppelin.
2. Store the metadata in another place. So user can just read the metadata
when restarting zeppelin. But in this case we have to make sure the
consistency between the notebookrepp and metadata store.
Personally I prefer using approach 1 as long term solution. Welcome any
comments.
Mohit Jaggi <mo...@gmail.com>于2018年7月5日周四 上午6:32写道：
> I have noticed it too and it is annoying. However, asynchronous loading
> might not be the solution you want. I want to choose the notebook to open
> from the list Z shows me. So I am blocked on it anyway. I think that the
> loading is asynchronous anyway because several times I have seen that I
> have to keep reloading my page until my notebook list appears.
>
> What we need is for Z to load the metadata for notebooks (like names etc)
> quickly. Optimizing that code might help.
>
> > On Jul 4, 2018, at 2:56 PM, Jhon Anderson Cardenas Diaz <
> jhonderson2007@gmail.com> wrote:
> >
> > Hi!.
> >
> > Right now the Zeppelin starting time depends directly on the time it
> takes to load the notebooks from the repository. If the user has a lot of
> notebooks (ex more than 1000), the starting time starts to be too long.
> >
> > Is there some plan to re implement this notebooks loading so that it is
> done asynchronously?. Or this is not a problem for zeppelin users.
> >
> > Thanks.
>
>
Re: Zeppelin starting time - tied to the load of notebooks loading
Posted by Mohit Jaggi <mo...@gmail.com>.
I have noticed it too and it is annoying. However, asynchronous loading might not be the solution you want. I want to choose the notebook to open from the list Z shows me. So I am blocked on it anyway. I think that the loading is asynchronous anyway because several times I have seen that I have to keep reloading my page until my notebook list appears.
What we need is for Z to load the metadata for notebooks (like names etc) quickly. Optimizing that code might help.
> On Jul 4, 2018, at 2:56 PM, Jhon Anderson Cardenas Diaz <jh...@gmail.com> wrote:
>
> Hi!.
>
> Right now the Zeppelin starting time depends directly on the time it takes to load the notebooks from the repository. If the user has a lot of notebooks (ex more than 1000), the starting time starts to be too long.
>
> Is there some plan to re implement this notebooks loading so that it is done asynchronously?. Or this is not a problem for zeppelin users.
>
> Thanks.