You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Jeff Zhang <zj...@gmail.com> on 2018/05/31 03:47:33 UTC
Spark Interpreter Tutorial in Apache Zeppelin
Hi Folks,
I often see users asking how to use spark interpreter in mail-list,
specially how to configure spark interpreter. So I wrote this article about
how to use spark interpreter in Apache Zeppelin (It is based on Zeppelin
0.8.0). But it is not completed yet, I will continue to add more content to
it, so welcome any feedback and comments on it.
https://medium.com/@zjffdu/spark-interpreter-tutorial-in-apache-zeppelin-a7e18b557a9c
Re: Re: Spark Interpreter Tutorial in Apache Zeppelin
Posted by Paul Brenner <pb...@placeiq.com>.
This is great! It inspired us to take another crack at using three of the newish features (new spark interpreter, yarn-cluster mode, and impersonation). If we run into problems and then find solutions we will share in case they are worth including in the documentation.
( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49Qt2kEcOZ5Y8-H3bm_DTYHSxrACRfMzAch0gWzeykdCmI= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49Qt2kEcOZ5Y8-H3bm_DTYHSxrACRfMzAch0gWzeykdCmI= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49Qt2kEcOZ5Y8-H3bm_DTYHSxrACRfMzAch0gWzeykdCmI= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72oEN-JhZ97M16f8QSkGBQdAxBxRHcrot_MzEHUJETwJiBHr ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72oEN-JhZ97M16f8QSkGBQdAxBxRHcrot_MzEHUJETwJiBHr ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72oEN-JhZ97M16f8QSkGBQdAxBxRHcrot_MzEHUJETwJiBHr ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72kEKbhzY8-H1qf-BXcJCwkK_QEIedSIBIQ8DXJf4eUC4QfR1OoXfQI= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72kEKbhzY8-H1qf-BXcJCwkK_QEIedSIBIQ8DXJf4eUC4QfR1OoXfQI= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72kEKbh5a8KJ0az4AHcJCwkKzgIEatCvLNxRiRKViOx7RXDQdE7OCXLRmVPo-QNzbw== ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72kEKbh5a8KJ0az4AHcJCwkKzgIEatCvLNxRiRKViOx7RXDQdE7OCXLRmVPo-QNzbw== ) SR. DATA SCIENTIST (217) 390-3033
( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49Qt2kEcOZ5Y8-H3bm_DTYHS1YVnFhGKoTuZ8UOlR-XjuBjGQ940bx8jNaBmCkhBSYIotlfJC4dxMbE-rTaW3Fd_2WP_5D2FegQUoz88mxhd7pAY27f6dPnm4aysy6TuBbqfHq45H_henvF2txpJCOCywHwhoRv ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUUsUn0JYIp6gNpBUlxKVlKh8Gw9mwrR6gYifniliCToIodARNSgR2NyA-bzBTy8doDSTvdj7DucSTMZCG8OVKD91U2yeQWJYhIHN ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUUsUn0JYIp6gNpBUlxKVlKh8Gw9mwrR6gYifniliCToIodARNSgR2NyA-bzBTy8doDSTvdj7DucSTMZCG8OVKD91U2yeQWJYhIHN ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUUsUn0JYIp6gNpBUlxKVlKh8Gw9mwrR6gYifniliCToIodARNSgR2NyA-bzBTy8doDSTvdj7DucSTMZCG8OVKD91U2yeQWJYhIHN ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUUsUn0JYIp6gNpBUlxKVlKh8Gw9mwrR6gYifniliCToIodARNSgR2NyA-bzBTy8doDSTvdj7DucSTMZCG8OVKD91U2yeQWJYhIHN ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksVnkJZIp6sMJJSkAGfg-InCUZywrRqm5qUnSJiFCIIrt4fJD0R0NzesLTGA2wfunjOpc7qDusfW8bxKb9hpQw0m11nsjlO7MuL ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksVmUJYKZ6xOZJCgBqHwO9lAUxlnaVxjdaYlDM4DyZO4N4WIjkKw9ve9LPSA2sepCHXq8nwEexeUIi4u2xmO6YTP3XCoJPjlZC-t2Cq2IbyAdDKffbjbZc846mf ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksVmUJYKZ6xOZJCgBqHwO9lAUxlnaVxjdaYlDM4DyZO4N4WIjkKw9ve9LPSA2sepCHXq8nwEexeUIi4u2xmO6YTP3XCoJPjlZC-t2Cq2IbyAdDKffbjbZc846mf ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksVmUJYKZ6xOZJCgBqHwO9lAUxlnaVxjdaYlDM4DyZO4N4WIjkKw9ve9LPSA2sepCHXq8nwEexeUIi4u2xmO6YTP3XCoJPjlZC-t2Cq2IbyAdDKffbjbZc846mf ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksVmUJYKZ6xOZJCgBqHwO9lAUxlnaVxjdaYlDM4DyZO4N4WIjkKw9ve9LPSA2sepCHXq8nwEexeUIi4u2xmO6YTP3XCoJPjlZC-t2Cq2IbyAdDKffbjbZc846mf ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksVmUJYKZ6xOZJCgBqHwO9lAUxlnaVxjdaYlDM4DyZO4N4WIjkKw9ve9LPSA2sepCHXq8nwEexeUIi4u2xmO6YTP3XCoJPjlZC-t2Cq2IbyAdDKffbjbZc846mf ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsH8UO-U7csCD1634H3cJCwkK4QIKe8WoOp0MoRKCjKhLC0FjwrB6kdahmS47BSREvdoAeRgXwNzB8rzRAGoEoDmBv8n0OPocS5uy8zBGf_BNbnXf_5ugjYa2miKCuVL-ZiaP7TEV7OpTISldpl-1G47MoS25lgab8KuiXQvnNeiXKuy49BszfylIygJQ5ak= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksVlUJZKZ6xOZJCgBqHwOdlBFFi1aNqxZeZkiY7CTtL4NYcIDkU29vK-LPWSy8AoTTKrNLrCqQEV525u2B0ZeNGfWLL_5qrkZyorCiPqUikSHvzWF7WARoI4sIFMUTd8w== ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksUnUJbLJ61PZYMiBKdhOttRU1wnbA0hJSVkDMmDzoIqd4GNXER2dbY7qnHVy8dpDnbucn2Cexcp7mAIKeX7gy9X-BAdZfHvg== ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksUn0JZLZ6xOZJCgBqHwOxkHFB51KR6jYjbnSYhBDlEv9RfNXEfxd3Y87nXXGcRpjzQrZD2Ae8WTIC_8SBhfvZXImXP4ZfwnYCo6C6Evl74eDa-730I6KkLPS1lrVurH8LUsyLovhGBqLWsXRPEDBhH6gLaA48S_KZYL-IPe94kEwULWVJePkycq4ViEbDIVad0DfclfLib8dOIa-XUf66EzY46vnqnmwTKc6J6lXg1Rm5aiTPETuzSx_U= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksUn0JZLZ6xOZJCgBqHwOxkHFB51KR6jYjbnSYhBDlEv9RfNXEfxd3Y87nXXGcRpjzQrZD2Ae8WTIC_8SBhfvZXImXP4ZfwnYCo6C6Evl74eDa-730I6KkLPS1lrVurH8LUsyLovhGBqLWsXRPEDBhH6gLaA48S_KZYL-IPe94kEwULWVJePkycq4ViEbDIVad0DfclfLib8dOIa-XUf66EzY46vnqnmwTKc6J6lXg1Rm5aiTPETuzSx_U= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72kEKbhlbs2B0aHgQDoFCUsXnVxeNYH0eoNNhBCThPR5RU533rV0iYmd3DcgFzFXvpIeOz8Zw9vC8_DXT3EVqXjXpM7wAOEHE4C_-GJjd-NKYG-H65H01ZO1tiaFsV6mbGi-9n0U4bpHJmlvoFqxCsLRriapugCc7LjuVRvEBh9MqUvaGYoS96ZYZ6Se4blP75rHe2ujRsn0mseI ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsH8UO-U7csCD1634H3cJCwkK7ig6KIHwbaxsgBaChOttOkdnxbRqnNWehSoj9mT9AhuL0MqKIRScqsqNvQ== ) PlaceIQ:CES 2018 ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsH8UO-U7csCD1634H3cJCwkKn11YLZyIO4dEggGXmeBuRW93wrp8nJKYlmoYCD1RqM8TJDkK6P79wpnaWWwcojTa5NXtCuWfUcg6A093o9yI3qvzVTMX )
On Thu, May 31st, 2018 at 1:6 PM moon soo Lee wrote:
>
> Thanks Jeff for sharing. It's very helpful.
>
>
> On Wed, May 30, 2018 at 8:47 PM Jeff Zhang < zjffdu@gmail.com > wrote:
>
>
>> Hi Folks,
>>
>>
>>
>>
>> I often see users asking how to use spark interpreter in mail-list,
>> specially how to configure spark interpreter. So I wrote this article
>> about how to use spark interpreter in Apache Zeppelin (It is based on
>> Zeppelin 0.8.0). But it is not completed yet, I will continue to add more
>> content to it, so welcome any feedback and comments on it.
>>
>>
>> https://medium.com/@zjffdu/spark-interpreter-tutorial-in-apache-zeppelin-a7e18b557a9c
>>
>>
>>
>
>
Re: Spark Interpreter Tutorial in Apache Zeppelin
Posted by moon soo Lee <mo...@apache.org>.
Thanks Jeff for sharing. It's very helpful.
On Wed, May 30, 2018 at 8:47 PM Jeff Zhang <zj...@gmail.com> wrote:
> Hi Folks,
>
>
> I often see users asking how to use spark interpreter in mail-list,
> specially how to configure spark interpreter. So I wrote this article about
> how to use spark interpreter in Apache Zeppelin (It is based on Zeppelin
> 0.8.0). But it is not completed yet, I will continue to add more content to
> it, so welcome any feedback and comments on it.
>
>
> https://medium.com/@zjffdu/spark-interpreter-tutorial-in-apache-zeppelin-a7e18b557a9c
>