You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Xiaoyong Zhu <xi...@microsoft.com> on 2015/05/05 08:10:42 UTC
Write and submit your Hive query using Visual Studio!
Dear Hive users
I am happy to announce that now you can write and submit your Hive queries using Visual Studio (which is free now!), with syntax coloring, keyword suggestion, remote metastore suggestion, IntelliSense (still in preview), and an intuitive UI to guide you to view jobs & logs.
[http://blogs.msdn.com/cfs-filesystemfile.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-70-93/4024.Screenshot-_2800_2_2900_.png]
Basically we are developing the HDInsight Tools for Visual Studio (HDInsight<http://azure.microsoft.com/en-us/services/hdinsight/> is a full managed Hadoop solution developed by Microsoft) and we also want to contribute back to the community by providing a good development experience. With this plugin, you can:
- Write your hive query with syntax coloring, auto-completion and IntelliSense style support (preview)
- Submit your hive job, and view the historical job logs & outputs in an intuitive way
- Navigate your Hive metastore (DB/Table/Colums)
- In the future we also want to add some performance tuing experience in this tool
Installation
The tool is compatible with two free Visual Studio versions: Visual Studio 2015 (now RC) Community and Visual Studio 2013 Community.
If you haven't installed them before, just click the links below, so Visual Studio and Azure SDK will be installed in your machine:
Visual Studio 2015 Community Release Candidate with Microsoft Azure SDK - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VS2015CommunityAzurePack.appids>
Visual Studio Community 2013 with Microsoft Azure SDK - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VS2013CommunityAzurePack.appids>
If you have ever installed the Visual Studio community version before, you need to install Azure SDK to get the latest Tools:
Azure SDK for .NET (VS 2015) - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VWDOrVs2015AzurePack.appids>
Azure SDK for .NET (VS 2013) - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VWDOrVs2013AzurePack.appids>
< Please note that this feature is currently in preview so it only supports the Basic Auth (the username/password combination) - it does not support Kerberos now.>
Writing Hive queries
After installation you can go to File > New > Project to create a Hive application (it is under HDInsight category) and write Hive queries there.
[cid:image006.jpg@01D0873D.3507E8D0]
Welcome to try out! You can get the details on how to use this tool and connect to your cluster by visiting the blog post here<http://blogs.msdn.com/b/xiaoyong/archive/2015/05/04/how-to-write-and-submit-hive-queries-using-visual-studio.aspx>. If you have any suggestions or feedback to the tool, feel free to reach to me (xiaoyzhu at microsoft dot com) or reach us at hdivstool at microsoft dot com! We also developing several cool features for improved Hive authoring experience, so if you are interested in trying that, please also email us!
Xiaoyong Zhu on behalf of Microsoft Big Data Developer Experience Team
RE: Write and submit your Hive query using Visual Studio!
Posted by Xiaoyong Zhu <xi...@microsoft.com>.
It also supports on-prem ones, and is compatible with all the major distributions.
Actually it is using the standard APIs (WebHCat/HiveServer2/WebHDFS) so any hadoop cluster that has these ports open and reachable could be connected via this tool (though you may need to have several configuration changes in your cluster side to grant the tool access).
Xiaoyong
From: Moore, Douglas [mailto:Douglas.Moore@thinkbiganalytics.com]
Sent: Tuesday, May 5, 2015 10:23 PM
To: user@hive.apache.org
Cc: HDInsight VS Tooling V-team
Subject: Re: Write and submit your Hive query using Visual Studio!
Sounds cool but we can't always put our clusters in the cloud.
Will this work with on premise clusters from Cloudera, Hortonworks, MapR or others?
Which versions of Hive are supported?
From: Xiaoyong Zhu <xi...@microsoft.com>>
Reply-To: <us...@hive.apache.org>>
Date: Tue, 5 May 2015 06:10:42 +0000
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: HDInsight VS Tooling V-team <hd...@microsoft.com>>
Subject: Write and submit your Hive query using Visual Studio!
Dear Hive users
I am happy to announce that now you can write and submit your Hive queries using Visual Studio (which is free now!), with syntax coloring, keyword suggestion, remote metastore suggestion, IntelliSense (still in preview), and an intuitive UI to guide you to view jobs & logs.
[http://blogs.msdn.com/cfs-filesystemfile.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-70-93/4024.Screenshot-_2800_2_2900_.png]
Basically we are developing the HDInsight Tools for Visual Studio (HDInsight<http://azure.microsoft.com/en-us/services/hdinsight/> is a full managed Hadoop solution developed by Microsoft) and we also want to contribute back to the community by providing a good development experience. With this plugin, you can:
- Write your hive query with syntax coloring, auto-completion and IntelliSense style support (preview)
- Submit your hive job, and view the historical job logs & outputs in an intuitive way
- Navigate your Hive metastore (DB/Table/Colums)
- In the future we also want to add some performance tuing experience in this tool
Installation
The tool is compatible with two free Visual Studio versions: Visual Studio 2015 (now RC) Community and Visual Studio 2013 Community.
If you haven't installed them before, just click the links below, so Visual Studio and Azure SDK will be installed in your machine:
Visual Studio 2015 Community Release Candidate with Microsoft Azure SDK - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VS2015CommunityAzurePack.appids>
Visual Studio Community 2013 with Microsoft Azure SDK - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VS2013CommunityAzurePack.appids>
If you have ever installed the Visual Studio community version before, you need to install Azure SDK to get the latest Tools:
Azure SDK for .NET (VS 2015) - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VWDOrVs2015AzurePack.appids>
Azure SDK for .NET (VS 2013) - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VWDOrVs2013AzurePack.appids>
< Please note that this feature is currently in preview so it only supports the Basic Auth (the username/password combination) - it does not support Kerberos now.>
Writing Hive queries
After installation you can go to File > New > Project to create a Hive application (it is under HDInsight category) and write Hive queries there.
[cid:image002.jpg@01D087CB.47B96E70]
Welcome to try out! You can get the details on how to use this tool and connect to your cluster by visiting the blog post here<http://blogs.msdn.com/b/xiaoyong/archive/2015/05/04/how-to-write-and-submit-hive-queries-using-visual-studio.aspx>. If you have any suggestions or feedback to the tool, feel free to reach to me (xiaoyzhu at microsoft dot com) or reach us at hdivstool at microsoft dot com! We also developing several cool features for improved Hive authoring experience, so if you are interested in trying that, please also email us!
Xiaoyong Zhu on behalf of Microsoft Big Data Developer Experience Team
Re: Write and submit your Hive query using Visual Studio!
Posted by "Moore, Douglas" <Do...@thinkbiganalytics.com>.
Sounds cool but we can't always put our clusters in the cloud.
Will this work with on premise clusters from Cloudera, Hortonworks, MapR or others?
Which versions of Hive are supported?
From: Xiaoyong Zhu <xi...@microsoft.com>>
Reply-To: <us...@hive.apache.org>>
Date: Tue, 5 May 2015 06:10:42 +0000
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: HDInsight VS Tooling V-team <hd...@microsoft.com>>
Subject: Write and submit your Hive query using Visual Studio!
Dear Hive users
I am happy to announce that now you can write and submit your Hive queries using Visual Studio (which is free now!), with syntax coloring, keyword suggestion, remote metastore suggestion, IntelliSense (still in preview), and an intuitive UI to guide you to view jobs & logs.
[http://blogs.msdn.com/cfs-filesystemfile.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-70-93/4024.Screenshot-_2800_2_2900_.png]
Basically we are developing the HDInsight Tools for Visual Studio (HDInsight<http://azure.microsoft.com/en-us/services/hdinsight/> is a full managed Hadoop solution developed by Microsoft) and we also want to contribute back to the community by providing a good development experience. With this plugin, you can:
- Write your hive query with syntax coloring, auto-completion and IntelliSense style support (preview)
- Submit your hive job, and view the historical job logs & outputs in an intuitive way
- Navigate your Hive metastore (DB/Table/Colums)
- In the future we also want to add some performance tuing experience in this tool
Installation
The tool is compatible with two free Visual Studio versions: Visual Studio 2015 (now RC) Community and Visual Studio 2013 Community.
If you haven't installed them before, just click the links below, so Visual Studio and Azure SDK will be installed in your machine:
Visual Studio 2015 Community Release Candidate with Microsoft Azure SDK - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VS2015CommunityAzurePack.appids>
Visual Studio Community 2013 with Microsoft Azure SDK - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VS2013CommunityAzurePack.appids>
If you have ever installed the Visual Studio community version before, you need to install Azure SDK to get the latest Tools:
Azure SDK for .NET (VS 2015) - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VWDOrVs2015AzurePack.appids>
Azure SDK for .NET (VS 2013) - 2.6<https://www.microsoft.com/web/handlers/webpi.ashx/getinstaller/VWDOrVs2013AzurePack.appids>
< Please note that this feature is currently in preview so it only supports the Basic Auth (the username/password combination) - it does not support Kerberos now.>
Writing Hive queries
After installation you can go to File > New > Project to create a Hive application (it is under HDInsight category) and write Hive queries there.
[cid:image006.jpg@01D0873D.3507E8D0]
Welcome to try out! You can get the details on how to use this tool and connect to your cluster by visiting the blog post here<http://blogs.msdn.com/b/xiaoyong/archive/2015/05/04/how-to-write-and-submit-hive-queries-using-visual-studio.aspx>. If you have any suggestions or feedback to the tool, feel free to reach to me (xiaoyzhu at microsoft dot com) or reach us at hdivstool at microsoft dot com! We also developing several cool features for improved Hive authoring experience, so if you are interested in trying that, please also email us!
Xiaoyong Zhu on behalf of Microsoft Big Data Developer Experience Team