You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by Timothy Chen <tn...@gmail.com> on 2013/12/17 18:42:21 UTC
Re: Drill on Amazon EMR
Just verified and it works great!
For folks that are going to try it, Drill is installed in
/home/hadoop/drill
Thanks,
Tim
On Tue, Dec 17, 2013 at 9:38 AM, McPherson, Steve <st...@amazon.com>wrote:
> Resending this per the Hangout.
>
>
> On 12/12/13 11:10 PM, "McPherson, Steve" <st...@amazon.com> wrote:
>
> Hi all,
>
> Sumit and Tim were able to get the bootstrap action working to launch
> Drill on EMR.
>
> We'd love to get feedback.
>
> Instructions:
>
> From the Elastic MapReduce CLI (which you can install using these
> instructions
> http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-cli-i
> nstall.html)
>
> ./elastic-mapreduce --create --alive --name "Drill.deploy" --instance-type
> m1.large --ami-version 3.0.1 --hbase --bootstrap-action
> "s3://beta.elasticmapreduce/bootstrap-actions/drill/install-drill.rb" --ssh
>
> Or, from the AWS EMR Web console
> (https://console.aws.amazon.com/elasticmapreduce/) launch a 3.0.1 cluster
> with the bootstrap action:
>
> "s3://beta.elasticmapreduce/bootstrap-actions/drill/install-drill.rb"
>
> SSH to the master node cluster and run Drill.
>
> cd drill
> /bin/sqlline -u jdbc:drill:schema=parquet-local -n admin -p admin
> ..select * from "/drill/sample-data/region.parquet";
> ..etc
>
>
>
> >On 12/12/13 7:59 PM, "Sumit Kumar (JIRA)" <ji...@apache.org> wrote:
> >
> >>
> >> [
> >>
> https://issues.apache.org/jira/browse/DRILL-322?page=com.atlassian.jira.p
> >>l
> >>ugin.system.issuetabpanels:all-tabpanel ]
> >>
> >>Sumit Kumar reassigned DRILL-322:
> >>---------------------------------
> >>
> >> Assignee: Sumit Kumar (was: Timothy Chen)
> >>
> >>> Fix classpath ordering in drill related scripts
> >>> ------------------------------------------------
> >>>
> >>> Key: DRILL-322
> >>> URL: https://issues.apache.org/jira/browse/DRILL-322
> >>> Project: Apache Drill
> >>> Issue Type: Bug
> >>> Reporter: Timothy Chen
> >>> Assignee: Sumit Kumar
> >>> Attachments: DRILL-322.patch
> >>>
> >>>
> >>> While Sumit Kumar (from EMR) and I working on EMR launch script for
> >>>Drill, Sumit found out our classpath is not correctly ordered as Drill's
> >>>classes are loaded before other dependencies, and dependencies such as
> >>>sqlline are not loaded the correct version.
> >>
> >>
> >>
> >>--
> >>This message was sent by Atlassian JIRA
> >>(v6.1.4#6159)
> >
>
>
Re: Drill on Amazon EMR
Posted by Jacques Nadeau <ja...@apache.org>.
Steve, Sumit and Tim, awesome work!
Look forward to trying it out. I'll also try to get Sumit patch merged
ASAP.
thanks!
Jacques
On Tue, Dec 17, 2013 at 9:42 AM, Timothy Chen <tn...@gmail.com> wrote:
> Just verified and it works great!
>
> For folks that are going to try it, Drill is installed in
> /home/hadoop/drill
>
> Thanks,
>
> Tim
>
>
> On Tue, Dec 17, 2013 at 9:38 AM, McPherson, Steve <stevemp@amazon.com
> >wrote:
>
> > Resending this per the Hangout.
> >
> >
> > On 12/12/13 11:10 PM, "McPherson, Steve" <st...@amazon.com> wrote:
> >
> > Hi all,
> >
> > Sumit and Tim were able to get the bootstrap action working to launch
> > Drill on EMR.
> >
> > We'd love to get feedback.
> >
> > Instructions:
> >
> > From the Elastic MapReduce CLI (which you can install using these
> > instructions
> >
> http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-cli-i
> > nstall.html)
> >
> > ./elastic-mapreduce --create --alive --name "Drill.deploy"
> --instance-type
> > m1.large --ami-version 3.0.1 --hbase --bootstrap-action
> > "s3://beta.elasticmapreduce/bootstrap-actions/drill/install-drill.rb"
> --ssh
> >
> > Or, from the AWS EMR Web console
> > (https://console.aws.amazon.com/elasticmapreduce/) launch a 3.0.1
> cluster
> > with the bootstrap action:
> >
> > "s3://beta.elasticmapreduce/bootstrap-actions/drill/install-drill.rb"
> >
> > SSH to the master node cluster and run Drill.
> >
> > cd drill
> > /bin/sqlline -u jdbc:drill:schema=parquet-local -n admin -p admin
> > ..select * from "/drill/sample-data/region.parquet";
> > ..etc
> >
> >
> >
> > >On 12/12/13 7:59 PM, "Sumit Kumar (JIRA)" <ji...@apache.org> wrote:
> > >
> > >>
> > >> [
> > >>
> >
> https://issues.apache.org/jira/browse/DRILL-322?page=com.atlassian.jira.p
> > >>l
> > >>ugin.system.issuetabpanels:all-tabpanel ]
> > >>
> > >>Sumit Kumar reassigned DRILL-322:
> > >>---------------------------------
> > >>
> > >> Assignee: Sumit Kumar (was: Timothy Chen)
> > >>
> > >>> Fix classpath ordering in drill related scripts
> > >>> ------------------------------------------------
> > >>>
> > >>> Key: DRILL-322
> > >>> URL: https://issues.apache.org/jira/browse/DRILL-322
> > >>> Project: Apache Drill
> > >>> Issue Type: Bug
> > >>> Reporter: Timothy Chen
> > >>> Assignee: Sumit Kumar
> > >>> Attachments: DRILL-322.patch
> > >>>
> > >>>
> > >>> While Sumit Kumar (from EMR) and I working on EMR launch script for
> > >>>Drill, Sumit found out our classpath is not correctly ordered as
> Drill's
> > >>>classes are loaded before other dependencies, and dependencies such as
> > >>>sqlline are not loaded the correct version.
> > >>
> > >>
> > >>
> > >>--
> > >>This message was sent by Atlassian JIRA
> > >>(v6.1.4#6159)
> > >
> >
> >
>