You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by Jacques Nadeau <ja...@dremio.com> on 2015/11/07 07:15:36 UTC
[VOTE] Release Apache Drill 1.3.0 (rc1)
Hey Everybody,
I'd like to propose a new release candidate of Apache Drill, version
1.3.0. This is the second release candidate (rc1). This addresses some
issues identified in the first release candidate including some test
threading issues, Parquet dictionary read issue with binary values, Joda
upgrade to avoid a concurrency bug and a couple other small things.
The tarball artifacts are hosted at [2] and the maven artifacts are hosted
at [3]. This release candidate is based on commit
f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
The vote will be open for 72 hours ending at 10PM Pacific, November 9, 2015.
[ ] +1
[ ] +0
[ ] -1
thanks,
Jacques
[1]
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
[3] https://repository.apache.org/content/repositories/orgapachedrill-1014/
[4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
--
Jacques Nadeau
CTO and Co-Founder, Dremio
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Julien Le Dem <ju...@dremio.com>.
+1 (non-binding)
I've downloaded the tar ball and run the tests.
On Mon, Nov 9, 2015 at 10:16 AM, Abdel Hakim Deneche <ad...@maprtech.com>
wrote:
> +1
>
> Checked checksum files and gpg signature for all 3 files. Built from
> source, deployed on a 4 nodes cluster then run several window function
> queries on TPCDS SF100. Looks great.
>
> On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <ja...@dremio.com> wrote:
>
> > I've seen another instance of DRILL-4041. Since it is exceedingly rare, I
> > don't think it is a release stopper. I will spend some more time
> reviewing
> > it.
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
> > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <am...@gmail.com> wrote:
> >
> > > +1, non-binding
> > > Downloaded tarball, mvn clean install
> > > Ran join queries,, was able to run queries on json, parquet and
> sequence
> > > files.
> > >
> > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <ab...@dremio.com>
> wrote:
> > >
> > > > resending the vote with details
> > > >
> > > > +1, non-binding
> > > >
> > > > ran maven tests, installed on Mac, ran drill in embedded mode,
> verified
> > > Web
> > > > UI for CSV header config changes, ran few queries on CSV files with
> and
> > > > without header, ran few queries against large CSV files with header
> in
> > > HDFS
> > > >
> > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <hy...@maprtech.com>
> > > wrote:
> > > >
> > > > > +1
> > > > > mvn clean install on mac and linux
> > > > >
> > > > > tried a few queries on distributed mode.
> > > > >
> > > > > Things looked fine
> > > > >
> > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <as...@maprtech.com>
> > > wrote:
> > > > >
> > > > > > +1.
> > > > > > Downloaded the binary tar ball and installed on Mac. Ran Drill
> in
> > > > > embedded
> > > > > > mode. Tested a few join, aggregation and limit queries against
> > > parquet
> > > > > > data with and without metadata cache. Tested cancellation for
> > couple
> > > > of
> > > > > > queries. Looked at query profiles on the WebUI. Looks good.
> > > > > >
> > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol <abhijit@dremio.com
> >
> > > > wrote:
> > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org>
> > wrote:
> > > > > > >
> > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > >
> > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > jacques@dremio.com>
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > Hey Everybody,
> > > > > > > > >
> > > > > > > > > I'd like to propose a new release candidate of Apache
> Drill,
> > > > > version
> > > > > > > > > 1.3.0. This is the second release candidate (rc1). This
> > > > addresses
> > > > > > > some
> > > > > > > > > issues identified in the first release candidate including
> > some
> > > > > test
> > > > > > > > > threading issues, Parquet dictionary read issue with binary
> > > > values,
> > > > > > > Joda
> > > > > > > > > upgrade to avoid a concurrency bug and a couple other small
> > > > things.
> > > > > > > > >
> > > > > > > > > The tarball artifacts are hosted at [2] and the maven
> > artifacts
> > > > are
> > > > > > > > hosted
> > > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > > > > > > > >
> > > > > > > > > The vote will be open for 72 hours ending at 10PM Pacific,
> > > > November
> > > > > > 9,
> > > > > > > > 2015.
> > > > > > > > >
> > > > > > > > > [ ] +1
> > > > > > > > > [ ] +0
> > > > > > > > > [ ] -1
> > > > > > > > >
> > > > > > > > > thanks,
> > > > > > > > > Jacques
> > > > > > > > >
> > > > > > > > > [1]
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> > > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> > > > > > > > > [3]
> > > > > > > >
> > > > > >
> > > >
> > https://repository.apache.org/content/repositories/orgapachedrill-1014/
> > > > > > > > > [4]
> https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Jacques Nadeau
> > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
>
> Abdelhakim Deneche
>
> Software Engineer
>
> <http://www.mapr.com/>
>
>
> Now Available - Free Hadoop On-Demand Training
> <
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >
>
--
Julien
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Jacques Nadeau <ja...@dremio.com>.
I have a new candidate branch. It appears the issue with the impersonation
tests was that we creating an excessive number of UserGroupInformation
objects. That then caused an excessive number of FileSystem objects to be
created. I have a patch up for DRILL-4065 that seems to resolve the issue.
Running the test suites now against my commit here:
https://github.com/jacques-n/drill/tree/drill-1.3.0
If the test looks good, I'll roll another release.
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Tue, Nov 10, 2015 at 9:33 AM, Jinfeng Ni <ji...@gmail.com> wrote:
> I run the impersonation test through IntelliJ and kept looking at the
> thread # through Activity Monitor. It seems towards the end of this
> testcase, the # of thread is increased from 12xx to 27xx, meaning the
> testcase created at least 1500 threads.
>
> jstack in the middle of running captures thousands of thread status.
> Most of them seems to be "IPC Client". Different object "user1_1",
> "user1_2" would have multiple different IPC client threads.
>
> "IPC Client (1767081798) connection to localhost/127.0.0.1:61790 from
> user1_1" daemon prio=5 tid=0x00007fbddb595800 nid=0x19607 in
> Object.wait() [0x0000000136a1e000]
> java.lang.Thread.State: TIMED_WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000007cc37c448> (a
> org.apache.hadoop.ipc.Client$Connection)
> at org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:928)
> - locked <0x00000007cc37c448> (a org.apache.hadoop.ipc.Client$Connection)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:973)
>
> It seems this test case indeed creates a lot of threads.
>
>
>
> On Tue, Nov 10, 2015 at 8:29 AM, Jacques Nadeau <ja...@dremio.com>
> wrote:
> > I think that is enough -1's that we should sink this release and get this
> > test figured out. I will spend some time looking at it this morning. Can
> > some others also lend a hand?
> >
> > If we can't figure out why the impersonation test is causing problems
> (or a
> > solution), I'm inclined to disable it and stop holding up the release. It
> > definitely seems like it probably has more to do with the test structure
> > itself rather than the a Drill bug.
> >
> > I'll shoot to start a new release candidate vote later today. In terms of
> > master, I propose that we fork a 1.3.0 release branch at commit
> > e78e28661e921c6bd07ba7bb95d91f9adeb5a247 and then we can reopen changes
> on
> > master.
> >
> > thanks,
> > Jacques
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
> > On Mon, Nov 9, 2015 at 6:14 PM, Jacques Nadeau <ja...@dremio.com>
> wrote:
> >
> >> Anybody want to profile what the impersonation tests are doing that are
> >> causing so many problems with resources?
> >>
> >> --
> >> Jacques Nadeau
> >> CTO and Co-Founder, Dremio
> >>
> >> On Mon, Nov 9, 2015 at 5:24 PM, Hanifi Gunes <hg...@maprtech.com>
> wrote:
> >>
> >>> 1024/4096/2032195 <==> soft/hard/system
> >>>
> >>> On Mon, Nov 9, 2015 at 4:50 PM, Jacques Nadeau <ja...@dremio.com>
> >>> wrote:
> >>>
> >>> > What about open files?
> >>> > On Nov 9, 2015 4:20 PM, "Hanifi Gunes" <hg...@maprtech.com> wrote:
> >>> >
> >>> > > Using the default parallelism, I get the same set of exceptions on
> >>> > CentOS.
> >>> > >
> >>> > > Also max # of threads per process is the system default, 319548.
> >>> > >
> >>> > > On Mon, Nov 9, 2015 at 4:13 PM, Amit Hadke <am...@gmail.com>
> >>> wrote:
> >>> > >
> >>> > > > Unfortunately, yes I changed them at OS level.
> >>> > > >
> >>> > > > I agree that making OS level changes to run tests is not
> something
> >>> we
> >>> > > > should advocate.
> >>> > > > It was just an observation that tests seem to pass on linux with
> >>> > default
> >>> > > > settings but on mac behavior is irregular.
> >>> > > >
> >>> > > > ~ Amit.
> >>> > > >
> >>> > > >
> >>> > > > On Mon, Nov 9, 2015 at 3:48 PM, Jason Altekruse <
> >>> > > altekrusejason@gmail.com>
> >>> > > > wrote:
> >>> > > >
> >>> > > > > Amit,
> >>> > > > >
> >>> > > > > Did you change these at the OS level? I would hope that we
> >>> wouldn't
> >>> > > have
> >>> > > > to
> >>> > > > > make people jump through such hoops to run the build, was
> there a
> >>> > > thread
> >>> > > > I
> >>> > > > > missed where we discussed this something that we should be
> >>> expecting
> >>> > > > > everyone to do? I did see the threads about increasing the
> maven
> >>> > > permgen
> >>> > > > > and did so accordingly, but I think adjusting something like
> the
> >>> > system
> >>> > > > > ulimit is something we really should try to avoid.
> >>> > > > >
> >>> > > > > On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche <
> >>> > > > adeneche@maprtech.com
> >>> > > > > >
> >>> > > > > wrote:
> >>> > > > >
> >>> > > > > > I just tried with the default forkCount and got similar
> >>> failures.
> >>> > I'm
> >>> > > > > > running the tests on a linux machine with the default maven
> >>> options
> >>> > > > > >
> >>> > > > > > Thanks
> >>> > > > > >
> >>> > > > > > On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <
> >>> jacques@dremio.com
> >>> > >
> >>> > > > > wrote:
> >>> > > > > >
> >>> > > > > > > So you're changing the forkCount from the default? What
> >>> happens
> >>> > > when
> >>> > > > > you
> >>> > > > > > > run with the default?
> >>> > > > > > >
> >>> > > > > > > Also, did you guys run with extra permgen or the default?
> >>> Also,
> >>> > can
> >>> > > > you
> >>> > > > > > > confirm what type of machine you are running on?
> >>> > > > > > >
> >>> > > > > > > Want to figure out why things are different.
> >>> > > > > > >
> >>> > > > > > > thanks,
> >>> > > > > > > Jacques
> >>> > > > > > >
> >>> > > > > > > --
> >>> > > > > > > Jacques Nadeau
> >>> > > > > > > CTO and Co-Founder, Dremio
> >>> > > > > > >
> >>> > > > > > > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <
> >>> > > > > > adeneche@maprtech.com
> >>> > > > > > > >
> >>> > > > > > > wrote:
> >>> > > > > > >
> >>> > > > > > > > Saw similar failures when running unit tests with
> forkCount
> >>> =
> >>> > 1:
> >>> > > > > > > >
> >>> > > > > > > > Tests in error:
> >>> > > > > > > > >
> >>> > > > >
> >>> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> >>> > > > > > > > > UserRemote
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> >>> > > > > > > > > » Rpc
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> >>> > > > > > > > > » IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> >>> > > > > > > > > » IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> >>> > > > > > > > > » IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> >>> > > > > > > > > » IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> >>> > > > > > > > > » IllegalState
> >>> > > > > > > > > TestCountDownLatchInjection.latchInjected:146
> >>> NullPointer
> >>> > > > > > > > >
> TestMergingReceiver.testMultipleProvidersMixedSizes:115
> >>> »
> >>> > > > > > > > > IllegalReferenceCount
> >>> > > > > > > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
> >>> > > > > > > >
> >>> > > > > > > >
> >>> > > > > > > > Unfortunately I'm changing my vote to -1
> >>> > > > > > > >
> >>> > > > > > > >
> >>> > > > > > > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <
> >>> > > hgunes@maprtech.com>
> >>> > > > > > > wrote:
> >>> > > > > > > >
> >>> > > > > > > > > -1 (binding)
> >>> > > > > > > > >
> >>> > > > > > > > > 5/5 consecutive runs I get the following consistently
> with
> >>> > > > > forkCount
> >>> > > > > > > set
> >>> > > > > > > > to
> >>> > > > > > > > > 1 on build.
> >>> > > > > > > > >
> >>> > > > > > > > > Tests in error:
> >>> > > > > > > > >
> >>> > > > >
> >>> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> >>> > > > > > > > > UserRemote
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> >>> > > > > > > > > updateClient:236->BaseTestQuery.updateClient:213 »
> >>> > > > IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> >>> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> >>> > > > > > > > >
> >>> > > > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> >>> > > > > > »
> >>> > > > > > > > > IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> >>> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> >>> > > > > > > > > >BaseTestQuery.updateClient:213 » IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> >>> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> >>> > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
> >>> > > > > > > stefan@activitystream.com
> >>> > > > > > > > >
> >>> > > > > > > > > wrote:
> >>> > > > > > > > >
> >>> > > > > > > > > > Hi,
> >>> > > > > > > > > >
> >>> > > > > > > > > > I'm not a committer and not voting but I want to
> point
> >>> out
> >>> > > that
> >>> > > > > the
> >>> > > > > > > > UDFs
> >>> > > > > > > > > > that we are using and run with 1.1 and 1.2 do not,
> for
> >>> some
> >>> > > > > reason,
> >>> > > > > > > run
> >>> > > > > > > > > > with 1.3.
> >>> > > > > > > > > >
> >>> > > > > > > > > > I'm inclined to insist that it's something we are
> doing
> >>> > wrong
> >>> > > > but
> >>> > > > > > if
> >>> > > > > > > > this
> >>> > > > > > > > > > counts as a test then it's failing.
> >>> > > > > > > > > >
> >>> > > > > > > > > > Regards,
> >>> > > > > > > > > > -Stefan
> >>> > > > > > > > > >
> >>> > > > > > > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <
> >>> > > norrisl@simba.com
> >>> > > > >
> >>> > > > > > > wrote:
> >>> > > > > > > > > >
> >>> > > > > > > > > > > +1 Non-binding.
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > Built from source on Linux, tested ODBC against
> >>> various
> >>> > > data
> >>> > > > > > > sources
> >>> > > > > > > > > > > (Hive, DFS-csv, tsv, parquet, json)
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > Norris
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > -----Original Message-----
> >>> > > > > > > > > > > From: Abdel Hakim Deneche [mailto:
> >>> adeneche@maprtech.com]
> >>> > > > > > > > > > > Sent: Monday, November 09, 2015 10:16 AM
> >>> > > > > > > > > > > To: dev@drill.apache.org
> >>> > > > > > > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0
> (rc1)
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > +1
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > Checked checksum files and gpg signature for all 3
> >>> files.
> >>> > > > Built
> >>> > > > > > > from
> >>> > > > > > > > > > > source, deployed on a 4 nodes cluster then run
> several
> >>> > > window
> >>> > > > > > > > function
> >>> > > > > > > > > > > queries on TPCDS SF100. Looks great.
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <
> >>> > > > > > jacques@dremio.com
> >>> > > > > > > >
> >>> > > > > > > > > > wrote:
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > > I've seen another instance of DRILL-4041. Since
> it
> >>> is
> >>> > > > > > exceedingly
> >>> > > > > > > > > > > > rare, I don't think it is a release stopper. I
> will
> >>> > spend
> >>> > > > > some
> >>> > > > > > > more
> >>> > > > > > > > > > > > time reviewing it.
> >>> > > > > > > > > > > >
> >>> > > > > > > > > > > > --
> >>> > > > > > > > > > > > Jacques Nadeau
> >>> > > > > > > > > > > > CTO and Co-Founder, Dremio
> >>> > > > > > > > > > > >
> >>> > > > > > > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <
> >>> > > > > > amit.hadke@gmail.com
> >>> > > > > > > >
> >>> > > > > > > > > > wrote:
> >>> > > > > > > > > > > >
> >>> > > > > > > > > > > > > +1, non-binding
> >>> > > > > > > > > > > > > Downloaded tarball, mvn clean install Ran join
> >>> > > queries,,
> >>> > > > > was
> >>> > > > > > > able
> >>> > > > > > > > > to
> >>> > > > > > > > > > > > > run queries on json, parquet and sequence
> files.
> >>> > > > > > > > > > > > >
> >>> > > > > > > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
> >>> > > > > > > abhijit@dremio.com
> >>> > > > > > > > >
> >>> > > > > > > > > > > wrote:
> >>> > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > resending the vote with details
> >>> > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > +1, non-binding
> >>> > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > ran maven tests, installed on Mac, ran drill
> in
> >>> > > > embedded
> >>> > > > > > > mode,
> >>> > > > > > > > > > > > > > verified
> >>> > > > > > > > > > > > > Web
> >>> > > > > > > > > > > > > > UI for CSV header config changes, ran few
> >>> queries
> >>> > on
> >>> > > > CSV
> >>> > > > > > > files
> >>> > > > > > > > > > > > > > with and without header, ran few queries
> against
> >>> > > large
> >>> > > > > CSV
> >>> > > > > > > > files
> >>> > > > > > > > > > > > > > with header in
> >>> > > > > > > > > > > > > HDFS
> >>> > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu
> <
> >>> > > > > > > > > hyichu@maprtech.com>
> >>> > > > > > > > > > > > > wrote:
> >>> > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > +1
> >>> > > > > > > > > > > > > > > mvn clean install on mac and linux
> >>> > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > tried a few queries on distributed mode.
> >>> > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > Things looked fine
> >>> > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha
> <
> >>> > > > > > > > > asinha@maprtech.com>
> >>> > > > > > > > > > > > > wrote:
> >>> > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > +1.
> >>> > > > > > > > > > > > > > > > Downloaded the binary tar ball and
> >>> installed on
> >>> > > > Mac.
> >>> > > > > > Ran
> >>> > > > > > > > > > > > > > > > Drill in
> >>> > > > > > > > > > > > > > > embedded
> >>> > > > > > > > > > > > > > > > mode. Tested a few join, aggregation and
> >>> limit
> >>> > > > > queries
> >>> > > > > > > > > > > > > > > > against
> >>> > > > > > > > > > > > > parquet
> >>> > > > > > > > > > > > > > > > data with and without metadata cache.
> >>> Tested
> >>> > > > > > > cancellation
> >>> > > > > > > > > for
> >>> > > > > > > > > > > > couple
> >>> > > > > > > > > > > > > > of
> >>> > > > > > > > > > > > > > > > queries. Looked at query profiles on the
> >>> > WebUI.
> >>> > > > > > Looks
> >>> > > > > > > > > good.
> >>> > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit
> Pol
> >>> > > > > > > > > > > > > > > > <ab...@dremio.com>
> >>> > > > > > > > > > > > > > wrote:
> >>> > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > +1
> >>> > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew
> <
> >>> > > > > > > > andrew@primer.org>
> >>> > > > > > > > > > > > wrote:
> >>> > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > +1 (non-binding, non-comitter)
> >>> > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM,
> Jacques
> >>> > > Nadeau <
> >>> > > > > > > > > > > > > jacques@dremio.com>
> >>> > > > > > > > > > > > > > > > > wrote:
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > > Hey Everybody,
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > > I'd like to propose a new release
> >>> > candidate
> >>> > > > of
> >>> > > > > > > Apache
> >>> > > > > > > > > > > > > > > > > > > Drill,
> >>> > > > > > > > > > > > > > > version
> >>> > > > > > > > > > > > > > > > > > > 1.3.0. This is the second release
> >>> > > candidate
> >>> > > > > > (rc1).
> >>> > > > > > > > > > > > > > > > > > > This
> >>> > > > > > > > > > > > > > addresses
> >>> > > > > > > > > > > > > > > > > some
> >>> > > > > > > > > > > > > > > > > > > issues identified in the first
> release
> >>> > > > > candidate
> >>> > > > > > > > > > > > > > > > > > > including
> >>> > > > > > > > > > > > some
> >>> > > > > > > > > > > > > > > test
> >>> > > > > > > > > > > > > > > > > > > threading issues, Parquet
> dictionary
> >>> read
> >>> > > > issue
> >>> > > > > > > with
> >>> > > > > > > > > > > > > > > > > > > binary
> >>> > > > > > > > > > > > > > values,
> >>> > > > > > > > > > > > > > > > > Joda
> >>> > > > > > > > > > > > > > > > > > > upgrade to avoid a concurrency bug
> >>> and a
> >>> > > > couple
> >>> > > > > > > other
> >>> > > > > > > > > > > > > > > > > > > small
> >>> > > > > > > > > > > > > > things.
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > > The tarball artifacts are hosted at
> >>> [2]
> >>> > and
> >>> > > > the
> >>> > > > > > > maven
> >>> > > > > > > > > > > > artifacts
> >>> > > > > > > > > > > > > > are
> >>> > > > > > > > > > > > > > > > > > hosted
> >>> > > > > > > > > > > > > > > > > > > at [3]. This release candidate is
> >>> based
> >>> > on
> >>> > > > > commit
> >>> > > > > > > > > > > > > > > > > > >
> >>> f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305
> >>> > > > > located
> >>> > > > > > at
> >>> > > > > > > > > [4].
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > > The vote will be open for 72 hours
> >>> ending
> >>> > > at
> >>> > > > > 10PM
> >>> > > > > > > > > > > > > > > > > > > Pacific,
> >>> > > > > > > > > > > > > > November
> >>> > > > > > > > > > > > > > > > 9,
> >>> > > > > > > > > > > > > > > > > > 2015.
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > > [ ] +1
> >>> > > > > > > > > > > > > > > > > > > [ ] +0
> >>> > > > > > > > > > > > > > > > > > > [ ] -1
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > > thanks,
> >>> > > > > > > > > > > > > > > > > > > Jacques
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > > [1]
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > >
> >>> > > > > > > > > > > > >
> >>> > > > > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > >
> >>> > >
> >>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> >>> > > > > > > > > > > > 820&version=12332946[2]
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > >
> http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> >>> > > > > > > > > > > > > > > > > > > /
> >>> > > > > > > > > > > > > > > > > > > [3]
> >>> > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > >
> >>> > > > > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > >
> >>> > >
> >>> https://repository.apache.org/content/repositories/orgapachedrill-1014
> >>> > > > > > > > > > > > /
> >>> > > > > > > > > > > > > > > > > > > [4]
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > >
> https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> >>> > > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > > > --
> >>> > > > > > > > > > > > > > > > > > > Jacques Nadeau
> >>> > > > > > > > > > > > > > > > > > > CTO and Co-Founder, Dremio
> >>> > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > > >
> >>> > > > > > > > > > > > > >
> >>> > > > > > > > > > > > >
> >>> > > > > > > > > > > >
> >>> > > > > > > > > > >
> >>> > > > > > > > > > >
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > --
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > Abdelhakim Deneche
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > Software Engineer
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > <http://www.mapr.com/>
> >>> > > > > > > > > > >
> >>> > > > > > > > > > >
> >>> > > > > > > > > > > Now Available - Free Hadoop On-Demand Training <
> >>> > > > > > > > > > >
> >>> > > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >>> > > > > > > > > > > >
> >>> > > > > > > > > > >
> >>> > > > > > > > > >
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > > >
> >>> > > > > > > >
> >>> > > > > > > > --
> >>> > > > > > > >
> >>> > > > > > > > Abdelhakim Deneche
> >>> > > > > > > >
> >>> > > > > > > > Software Engineer
> >>> > > > > > > >
> >>> > > > > > > > <http://www.mapr.com/>
> >>> > > > > > > >
> >>> > > > > > > >
> >>> > > > > > > > Now Available - Free Hadoop On-Demand Training
> >>> > > > > > > > <
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >>> > > > > > > > >
> >>> > > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > > >
> >>> > > > > >
> >>> > > > > > --
> >>> > > > > >
> >>> > > > > > Abdelhakim Deneche
> >>> > > > > >
> >>> > > > > > Software Engineer
> >>> > > > > >
> >>> > > > > > <http://www.mapr.com/>
> >>> > > > > >
> >>> > > > > >
> >>> > > > > > Now Available - Free Hadoop On-Demand Training
> >>> > > > > > <
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >>> > > > > > >
> >>> > > > > >
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> >>
> >>
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Jinfeng Ni <ji...@gmail.com>.
I run the impersonation test through IntelliJ and kept looking at the
thread # through Activity Monitor. It seems towards the end of this
testcase, the # of thread is increased from 12xx to 27xx, meaning the
testcase created at least 1500 threads.
jstack in the middle of running captures thousands of thread status.
Most of them seems to be "IPC Client". Different object "user1_1",
"user1_2" would have multiple different IPC client threads.
"IPC Client (1767081798) connection to localhost/127.0.0.1:61790 from
user1_1" daemon prio=5 tid=0x00007fbddb595800 nid=0x19607 in
Object.wait() [0x0000000136a1e000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007cc37c448> (a org.apache.hadoop.ipc.Client$Connection)
at org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:928)
- locked <0x00000007cc37c448> (a org.apache.hadoop.ipc.Client$Connection)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:973)
It seems this test case indeed creates a lot of threads.
On Tue, Nov 10, 2015 at 8:29 AM, Jacques Nadeau <ja...@dremio.com> wrote:
> I think that is enough -1's that we should sink this release and get this
> test figured out. I will spend some time looking at it this morning. Can
> some others also lend a hand?
>
> If we can't figure out why the impersonation test is causing problems (or a
> solution), I'm inclined to disable it and stop holding up the release. It
> definitely seems like it probably has more to do with the test structure
> itself rather than the a Drill bug.
>
> I'll shoot to start a new release candidate vote later today. In terms of
> master, I propose that we fork a 1.3.0 release branch at commit
> e78e28661e921c6bd07ba7bb95d91f9adeb5a247 and then we can reopen changes on
> master.
>
> thanks,
> Jacques
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Mon, Nov 9, 2015 at 6:14 PM, Jacques Nadeau <ja...@dremio.com> wrote:
>
>> Anybody want to profile what the impersonation tests are doing that are
>> causing so many problems with resources?
>>
>> --
>> Jacques Nadeau
>> CTO and Co-Founder, Dremio
>>
>> On Mon, Nov 9, 2015 at 5:24 PM, Hanifi Gunes <hg...@maprtech.com> wrote:
>>
>>> 1024/4096/2032195 <==> soft/hard/system
>>>
>>> On Mon, Nov 9, 2015 at 4:50 PM, Jacques Nadeau <ja...@dremio.com>
>>> wrote:
>>>
>>> > What about open files?
>>> > On Nov 9, 2015 4:20 PM, "Hanifi Gunes" <hg...@maprtech.com> wrote:
>>> >
>>> > > Using the default parallelism, I get the same set of exceptions on
>>> > CentOS.
>>> > >
>>> > > Also max # of threads per process is the system default, 319548.
>>> > >
>>> > > On Mon, Nov 9, 2015 at 4:13 PM, Amit Hadke <am...@gmail.com>
>>> wrote:
>>> > >
>>> > > > Unfortunately, yes I changed them at OS level.
>>> > > >
>>> > > > I agree that making OS level changes to run tests is not something
>>> we
>>> > > > should advocate.
>>> > > > It was just an observation that tests seem to pass on linux with
>>> > default
>>> > > > settings but on mac behavior is irregular.
>>> > > >
>>> > > > ~ Amit.
>>> > > >
>>> > > >
>>> > > > On Mon, Nov 9, 2015 at 3:48 PM, Jason Altekruse <
>>> > > altekrusejason@gmail.com>
>>> > > > wrote:
>>> > > >
>>> > > > > Amit,
>>> > > > >
>>> > > > > Did you change these at the OS level? I would hope that we
>>> wouldn't
>>> > > have
>>> > > > to
>>> > > > > make people jump through such hoops to run the build, was there a
>>> > > thread
>>> > > > I
>>> > > > > missed where we discussed this something that we should be
>>> expecting
>>> > > > > everyone to do? I did see the threads about increasing the maven
>>> > > permgen
>>> > > > > and did so accordingly, but I think adjusting something like the
>>> > system
>>> > > > > ulimit is something we really should try to avoid.
>>> > > > >
>>> > > > > On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche <
>>> > > > adeneche@maprtech.com
>>> > > > > >
>>> > > > > wrote:
>>> > > > >
>>> > > > > > I just tried with the default forkCount and got similar
>>> failures.
>>> > I'm
>>> > > > > > running the tests on a linux machine with the default maven
>>> options
>>> > > > > >
>>> > > > > > Thanks
>>> > > > > >
>>> > > > > > On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <
>>> jacques@dremio.com
>>> > >
>>> > > > > wrote:
>>> > > > > >
>>> > > > > > > So you're changing the forkCount from the default? What
>>> happens
>>> > > when
>>> > > > > you
>>> > > > > > > run with the default?
>>> > > > > > >
>>> > > > > > > Also, did you guys run with extra permgen or the default?
>>> Also,
>>> > can
>>> > > > you
>>> > > > > > > confirm what type of machine you are running on?
>>> > > > > > >
>>> > > > > > > Want to figure out why things are different.
>>> > > > > > >
>>> > > > > > > thanks,
>>> > > > > > > Jacques
>>> > > > > > >
>>> > > > > > > --
>>> > > > > > > Jacques Nadeau
>>> > > > > > > CTO and Co-Founder, Dremio
>>> > > > > > >
>>> > > > > > > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <
>>> > > > > > adeneche@maprtech.com
>>> > > > > > > >
>>> > > > > > > wrote:
>>> > > > > > >
>>> > > > > > > > Saw similar failures when running unit tests with forkCount
>>> =
>>> > 1:
>>> > > > > > > >
>>> > > > > > > > Tests in error:
>>> > > > > > > > >
>>> > > > >
>>> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
>>> > > > > > > > > UserRemote
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>>> > > > > > > > > » Rpc
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>>> > > > > > > > > » IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>>> > > > > > > > > » IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>>> > > > > > > > > » IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>>> > > > > > > > > » IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>>> > > > > > > > > » IllegalState
>>> > > > > > > > > TestCountDownLatchInjection.latchInjected:146
>>> NullPointer
>>> > > > > > > > > TestMergingReceiver.testMultipleProvidersMixedSizes:115
>>> »
>>> > > > > > > > > IllegalReferenceCount
>>> > > > > > > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
>>> > > > > > > >
>>> > > > > > > >
>>> > > > > > > > Unfortunately I'm changing my vote to -1
>>> > > > > > > >
>>> > > > > > > >
>>> > > > > > > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <
>>> > > hgunes@maprtech.com>
>>> > > > > > > wrote:
>>> > > > > > > >
>>> > > > > > > > > -1 (binding)
>>> > > > > > > > >
>>> > > > > > > > > 5/5 consecutive runs I get the following consistently with
>>> > > > > forkCount
>>> > > > > > > set
>>> > > > > > > > to
>>> > > > > > > > > 1 on build.
>>> > > > > > > > >
>>> > > > > > > > > Tests in error:
>>> > > > > > > > >
>>> > > > >
>>> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
>>> > > > > > > > > UserRemote
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
>>> > > > > > > > > updateClient:236->BaseTestQuery.updateClient:213 »
>>> > > > IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
>>> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
>>> > > > > > > > >
>>> > > > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>>> > > > > > »
>>> > > > > > > > > IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
>>> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
>>> > > > > > > > > >BaseTestQuery.updateClient:213 » IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
>>> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
>>> > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
>>> > > > > > > stefan@activitystream.com
>>> > > > > > > > >
>>> > > > > > > > > wrote:
>>> > > > > > > > >
>>> > > > > > > > > > Hi,
>>> > > > > > > > > >
>>> > > > > > > > > > I'm not a committer and not voting but I want to point
>>> out
>>> > > that
>>> > > > > the
>>> > > > > > > > UDFs
>>> > > > > > > > > > that we are using and run with 1.1 and 1.2 do not, for
>>> some
>>> > > > > reason,
>>> > > > > > > run
>>> > > > > > > > > > with 1.3.
>>> > > > > > > > > >
>>> > > > > > > > > > I'm inclined to insist that it's something we are doing
>>> > wrong
>>> > > > but
>>> > > > > > if
>>> > > > > > > > this
>>> > > > > > > > > > counts as a test then it's failing.
>>> > > > > > > > > >
>>> > > > > > > > > > Regards,
>>> > > > > > > > > > -Stefan
>>> > > > > > > > > >
>>> > > > > > > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <
>>> > > norrisl@simba.com
>>> > > > >
>>> > > > > > > wrote:
>>> > > > > > > > > >
>>> > > > > > > > > > > +1 Non-binding.
>>> > > > > > > > > > >
>>> > > > > > > > > > > Built from source on Linux, tested ODBC against
>>> various
>>> > > data
>>> > > > > > > sources
>>> > > > > > > > > > > (Hive, DFS-csv, tsv, parquet, json)
>>> > > > > > > > > > >
>>> > > > > > > > > > > Norris
>>> > > > > > > > > > >
>>> > > > > > > > > > > -----Original Message-----
>>> > > > > > > > > > > From: Abdel Hakim Deneche [mailto:
>>> adeneche@maprtech.com]
>>> > > > > > > > > > > Sent: Monday, November 09, 2015 10:16 AM
>>> > > > > > > > > > > To: dev@drill.apache.org
>>> > > > > > > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
>>> > > > > > > > > > >
>>> > > > > > > > > > > +1
>>> > > > > > > > > > >
>>> > > > > > > > > > > Checked checksum files and gpg signature for all 3
>>> files.
>>> > > > Built
>>> > > > > > > from
>>> > > > > > > > > > > source, deployed on a 4 nodes cluster then run several
>>> > > window
>>> > > > > > > > function
>>> > > > > > > > > > > queries on TPCDS SF100. Looks great.
>>> > > > > > > > > > >
>>> > > > > > > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <
>>> > > > > > jacques@dremio.com
>>> > > > > > > >
>>> > > > > > > > > > wrote:
>>> > > > > > > > > > >
>>> > > > > > > > > > > > I've seen another instance of DRILL-4041. Since it
>>> is
>>> > > > > > exceedingly
>>> > > > > > > > > > > > rare, I don't think it is a release stopper. I will
>>> > spend
>>> > > > > some
>>> > > > > > > more
>>> > > > > > > > > > > > time reviewing it.
>>> > > > > > > > > > > >
>>> > > > > > > > > > > > --
>>> > > > > > > > > > > > Jacques Nadeau
>>> > > > > > > > > > > > CTO and Co-Founder, Dremio
>>> > > > > > > > > > > >
>>> > > > > > > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <
>>> > > > > > amit.hadke@gmail.com
>>> > > > > > > >
>>> > > > > > > > > > wrote:
>>> > > > > > > > > > > >
>>> > > > > > > > > > > > > +1, non-binding
>>> > > > > > > > > > > > > Downloaded tarball, mvn clean install Ran join
>>> > > queries,,
>>> > > > > was
>>> > > > > > > able
>>> > > > > > > > > to
>>> > > > > > > > > > > > > run queries on json, parquet and sequence files.
>>> > > > > > > > > > > > >
>>> > > > > > > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
>>> > > > > > > abhijit@dremio.com
>>> > > > > > > > >
>>> > > > > > > > > > > wrote:
>>> > > > > > > > > > > > >
>>> > > > > > > > > > > > > > resending the vote with details
>>> > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > +1, non-binding
>>> > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > ran maven tests, installed on Mac, ran drill in
>>> > > > embedded
>>> > > > > > > mode,
>>> > > > > > > > > > > > > > verified
>>> > > > > > > > > > > > > Web
>>> > > > > > > > > > > > > > UI for CSV header config changes, ran few
>>> queries
>>> > on
>>> > > > CSV
>>> > > > > > > files
>>> > > > > > > > > > > > > > with and without header, ran few queries against
>>> > > large
>>> > > > > CSV
>>> > > > > > > > files
>>> > > > > > > > > > > > > > with header in
>>> > > > > > > > > > > > > HDFS
>>> > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
>>> > > > > > > > > hyichu@maprtech.com>
>>> > > > > > > > > > > > > wrote:
>>> > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > +1
>>> > > > > > > > > > > > > > > mvn clean install on mac and linux
>>> > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > tried a few queries on distributed mode.
>>> > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > Things looked fine
>>> > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
>>> > > > > > > > > asinha@maprtech.com>
>>> > > > > > > > > > > > > wrote:
>>> > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > +1.
>>> > > > > > > > > > > > > > > > Downloaded the binary tar ball and
>>> installed on
>>> > > > Mac.
>>> > > > > > Ran
>>> > > > > > > > > > > > > > > > Drill in
>>> > > > > > > > > > > > > > > embedded
>>> > > > > > > > > > > > > > > > mode. Tested a few join, aggregation and
>>> limit
>>> > > > > queries
>>> > > > > > > > > > > > > > > > against
>>> > > > > > > > > > > > > parquet
>>> > > > > > > > > > > > > > > > data with and without metadata cache.
>>> Tested
>>> > > > > > > cancellation
>>> > > > > > > > > for
>>> > > > > > > > > > > > couple
>>> > > > > > > > > > > > > > of
>>> > > > > > > > > > > > > > > > queries. Looked at query profiles on the
>>> > WebUI.
>>> > > > > > Looks
>>> > > > > > > > > good.
>>> > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
>>> > > > > > > > > > > > > > > > <ab...@dremio.com>
>>> > > > > > > > > > > > > > wrote:
>>> > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > +1
>>> > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
>>> > > > > > > > andrew@primer.org>
>>> > > > > > > > > > > > wrote:
>>> > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > +1 (non-binding, non-comitter)
>>> > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques
>>> > > Nadeau <
>>> > > > > > > > > > > > > jacques@dremio.com>
>>> > > > > > > > > > > > > > > > > wrote:
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > > Hey Everybody,
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > > I'd like to propose a new release
>>> > candidate
>>> > > > of
>>> > > > > > > Apache
>>> > > > > > > > > > > > > > > > > > > Drill,
>>> > > > > > > > > > > > > > > version
>>> > > > > > > > > > > > > > > > > > > 1.3.0. This is the second release
>>> > > candidate
>>> > > > > > (rc1).
>>> > > > > > > > > > > > > > > > > > > This
>>> > > > > > > > > > > > > > addresses
>>> > > > > > > > > > > > > > > > > some
>>> > > > > > > > > > > > > > > > > > > issues identified in the first release
>>> > > > > candidate
>>> > > > > > > > > > > > > > > > > > > including
>>> > > > > > > > > > > > some
>>> > > > > > > > > > > > > > > test
>>> > > > > > > > > > > > > > > > > > > threading issues, Parquet dictionary
>>> read
>>> > > > issue
>>> > > > > > > with
>>> > > > > > > > > > > > > > > > > > > binary
>>> > > > > > > > > > > > > > values,
>>> > > > > > > > > > > > > > > > > Joda
>>> > > > > > > > > > > > > > > > > > > upgrade to avoid a concurrency bug
>>> and a
>>> > > > couple
>>> > > > > > > other
>>> > > > > > > > > > > > > > > > > > > small
>>> > > > > > > > > > > > > > things.
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > > The tarball artifacts are hosted at
>>> [2]
>>> > and
>>> > > > the
>>> > > > > > > maven
>>> > > > > > > > > > > > artifacts
>>> > > > > > > > > > > > > > are
>>> > > > > > > > > > > > > > > > > > hosted
>>> > > > > > > > > > > > > > > > > > > at [3]. This release candidate is
>>> based
>>> > on
>>> > > > > commit
>>> > > > > > > > > > > > > > > > > > >
>>> f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305
>>> > > > > located
>>> > > > > > at
>>> > > > > > > > > [4].
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > > The vote will be open for 72 hours
>>> ending
>>> > > at
>>> > > > > 10PM
>>> > > > > > > > > > > > > > > > > > > Pacific,
>>> > > > > > > > > > > > > > November
>>> > > > > > > > > > > > > > > > 9,
>>> > > > > > > > > > > > > > > > > > 2015.
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > > [ ] +1
>>> > > > > > > > > > > > > > > > > > > [ ] +0
>>> > > > > > > > > > > > > > > > > > > [ ] -1
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > > thanks,
>>> > > > > > > > > > > > > > > > > > > Jacques
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > > [1]
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > >
>>> > > > > > > > > > > > >
>>> > > > > > > > > > > >
>>> > > > > > > > >
>>> > > > > >
>>> > >
>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
>>> > > > > > > > > > > > 820&version=12332946[2]
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
>>> > > > > > > > > > > > > > > > > > > /
>>> > > > > > > > > > > > > > > > > > > [3]
>>> > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > >
>>> > > > > > > > > > > >
>>> > > > > > > > >
>>> > > > > >
>>> > >
>>> https://repository.apache.org/content/repositories/orgapachedrill-1014
>>> > > > > > > > > > > > /
>>> > > > > > > > > > > > > > > > > > > [4]
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
>>> > > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > > > --
>>> > > > > > > > > > > > > > > > > > > Jacques Nadeau
>>> > > > > > > > > > > > > > > > > > > CTO and Co-Founder, Dremio
>>> > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > > >
>>> > > > > > > > > > > > > >
>>> > > > > > > > > > > > >
>>> > > > > > > > > > > >
>>> > > > > > > > > > >
>>> > > > > > > > > > >
>>> > > > > > > > > > >
>>> > > > > > > > > > > --
>>> > > > > > > > > > >
>>> > > > > > > > > > > Abdelhakim Deneche
>>> > > > > > > > > > >
>>> > > > > > > > > > > Software Engineer
>>> > > > > > > > > > >
>>> > > > > > > > > > > <http://www.mapr.com/>
>>> > > > > > > > > > >
>>> > > > > > > > > > >
>>> > > > > > > > > > > Now Available - Free Hadoop On-Demand Training <
>>> > > > > > > > > > >
>>> > > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
>>> > > > > > > > > > > >
>>> > > > > > > > > > >
>>> > > > > > > > > >
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > > >
>>> > > > > > > >
>>> > > > > > > > --
>>> > > > > > > >
>>> > > > > > > > Abdelhakim Deneche
>>> > > > > > > >
>>> > > > > > > > Software Engineer
>>> > > > > > > >
>>> > > > > > > > <http://www.mapr.com/>
>>> > > > > > > >
>>> > > > > > > >
>>> > > > > > > > Now Available - Free Hadoop On-Demand Training
>>> > > > > > > > <
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
>>> > > > > > > > >
>>> > > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > > >
>>> > > > > >
>>> > > > > > --
>>> > > > > >
>>> > > > > > Abdelhakim Deneche
>>> > > > > >
>>> > > > > > Software Engineer
>>> > > > > >
>>> > > > > > <http://www.mapr.com/>
>>> > > > > >
>>> > > > > >
>>> > > > > > Now Available - Free Hadoop On-Demand Training
>>> > > > > > <
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>>
>>
>>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Jacques Nadeau <ja...@dremio.com>.
I think that is enough -1's that we should sink this release and get this
test figured out. I will spend some time looking at it this morning. Can
some others also lend a hand?
If we can't figure out why the impersonation test is causing problems (or a
solution), I'm inclined to disable it and stop holding up the release. It
definitely seems like it probably has more to do with the test structure
itself rather than the a Drill bug.
I'll shoot to start a new release candidate vote later today. In terms of
master, I propose that we fork a 1.3.0 release branch at commit
e78e28661e921c6bd07ba7bb95d91f9adeb5a247 and then we can reopen changes on
master.
thanks,
Jacques
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Mon, Nov 9, 2015 at 6:14 PM, Jacques Nadeau <ja...@dremio.com> wrote:
> Anybody want to profile what the impersonation tests are doing that are
> causing so many problems with resources?
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Mon, Nov 9, 2015 at 5:24 PM, Hanifi Gunes <hg...@maprtech.com> wrote:
>
>> 1024/4096/2032195 <==> soft/hard/system
>>
>> On Mon, Nov 9, 2015 at 4:50 PM, Jacques Nadeau <ja...@dremio.com>
>> wrote:
>>
>> > What about open files?
>> > On Nov 9, 2015 4:20 PM, "Hanifi Gunes" <hg...@maprtech.com> wrote:
>> >
>> > > Using the default parallelism, I get the same set of exceptions on
>> > CentOS.
>> > >
>> > > Also max # of threads per process is the system default, 319548.
>> > >
>> > > On Mon, Nov 9, 2015 at 4:13 PM, Amit Hadke <am...@gmail.com>
>> wrote:
>> > >
>> > > > Unfortunately, yes I changed them at OS level.
>> > > >
>> > > > I agree that making OS level changes to run tests is not something
>> we
>> > > > should advocate.
>> > > > It was just an observation that tests seem to pass on linux with
>> > default
>> > > > settings but on mac behavior is irregular.
>> > > >
>> > > > ~ Amit.
>> > > >
>> > > >
>> > > > On Mon, Nov 9, 2015 at 3:48 PM, Jason Altekruse <
>> > > altekrusejason@gmail.com>
>> > > > wrote:
>> > > >
>> > > > > Amit,
>> > > > >
>> > > > > Did you change these at the OS level? I would hope that we
>> wouldn't
>> > > have
>> > > > to
>> > > > > make people jump through such hoops to run the build, was there a
>> > > thread
>> > > > I
>> > > > > missed where we discussed this something that we should be
>> expecting
>> > > > > everyone to do? I did see the threads about increasing the maven
>> > > permgen
>> > > > > and did so accordingly, but I think adjusting something like the
>> > system
>> > > > > ulimit is something we really should try to avoid.
>> > > > >
>> > > > > On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche <
>> > > > adeneche@maprtech.com
>> > > > > >
>> > > > > wrote:
>> > > > >
>> > > > > > I just tried with the default forkCount and got similar
>> failures.
>> > I'm
>> > > > > > running the tests on a linux machine with the default maven
>> options
>> > > > > >
>> > > > > > Thanks
>> > > > > >
>> > > > > > On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <
>> jacques@dremio.com
>> > >
>> > > > > wrote:
>> > > > > >
>> > > > > > > So you're changing the forkCount from the default? What
>> happens
>> > > when
>> > > > > you
>> > > > > > > run with the default?
>> > > > > > >
>> > > > > > > Also, did you guys run with extra permgen or the default?
>> Also,
>> > can
>> > > > you
>> > > > > > > confirm what type of machine you are running on?
>> > > > > > >
>> > > > > > > Want to figure out why things are different.
>> > > > > > >
>> > > > > > > thanks,
>> > > > > > > Jacques
>> > > > > > >
>> > > > > > > --
>> > > > > > > Jacques Nadeau
>> > > > > > > CTO and Co-Founder, Dremio
>> > > > > > >
>> > > > > > > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <
>> > > > > > adeneche@maprtech.com
>> > > > > > > >
>> > > > > > > wrote:
>> > > > > > >
>> > > > > > > > Saw similar failures when running unit tests with forkCount
>> =
>> > 1:
>> > > > > > > >
>> > > > > > > > Tests in error:
>> > > > > > > > >
>> > > > >
>> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
>> > > > > > > > > UserRemote
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>> > > > > > > > > » Rpc
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>> > > > > > > > > » IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>> > > > > > > > > » IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>> > > > > > > > > » IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>> > > > > > > > > » IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>> > > > > > > > > » IllegalState
>> > > > > > > > > TestCountDownLatchInjection.latchInjected:146
>> NullPointer
>> > > > > > > > > TestMergingReceiver.testMultipleProvidersMixedSizes:115
>> »
>> > > > > > > > > IllegalReferenceCount
>> > > > > > > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > Unfortunately I'm changing my vote to -1
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <
>> > > hgunes@maprtech.com>
>> > > > > > > wrote:
>> > > > > > > >
>> > > > > > > > > -1 (binding)
>> > > > > > > > >
>> > > > > > > > > 5/5 consecutive runs I get the following consistently with
>> > > > > forkCount
>> > > > > > > set
>> > > > > > > > to
>> > > > > > > > > 1 on build.
>> > > > > > > > >
>> > > > > > > > > Tests in error:
>> > > > > > > > >
>> > > > >
>> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
>> > > > > > > > > UserRemote
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
>> > > > > > > > > updateClient:236->BaseTestQuery.updateClient:213 »
>> > > > IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
>> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
>> > > > > > > > >
>> > > > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
>> > > > > > »
>> > > > > > > > > IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
>> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
>> > > > > > > > > >BaseTestQuery.updateClient:213 » IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
>> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
>> > > > > > > stefan@activitystream.com
>> > > > > > > > >
>> > > > > > > > > wrote:
>> > > > > > > > >
>> > > > > > > > > > Hi,
>> > > > > > > > > >
>> > > > > > > > > > I'm not a committer and not voting but I want to point
>> out
>> > > that
>> > > > > the
>> > > > > > > > UDFs
>> > > > > > > > > > that we are using and run with 1.1 and 1.2 do not, for
>> some
>> > > > > reason,
>> > > > > > > run
>> > > > > > > > > > with 1.3.
>> > > > > > > > > >
>> > > > > > > > > > I'm inclined to insist that it's something we are doing
>> > wrong
>> > > > but
>> > > > > > if
>> > > > > > > > this
>> > > > > > > > > > counts as a test then it's failing.
>> > > > > > > > > >
>> > > > > > > > > > Regards,
>> > > > > > > > > > -Stefan
>> > > > > > > > > >
>> > > > > > > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <
>> > > norrisl@simba.com
>> > > > >
>> > > > > > > wrote:
>> > > > > > > > > >
>> > > > > > > > > > > +1 Non-binding.
>> > > > > > > > > > >
>> > > > > > > > > > > Built from source on Linux, tested ODBC against
>> various
>> > > data
>> > > > > > > sources
>> > > > > > > > > > > (Hive, DFS-csv, tsv, parquet, json)
>> > > > > > > > > > >
>> > > > > > > > > > > Norris
>> > > > > > > > > > >
>> > > > > > > > > > > -----Original Message-----
>> > > > > > > > > > > From: Abdel Hakim Deneche [mailto:
>> adeneche@maprtech.com]
>> > > > > > > > > > > Sent: Monday, November 09, 2015 10:16 AM
>> > > > > > > > > > > To: dev@drill.apache.org
>> > > > > > > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
>> > > > > > > > > > >
>> > > > > > > > > > > +1
>> > > > > > > > > > >
>> > > > > > > > > > > Checked checksum files and gpg signature for all 3
>> files.
>> > > > Built
>> > > > > > > from
>> > > > > > > > > > > source, deployed on a 4 nodes cluster then run several
>> > > window
>> > > > > > > > function
>> > > > > > > > > > > queries on TPCDS SF100. Looks great.
>> > > > > > > > > > >
>> > > > > > > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <
>> > > > > > jacques@dremio.com
>> > > > > > > >
>> > > > > > > > > > wrote:
>> > > > > > > > > > >
>> > > > > > > > > > > > I've seen another instance of DRILL-4041. Since it
>> is
>> > > > > > exceedingly
>> > > > > > > > > > > > rare, I don't think it is a release stopper. I will
>> > spend
>> > > > > some
>> > > > > > > more
>> > > > > > > > > > > > time reviewing it.
>> > > > > > > > > > > >
>> > > > > > > > > > > > --
>> > > > > > > > > > > > Jacques Nadeau
>> > > > > > > > > > > > CTO and Co-Founder, Dremio
>> > > > > > > > > > > >
>> > > > > > > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <
>> > > > > > amit.hadke@gmail.com
>> > > > > > > >
>> > > > > > > > > > wrote:
>> > > > > > > > > > > >
>> > > > > > > > > > > > > +1, non-binding
>> > > > > > > > > > > > > Downloaded tarball, mvn clean install Ran join
>> > > queries,,
>> > > > > was
>> > > > > > > able
>> > > > > > > > > to
>> > > > > > > > > > > > > run queries on json, parquet and sequence files.
>> > > > > > > > > > > > >
>> > > > > > > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
>> > > > > > > abhijit@dremio.com
>> > > > > > > > >
>> > > > > > > > > > > wrote:
>> > > > > > > > > > > > >
>> > > > > > > > > > > > > > resending the vote with details
>> > > > > > > > > > > > > >
>> > > > > > > > > > > > > > +1, non-binding
>> > > > > > > > > > > > > >
>> > > > > > > > > > > > > > ran maven tests, installed on Mac, ran drill in
>> > > > embedded
>> > > > > > > mode,
>> > > > > > > > > > > > > > verified
>> > > > > > > > > > > > > Web
>> > > > > > > > > > > > > > UI for CSV header config changes, ran few
>> queries
>> > on
>> > > > CSV
>> > > > > > > files
>> > > > > > > > > > > > > > with and without header, ran few queries against
>> > > large
>> > > > > CSV
>> > > > > > > > files
>> > > > > > > > > > > > > > with header in
>> > > > > > > > > > > > > HDFS
>> > > > > > > > > > > > > >
>> > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
>> > > > > > > > > hyichu@maprtech.com>
>> > > > > > > > > > > > > wrote:
>> > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > +1
>> > > > > > > > > > > > > > > mvn clean install on mac and linux
>> > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > tried a few queries on distributed mode.
>> > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > Things looked fine
>> > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
>> > > > > > > > > asinha@maprtech.com>
>> > > > > > > > > > > > > wrote:
>> > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > +1.
>> > > > > > > > > > > > > > > > Downloaded the binary tar ball and
>> installed on
>> > > > Mac.
>> > > > > > Ran
>> > > > > > > > > > > > > > > > Drill in
>> > > > > > > > > > > > > > > embedded
>> > > > > > > > > > > > > > > > mode. Tested a few join, aggregation and
>> limit
>> > > > > queries
>> > > > > > > > > > > > > > > > against
>> > > > > > > > > > > > > parquet
>> > > > > > > > > > > > > > > > data with and without metadata cache.
>> Tested
>> > > > > > > cancellation
>> > > > > > > > > for
>> > > > > > > > > > > > couple
>> > > > > > > > > > > > > > of
>> > > > > > > > > > > > > > > > queries. Looked at query profiles on the
>> > WebUI.
>> > > > > > Looks
>> > > > > > > > > good.
>> > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
>> > > > > > > > > > > > > > > > <ab...@dremio.com>
>> > > > > > > > > > > > > > wrote:
>> > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > +1
>> > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
>> > > > > > > > andrew@primer.org>
>> > > > > > > > > > > > wrote:
>> > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > +1 (non-binding, non-comitter)
>> > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques
>> > > Nadeau <
>> > > > > > > > > > > > > jacques@dremio.com>
>> > > > > > > > > > > > > > > > > wrote:
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > > Hey Everybody,
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > > I'd like to propose a new release
>> > candidate
>> > > > of
>> > > > > > > Apache
>> > > > > > > > > > > > > > > > > > > Drill,
>> > > > > > > > > > > > > > > version
>> > > > > > > > > > > > > > > > > > > 1.3.0. This is the second release
>> > > candidate
>> > > > > > (rc1).
>> > > > > > > > > > > > > > > > > > > This
>> > > > > > > > > > > > > > addresses
>> > > > > > > > > > > > > > > > > some
>> > > > > > > > > > > > > > > > > > > issues identified in the first release
>> > > > > candidate
>> > > > > > > > > > > > > > > > > > > including
>> > > > > > > > > > > > some
>> > > > > > > > > > > > > > > test
>> > > > > > > > > > > > > > > > > > > threading issues, Parquet dictionary
>> read
>> > > > issue
>> > > > > > > with
>> > > > > > > > > > > > > > > > > > > binary
>> > > > > > > > > > > > > > values,
>> > > > > > > > > > > > > > > > > Joda
>> > > > > > > > > > > > > > > > > > > upgrade to avoid a concurrency bug
>> and a
>> > > > couple
>> > > > > > > other
>> > > > > > > > > > > > > > > > > > > small
>> > > > > > > > > > > > > > things.
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > > The tarball artifacts are hosted at
>> [2]
>> > and
>> > > > the
>> > > > > > > maven
>> > > > > > > > > > > > artifacts
>> > > > > > > > > > > > > > are
>> > > > > > > > > > > > > > > > > > hosted
>> > > > > > > > > > > > > > > > > > > at [3]. This release candidate is
>> based
>> > on
>> > > > > commit
>> > > > > > > > > > > > > > > > > > >
>> f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305
>> > > > > located
>> > > > > > at
>> > > > > > > > > [4].
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > > The vote will be open for 72 hours
>> ending
>> > > at
>> > > > > 10PM
>> > > > > > > > > > > > > > > > > > > Pacific,
>> > > > > > > > > > > > > > November
>> > > > > > > > > > > > > > > > 9,
>> > > > > > > > > > > > > > > > > > 2015.
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > > [ ] +1
>> > > > > > > > > > > > > > > > > > > [ ] +0
>> > > > > > > > > > > > > > > > > > > [ ] -1
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > > thanks,
>> > > > > > > > > > > > > > > > > > > Jacques
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > > [1]
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > >
>> > > > > > > > > > > > > >
>> > > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > >
>> > > > > >
>> > >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
>> > > > > > > > > > > > 820&version=12332946[2]
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
>> > > > > > > > > > > > > > > > > > > /
>> > > > > > > > > > > > > > > > > > > [3]
>> > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > >
>> > > > > >
>> > >
>> https://repository.apache.org/content/repositories/orgapachedrill-1014
>> > > > > > > > > > > > /
>> > > > > > > > > > > > > > > > > > > [4]
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
>> > > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > > > --
>> > > > > > > > > > > > > > > > > > > Jacques Nadeau
>> > > > > > > > > > > > > > > > > > > CTO and Co-Founder, Dremio
>> > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > > >
>> > > > > > > > > > > > > > >
>> > > > > > > > > > > > > >
>> > > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > > --
>> > > > > > > > > > >
>> > > > > > > > > > > Abdelhakim Deneche
>> > > > > > > > > > >
>> > > > > > > > > > > Software Engineer
>> > > > > > > > > > >
>> > > > > > > > > > > <http://www.mapr.com/>
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > > Now Available - Free Hadoop On-Demand Training <
>> > > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
>> > > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > --
>> > > > > > > >
>> > > > > > > > Abdelhakim Deneche
>> > > > > > > >
>> > > > > > > > Software Engineer
>> > > > > > > >
>> > > > > > > > <http://www.mapr.com/>
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > Now Available - Free Hadoop On-Demand Training
>> > > > > > > > <
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > --
>> > > > > >
>> > > > > > Abdelhakim Deneche
>> > > > > >
>> > > > > > Software Engineer
>> > > > > >
>> > > > > > <http://www.mapr.com/>
>> > > > > >
>> > > > > >
>> > > > > > Now Available - Free Hadoop On-Demand Training
>> > > > > > <
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Jacques Nadeau <ja...@dremio.com>.
Anybody want to profile what the impersonation tests are doing that are
causing so many problems with resources?
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Mon, Nov 9, 2015 at 5:24 PM, Hanifi Gunes <hg...@maprtech.com> wrote:
> 1024/4096/2032195 <==> soft/hard/system
>
> On Mon, Nov 9, 2015 at 4:50 PM, Jacques Nadeau <ja...@dremio.com> wrote:
>
> > What about open files?
> > On Nov 9, 2015 4:20 PM, "Hanifi Gunes" <hg...@maprtech.com> wrote:
> >
> > > Using the default parallelism, I get the same set of exceptions on
> > CentOS.
> > >
> > > Also max # of threads per process is the system default, 319548.
> > >
> > > On Mon, Nov 9, 2015 at 4:13 PM, Amit Hadke <am...@gmail.com>
> wrote:
> > >
> > > > Unfortunately, yes I changed them at OS level.
> > > >
> > > > I agree that making OS level changes to run tests is not something we
> > > > should advocate.
> > > > It was just an observation that tests seem to pass on linux with
> > default
> > > > settings but on mac behavior is irregular.
> > > >
> > > > ~ Amit.
> > > >
> > > >
> > > > On Mon, Nov 9, 2015 at 3:48 PM, Jason Altekruse <
> > > altekrusejason@gmail.com>
> > > > wrote:
> > > >
> > > > > Amit,
> > > > >
> > > > > Did you change these at the OS level? I would hope that we wouldn't
> > > have
> > > > to
> > > > > make people jump through such hoops to run the build, was there a
> > > thread
> > > > I
> > > > > missed where we discussed this something that we should be
> expecting
> > > > > everyone to do? I did see the threads about increasing the maven
> > > permgen
> > > > > and did so accordingly, but I think adjusting something like the
> > system
> > > > > ulimit is something we really should try to avoid.
> > > > >
> > > > > On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche <
> > > > adeneche@maprtech.com
> > > > > >
> > > > > wrote:
> > > > >
> > > > > > I just tried with the default forkCount and got similar failures.
> > I'm
> > > > > > running the tests on a linux machine with the default maven
> options
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > > On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <
> jacques@dremio.com
> > >
> > > > > wrote:
> > > > > >
> > > > > > > So you're changing the forkCount from the default? What happens
> > > when
> > > > > you
> > > > > > > run with the default?
> > > > > > >
> > > > > > > Also, did you guys run with extra permgen or the default? Also,
> > can
> > > > you
> > > > > > > confirm what type of machine you are running on?
> > > > > > >
> > > > > > > Want to figure out why things are different.
> > > > > > >
> > > > > > > thanks,
> > > > > > > Jacques
> > > > > > >
> > > > > > > --
> > > > > > > Jacques Nadeau
> > > > > > > CTO and Co-Founder, Dremio
> > > > > > >
> > > > > > > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <
> > > > > > adeneche@maprtech.com
> > > > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Saw similar failures when running unit tests with forkCount =
> > 1:
> > > > > > > >
> > > > > > > > Tests in error:
> > > > > > > > >
> > > > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView
> »
> > > > > > > > > UserRemote
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > > » Rpc
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > > » IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > > » IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > > » IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > > » IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > > » IllegalState
> > > > > > > > > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > > > > > > > > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > > > > > > > > IllegalReferenceCount
> > > > > > > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
> > > > > > > >
> > > > > > > >
> > > > > > > > Unfortunately I'm changing my vote to -1
> > > > > > > >
> > > > > > > >
> > > > > > > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <
> > > hgunes@maprtech.com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > -1 (binding)
> > > > > > > > >
> > > > > > > > > 5/5 consecutive runs I get the following consistently with
> > > > > forkCount
> > > > > > > set
> > > > > > > > to
> > > > > > > > > 1 on build.
> > > > > > > > >
> > > > > > > > > Tests in error:
> > > > > > > > >
> > > > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView
> »
> > > > > > > > > UserRemote
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > > > > > > > > updateClient:236->BaseTestQuery.updateClient:213 »
> > > > IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > > > > > > > >
> > > > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > »
> > > > > > > > > IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > > > > > > > > >BaseTestQuery.updateClient:213 » IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
> > > > > > > stefan@activitystream.com
> > > > > > > > >
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hi,
> > > > > > > > > >
> > > > > > > > > > I'm not a committer and not voting but I want to point
> out
> > > that
> > > > > the
> > > > > > > > UDFs
> > > > > > > > > > that we are using and run with 1.1 and 1.2 do not, for
> some
> > > > > reason,
> > > > > > > run
> > > > > > > > > > with 1.3.
> > > > > > > > > >
> > > > > > > > > > I'm inclined to insist that it's something we are doing
> > wrong
> > > > but
> > > > > > if
> > > > > > > > this
> > > > > > > > > > counts as a test then it's failing.
> > > > > > > > > >
> > > > > > > > > > Regards,
> > > > > > > > > > -Stefan
> > > > > > > > > >
> > > > > > > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <
> > > norrisl@simba.com
> > > > >
> > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1 Non-binding.
> > > > > > > > > > >
> > > > > > > > > > > Built from source on Linux, tested ODBC against various
> > > data
> > > > > > > sources
> > > > > > > > > > > (Hive, DFS-csv, tsv, parquet, json)
> > > > > > > > > > >
> > > > > > > > > > > Norris
> > > > > > > > > > >
> > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > From: Abdel Hakim Deneche [mailto:
> adeneche@maprtech.com]
> > > > > > > > > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > > > > > > > > To: dev@drill.apache.org
> > > > > > > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > > > > > > > > >
> > > > > > > > > > > +1
> > > > > > > > > > >
> > > > > > > > > > > Checked checksum files and gpg signature for all 3
> files.
> > > > Built
> > > > > > > from
> > > > > > > > > > > source, deployed on a 4 nodes cluster then run several
> > > window
> > > > > > > > function
> > > > > > > > > > > queries on TPCDS SF100. Looks great.
> > > > > > > > > > >
> > > > > > > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <
> > > > > > jacques@dremio.com
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > I've seen another instance of DRILL-4041. Since it is
> > > > > > exceedingly
> > > > > > > > > > > > rare, I don't think it is a release stopper. I will
> > spend
> > > > > some
> > > > > > > more
> > > > > > > > > > > > time reviewing it.
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > > >
> > > > > > > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <
> > > > > > amit.hadke@gmail.com
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > +1, non-binding
> > > > > > > > > > > > > Downloaded tarball, mvn clean install Ran join
> > > queries,,
> > > > > was
> > > > > > > able
> > > > > > > > > to
> > > > > > > > > > > > > run queries on json, parquet and sequence files.
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
> > > > > > > abhijit@dremio.com
> > > > > > > > >
> > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > resending the vote with details
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > +1, non-binding
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > ran maven tests, installed on Mac, ran drill in
> > > > embedded
> > > > > > > mode,
> > > > > > > > > > > > > > verified
> > > > > > > > > > > > > Web
> > > > > > > > > > > > > > UI for CSV header config changes, ran few queries
> > on
> > > > CSV
> > > > > > > files
> > > > > > > > > > > > > > with and without header, ran few queries against
> > > large
> > > > > CSV
> > > > > > > > files
> > > > > > > > > > > > > > with header in
> > > > > > > > > > > > > HDFS
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > > > > > > > > hyichu@maprtech.com>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > +1
> > > > > > > > > > > > > > > mvn clean install on mac and linux
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > tried a few queries on distributed mode.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Things looked fine
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > > > > > > > > asinha@maprtech.com>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > +1.
> > > > > > > > > > > > > > > > Downloaded the binary tar ball and installed
> on
> > > > Mac.
> > > > > > Ran
> > > > > > > > > > > > > > > > Drill in
> > > > > > > > > > > > > > > embedded
> > > > > > > > > > > > > > > > mode. Tested a few join, aggregation and
> limit
> > > > > queries
> > > > > > > > > > > > > > > > against
> > > > > > > > > > > > > parquet
> > > > > > > > > > > > > > > > data with and without metadata cache. Tested
> > > > > > > cancellation
> > > > > > > > > for
> > > > > > > > > > > > couple
> > > > > > > > > > > > > > of
> > > > > > > > > > > > > > > > queries. Looked at query profiles on the
> > WebUI.
> > > > > > Looks
> > > > > > > > > good.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > > > > > > > > <ab...@dremio.com>
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > +1
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> > > > > > > > andrew@primer.org>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques
> > > Nadeau <
> > > > > > > > > > > > > jacques@dremio.com>
> > > > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > > I'd like to propose a new release
> > candidate
> > > > of
> > > > > > > Apache
> > > > > > > > > > > > > > > > > > > Drill,
> > > > > > > > > > > > > > > version
> > > > > > > > > > > > > > > > > > > 1.3.0. This is the second release
> > > candidate
> > > > > > (rc1).
> > > > > > > > > > > > > > > > > > > This
> > > > > > > > > > > > > > addresses
> > > > > > > > > > > > > > > > > some
> > > > > > > > > > > > > > > > > > > issues identified in the first release
> > > > > candidate
> > > > > > > > > > > > > > > > > > > including
> > > > > > > > > > > > some
> > > > > > > > > > > > > > > test
> > > > > > > > > > > > > > > > > > > threading issues, Parquet dictionary
> read
> > > > issue
> > > > > > > with
> > > > > > > > > > > > > > > > > > > binary
> > > > > > > > > > > > > > values,
> > > > > > > > > > > > > > > > > Joda
> > > > > > > > > > > > > > > > > > > upgrade to avoid a concurrency bug and
> a
> > > > couple
> > > > > > > other
> > > > > > > > > > > > > > > > > > > small
> > > > > > > > > > > > > > things.
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > > The tarball artifacts are hosted at [2]
> > and
> > > > the
> > > > > > > maven
> > > > > > > > > > > > artifacts
> > > > > > > > > > > > > > are
> > > > > > > > > > > > > > > > > > hosted
> > > > > > > > > > > > > > > > > > > at [3]. This release candidate is based
> > on
> > > > > commit
> > > > > > > > > > > > > > > > > > >
> f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305
> > > > > located
> > > > > > at
> > > > > > > > > [4].
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > > The vote will be open for 72 hours
> ending
> > > at
> > > > > 10PM
> > > > > > > > > > > > > > > > > > > Pacific,
> > > > > > > > > > > > > > November
> > > > > > > > > > > > > > > > 9,
> > > > > > > > > > > > > > > > > > 2015.
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > > > > > > > > [ ] -1
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > > thanks,
> > > > > > > > > > > > > > > > > > > Jacques
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > > [1]
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > >
> > > > > >
> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > > > > > > > > 820&version=12332946[2]
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > > > > > > > > /
> > > > > > > > > > > > > > > > > > > [3]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > >
> > > > > >
> > > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > > > > > > > > /
> > > > > > > > > > > > > > > > > > > [4]
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > >
> > > > > > > > > > > Abdelhakim Deneche
> > > > > > > > > > >
> > > > > > > > > > > Software Engineer
> > > > > > > > > > >
> > > > > > > > > > > <http://www.mapr.com/>
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Now Available - Free Hadoop On-Demand Training <
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > >
> > > > > > > > Abdelhakim Deneche
> > > > > > > >
> > > > > > > > Software Engineer
> > > > > > > >
> > > > > > > > <http://www.mapr.com/>
> > > > > > > >
> > > > > > > >
> > > > > > > > Now Available - Free Hadoop On-Demand Training
> > > > > > > > <
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > >
> > > > > > Abdelhakim Deneche
> > > > > >
> > > > > > Software Engineer
> > > > > >
> > > > > > <http://www.mapr.com/>
> > > > > >
> > > > > >
> > > > > > Now Available - Free Hadoop On-Demand Training
> > > > > > <
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Hanifi Gunes <hg...@maprtech.com>.
1024/4096/2032195 <==> soft/hard/system
On Mon, Nov 9, 2015 at 4:50 PM, Jacques Nadeau <ja...@dremio.com> wrote:
> What about open files?
> On Nov 9, 2015 4:20 PM, "Hanifi Gunes" <hg...@maprtech.com> wrote:
>
> > Using the default parallelism, I get the same set of exceptions on
> CentOS.
> >
> > Also max # of threads per process is the system default, 319548.
> >
> > On Mon, Nov 9, 2015 at 4:13 PM, Amit Hadke <am...@gmail.com> wrote:
> >
> > > Unfortunately, yes I changed them at OS level.
> > >
> > > I agree that making OS level changes to run tests is not something we
> > > should advocate.
> > > It was just an observation that tests seem to pass on linux with
> default
> > > settings but on mac behavior is irregular.
> > >
> > > ~ Amit.
> > >
> > >
> > > On Mon, Nov 9, 2015 at 3:48 PM, Jason Altekruse <
> > altekrusejason@gmail.com>
> > > wrote:
> > >
> > > > Amit,
> > > >
> > > > Did you change these at the OS level? I would hope that we wouldn't
> > have
> > > to
> > > > make people jump through such hoops to run the build, was there a
> > thread
> > > I
> > > > missed where we discussed this something that we should be expecting
> > > > everyone to do? I did see the threads about increasing the maven
> > permgen
> > > > and did so accordingly, but I think adjusting something like the
> system
> > > > ulimit is something we really should try to avoid.
> > > >
> > > > On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche <
> > > adeneche@maprtech.com
> > > > >
> > > > wrote:
> > > >
> > > > > I just tried with the default forkCount and got similar failures.
> I'm
> > > > > running the tests on a linux machine with the default maven options
> > > > >
> > > > > Thanks
> > > > >
> > > > > On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <jacques@dremio.com
> >
> > > > wrote:
> > > > >
> > > > > > So you're changing the forkCount from the default? What happens
> > when
> > > > you
> > > > > > run with the default?
> > > > > >
> > > > > > Also, did you guys run with extra permgen or the default? Also,
> can
> > > you
> > > > > > confirm what type of machine you are running on?
> > > > > >
> > > > > > Want to figure out why things are different.
> > > > > >
> > > > > > thanks,
> > > > > > Jacques
> > > > > >
> > > > > > --
> > > > > > Jacques Nadeau
> > > > > > CTO and Co-Founder, Dremio
> > > > > >
> > > > > > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <
> > > > > adeneche@maprtech.com
> > > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Saw similar failures when running unit tests with forkCount =
> 1:
> > > > > > >
> > > > > > > Tests in error:
> > > > > > > >
> > > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > > > > > UserRemote
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > » Rpc
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > » IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > » IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > » IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > » IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > > » IllegalState
> > > > > > > > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > > > > > > > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > > > > > > > IllegalReferenceCount
> > > > > > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
> > > > > > >
> > > > > > >
> > > > > > > Unfortunately I'm changing my vote to -1
> > > > > > >
> > > > > > >
> > > > > > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <
> > hgunes@maprtech.com>
> > > > > > wrote:
> > > > > > >
> > > > > > > > -1 (binding)
> > > > > > > >
> > > > > > > > 5/5 consecutive runs I get the following consistently with
> > > > forkCount
> > > > > > set
> > > > > > > to
> > > > > > > > 1 on build.
> > > > > > > >
> > > > > > > > Tests in error:
> > > > > > > >
> > > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > > > > > UserRemote
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > > > > > > > updateClient:236->BaseTestQuery.updateClient:213 »
> > > IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > > > > > > >
> > > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > »
> > > > > > > > IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > > > > > > > >BaseTestQuery.updateClient:213 » IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > > > >
> > > > > > > >
> > > > > > > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
> > > > > > stefan@activitystream.com
> > > > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > I'm not a committer and not voting but I want to point out
> > that
> > > > the
> > > > > > > UDFs
> > > > > > > > > that we are using and run with 1.1 and 1.2 do not, for some
> > > > reason,
> > > > > > run
> > > > > > > > > with 1.3.
> > > > > > > > >
> > > > > > > > > I'm inclined to insist that it's something we are doing
> wrong
> > > but
> > > > > if
> > > > > > > this
> > > > > > > > > counts as a test then it's failing.
> > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > > -Stefan
> > > > > > > > >
> > > > > > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <
> > norrisl@simba.com
> > > >
> > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1 Non-binding.
> > > > > > > > > >
> > > > > > > > > > Built from source on Linux, tested ODBC against various
> > data
> > > > > > sources
> > > > > > > > > > (Hive, DFS-csv, tsv, parquet, json)
> > > > > > > > > >
> > > > > > > > > > Norris
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > > > > > > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > > > > > > > To: dev@drill.apache.org
> > > > > > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > > > > > > > >
> > > > > > > > > > +1
> > > > > > > > > >
> > > > > > > > > > Checked checksum files and gpg signature for all 3 files.
> > > Built
> > > > > > from
> > > > > > > > > > source, deployed on a 4 nodes cluster then run several
> > window
> > > > > > > function
> > > > > > > > > > queries on TPCDS SF100. Looks great.
> > > > > > > > > >
> > > > > > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <
> > > > > jacques@dremio.com
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > I've seen another instance of DRILL-4041. Since it is
> > > > > exceedingly
> > > > > > > > > > > rare, I don't think it is a release stopper. I will
> spend
> > > > some
> > > > > > more
> > > > > > > > > > > time reviewing it.
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > >
> > > > > > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <
> > > > > amit.hadke@gmail.com
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > +1, non-binding
> > > > > > > > > > > > Downloaded tarball, mvn clean install Ran join
> > queries,,
> > > > was
> > > > > > able
> > > > > > > > to
> > > > > > > > > > > > run queries on json, parquet and sequence files.
> > > > > > > > > > > >
> > > > > > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
> > > > > > abhijit@dremio.com
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > resending the vote with details
> > > > > > > > > > > > >
> > > > > > > > > > > > > +1, non-binding
> > > > > > > > > > > > >
> > > > > > > > > > > > > ran maven tests, installed on Mac, ran drill in
> > > embedded
> > > > > > mode,
> > > > > > > > > > > > > verified
> > > > > > > > > > > > Web
> > > > > > > > > > > > > UI for CSV header config changes, ran few queries
> on
> > > CSV
> > > > > > files
> > > > > > > > > > > > > with and without header, ran few queries against
> > large
> > > > CSV
> > > > > > > files
> > > > > > > > > > > > > with header in
> > > > > > > > > > > > HDFS
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > > > > > > > hyichu@maprtech.com>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > +1
> > > > > > > > > > > > > > mvn clean install on mac and linux
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > tried a few queries on distributed mode.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Things looked fine
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > > > > > > > asinha@maprtech.com>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > +1.
> > > > > > > > > > > > > > > Downloaded the binary tar ball and installed on
> > > Mac.
> > > > > Ran
> > > > > > > > > > > > > > > Drill in
> > > > > > > > > > > > > > embedded
> > > > > > > > > > > > > > > mode. Tested a few join, aggregation and limit
> > > > queries
> > > > > > > > > > > > > > > against
> > > > > > > > > > > > parquet
> > > > > > > > > > > > > > > data with and without metadata cache. Tested
> > > > > > cancellation
> > > > > > > > for
> > > > > > > > > > > couple
> > > > > > > > > > > > > of
> > > > > > > > > > > > > > > queries. Looked at query profiles on the
> WebUI.
> > > > > Looks
> > > > > > > > good.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > > > > > > > <ab...@dremio.com>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > +1
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> > > > > > > andrew@primer.org>
> > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques
> > Nadeau <
> > > > > > > > > > > > jacques@dremio.com>
> > > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > I'd like to propose a new release
> candidate
> > > of
> > > > > > Apache
> > > > > > > > > > > > > > > > > > Drill,
> > > > > > > > > > > > > > version
> > > > > > > > > > > > > > > > > > 1.3.0. This is the second release
> > candidate
> > > > > (rc1).
> > > > > > > > > > > > > > > > > > This
> > > > > > > > > > > > > addresses
> > > > > > > > > > > > > > > > some
> > > > > > > > > > > > > > > > > > issues identified in the first release
> > > > candidate
> > > > > > > > > > > > > > > > > > including
> > > > > > > > > > > some
> > > > > > > > > > > > > > test
> > > > > > > > > > > > > > > > > > threading issues, Parquet dictionary read
> > > issue
> > > > > > with
> > > > > > > > > > > > > > > > > > binary
> > > > > > > > > > > > > values,
> > > > > > > > > > > > > > > > Joda
> > > > > > > > > > > > > > > > > > upgrade to avoid a concurrency bug and a
> > > couple
> > > > > > other
> > > > > > > > > > > > > > > > > > small
> > > > > > > > > > > > > things.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > The tarball artifacts are hosted at [2]
> and
> > > the
> > > > > > maven
> > > > > > > > > > > artifacts
> > > > > > > > > > > > > are
> > > > > > > > > > > > > > > > > hosted
> > > > > > > > > > > > > > > > > > at [3]. This release candidate is based
> on
> > > > commit
> > > > > > > > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305
> > > > located
> > > > > at
> > > > > > > > [4].
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > The vote will be open for 72 hours ending
> > at
> > > > 10PM
> > > > > > > > > > > > > > > > > > Pacific,
> > > > > > > > > > > > > November
> > > > > > > > > > > > > > > 9,
> > > > > > > > > > > > > > > > > 2015.
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > > > > > > > [ ] -1
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > thanks,
> > > > > > > > > > > > > > > > > > Jacques
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > [1]
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > >
> > > > >
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > > > > > > > 820&version=12332946[2]
> > > > > > > > > > > > > > > > > >
> > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > > > > > > > /
> > > > > > > > > > > > > > > > > > [3]
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > >
> > > > >
> > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > > > > > > > /
> > > > > > > > > > > > > > > > > > [4]
> > > > > > > > > > > > > > > > > >
> > > > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > >
> > > > > > > > > > Abdelhakim Deneche
> > > > > > > > > >
> > > > > > > > > > Software Engineer
> > > > > > > > > >
> > > > > > > > > > <http://www.mapr.com/>
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Now Available - Free Hadoop On-Demand Training <
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > >
> > > > > > > Abdelhakim Deneche
> > > > > > >
> > > > > > > Software Engineer
> > > > > > >
> > > > > > > <http://www.mapr.com/>
> > > > > > >
> > > > > > >
> > > > > > > Now Available - Free Hadoop On-Demand Training
> > > > > > > <
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Abdelhakim Deneche
> > > > >
> > > > > Software Engineer
> > > > >
> > > > > <http://www.mapr.com/>
> > > > >
> > > > >
> > > > > Now Available - Free Hadoop On-Demand Training
> > > > > <
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Jacques Nadeau <ja...@dremio.com>.
What about open files?
On Nov 9, 2015 4:20 PM, "Hanifi Gunes" <hg...@maprtech.com> wrote:
> Using the default parallelism, I get the same set of exceptions on CentOS.
>
> Also max # of threads per process is the system default, 319548.
>
> On Mon, Nov 9, 2015 at 4:13 PM, Amit Hadke <am...@gmail.com> wrote:
>
> > Unfortunately, yes I changed them at OS level.
> >
> > I agree that making OS level changes to run tests is not something we
> > should advocate.
> > It was just an observation that tests seem to pass on linux with default
> > settings but on mac behavior is irregular.
> >
> > ~ Amit.
> >
> >
> > On Mon, Nov 9, 2015 at 3:48 PM, Jason Altekruse <
> altekrusejason@gmail.com>
> > wrote:
> >
> > > Amit,
> > >
> > > Did you change these at the OS level? I would hope that we wouldn't
> have
> > to
> > > make people jump through such hoops to run the build, was there a
> thread
> > I
> > > missed where we discussed this something that we should be expecting
> > > everyone to do? I did see the threads about increasing the maven
> permgen
> > > and did so accordingly, but I think adjusting something like the system
> > > ulimit is something we really should try to avoid.
> > >
> > > On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche <
> > adeneche@maprtech.com
> > > >
> > > wrote:
> > >
> > > > I just tried with the default forkCount and got similar failures. I'm
> > > > running the tests on a linux machine with the default maven options
> > > >
> > > > Thanks
> > > >
> > > > On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <ja...@dremio.com>
> > > wrote:
> > > >
> > > > > So you're changing the forkCount from the default? What happens
> when
> > > you
> > > > > run with the default?
> > > > >
> > > > > Also, did you guys run with extra permgen or the default? Also, can
> > you
> > > > > confirm what type of machine you are running on?
> > > > >
> > > > > Want to figure out why things are different.
> > > > >
> > > > > thanks,
> > > > > Jacques
> > > > >
> > > > > --
> > > > > Jacques Nadeau
> > > > > CTO and Co-Founder, Dremio
> > > > >
> > > > > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <
> > > > adeneche@maprtech.com
> > > > > >
> > > > > wrote:
> > > > >
> > > > > > Saw similar failures when running unit tests with forkCount = 1:
> > > > > >
> > > > > > Tests in error:
> > > > > > >
> > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > > > > UserRemote
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > » Rpc
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > » IllegalState
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > » IllegalState
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > » IllegalState
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > » IllegalState
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > > » IllegalState
> > > > > > > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > > > > > > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > > > > > > IllegalReferenceCount
> > > > > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
> > > > > >
> > > > > >
> > > > > > Unfortunately I'm changing my vote to -1
> > > > > >
> > > > > >
> > > > > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <
> hgunes@maprtech.com>
> > > > > wrote:
> > > > > >
> > > > > > > -1 (binding)
> > > > > > >
> > > > > > > 5/5 consecutive runs I get the following consistently with
> > > forkCount
> > > > > set
> > > > > > to
> > > > > > > 1 on build.
> > > > > > >
> > > > > > > Tests in error:
> > > > > > >
> > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > > > > UserRemote
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > > > > > > updateClient:236->BaseTestQuery.updateClient:213 »
> > IllegalState
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > > > > > >
> > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > »
> > > > > > > IllegalState
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > > > > > > >BaseTestQuery.updateClient:213 » IllegalState
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > > >
> > > > > > >
> > > > > > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
> > > > > stefan@activitystream.com
> > > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > I'm not a committer and not voting but I want to point out
> that
> > > the
> > > > > > UDFs
> > > > > > > > that we are using and run with 1.1 and 1.2 do not, for some
> > > reason,
> > > > > run
> > > > > > > > with 1.3.
> > > > > > > >
> > > > > > > > I'm inclined to insist that it's something we are doing wrong
> > but
> > > > if
> > > > > > this
> > > > > > > > counts as a test then it's failing.
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > -Stefan
> > > > > > > >
> > > > > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <
> norrisl@simba.com
> > >
> > > > > wrote:
> > > > > > > >
> > > > > > > > > +1 Non-binding.
> > > > > > > > >
> > > > > > > > > Built from source on Linux, tested ODBC against various
> data
> > > > > sources
> > > > > > > > > (Hive, DFS-csv, tsv, parquet, json)
> > > > > > > > >
> > > > > > > > > Norris
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > > > > > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > > > > > > To: dev@drill.apache.org
> > > > > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > > > > > > >
> > > > > > > > > +1
> > > > > > > > >
> > > > > > > > > Checked checksum files and gpg signature for all 3 files.
> > Built
> > > > > from
> > > > > > > > > source, deployed on a 4 nodes cluster then run several
> window
> > > > > > function
> > > > > > > > > queries on TPCDS SF100. Looks great.
> > > > > > > > >
> > > > > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <
> > > > jacques@dremio.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > I've seen another instance of DRILL-4041. Since it is
> > > > exceedingly
> > > > > > > > > > rare, I don't think it is a release stopper. I will spend
> > > some
> > > > > more
> > > > > > > > > > time reviewing it.
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Jacques Nadeau
> > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > >
> > > > > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <
> > > > amit.hadke@gmail.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1, non-binding
> > > > > > > > > > > Downloaded tarball, mvn clean install Ran join
> queries,,
> > > was
> > > > > able
> > > > > > > to
> > > > > > > > > > > run queries on json, parquet and sequence files.
> > > > > > > > > > >
> > > > > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
> > > > > abhijit@dremio.com
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > resending the vote with details
> > > > > > > > > > > >
> > > > > > > > > > > > +1, non-binding
> > > > > > > > > > > >
> > > > > > > > > > > > ran maven tests, installed on Mac, ran drill in
> > embedded
> > > > > mode,
> > > > > > > > > > > > verified
> > > > > > > > > > > Web
> > > > > > > > > > > > UI for CSV header config changes, ran few queries on
> > CSV
> > > > > files
> > > > > > > > > > > > with and without header, ran few queries against
> large
> > > CSV
> > > > > > files
> > > > > > > > > > > > with header in
> > > > > > > > > > > HDFS
> > > > > > > > > > > >
> > > > > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > > > > > > hyichu@maprtech.com>
> > > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > +1
> > > > > > > > > > > > > mvn clean install on mac and linux
> > > > > > > > > > > > >
> > > > > > > > > > > > > tried a few queries on distributed mode.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Things looked fine
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > > > > > > asinha@maprtech.com>
> > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > +1.
> > > > > > > > > > > > > > Downloaded the binary tar ball and installed on
> > Mac.
> > > > Ran
> > > > > > > > > > > > > > Drill in
> > > > > > > > > > > > > embedded
> > > > > > > > > > > > > > mode. Tested a few join, aggregation and limit
> > > queries
> > > > > > > > > > > > > > against
> > > > > > > > > > > parquet
> > > > > > > > > > > > > > data with and without metadata cache. Tested
> > > > > cancellation
> > > > > > > for
> > > > > > > > > > couple
> > > > > > > > > > > > of
> > > > > > > > > > > > > > queries. Looked at query profiles on the WebUI.
> > > > Looks
> > > > > > > good.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > > > > > > <ab...@dremio.com>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > +1
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> > > > > > andrew@primer.org>
> > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques
> Nadeau <
> > > > > > > > > > > jacques@dremio.com>
> > > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > I'd like to propose a new release candidate
> > of
> > > > > Apache
> > > > > > > > > > > > > > > > > Drill,
> > > > > > > > > > > > > version
> > > > > > > > > > > > > > > > > 1.3.0. This is the second release
> candidate
> > > > (rc1).
> > > > > > > > > > > > > > > > > This
> > > > > > > > > > > > addresses
> > > > > > > > > > > > > > > some
> > > > > > > > > > > > > > > > > issues identified in the first release
> > > candidate
> > > > > > > > > > > > > > > > > including
> > > > > > > > > > some
> > > > > > > > > > > > > test
> > > > > > > > > > > > > > > > > threading issues, Parquet dictionary read
> > issue
> > > > > with
> > > > > > > > > > > > > > > > > binary
> > > > > > > > > > > > values,
> > > > > > > > > > > > > > > Joda
> > > > > > > > > > > > > > > > > upgrade to avoid a concurrency bug and a
> > couple
> > > > > other
> > > > > > > > > > > > > > > > > small
> > > > > > > > > > > > things.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > The tarball artifacts are hosted at [2] and
> > the
> > > > > maven
> > > > > > > > > > artifacts
> > > > > > > > > > > > are
> > > > > > > > > > > > > > > > hosted
> > > > > > > > > > > > > > > > > at [3]. This release candidate is based on
> > > commit
> > > > > > > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305
> > > located
> > > > at
> > > > > > > [4].
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > The vote will be open for 72 hours ending
> at
> > > 10PM
> > > > > > > > > > > > > > > > > Pacific,
> > > > > > > > > > > > November
> > > > > > > > > > > > > > 9,
> > > > > > > > > > > > > > > > 2015.
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > > > > > > [ ] -1
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > thanks,
> > > > > > > > > > > > > > > > > Jacques
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > [1]
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > >
> > > >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > > > > > > 820&version=12332946[2]
> > > > > > > > > > > > > > > > >
> > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > > > > > > /
> > > > > > > > > > > > > > > > > [3]
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > >
> > > > > > >
> > > >
> https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > > > > > > /
> > > > > > > > > > > > > > > > > [4]
> > > > > > > > > > > > > > > > >
> > > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > >
> > > > > > > > > Abdelhakim Deneche
> > > > > > > > >
> > > > > > > > > Software Engineer
> > > > > > > > >
> > > > > > > > > <http://www.mapr.com/>
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Now Available - Free Hadoop On-Demand Training <
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > >
> > > > > > Abdelhakim Deneche
> > > > > >
> > > > > > Software Engineer
> > > > > >
> > > > > > <http://www.mapr.com/>
> > > > > >
> > > > > >
> > > > > > Now Available - Free Hadoop On-Demand Training
> > > > > > <
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >
> > > > Abdelhakim Deneche
> > > >
> > > > Software Engineer
> > > >
> > > > <http://www.mapr.com/>
> > > >
> > > >
> > > > Now Available - Free Hadoop On-Demand Training
> > > > <
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > >
> > > >
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Hanifi Gunes <hg...@maprtech.com>.
Using the default parallelism, I get the same set of exceptions on CentOS.
Also max # of threads per process is the system default, 319548.
On Mon, Nov 9, 2015 at 4:13 PM, Amit Hadke <am...@gmail.com> wrote:
> Unfortunately, yes I changed them at OS level.
>
> I agree that making OS level changes to run tests is not something we
> should advocate.
> It was just an observation that tests seem to pass on linux with default
> settings but on mac behavior is irregular.
>
> ~ Amit.
>
>
> On Mon, Nov 9, 2015 at 3:48 PM, Jason Altekruse <al...@gmail.com>
> wrote:
>
> > Amit,
> >
> > Did you change these at the OS level? I would hope that we wouldn't have
> to
> > make people jump through such hoops to run the build, was there a thread
> I
> > missed where we discussed this something that we should be expecting
> > everyone to do? I did see the threads about increasing the maven permgen
> > and did so accordingly, but I think adjusting something like the system
> > ulimit is something we really should try to avoid.
> >
> > On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche <
> adeneche@maprtech.com
> > >
> > wrote:
> >
> > > I just tried with the default forkCount and got similar failures. I'm
> > > running the tests on a linux machine with the default maven options
> > >
> > > Thanks
> > >
> > > On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <ja...@dremio.com>
> > wrote:
> > >
> > > > So you're changing the forkCount from the default? What happens when
> > you
> > > > run with the default?
> > > >
> > > > Also, did you guys run with extra permgen or the default? Also, can
> you
> > > > confirm what type of machine you are running on?
> > > >
> > > > Want to figure out why things are different.
> > > >
> > > > thanks,
> > > > Jacques
> > > >
> > > > --
> > > > Jacques Nadeau
> > > > CTO and Co-Founder, Dremio
> > > >
> > > > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <
> > > adeneche@maprtech.com
> > > > >
> > > > wrote:
> > > >
> > > > > Saw similar failures when running unit tests with forkCount = 1:
> > > > >
> > > > > Tests in error:
> > > > > >
> > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > > > UserRemote
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > » Rpc
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > » IllegalState
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > » IllegalState
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > » IllegalState
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > » IllegalState
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > > » IllegalState
> > > > > > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > > > > > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > > > > > IllegalReferenceCount
> > > > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
> > > > >
> > > > >
> > > > > Unfortunately I'm changing my vote to -1
> > > > >
> > > > >
> > > > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <hg...@maprtech.com>
> > > > wrote:
> > > > >
> > > > > > -1 (binding)
> > > > > >
> > > > > > 5/5 consecutive runs I get the following consistently with
> > forkCount
> > > > set
> > > > > to
> > > > > > 1 on build.
> > > > > >
> > > > > > Tests in error:
> > > > > >
> > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > > > UserRemote
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > > > > > updateClient:236->BaseTestQuery.updateClient:213 »
> IllegalState
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > > > > >
> > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > »
> > > > > > IllegalState
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > > > > > >BaseTestQuery.updateClient:213 » IllegalState
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > > >
> > > > > >
> > > > > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
> > > > stefan@activitystream.com
> > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > I'm not a committer and not voting but I want to point out that
> > the
> > > > > UDFs
> > > > > > > that we are using and run with 1.1 and 1.2 do not, for some
> > reason,
> > > > run
> > > > > > > with 1.3.
> > > > > > >
> > > > > > > I'm inclined to insist that it's something we are doing wrong
> but
> > > if
> > > > > this
> > > > > > > counts as a test then it's failing.
> > > > > > >
> > > > > > > Regards,
> > > > > > > -Stefan
> > > > > > >
> > > > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <norrisl@simba.com
> >
> > > > wrote:
> > > > > > >
> > > > > > > > +1 Non-binding.
> > > > > > > >
> > > > > > > > Built from source on Linux, tested ODBC against various data
> > > > sources
> > > > > > > > (Hive, DFS-csv, tsv, parquet, json)
> > > > > > > >
> > > > > > > > Norris
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > > > > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > > > > > To: dev@drill.apache.org
> > > > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > > > > > >
> > > > > > > > +1
> > > > > > > >
> > > > > > > > Checked checksum files and gpg signature for all 3 files.
> Built
> > > > from
> > > > > > > > source, deployed on a 4 nodes cluster then run several window
> > > > > function
> > > > > > > > queries on TPCDS SF100. Looks great.
> > > > > > > >
> > > > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <
> > > jacques@dremio.com
> > > > >
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > I've seen another instance of DRILL-4041. Since it is
> > > exceedingly
> > > > > > > > > rare, I don't think it is a release stopper. I will spend
> > some
> > > > more
> > > > > > > > > time reviewing it.
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Jacques Nadeau
> > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > >
> > > > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <
> > > amit.hadke@gmail.com
> > > > >
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1, non-binding
> > > > > > > > > > Downloaded tarball, mvn clean install Ran join queries,,
> > was
> > > > able
> > > > > > to
> > > > > > > > > > run queries on json, parquet and sequence files.
> > > > > > > > > >
> > > > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
> > > > abhijit@dremio.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > resending the vote with details
> > > > > > > > > > >
> > > > > > > > > > > +1, non-binding
> > > > > > > > > > >
> > > > > > > > > > > ran maven tests, installed on Mac, ran drill in
> embedded
> > > > mode,
> > > > > > > > > > > verified
> > > > > > > > > > Web
> > > > > > > > > > > UI for CSV header config changes, ran few queries on
> CSV
> > > > files
> > > > > > > > > > > with and without header, ran few queries against large
> > CSV
> > > > > files
> > > > > > > > > > > with header in
> > > > > > > > > > HDFS
> > > > > > > > > > >
> > > > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > > > > > hyichu@maprtech.com>
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > +1
> > > > > > > > > > > > mvn clean install on mac and linux
> > > > > > > > > > > >
> > > > > > > > > > > > tried a few queries on distributed mode.
> > > > > > > > > > > >
> > > > > > > > > > > > Things looked fine
> > > > > > > > > > > >
> > > > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > > > > > asinha@maprtech.com>
> > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > +1.
> > > > > > > > > > > > > Downloaded the binary tar ball and installed on
> Mac.
> > > Ran
> > > > > > > > > > > > > Drill in
> > > > > > > > > > > > embedded
> > > > > > > > > > > > > mode. Tested a few join, aggregation and limit
> > queries
> > > > > > > > > > > > > against
> > > > > > > > > > parquet
> > > > > > > > > > > > > data with and without metadata cache. Tested
> > > > cancellation
> > > > > > for
> > > > > > > > > couple
> > > > > > > > > > > of
> > > > > > > > > > > > > queries. Looked at query profiles on the WebUI.
> > > Looks
> > > > > > good.
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > > > > > <ab...@dremio.com>
> > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > +1
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> > > > > andrew@primer.org>
> > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > > > > > > > > jacques@dremio.com>
> > > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > I'd like to propose a new release candidate
> of
> > > > Apache
> > > > > > > > > > > > > > > > Drill,
> > > > > > > > > > > > version
> > > > > > > > > > > > > > > > 1.3.0. This is the second release candidate
> > > (rc1).
> > > > > > > > > > > > > > > > This
> > > > > > > > > > > addresses
> > > > > > > > > > > > > > some
> > > > > > > > > > > > > > > > issues identified in the first release
> > candidate
> > > > > > > > > > > > > > > > including
> > > > > > > > > some
> > > > > > > > > > > > test
> > > > > > > > > > > > > > > > threading issues, Parquet dictionary read
> issue
> > > > with
> > > > > > > > > > > > > > > > binary
> > > > > > > > > > > values,
> > > > > > > > > > > > > > Joda
> > > > > > > > > > > > > > > > upgrade to avoid a concurrency bug and a
> couple
> > > > other
> > > > > > > > > > > > > > > > small
> > > > > > > > > > > things.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > The tarball artifacts are hosted at [2] and
> the
> > > > maven
> > > > > > > > > artifacts
> > > > > > > > > > > are
> > > > > > > > > > > > > > > hosted
> > > > > > > > > > > > > > > > at [3]. This release candidate is based on
> > commit
> > > > > > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305
> > located
> > > at
> > > > > > [4].
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > The vote will be open for 72 hours ending at
> > 10PM
> > > > > > > > > > > > > > > > Pacific,
> > > > > > > > > > > November
> > > > > > > > > > > > > 9,
> > > > > > > > > > > > > > > 2015.
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > > > > > [ ] -1
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > thanks,
> > > > > > > > > > > > > > > > Jacques
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > [1]
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > >
> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > > > > > 820&version=12332946[2]
> > > > > > > > > > > > > > > >
> > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > > > > > /
> > > > > > > > > > > > > > > > [3]
> > > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > >
> > > > > >
> > > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > > > > > /
> > > > > > > > > > > > > > > > [4]
> > > > > > > > > > > > > > > >
> > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > >
> > > > > > > > Abdelhakim Deneche
> > > > > > > >
> > > > > > > > Software Engineer
> > > > > > > >
> > > > > > > > <http://www.mapr.com/>
> > > > > > > >
> > > > > > > >
> > > > > > > > Now Available - Free Hadoop On-Demand Training <
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Abdelhakim Deneche
> > > > >
> > > > > Software Engineer
> > > > >
> > > > > <http://www.mapr.com/>
> > > > >
> > > > >
> > > > > Now Available - Free Hadoop On-Demand Training
> > > > > <
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > >
> > > Abdelhakim Deneche
> > >
> > > Software Engineer
> > >
> > > <http://www.mapr.com/>
> > >
> > >
> > > Now Available - Free Hadoop On-Demand Training
> > > <
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > >
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Amit Hadke <am...@gmail.com>.
Unfortunately, yes I changed them at OS level.
I agree that making OS level changes to run tests is not something we
should advocate.
It was just an observation that tests seem to pass on linux with default
settings but on mac behavior is irregular.
~ Amit.
On Mon, Nov 9, 2015 at 3:48 PM, Jason Altekruse <al...@gmail.com>
wrote:
> Amit,
>
> Did you change these at the OS level? I would hope that we wouldn't have to
> make people jump through such hoops to run the build, was there a thread I
> missed where we discussed this something that we should be expecting
> everyone to do? I did see the threads about increasing the maven permgen
> and did so accordingly, but I think adjusting something like the system
> ulimit is something we really should try to avoid.
>
> On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche <adeneche@maprtech.com
> >
> wrote:
>
> > I just tried with the default forkCount and got similar failures. I'm
> > running the tests on a linux machine with the default maven options
> >
> > Thanks
> >
> > On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <ja...@dremio.com>
> wrote:
> >
> > > So you're changing the forkCount from the default? What happens when
> you
> > > run with the default?
> > >
> > > Also, did you guys run with extra permgen or the default? Also, can you
> > > confirm what type of machine you are running on?
> > >
> > > Want to figure out why things are different.
> > >
> > > thanks,
> > > Jacques
> > >
> > > --
> > > Jacques Nadeau
> > > CTO and Co-Founder, Dremio
> > >
> > > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <
> > adeneche@maprtech.com
> > > >
> > > wrote:
> > >
> > > > Saw similar failures when running unit tests with forkCount = 1:
> > > >
> > > > Tests in error:
> > > > >
> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > > UserRemote
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > » Rpc
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > » IllegalState
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > » IllegalState
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > » IllegalState
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > » IllegalState
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > > » IllegalState
> > > > > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > > > > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > > > > IllegalReferenceCount
> > > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
> > > >
> > > >
> > > > Unfortunately I'm changing my vote to -1
> > > >
> > > >
> > > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <hg...@maprtech.com>
> > > wrote:
> > > >
> > > > > -1 (binding)
> > > > >
> > > > > 5/5 consecutive runs I get the following consistently with
> forkCount
> > > set
> > > > to
> > > > > 1 on build.
> > > > >
> > > > > Tests in error:
> > > > >
> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > > UserRemote
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > > > > updateClient:236->BaseTestQuery.updateClient:213 » IllegalState
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > > > >
> >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > »
> > > > > IllegalState
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > > > > >BaseTestQuery.updateClient:213 » IllegalState
> > > > >
> > > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > > >
> > > > >
> > > > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
> > > stefan@activitystream.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I'm not a committer and not voting but I want to point out that
> the
> > > > UDFs
> > > > > > that we are using and run with 1.1 and 1.2 do not, for some
> reason,
> > > run
> > > > > > with 1.3.
> > > > > >
> > > > > > I'm inclined to insist that it's something we are doing wrong but
> > if
> > > > this
> > > > > > counts as a test then it's failing.
> > > > > >
> > > > > > Regards,
> > > > > > -Stefan
> > > > > >
> > > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <no...@simba.com>
> > > wrote:
> > > > > >
> > > > > > > +1 Non-binding.
> > > > > > >
> > > > > > > Built from source on Linux, tested ODBC against various data
> > > sources
> > > > > > > (Hive, DFS-csv, tsv, parquet, json)
> > > > > > >
> > > > > > > Norris
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > > > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > > > > To: dev@drill.apache.org
> > > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > Checked checksum files and gpg signature for all 3 files. Built
> > > from
> > > > > > > source, deployed on a 4 nodes cluster then run several window
> > > > function
> > > > > > > queries on TPCDS SF100. Looks great.
> > > > > > >
> > > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <
> > jacques@dremio.com
> > > >
> > > > > > wrote:
> > > > > > >
> > > > > > > > I've seen another instance of DRILL-4041. Since it is
> > exceedingly
> > > > > > > > rare, I don't think it is a release stopper. I will spend
> some
> > > more
> > > > > > > > time reviewing it.
> > > > > > > >
> > > > > > > > --
> > > > > > > > Jacques Nadeau
> > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > >
> > > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <
> > amit.hadke@gmail.com
> > > >
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1, non-binding
> > > > > > > > > Downloaded tarball, mvn clean install Ran join queries,,
> was
> > > able
> > > > > to
> > > > > > > > > run queries on json, parquet and sequence files.
> > > > > > > > >
> > > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
> > > abhijit@dremio.com
> > > > >
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > resending the vote with details
> > > > > > > > > >
> > > > > > > > > > +1, non-binding
> > > > > > > > > >
> > > > > > > > > > ran maven tests, installed on Mac, ran drill in embedded
> > > mode,
> > > > > > > > > > verified
> > > > > > > > > Web
> > > > > > > > > > UI for CSV header config changes, ran few queries on CSV
> > > files
> > > > > > > > > > with and without header, ran few queries against large
> CSV
> > > > files
> > > > > > > > > > with header in
> > > > > > > > > HDFS
> > > > > > > > > >
> > > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > > > > hyichu@maprtech.com>
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1
> > > > > > > > > > > mvn clean install on mac and linux
> > > > > > > > > > >
> > > > > > > > > > > tried a few queries on distributed mode.
> > > > > > > > > > >
> > > > > > > > > > > Things looked fine
> > > > > > > > > > >
> > > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > > > > asinha@maprtech.com>
> > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > +1.
> > > > > > > > > > > > Downloaded the binary tar ball and installed on Mac.
> > Ran
> > > > > > > > > > > > Drill in
> > > > > > > > > > > embedded
> > > > > > > > > > > > mode. Tested a few join, aggregation and limit
> queries
> > > > > > > > > > > > against
> > > > > > > > > parquet
> > > > > > > > > > > > data with and without metadata cache. Tested
> > > cancellation
> > > > > for
> > > > > > > > couple
> > > > > > > > > > of
> > > > > > > > > > > > queries. Looked at query profiles on the WebUI.
> > Looks
> > > > > good.
> > > > > > > > > > > >
> > > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > > > > <ab...@dremio.com>
> > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > +1
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> > > > andrew@primer.org>
> > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > > > > > > > jacques@dremio.com>
> > > > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > I'd like to propose a new release candidate of
> > > Apache
> > > > > > > > > > > > > > > Drill,
> > > > > > > > > > > version
> > > > > > > > > > > > > > > 1.3.0. This is the second release candidate
> > (rc1).
> > > > > > > > > > > > > > > This
> > > > > > > > > > addresses
> > > > > > > > > > > > > some
> > > > > > > > > > > > > > > issues identified in the first release
> candidate
> > > > > > > > > > > > > > > including
> > > > > > > > some
> > > > > > > > > > > test
> > > > > > > > > > > > > > > threading issues, Parquet dictionary read issue
> > > with
> > > > > > > > > > > > > > > binary
> > > > > > > > > > values,
> > > > > > > > > > > > > Joda
> > > > > > > > > > > > > > > upgrade to avoid a concurrency bug and a couple
> > > other
> > > > > > > > > > > > > > > small
> > > > > > > > > > things.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > The tarball artifacts are hosted at [2] and the
> > > maven
> > > > > > > > artifacts
> > > > > > > > > > are
> > > > > > > > > > > > > > hosted
> > > > > > > > > > > > > > > at [3]. This release candidate is based on
> commit
> > > > > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305
> located
> > at
> > > > > [4].
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > The vote will be open for 72 hours ending at
> 10PM
> > > > > > > > > > > > > > > Pacific,
> > > > > > > > > > November
> > > > > > > > > > > > 9,
> > > > > > > > > > > > > > 2015.
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > > > > [ ] -1
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > thanks,
> > > > > > > > > > > > > > > Jacques
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > [1]
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > >
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > > > > 820&version=12332946[2]
> > > > > > > > > > > > > > >
> > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > > > > /
> > > > > > > > > > > > > > > [3]
> > > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > >
> > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > > > > /
> > > > > > > > > > > > > > > [4]
> > > > > > > > > > > > > > >
> > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > --
> > > > > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > >
> > > > > > > Abdelhakim Deneche
> > > > > > >
> > > > > > > Software Engineer
> > > > > > >
> > > > > > > <http://www.mapr.com/>
> > > > > > >
> > > > > > >
> > > > > > > Now Available - Free Hadoop On-Demand Training <
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >
> > > > Abdelhakim Deneche
> > > >
> > > > Software Engineer
> > > >
> > > > <http://www.mapr.com/>
> > > >
> > > >
> > > > Now Available - Free Hadoop On-Demand Training
> > > > <
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> >
> > Abdelhakim Deneche
> >
> > Software Engineer
> >
> > <http://www.mapr.com/>
> >
> >
> > Now Available - Free Hadoop On-Demand Training
> > <
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Jason Altekruse <al...@gmail.com>.
Amit,
Did you change these at the OS level? I would hope that we wouldn't have to
make people jump through such hoops to run the build, was there a thread I
missed where we discussed this something that we should be expecting
everyone to do? I did see the threads about increasing the maven permgen
and did so accordingly, but I think adjusting something like the system
ulimit is something we really should try to avoid.
On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche <ad...@maprtech.com>
wrote:
> I just tried with the default forkCount and got similar failures. I'm
> running the tests on a linux machine with the default maven options
>
> Thanks
>
> On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <ja...@dremio.com> wrote:
>
> > So you're changing the forkCount from the default? What happens when you
> > run with the default?
> >
> > Also, did you guys run with extra permgen or the default? Also, can you
> > confirm what type of machine you are running on?
> >
> > Want to figure out why things are different.
> >
> > thanks,
> > Jacques
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
> > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <
> adeneche@maprtech.com
> > >
> > wrote:
> >
> > > Saw similar failures when running unit tests with forkCount = 1:
> > >
> > > Tests in error:
> > > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > UserRemote
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > » Rpc
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > » IllegalState
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > » IllegalState
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > » IllegalState
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > » IllegalState
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > > » IllegalState
> > > > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > > > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > > > IllegalReferenceCount
> > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
> > >
> > >
> > > Unfortunately I'm changing my vote to -1
> > >
> > >
> > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <hg...@maprtech.com>
> > wrote:
> > >
> > > > -1 (binding)
> > > >
> > > > 5/5 consecutive runs I get the following consistently with forkCount
> > set
> > > to
> > > > 1 on build.
> > > >
> > > > Tests in error:
> > > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > > UserRemote
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > > > updateClient:236->BaseTestQuery.updateClient:213 » IllegalState
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> »
> > > > IllegalState
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > > > >BaseTestQuery.updateClient:213 » IllegalState
> > > >
> > > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > > >
> > > >
> > > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
> > stefan@activitystream.com
> > > >
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I'm not a committer and not voting but I want to point out that the
> > > UDFs
> > > > > that we are using and run with 1.1 and 1.2 do not, for some reason,
> > run
> > > > > with 1.3.
> > > > >
> > > > > I'm inclined to insist that it's something we are doing wrong but
> if
> > > this
> > > > > counts as a test then it's failing.
> > > > >
> > > > > Regards,
> > > > > -Stefan
> > > > >
> > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <no...@simba.com>
> > wrote:
> > > > >
> > > > > > +1 Non-binding.
> > > > > >
> > > > > > Built from source on Linux, tested ODBC against various data
> > sources
> > > > > > (Hive, DFS-csv, tsv, parquet, json)
> > > > > >
> > > > > > Norris
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > > > To: dev@drill.apache.org
> > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > > > >
> > > > > > +1
> > > > > >
> > > > > > Checked checksum files and gpg signature for all 3 files. Built
> > from
> > > > > > source, deployed on a 4 nodes cluster then run several window
> > > function
> > > > > > queries on TPCDS SF100. Looks great.
> > > > > >
> > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <
> jacques@dremio.com
> > >
> > > > > wrote:
> > > > > >
> > > > > > > I've seen another instance of DRILL-4041. Since it is
> exceedingly
> > > > > > > rare, I don't think it is a release stopper. I will spend some
> > more
> > > > > > > time reviewing it.
> > > > > > >
> > > > > > > --
> > > > > > > Jacques Nadeau
> > > > > > > CTO and Co-Founder, Dremio
> > > > > > >
> > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <
> amit.hadke@gmail.com
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > > +1, non-binding
> > > > > > > > Downloaded tarball, mvn clean install Ran join queries,, was
> > able
> > > > to
> > > > > > > > run queries on json, parquet and sequence files.
> > > > > > > >
> > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
> > abhijit@dremio.com
> > > >
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > resending the vote with details
> > > > > > > > >
> > > > > > > > > +1, non-binding
> > > > > > > > >
> > > > > > > > > ran maven tests, installed on Mac, ran drill in embedded
> > mode,
> > > > > > > > > verified
> > > > > > > > Web
> > > > > > > > > UI for CSV header config changes, ran few queries on CSV
> > files
> > > > > > > > > with and without header, ran few queries against large CSV
> > > files
> > > > > > > > > with header in
> > > > > > > > HDFS
> > > > > > > > >
> > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > > > hyichu@maprtech.com>
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1
> > > > > > > > > > mvn clean install on mac and linux
> > > > > > > > > >
> > > > > > > > > > tried a few queries on distributed mode.
> > > > > > > > > >
> > > > > > > > > > Things looked fine
> > > > > > > > > >
> > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > > > asinha@maprtech.com>
> > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1.
> > > > > > > > > > > Downloaded the binary tar ball and installed on Mac.
> Ran
> > > > > > > > > > > Drill in
> > > > > > > > > > embedded
> > > > > > > > > > > mode. Tested a few join, aggregation and limit queries
> > > > > > > > > > > against
> > > > > > > > parquet
> > > > > > > > > > > data with and without metadata cache. Tested
> > cancellation
> > > > for
> > > > > > > couple
> > > > > > > > > of
> > > > > > > > > > > queries. Looked at query profiles on the WebUI.
> Looks
> > > > good.
> > > > > > > > > > >
> > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > > > <ab...@dremio.com>
> > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > +1
> > > > > > > > > > > >
> > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> > > andrew@primer.org>
> > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > > > >
> > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > > > > > > jacques@dremio.com>
> > > > > > > > > > > > wrote:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > I'd like to propose a new release candidate of
> > Apache
> > > > > > > > > > > > > > Drill,
> > > > > > > > > > version
> > > > > > > > > > > > > > 1.3.0. This is the second release candidate
> (rc1).
> > > > > > > > > > > > > > This
> > > > > > > > > addresses
> > > > > > > > > > > > some
> > > > > > > > > > > > > > issues identified in the first release candidate
> > > > > > > > > > > > > > including
> > > > > > > some
> > > > > > > > > > test
> > > > > > > > > > > > > > threading issues, Parquet dictionary read issue
> > with
> > > > > > > > > > > > > > binary
> > > > > > > > > values,
> > > > > > > > > > > > Joda
> > > > > > > > > > > > > > upgrade to avoid a concurrency bug and a couple
> > other
> > > > > > > > > > > > > > small
> > > > > > > > > things.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > The tarball artifacts are hosted at [2] and the
> > maven
> > > > > > > artifacts
> > > > > > > > > are
> > > > > > > > > > > > > hosted
> > > > > > > > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located
> at
> > > > [4].
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > The vote will be open for 72 hours ending at 10PM
> > > > > > > > > > > > > > Pacific,
> > > > > > > > > November
> > > > > > > > > > > 9,
> > > > > > > > > > > > > 2015.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > > > [ ] -1
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > thanks,
> > > > > > > > > > > > > > Jacques
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > [1]
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > > > 820&version=12332946[2]
> > > > > > > > > > > > > >
> > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > > > /
> > > > > > > > > > > > > > [3]
> > > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > >
> https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > > > /
> > > > > > > > > > > > > > [4]
> > > > > > > > > > > > > >
> > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > --
> > > > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > >
> > > > > > Abdelhakim Deneche
> > > > > >
> > > > > > Software Engineer
> > > > > >
> > > > > > <http://www.mapr.com/>
> > > > > >
> > > > > >
> > > > > > Now Available - Free Hadoop On-Demand Training <
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > >
> > > Abdelhakim Deneche
> > >
> > > Software Engineer
> > >
> > > <http://www.mapr.com/>
> > >
> > >
> > > Now Available - Free Hadoop On-Demand Training
> > > <
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > >
> > >
> >
>
>
>
> --
>
> Abdelhakim Deneche
>
> Software Engineer
>
> <http://www.mapr.com/>
>
>
> Now Available - Free Hadoop On-Demand Training
> <
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Abdel Hakim Deneche <ad...@maprtech.com>.
I just tried with the default forkCount and got similar failures. I'm
running the tests on a linux machine with the default maven options
Thanks
On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau <ja...@dremio.com> wrote:
> So you're changing the forkCount from the default? What happens when you
> run with the default?
>
> Also, did you guys run with extra permgen or the default? Also, can you
> confirm what type of machine you are running on?
>
> Want to figure out why things are different.
>
> thanks,
> Jacques
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <adeneche@maprtech.com
> >
> wrote:
>
> > Saw similar failures when running unit tests with forkCount = 1:
> >
> > Tests in error:
> > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > UserRemote
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » Rpc
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > > IllegalReferenceCount
> > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
> >
> >
> > Unfortunately I'm changing my vote to -1
> >
> >
> > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <hg...@maprtech.com>
> wrote:
> >
> > > -1 (binding)
> > >
> > > 5/5 consecutive runs I get the following consistently with forkCount
> set
> > to
> > > 1 on build.
> > >
> > > Tests in error:
> > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > UserRemote
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > > updateClient:236->BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213 »
> > > IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > > >BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
> stefan@activitystream.com
> > >
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I'm not a committer and not voting but I want to point out that the
> > UDFs
> > > > that we are using and run with 1.1 and 1.2 do not, for some reason,
> run
> > > > with 1.3.
> > > >
> > > > I'm inclined to insist that it's something we are doing wrong but if
> > this
> > > > counts as a test then it's failing.
> > > >
> > > > Regards,
> > > > -Stefan
> > > >
> > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <no...@simba.com>
> wrote:
> > > >
> > > > > +1 Non-binding.
> > > > >
> > > > > Built from source on Linux, tested ODBC against various data
> sources
> > > > > (Hive, DFS-csv, tsv, parquet, json)
> > > > >
> > > > > Norris
> > > > >
> > > > > -----Original Message-----
> > > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > > To: dev@drill.apache.org
> > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > > >
> > > > > +1
> > > > >
> > > > > Checked checksum files and gpg signature for all 3 files. Built
> from
> > > > > source, deployed on a 4 nodes cluster then run several window
> > function
> > > > > queries on TPCDS SF100. Looks great.
> > > > >
> > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <jacques@dremio.com
> >
> > > > wrote:
> > > > >
> > > > > > I've seen another instance of DRILL-4041. Since it is exceedingly
> > > > > > rare, I don't think it is a release stopper. I will spend some
> more
> > > > > > time reviewing it.
> > > > > >
> > > > > > --
> > > > > > Jacques Nadeau
> > > > > > CTO and Co-Founder, Dremio
> > > > > >
> > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <amit.hadke@gmail.com
> >
> > > > wrote:
> > > > > >
> > > > > > > +1, non-binding
> > > > > > > Downloaded tarball, mvn clean install Ran join queries,, was
> able
> > > to
> > > > > > > run queries on json, parquet and sequence files.
> > > > > > >
> > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
> abhijit@dremio.com
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > > resending the vote with details
> > > > > > > >
> > > > > > > > +1, non-binding
> > > > > > > >
> > > > > > > > ran maven tests, installed on Mac, ran drill in embedded
> mode,
> > > > > > > > verified
> > > > > > > Web
> > > > > > > > UI for CSV header config changes, ran few queries on CSV
> files
> > > > > > > > with and without header, ran few queries against large CSV
> > files
> > > > > > > > with header in
> > > > > > > HDFS
> > > > > > > >
> > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > > hyichu@maprtech.com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1
> > > > > > > > > mvn clean install on mac and linux
> > > > > > > > >
> > > > > > > > > tried a few queries on distributed mode.
> > > > > > > > >
> > > > > > > > > Things looked fine
> > > > > > > > >
> > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > > asinha@maprtech.com>
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1.
> > > > > > > > > > Downloaded the binary tar ball and installed on Mac. Ran
> > > > > > > > > > Drill in
> > > > > > > > > embedded
> > > > > > > > > > mode. Tested a few join, aggregation and limit queries
> > > > > > > > > > against
> > > > > > > parquet
> > > > > > > > > > data with and without metadata cache. Tested
> cancellation
> > > for
> > > > > > couple
> > > > > > > > of
> > > > > > > > > > queries. Looked at query profiles on the WebUI. Looks
> > > good.
> > > > > > > > > >
> > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > > <ab...@dremio.com>
> > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1
> > > > > > > > > > >
> > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> > andrew@primer.org>
> > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > > >
> > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > > > > > jacques@dremio.com>
> > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > > >
> > > > > > > > > > > > > I'd like to propose a new release candidate of
> Apache
> > > > > > > > > > > > > Drill,
> > > > > > > > > version
> > > > > > > > > > > > > 1.3.0. This is the second release candidate (rc1).
> > > > > > > > > > > > > This
> > > > > > > > addresses
> > > > > > > > > > > some
> > > > > > > > > > > > > issues identified in the first release candidate
> > > > > > > > > > > > > including
> > > > > > some
> > > > > > > > > test
> > > > > > > > > > > > > threading issues, Parquet dictionary read issue
> with
> > > > > > > > > > > > > binary
> > > > > > > > values,
> > > > > > > > > > > Joda
> > > > > > > > > > > > > upgrade to avoid a concurrency bug and a couple
> other
> > > > > > > > > > > > > small
> > > > > > > > things.
> > > > > > > > > > > > >
> > > > > > > > > > > > > The tarball artifacts are hosted at [2] and the
> maven
> > > > > > artifacts
> > > > > > > > are
> > > > > > > > > > > > hosted
> > > > > > > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at
> > > [4].
> > > > > > > > > > > > >
> > > > > > > > > > > > > The vote will be open for 72 hours ending at 10PM
> > > > > > > > > > > > > Pacific,
> > > > > > > > November
> > > > > > > > > > 9,
> > > > > > > > > > > > 2015.
> > > > > > > > > > > > >
> > > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > > [ ] -1
> > > > > > > > > > > > >
> > > > > > > > > > > > > thanks,
> > > > > > > > > > > > > Jacques
> > > > > > > > > > > > >
> > > > > > > > > > > > > [1]
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > > 820&version=12332946[2]
> > > > > > > > > > > > >
> > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > > /
> > > > > > > > > > > > > [3]
> > > > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > > >
> > > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > > /
> > > > > > > > > > > > > [4]
> > > > > > > > > > > > >
> > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Abdelhakim Deneche
> > > > >
> > > > > Software Engineer
> > > > >
> > > > > <http://www.mapr.com/>
> > > > >
> > > > >
> > > > > Now Available - Free Hadoop On-Demand Training <
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> >
> > Abdelhakim Deneche
> >
> > Software Engineer
> >
> > <http://www.mapr.com/>
> >
> >
> > Now Available - Free Hadoop On-Demand Training
> > <
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > >
> >
>
--
Abdelhakim Deneche
Software Engineer
<http://www.mapr.com/>
Now Available - Free Hadoop On-Demand Training
<http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Jacques Nadeau <ja...@dremio.com>.
So you're changing the forkCount from the default? What happens when you
run with the default?
Also, did you guys run with extra permgen or the default? Also, can you
confirm what type of machine you are running on?
Want to figure out why things are different.
thanks,
Jacques
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <ad...@maprtech.com>
wrote:
> Saw similar failures when running unit tests with forkCount = 1:
>
> Tests in error:
> > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > UserRemote
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » Rpc
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > IllegalReferenceCount
> > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
>
>
> Unfortunately I'm changing my vote to -1
>
>
> On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <hg...@maprtech.com> wrote:
>
> > -1 (binding)
> >
> > 5/5 consecutive runs I get the following consistently with forkCount set
> to
> > 1 on build.
> >
> > Tests in error:
> > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > UserRemote
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > updateClient:236->BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > 236->BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213 »
> > IllegalState
> >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > 236->BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > >BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > 236->BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <stefan@activitystream.com
> >
> > wrote:
> >
> > > Hi,
> > >
> > > I'm not a committer and not voting but I want to point out that the
> UDFs
> > > that we are using and run with 1.1 and 1.2 do not, for some reason, run
> > > with 1.3.
> > >
> > > I'm inclined to insist that it's something we are doing wrong but if
> this
> > > counts as a test then it's failing.
> > >
> > > Regards,
> > > -Stefan
> > >
> > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <no...@simba.com> wrote:
> > >
> > > > +1 Non-binding.
> > > >
> > > > Built from source on Linux, tested ODBC against various data sources
> > > > (Hive, DFS-csv, tsv, parquet, json)
> > > >
> > > > Norris
> > > >
> > > > -----Original Message-----
> > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > To: dev@drill.apache.org
> > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > >
> > > > +1
> > > >
> > > > Checked checksum files and gpg signature for all 3 files. Built from
> > > > source, deployed on a 4 nodes cluster then run several window
> function
> > > > queries on TPCDS SF100. Looks great.
> > > >
> > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <ja...@dremio.com>
> > > wrote:
> > > >
> > > > > I've seen another instance of DRILL-4041. Since it is exceedingly
> > > > > rare, I don't think it is a release stopper. I will spend some more
> > > > > time reviewing it.
> > > > >
> > > > > --
> > > > > Jacques Nadeau
> > > > > CTO and Co-Founder, Dremio
> > > > >
> > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <am...@gmail.com>
> > > wrote:
> > > > >
> > > > > > +1, non-binding
> > > > > > Downloaded tarball, mvn clean install Ran join queries,, was able
> > to
> > > > > > run queries on json, parquet and sequence files.
> > > > > >
> > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <abhijit@dremio.com
> >
> > > > wrote:
> > > > > >
> > > > > > > resending the vote with details
> > > > > > >
> > > > > > > +1, non-binding
> > > > > > >
> > > > > > > ran maven tests, installed on Mac, ran drill in embedded mode,
> > > > > > > verified
> > > > > > Web
> > > > > > > UI for CSV header config changes, ran few queries on CSV files
> > > > > > > with and without header, ran few queries against large CSV
> files
> > > > > > > with header in
> > > > > > HDFS
> > > > > > >
> > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > hyichu@maprtech.com>
> > > > > > wrote:
> > > > > > >
> > > > > > > > +1
> > > > > > > > mvn clean install on mac and linux
> > > > > > > >
> > > > > > > > tried a few queries on distributed mode.
> > > > > > > >
> > > > > > > > Things looked fine
> > > > > > > >
> > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > asinha@maprtech.com>
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1.
> > > > > > > > > Downloaded the binary tar ball and installed on Mac. Ran
> > > > > > > > > Drill in
> > > > > > > > embedded
> > > > > > > > > mode. Tested a few join, aggregation and limit queries
> > > > > > > > > against
> > > > > > parquet
> > > > > > > > > data with and without metadata cache. Tested cancellation
> > for
> > > > > couple
> > > > > > > of
> > > > > > > > > queries. Looked at query profiles on the WebUI. Looks
> > good.
> > > > > > > > >
> > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > <ab...@dremio.com>
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1
> > > > > > > > > >
> > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> andrew@primer.org>
> > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > >
> > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > > > > jacques@dremio.com>
> > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > >
> > > > > > > > > > > > I'd like to propose a new release candidate of Apache
> > > > > > > > > > > > Drill,
> > > > > > > > version
> > > > > > > > > > > > 1.3.0. This is the second release candidate (rc1).
> > > > > > > > > > > > This
> > > > > > > addresses
> > > > > > > > > > some
> > > > > > > > > > > > issues identified in the first release candidate
> > > > > > > > > > > > including
> > > > > some
> > > > > > > > test
> > > > > > > > > > > > threading issues, Parquet dictionary read issue with
> > > > > > > > > > > > binary
> > > > > > > values,
> > > > > > > > > > Joda
> > > > > > > > > > > > upgrade to avoid a concurrency bug and a couple other
> > > > > > > > > > > > small
> > > > > > > things.
> > > > > > > > > > > >
> > > > > > > > > > > > The tarball artifacts are hosted at [2] and the maven
> > > > > artifacts
> > > > > > > are
> > > > > > > > > > > hosted
> > > > > > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at
> > [4].
> > > > > > > > > > > >
> > > > > > > > > > > > The vote will be open for 72 hours ending at 10PM
> > > > > > > > > > > > Pacific,
> > > > > > > November
> > > > > > > > > 9,
> > > > > > > > > > > 2015.
> > > > > > > > > > > >
> > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > [ ] -1
> > > > > > > > > > > >
> > > > > > > > > > > > thanks,
> > > > > > > > > > > > Jacques
> > > > > > > > > > > >
> > > > > > > > > > > > [1]
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > 820&version=12332946[2]
> > > > > > > > > > > >
> > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > /
> > > > > > > > > > > > [3]
> > > > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > >
> > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > /
> > > > > > > > > > > > [4]
> > > > > > > > > > > >
> > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >
> > > > Abdelhakim Deneche
> > > >
> > > > Software Engineer
> > > >
> > > > <http://www.mapr.com/>
> > > >
> > > >
> > > > Now Available - Free Hadoop On-Demand Training <
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > >
> > > >
> > >
> >
>
>
>
> --
>
> Abdelhakim Deneche
>
> Software Engineer
>
> <http://www.mapr.com/>
>
>
> Now Available - Free Hadoop On-Demand Training
> <
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Amit Hadke <am...@gmail.com>.
I've seen "OutOfMemoryError:unable to create new native thread". on mac,
especially for impersonation tests(minidfs).
I had to increase limits in order to fix that. (open files and max user
processes)
On Mon, Nov 9, 2015 at 3:32 PM, Jason Altekruse <al...@gmail.com>
wrote:
> On two successive attempts I saw these errors while running the tests on my
> mac. One of the commits on Friday was trying to fix an issue with leaking
> threads. It appears that there is still more that needs to be done here.
>
> It's unfortunately going to have to be -1 for me as well.
>
> Tests in error:
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions
> » UserRemote
>
>
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> » Rpc
>
>
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> »
>
>
> testDirectImpersonation_HasGroupReadPermissions(org.apache.drill.exec.impersonation.TestImpersonationQueries)
> Time elapsed: 0.101 sec <<< ERROR!
> org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
> OutOfMemoryError: unable to create new native thread
>
>
> [Error Id: 61865e6f-780a-4a76-906d-2f88191d7e5e on 10.0.1.12:31010]
> at
>
> org.apache.drill.exec.rpc.user.QueryResultHandler.resultArrived(QueryResultHandler.java:118)
> at
>
> org.apache.drill.exec.rpc.user.UserClient.handleReponse(UserClient.java:112)
> at
>
> org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:47)
> at
>
> org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:32)
> at org.apache.drill.exec.rpc.RpcBus.handle(RpcBus.java:68)
> at org.apache.drill.exec.rpc.RpcBus$RequestEvent.run(RpcBus.java:390)
> at
>
> org.apache.drill.common.SerializedExecutor$RunnableProcessor.run(SerializedExecutor.java:105)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
> testDirectImpersonation_NoReadPermissions(org.apache.drill.exec.impersonation.TestImpersonationQueries)
> Time elapsed: 0.021 sec <<< ERROR!
> org.apache.drill.exec.rpc.RpcException:
> org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
> OutOfMemoryError: unable to create new native thread
>
>
> [Error Id: f1cd9d09-8444-4e5f-9e89-5810d15cf5c9 on 10.0.1.12:31010]
> at
> org.apache.drill.exec.rpc.RpcException.mapException(RpcException.java:60)
> at
>
> org.apache.drill.exec.client.DrillClient$ListHoldingResultsListener.getResults(DrillClient.java:424)
> at
> org.apache.drill.exec.client.DrillClient.runQuery(DrillClient.java:321)
> at org.apache.drill.QueryTestUtil.createClient(QueryTestUtil.java:69)
> at org.apache.drill.BaseTestQuery.updateClient(BaseTestQuery.java:213)
> at org.apache.drill.BaseTestQuery.updateClient(BaseTestQuery.java:236)
> at org.apache.drill.BaseTestQuery.updateClient(BaseTestQuery.java:222)
> at
>
> org.apache.drill.exec.impersonation.TestImpersonationQueries.testDirectImpersonation_NoReadPermissions(TestImpersonationQueries.java:196)
> Caused by: org.apache.drill.common.exceptions.UserRemoteException: SYSTEM
> ERROR: OutOfMemoryError: unable to create new native thread
>
> On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <adeneche@maprtech.com
> >
> wrote:
>
> > Saw similar failures when running unit tests with forkCount = 1:
> >
> > Tests in error:
> > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > UserRemote
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » Rpc
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > > » IllegalState
> > > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > > IllegalReferenceCount
> > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
> >
> >
> > Unfortunately I'm changing my vote to -1
> >
> >
> > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <hg...@maprtech.com>
> wrote:
> >
> > > -1 (binding)
> > >
> > > 5/5 consecutive runs I get the following consistently with forkCount
> set
> > to
> > > 1 on build.
> > >
> > > Tests in error:
> > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > > UserRemote
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > > updateClient:236->BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213 »
> > > IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > > >BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > > 236->BaseTestQuery.updateClient:213 » IllegalState
> > >
> > >
> > > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <
> stefan@activitystream.com
> > >
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I'm not a committer and not voting but I want to point out that the
> > UDFs
> > > > that we are using and run with 1.1 and 1.2 do not, for some reason,
> run
> > > > with 1.3.
> > > >
> > > > I'm inclined to insist that it's something we are doing wrong but if
> > this
> > > > counts as a test then it's failing.
> > > >
> > > > Regards,
> > > > -Stefan
> > > >
> > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <no...@simba.com>
> wrote:
> > > >
> > > > > +1 Non-binding.
> > > > >
> > > > > Built from source on Linux, tested ODBC against various data
> sources
> > > > > (Hive, DFS-csv, tsv, parquet, json)
> > > > >
> > > > > Norris
> > > > >
> > > > > -----Original Message-----
> > > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > > To: dev@drill.apache.org
> > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > > >
> > > > > +1
> > > > >
> > > > > Checked checksum files and gpg signature for all 3 files. Built
> from
> > > > > source, deployed on a 4 nodes cluster then run several window
> > function
> > > > > queries on TPCDS SF100. Looks great.
> > > > >
> > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <jacques@dremio.com
> >
> > > > wrote:
> > > > >
> > > > > > I've seen another instance of DRILL-4041. Since it is exceedingly
> > > > > > rare, I don't think it is a release stopper. I will spend some
> more
> > > > > > time reviewing it.
> > > > > >
> > > > > > --
> > > > > > Jacques Nadeau
> > > > > > CTO and Co-Founder, Dremio
> > > > > >
> > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <amit.hadke@gmail.com
> >
> > > > wrote:
> > > > > >
> > > > > > > +1, non-binding
> > > > > > > Downloaded tarball, mvn clean install Ran join queries,, was
> able
> > > to
> > > > > > > run queries on json, parquet and sequence files.
> > > > > > >
> > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <
> abhijit@dremio.com
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > > resending the vote with details
> > > > > > > >
> > > > > > > > +1, non-binding
> > > > > > > >
> > > > > > > > ran maven tests, installed on Mac, ran drill in embedded
> mode,
> > > > > > > > verified
> > > > > > > Web
> > > > > > > > UI for CSV header config changes, ran few queries on CSV
> files
> > > > > > > > with and without header, ran few queries against large CSV
> > files
> > > > > > > > with header in
> > > > > > > HDFS
> > > > > > > >
> > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > > hyichu@maprtech.com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1
> > > > > > > > > mvn clean install on mac and linux
> > > > > > > > >
> > > > > > > > > tried a few queries on distributed mode.
> > > > > > > > >
> > > > > > > > > Things looked fine
> > > > > > > > >
> > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > > asinha@maprtech.com>
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1.
> > > > > > > > > > Downloaded the binary tar ball and installed on Mac. Ran
> > > > > > > > > > Drill in
> > > > > > > > > embedded
> > > > > > > > > > mode. Tested a few join, aggregation and limit queries
> > > > > > > > > > against
> > > > > > > parquet
> > > > > > > > > > data with and without metadata cache. Tested
> cancellation
> > > for
> > > > > > couple
> > > > > > > > of
> > > > > > > > > > queries. Looked at query profiles on the WebUI. Looks
> > > good.
> > > > > > > > > >
> > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > > <ab...@dremio.com>
> > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1
> > > > > > > > > > >
> > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> > andrew@primer.org>
> > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > > >
> > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > > > > > jacques@dremio.com>
> > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > > >
> > > > > > > > > > > > > I'd like to propose a new release candidate of
> Apache
> > > > > > > > > > > > > Drill,
> > > > > > > > > version
> > > > > > > > > > > > > 1.3.0. This is the second release candidate (rc1).
> > > > > > > > > > > > > This
> > > > > > > > addresses
> > > > > > > > > > > some
> > > > > > > > > > > > > issues identified in the first release candidate
> > > > > > > > > > > > > including
> > > > > > some
> > > > > > > > > test
> > > > > > > > > > > > > threading issues, Parquet dictionary read issue
> with
> > > > > > > > > > > > > binary
> > > > > > > > values,
> > > > > > > > > > > Joda
> > > > > > > > > > > > > upgrade to avoid a concurrency bug and a couple
> other
> > > > > > > > > > > > > small
> > > > > > > > things.
> > > > > > > > > > > > >
> > > > > > > > > > > > > The tarball artifacts are hosted at [2] and the
> maven
> > > > > > artifacts
> > > > > > > > are
> > > > > > > > > > > > hosted
> > > > > > > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at
> > > [4].
> > > > > > > > > > > > >
> > > > > > > > > > > > > The vote will be open for 72 hours ending at 10PM
> > > > > > > > > > > > > Pacific,
> > > > > > > > November
> > > > > > > > > > 9,
> > > > > > > > > > > > 2015.
> > > > > > > > > > > > >
> > > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > > [ ] -1
> > > > > > > > > > > > >
> > > > > > > > > > > > > thanks,
> > > > > > > > > > > > > Jacques
> > > > > > > > > > > > >
> > > > > > > > > > > > > [1]
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > > 820&version=12332946[2]
> > > > > > > > > > > > >
> > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > > /
> > > > > > > > > > > > > [3]
> > > > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > > >
> > > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > > /
> > > > > > > > > > > > > [4]
> > > > > > > > > > > > >
> > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Abdelhakim Deneche
> > > > >
> > > > > Software Engineer
> > > > >
> > > > > <http://www.mapr.com/>
> > > > >
> > > > >
> > > > > Now Available - Free Hadoop On-Demand Training <
> > > > >
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> >
> > Abdelhakim Deneche
> >
> > Software Engineer
> >
> > <http://www.mapr.com/>
> >
> >
> > Now Available - Free Hadoop On-Demand Training
> > <
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Jason Altekruse <al...@gmail.com>.
On two successive attempts I saw these errors while running the tests on my
mac. One of the commits on Friday was trying to fix an issue with leaking
threads. It appears that there is still more that needs to be done here.
It's unfortunately going to have to be -1 for me as well.
Tests in error:
TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions
» UserRemote
TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
» Rpc
TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
»
testDirectImpersonation_HasGroupReadPermissions(org.apache.drill.exec.impersonation.TestImpersonationQueries)
Time elapsed: 0.101 sec <<< ERROR!
org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
OutOfMemoryError: unable to create new native thread
[Error Id: 61865e6f-780a-4a76-906d-2f88191d7e5e on 10.0.1.12:31010]
at
org.apache.drill.exec.rpc.user.QueryResultHandler.resultArrived(QueryResultHandler.java:118)
at
org.apache.drill.exec.rpc.user.UserClient.handleReponse(UserClient.java:112)
at
org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:47)
at
org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:32)
at org.apache.drill.exec.rpc.RpcBus.handle(RpcBus.java:68)
at org.apache.drill.exec.rpc.RpcBus$RequestEvent.run(RpcBus.java:390)
at
org.apache.drill.common.SerializedExecutor$RunnableProcessor.run(SerializedExecutor.java:105)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
testDirectImpersonation_NoReadPermissions(org.apache.drill.exec.impersonation.TestImpersonationQueries)
Time elapsed: 0.021 sec <<< ERROR!
org.apache.drill.exec.rpc.RpcException:
org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
OutOfMemoryError: unable to create new native thread
[Error Id: f1cd9d09-8444-4e5f-9e89-5810d15cf5c9 on 10.0.1.12:31010]
at
org.apache.drill.exec.rpc.RpcException.mapException(RpcException.java:60)
at
org.apache.drill.exec.client.DrillClient$ListHoldingResultsListener.getResults(DrillClient.java:424)
at
org.apache.drill.exec.client.DrillClient.runQuery(DrillClient.java:321)
at org.apache.drill.QueryTestUtil.createClient(QueryTestUtil.java:69)
at org.apache.drill.BaseTestQuery.updateClient(BaseTestQuery.java:213)
at org.apache.drill.BaseTestQuery.updateClient(BaseTestQuery.java:236)
at org.apache.drill.BaseTestQuery.updateClient(BaseTestQuery.java:222)
at
org.apache.drill.exec.impersonation.TestImpersonationQueries.testDirectImpersonation_NoReadPermissions(TestImpersonationQueries.java:196)
Caused by: org.apache.drill.common.exceptions.UserRemoteException: SYSTEM
ERROR: OutOfMemoryError: unable to create new native thread
On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche <ad...@maprtech.com>
wrote:
> Saw similar failures when running unit tests with forkCount = 1:
>
> Tests in error:
> > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > UserRemote
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » Rpc
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> > » IllegalState
> > TestCountDownLatchInjection.latchInjected:146 NullPointer
> > TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> > IllegalReferenceCount
> > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
>
>
> Unfortunately I'm changing my vote to -1
>
>
> On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <hg...@maprtech.com> wrote:
>
> > -1 (binding)
> >
> > 5/5 consecutive runs I get the following consistently with forkCount set
> to
> > 1 on build.
> >
> > Tests in error:
> > TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> > UserRemote
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> > updateClient:236->BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > 236->BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213 »
> > IllegalState
> >
> >
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > 236->BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> > >BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> > 236->BaseTestQuery.updateClient:213 » IllegalState
> >
> >
> > On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <stefan@activitystream.com
> >
> > wrote:
> >
> > > Hi,
> > >
> > > I'm not a committer and not voting but I want to point out that the
> UDFs
> > > that we are using and run with 1.1 and 1.2 do not, for some reason, run
> > > with 1.3.
> > >
> > > I'm inclined to insist that it's something we are doing wrong but if
> this
> > > counts as a test then it's failing.
> > >
> > > Regards,
> > > -Stefan
> > >
> > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <no...@simba.com> wrote:
> > >
> > > > +1 Non-binding.
> > > >
> > > > Built from source on Linux, tested ODBC against various data sources
> > > > (Hive, DFS-csv, tsv, parquet, json)
> > > >
> > > > Norris
> > > >
> > > > -----Original Message-----
> > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > > Sent: Monday, November 09, 2015 10:16 AM
> > > > To: dev@drill.apache.org
> > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > > >
> > > > +1
> > > >
> > > > Checked checksum files and gpg signature for all 3 files. Built from
> > > > source, deployed on a 4 nodes cluster then run several window
> function
> > > > queries on TPCDS SF100. Looks great.
> > > >
> > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <ja...@dremio.com>
> > > wrote:
> > > >
> > > > > I've seen another instance of DRILL-4041. Since it is exceedingly
> > > > > rare, I don't think it is a release stopper. I will spend some more
> > > > > time reviewing it.
> > > > >
> > > > > --
> > > > > Jacques Nadeau
> > > > > CTO and Co-Founder, Dremio
> > > > >
> > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <am...@gmail.com>
> > > wrote:
> > > > >
> > > > > > +1, non-binding
> > > > > > Downloaded tarball, mvn clean install Ran join queries,, was able
> > to
> > > > > > run queries on json, parquet and sequence files.
> > > > > >
> > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <abhijit@dremio.com
> >
> > > > wrote:
> > > > > >
> > > > > > > resending the vote with details
> > > > > > >
> > > > > > > +1, non-binding
> > > > > > >
> > > > > > > ran maven tests, installed on Mac, ran drill in embedded mode,
> > > > > > > verified
> > > > > > Web
> > > > > > > UI for CSV header config changes, ran few queries on CSV files
> > > > > > > with and without header, ran few queries against large CSV
> files
> > > > > > > with header in
> > > > > > HDFS
> > > > > > >
> > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> > hyichu@maprtech.com>
> > > > > > wrote:
> > > > > > >
> > > > > > > > +1
> > > > > > > > mvn clean install on mac and linux
> > > > > > > >
> > > > > > > > tried a few queries on distributed mode.
> > > > > > > >
> > > > > > > > Things looked fine
> > > > > > > >
> > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> > asinha@maprtech.com>
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1.
> > > > > > > > > Downloaded the binary tar ball and installed on Mac. Ran
> > > > > > > > > Drill in
> > > > > > > > embedded
> > > > > > > > > mode. Tested a few join, aggregation and limit queries
> > > > > > > > > against
> > > > > > parquet
> > > > > > > > > data with and without metadata cache. Tested cancellation
> > for
> > > > > couple
> > > > > > > of
> > > > > > > > > queries. Looked at query profiles on the WebUI. Looks
> > good.
> > > > > > > > >
> > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > > <ab...@dremio.com>
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1
> > > > > > > > > >
> > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <
> andrew@primer.org>
> > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > > >
> > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > > > > jacques@dremio.com>
> > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > Hey Everybody,
> > > > > > > > > > > >
> > > > > > > > > > > > I'd like to propose a new release candidate of Apache
> > > > > > > > > > > > Drill,
> > > > > > > > version
> > > > > > > > > > > > 1.3.0. This is the second release candidate (rc1).
> > > > > > > > > > > > This
> > > > > > > addresses
> > > > > > > > > > some
> > > > > > > > > > > > issues identified in the first release candidate
> > > > > > > > > > > > including
> > > > > some
> > > > > > > > test
> > > > > > > > > > > > threading issues, Parquet dictionary read issue with
> > > > > > > > > > > > binary
> > > > > > > values,
> > > > > > > > > > Joda
> > > > > > > > > > > > upgrade to avoid a concurrency bug and a couple other
> > > > > > > > > > > > small
> > > > > > > things.
> > > > > > > > > > > >
> > > > > > > > > > > > The tarball artifacts are hosted at [2] and the maven
> > > > > artifacts
> > > > > > > are
> > > > > > > > > > > hosted
> > > > > > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at
> > [4].
> > > > > > > > > > > >
> > > > > > > > > > > > The vote will be open for 72 hours ending at 10PM
> > > > > > > > > > > > Pacific,
> > > > > > > November
> > > > > > > > > 9,
> > > > > > > > > > > 2015.
> > > > > > > > > > > >
> > > > > > > > > > > > [ ] +1
> > > > > > > > > > > > [ ] +0
> > > > > > > > > > > > [ ] -1
> > > > > > > > > > > >
> > > > > > > > > > > > thanks,
> > > > > > > > > > > > Jacques
> > > > > > > > > > > >
> > > > > > > > > > > > [1]
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > > 820&version=12332946[2]
> > > > > > > > > > > >
> > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > > /
> > > > > > > > > > > > [3]
> > > > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > >
> > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > > /
> > > > > > > > > > > > [4]
> > > > > > > > > > > >
> > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >
> > > > Abdelhakim Deneche
> > > >
> > > > Software Engineer
> > > >
> > > > <http://www.mapr.com/>
> > > >
> > > >
> > > > Now Available - Free Hadoop On-Demand Training <
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > >
> > > >
> > >
> >
>
>
>
> --
>
> Abdelhakim Deneche
>
> Software Engineer
>
> <http://www.mapr.com/>
>
>
> Now Available - Free Hadoop On-Demand Training
> <
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Abdel Hakim Deneche <ad...@maprtech.com>.
Saw similar failures when running unit tests with forkCount = 1:
Tests in error:
> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> UserRemote
>
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> » Rpc
>
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> » IllegalState
>
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> » IllegalState
>
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> » IllegalState
>
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> » IllegalState
>
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213
> » IllegalState
> TestCountDownLatchInjection.latchInjected:146 NullPointer
> TestMergingReceiver.testMultipleProvidersMixedSizes:115 »
> IllegalReferenceCount
> Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118
Unfortunately I'm changing my vote to -1
On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes <hg...@maprtech.com> wrote:
> -1 (binding)
>
> 5/5 consecutive runs I get the following consistently with forkCount set to
> 1 on build.
>
> Tests in error:
> TestImpersonationQueries.sequenceFileChainedImpersonationWithView »
> UserRemote
>
> TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
> updateClient:236->BaseTestQuery.updateClient:213 » IllegalState
>
> TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> 236->BaseTestQuery.updateClient:213 » IllegalState
>
> TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
> >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213 »
> IllegalState
>
> TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> 236->BaseTestQuery.updateClient:213 » IllegalState
>
> TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
> >BaseTestQuery.updateClient:213 » IllegalState
>
> TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
> 236->BaseTestQuery.updateClient:213 » IllegalState
>
>
> On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <st...@activitystream.com>
> wrote:
>
> > Hi,
> >
> > I'm not a committer and not voting but I want to point out that the UDFs
> > that we are using and run with 1.1 and 1.2 do not, for some reason, run
> > with 1.3.
> >
> > I'm inclined to insist that it's something we are doing wrong but if this
> > counts as a test then it's failing.
> >
> > Regards,
> > -Stefan
> >
> > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <no...@simba.com> wrote:
> >
> > > +1 Non-binding.
> > >
> > > Built from source on Linux, tested ODBC against various data sources
> > > (Hive, DFS-csv, tsv, parquet, json)
> > >
> > > Norris
> > >
> > > -----Original Message-----
> > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > > Sent: Monday, November 09, 2015 10:16 AM
> > > To: dev@drill.apache.org
> > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> > >
> > > +1
> > >
> > > Checked checksum files and gpg signature for all 3 files. Built from
> > > source, deployed on a 4 nodes cluster then run several window function
> > > queries on TPCDS SF100. Looks great.
> > >
> > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <ja...@dremio.com>
> > wrote:
> > >
> > > > I've seen another instance of DRILL-4041. Since it is exceedingly
> > > > rare, I don't think it is a release stopper. I will spend some more
> > > > time reviewing it.
> > > >
> > > > --
> > > > Jacques Nadeau
> > > > CTO and Co-Founder, Dremio
> > > >
> > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <am...@gmail.com>
> > wrote:
> > > >
> > > > > +1, non-binding
> > > > > Downloaded tarball, mvn clean install Ran join queries,, was able
> to
> > > > > run queries on json, parquet and sequence files.
> > > > >
> > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <ab...@dremio.com>
> > > wrote:
> > > > >
> > > > > > resending the vote with details
> > > > > >
> > > > > > +1, non-binding
> > > > > >
> > > > > > ran maven tests, installed on Mac, ran drill in embedded mode,
> > > > > > verified
> > > > > Web
> > > > > > UI for CSV header config changes, ran few queries on CSV files
> > > > > > with and without header, ran few queries against large CSV files
> > > > > > with header in
> > > > > HDFS
> > > > > >
> > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <
> hyichu@maprtech.com>
> > > > > wrote:
> > > > > >
> > > > > > > +1
> > > > > > > mvn clean install on mac and linux
> > > > > > >
> > > > > > > tried a few queries on distributed mode.
> > > > > > >
> > > > > > > Things looked fine
> > > > > > >
> > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <
> asinha@maprtech.com>
> > > > > wrote:
> > > > > > >
> > > > > > > > +1.
> > > > > > > > Downloaded the binary tar ball and installed on Mac. Ran
> > > > > > > > Drill in
> > > > > > > embedded
> > > > > > > > mode. Tested a few join, aggregation and limit queries
> > > > > > > > against
> > > > > parquet
> > > > > > > > data with and without metadata cache. Tested cancellation
> for
> > > > couple
> > > > > > of
> > > > > > > > queries. Looked at query profiles on the WebUI. Looks
> good.
> > > > > > > >
> > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > > <ab...@dremio.com>
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1
> > > > > > > > >
> > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org>
> > > > wrote:
> > > > > > > > >
> > > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > > >
> > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > > > jacques@dremio.com>
> > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > Hey Everybody,
> > > > > > > > > > >
> > > > > > > > > > > I'd like to propose a new release candidate of Apache
> > > > > > > > > > > Drill,
> > > > > > > version
> > > > > > > > > > > 1.3.0. This is the second release candidate (rc1).
> > > > > > > > > > > This
> > > > > > addresses
> > > > > > > > > some
> > > > > > > > > > > issues identified in the first release candidate
> > > > > > > > > > > including
> > > > some
> > > > > > > test
> > > > > > > > > > > threading issues, Parquet dictionary read issue with
> > > > > > > > > > > binary
> > > > > > values,
> > > > > > > > > Joda
> > > > > > > > > > > upgrade to avoid a concurrency bug and a couple other
> > > > > > > > > > > small
> > > > > > things.
> > > > > > > > > > >
> > > > > > > > > > > The tarball artifacts are hosted at [2] and the maven
> > > > artifacts
> > > > > > are
> > > > > > > > > > hosted
> > > > > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at
> [4].
> > > > > > > > > > >
> > > > > > > > > > > The vote will be open for 72 hours ending at 10PM
> > > > > > > > > > > Pacific,
> > > > > > November
> > > > > > > > 9,
> > > > > > > > > > 2015.
> > > > > > > > > > >
> > > > > > > > > > > [ ] +1
> > > > > > > > > > > [ ] +0
> > > > > > > > > > > [ ] -1
> > > > > > > > > > >
> > > > > > > > > > > thanks,
> > > > > > > > > > > Jacques
> > > > > > > > > > >
> > > > > > > > > > > [1]
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > > 820&version=12332946[2]
> > > > > > > > > > >
> http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > > /
> > > > > > > > > > > [3]
> > > > > > > > > >
> > > > > > > >
> > > > > >
> > > >
> https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > > /
> > > > > > > > > > > [4]
> > > > > > > > > > >
> https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Jacques Nadeau
> > > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > >
> > > Abdelhakim Deneche
> > >
> > > Software Engineer
> > >
> > > <http://www.mapr.com/>
> > >
> > >
> > > Now Available - Free Hadoop On-Demand Training <
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > >
> > >
> >
>
--
Abdelhakim Deneche
Software Engineer
<http://www.mapr.com/>
Now Available - Free Hadoop On-Demand Training
<http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Hanifi Gunes <hg...@maprtech.com>.
-1 (binding)
5/5 consecutive runs I get the following consistently with forkCount set to
1 on build.
Tests in error:
TestImpersonationQueries.sequenceFileChainedImpersonationWithView » UserRemote
TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMaxUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.
updateClient:236->BaseTestQuery.updateClient:213 » IllegalState
TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:219->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
236->BaseTestQuery.updateClient:213 » IllegalState
TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestImpersonation.createView:186->BaseTestQuery.updateClient:222-
>BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213 »
IllegalState
TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
236->BaseTestQuery.updateClient:213 » IllegalState
TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236-
>BaseTestQuery.updateClient:213 » IllegalState
TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:210->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:
236->BaseTestQuery.updateClient:213 » IllegalState
On Mon, Nov 9, 2015 at 2:19 PM, Stefán Baxter <st...@activitystream.com>
wrote:
> Hi,
>
> I'm not a committer and not voting but I want to point out that the UDFs
> that we are using and run with 1.1 and 1.2 do not, for some reason, run
> with 1.3.
>
> I'm inclined to insist that it's something we are doing wrong but if this
> counts as a test then it's failing.
>
> Regards,
> -Stefan
>
> On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <no...@simba.com> wrote:
>
> > +1 Non-binding.
> >
> > Built from source on Linux, tested ODBC against various data sources
> > (Hive, DFS-csv, tsv, parquet, json)
> >
> > Norris
> >
> > -----Original Message-----
> > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> > Sent: Monday, November 09, 2015 10:16 AM
> > To: dev@drill.apache.org
> > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
> >
> > +1
> >
> > Checked checksum files and gpg signature for all 3 files. Built from
> > source, deployed on a 4 nodes cluster then run several window function
> > queries on TPCDS SF100. Looks great.
> >
> > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <ja...@dremio.com>
> wrote:
> >
> > > I've seen another instance of DRILL-4041. Since it is exceedingly
> > > rare, I don't think it is a release stopper. I will spend some more
> > > time reviewing it.
> > >
> > > --
> > > Jacques Nadeau
> > > CTO and Co-Founder, Dremio
> > >
> > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <am...@gmail.com>
> wrote:
> > >
> > > > +1, non-binding
> > > > Downloaded tarball, mvn clean install Ran join queries,, was able to
> > > > run queries on json, parquet and sequence files.
> > > >
> > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <ab...@dremio.com>
> > wrote:
> > > >
> > > > > resending the vote with details
> > > > >
> > > > > +1, non-binding
> > > > >
> > > > > ran maven tests, installed on Mac, ran drill in embedded mode,
> > > > > verified
> > > > Web
> > > > > UI for CSV header config changes, ran few queries on CSV files
> > > > > with and without header, ran few queries against large CSV files
> > > > > with header in
> > > > HDFS
> > > > >
> > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <hy...@maprtech.com>
> > > > wrote:
> > > > >
> > > > > > +1
> > > > > > mvn clean install on mac and linux
> > > > > >
> > > > > > tried a few queries on distributed mode.
> > > > > >
> > > > > > Things looked fine
> > > > > >
> > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <as...@maprtech.com>
> > > > wrote:
> > > > > >
> > > > > > > +1.
> > > > > > > Downloaded the binary tar ball and installed on Mac. Ran
> > > > > > > Drill in
> > > > > > embedded
> > > > > > > mode. Tested a few join, aggregation and limit queries
> > > > > > > against
> > > > parquet
> > > > > > > data with and without metadata cache. Tested cancellation for
> > > couple
> > > > > of
> > > > > > > queries. Looked at query profiles on the WebUI. Looks good.
> > > > > > >
> > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > > <ab...@dremio.com>
> > > > > wrote:
> > > > > > >
> > > > > > > > +1
> > > > > > > >
> > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org>
> > > wrote:
> > > > > > > >
> > > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > > >
> > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > > jacques@dremio.com>
> > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > Hey Everybody,
> > > > > > > > > >
> > > > > > > > > > I'd like to propose a new release candidate of Apache
> > > > > > > > > > Drill,
> > > > > > version
> > > > > > > > > > 1.3.0. This is the second release candidate (rc1).
> > > > > > > > > > This
> > > > > addresses
> > > > > > > > some
> > > > > > > > > > issues identified in the first release candidate
> > > > > > > > > > including
> > > some
> > > > > > test
> > > > > > > > > > threading issues, Parquet dictionary read issue with
> > > > > > > > > > binary
> > > > > values,
> > > > > > > > Joda
> > > > > > > > > > upgrade to avoid a concurrency bug and a couple other
> > > > > > > > > > small
> > > > > things.
> > > > > > > > > >
> > > > > > > > > > The tarball artifacts are hosted at [2] and the maven
> > > artifacts
> > > > > are
> > > > > > > > > hosted
> > > > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > > > > > > > > >
> > > > > > > > > > The vote will be open for 72 hours ending at 10PM
> > > > > > > > > > Pacific,
> > > > > November
> > > > > > > 9,
> > > > > > > > > 2015.
> > > > > > > > > >
> > > > > > > > > > [ ] +1
> > > > > > > > > > [ ] +0
> > > > > > > > > > [ ] -1
> > > > > > > > > >
> > > > > > > > > > thanks,
> > > > > > > > > > Jacques
> > > > > > > > > >
> > > > > > > > > > [1]
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > > 820&version=12332946[2]
> > > > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > > /
> > > > > > > > > > [3]
> > > > > > > > >
> > > > > > >
> > > > >
> > > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > > /
> > > > > > > > > > [4]
> > > > > > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Jacques Nadeau
> > > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> >
> > Abdelhakim Deneche
> >
> > Software Engineer
> >
> > <http://www.mapr.com/>
> >
> >
> > Now Available - Free Hadoop On-Demand Training <
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Stefán Baxter <st...@activitystream.com>.
Hi,
I'm not a committer and not voting but I want to point out that the UDFs
that we are using and run with 1.1 and 1.2 do not, for some reason, run
with 1.3.
I'm inclined to insist that it's something we are doing wrong but if this
counts as a test then it's failing.
Regards,
-Stefan
On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee <no...@simba.com> wrote:
> +1 Non-binding.
>
> Built from source on Linux, tested ODBC against various data sources
> (Hive, DFS-csv, tsv, parquet, json)
>
> Norris
>
> -----Original Message-----
> From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
> Sent: Monday, November 09, 2015 10:16 AM
> To: dev@drill.apache.org
> Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
>
> +1
>
> Checked checksum files and gpg signature for all 3 files. Built from
> source, deployed on a 4 nodes cluster then run several window function
> queries on TPCDS SF100. Looks great.
>
> On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <ja...@dremio.com> wrote:
>
> > I've seen another instance of DRILL-4041. Since it is exceedingly
> > rare, I don't think it is a release stopper. I will spend some more
> > time reviewing it.
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
> > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <am...@gmail.com> wrote:
> >
> > > +1, non-binding
> > > Downloaded tarball, mvn clean install Ran join queries,, was able to
> > > run queries on json, parquet and sequence files.
> > >
> > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <ab...@dremio.com>
> wrote:
> > >
> > > > resending the vote with details
> > > >
> > > > +1, non-binding
> > > >
> > > > ran maven tests, installed on Mac, ran drill in embedded mode,
> > > > verified
> > > Web
> > > > UI for CSV header config changes, ran few queries on CSV files
> > > > with and without header, ran few queries against large CSV files
> > > > with header in
> > > HDFS
> > > >
> > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <hy...@maprtech.com>
> > > wrote:
> > > >
> > > > > +1
> > > > > mvn clean install on mac and linux
> > > > >
> > > > > tried a few queries on distributed mode.
> > > > >
> > > > > Things looked fine
> > > > >
> > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <as...@maprtech.com>
> > > wrote:
> > > > >
> > > > > > +1.
> > > > > > Downloaded the binary tar ball and installed on Mac. Ran
> > > > > > Drill in
> > > > > embedded
> > > > > > mode. Tested a few join, aggregation and limit queries
> > > > > > against
> > > parquet
> > > > > > data with and without metadata cache. Tested cancellation for
> > couple
> > > > of
> > > > > > queries. Looked at query profiles on the WebUI. Looks good.
> > > > > >
> > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > > <ab...@dremio.com>
> > > > wrote:
> > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org>
> > wrote:
> > > > > > >
> > > > > > > > +1 (non-binding, non-comitter)
> > > > > > > >
> > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > > jacques@dremio.com>
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > Hey Everybody,
> > > > > > > > >
> > > > > > > > > I'd like to propose a new release candidate of Apache
> > > > > > > > > Drill,
> > > > > version
> > > > > > > > > 1.3.0. This is the second release candidate (rc1).
> > > > > > > > > This
> > > > addresses
> > > > > > > some
> > > > > > > > > issues identified in the first release candidate
> > > > > > > > > including
> > some
> > > > > test
> > > > > > > > > threading issues, Parquet dictionary read issue with
> > > > > > > > > binary
> > > > values,
> > > > > > > Joda
> > > > > > > > > upgrade to avoid a concurrency bug and a couple other
> > > > > > > > > small
> > > > things.
> > > > > > > > >
> > > > > > > > > The tarball artifacts are hosted at [2] and the maven
> > artifacts
> > > > are
> > > > > > > > hosted
> > > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > > > > > > > >
> > > > > > > > > The vote will be open for 72 hours ending at 10PM
> > > > > > > > > Pacific,
> > > > November
> > > > > > 9,
> > > > > > > > 2015.
> > > > > > > > >
> > > > > > > > > [ ] +1
> > > > > > > > > [ ] +0
> > > > > > > > > [ ] -1
> > > > > > > > >
> > > > > > > > > thanks,
> > > > > > > > > Jacques
> > > > > > > > >
> > > > > > > > > [1]
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> > 820&version=12332946[2]
> > > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > > /
> > > > > > > > > [3]
> > > > > > > >
> > > > > >
> > > >
> > https://repository.apache.org/content/repositories/orgapachedrill-1014
> > /
> > > > > > > > > [4]
> > > > > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Jacques Nadeau
> > > > > > > > > CTO and Co-Founder, Dremio
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
>
> Abdelhakim Deneche
>
> Software Engineer
>
> <http://www.mapr.com/>
>
>
> Now Available - Free Hadoop On-Demand Training <
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >
>
RE: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Norris Lee <no...@simba.com>.
+1 Non-binding.
Built from source on Linux, tested ODBC against various data sources (Hive, DFS-csv, tsv, parquet, json)
Norris
-----Original Message-----
From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com]
Sent: Monday, November 09, 2015 10:16 AM
To: dev@drill.apache.org
Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
+1
Checked checksum files and gpg signature for all 3 files. Built from source, deployed on a 4 nodes cluster then run several window function queries on TPCDS SF100. Looks great.
On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <ja...@dremio.com> wrote:
> I've seen another instance of DRILL-4041. Since it is exceedingly
> rare, I don't think it is a release stopper. I will spend some more
> time reviewing it.
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <am...@gmail.com> wrote:
>
> > +1, non-binding
> > Downloaded tarball, mvn clean install Ran join queries,, was able to
> > run queries on json, parquet and sequence files.
> >
> > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <ab...@dremio.com> wrote:
> >
> > > resending the vote with details
> > >
> > > +1, non-binding
> > >
> > > ran maven tests, installed on Mac, ran drill in embedded mode,
> > > verified
> > Web
> > > UI for CSV header config changes, ran few queries on CSV files
> > > with and without header, ran few queries against large CSV files
> > > with header in
> > HDFS
> > >
> > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <hy...@maprtech.com>
> > wrote:
> > >
> > > > +1
> > > > mvn clean install on mac and linux
> > > >
> > > > tried a few queries on distributed mode.
> > > >
> > > > Things looked fine
> > > >
> > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <as...@maprtech.com>
> > wrote:
> > > >
> > > > > +1.
> > > > > Downloaded the binary tar ball and installed on Mac. Ran
> > > > > Drill in
> > > > embedded
> > > > > mode. Tested a few join, aggregation and limit queries
> > > > > against
> > parquet
> > > > > data with and without metadata cache. Tested cancellation for
> couple
> > > of
> > > > > queries. Looked at query profiles on the WebUI. Looks good.
> > > > >
> > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol
> > > > > <ab...@dremio.com>
> > > wrote:
> > > > >
> > > > > > +1
> > > > > >
> > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org>
> wrote:
> > > > > >
> > > > > > > +1 (non-binding, non-comitter)
> > > > > > >
> > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > jacques@dremio.com>
> > > > > > wrote:
> > > > > > > >
> > > > > > > > Hey Everybody,
> > > > > > > >
> > > > > > > > I'd like to propose a new release candidate of Apache
> > > > > > > > Drill,
> > > > version
> > > > > > > > 1.3.0. This is the second release candidate (rc1).
> > > > > > > > This
> > > addresses
> > > > > > some
> > > > > > > > issues identified in the first release candidate
> > > > > > > > including
> some
> > > > test
> > > > > > > > threading issues, Parquet dictionary read issue with
> > > > > > > > binary
> > > values,
> > > > > > Joda
> > > > > > > > upgrade to avoid a concurrency bug and a couple other
> > > > > > > > small
> > > things.
> > > > > > > >
> > > > > > > > The tarball artifacts are hosted at [2] and the maven
> artifacts
> > > are
> > > > > > > hosted
> > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > > > > > > >
> > > > > > > > The vote will be open for 72 hours ending at 10PM
> > > > > > > > Pacific,
> > > November
> > > > > 9,
> > > > > > > 2015.
> > > > > > > >
> > > > > > > > [ ] +1
> > > > > > > > [ ] +0
> > > > > > > > [ ] -1
> > > > > > > >
> > > > > > > > thanks,
> > > > > > > > Jacques
> > > > > > > >
> > > > > > > > [1]
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313
> 820&version=12332946[2]
> > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1
> > > > > > > > /
> > > > > > > > [3]
> > > > > > >
> > > > >
> > >
> https://repository.apache.org/content/repositories/orgapachedrill-1014
> /
> > > > > > > > [4]
> > > > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > >
> > > > > > > > --
> > > > > > > > Jacques Nadeau
> > > > > > > > CTO and Co-Founder, Dremio
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
--
Abdelhakim Deneche
Software Engineer
<http://www.mapr.com/>
Now Available - Free Hadoop On-Demand Training <http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Abdel Hakim Deneche <ad...@maprtech.com>.
+1
Checked checksum files and gpg signature for all 3 files. Built from
source, deployed on a 4 nodes cluster then run several window function
queries on TPCDS SF100. Looks great.
On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau <ja...@dremio.com> wrote:
> I've seen another instance of DRILL-4041. Since it is exceedingly rare, I
> don't think it is a release stopper. I will spend some more time reviewing
> it.
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <am...@gmail.com> wrote:
>
> > +1, non-binding
> > Downloaded tarball, mvn clean install
> > Ran join queries,, was able to run queries on json, parquet and sequence
> > files.
> >
> > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <ab...@dremio.com> wrote:
> >
> > > resending the vote with details
> > >
> > > +1, non-binding
> > >
> > > ran maven tests, installed on Mac, ran drill in embedded mode, verified
> > Web
> > > UI for CSV header config changes, ran few queries on CSV files with and
> > > without header, ran few queries against large CSV files with header in
> > HDFS
> > >
> > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <hy...@maprtech.com>
> > wrote:
> > >
> > > > +1
> > > > mvn clean install on mac and linux
> > > >
> > > > tried a few queries on distributed mode.
> > > >
> > > > Things looked fine
> > > >
> > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <as...@maprtech.com>
> > wrote:
> > > >
> > > > > +1.
> > > > > Downloaded the binary tar ball and installed on Mac. Ran Drill in
> > > > embedded
> > > > > mode. Tested a few join, aggregation and limit queries against
> > parquet
> > > > > data with and without metadata cache. Tested cancellation for
> couple
> > > of
> > > > > queries. Looked at query profiles on the WebUI. Looks good.
> > > > >
> > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol <ab...@dremio.com>
> > > wrote:
> > > > >
> > > > > > +1
> > > > > >
> > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org>
> wrote:
> > > > > >
> > > > > > > +1 (non-binding, non-comitter)
> > > > > > >
> > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> > jacques@dremio.com>
> > > > > > wrote:
> > > > > > > >
> > > > > > > > Hey Everybody,
> > > > > > > >
> > > > > > > > I'd like to propose a new release candidate of Apache Drill,
> > > > version
> > > > > > > > 1.3.0. This is the second release candidate (rc1). This
> > > addresses
> > > > > > some
> > > > > > > > issues identified in the first release candidate including
> some
> > > > test
> > > > > > > > threading issues, Parquet dictionary read issue with binary
> > > values,
> > > > > > Joda
> > > > > > > > upgrade to avoid a concurrency bug and a couple other small
> > > things.
> > > > > > > >
> > > > > > > > The tarball artifacts are hosted at [2] and the maven
> artifacts
> > > are
> > > > > > > hosted
> > > > > > > > at [3]. This release candidate is based on commit
> > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > > > > > > >
> > > > > > > > The vote will be open for 72 hours ending at 10PM Pacific,
> > > November
> > > > > 9,
> > > > > > > 2015.
> > > > > > > >
> > > > > > > > [ ] +1
> > > > > > > > [ ] +0
> > > > > > > > [ ] -1
> > > > > > > >
> > > > > > > > thanks,
> > > > > > > > Jacques
> > > > > > > >
> > > > > > > > [1]
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> > > > > > > > [3]
> > > > > > >
> > > > >
> > >
> https://repository.apache.org/content/repositories/orgapachedrill-1014/
> > > > > > > > [4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > > >
> > > > > > > > --
> > > > > > > > Jacques Nadeau
> > > > > > > > CTO and Co-Founder, Dremio
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
--
Abdelhakim Deneche
Software Engineer
<http://www.mapr.com/>
Now Available - Free Hadoop On-Demand Training
<http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Jacques Nadeau <ja...@dremio.com>.
I've seen another instance of DRILL-4041. Since it is exceedingly rare, I
don't think it is a release stopper. I will spend some more time reviewing
it.
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke <am...@gmail.com> wrote:
> +1, non-binding
> Downloaded tarball, mvn clean install
> Ran join queries,, was able to run queries on json, parquet and sequence
> files.
>
> On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <ab...@dremio.com> wrote:
>
> > resending the vote with details
> >
> > +1, non-binding
> >
> > ran maven tests, installed on Mac, ran drill in embedded mode, verified
> Web
> > UI for CSV header config changes, ran few queries on CSV files with and
> > without header, ran few queries against large CSV files with header in
> HDFS
> >
> > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <hy...@maprtech.com>
> wrote:
> >
> > > +1
> > > mvn clean install on mac and linux
> > >
> > > tried a few queries on distributed mode.
> > >
> > > Things looked fine
> > >
> > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <as...@maprtech.com>
> wrote:
> > >
> > > > +1.
> > > > Downloaded the binary tar ball and installed on Mac. Ran Drill in
> > > embedded
> > > > mode. Tested a few join, aggregation and limit queries against
> parquet
> > > > data with and without metadata cache. Tested cancellation for couple
> > of
> > > > queries. Looked at query profiles on the WebUI. Looks good.
> > > >
> > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol <ab...@dremio.com>
> > wrote:
> > > >
> > > > > +1
> > > > >
> > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org> wrote:
> > > > >
> > > > > > +1 (non-binding, non-comitter)
> > > > > >
> > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <
> jacques@dremio.com>
> > > > > wrote:
> > > > > > >
> > > > > > > Hey Everybody,
> > > > > > >
> > > > > > > I'd like to propose a new release candidate of Apache Drill,
> > > version
> > > > > > > 1.3.0. This is the second release candidate (rc1). This
> > addresses
> > > > > some
> > > > > > > issues identified in the first release candidate including some
> > > test
> > > > > > > threading issues, Parquet dictionary read issue with binary
> > values,
> > > > > Joda
> > > > > > > upgrade to avoid a concurrency bug and a couple other small
> > things.
> > > > > > >
> > > > > > > The tarball artifacts are hosted at [2] and the maven artifacts
> > are
> > > > > > hosted
> > > > > > > at [3]. This release candidate is based on commit
> > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > > > > > >
> > > > > > > The vote will be open for 72 hours ending at 10PM Pacific,
> > November
> > > > 9,
> > > > > > 2015.
> > > > > > >
> > > > > > > [ ] +1
> > > > > > > [ ] +0
> > > > > > > [ ] -1
> > > > > > >
> > > > > > > thanks,
> > > > > > > Jacques
> > > > > > >
> > > > > > > [1]
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> > > > > > > [3]
> > > > > >
> > > >
> > https://repository.apache.org/content/repositories/orgapachedrill-1014/
> > > > > > > [4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > > >
> > > > > > > --
> > > > > > > Jacques Nadeau
> > > > > > > CTO and Co-Founder, Dremio
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Amit Hadke <am...@gmail.com>.
+1, non-binding
Downloaded tarball, mvn clean install
Ran join queries,, was able to run queries on json, parquet and sequence
files.
On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol <ab...@dremio.com> wrote:
> resending the vote with details
>
> +1, non-binding
>
> ran maven tests, installed on Mac, ran drill in embedded mode, verified Web
> UI for CSV header config changes, ran few queries on CSV files with and
> without header, ran few queries against large CSV files with header in HDFS
>
> On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <hy...@maprtech.com> wrote:
>
> > +1
> > mvn clean install on mac and linux
> >
> > tried a few queries on distributed mode.
> >
> > Things looked fine
> >
> > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <as...@maprtech.com> wrote:
> >
> > > +1.
> > > Downloaded the binary tar ball and installed on Mac. Ran Drill in
> > embedded
> > > mode. Tested a few join, aggregation and limit queries against parquet
> > > data with and without metadata cache. Tested cancellation for couple
> of
> > > queries. Looked at query profiles on the WebUI. Looks good.
> > >
> > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol <ab...@dremio.com>
> wrote:
> > >
> > > > +1
> > > >
> > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org> wrote:
> > > >
> > > > > +1 (non-binding, non-comitter)
> > > > >
> > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <ja...@dremio.com>
> > > > wrote:
> > > > > >
> > > > > > Hey Everybody,
> > > > > >
> > > > > > I'd like to propose a new release candidate of Apache Drill,
> > version
> > > > > > 1.3.0. This is the second release candidate (rc1). This
> addresses
> > > > some
> > > > > > issues identified in the first release candidate including some
> > test
> > > > > > threading issues, Parquet dictionary read issue with binary
> values,
> > > > Joda
> > > > > > upgrade to avoid a concurrency bug and a couple other small
> things.
> > > > > >
> > > > > > The tarball artifacts are hosted at [2] and the maven artifacts
> are
> > > > > hosted
> > > > > > at [3]. This release candidate is based on commit
> > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > > > > >
> > > > > > The vote will be open for 72 hours ending at 10PM Pacific,
> November
> > > 9,
> > > > > 2015.
> > > > > >
> > > > > > [ ] +1
> > > > > > [ ] +0
> > > > > > [ ] -1
> > > > > >
> > > > > > thanks,
> > > > > > Jacques
> > > > > >
> > > > > > [1]
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> > > > > > [3]
> > > > >
> > >
> https://repository.apache.org/content/repositories/orgapachedrill-1014/
> > > > > > [4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > > >
> > > > > > --
> > > > > > Jacques Nadeau
> > > > > > CTO and Co-Founder, Dremio
> > > > >
> > > > >
> > > >
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Abhijit Pol <ab...@dremio.com>.
resending the vote with details
+1, non-binding
ran maven tests, installed on Mac, ran drill in embedded mode, verified Web
UI for CSV header config changes, ran few queries on CSV files with and
without header, ran few queries against large CSV files with header in HDFS
On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu <hy...@maprtech.com> wrote:
> +1
> mvn clean install on mac and linux
>
> tried a few queries on distributed mode.
>
> Things looked fine
>
> On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <as...@maprtech.com> wrote:
>
> > +1.
> > Downloaded the binary tar ball and installed on Mac. Ran Drill in
> embedded
> > mode. Tested a few join, aggregation and limit queries against parquet
> > data with and without metadata cache. Tested cancellation for couple of
> > queries. Looked at query profiles on the WebUI. Looks good.
> >
> > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol <ab...@dremio.com> wrote:
> >
> > > +1
> > >
> > > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org> wrote:
> > >
> > > > +1 (non-binding, non-comitter)
> > > >
> > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <ja...@dremio.com>
> > > wrote:
> > > > >
> > > > > Hey Everybody,
> > > > >
> > > > > I'd like to propose a new release candidate of Apache Drill,
> version
> > > > > 1.3.0. This is the second release candidate (rc1). This addresses
> > > some
> > > > > issues identified in the first release candidate including some
> test
> > > > > threading issues, Parquet dictionary read issue with binary values,
> > > Joda
> > > > > upgrade to avoid a concurrency bug and a couple other small things.
> > > > >
> > > > > The tarball artifacts are hosted at [2] and the maven artifacts are
> > > > hosted
> > > > > at [3]. This release candidate is based on commit
> > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > > > >
> > > > > The vote will be open for 72 hours ending at 10PM Pacific, November
> > 9,
> > > > 2015.
> > > > >
> > > > > [ ] +1
> > > > > [ ] +0
> > > > > [ ] -1
> > > > >
> > > > > thanks,
> > > > > Jacques
> > > > >
> > > > > [1]
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> > > > > [3]
> > > >
> > https://repository.apache.org/content/repositories/orgapachedrill-1014/
> > > > > [4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > > >
> > > > > --
> > > > > Jacques Nadeau
> > > > > CTO and Co-Founder, Dremio
> > > >
> > > >
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Hsuan Yi Chu <hy...@maprtech.com>.
+1
mvn clean install on mac and linux
tried a few queries on distributed mode.
Things looked fine
On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha <as...@maprtech.com> wrote:
> +1.
> Downloaded the binary tar ball and installed on Mac. Ran Drill in embedded
> mode. Tested a few join, aggregation and limit queries against parquet
> data with and without metadata cache. Tested cancellation for couple of
> queries. Looked at query profiles on the WebUI. Looks good.
>
> On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol <ab...@dremio.com> wrote:
>
> > +1
> >
> > On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org> wrote:
> >
> > > +1 (non-binding, non-comitter)
> > >
> > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <ja...@dremio.com>
> > wrote:
> > > >
> > > > Hey Everybody,
> > > >
> > > > I'd like to propose a new release candidate of Apache Drill, version
> > > > 1.3.0. This is the second release candidate (rc1). This addresses
> > some
> > > > issues identified in the first release candidate including some test
> > > > threading issues, Parquet dictionary read issue with binary values,
> > Joda
> > > > upgrade to avoid a concurrency bug and a couple other small things.
> > > >
> > > > The tarball artifacts are hosted at [2] and the maven artifacts are
> > > hosted
> > > > at [3]. This release candidate is based on commit
> > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > > >
> > > > The vote will be open for 72 hours ending at 10PM Pacific, November
> 9,
> > > 2015.
> > > >
> > > > [ ] +1
> > > > [ ] +0
> > > > [ ] -1
> > > >
> > > > thanks,
> > > > Jacques
> > > >
> > > > [1]
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> > > > [3]
> > >
> https://repository.apache.org/content/repositories/orgapachedrill-1014/
> > > > [4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > > >
> > > > --
> > > > Jacques Nadeau
> > > > CTO and Co-Founder, Dremio
> > >
> > >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Aman Sinha <as...@maprtech.com>.
+1.
Downloaded the binary tar ball and installed on Mac. Ran Drill in embedded
mode. Tested a few join, aggregation and limit queries against parquet
data with and without metadata cache. Tested cancellation for couple of
queries. Looked at query profiles on the WebUI. Looks good.
On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol <ab...@dremio.com> wrote:
> +1
>
> On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org> wrote:
>
> > +1 (non-binding, non-comitter)
> >
> > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <ja...@dremio.com>
> wrote:
> > >
> > > Hey Everybody,
> > >
> > > I'd like to propose a new release candidate of Apache Drill, version
> > > 1.3.0. This is the second release candidate (rc1). This addresses
> some
> > > issues identified in the first release candidate including some test
> > > threading issues, Parquet dictionary read issue with binary values,
> Joda
> > > upgrade to avoid a concurrency bug and a couple other small things.
> > >
> > > The tarball artifacts are hosted at [2] and the maven artifacts are
> > hosted
> > > at [3]. This release candidate is based on commit
> > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> > >
> > > The vote will be open for 72 hours ending at 10PM Pacific, November 9,
> > 2015.
> > >
> > > [ ] +1
> > > [ ] +0
> > > [ ] -1
> > >
> > > thanks,
> > > Jacques
> > >
> > > [1]
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> > > [3]
> > https://repository.apache.org/content/repositories/orgapachedrill-1014/
> > > [4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> > >
> > > --
> > > Jacques Nadeau
> > > CTO and Co-Founder, Dremio
> >
> >
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Abhijit Pol <ab...@dremio.com>.
+1
On Sat, Nov 7, 2015 at 9:41 PM, andrew <an...@primer.org> wrote:
> +1 (non-binding, non-comitter)
>
> > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <ja...@dremio.com> wrote:
> >
> > Hey Everybody,
> >
> > I'd like to propose a new release candidate of Apache Drill, version
> > 1.3.0. This is the second release candidate (rc1). This addresses some
> > issues identified in the first release candidate including some test
> > threading issues, Parquet dictionary read issue with binary values, Joda
> > upgrade to avoid a concurrency bug and a couple other small things.
> >
> > The tarball artifacts are hosted at [2] and the maven artifacts are
> hosted
> > at [3]. This release candidate is based on commit
> > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
> >
> > The vote will be open for 72 hours ending at 10PM Pacific, November 9,
> 2015.
> >
> > [ ] +1
> > [ ] +0
> > [ ] -1
> >
> > thanks,
> > Jacques
> >
> > [1]
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> > [3]
> https://repository.apache.org/content/repositories/orgapachedrill-1014/
> > [4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
>
>
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by andrew <an...@primer.org>.
+1 (non-binding, non-comitter)
> On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <ja...@dremio.com> wrote:
>
> Hey Everybody,
>
> I'd like to propose a new release candidate of Apache Drill, version
> 1.3.0. This is the second release candidate (rc1). This addresses some
> issues identified in the first release candidate including some test
> threading issues, Parquet dictionary read issue with binary values, Joda
> upgrade to avoid a concurrency bug and a couple other small things.
>
> The tarball artifacts are hosted at [2] and the maven artifacts are hosted
> at [3]. This release candidate is based on commit
> f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
>
> The vote will be open for 72 hours ending at 10PM Pacific, November 9, 2015.
>
> [ ] +1
> [ ] +0
> [ ] -1
>
> thanks,
> Jacques
>
> [1]
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> [3] https://repository.apache.org/content/repositories/orgapachedrill-1014/
> [4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
Re: [VOTE] Release Apache Drill 1.3.0 (rc1)
Posted by Tomer Shiran <ts...@dremio.com>.
+1
Downloaded and ran in embedded mode on a local MongoDB cluster. Executed various queries on nested data in the MongoDB cluster.
> On Nov 6, 2015, at 10:15 PM, Jacques Nadeau <ja...@dremio.com> wrote:
>
> Hey Everybody,
>
> I'd like to propose a new release candidate of Apache Drill, version
> 1.3.0. This is the second release candidate (rc1). This addresses some
> issues identified in the first release candidate including some test
> threading issues, Parquet dictionary read issue with binary values, Joda
> upgrade to avoid a concurrency bug and a couple other small things.
>
> The tarball artifacts are hosted at [2] and the maven artifacts are hosted
> at [3]. This release candidate is based on commit
> f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 located at [4].
>
> The vote will be open for 72 hours ending at 10PM Pacific, November 9, 2015.
>
> [ ] +1
> [ ] +0
> [ ] -1
>
> thanks,
> Jacques
>
> [1]
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12332946[2]
> http://people.apache.org/~jacques/apache-drill-1.3.0.rc1/
> [3] https://repository.apache.org/content/repositories/orgapachedrill-1014/
> [4] https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio