[jira] [Created] (PHOENIX-2690) Exceeding OS limit for native threads with large number of guide posts

["Mujtaba Chohan (JIRA)" <ji...@apache.org>]

Mujtaba Chohan created PHOENIX-2690:
---------------------------------------

             Summary: Exceeding OS limit for native threads with large number of guide posts
                 Key: PHOENIX-2690
                 URL: https://issues.apache.org/jira/browse/PHOENIX-2690
             Project: Phoenix
          Issue Type: Bug
    Affects Versions: 4.7.0
            Reporter: Mujtaba Chohan
            Priority: Minor


With >32K guidepost count for a table (which equates to a 320 GB table size with 10MB guidepost width), following OOM occurs on 64bit Linux client

{code}
select * from table_with_32k_guideposts limit 1000;
java.lang.OutOfMemoryError: unable to create new native thread
	at java.lang.Thread.start0(Native Method)
	at java.lang.Thread.start(Thread.java:714)
	at java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:949) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1360) at org.apache.phoenix.job.JobManager$InstrumentedThreadPoolExecutor.execute(JobManager.java:261) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:132) at org.apache.phoenix.iterate.ParallelIterators.submitWork(ParallelIterators.java:103) at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:621) at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:591) at org.apache.phoenix.iterate.RoundRobinResultIterator.getIterators(RoundRobinResultIterator.java:176) at org.apache.phoenix.iterate.RoundRobinResultIterator.next(RoundRobinResultIterator.java:91) at org.apache.phoenix.iterate.DelegateResultIterator.next(DelegateResultIterator.java:44) at org.apache.phoenix.iterate.LimitingResultIterator.next(LimitingResultIterator.java:47)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)