You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "Barry Fritchman (JIRA)" <ji...@apache.org> on 2016/05/04 18:47:13 UTC

[jira] [Created] (TRAFODION-1971) Redundant initialization slows down bulk load

Barry Fritchman created TRAFODION-1971:
------------------------------------------

             Summary: Redundant initialization slows down bulk load
                 Key: TRAFODION-1971
                 URL: https://issues.apache.org/jira/browse/TRAFODION-1971
             Project: Apache Trafodion
          Issue Type: Bug
          Components: sql-exe
    Affects Versions: 2.0-incubating
            Reporter: Barry Fritchman


During the preparation phase of bulk load, HFIle parameter initialization is performed redundantly following each flush. For a 52-million row table with fairly wide rows, a load takes 3.5 hours vs 35-40 minutes when the unnecessary re-initialization is avoided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [jira] [Created] (TRAFODION-1971) Redundant initialization slows down bulk load

Posted by Qifan Chen <qi...@esgyn.com>.
Nice work, Barry!

On Wed, May 4, 2016 at 7:05 PM, Sean Broeder <se...@esgyn.com> wrote:

> Wow!  I had to read that twice :-)
>
> -----Original Message-----
> From: Dave Birdsall [mailto:dave.birdsall@esgyn.com]
> Sent: Wednesday, May 4, 2016 4:44 PM
> To: dev@trafodion.incubator.apache.org
> Subject: RE: [jira] [Created] (TRAFODION-1971) Redundant initialization
> slows down bulk load
>
> Very nice find!
>
> -----Original Message-----
> From: Liu, Ming (Ming) [mailto:ming.liu@esgyn.cn]
> Sent: Wednesday, May 4, 2016 4:41 PM
> To: dev@trafodion.incubator.apache.org
> Subject: 答复: [jira] [Created] (TRAFODION-1971) Redundant initialization
> slows down bulk load
>
> Increadible!!
>
> -----邮件原件-----
> 发件人: Barry Fritchman (JIRA) [mailto:jira@apache.org]
> 发送时间: 2016年5月5日 2:47
> 收件人: issues@trafodion.incubator.apache.org
> 主题: [jira] [Created] (TRAFODION-1971) Redundant initialization slows down
> bulk load
>
> Barry Fritchman created TRAFODION-1971:
> ------------------------------------------
>
>              Summary: Redundant initialization slows down bulk load
>                  Key: TRAFODION-1971
>                  URL: https://issues.apache.org/jira/browse/TRAFODION-1971
>              Project: Apache Trafodion
>           Issue Type: Bug
>           Components: sql-exe
>     Affects Versions: 2.0-incubating
>             Reporter: Barry Fritchman
>
>
> During the preparation phase of bulk load, HFIle parameter initialization
> is
> performed redundantly following each flush. For a 52-million row table with
> fairly wide rows, a load takes 3.5 hours vs 35-40 minutes when the
> unnecessary re-initialization is avoided.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>



-- 
Regards, --Qifan

RE: [jira] [Created] (TRAFODION-1971) Redundant initialization slows down bulk load

Posted by Sean Broeder <se...@esgyn.com>.
Wow!  I had to read that twice :-)

-----Original Message-----
From: Dave Birdsall [mailto:dave.birdsall@esgyn.com]
Sent: Wednesday, May 4, 2016 4:44 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: [jira] [Created] (TRAFODION-1971) Redundant initialization
slows down bulk load

Very nice find!

-----Original Message-----
From: Liu, Ming (Ming) [mailto:ming.liu@esgyn.cn]
Sent: Wednesday, May 4, 2016 4:41 PM
To: dev@trafodion.incubator.apache.org
Subject: 答复: [jira] [Created] (TRAFODION-1971) Redundant initialization
slows down bulk load

Increadible!!

-----邮件原件-----
发件人: Barry Fritchman (JIRA) [mailto:jira@apache.org]
发送时间: 2016年5月5日 2:47
收件人: issues@trafodion.incubator.apache.org
主题: [jira] [Created] (TRAFODION-1971) Redundant initialization slows down
bulk load

Barry Fritchman created TRAFODION-1971:
------------------------------------------

             Summary: Redundant initialization slows down bulk load
                 Key: TRAFODION-1971
                 URL: https://issues.apache.org/jira/browse/TRAFODION-1971
             Project: Apache Trafodion
          Issue Type: Bug
          Components: sql-exe
    Affects Versions: 2.0-incubating
            Reporter: Barry Fritchman


During the preparation phase of bulk load, HFIle parameter initialization is
performed redundantly following each flush. For a 52-million row table with
fairly wide rows, a load takes 3.5 hours vs 35-40 minutes when the
unnecessary re-initialization is avoided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

RE: [jira] [Created] (TRAFODION-1971) Redundant initialization slows down bulk load

Posted by Dave Birdsall <da...@esgyn.com>.
Very nice find!

-----Original Message-----
From: Liu, Ming (Ming) [mailto:ming.liu@esgyn.cn]
Sent: Wednesday, May 4, 2016 4:41 PM
To: dev@trafodion.incubator.apache.org
Subject: 答复: [jira] [Created] (TRAFODION-1971) Redundant initialization
slows down bulk load

Increadible!!

-----邮件原件-----
发件人: Barry Fritchman (JIRA) [mailto:jira@apache.org]
发送时间: 2016年5月5日 2:47
收件人: issues@trafodion.incubator.apache.org
主题: [jira] [Created] (TRAFODION-1971) Redundant initialization slows down
bulk load

Barry Fritchman created TRAFODION-1971:
------------------------------------------

             Summary: Redundant initialization slows down bulk load
                 Key: TRAFODION-1971
                 URL: https://issues.apache.org/jira/browse/TRAFODION-1971
             Project: Apache Trafodion
          Issue Type: Bug
          Components: sql-exe
    Affects Versions: 2.0-incubating
            Reporter: Barry Fritchman


During the preparation phase of bulk load, HFIle parameter initialization is
performed redundantly following each flush. For a 52-million row table with
fairly wide rows, a load takes 3.5 hours vs 35-40 minutes when the
unnecessary re-initialization is avoided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

答复: [jira] [Created] (TRAFODION-1971) Redundant initialization slows down bulk load

Posted by "Liu, Ming (Ming)" <mi...@esgyn.cn>.
Increadible!!

-----邮件原件-----
发件人: Barry Fritchman (JIRA) [mailto:jira@apache.org] 
发送时间: 2016年5月5日 2:47
收件人: issues@trafodion.incubator.apache.org
主题: [jira] [Created] (TRAFODION-1971) Redundant initialization slows down bulk load

Barry Fritchman created TRAFODION-1971:
------------------------------------------

             Summary: Redundant initialization slows down bulk load
                 Key: TRAFODION-1971
                 URL: https://issues.apache.org/jira/browse/TRAFODION-1971
             Project: Apache Trafodion
          Issue Type: Bug
          Components: sql-exe
    Affects Versions: 2.0-incubating
            Reporter: Barry Fritchman


During the preparation phase of bulk load, HFIle parameter initialization is performed redundantly following each flush. For a 52-million row table with fairly wide rows, a load takes 3.5 hours vs 35-40 minutes when the unnecessary re-initialization is avoided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)