You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@royale.apache.org by Piotr Zarzycki <pi...@gmail.com> on 2020/04/20 08:43:36 UTC

Separate mailing list for Jenkins notifications

Hi Guys,

In the last year or so all notifications from Jenkins build are going to
development mailing list. It becomes very messy I see every day 40-50
emails where 80% of that is notification from Jenkins.

I would like to propose create separate mailing list to have such
notifications there.

Is it possible?

Please share your thoughts on that subject.

Thanks,
-- 

Piotr Zarzycki

Re: Separate mailing list for Jenkins notifications

Posted by Christofer Dutz <ch...@c-ware.de>.

Hi Alex,

one of the moderators can also send commands to add the email address to the list of allowed senders. So it doesn't have to be an apache email address, as far as I know.

Chris


Am 21.04.20, 08:44 schrieb "Alex Harui" <ah...@adobe.com.INVALID>:

    I have a few minutes waiting for step 11 to finish so have some time to think about this more.

    My understanding is that we would need to send from an a.o email address to have it end up on commits@.  I don't know how to do that on a shared machine.

    Maybe we should agree on what the problem is before looking for solutions.  To me, the problem seems mostly unsolvable.  As a PMC member you are supposed to be watching the commits, and as a committer, you need to know if you broke the build, and as a community member, you should help fix the build even if you didn't break it.  Moving CI emails out of your inbox via another list or a filter certainly will save you time, but doesn't seem fair to others.  Because if you aren't doing your share of commit reviews, or if you don't see right away that you might have broken the build then others have more work to do or can't get their work done.

    And  if we were a busier project, we might have rules on whether you can commit while the build is broken or not so as not to make it harder for the person trying to fix the build to fix it.

    But meanwhile, there are a lot of emails that you don't really need to read.  How can anyone know which ones to read and which ones can be skipped?  And what tools can be used to make that happen?  Are there email tools that can tell if someone is working on a broken build?  Can Jenkins tell us more in each failure message so you can filter out a series of broken build emails?  Maybe that's what we should be figuring out.

    My 2 cents,
    -Alex

    On 4/20/20, 11:21 PM, "Piotr Zarzycki" <pi...@gmail.com> wrote:

        It's end up with using Dev, so I would like to get back to idea of having
        either separate mailing list or sending that to  commits@royale.a.o - Your
        last comments indicates that email was still rejected - Is it still the
        case ?

        wt., 21 kwi 2020 o 00:43 Alex Harui <ah...@adobe.com.invalid> napisał(a):

        > I already asked.  See: INFRA-15722
        >
        >
        > On 4/20/20, 2:45 PM, "Piotr Zarzycki" <pi...@gmail.com> wrote:
        >
        >     To me argument of having info that server failed vs have cleaned inbox
        >     finally - I'm choosing to have inbox cleaned.
        >
        >     If Apache rejected email from Jenkins on commits@ I can ask infra
        > what can
        >     be done.
        >
        >     On Mon, Apr 20, 2020, 10:43 PM Alex Harui <ah...@adobe.com.invalid>
        > wrote:
        >
        >     > I've been unable to get the CI server to send to commits@.  Apache
        > blocks
        >     > it.
        >     >
        >     > Maybe issues@, but these aren't about issues.
        >     >
        >     > IMO, the point of these Jenkins emails is so that all committers
        > know the
        >     > current state of the builds and help fix issues when possible.  My
        > concern
        >     > is that when committers start filtering CI emails they will miss
        > when one
        >     > of their commits breaks the build.  So, the only reason to split CI
        > emails
        >     > off this list is to reduce traffic to the non-committers.
        >     >
        >     > My 2 cents,
        >     > -Alex
        >     >
        >     > On 4/20/20, 1:17 PM, "OmPrakash Muppirala" <bi...@gmail.com>
        > wrote:
        >     >
        >     >     We already have issues@ and commits@.  Can we redirect the
        > emails to
        >     > one of
        >     >     the lists?
        >     >
        >     >     On Mon, Apr 20, 2020 at 11:54 AM Alex Harui
        > <ah...@adobe.com.invalid>
        >     >     wrote:
        >     >
        >     >     > IMO, if we do create a new list, all committers must be
        > subscribed.
        >     >     >
        >     >     > My 2 cents,
        >     >     > -Alex
        >     >     >
        >     >     > On 4/20/20, 1:53 AM, "Piotr Zarzycki" <
        > piotrzarzycki21@gmail.com>
        >     > wrote:
        >     >     >
        >     >     >     Hi Guys,
        >     >     >
        >     >     >     In the last year or so all notifications from Jenkins
        > build are
        >     > going
        >     >     > to
        >     >     >     development mailing list. It becomes very messy I see
        > every day
        >     > 40-50
        >     >     >     emails where 80% of that is notification from Jenkins.
        >     >     >
        >     >     >     I would like to propose create separate mailing list to
        > have such
        >     >     >     notifications there.
        >     >     >
        >     >     >     Is it possible?
        >     >     >
        >     >     >     Please share your thoughts on that subject.
        >     >     >
        >     >     >     Thanks,
        >     >     >     --
        >     >     >
        >     >     >     Piotr Zarzycki
        >     >     >
        >     >     >
        >     >     >
        >     >
        >     >
        >     >
        >
        >
        >

        -- 

        Piotr Zarzycki

        Patreon: *https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7Ca1ae2823bf944c82ba6908d7e5bc4b5a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230469193169564&amp;sdata=7MpOVnN%2F5QbK2TF6o%2F%2FGY43wKTRTNYRBSE4MANdz5%2B4%3D&amp;reserved=0
        <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7Ca1ae2823bf944c82ba6908d7e5bc4b5a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230469193169564&amp;sdata=7MpOVnN%2F5QbK2TF6o%2F%2FGY43wKTRTNYRBSE4MANdz5%2B4%3D&amp;reserved=0>*

Re: Separate mailing list for Jenkins notifications

Posted by OmPrakash Muppirala <bi...@gmail.com>.

Piotr,

You could try with your own email, i.e. create a new gmail account so you
can work on this.  Once you figure out how to make the emails come through,
you could swap it out - or leave yours.  As long as you share the
credentials on private@, we should be fine.

Thanks,
Om

On Wed, Apr 22, 2020 at 11:25 PM Piotr Zarzycki <pi...@gmail.com>
wrote:

> When google remember your devices you do not need to use anymore 2 factor
> authentication. It's failed cause when it ask me to input google code from
> message send on the number attached to account - I wasn't able so it failed
> after some time of waiting.
>
> czw., 23 kwi 2020 o 08:21 Alex Harui <ah...@adobe.com.invalid>
> napisał(a):
>
> > I just logged in without needing my phone.  I also got a notice that they
> > saw a failed login attempt from your location.  Are you sure you used the
> > right password?  The email password is not the same as Jenkins and RDP.
> It
> > is in private@ in January of 2020.
> >
> > -Alex
> >
> > On 4/22/20, 10:39 PM, "Piotr Zarzycki" <pi...@gmail.com>
> wrote:
> >
> >     Email has 2 Factor authentication on, so I cannot login to it unless
> >     someone with added number allows me ;)
> >
> >     czw., 23 kwi 2020 o 07:13 Alex Harui <ah...@adobe.com.invalid>
> > napisał(a):
> >
> >     > I hope I posted the Gmail credentials on private@, so you can
> login
> > and
> >     > look there.  But also, the email won't make it to the list.
> >     >
> >     > -Alex
> >     >
> >     > On 4/22/20, 9:19 PM, "Piotr Zarzycki" <pi...@gmail.com>
> > wrote:
> >     >
> >     >     If I redirect emails to commits etc. How would I know that
> > Jenkins got
> >     >     rejection? Do I get this info in Jenkins web console interface
> > somehow?
> >     >
> >     >     On Tue, Apr 21, 2020, 6:37 PM Alex Harui
> > <ah...@adobe.com.invalid>
> >     > wrote:
> >     >
> >     >     > Pretty sure I tried allowing CI Server and Infra would have
> >     > suggested that
> >     >     > as well.  You are welcome to try it maybe on Royale-asjs
> since
> > it is
> >     >     > failing a lot right now.
> >     >     >
> >     >     > -Alex
> >     >     >
> >     >     > On 4/21/20, 12:01 AM, "Piotr Zarzycki" <
> > piotrzarzycki21@gmail.com>
> >     > wrote:
> >     >     >
> >     >     >     Alex,
> >     >     >
> >     >     >     Yes problem is solvable - redirect email not to dev but
> to
> >     > commits or
> >     >     > other
> >     >     >     email which we have available - This is the solution.
> >     >     >
> >     >     >     If I'm new to the list and subscribing here - seeing tons
> > of
> >     > weird
> >     >     > emails
> >     >     >     instead of emails about concrete subject - I would
> > unsubscribe in
> >     >     > about 1
> >     >     >     day max. - I wouldn't care that I can make a filter on my
> > inbox,
> >     > cause
> >     >     > I
> >     >     >     have for example 100 filters already. If I look into the
> > archive
> >     > I
> >     >     > really
> >     >     >     cannot read it, cause mailing list is obfuscated by stuff
> > which
> >     > uses
> >     >     > by PMC
> >     >     >     and committers - If you are PMC or committer and care
> about
> >     > stuff you
> >     >     > will
> >     >     >     subscribe for another list.
> >     >     >
> >     >     >     Thanks,
> >     >     >     Piotr
> >     >     >
> >     >     >     wt., 21 kwi 2020 o 08:44 Alex Harui
> > <ah...@adobe.com.invalid>
> >     >     > napisał(a):
> >     >     >
> >     >     >     > I have a few minutes waiting for step 11 to finish so
> > have
> >     > some time
> >     >     > to
> >     >     >     > think about this more.
> >     >     >     >
> >     >     >     > My understanding is that we would need to send from an
> > a.o
> >     > email
> >     >     > address
> >     >     >     > to have it end up on commits@.  I don't know how to do
> > that
> >     > on a
> >     >     > shared
> >     >     >     > machine.
> >     >     >     >
> >     >     >     > Maybe we should agree on what the problem is before
> > looking for
> >     >     >     > solutions.  To me, the problem seems mostly unsolvable.
> > As a
> >     > PMC
> >     >     > member
> >     >     >     > you are supposed to be watching the commits, and as a
> >     > committer, you
> >     >     > need
> >     >     >     > to know if you broke the build, and as a community
> > member, you
> >     >     > should help
> >     >     >     > fix the build even if you didn't break it.  Moving CI
> > emails
> >     > out of
> >     >     > your
> >     >     >     > inbox via another list or a filter certainly will save
> > you
> >     > time, but
> >     >     >     > doesn't seem fair to others.  Because if you aren't
> > doing your
> >     > share
> >     >     > of
> >     >     >     > commit reviews, or if you don't see right away that you
> > might
> >     > have
> >     >     > broken
> >     >     >     > the build then others have more work to do or can't get
> > their
> >     > work
> >     >     > done.
> >     >     >     >
> >     >     >     > And  if we were a busier project, we might have rules
> on
> >     > whether you
> >     >     > can
> >     >     >     > commit while the build is broken or not so as not to
> > make it
> >     > harder
> >     >     > for the
> >     >     >     > person trying to fix the build to fix it.
> >     >     >     >
> >     >     >     > But meanwhile, there are a lot of emails that you don't
> > really
> >     > need
> >     >     > to
> >     >     >     > read.  How can anyone know which ones to read and which
> > ones
> >     > can be
> >     >     >     > skipped?  And what tools can be used to make that
> > happen?  Are
> >     > there
> >     >     > email
> >     >     >     > tools that can tell if someone is working on a broken
> > build?
> >     > Can
> >     >     > Jenkins
> >     >     >     > tell us more in each failure message so you can filter
> > out a
> >     > series
> >     >     > of
> >     >     >     > broken build emails?  Maybe that's what we should be
> > figuring
> >     > out.
> >     >     >     >
> >     >     >     > My 2 cents,
> >     >     >     > -Alex
> >     >     >     >
> >     >     >     > On 4/20/20, 11:21 PM, "Piotr Zarzycki" <
> >     > piotrzarzycki21@gmail.com>
> >     >     > wrote:
> >     >     >     >
> >     >     >     >     It's end up with using Dev, so I would like to get
> > back to
> >     > idea
> >     >     > of
> >     >     >     > having
> >     >     >     >     either separate mailing list or sending that to
> >     >     > commits@royale.a.o -
> >     >     >     > Your
> >     >     >     >     last comments indicates that email was still
> > rejected - Is
> >     > it
> >     >     > still the
> >     >     >     >     case ?
> >     >     >     >
> >     >     >     >     wt., 21 kwi 2020 o 00:43 Alex Harui
> >     > <ah...@adobe.com.invalid>
> >     >     >     > napisał(a):
> >     >     >     >
> >     >     >     >     > I already asked.  See: INFRA-15722
> >     >     >     >     >
> >     >     >     >     >
> >     >     >     >     > On 4/20/20, 2:45 PM, "Piotr Zarzycki" <
> >     >     > piotrzarzycki21@gmail.com>
> >     >     >     > wrote:
> >     >     >     >     >
> >     >     >     >     >     To me argument of having info that server
> > failed vs
> >     > have
> >     >     > cleaned
> >     >     >     > inbox
> >     >     >     >     >     finally - I'm choosing to have inbox cleaned.
> >     >     >     >     >
> >     >     >     >     >     If Apache rejected email from Jenkins on
> > commits@ I
> >     > can
> >     >     > ask
> >     >     >     > infra
> >     >     >     >     > what can
> >     >     >     >     >     be done.
> >     >     >     >     >
> >     >     >     >     >     On Mon, Apr 20, 2020, 10:43 PM Alex Harui
> >     >     >     > <ah...@adobe.com.invalid>
> >     >     >     >     > wrote:
> >     >     >     >     >
> >     >     >     >     >     > I've been unable to get the CI server to
> > send to
> >     > commits@
> >     >     > .
> >     >     >     > Apache
> >     >     >     >     > blocks
> >     >     >     >     >     > it.
> >     >     >     >     >     >
> >     >     >     >     >     > Maybe issues@, but these aren't about
> > issues.
> >     >     >     >     >     >
> >     >     >     >     >     > IMO, the point of these Jenkins emails is
> so
> > that
> >     > all
> >     >     >     > committers
> >     >     >     >     > know the
> >     >     >     >     >     > current state of the builds and help fix
> > issues
> >     > when
> >     >     >     > possible.  My
> >     >     >     >     > concern
> >     >     >     >     >     > is that when committers start filtering CI
> > emails
> >     > they
> >     >     > will
> >     >     >     > miss
> >     >     >     >     > when one
> >     >     >     >     >     > of their commits breaks the build.  So, the
> > only
> >     > reason
> >     >     > to
> >     >     >     > split CI
> >     >     >     >     > emails
> >     >     >     >     >     > off this list is to reduce traffic to the
> >     > non-committers.
> >     >     >     >     >     >
> >     >     >     >     >     > My 2 cents,
> >     >     >     >     >     > -Alex
> >     >     >     >     >     >
> >     >     >     >     >     > On 4/20/20, 1:17 PM, "OmPrakash Muppirala"
> <
> >     >     >     > bigosmallm@gmail.com>
> >     >     >     >     > wrote:
> >     >     >     >     >     >
> >     >     >     >     >     >     We already have issues@ and commits@.
> > Can we
> >     >     > redirect the
> >     >     >     >     > emails to
> >     >     >     >     >     > one of
> >     >     >     >     >     >     the lists?
> >     >     >     >     >     >
> >     >     >     >     >     >     On Mon, Apr 20, 2020 at 11:54 AM Alex
> > Harui
> >     >     >     >     > <ah...@adobe.com.invalid>
> >     >     >     >     >     >     wrote:
> >     >     >     >     >     >
> >     >     >     >     >     >     > IMO, if we do create a new list, all
> >     > committers
> >     >     > must be
> >     >     >     >     > subscribed.
> >     >     >     >     >     >     >
> >     >     >     >     >     >     > My 2 cents,
> >     >     >     >     >     >     > -Alex
> >     >     >     >     >     >     >
> >     >     >     >     >     >     > On 4/20/20, 1:53 AM, "Piotr
> Zarzycki" <
> >     >     >     >     > piotrzarzycki21@gmail.com>
> >     >     >     >     >     > wrote:
> >     >     >     >     >     >     >
> >     >     >     >     >     >     >     Hi Guys,
> >     >     >     >     >     >     >
> >     >     >     >     >     >     >     In the last year or so all
> > notifications
> >     > from
> >     >     > Jenkins
> >     >     >     >     > build are
> >     >     >     >     >     > going
> >     >     >     >     >     >     > to
> >     >     >     >     >     >     >     development mailing list. It
> > becomes very
> >     >     > messy I see
> >     >     >     >     > every day
> >     >     >     >     >     > 40-50
> >     >     >     >     >     >     >     emails where 80% of that is
> > notification
> >     > from
> >     >     >     > Jenkins.
> >     >     >     >     >     >     >
> >     >     >     >     >     >     >     I would like to propose create
> > separate
> >     >     > mailing list
> >     >     >     > to
> >     >     >     >     > have such
> >     >     >     >     >     >     >     notifications there.
> >     >     >     >     >     >     >
> >     >     >     >     >     >     >     Is it possible?
> >     >     >     >     >     >     >
> >     >     >     >     >     >     >     Please share your thoughts on
> that
> >     > subject.
> >     >     >     >     >     >     >
> >     >     >     >     >     >     >     Thanks,
> >     >     >     >     >     >     >     --
> >     >     >     >     >     >     >
> >     >     >     >     >     >     >     Piotr Zarzycki
> >     >     >     >     >     >     >
> >     >     >     >     >     >     >
> >     >     >     >     >     >     >
> >     >     >     >     >     >
> >     >     >     >     >     >
> >     >     >     >     >     >
> >     >     >     >     >
> >     >     >     >     >
> >     >     >     >     >
> >     >     >     >
> >     >     >     >     --
> >     >     >     >
> >     >     >     >     Piotr Zarzycki
> >     >     >     >
> >     >     >     >     Patreon: *
> >     >     >     >
> >     >     >
> >     >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C0e322d87df694b958bd608d7e748bdb2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232171919348834&amp;sdata=L5hTubi%2BS0Cb5gmqcmGL9H133A1ZyJEs4Uf8Ww4T4nY%3D&amp;reserved=0
> >     >     >     >     <
> >     >     >     >
> >     >     >
> >     >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C0e322d87df694b958bd608d7e748bdb2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232171919348834&amp;sdata=L5hTubi%2BS0Cb5gmqcmGL9H133A1ZyJEs4Uf8Ww4T4nY%3D&amp;reserved=0
> >     >     >     > >*
> >     >     >     >
> >     >     >     >
> >     >     >     >
> >     >     >
> >     >     >     --
> >     >     >
> >     >     >     Piotr Zarzycki
> >     >     >
> >     >     >     Patreon: *
> >     >     >
> >     >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C0e322d87df694b958bd608d7e748bdb2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232171919348834&amp;sdata=L5hTubi%2BS0Cb5gmqcmGL9H133A1ZyJEs4Uf8Ww4T4nY%3D&amp;reserved=0
> >     >     >     <
> >     >     >
> >     >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C0e322d87df694b958bd608d7e748bdb2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232171919348834&amp;sdata=L5hTubi%2BS0Cb5gmqcmGL9H133A1ZyJEs4Uf8Ww4T4nY%3D&amp;reserved=0
> >     >     > >*
> >     >     >
> >     >     >
> >     >     >
> >     >
> >     >
> >     >
> >
> >     --
> >
> >     Piotr Zarzycki
> >
> >     Patreon: *
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C0e322d87df694b958bd608d7e748bdb2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232171919348834&amp;sdata=L5hTubi%2BS0Cb5gmqcmGL9H133A1ZyJEs4Uf8Ww4T4nY%3D&amp;reserved=0
> >     <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C0e322d87df694b958bd608d7e748bdb2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232171919348834&amp;sdata=L5hTubi%2BS0Cb5gmqcmGL9H133A1ZyJEs4Uf8Ww4T4nY%3D&amp;reserved=0
> > >*
> >
> >
> >
>
> --
>
> Piotr Zarzycki
>
> Patreon: *https://www.patreon.com/piotrzarzycki
> <https://www.patreon.com/piotrzarzycki>*
>

Re: Separate mailing list for Jenkins notifications

Posted by Harbs <ha...@gmail.com>.

+1!

> On May 27, 2020, at 3:45 PM, OmPrakash Muppirala <bi...@gmail.com> wrote:
> 
> On Wed, May 27, 2020 at 1:12 AM Piotr Zarzycki <pi...@gmail.com>
> wrote:
> 
>> I have created new mailing list called:  royale-builds@royale.apache.org -
>> If everything works out I will start playing with redirection all builds
>> stuff there. It looks like my request has to be processed and it can take
>> 24h.
>> 
> 
> That looks good.  Thanks for powering through this, Piotr!
> 
> 
>> 
>> śr., 27 maj 2020 o 10:00 Piotr Zarzycki <pi...@gmail.com>
>> napisał(a):
>> 
>>> I see that we have list builds@royale.apache.org - Anyone know why I
>>> cannot subscribe to it ?
>>> 
>>> śr., 20 maj 2020 o 10:05 Piotr Zarzycki <pi...@gmail.com>
>>> napisał(a):
>>> 
>>>> Ok I noticed that we have notifications list, but it seems to me that it
>>>> is empty. I will redirect one of the build there and see if it works.
>> [1]
>>>> 
>>>> [1] https://lists.apache.org/list.html?notifications@royale.apache.org
>>>> 
>>>> wt., 19 maj 2020 o 10:17 Piotr Zarzycki <pi...@gmail.com>
>>>> napisał(a):
>>>> 
>>>>> My proposition is "notifications" - Any objections ?
>>>>> 
>>>>> niedz., 17 maj 2020 o 10:05 Piotr Zarzycki <pi...@gmail.com>
>>>>> napisał(a):
>>>>> 
>>>>>> It's been stronger suggested to create for that purpose separate
>>>>>> mailing list. [1] I'm willing to do that - What would be the name ?
>>>>>> 
>>>>>> [1] https://bit.ly/3fWdide
>>>>>> 
>>>>>> sob., 25 kwi 2020 o 12:11 Piotr Zarzycki <pi...@gmail.com>
>>>>>> napisał(a):
>>>>>> 
>>>>>>> Hi Guys,
>>>>>>> 
>>>>>>> Email is still rejected. I'm going to comment in raised jira that we
>>>>>>> would like to redirect our messages to commits . I don't see in the
>>>>>>> comments of jira concrete solution and when to execute them - they
>> are
>>>>>>> mention about some config - If someone know where I should look I
>> will
>>>>>>> otherwise I'm going to raise again discussion in jira.
>>>>>>> 
>>>>>>> Thanks,
>>>>>>> Piotr
>>>>>>> 
>>>>>>> czw., 23 kwi 2020 o 08:40 Alex Harui <ah...@adobe.com.invalid>
>>>>>>> napisał(a):
>>>>>>> 
>>>>>>>> I got a strange text this evening.  It had a long string of numbers
>>>>>>>> and the word "Google" at the end.  No other identifying words.  So
>> I just
>>>>>>>> deleted it thinking it was spam.
>>>>>>>> 
>>>>>>>> Anyway, I RDP'd to the CI Server and used the Chrome Browser to
>>>>>>>> login.  It did not ask for a code for my phone, but Google said
>> that it was
>>>>>>>> a new device.  Maybe I used FF last time from the CI Server.  It is
>>>>>>>> probably best if you use the CI Server to get to the gmail for the
>> server.
>>>>>>>> That way I don't have to authenticate every PMC member from their
>>>>>>>> location.  I left Chrome up with Gmail.
>>>>>>>> 
>>>>>>>> HTH,
>>>>>>>> -Alex
>>>>>>>> 
>>>>>>>> On 4/22/20, 11:25 PM, "Piotr Zarzycki" <pi...@gmail.com>
>>>>>>>> wrote:
>>>>>>>> 
>>>>>>>>    When google remember your devices you do not need to use anymore
>>>>>>>> 2 factor
>>>>>>>>    authentication. It's failed cause when it ask me to input google
>>>>>>>> code from
>>>>>>>>    message send on the number attached to account - I wasn't able
>> so
>>>>>>>> it failed
>>>>>>>>    after some time of waiting.
>>>>>>>> 
>>>>>>>>    czw., 23 kwi 2020 o 08:21 Alex Harui <ah...@adobe.com.invalid>
>>>>>>>> napisał(a):
>>>>>>>> 
>>>>>>>>> I just logged in without needing my phone.  I also got a
>> notice
>>>>>>>> that they
>>>>>>>>> saw a failed login attempt from your location.  Are you sure
>>>>>>>> you used the
>>>>>>>>> right password?  The email password is not the same as Jenkins
>>>>>>>> and RDP.  It
>>>>>>>>> is in private@ in January of 2020.
>>>>>>>>> 
>>>>>>>>> -Alex
>>>>>>>>> 
>>>>>>>>> On 4/22/20, 10:39 PM, "Piotr Zarzycki" <
>>>>>>>> piotrzarzycki21@gmail.com> wrote:
>>>>>>>>> 
>>>>>>>>>    Email has 2 Factor authentication on, so I cannot login to
>>>>>>>> it unless
>>>>>>>>>    someone with added number allows me ;)
>>>>>>>>> 
>>>>>>>>>    czw., 23 kwi 2020 o 07:13 Alex Harui
>>>>>>>> <ah...@adobe.com.invalid>
>>>>>>>>> napisał(a):
>>>>>>>>> 
>>>>>>>>>> I hope I posted the Gmail credentials on private@, so
>>>>>>>> you can login
>>>>>>>>> and
>>>>>>>>>> look there.  But also, the email won't make it to the
>>>>>>>> list.
>>>>>>>>>> 
>>>>>>>>>> -Alex
>>>>>>>>>> 
>>>>>>>>>> On 4/22/20, 9:19 PM, "Piotr Zarzycki" <
>>>>>>>> piotrzarzycki21@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>> 
>>>>>>>>>>    If I redirect emails to commits etc. How would I
>> know
>>>>>>>> that
>>>>>>>>> Jenkins got
>>>>>>>>>>    rejection? Do I get this info in Jenkins web console
>>>>>>>> interface
>>>>>>>>> somehow?
>>>>>>>>>> 
>>>>>>>>>>    On Tue, Apr 21, 2020, 6:37 PM Alex Harui
>>>>>>>>> <ah...@adobe.com.invalid>
>>>>>>>>>> wrote:
>>>>>>>>>> 
>>>>>>>>>>> Pretty sure I tried allowing CI Server and Infra
>>>>>>>> would have
>>>>>>>>>> suggested that
>>>>>>>>>>> as well.  You are welcome to try it maybe on
>>>>>>>> Royale-asjs since
>>>>>>>>> it is
>>>>>>>>>>> failing a lot right now.
>>>>>>>>>>> 
>>>>>>>>>>> -Alex
>>>>>>>>>>> 
>>>>>>>>>>> On 4/21/20, 12:01 AM, "Piotr Zarzycki" <
>>>>>>>>> piotrzarzycki21@gmail.com>
>>>>>>>>>> wrote:
>>>>>>>>>>> 
>>>>>>>>>>>    Alex,
>>>>>>>>>>> 
>>>>>>>>>>>    Yes problem is solvable - redirect email not
>> to
>>>>>>>> dev but to
>>>>>>>>>> commits or
>>>>>>>>>>> other
>>>>>>>>>>>    email which we have available - This is the
>>>>>>>> solution.
>>>>>>>>>>> 
>>>>>>>>>>>    If I'm new to the list and subscribing here -
>>>>>>>> seeing tons
>>>>>>>>> of
>>>>>>>>>> weird
>>>>>>>>>>> emails
>>>>>>>>>>>    instead of emails about concrete subject - I
>>>>>>>> would
>>>>>>>>> unsubscribe in
>>>>>>>>>>> about 1
>>>>>>>>>>>    day max. - I wouldn't care that I can make a
>>>>>>>> filter on my
>>>>>>>>> inbox,
>>>>>>>>>> cause
>>>>>>>>>>> I
>>>>>>>>>>>    have for example 100 filters already. If I
>> look
>>>>>>>> into the
>>>>>>>>> archive
>>>>>>>>>> I
>>>>>>>>>>> really
>>>>>>>>>>>    cannot read it, cause mailing list is
>>>>>>>> obfuscated by stuff
>>>>>>>>> which
>>>>>>>>>> uses
>>>>>>>>>>> by PMC
>>>>>>>>>>>    and committers - If you are PMC or committer
>>>>>>>> and care about
>>>>>>>>>> stuff you
>>>>>>>>>>> will
>>>>>>>>>>>    subscribe for another list.
>>>>>>>>>>> 
>>>>>>>>>>>    Thanks,
>>>>>>>>>>>    Piotr
>>>>>>>>>>> 
>>>>>>>>>>>    wt., 21 kwi 2020 o 08:44 Alex Harui
>>>>>>>>> <ah...@adobe.com.invalid>
>>>>>>>>>>> napisał(a):
>>>>>>>>>>> 
>>>>>>>>>>>> I have a few minutes waiting for step 11 to
>>>>>>>> finish so
>>>>>>>>> have
>>>>>>>>>> some time
>>>>>>>>>>> to
>>>>>>>>>>>> think about this more.
>>>>>>>>>>>> 
>>>>>>>>>>>> My understanding is that we would need to
>>>>>>>> send from an
>>>>>>>>> a.o
>>>>>>>>>> email
>>>>>>>>>>> address
>>>>>>>>>>>> to have it end up on commits@.  I don't
>> know
>>>>>>>> how to do
>>>>>>>>> that
>>>>>>>>>> on a
>>>>>>>>>>> shared
>>>>>>>>>>>> machine.
>>>>>>>>>>>> 
>>>>>>>>>>>> Maybe we should agree on what the problem is
>>>>>>>> before
>>>>>>>>> looking for
>>>>>>>>>>>> solutions.  To me, the problem seems mostly
>>>>>>>> unsolvable.
>>>>>>>>> As a
>>>>>>>>>> PMC
>>>>>>>>>>> member
>>>>>>>>>>>> you are supposed to be watching the commits,
>>>>>>>> and as a
>>>>>>>>>> committer, you
>>>>>>>>>>> need
>>>>>>>>>>>> to know if you broke the build, and as a
>>>>>>>> community
>>>>>>>>> member, you
>>>>>>>>>>> should help
>>>>>>>>>>>> fix the build even if you didn't break it.
>>>>>>>> Moving CI
>>>>>>>>> emails
>>>>>>>>>> out of
>>>>>>>>>>> your
>>>>>>>>>>>> inbox via another list or a filter certainly
>>>>>>>> will save
>>>>>>>>> you
>>>>>>>>>> time, but
>>>>>>>>>>>> doesn't seem fair to others.  Because if you
>>>>>>>> aren't
>>>>>>>>> doing your
>>>>>>>>>> share
>>>>>>>>>>> of
>>>>>>>>>>>> commit reviews, or if you don't see right
>>>>>>>> away that you
>>>>>>>>> might
>>>>>>>>>> have
>>>>>>>>>>> broken
>>>>>>>>>>>> the build then others have more work to do
>> or
>>>>>>>> can't get
>>>>>>>>> their
>>>>>>>>>> work
>>>>>>>>>>> done.
>>>>>>>>>>>> 
>>>>>>>>>>>> And  if we were a busier project, we might
>>>>>>>> have rules on
>>>>>>>>>> whether you
>>>>>>>>>>> can
>>>>>>>>>>>> commit while the build is broken or not so
>> as
>>>>>>>> not to
>>>>>>>>> make it
>>>>>>>>>> harder
>>>>>>>>>>> for the
>>>>>>>>>>>> person trying to fix the build to fix it.
>>>>>>>>>>>> 
>>>>>>>>>>>> But meanwhile, there are a lot of emails
>> that
>>>>>>>> you don't
>>>>>>>>> really
>>>>>>>>>> need
>>>>>>>>>>> to
>>>>>>>>>>>> read.  How can anyone know which ones to
>> read
>>>>>>>> and which
>>>>>>>>> ones
>>>>>>>>>> can be
>>>>>>>>>>>> skipped?  And what tools can be used to make
>>>>>>>> that
>>>>>>>>> happen?  Are
>>>>>>>>>> there
>>>>>>>>>>> email
>>>>>>>>>>>> tools that can tell if someone is working on
>>>>>>>> a broken
>>>>>>>>> build?
>>>>>>>>>> Can
>>>>>>>>>>> Jenkins
>>>>>>>>>>>> tell us more in each failure message so you
>>>>>>>> can filter
>>>>>>>>> out a
>>>>>>>>>> series
>>>>>>>>>>> of
>>>>>>>>>>>> broken build emails?  Maybe that's what we
>>>>>>>> should be
>>>>>>>>> figuring
>>>>>>>>>> out.
>>>>>>>>>>>> 
>>>>>>>>>>>> My 2 cents,
>>>>>>>>>>>> -Alex
>>>>>>>>>>>> 
>>>>>>>>>>>> On 4/20/20, 11:21 PM, "Piotr Zarzycki" <
>>>>>>>>>> piotrzarzycki21@gmail.com>
>>>>>>>>>>> wrote:
>>>>>>>>>>>> 
>>>>>>>>>>>>    It's end up with using Dev, so I would
>>>>>>>> like to get
>>>>>>>>> back to
>>>>>>>>>> idea
>>>>>>>>>>> of
>>>>>>>>>>>> having
>>>>>>>>>>>>    either separate mailing list or sending
>>>>>>>> that to
>>>>>>>>>>> commits@royale.a.o -
>>>>>>>>>>>> Your
>>>>>>>>>>>>    last comments indicates that email was
>>>>>>>> still
>>>>>>>>> rejected - Is
>>>>>>>>>> it
>>>>>>>>>>> still the
>>>>>>>>>>>>    case ?
>>>>>>>>>>>> 
>>>>>>>>>>>>    wt., 21 kwi 2020 o 00:43 Alex Harui
>>>>>>>>>> <ah...@adobe.com.invalid>
>>>>>>>>>>>> napisał(a):
>>>>>>>>>>>> 
>>>>>>>>>>>>> I already asked.  See: INFRA-15722
>>>>>>>>>>>>> 
>>>>>>>>>>>>> 
>>>>>>>>>>>>> On 4/20/20, 2:45 PM, "Piotr Zarzycki"
>> <
>>>>>>>>>>> piotrzarzycki21@gmail.com>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>> 
>>>>>>>>>>>>>    To me argument of having info that
>>>>>>>> server
>>>>>>>>> failed vs
>>>>>>>>>> have
>>>>>>>>>>> cleaned
>>>>>>>>>>>> inbox
>>>>>>>>>>>>>    finally - I'm choosing to have
>>>>>>>> inbox cleaned.
>>>>>>>>>>>>> 
>>>>>>>>>>>>>    If Apache rejected email from
>>>>>>>> Jenkins on
>>>>>>>>> commits@ I
>>>>>>>>>> can
>>>>>>>>>>> ask
>>>>>>>>>>>> infra
>>>>>>>>>>>>> what can
>>>>>>>>>>>>>    be done.
>>>>>>>>>>>>> 
>>>>>>>>>>>>>    On Mon, Apr 20, 2020, 10:43 PM
>> Alex
>>>>>>>> Harui
>>>>>>>>>>>> <ah...@adobe.com.invalid>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>> 
>>>>>>>>>>>>>> I've been unable to get the CI
>>>>>>>> server to
>>>>>>>>> send to
>>>>>>>>>> commits@
>>>>>>>>>>> .
>>>>>>>>>>>> Apache
>>>>>>>>>>>>> blocks
>>>>>>>>>>>>>> it.
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> Maybe issues@, but these aren't
>>>>>>>> about
>>>>>>>>> issues.
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> IMO, the point of these Jenkins
>>>>>>>> emails is so
>>>>>>>>> that
>>>>>>>>>> all
>>>>>>>>>>>> committers
>>>>>>>>>>>>> know the
>>>>>>>>>>>>>> current state of the builds and
>>>>>>>> help fix
>>>>>>>>> issues
>>>>>>>>>> when
>>>>>>>>>>>> possible.  My
>>>>>>>>>>>>> concern
>>>>>>>>>>>>>> is that when committers start
>>>>>>>> filtering CI
>>>>>>>>> emails
>>>>>>>>>> they
>>>>>>>>>>> will
>>>>>>>>>>>> miss
>>>>>>>>>>>>> when one
>>>>>>>>>>>>>> of their commits breaks the
>>>>>>>> build.  So, the
>>>>>>>>> only
>>>>>>>>>> reason
>>>>>>>>>>> to
>>>>>>>>>>>> split CI
>>>>>>>>>>>>> emails
>>>>>>>>>>>>>> off this list is to reduce
>>>>>>>> traffic to the
>>>>>>>>>> non-committers.
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> My 2 cents,
>>>>>>>>>>>>>> -Alex
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> On 4/20/20, 1:17 PM, "OmPrakash
>>>>>>>> Muppirala" <
>>>>>>>>>>>> bigosmallm@gmail.com>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>    We already have issues@ and
>>>>>>>> commits@.
>>>>>>>>> Can we
>>>>>>>>>>> redirect the
>>>>>>>>>>>>> emails to
>>>>>>>>>>>>>> one of
>>>>>>>>>>>>>>    the lists?
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>    On Mon, Apr 20, 2020 at
>> 11:54
>>>>>>>> AM Alex
>>>>>>>>> Harui
>>>>>>>>>>>>> <ah...@adobe.com.invalid>
>>>>>>>>>>>>>>    wrote:
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>> IMO, if we do create a new
>>>>>>>> list, all
>>>>>>>>>> committers
>>>>>>>>>>> must be
>>>>>>>>>>>>> subscribed.
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>> My 2 cents,
>>>>>>>>>>>>>>> -Alex
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>> On 4/20/20, 1:53 AM,
>> "Piotr
>>>>>>>> Zarzycki" <
>>>>>>>>>>>>> piotrzarzycki21@gmail.com>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>>    Hi Guys,
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>>    In the last year or so
>>>>>>>> all
>>>>>>>>> notifications
>>>>>>>>>> from
>>>>>>>>>>> Jenkins
>>>>>>>>>>>>> build are
>>>>>>>>>>>>>> going
>>>>>>>>>>>>>>> to
>>>>>>>>>>>>>>>    development mailing
>>>>>>>> list. It
>>>>>>>>> becomes very
>>>>>>>>>>> messy I see
>>>>>>>>>>>>> every day
>>>>>>>>>>>>>> 40-50
>>>>>>>>>>>>>>>    emails where 80% of
>>>>>>>> that is
>>>>>>>>> notification
>>>>>>>>>> from
>>>>>>>>>>>> Jenkins.
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>>    I would like to
>> propose
>>>>>>>> create
>>>>>>>>> separate
>>>>>>>>>>> mailing list
>>>>>>>>>>>> to
>>>>>>>>>>>>> have such
>>>>>>>>>>>>>>>    notifications there.
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>>    Is it possible?
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>>    Please share your
>>>>>>>> thoughts on that
>>>>>>>>>> subject.
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>>    Thanks,
>>>>>>>>>>>>>>>    --
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>>    Piotr Zarzycki
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> 
>>>>>>>>>>>>> 
>>>>>>>>>>>>> 
>>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>>    --
>>>>>>>>>>>> 
>>>>>>>>>>>>    Piotr Zarzycki
>>>>>>>>>>>> 
>>>>>>>>>>>>    Patreon: *
>>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C81270bd984274fe8987108d7e74f0dd6%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232199037238814&amp;sdata=zaTC%2FrrJs8%2FG6oZMd4h5n9HP5p%2FBmn2RaM4sXw2vDqI%3D&amp;reserved=0
>>>>>>>>>>>>    <
>>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C81270bd984274fe8987108d7e74f0dd6%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232199037248805&amp;sdata=cYWoNBICSR8dBIKZc%2BRf8QIIhCdc%2BYyZmtAiG4tfPbU%3D&amp;reserved=0
>>>>>>>>>>>>> *
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>>>    --
>>>>>>>>>>> 
>>>>>>>>>>>    Piotr Zarzycki
>>>>>>>>>>> 
>>>>>>>>>>>    Patreon: *
>>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C81270bd984274fe8987108d7e74f0dd6%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232199037248805&amp;sdata=cYWoNBICSR8dBIKZc%2BRf8QIIhCdc%2BYyZmtAiG4tfPbU%3D&amp;reserved=0
>>>>>>>>>>>    <
>>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C81270bd984274fe8987108d7e74f0dd6%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232199037248805&amp;sdata=cYWoNBICSR8dBIKZc%2BRf8QIIhCdc%2BYyZmtAiG4tfPbU%3D&amp;reserved=0
>>>>>>>>>>>> *
>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>>    --
>>>>>>>>> 
>>>>>>>>>    Piotr Zarzycki
>>>>>>>>> 
>>>>>>>>>    Patreon: *
>>>>>>>>> 
>>>>>>>> 
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C81270bd984274fe8987108d7e74f0dd6%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232199037248805&amp;sdata=cYWoNBICSR8dBIKZc%2BRf8QIIhCdc%2BYyZmtAiG4tfPbU%3D&amp;reserved=0
>>>>>>>>>    <
>>>>>>>>> 
>>>>>>>> 
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C81270bd984274fe8987108d7e74f0dd6%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232199037248805&amp;sdata=cYWoNBICSR8dBIKZc%2BRf8QIIhCdc%2BYyZmtAiG4tfPbU%3D&amp;reserved=0
>>>>>>>>>> *
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>>>    --
>>>>>>>> 
>>>>>>>>    Piotr Zarzycki
>>>>>>>> 
>>>>>>>>    Patreon: *
>>>>>>>> 
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C81270bd984274fe8987108d7e74f0dd6%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232199037248805&amp;sdata=cYWoNBICSR8dBIKZc%2BRf8QIIhCdc%2BYyZmtAiG4tfPbU%3D&amp;reserved=0
>>>>>>>>    <
>>>>>>>> 
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.patreon.com%2Fpiotrzarzycki&amp;data=02%7C01%7Caharui%40adobe.com%7C81270bd984274fe8987108d7e74f0dd6%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637232199037248805&amp;sdata=cYWoNBICSR8dBIKZc%2BRf8QIIhCdc%2BYyZmtAiG4tfPbU%3D&amp;reserved=0
>>>>>>>>> *
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>>> --
>>>>>>> 
>>>>>>> Piotr Zarzycki
>>>>>>> 
>>>>>>> Patreon: *https://www.patreon.com/piotrzarzycki
>>>>>>> <https://www.patreon.com/piotrzarzycki>*
>>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> --
>>>>>> 
>>>>>> Piotr Zarzycki
>>>>>> 
>>>>>> Patreon: *https://www.patreon.com/piotrzarzycki
>>>>>> <https://www.patreon.com/piotrzarzycki>*
>>>>>> 
>>>>> 
>>>>> 
>>>>> --
>>>>> 
>>>>> Piotr Zarzycki
>>>>> 
>>>>> Patreon: *https://www.patreon.com/piotrzarzycki
>>>>> <https://www.patreon.com/piotrzarzycki>*
>>>>> 
>>>> 
>>>> 
>>>> --
>>>> 
>>>> Piotr Zarzycki
>>>> 
>>>> Patreon: *https://www.patreon.com/piotrzarzycki
>>>> <https://www.patreon.com/piotrzarzycki>*
>>>> 
>>> 
>>> 
>>> --
>>> 
>>> Piotr Zarzycki
>>> 
>>> Patreon: *https://www.patreon.com/piotrzarzycki
>>> <https://www.patreon.com/piotrzarzycki>*
>>> 
>> 
>> 
>> --
>> 
>> Piotr Zarzycki
>> 
>> Patreon: *https://www.patreon.com/piotrzarzycki
>> <https://www.patreon.com/piotrzarzycki>*
>>