[jira] [Commented] (YETUS-217) docker fallback mode isn't working

["Allen Wittenauer (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YETUS-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048890#comment-15048890 ] 

Allen Wittenauer commented on YETUS-217:
----------------------------------------

Originally this was filed as branches weren't working.  That's clearly not the case:

{code}
Running in Jenkins mode
Processing: YARN-4348
YARN-4348 patch is being downloaded at Tue Dec  1 01:20:58 UTC 2015 from
https://issues.apache.org/jira/secure/attachment/12774920/YARN-4348-branch-2.7.004.patch


============================================================================
============================================================================
                        Confirming git environment
============================================================================
============================================================================


HEAD is now at 9b8e50b HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang.
Previous HEAD position was 9b8e50b... HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang.
Switched to branch 'trunk'
Your branch is behind 'origin/trunk' by 1 commit, and can be fast-forwarded.
  (use "git pull" to update your local branch)
First, rewinding head to replay your work on top of it...
Fast-forwarded trunk to 9b8e50b424d060e16c1175b1811e7abc476e2468.
Switched to branch 'branch-2.7'
Your branch is behind 'origin/branch-2.7' by 9 commits, and can be fast-forwarded.
  (use "git pull" to update your local branch)
First, rewinding head to replay your work on top of it...
Fast-forwarded branch-2.7 to 10e8a67d23200d2b6fbab7a050adf922b27e77c4.
Testing YARN-4348 patch on branch-2.7.

===
                          Re-execing under Docker
===
{code}

But something else entirely is going wrong. The first sign of trouble is this:

{code}
===
                    Building base image: yetus/hadoop:
===
{code}

There's no tag on this base image.  Very very odd.  I don't see a reference to it using the fallback image, but it pretty much has to be since branch-2.7 doesn't have a dockerfile of it's own in dev-support/docker/dockerfile. Other evidence:

{code}
Step 2 : RUN apt-get update && apt-get install --no-install-recommends -y     git curl ant make maven     cmake gcc g++ protobuf-compiler     build-essential libtool     zlib1g-dev pkg-config libssl-dev     snappy libsnappy-dev     bzip2 libbz2-dev     libjansson-dev     fuse libfuse-dev     libcurl4-openssl-dev     python python2.7 pylint     ruby     openjdk-7-jdk     libperl-critic-perl
{code}

ruby doesn't show up in older Hadoop dockerfiles or in very new Hadoop dockerfiles.

Things progress as normal until:

{code}
Step 19 : RUN apt-get install -y bats
 ---> Using cache
 ---> d23ffc28899a
Step 20 : RUN locale-gen en_US.UTF-8
 ---> Using cache
 ---> e1bc9b031b99
Step 21 : ENV LANG en_US.UTF-8
 ---> Using cache
 ---> db39b3b44e61
Step 22 : ENV LANGUAGE en_US:en
 ---> Using cache
 ---> 2461b2291938
Step 23 : ENV LC_ALL en_US.UTF-8
 ---> Using cache
 ---> 62aea080671f
Successfully built 62aea080671f
{code}


... at which point everything falls apart.  The stanza that actually launches test-patch in the container is missing.  But our code doesn't verify that (it probably should).  Now that the base image for this branch is built, test-patch continues on making the container for this specific run:

{code}
==
                Building patch image: yetus/hadoop:tp-22440
==
...
Removing intermediate container a889b4b0bdbd
Step 5 : USER jenkins
 ---> Running in 3ee8c8df3345
 ---> 9323fb13db61
Removing intermediate container 3ee8c8df3345
Successfully built 9323fb13db61

Total Elapsed time:   0m  4s

Archiving artifacts
Compressed 1.05 MB of artifacts by 83.1% relative to #9791
[description-setter] Description set: YARN-4348
{code}

... and thus jenkins ends because there is nothing to do.

At this point, without looking to hard at the code, is that something is wrong when docker mode's fallback methods are invoked.

> docker fallback mode isn't working
> ----------------------------------
>
>                 Key: YETUS-217
>                 URL: https://issues.apache.org/jira/browse/YETUS-217
>             Project: Yetus
>          Issue Type: Bug
>          Components: Test Patch
>            Reporter: Tsuyoshi Ozawa
>            Priority: Blocker
>
> I tried to launch the test against branch-2.7 on YARN-4348, but failed. Log is as follows:
> https://builds.apache.org/job/PreCommit-YARN-Build/9817/console



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)