You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Jakub Dubovsky <sp...@gmail.com> on 2017/02/08 11:54:46 UTC
Cannot find checkstyle.xml
Hello there,
I am trying to build spark locally so I can test something to help resolve this
ticket <https://issues.apache.org/jira/browse/SPARK-16599>.
git checkout v2.1.0
./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
-Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install
This starts the build successfully. Then I changed one source file and a
version in pom.xml (exact diff). After this change when I run the same
build command as above I get failure:
Could not find resource 'dev/checkstyle.xml'
whole build log <<script
src="https://gist.github.com/james64/85b3bf4613e7105bebd687502258a518.js"></script>>
How this one commit change can cause this error? checkstyle.xml is still
there. I run maven from project root in both cases. What should I change to
build this?
Thanks for your help
Jakub
Re: Cannot find checkstyle.xml
Posted by Jakub Dubovsky <sp...@gmail.com>.
Sorry, correct links set in text below.
Hello there,
I am trying to build spark locally so I can test something to help resolve this
ticket <https://issues.apache.org/jira/browse/SPARK-16599>.
git checkout v2.1.0
./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
-Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install
This starts the build successfully. Then I changed one source file and a
version in pom.xml (exact diff
<https://gist.github.com/james64/cc158bdb81bc1828937c757fde94ce82>). After
this change when I run the same build command as above I get failure:
Could not find resource 'dev/checkstyle.xml'
whole build log
<https://gist.github.com/james64/85b3bf4613e7105bebd687502258a518>
How this one commit change can cause this error? checkstyle.xml is still
there. I run maven from project root in both cases. What should I change to
build this?
Thanks for your help
Jakub
Re: Cannot find checkstyle.xml
Posted by Jakub Dubovsky <sp...@gmail.com>.
Somebody is able to help with this? I am stuck on this in my attempt to
help solve issues:
SPARK-16599 <https://issues.apache.org/jira/browse/SPARK-16599>
sparkNB-807 <https://github.com/andypetrella/spark-notebook/issues/807>
Thanks
On Thu, Feb 9, 2017 at 10:18 AM, Jakub Dubovsky <
spark.dubovsky.jakub@gmail.com> wrote:
> Thanks Ted for trying. (see below for Ted's reply). Con somebody confirm
> that this is not an expected behaviour? Is there somebody else having same
> issue?
>
> Thanks!
>
>
> On Wed, Feb 8, 2017 at 11:42 PM, Ted Yu <yu...@gmail.com> wrote:
>
>> Using your command, I got:
>>
>> Caused by: org.apache.maven.project.DependencyResolutionException: Could
>> not resolve dependencies for project org.apache.spark:spark-launcher_2.11:jar:2.1.0:
>> Could not find artifact org.apache.hadoop:hadoop-client:jar:2.6.0-cdh5.7.1
>> in central (https://repo1.maven.org/maven2)
>> at org.apache.maven.project.DefaultProjectDependenciesResolver.
>> resolve(DefaultProjectDependenciesResolver.java:211)
>> at org.apache.maven.lifecycle.internal.LifecycleDependencyResol
>> ver.getDependencies(LifecycleDependencyResolver.java:195)
>> ... 23 more
>>
>> So I switched to:
>>
>> ./build/mvn -Phadoop-2.7 -Phive -Phive-thriftserver -Pyarn -DskipTests -e
>> clean install
>>
>> With your change to pom.xml, I got the same error.
>>
>> Without change to pom.xml, the build continues.
>>
>> On Wed, Feb 8, 2017 at 8:19 AM, Jakub Dubovsky <
>> spark.dubovsky.jakub@gmail.com> wrote:
>>
>>> Sorry, correct links set in text below.
>>>
>>>
>>> Hello there,
>>>>
>>>> I am trying to build spark locally so I can test something to help
>>>> resolve this ticket <https://issues.apache.org/jira/browse/SPARK-16599>
>>>> .
>>>>
>>>> git checkout v2.1.0
>>>> ./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
>>>> -Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install
>>>>
>>>> This starts the build successfully. Then I changed one source file and
>>>> a version in pom.xml (exact diff
>>>> <https://gist.github.com/james64/cc158bdb81bc1828937c757fde94ce82>).
>>>> After this change when I run the same build command as above I get failure:
>>>>
>>>> Could not find resource 'dev/checkstyle.xml'
>>>>
>>>> whole build log
>>>> <https://gist.github.com/james64/85b3bf4613e7105bebd687502258a518>
>>>>
>>>> How this one commit change can cause this error? checkstyle.xml is
>>>> still there. I run maven from project root in both cases. What should I
>>>> change to build this?
>>>>
>>>> Thanks for your help
>>>>
>>>> Jakub
>>>>
>>>>
>>>
>>
>
Re: Cannot find checkstyle.xml
Posted by Jakub Dubovsky <sp...@gmail.com>.
Thanks Ted for trying. (see below for Ted's reply). Con somebody confirm
that this is not an expected behaviour? Is there somebody else having same
issue?
Thanks!
On Wed, Feb 8, 2017 at 11:42 PM, Ted Yu <yu...@gmail.com> wrote:
> Using your command, I got:
>
> Caused by: org.apache.maven.project.DependencyResolutionException: Could
> not resolve dependencies for project org.apache.spark:spark-launcher_2.11:jar:2.1.0:
> Could not find artifact org.apache.hadoop:hadoop-client:jar:2.6.0-cdh5.7.1
> in central (https://repo1.maven.org/maven2)
> at org.apache.maven.project.DefaultProjectDependenciesResolver.
> resolve(DefaultProjectDependenciesResolver.java:211)
> at org.apache.maven.lifecycle.internal.LifecycleDependencyResol
> ver.getDependencies(LifecycleDependencyResolver.java:195)
> ... 23 more
>
> So I switched to:
>
> ./build/mvn -Phadoop-2.7 -Phive -Phive-thriftserver -Pyarn -DskipTests -e
> clean install
>
> With your change to pom.xml, I got the same error.
>
> Without change to pom.xml, the build continues.
>
> On Wed, Feb 8, 2017 at 8:19 AM, Jakub Dubovsky <
> spark.dubovsky.jakub@gmail.com> wrote:
>
>> Sorry, correct links set in text below.
>>
>>
>> Hello there,
>>>
>>> I am trying to build spark locally so I can test something to help
>>> resolve this ticket <https://issues.apache.org/jira/browse/SPARK-16599>.
>>>
>>> git checkout v2.1.0
>>> ./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
>>> -Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install
>>>
>>> This starts the build successfully. Then I changed one source file and a
>>> version in pom.xml (exact diff
>>> <https://gist.github.com/james64/cc158bdb81bc1828937c757fde94ce82>).
>>> After this change when I run the same build command as above I get failure:
>>>
>>> Could not find resource 'dev/checkstyle.xml'
>>>
>>> whole build log
>>> <https://gist.github.com/james64/85b3bf4613e7105bebd687502258a518>
>>>
>>> How this one commit change can cause this error? checkstyle.xml is still
>>> there. I run maven from project root in both cases. What should I change to
>>> build this?
>>>
>>> Thanks for your help
>>>
>>> Jakub
>>>
>>>
>>
>
Re: Cannot find checkstyle.xml
Posted by Jakub Dubovsky <sp...@gmail.com>.
Sorry, correct links set in text below.
Hello there,
>
> I am trying to build spark locally so I can test something to help resolve this
> ticket <https://issues.apache.org/jira/browse/SPARK-16599>.
>
> git checkout v2.1.0
> ./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
> -Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install
>
> This starts the build successfully. Then I changed one source file and a
> version in pom.xml (exact diff
> <https://gist.github.com/james64/cc158bdb81bc1828937c757fde94ce82>).
> After this change when I run the same build command as above I get failure:
>
> Could not find resource 'dev/checkstyle.xml'
>
> whole build log
> <https://gist.github.com/james64/85b3bf4613e7105bebd687502258a518>
>
> How this one commit change can cause this error? checkstyle.xml is still
> there. I run maven from project root in both cases. What should I change to
> build this?
>
> Thanks for your help
>
> Jakub
>
>