You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Tibor Kiss (JIRA)" <ji...@apache.org> on 2016/05/02 14:36:12 UTC

[jira] [Created] (HDFS-10354) Fix compilation & unit test issues on Mac OS X with clang compiler

Tibor Kiss created HDFS-10354:
---------------------------------

             Summary: Fix compilation & unit test issues on Mac OS X with clang compiler
                 Key: HDFS-10354
                 URL: https://issues.apache.org/jira/browse/HDFS-10354
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: hdfs-client
         Environment: OS X: 10.11
clang: Apple LLVM version 7.0.2 (clang-700.1.81)
            Reporter: Tibor Kiss
            Assignee: Tibor Kiss


Compilation fails with multiple errors on Mac OS X.
Unit test test_test_libhdfs_zerocopy_hdfs_static also fails to execute on OS X.

Compile error 1:
{noformat}
     [exec] Scanning dependencies of target common_obj
     [exec] [ 45%] Building CXX object main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/base64.cc.o
     [exec] [ 45%] Building CXX object main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/status.cc.o
     [exec] [ 46%] Building CXX object main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/sasl_digest_md5.cc.o
     [exec] [ 46%] Building CXX object main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/hdfs_public_api.cc.o
     [exec] [ 47%] Building CXX object main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/options.cc.o
     [exec] [ 48%] Building CXX object main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/configuration.cc.o
     [exec] /Users/tiborkiss/workspace/apache-hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/configuration.cc:85:12: error: no viable conversion from 'optional<long>' to 'optional<long long>'
     [exec]     return result;
     [exec]            ^~~~~~
     [exec] /Users/tiborkiss/workspace/apache-hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/tr2/optional.hpp:427:13: note: candidate constructor not viable: no known conversion from 'std::experimental::optional<long>' to 'std::experimental::nullopt_t' for 1st argument
     [exec]   constexpr optional(nullopt_t) noexcept : OptionalBase<T>() {};
     [exec]             ^
     [exec] /Users/tiborkiss/workspace/apache-hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/tr2/optional.hpp:429:3: note: candidate constructor not viable: no known conversion from 'std::experimental::optional<long>' to 'const std::experimental::optional<long long> &' for 1st argument
     [exec]   optional(const optional& rhs)
     [exec]   ^
     [exec] /Users/tiborkiss/workspace/apache-hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/tr2/optional.hpp:438:3: note: candidate constructor not viable: no known conversion from 'std::experimental::optional<long>' to 'std::experimental::optional<long long> &&' for 1st argument
     [exec]   optional(optional&& rhs) noexcept(is_nothrow_move_constructible<T>::value)
     [exec]   ^
     [exec] /Users/tiborkiss/workspace/apache-hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/tr2/optional.hpp:447:13: note: candidate constructor not viable: no known conversion from 'std::experimental::optional<long>' to 'const long long &' for 1st argument
     [exec]   constexpr optional(const T& v) : OptionalBase<T>(v) {}
     [exec]             ^
     [exec] /Users/tiborkiss/workspace/apache-hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/tr2/optional.hpp:449:13: note: candidate constructor not viable: no known conversion from 'std::experimental::optional<long>' to 'long long &&' for 1st argument
     [exec]   constexpr optional(T&& v) : OptionalBase<T>(constexpr_move(v)) {}
     [exec]             ^
     [exec] 1 error generated.
     [exec] make[2]: *** [main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/configuration.cc.o] Error 1
     [exec] make[1]: *** [main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/all] Error 2
     [exec] make: *** [all] Error 2
{noformat}

Compile error 2:
{noformat}
     [exec] /Users/tiborkiss/workspace/apache-hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/fs/filesystem.cc:285:66: error: use of overloaded operator '<<' is ambiguous (with operand types 'hdfs::LogMessage' and 'size_type' (aka 'unsigned long'))
     [exec]                                   << " Existing thread count = " << worker_threads_.size());
     [exec]                                   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~
{noformat}

Unit test failure:
{noformat}

{noformat}


There is an addition compile failure in native client related to thread_local.
The complexity of the error mandates to track that issue in a separate ticket.
{noformat}
     [exec]  2/16 Test  #2: test_test_libhdfs_zerocopy_hdfs_static ..........***Failed    2.07 sec
     [exec] log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
     [exec] log4j:WARN Please initialize the log4j system properly.
     [exec] log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
     [exec] Formatting using clusterid: testClusterID
     [exec] nmdCreate: Builder#build error:
     [exec] java.lang.RuntimeException: Although a UNIX domain socket path is configured as /var/folders/g1/r_lb7cr10d9951ff9yrtvq9w0000gp/T//native_mini_dfs.sock.87990.282475249, we cannot start a localDataXceiverServer because libhadoop cannot be loaded.
     [exec] 	at org.apache.hadoop.hdfs.server.datanode.DataNode.getDomainPeerServer(DataNode.java:1017)
     [exec] 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initDataXceiver(DataNode.java:988)
     [exec] 	at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1196)
     [exec] 	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:467)
     [exec] 	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2486)
     [exec] 	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2374)
     [exec] 	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1592)
     [exec] 	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:844)
     [exec] 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:482)
     [exec] 	at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:441)
     [exec] TEST_ERROR: failed on /Users/tiborkiss/workspace/apache-hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_zerocopy.c:254 (errno: 316): got NULL from cl
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org