You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "haosdent (JIRA)" <ji...@apache.org> on 2015/11/09 20:04:11 UTC
[jira] [Commented] (MESOS-3216) virtual memory exhausted:: Cannot
allocate memory
[ https://issues.apache.org/jira/browse/MESOS-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997149#comment-14997149 ]
haosdent commented on MESOS-3216:
---------------------------------
I try compile Mesos in a VM which only have 1G memory. Fail when compile master.cpp.
{noformat}
g++ -DPACKAGE_NAME=\"mesos\" -DPACKAGE_TARNAME=\"mesos\" -DPACKAGE_VERSION=\"0.26.0\" "-DPACKAGE_STRING=\"mesos 0.26.0\"" -DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"mesos\" -DVERSION=\"0.26.0\" -DSTDC_HEADERS=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_MEMORY_H=1 -DHAVE_STRINGS_H=1 -DHAVE_INTTYPES_H=1 -DHAVE_STDINT_H=1 -DHAVE_UNISTD_H=1 -DHAVE_DLFCN_H=1 -DLT_OBJDIR=\".libs/\" -DHAVE_PTHREAD_PRIO_INHERIT=1 -DHAVE_PTHREAD=1 -DHAVE_LIBZ=1 -DHAVE_LIBCURL=1 -DHAVE_APR_POOLS_H=1 -DHAVE_LIBAPR_1=1 -DHAVE_SVN_VERSION_H=1 -DHAVE_LIBSVN_SUBR_1=1 -DHAVE_SVN_DELTA_H=1 -DHAVE_LIBSVN_DELTA_1=1 -DHAVE_LIBSASL2=1 -DMESOS_HAS_JAVA=1 -DHAVE_PYTHON=\"2.7\" -DMESOS_HAS_PYTHON=1 -I. -I../../src -Wall -Werror -DLIBDIR=\"/usr/local/lib\" -DPKGLIBEXECDIR=\"/usr/local/libexec/mesos\" -DPKGDATADIR=\"/usr/local/share/mesos\" -I../../include -I../../3rdparty/libprocess/include -I../../3rdparty/libprocess/3rdparty/stout/include -I../include -I../include/mesos -I../3rdparty/libprocess/3rdparty/boost-1.53.0 -I../3rdparty/libprocess/3rdparty/picojson-1.3.0 -DPICOJSON_USE_INT64 -D__STDC_FORMAT_MACROS -I../3rdparty/libprocess/3rdparty/protobuf-2.5.0/src -I../3rdparty/libprocess/3rdparty/glog-0.3.3/src -I../3rdparty/libprocess/3rdparty/glog-0.3.3/src -I../3rdparty/leveldb/include -I../3rdparty/zookeeper-3.4.5/src/c/include -I../3rdparty/zookeeper-3.4.5/src/c/generated -I../3rdparty/libprocess/3rdparty/protobuf-2.5.0/src -I/usr/include/subversion-1 -I/usr/include/apr-1 -I/usr/include/apr-1.0 -pthread -laprutil-1 -Wno-unused-local-typedefs -std=c++11 -MT master/libmesos_no_3rdparty_la-master.lo -MD -MP -MF master/.deps/libmesos_no_3rdparty_la-master.Tpo -c ../../src/master/master.cpp -fPIC -DPIC -o master/.libs/libmesos_no_3rdparty_la-master.o
{noformat}
mem-report result for master.cpp in a enough memory machine.
{noformat}
Number of expanded macros: 570265
Average number of tokens per macro expansion: 14
Line Table allocations during the compilation process
Number of ordinary maps used: 3846
Ordinary map used size: 150k
Number of ordinary maps allocated: 6553
Ordinary maps allocated size: 255k
Number of macro maps used: 432k
Macro maps used size: 16M
Macro maps locations size: 64M
Macro maps size: 81M
Duplicated maps locations size: 15M
Total allocated maps size: 128M
Total used maps size: 81M
Memory still allocated at the end of the compilation process
Size Allocated Used Overhead
8 684k 666k 20k
16 12M 5998k 282k
32 89M 33M 1615k
64 26M 16M 431k
256 71M 64M 1000k
512 10M 10M 149k
1024 11M 11M 166k
2048 11M 11M 155k
4096 3512k 3512k 48k
8192 11M 11M 80k
16384 4400k 4400k 15k
32768 1216k 1216k 2128
65536 128k 128k 112
131072 128k 128k 56
262144 1024k 1024k 224
1048576 4096k 4096k 224
2097152 8192k 8192k 224
4194304 4096k 4096k 56
67108864 64M 64M 56
24 82M 20M 1480k
40 98M 49M 1581k
48 39M 17M 635k
56 16M 3329k 268k
72 31M 3472k 447k
80 16M 4683k 235k
88 16M 10204k 231k
96 12M 12M 177k
112 21M 6610k 299k
120 9204k 9052k 125k
184 129M 104M 1813k
128 73M 66M 1029k
152 44M 27M 625k
168 219M 169M 3075k
160 8092k 3025k 110k
104 39M 23M 548k
296 22M 20M 309k
136 9360k 3567k 127k
Total 1228M 810M 16M
String pool
entries 119613
identifiers 103248 (86.32%)
slots 262144
deleted 5762
bytes 8142k (17592186044408M overhead)
table size 2048k
coll/search 0.3573
ins/search 0.0490
avg. entry 69.70 bytes (+/- 78.32)
longest entry 711
(No per-node statistics)
Type hash: size 262139, 146760 elements, 1.047335 collisions
DECL_DEBUG_EXPR hash: size 1021, 68 elements, 0.114537 collisions
DECL_VALUE_EXPR hash: size 4093, 1420 elements, 0.939095 collisions
no search statistics
decl_specializations: size 524287, 201364 elements, 1.321482 collisions
type_specializations: size 262139, 111708 elements, 1.986983 collisions
No gimple statistics
No RTX statistics
Alias oracle query stats:
refs_may_alias_p: 0 disambiguations, 0 queries
ref_maybe_used_by_call_p: 0 disambiguations, 0 queries
call_may_clobber_ref_p: 0 disambiguations, 0 queries
PTA query stats:
pt_solution_includes: 0 disambiguations, 0 queries
pt_solutions_intersect: 0 disambiguations, 0 queries
{noformat}
> virtual memory exhausted:: Cannot allocate memory
> -------------------------------------------------
>
> Key: MESOS-3216
> URL: https://issues.apache.org/jira/browse/MESOS-3216
> Project: Mesos
> Issue Type: Bug
> Components: build
> Affects Versions: 0.23.0
> Environment: Linux Kudu 3.19.0-25-generic #26-Ubuntu SMP Fri Jul 24 21:17:31 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux
> (Ubuntu 15.04)
> Reporter: Samuel Marks
> Assignee: haosdent
>
> After receiving this error when building on a virtual instance, I decided to build a package using https://github.com/deric/mesos-deb-packaging.
> Here is the last little bit of the output after running {{./build_mesos --ref 0.23.0 --build-version p1}}:
> {code}
> mv -f common/.deps/libmesos_no_3rdparty_la-http.Tpo common/.deps/libmesos_no_3rdparty_la-http.Plo
> /bin/bash ../libtool --tag=CXX --mode=compile g++ -DPACKAGE_NAME=\"mesos\" -DPACKAGE_TARNAME=\"mesos\" -DPACKAGE_VERSION=\"0.23.0\" -DPACKAGE_STRING=\"mesos\ 0.23.0\" -DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"mesos\" -DVERSION=\"0.23.0\" -DSTDC_HEADERS=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_MEMORY_H=1 -DHAVE_STRINGS_H=1 -DHAVE_INTTYPES_H=1 -DHAVE_STDINT_H=1 -DHAVE_UNISTD_H=1 -DHAVE_DLFCN_H=1 -DLT_OBJDIR=\".libs/\" -DHAVE_PTHREAD_PRIO_INHERIT=1 -DHAVE_PTHREAD=1 -DHAVE_LIBZ=1 -DHAVE_LIBCURL=1 -DHAVE_APR_POOLS_H=1 -DHAVE_LIBAPR_1=1 -DHAVE_SVN_VERSION_H=1 -DHAVE_LIBSVN_SUBR_1=1 -DHAVE_SVN_DELTA_H=1 -DHAVE_LIBSVN_DELTA_1=1 -DHAVE_LIBSASL2=1 -DMESOS_HAS_JAVA=1 -DHAVE_PYTHON=\"2.7\" -DMESOS_HAS_PYTHON=1 -I. -I/linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/src -Wall -Werror -DLIBDIR=\"/usr/lib\" -DPKGLIBEXECDIR=\"/usr/libexec/mesos\" -DPKGDATADIR=\"/usr/share/mesos\" -I/linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/include -I/linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/3rdparty/libprocess/include -I/linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/3rdparty/libprocess/3rdparty/stout/include -I../include -I../include/mesos -I../3rdparty/libprocess/3rdparty/boost-1.53.0 -I../3rdparty/libprocess/3rdparty/picojson-4f93734 -I../3rdparty/libprocess/3rdparty/protobuf-2.5.0/src -I../3rdparty/libprocess/3rdparty/glog-0.3.3/src -I../3rdparty/libprocess/3rdparty/glog-0.3.3/src -I../3rdparty/leveldb/include -I../3rdparty/zookeeper-3.4.5/src/c/include -I../3rdparty/zookeeper-3.4.5/src/c/generated -I../3rdparty/libprocess/3rdparty/protobuf-2.5.0/src -I/usr/include/subversion-1 -I/usr/include/apr-1 -I/usr/include/apr-1.0 -pthread -O2 -Wno-unused-local-typedefs -Wno-maybe-uninitialized -std=c++11 -MT master/allocator/libmesos_no_3rdparty_la-allocator.lo -MD -MP -MF master/allocator/.deps/libmesos_no_3rdparty_la-allocator.Tpo -c -o master/allocator/libmesos_no_3rdparty_la-allocator.lo `test -f 'master/allocator/allocator.cpp' || echo '/linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/src/'`master/allocator/allocator.cpp
> libtool: compile: g++ -DPACKAGE_NAME=\"mesos\" -DPACKAGE_TARNAME=\"mesos\" -DPACKAGE_VERSION=\"0.23.0\" "-DPACKAGE_STRING=\"mesos 0.23.0\"" -DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"mesos\" -DVERSION=\"0.23.0\" -DSTDC_HEADERS=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_MEMORY_H=1 -DHAVE_STRINGS_H=1 -DHAVE_INTTYPES_H=1 -DHAVE_STDINT_H=1 -DHAVE_UNISTD_H=1 -DHAVE_DLFCN_H=1 -DLT_OBJDIR=\".libs/\" -DHAVE_PTHREAD_PRIO_INHERIT=1 -DHAVE_PTHREAD=1 -DHAVE_LIBZ=1 -DHAVE_LIBCURL=1 -DHAVE_APR_POOLS_H=1 -DHAVE_LIBAPR_1=1 -DHAVE_SVN_VERSION_H=1 -DHAVE_LIBSVN_SUBR_1=1 -DHAVE_SVN_DELTA_H=1 -DHAVE_LIBSVN_DELTA_1=1 -DHAVE_LIBSASL2=1 -DMESOS_HAS_JAVA=1 -DHAVE_PYTHON=\"2.7\" -DMESOS_HAS_PYTHON=1 -I. -I/linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/src -Wall -Werror -DLIBDIR=\"/usr/lib\" -DPKGLIBEXECDIR=\"/usr/libexec/mesos\" -DPKGDATADIR=\"/usr/share/mesos\" -I/linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/include -I/linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/3rdparty/libprocess/include -I/linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/3rdparty/libprocess/3rdparty/stout/include -I../include -I../include/mesos -I../3rdparty/libprocess/3rdparty/boost-1.53.0 -I../3rdparty/libprocess/3rdparty/picojson-4f93734 -I../3rdparty/libprocess/3rdparty/protobuf-2.5.0/src -I../3rdparty/libprocess/3rdparty/glog-0.3.3/src -I../3rdparty/libprocess/3rdparty/glog-0.3.3/src -I../3rdparty/leveldb/include -I../3rdparty/zookeeper-3.4.5/src/c/include -I../3rdparty/zookeeper-3.4.5/src/c/generated -I../3rdparty/libprocess/3rdparty/protobuf-2.5.0/src -I/usr/include/subversion-1 -I/usr/include/apr-1 -I/usr/include/apr-1.0 -pthread -O2 -Wno-unused-local-typedefs -Wno-maybe-uninitialized -std=c++11 -MT master/allocator/libmesos_no_3rdparty_la-allocator.lo -MD -MP -MF master/allocator/.deps/libmesos_no_3rdparty_la-allocator.Tpo -c /linked_replaced_actual_path/mesos-deb-packaging/mesos-repo/src/master/allocator/allocator.cpp -fPIC -DPIC -o master/allocator/.libs/libmesos_no_3rdparty_la-allocator.o
> virtual memory exhaustedvirtual memory exhausted:: Cannot allocate memory
> virtual memory exhausted: Cannot allocate memory
> Cannot allocate memory
> virtual memory exhausted: Cannot allocate memory
> Makefile:4159: recipe for target 'docker/libmesos_no_3rdparty_la-docker.lo' failed
> make[2]: *** [docker/libmesos_no_3rdparty_la-docker.lo] Error 1
> make[2]: *** Waiting for unfinished jobs....
> Makefile:4257: recipe for target 'master/libmesos_no_3rdparty_la-registrar.lo' failed
> make[2]: *** [master/libmesos_no_3rdparty_la-registrar.lo] Error 1
> Makefile:4278: recipe for target 'master/allocator/libmesos_no_3rdparty_la-allocator.lo' failed
> make[2]: *** [master/allocator/libmesos_no_3rdparty_la-allocator.lo] Error 1
> Makefile:4222: recipe for target 'master/libmesos_no_3rdparty_la-detector.lo' failed
> make[2]: *** [master/libmesos_no_3rdparty_la-detector.lo] Error 1
> mv -f authorizer/.deps/libmesos_no_3rdparty_la-authorizer.Tpo authorizer/.deps/libmesos_no_3rdparty_la-authorizer.Plo
> mv -f authentication/cram_md5/.deps/libmesos_no_3rdparty_la-authenticatee.Tpo authentication/cram_md5/.deps/libmesos_no_3rdparty_la-authenticatee.Plo
> mv -f authentication/cram_md5/.deps/libmesos_no_3rdparty_la-authenticator.Tpo authentication/cram_md5/.deps/libmesos_no_3rdparty_la-authenticator.Plo
> mv -f exec/.deps/libmesos_no_3rdparty_la-exec.Tpo exec/.deps/libmesos_no_3rdparty_la-exec.Plo
> mv -f master/.deps/libmesos_no_3rdparty_la-repairer.Tpo master/.deps/libmesos_no_3rdparty_la-repairer.Plo
> mv -f master/.deps/libmesos_no_3rdparty_la-contender.Tpo master/.deps/libmesos_no_3rdparty_la-contender.Plo
> mv -f master/.deps/libmesos_no_3rdparty_la-flags.Tpo master/.deps/libmesos_no_3rdparty_la-flags.Plo
> mv -f master/.deps/libmesos_no_3rdparty_la-metrics.Tpo master/.deps/libmesos_no_3rdparty_la-metrics.Plo
> mv -f master/.deps/libmesos_no_3rdparty_la-validation.Tpo master/.deps/libmesos_no_3rdparty_la-validation.Plo
> mv -f local/.deps/libmesos_no_3rdparty_la-local.Tpo local/.deps/libmesos_no_3rdparty_la-local.Plo
> mv -f master/.deps/libmesos_no_3rdparty_la-http.Tpo master/.deps/libmesos_no_3rdparty_la-http.Plo
> mv -f master/.deps/libmesos_no_3rdparty_la-master.Tpo master/.deps/libmesos_no_3rdparty_la-master.Plo
> make[2]: Leaving directory '/replaced_actual_path/mesos-deb-packaging/mesos-repo/build/src'
> Makefile:2109: recipe for target 'all' failed
> make[1]: *** [all] Error 2
> make[1]: Leaving directory '/replaced_actual_path/mesos-deb-packaging/mesos-repo/build/src'
> Makefile:667: recipe for target 'all-recursive' failed
> make: *** [all-recursive] Error 1
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)