You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nemo.apache.org by ta...@apache.org on 2019/03/11 04:24:57 UTC
[incubator-nemo] branch serverless-general-check-stateful created
(now 788abbd)
This is an automated email from the ASF dual-hosted git repository.
taegeonum pushed a change to branch serverless-general-check-stateful
in repository https://gitbox.apache.org/repos/asf/incubator-nemo.git.
at 788abbd Revert "disable output writer mapt from offlaoding event handler"
This branch includes the following new commits:
new fb6ddc6 nexmark
new 66de21f dd
new 92c6bd3 nexmark fix
new 10c8cbd fix script
new d4c224c Merge branch 'Nemo-279' into 247-unbounded-nexmark
new 69f161e Merge branch 'Nemo-279' into 247-unbounded-nexmark
new 31cbc83 Merge branch '247-unbounded-mr' into 247-unbounded-nexmark
new fc407e9 set window
new 21bae85 fix script
new 9a0b341 fix parsing
new 71ac442 Merge branch '247-unbounded-nexmark' into 247-unbounded-nexmark-sls
new cd73c8c broadcast windowed value
new d551e0a impl..
new a0e84c6 Merge branch 'master' of https://github.com/apache/incubator-nemo into 247-unbounded-nexmark-sls
new 4a024c3 done: upload main/side input to s3
new bfa69d0 done: upload main/side input to s3
new 8a63da3 lambda
new 967aa71 serverless deserialize
new fe2e2d9 nemo serverless
new 8b3a850 flush multithread
new 7c1136d flush fix
new 3802f98 fix concurrent map
new adcbfd9 rm log
new dc20f66 fix
new d3bc3f8 Merge branch 'master' of https://github.com/apache/incubator-nemo into 247-unbounded-nexmark-sls
new e0e6a84 add netty leak log
new 6d8c09a delete unncessary files
new 10722e9 fix
new f5f4ff5 complete
new 01f4c03 rm file in lambda
new 9290861 delete key
new aa2e69e origin
new db0d126 merge jyk branch
new dfe8083 0.2 snapshot
new eede9f9 0.2 snapshot
new 433d7b9 fix driver option
new 6697c71 fix
new 3efbb20 enable sls
new 33a053b operator20 -> operator22
new 6a6028c fix
new 186cc80 fix
new 964c845 fix side input output
new 278373c multiple async client
new f7b2a9c logging
new c78691d fix cli size
new 1dc79c8 fix num
new 97df641 Merge branch '247-unbounded-nexmark-sls-origin' of github.com:taegeonum/incubator-nemo into 247-unbounded-nexmark-sls-origin
new 2d7e4f2 add warmer
new 1c3c068 Merge branch '247-unbounded-nexmark-sls-origin' of github.com:taegeonum/incubator-nemo into 247-unbounded-nexmark-sls-origin
new 977b47c aws async -> aws client
new f7128e1 Merge branch '247-unbounded-nexmark-sls-origin' of github.com:taegeonum/incubator-nemo into 247-unbounded-nexmark-sls-origin
new d448ccf Merge branch '259-sideinput' of https://github.com/johnyangk/incubator-nemo into 247-unbounded-nexmark-sls-origin
new f0fddaf merge jyk
new 18bbb06 warmer fix
new fdd377b Merge branch '247-unbounded-nexmark-sls-origin' of github.com:taegeonum/incubator-nemo into 247-unbounded-nexmark-sls-origin
new c215433 Merge branch '247-unbounded-nexmark-sls-origin' of github.com:taegeonum/incubator-nemo into 247-unbounded-nexmark-sls-origin
new d4290c8 fix max client
new 167fa8f Merge branch '247-unbounded-nexmark-sls-origin' of github.com:taegeonum/incubator-nemo into 247-unbounded-nexmark-sls-origin
new dfdd60a side input lambda
new a2c9a8a Merge branch 'master' of https://github.com/apache/incubator-nemo into 247-unbounded-nexmark-sls-origin
new 2080b74 Merge branch 'master' of https://github.com/apache/incubator-nemo into 247-unbounded-nexmark-sls-origin
new 925336f logging fix
new 7835f8e fix fanout
new b93b820 late data
new caf9d3f Merge branch 'drop-data' into 247-unbounded-nexmark-sls-origin
new 4447cac allowed lateness
new d219b78 nemo 282
new f3cd3a2 Merge branch 'Nemo-282' into 247-unbounded-nexmark-sls-origin
new 19638cb disable compression
new 9331059 logging
new 8514db5 comment out
new 03d3ea6 comment out
new 82b78d3 fix inmemory side input reader map
new 5637218 unbounded source revert
new 1628034 fix window access map
new d5d0c1b compression enable
new ad68349 logging fix
new 83b2729 fix logic
new 4f43afe warmer invocation
new 7eeadb1 fix periodic flush
new 4410dfa inmemory
new f8c55a7 fix
new c1d2ba3 inmemory
new 73eb1a1 logging
new ec262be fix filename
new b9a5495 fix server side channel handler
new 6610ee3 add logging
new df43b94 adr
new b664b44 logging
new 97293d1 coder fix
new dd8501a logging
new 94dc1c8 logging
new 9d41d90 logging
new 3f12125 fix
new 9d8f0a4 bug fix
new 05e08e5 fix
new d9754df logging
new 06bb8a8 close obj
new cb578be loggingg
new 7f3bf52 log
new 7049138 fix bug
new c9a479c rm logging
new ceaf10d fix sending byte
new 0d2e171 Merge branch 'Nemo-293' into 247-sls-inmemory
new 4d7cd3b Merge branch 'Nemo-293' into 247-sls-inmemory
new 0654f2a in-memory
new d9206b7 warmer fix
new 5229583 logging
new c562e86 lambda async inmemory
new 23dcc00 no wait all handshakes
new 5e9e953 Merge branch 'master' of https://github.com/apache/incubator-nemo into 247-sls-inmemory
new 07c52ce Merge branch 'Nemo-293' into 247-sls-inmemory
new 3360381 synchronized
new d78cd38 Merge branch 'master' of https://github.com/apache/incubator-nemo into 247-sls-inmemory
new a4fe1fa Merge branch 'master' of https://github.com/apache/incubator-nemo into 247-sls-inmemory
new a32142d lazy init
new ae23c9f add log
new f8fce01 write and flush
new 65bc6f0 Merge branch 'Nemo-309' into 247-sls-inmemory
new eb3bfa8 flush at watermark
new 211a30b Merge branch 'Nemo-309' into 247-sls-inmemory
new 9c99a9e logging
new 31987e3 lo0g
new c6392e6 log
new 5778d96 log
new aea2679 logging
new 3cec2f3 log
new f03ad17 fix ped
new fb165c3 fix script
new f50ee6c query8 logging
new a9eca42 gc
new 103296d fix gbkw
new e5d909b number of key logging
new d4a4b94 rm unused keys
new 9ffead2 logging
new 537abaa log
new 425ad7a fix trigger
new 18c77d8 rm key
new 3b73444 log:
new e40cb73 fix gbkw timer internal
new 9afbfc8 rm log
new d6443c6 fix bug
new dfc8f36 rm log
new 9e468b4 element-wise processing
new b5e22c6 log
new bbc7ca8 element wise flush
new f42b080 netty flush fix
new 8fdbfa4 add ser file
new bdd0e5e send ir vertex
new efa9d96 fix
new 0346794 query8 serverless
new 2776944 address fixgs
new 2dffba1 fix
new d987f3a disable serialized file
new 7323712 disable query8
new 58dc48b fix bug
new c4b7fbd warmup
new 51a7fcb warmup
new 7d3ca18 fix handler
new efcb77a warmer count fix
new a453d6a add query8
new df3ae05 watermark logging
new e8f6cbe warmup
new 6fd591a rm warmer
new 0881066 warmup fix
new 786aaa4 logging
new 6b2a778 fix
new a337157 fix netty handler
new f161c3f buffer -> ioBuffer
new 9d98d68 addr
new 63e5fd8 refactoring gbk lambda emitter
new 46dbf4b buffer batch
new c8d4a51 Add logging
new 6e6fb2b refactor
new 812e3e5 fix
new f80d07b rm warmer
new b3a9512 fix
new 7f59f96 fix
new c9c0892 fix
new 8c3725a fix
new 672d5c6 fix
new cca81c4 fix gbk
new f19427d fix period
new a4816fe Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new ec0a59b fix
new f077fbf Merge branch 'after-hos-refactor' of https://github.com/taegeonum/incubator-nemo into after-hos-refactor
new c76480c logging pushback
new 6014623 serialize vertices
new ee53aca fix
new 4c15b42 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 8d11b03 vertex submit
new 79f7679 fix
new ad24bf6 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 4538fac fix
new 582b74d logging
new ac88fed Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new df79b23 logging
new ba1167e Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 556abab add pending queue
new 9d6426f Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new d437149 fix
new d826f58 fix addr
new 34e923a Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 4112457 fix pending
new 808e6e4 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 94a6932 fix
new b7aca1e Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 93a6d8a logging
new 4be704f MMerge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 0a30537 log
new bfe73c7 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 90508fd fix
new b8116e0 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 4092c50 rm log
new a692694 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 9458e06 refactor for vm
new 45bdcd3 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new bc0056c fix bug
new c10b13b Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 1862301 refactoring for vm
new dd0cd89 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 4b14153 fix
new ee457bd address
new 82a5ceb Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 22e1a2b vm
new d311a54 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 454ff1b fix address
new bb6676e Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 05ef119 log
new 9bf9f95 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 7bc3cee fix
new 061cc23 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new eb221c5 fix pom
new 84385cc rm pushback logg
new 3664ec2 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new b05e4f7 rm gbkw log
new 5565577 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 11df234 logging:
new ac13e5b Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 48682e9 bug fix
new 44d0f0e Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 48b8a5c offloading handler
new 3349f54 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 3d23977 fix bug
new 43c9a56 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 923afef rm logs
new 58a22ef fix address
new 972e6e8 Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new d956cd1 fix pa
new 4973141 fix
new 7152ead add start/stop vm
new 327320a Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 92b94ae Merge branch 'after-hos-refactor' of github.com:taegeonum/incubator-nemo into after-hos-refactor
new 56ab2fa fix destroy
new d4f3970 Merge branch 'after-hos-refactor' of https://github.com/taegeonum/incubator-nemo into after-hos-refactor
new f6fd317 handle restart exception
new bf7f6b7 fix bug
new 2f24ccd fix ready vm
new 2d4089e rm pool
new 7ea9816 constants
new f9f137a element wise flush
new 52b1d88 fix lambda offloading requester
new 4699f48 fix
new fce0896 loggig
new 632b576 logging
new 964a7dd synchronized
new c51141e rm sync
new f99f952 push back log
new 65a221d logging fix
new 65f16c9 refactoring
new c4fd515 fix dependency
new 84bb5b9 Revert "fix dependency"
new ebf5e7d Revert "Revert "fix dependency""
new 9ee8d29 refactoring
new 6df363d fix sh
new 864549f fix pom
new 9d1702d fix pom
new d541f71 warmer in master
new b63fa4a fix script
new a7f21e3 Merge branch 'serverless-general' of github.com:taegeonum/incubator-nemo into serverless-general
new 6a0727d fix address
new 4b354a3 fix constants
new 7735396 Merge branch 'serverless-general' of github.com:taegeonum/incubator-nemo into serverless-general
new 2109c64 fix netutil
new 57a4d8a Merge branch 'serverless-general' of https://github.com/taegeonum/incubator-nemo into serverless-general
new 99b0d5d Addrr
new f4c4a84 inet socket addr
new 18783df disable serverless warmer
new 1fd19e1 logging
new 167acd6 fix
new 545546c logging
new 974b6cd 20332
new 473faaa fix
new 450f9b9 warmer in master
new 517f636 fix lambda worker connection
new b92a13b refactoring task executor
new 8cd8d3b log
new 2535528 support join
new 8b2bdf9 rm unused import
new c7df232 fix push back
new 955b35c fix bug
new 1671331 fix bug
new 0ba4b83 add bytebuf.release()
new ad410cc fix exernal class loader
new 7d424c2 logging
new 49a3cd3 log
new 2d385d8 fix bug
new f4cf373 rm logging
new 9689565 fix bug
new 088a2a5 log
new 861cb68 parallelism
new ec4779e log
new 1b1444a fix push back transform
new c0ac3bc extra request
new 377d9f4 logging
new 1d8088d fix extra request logic
new 717f825 logging
new a2911c3 rm write and flush
new 4213b27 more logging
new 7289cb3 logging
new e41ea95 pipelining data transfer
new 39e3653 fix
new 28c2cbd no direct flush
new 6232335 fix constnats
new d0ff291 rm
new f5e03ab fix
new 605a206 fix
new c95c296 refactoring
new 1eed91e fix format
new c79c00e fix pushback offloading
new 1df130d worker init buffer retain
new 13eca46 fix
new 8df4d03 logging
new a9a1728 fix sls executor service
new 1fa731b write ordinal
new e27b064 fix result
new 0dbe513 logging
new db8452b output emit
new 981fbde result logging
new d4142e0 rm logging
new eabc609 fix log
new 2c38af6 log
new abf4e23 rm pending request in offloading factory and preparing for speculative execution (global id)
new 37fb5a5 speculative exection
new 3cc69ea fix output emission
new 67f1843 fix shutdown logig
new 07642cf logging
new 8f7be6e rm logging
new 09a1961 log
new c5f5fe4 rm result map
new 66a92b1 loggingg
new 90dddad pushback fix
new 7b7446e fix push back offloading
new a8442ec rm ready state
new 8b0e159 log
new fa5ef0e optional fix
new 6891754 fix result map clear bug in finishOffloading
new 98fa2df period
new 6fc7a65 logging output latency
new 4d4626b more logging
new 2b1cf15 fix
new 7481a3d more logging
new 6b56cc7 serialize fix
new d99dd6f fix transient
new db27346 fix bug
new cc6a5cd data ordinal add
new 166d6cc direct buff -> heap buffer
new f25bd1a log
new 7938d6e speculative execution
new 745794b fix bytebuf bug
new 571d8ce fix bug
new c635471 speculative fix
new c0e6f33 comment out
new 8ef6f43 speuclative bug fix
new aa787a3 emittable fix
new 74d2a73 logging
new 313d8b3 logging fix
new e7c9afd fix retain
new 7619de8 scheduler log
new a17c6e3 scheduler log
new 3bb0541 print exception
new f3bf055 fix error
new 27d4fa8 fix speculative execution (reject execution if the work is done)
new 28f29ca fix
new e276dff more logging
new ea49c39 fix
new bed7b49 finish offloading
new b3fa0ad remove rejected output
new 438e1b2 speculative execution optimization
new b76c7e1 fix speculative
new 7e2ec0d sync bytebuf
new 13cff04 Revert "sync bytebuf"
new 39cb71e exception handling
new 52f375d ioBuffer -> buffer
new 5ef047d wo speculative
new 6f7a016 more logging
new c7235a2 add exception
new 12407e6 Revert "ioBuffer -> buffer"
new d63df8f sls general logging
new 56486e7 more logging
new 2a79bf2 speculative execution fix
new 41b4a3d Merge branch 'serverless-general-wo-speculative' of github.com:taegeonum/incubator-nemo into serverless-general-wo-speculative
new 22a7062 bug fix
new dd2d9f0 Merge branch 'serverless-general-wo-speculative' of github.com:taegeonum/incubator-nemo into serverless-general-wo-speculative
new abbeea0 logging
new a8dd525 Merge branch 'serverless-general-wo-speculative' of github.com:taegeonum/incubator-nemo into serverless-general-wo-speculative
new 2756201 fix log
new 5311d96 decoupling serverless module
new 1c4ad0a add nexmark
new 172440c rm unnecessary
new 9a9a781 Merge branch 'decouple-serverless' into serverless-general
new c26cbc4 rm no element
new fd56ddd offloading false
new a0a0fbb fix pushback
new dd17583 fix
new b666488 Revert "fix"
new d9e7abd Revert "rm no element"
new c621867 nexmark 2.7.0-snapshot
new c516d9b fix pom
new 754f678 add gcp pom
new 2fddccb rm gcp pom
new 89f8583 Revert "rm gcp pom"
new 22e6486 cpu bottleneck detection
new f1c1e46 fix event handler
new 8f1c857 logging prcoessed events
new 6f55fb6 logging prcoessed events
new a20a4ae fix cpu bottleneck handler
new f8fed16 start/stop offloading skeleton code
new 5a592b0 input fluctuation detection
new a3f8284 fix
new 2108a6f fix cpu bottleneck detection
new fa8a4f9 comment
new 36f0e7e automatic offloading checkpoint... rm data type write
new 30dffde fix offloading event coder
new 75e3591 fix offloading event coder
new 3727ad4 fix
new 3e250e9 fix encoder
new 2685979 fix
new cb6dbd7 fix
new 70d0924 fix
new 0344bd7 fix
new 5a3e4ea logging..
new 3d598f0 add sdk
new fe34c6e set context class loader
new e368f9c use composite
new 71ace5e add writer index
new c0c7e11 fix
new 57758f7 logging encode/decode byte
new fb4dd7c fix cached pool worker init buf
new a7733d7 more logging
new c8e6fec rm windowaccessmap
new 3772170 log
new bca6df1 new pushbackdofn
new dc9bd6a new pushbackdofn
new f703da3 offloading bytebuf
new 94e1117 revert to beam 2.6.0
new 92557e1 fix pom
new 8246f4a initial commit for offloading stateless transform
new 1840095 add offloading result event
new 3ec5b4a add offloading true
new 3a59a76 add logging
new 1b29e06 log
new 3246b6f fix encoder
new efc2cf1 more logging
new 62b21b2 add nemo-beam-runner
new bd911c9 skip sink
new 2b83693 logging
new 2f7a786 logging and fix
new 32fbd7d output emit logging
new b3ecbe6 mv file
new 9302453 remove logging
new 3d4f100 flush to sls
new d4e896b flush fix
new 9e288aa rm logging and fix
new b097c5f logging
new b30dfee shutdown thread
new c04a068 operator bursty disable
new 5177ae2 add configuration for offloading
new e598367 create evalconf
new 88c4164 fix
new 0d7d70e use evalConf for poolSize and flushBytes
new 7650b3e fix
new 9a9a55b fix
new 0ec9c31 rm log
new 79e6998 rm log
new 88d705a bottleneck detection parameter conf
new 3942df6 logging enable/disble lambda
new 016c047 add offloading debug
new eb7a508 fix
new 6be1b0e offloading request after 10 sec
new f1305d8 Add Timestamp Value to NemoEvent for Input Tracking
new b4658c9 metric collector implementation
new 55455a2 rm logging
new 5bee178 latency logging fix
new 0988de4 latency logging fix
new a0d99ed latency logging fix
new 04ef8f7 Timestampvalue for offloading
new 610ab7c fix
new 012f686 add script
new 734db94 fix pom
new 9ba3f9e fix dependency
new 8b21e67 fix dependency
new 810b2f9 Automatic offloading for general query DAG
new d40e090 Refactoring packages
new cf41b1f rm logging
new d5db1ad fix
new 07d107b Merge branch 'master' of https://github.com/apache/incubator-nemo into merge-from-master
new 5a11b3c logging
new 78b049f fix unbounded source readable
new 42a3d36 rm nemo-client dependency from nemo-beam-compiler-frontend
new e1b02f9 rm unnecessary files
new f55b258 latency logging
new dbb72b8 fix logging
new ec2ec1c rm unnecessary variables
new bfed190 multi-stage (output writer)
new 319b96f fix bug
new 3edd4fa print vertex id
new d35d912 log
new 5fc5ec9 logging
new 33b79c6 src id
new 0790b3c logging
new ba3b1e4 fix dag
new b8d52b3 logging
new cc34460 dag fix
new bf14c82 fix
new 561ce4a fix
new ae66872 offloading output writer fix
new a022ef5 logging
new cde47e9 loggging
new 0b2bc17 more logging
new db3a302 fix offloading debug start
new a9f94db log
new aefcb54 logging
new 17b6ceb fix
new 2887bac fix
new 6bd9c74 disable output writer mapt from offlaoding event handler
new 78a4a0e vertex logging
new 788abbd Revert "disable output writer mapt from offlaoding event handler"
The 538 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.