You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@rocketmq.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/12/07 03:02:45 UTC
[jira] [Commented] (ROCKETMQ-193) Develop rocketmq-redis-replicator
component
[ https://issues.apache.org/jira/browse/ROCKETMQ-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281261#comment-16281261 ]
ASF GitHub Bot commented on ROCKETMQ-193:
-----------------------------------------
vongosling closed pull request #29: [ROCKETMQ-193] Develop rocketmq-redis-replicator component
URL: https://github.com/apache/rocketmq-externals/pull/29
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git a/.travis.yml b/.travis.yml
new file mode 100644
index 00000000..ebf697d4
--- /dev/null
+++ b/.travis.yml
@@ -0,0 +1,9 @@
+language: java
+jdk:
+ - oraclejdk8
+branches:
+ only:
+ - master
+env:
+ - TEST_DIR=rocketmq-redis
+script: "cd $TEST_DIR && sh INTEGRATION-TEST"
diff --git a/README.md b/README.md
index 8cd617be..c9e0bdd6 100644
--- a/README.md
+++ b/README.md
@@ -22,5 +22,17 @@ Apache RocketMQ Docker provides Dockerfile and bash scripts for building and run
## RocketMQ-MySQL
This project is a data replicator between MySQL and other systems.For more details please refer to [README](https://github.com/apache/incubator-rocketmq-externals/tree/master/rocketmq-mysql).
+## RocketMQ-CPP
+
+A stable, widely used C++ client sdk of Apache RocketMQ, donated by Alibaba Group.
+
## Others
[RocketMQ-Druid](https://github.com/druid-io/druid/tree/master/extensions-contrib/druid-rocketmq), [RocketMQ-Ignite](https://github.com/apache/ignite/tree/master/modules/rocketmq) and [RocketMQ-Storm](https://github.com/apache/storm/tree/master/external/storm-rocketmq) integration can be found in those repositories.
+
+## Contribution
+
+We are always very happy to have contributions, whether for trivial cleanups or big new features. We want to have high quality, well documented codes for each programming language, as well as the surrounding ecosystem of integration tools that people use with RocketMQ.
+
+Nor is code the only way to contribute to the project. We strongly value documentation, integration with other project, and gladly accept improvements for these aspects.
+
+More info please refer to [How To Contribute](http://rocketmq.apache.org/docs/how-to-contribute/).
diff --git a/rocketmq-client4cpp/.gitignore b/rocketmq-client4cpp/.gitignore
deleted file mode 100644
index c17af800..00000000
--- a/rocketmq-client4cpp/.gitignore
+++ /dev/null
@@ -1,30 +0,0 @@
-# Compiled Object files
-*.slo
-*.lo
-*.o
-*.d
-*.obj
-
-# Precompiled Headers
-*.gch
-*.pch
-
-# Compiled Dynamic libraries
-*.so
-*.dylib
-*.dll
-
-# Fortran module files
-*.mod
-*.smod
-
-# Compiled Static libraries
-*.lai
-*.la
-*.a
-*.lib
-
-# Executables
-*.exe
-*.out
-*.app
diff --git a/rocketmq-client4cpp/LICENSE b/rocketmq-client4cpp/LICENSE
deleted file mode 100644
index 5c304d1a..00000000
--- a/rocketmq-client4cpp/LICENSE
+++ /dev/null
@@ -1,201 +0,0 @@
-Apache License
- Version 2.0, January 2004
- http://www.apache.org/licenses/
-
- TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
-
- 1. Definitions.
-
- "License" shall mean the terms and conditions for use, reproduction,
- and distribution as defined by Sections 1 through 9 of this document.
-
- "Licensor" shall mean the copyright owner or entity authorized by
- the copyright owner that is granting the License.
-
- "Legal Entity" shall mean the union of the acting entity and all
- other entities that control, are controlled by, or are under common
- control with that entity. For the purposes of this definition,
- "control" means (i) the power, direct or indirect, to cause the
- direction or management of such entity, whether by contract or
- otherwise, or (ii) ownership of fifty percent (50%) or more of the
- outstanding shares, or (iii) beneficial ownership of such entity.
-
- "You" (or "Your") shall mean an individual or Legal Entity
- exercising permissions granted by this License.
-
- "Source" form shall mean the preferred form for making modifications,
- including but not limited to software source code, documentation
- source, and configuration files.
-
- "Object" form shall mean any form resulting from mechanical
- transformation or translation of a Source form, including but
- not limited to compiled object code, generated documentation,
- and conversions to other media types.
-
- "Work" shall mean the work of authorship, whether in Source or
- Object form, made available under the License, as indicated by a
- copyright notice that is included in or attached to the work
- (an example is provided in the Appendix below).
-
- "Derivative Works" shall mean any work, whether in Source or Object
- form, that is based on (or derived from) the Work and for which the
- editorial revisions, annotations, elaborations, or other modifications
- represent, as a whole, an original work of authorship. For the purposes
- of this License, Derivative Works shall not include works that remain
- separable from, or merely link (or bind by name) to the interfaces of,
- the Work and Derivative Works thereof.
-
- "Contribution" shall mean any work of authorship, including
- the original version of the Work and any modifications or additions
- to that Work or Derivative Works thereof, that is intentionally
- submitted to Licensor for inclusion in the Work by the copyright owner
- or by an individual or Legal Entity authorized to submit on behalf of
- the copyright owner. For the purposes of this definition, "submitted"
- means any form of electronic, verbal, or written communication sent
- to the Licensor or its representatives, including but not limited to
- communication on electronic mailing lists, source code control systems,
- and issue tracking systems that are managed by, or on behalf of, the
- Licensor for the purpose of discussing and improving the Work, but
- excluding communication that is conspicuously marked or otherwise
- designated in writing by the copyright owner as "Not a Contribution."
-
- "Contributor" shall mean Licensor and any individual or Legal Entity
- on behalf of whom a Contribution has been received by Licensor and
- subsequently incorporated within the Work.
-
- 2. Grant of Copyright License. Subject to the terms and conditions of
- this License, each Contributor hereby grants to You a perpetual,
- worldwide, non-exclusive, no-charge, royalty-free, irrevocable
- copyright license to reproduce, prepare Derivative Works of,
- publicly display, publicly perform, sublicense, and distribute the
- Work and such Derivative Works in Source or Object form.
-
- 3. Grant of Patent License. Subject to the terms and conditions of
- this License, each Contributor hereby grants to You a perpetual,
- worldwide, non-exclusive, no-charge, royalty-free, irrevocable
- (except as stated in this section) patent license to make, have made,
- use, offer to sell, sell, import, and otherwise transfer the Work,
- where such license applies only to those patent claims licensable
- by such Contributor that are necessarily infringed by their
- Contribution(s) alone or by combination of their Contribution(s)
- with the Work to which such Contribution(s) was submitted. If You
- institute patent litigation against any entity (including a
- cross-claim or counterclaim in a lawsuit) alleging that the Work
- or a Contribution incorporated within the Work constitutes direct
- or contributory patent infringement, then any patent licenses
- granted to You under this License for that Work shall terminate
- as of the date such litigation is filed.
-
- 4. Redistribution. You may reproduce and distribute copies of the
- Work or Derivative Works thereof in any medium, with or without
- modifications, and in Source or Object form, provided that You
- meet the following conditions:
-
- (a) You must give any other recipients of the Work or
- Derivative Works a copy of this License; and
-
- (b) You must cause any modified files to carry prominent notices
- stating that You changed the files; and
-
- (c) You must retain, in the Source form of any Derivative Works
- that You distribute, all copyright, patent, trademark, and
- attribution notices from the Source form of the Work,
- excluding those notices that do not pertain to any part of
- the Derivative Works; and
-
- (d) If the Work includes a "NOTICE" text file as part of its
- distribution, then any Derivative Works that You distribute must
- include a readable copy of the attribution notices contained
- within such NOTICE file, excluding those notices that do not
- pertain to any part of the Derivative Works, in at least one
- of the following places: within a NOTICE text file distributed
- as part of the Derivative Works; within the Source form or
- documentation, if provided along with the Derivative Works; or,
- within a display generated by the Derivative Works, if and
- wherever such third-party notices normally appear. The contents
- of the NOTICE file are for informational purposes only and
- do not modify the License. You may add Your own attribution
- notices within Derivative Works that You distribute, alongside
- or as an addendum to the NOTICE text from the Work, provided
- that such additional attribution notices cannot be construed
- as modifying the License.
-
- You may add Your own copyright statement to Your modifications and
- may provide additional or different license terms and conditions
- for use, reproduction, or distribution of Your modifications, or
- for any such Derivative Works as a whole, provided Your use,
- reproduction, and distribution of the Work otherwise complies with
- the conditions stated in this License.
-
- 5. Submission of Contributions. Unless You explicitly state otherwise,
- any Contribution intentionally submitted for inclusion in the Work
- by You to the Licensor shall be under the terms and conditions of
- this License, without any additional terms or conditions.
- Notwithstanding the above, nothing herein shall supersede or modify
- the terms of any separate license agreement you may have executed
- with Licensor regarding such Contributions.
-
- 6. Trademarks. This License does not grant permission to use the trade
- names, trademarks, service marks, or product names of the Licensor,
- except as required for reasonable and customary use in describing the
- origin of the Work and reproducing the content of the NOTICE file.
-
- 7. Disclaimer of Warranty. Unless required by applicable law or
- agreed to in writing, Licensor provides the Work (and each
- Contributor provides its Contributions) on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
- implied, including, without limitation, any warranties or conditions
- of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
- PARTICULAR PURPOSE. You are solely responsible for determining the
- appropriateness of using or redistributing the Work and assume any
- risks associated with Your exercise of permissions under this License.
-
- 8. Limitation of Liability. In no event and under no legal theory,
- whether in tort (including negligence), contract, or otherwise,
- unless required by applicable law (such as deliberate and grossly
- negligent acts) or agreed to in writing, shall any Contributor be
- liable to You for damages, including any direct, indirect, special,
- incidental, or consequential damages of any character arising as a
- result of this License or out of the use or inability to use the
- Work (including but not limited to damages for loss of goodwill,
- work stoppage, computer failure or malfunction, or any and all
- other commercial damages or losses), even if such Contributor
- has been advised of the possibility of such damages.
-
- 9. Accepting Warranty or Additional Liability. While redistributing
- the Work or Derivative Works thereof, You may choose to offer,
- and charge a fee for, acceptance of support, warranty, indemnity,
- or other liability obligations and/or rights consistent with this
- License. However, in accepting such obligations, You may act only
- on Your own behalf and on Your sole responsibility, not on behalf
- of any other Contributor, and only if You agree to indemnify,
- defend, and hold each Contributor harmless for any liability
- incurred by, or claims asserted against, such Contributor by reason
- of your accepting any such warranty or additional liability.
-
- END OF TERMS AND CONDITIONS
-
- APPENDIX: How to apply the Apache License to your work.
-
- To apply the Apache License to your work, attach the following
- boilerplate notice, with the fields enclosed by brackets "{}"
- replaced with your own identifying information. (Don't include
- the brackets!) The text should be enclosed in the appropriate
- comment syntax for the file format. We also recommend that a
- file or class name and description of purpose be included on the
- same "printed page" as the copyright notice for easier
- identification within third-party archives.
-
- Copyright {yyyy} {name of copyright owner}
-
- Licensed under the Apache License, Version 2.0 (the "License");
- you may not use this file except in compliance with the License.
- You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing, software
- distributed under the License is distributed on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- See the License for the specific language governing permissions and
- limitations under the License.
diff --git a/rocketmq-client4cpp/Makefile b/rocketmq-client4cpp/Makefile
deleted file mode 100644
index 7b31385b..00000000
--- a/rocketmq-client4cpp/Makefile
+++ /dev/null
@@ -1,5 +0,0 @@
-all:
- make -C src all
-
-clean:
- make -C src clean
diff --git a/rocketmq-client4cpp/NOTICE b/rocketmq-client4cpp/NOTICE
deleted file mode 100644
index 53848573..00000000
--- a/rocketmq-client4cpp/NOTICE
+++ /dev/null
@@ -1,5 +0,0 @@
-Apache RocketMQ (incubating)
-Copyright 2016-2017 The Apache Software Foundation
-
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
\ No newline at end of file
diff --git a/rocketmq-client4cpp/README.md b/rocketmq-client4cpp/README.md
deleted file mode 100755
index b4fa664e..00000000
--- a/rocketmq-client4cpp/README.md
+++ /dev/null
@@ -1,21 +0,0 @@
-Fork from [RocketMQ-Client4CPP](https://github.com/NDPMediaCorp/RocketMQ-Client4CPP)
-
-[RocketMQ](https://github.com/alibaba/RocketMQ) C++ Client
-===================
-
-### Contributors
-* @[kangliqiang](https://github.com/kangliqiang)
-* @[lizhanhui](https://github.com/lizhanhui)
-* @[suwenkuang](https://github.com/hooligan520)
-
-### Current status
-* On the basis of the original repair a lot of coredump, and memory leak (valgrind) problem, add namespace, fill some of the features
-* only support linux system
-* Currently supports sending messages, support pull mode consumption messages, support push mode consumption messages
-
-### Roadmap
-* Support for transaction messages
-* Continue to support more commands (such as support broker query client running information)
-
-
-
diff --git a/rocketmq-client4cpp/build.sh b/rocketmq-client4cpp/build.sh
deleted file mode 100755
index 15197807..00000000
--- a/rocketmq-client4cpp/build.sh
+++ /dev/null
@@ -1,38 +0,0 @@
-#!/bin/sh
-VERSION=1.0.3
-BUILD_PATH=`pwd`
-INSTALL_PATH=$BUILD_PATH/release
-RELEASE_PATH=/data/libs/rocketmq
-
-echo -e "\e[33;1m# copy include files...\e[0m"
-mkdir -p $INSTALL_PATH
-rm -rf $INSTALL_PATH/*
-cp -rf $BUILD_PATH/rocketmq.mk $INSTALL_PATH/
-cp -rf $BUILD_PATH/include $INSTALL_PATH/
-cp -rf $BUILD_PATH/example $INSTALL_PATH/
-
-echo -e "\e[33;1m# build target with BIT=32...\e[0m"
-cd $BUILD_PATH/
-BIT=32 make clean >/dev/null
-BIT=32 make all >/dev/null
-mkdir -p $INSTALL_PATH/lib32
-cp -rf $BUILD_PATH/src/librocketmq.a $INSTALL_PATH/lib32/librocketmq.a
-
-echo -e "\e[33;1m# build target with BIT=64...\e[0m"
-cd $BUILD_PATH/
-BIT=64 make clean >/dev/null
-BIT=64 make all >/dev/null
-mkdir -p $INSTALL_PATH/lib64
-cp -rf $BUILD_PATH/src/librocketmq.a $INSTALL_PATH/lib64/librocketmq.a
-
-echo -e "\e[33;1m# release libs...\e[0m"
-cd $BUILD_PATH/
-tar czf rocketmq-client4cpp-${VERSION}.tgz release/
-
-#rm -rf $RELEASE_PATH
-#cp -rf $INSTALL_PATH $RELEASE_PATH
-
-echo -e "\e[33;1m# build example...\e[0m"
-cd $INSTALL_PATH/example
-make all >/dev/null
-
diff --git a/rocketmq-client4cpp/clean.sh b/rocketmq-client4cpp/clean.sh
deleted file mode 100755
index 3cf8145f..00000000
--- a/rocketmq-client4cpp/clean.sh
+++ /dev/null
@@ -1,7 +0,0 @@
-#!/bin/sh
-
-BUILD_PATH=`pwd`
-BIT=32 make -C ./src/ cleanall
-BIT=64 make -C ./src/ cleanall
-rm -rf release
-
diff --git a/rocketmq-client4cpp/example/Makefile b/rocketmq-client4cpp/example/Makefile
deleted file mode 100755
index 25a94504..00000000
--- a/rocketmq-client4cpp/example/Makefile
+++ /dev/null
@@ -1,5 +0,0 @@
-all:
- make -C demo all
-
-clean:
- make -C demo clean
diff --git a/rocketmq-client4cpp/example/demo/AsyncProducer.cpp b/rocketmq-client4cpp/example/demo/AsyncProducer.cpp
deleted file mode 100644
index 045a32a9..00000000
--- a/rocketmq-client4cpp/example/demo/AsyncProducer.cpp
+++ /dev/null
@@ -1,249 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "Common.h"
-#include "SendCallback.h"
-#include "DefaultMQProducer.h"
-using namespace rmq;
-
-long long g_lastUpdateTime = 0;
-volatile long long g_cnt_total = 0;
-volatile long long g_cnt_last = 0;
-volatile long long g_cnt_succ = 0;
-volatile long long g_cnt_fail = 0;
-
-
-void Usage(const char* program)
-{
- printf("Usage:%s ip:port [-g group] [-t topic] [-n count] [-s size] [-w logpath]\n", program);
- printf("\t -g group\n");
- printf("\t -t topic\n");
- printf("\t -n message count\n");
- printf("\t -s message size \n");
- printf("\t -w log path\n");
-}
-
-
-class SampleSendCallback : public SendCallback {
-public:
- SampleSendCallback()
- {
- }
-
- virtual ~SampleSendCallback()
- {
- }
-
- int count()
- {
-
- long long now = MyUtil::getNowMs();
- long long old = g_lastUpdateTime;
- long long total = g_cnt_succ + g_cnt_fail;
- if ((now - old) >= 1000)
- {
- if (__sync_bool_compare_and_swap(&g_lastUpdateTime, old, now))
- {
- long long time = now - old;
- int tps = (int)((total - g_cnt_last) * 1.0 / time * 1000.0);
- g_cnt_last = total;
-
- MYDEBUG("[producer]succ: %lld, fail: %lld, TPS: %d\n",
- g_cnt_succ, g_cnt_fail, tps);
- }
- }
- }
-
- void onSuccess(SendResult& sendResult)
- {
- int cnt = __sync_fetch_and_add(&g_cnt_total, 1);
- __sync_fetch_and_add(&g_cnt_succ, 1);
- MYLOG("[%d]|succ|%s\n", cnt, sendResult.toString().c_str());
- }
-
- void onException(MQException& e)
- {
- int cnt = __sync_fetch_and_add(&g_cnt_total, 1);
- __sync_fetch_and_add(&g_cnt_fail, 1);
-
- MYLOG("[%d]|fail|%s\n", cnt, e.what());
- }
-};
-
-int main(int argc, char *argv[]) {
- if (argc < 2)
- {
- Usage(argv[0]);
- return 0;
- }
-
- std::string namesrv = argv[1];
- std::string group = "pg_test_group";
- std::string topic = "topic_test";
- int size = 32;
- int count = 1000;
-
- for (int i=2; i< argc; i++)
- {
- if (strcmp(argv[i],"-g")==0)
- {
- if (i+1 < argc)
- {
- group = argv[i+1];
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-t")==0)
- {
- if (i+1 < argc)
- {
- topic = argv[i+1];
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-n")==0)
- {
- if (i+1 < argc)
- {
- count = atoi(argv[i+1]);
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-s")==0)
- {
- if (i+1 < argc)
- {
- size = atoi(argv[i+1]);
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-w")==0)
- {
- if (i+1 < argc)
- {
- MyUtil::initLog(argv[i+1]);
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
-
- // init client api log, here is not necessary, need to debug the api need to be initialized, you can consider comment it
- // Here only the default print warning, error log, the log will be rolling by day, if you need to modify the log level, please set the environment variable, export ROCKETMQ_LOGLEVEL = loglevel
- // The log level is as follows:
- // 0 - close the log
- // 1 - write error log
- // 2 - write error, warning log
- // 3 - write error, warning, info log
- // 4 - write errors, warnings, info, debug logs
- RocketMQUtil::initLog("/tmp/rocketmq_producer.log");
-
- RMQ_DEBUG("producer.new: %s", "pg_CppClient");
- DefaultMQProducer producer("pg_CppClient");
-
- RMQ_DEBUG("producer.setNamesrvAddr: %s", namesrv.c_str());
- producer.setNamesrvAddr(namesrv);
-
- RMQ_DEBUG("producer.start");
- producer.start();
-
- std::string tags[] = { "TagA", "TagB", "TagC", "TagD", "TagE" };
- int nNow = time(NULL);
- char key[64];
- char value[1024];
-
- std::string str;
- for (int i = 0; i < size; i += 8)
- {
- str.append("hello baby");
- }
-
- TimeCount tcTotal;
- tcTotal.begin();
-
- for (int i = 0; i < count; i++)
- {
- try
- {
- snprintf(key, sizeof(key), "KEY_%d_%d", nNow, i);
- snprintf(value, sizeof(value), "%011d_%s", i, str.c_str());
- Message msg(topic,// topic
- tags[i % 5],// tag
- key,// key
- value,// body
- strlen(value)+1
- );
-
- // Send messages asynchronously
- SampleSendCallback* pSendCallback = new SampleSendCallback();
- producer.send(msg, pSendCallback);
- }
- catch (MQClientException& e)
- {
- std::cout << e << std::endl;
- __sync_fetch_and_add(&g_cnt_fail, 1);
- MyUtil::msleep(3000);
- }
- }
-
- while (1)
- {
- if ((g_cnt_succ + g_cnt_fail) >= count)
- {
- break;
- }
- }
-
- tcTotal.end();
-
- printf("statsics: succ=%d, fail=%d, total_cost=%ds, tps=%d, avg=%dms\n",
- g_cnt_succ, g_cnt_fail, tcTotal.countSec(),
- (int)((double)count/((double)tcTotal.countUsec()/1000/1000)), tcTotal.countMsec()/count);
-
- producer.shutdown();
-
- return 0;
-}
-
diff --git a/rocketmq-client4cpp/example/demo/Common.cpp b/rocketmq-client4cpp/example/demo/Common.cpp
deleted file mode 100755
index b4db55ca..00000000
--- a/rocketmq-client4cpp/example/demo/Common.cpp
+++ /dev/null
@@ -1,20 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "Common.h"
-
-
-std::string MyUtil::_logPath = "";
diff --git a/rocketmq-client4cpp/example/demo/Common.h b/rocketmq-client4cpp/example/demo/Common.h
deleted file mode 100644
index 48635889..00000000
--- a/rocketmq-client4cpp/example/demo/Common.h
+++ /dev/null
@@ -1,162 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include <stdlib.h>
-#include <stdio.h>
-#include <stdint.h>
-#include <string.h>
-#include <assert.h>
-#include <time.h>
-#include <stdarg.h>
-#include <fcntl.h>
-#include <errno.h>
-#include <signal.h>
-#include <pthread.h>
-
-#include <sys/time.h>
-#include <sys/timeb.h>
-#include <sys/types.h>
-#include <sys/stat.h>
-#include <sys/file.h>
-#include <sys/syscall.h>
-#include <linux/unistd.h>
-
-#include <cstdio>
-#include <iostream>
-#include <string>
-#include <sstream>
-#include <vector>
-#include <map>
-#include <set>
-
-
-#define MYDEBUG(fmt, args...) printf(fmt, ##args)
-#define MYLOG(fmt, args...) MyUtil::writelog("[%s]"fmt, RocketMQUtil::now2str().c_str(), ##args)
-
-class MyUtil
-{
-public:
- static void msleep(long millis)
- {
- struct timespec tv;
- tv.tv_sec = millis / 1000;
- tv.tv_nsec = (millis % 1000) * 1000000;
- nanosleep(&tv, 0);
- }
-
- static long long str2ll( const char *str )
- {
- return atoll(str);
- }
-
- static unsigned long long getNowMs()
- {
- struct timeval tv;
- gettimeofday(&tv, 0);
- return tv.tv_sec * 1000ULL+tv.tv_usec/1000;
- }
-
- static int initLog(const std::string& logPath)
- {
- _logPath = logPath;
- }
-
- static void writelog(const char* fmt, ...)
- {
- if (_logPath.empty())
- {
- return;
- }
-
- static int logFd = -1;
- if (logFd < 0)
- {
- logFd = open(_logPath.c_str(), O_CREAT | O_RDWR | O_APPEND, 0666);
- }
-
- if (logFd > 0)
- {
- char buf[1024*128];
- buf[0] = buf[sizeof(buf) - 1] = '\0';
-
- va_list ap;
- va_start(ap, fmt);
- int size = vsnprintf(buf, sizeof(buf), fmt, ap);
- va_end(ap);
-
- write(logFd, buf, size);
- }
-
- return;
- }
-public:
- static std::string _logPath;
-};
-
-/*
- * int test()
- * {
- * TimeCount tc;
- * tc.begin();
- * func1();
- * tc.end();
- * cout << "cost:" << tc.countSec() << endl;
- * }
- */
-class TimeCount
-{
-public:
- TimeCount()
- {
- m_tBegin.tv_sec = 0;
- m_tBegin.tv_usec = 0;
-
- m_tEnd.tv_sec = 0;
- m_tEnd.tv_usec = 0;
- }
-
- ~TimeCount(){}
-public:
- void begin()
- {
- gettimeofday(&m_tBegin,0);
- }
-
- void end()
- {
- gettimeofday(&m_tEnd, 0);
- }
-
- int countMsec()
- {
- return (int)((m_tEnd.tv_sec - m_tBegin.tv_sec)*1000 + (m_tEnd.tv_usec -m_tBegin.tv_usec)/1000.0);
- }
-
- int countUsec()
- {
- return (m_tEnd.tv_sec - m_tBegin.tv_sec)*1000000+(m_tEnd.tv_usec -m_tBegin.tv_usec);
- }
-
- int countSec()
- {
- return (m_tEnd.tv_sec - m_tBegin.tv_sec);
- }
-
-public:
- timeval m_tBegin;
- timeval m_tEnd;
-};
-
diff --git a/rocketmq-client4cpp/example/demo/Makefile b/rocketmq-client4cpp/example/demo/Makefile
deleted file mode 100755
index be2d60f0..00000000
--- a/rocketmq-client4cpp/example/demo/Makefile
+++ /dev/null
@@ -1,40 +0,0 @@
-#!/bin/sh
-TOPDIR=../..
-
-CFLAGS=-g -ggdb -Wno-deprecated -fno-strict-aliasing -fno-omit-frame-pointer
-INCLUDE=-I${TOPDIR}/include
-LIB=-L${TOPDIR}/lib64 -lrocketmq -lz -lrt -lpthread
-TARGET=Producer AsyncProducer PullConsumer PushConsumer
-DEPEND_OBJ=Common.o
-
-
-LOCAL_SRC += $(sort $(wildcard *.cpp *.cc *.c))
-LOCAL_OBJ += $(patsubst %.cpp,%.o, $(patsubst %.cc,%.o, $(patsubst %.c,%.o, $(LOCAL_SRC))))
-
-all:${LOCAL_OBJ} ${TARGET}
- @echo "build succ!"
-
-clean:
- rm -vf ${TARGET} *.o
- @echo "clean succ!"
-
-Producer:Producer.o ${DEPEND_OBJ}
- $(CXX) $(CFLAGS) -o $@ $^ $(INCLUDE) $(LIB)
-
-AsyncProducer:AsyncProducer.o ${DEPEND_OBJ}
- $(CXX) $(CFLAGS) -o $@ $^ $(INCLUDE) $(LIB)
-
-PullConsumer:PullConsumer.o ${DEPEND_OBJ}
- $(CXX) $(CFLAGS) -o $@ $^ $(INCLUDE) $(LIB)
-
-PushConsumer:PushConsumer.o ${DEPEND_OBJ}
- $(CXX) $(CFLAGS) -o $@ $^ $(INCLUDE) $(LIB)
-
-%.o: %.cpp
- $(CXX) $(CFLAGS) $(INCLUDE) -o $@ -c $<
-
-%.o: %.cc
- $(CXX) $(CFLAGS) $(INCLUDE) -o $@ -c $<
-
-%.o: %.c
- $(CC) $(CFLAGS) $(INCLUDE) -o $@ -c $<
diff --git a/rocketmq-client4cpp/example/demo/Producer.cpp b/rocketmq-client4cpp/example/demo/Producer.cpp
deleted file mode 100644
index 9905e0b6..00000000
--- a/rocketmq-client4cpp/example/demo/Producer.cpp
+++ /dev/null
@@ -1,199 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "Common.h"
-#include "DefaultMQProducer.h"
-using namespace rmq;
-
-void Usage(const char* program)
-{
- printf("Usage:%s ip:port [-g group] [-t topic] [-n count] [-s size] [-w logpath]\n", program);
- printf("\t -g group\n");
- printf("\t -t topic\n");
- printf("\t -n message count\n");
- printf("\t -s message size \n");
- printf("\t -w log path\n");
-}
-
-int main(int argc, char* argv[])
-{
- if (argc < 2)
- {
- Usage(argv[0]);
- return 0;
- }
-
- std::string namesrv = argv[1];
- std::string group = "pg_test_group";
- std::string topic = "topic_test";
- int size = 32;
- int count = 1000;
-
- for (int i=2; i< argc; i++)
- {
- if (strcmp(argv[i],"-g")==0)
- {
- if (i+1 < argc)
- {
- group = argv[i+1];
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-t")==0)
- {
- if (i+1 < argc)
- {
- topic = argv[i+1];
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-n")==0)
- {
- if (i+1 < argc)
- {
- count = atoi(argv[i+1]);
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-s")==0)
- {
- if (i+1 < argc)
- {
- size = atoi(argv[i+1]);
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-w")==0)
- {
- if (i+1 < argc)
- {
- MyUtil::initLog(argv[i+1]);
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
-
- // init client api log, here is not necessary, need to debug the api need to be initialized, you can consider comment it
- // Here only the default print warning, error log, the log will be rolling by day, if you need to modify the log level, please set the environment variable, export ROCKETMQ_LOGLEVEL = loglevel
- // The log level is as follows:
- // 0 - close the log
- // 1 - write error log
- // 2 - write error, warning log
- // 3 - write error, warning, info log
- // 4 - write errors, warnings, info, debug logs
- RocketMQUtil::initLog("/tmp/rocketmq_producer.log");
-
- RMQ_DEBUG("producer.new: %s", group.c_str());
- DefaultMQProducer producer(group);
-
- RMQ_DEBUG("producer.setNamesrvAddr: %s", namesrv.c_str());
- producer.setNamesrvAddr(namesrv);
-
- RMQ_DEBUG("producer.start");
- producer.start();
-
- std::string tags[] = { "TagA", "TagB", "TagC", "TagD", "TagE" };
-
- int _cost = 0, _tps = 0, _avg = 0, _min = 0, _max = 0;
- int _failCnt = 0;
- TimeCount tc;
- TimeCount tcTotal;
- tcTotal.begin();
-
- int nNow = time(NULL);
- char key[64];
- char value[1024];
-
- std::string str;
- for (int i = 0; i < size; i += 8)
- {
- str.append("hello baby");
- }
-
- for (int i = 0; i < count; i++)
- {
- try
- {
-
- tc.begin();
-
- snprintf(key, sizeof(key), "KEY_%d_%d", nNow, i);
- snprintf(value, sizeof(value), "%011d_%s", i, str.c_str());
- Message msg(topic,// topic
- tags[i % 5],// tag
- key,// key
- value,// body
- strlen(value)+1
- );
-
- // Send messages synchronously
- SendResult sendResult = producer.send(msg);
-
- tc.end();
-
- int cost = tc.countMsec();
- _min = (_min == 0) ? cost : (std::min(cost, _min));
- _max = (_max == 0) ? cost : (std::max(cost, _max));
-
- MYLOG("[%d]|succ|cost:%dms, result:%s\n", i, cost, sendResult.toString().c_str());
- }
- catch (MQClientException& e)
- {
- _failCnt++;
- MYLOG("[%d]|fail|%s\n", i, e.what());
- }
- }
- tcTotal.end();
-
- MYDEBUG("statsics: num=%d, fail=%d, total_cost=%ds, tps=%d, avg=%dms, min=%dms, max=%dms\n",
- count, _failCnt, tcTotal.countSec(), (int)((double)count/(tcTotal.countMsec()/1000)),
- tcTotal.countMsec()/count, _min, _max);
-
- // 停止生产者
- producer.shutdown();
-
- return 0;
-}
-
diff --git a/rocketmq-client4cpp/example/demo/PullConsumer.cpp b/rocketmq-client4cpp/example/demo/PullConsumer.cpp
deleted file mode 100755
index 3fae6dc2..00000000
--- a/rocketmq-client4cpp/example/demo/PullConsumer.cpp
+++ /dev/null
@@ -1,194 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "Common.h"
-#include "DefaultMQPullConsumer.h"
-using namespace rmq;
-
-volatile long long g_totalCnt = 0;
-
-void PrintResult(PullResult& result)
-{
- std::list<MessageExt*>::iterator it = result.msgFoundList.begin();
- for (;it!=result.msgFoundList.end();it++)
- {
- MessageExt* me = *it;
- std::string str;
- str.assign(me->getBody(),me->getBodyLen());
-
- int cnt = __sync_fetch_and_add(&g_totalCnt, 1);
- MYLOG("[%d]|%s|%s\n", cnt, me->toString().c_str(), str.c_str());
- }
-}
-
-
-void Usage(const char* program)
-{
- printf("Usage:%s ip:port [-g group] [-t topic] [-w logpath]\n", program);
- printf("\t -g consumer group\n");
- printf("\t -t topic\n");
- printf("\t -w log path\n");
-}
-
-
-int main(int argc, char* argv[])
-{
- if (argc<2)
- {
- Usage(argv[0]);
- return 0;
- }
-
- std::string namesrv = argv[1];
- std::string group = "cg_test_pull_group";
- std::string topic = "topic_test";
-
- for (int i=2; i< argc; i++)
- {
- if (strcmp(argv[i],"-g")==0)
- {
- if (i+1 < argc)
- {
- group = argv[i+1];
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-t")==0)
- {
- if (i+1 < argc)
- {
- topic = argv[i+1];
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-w")==0)
- {
- if (i+1 < argc)
- {
- MyUtil::initLog(argv[i+1]);
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
-
- // init client api log, here is not necessary, need to debug the api need to be initialized, you can consider comment it
- // Here only the default print warning, error log, the log will be rolling by day, if you need to modify the log level, please set the environment variable, export ROCKETMQ_LOGLEVEL = loglevel
- // The log level is as follows:
- // 0 - close the log
- // 1 - write error log
- // 2 - write error, warning log
- // 3 - write error, warning, info log
- // 4 - write errors, warnings, info, debug logs
- RocketMQUtil::initLog("/tmp/rocketmq_pullconsumer.log");
-
- RMQ_DEBUG("consumer.new: %s", group.c_str());
- DefaultMQPullConsumer consumer(group);
-
- RMQ_DEBUG("consumer.setNamesrvAddr: %s", namesrv.c_str());
- consumer.setNamesrvAddr(namesrv);
-
- RMQ_DEBUG("consumer.setMessageModel: %s", getMessageModelString(CLUSTERING));
- consumer.setMessageModel(CLUSTERING);
-
- consumer.setConsumerPullTimeoutMillis(4000);
- consumer.setBrokerSuspendMaxTimeMillis(3000);
- consumer.setConsumerTimeoutMillisWhenSuspend(5000);
-
- RMQ_DEBUG("consumer.start");
- consumer.start();
-
- RMQ_DEBUG("consumer.fetchSubscribeMessageQueues");
- std::set<MessageQueue>* mqs = consumer.fetchSubscribeMessageQueues(topic);
-
- std::set<MessageQueue>::iterator it = mqs->begin();
- for (; it!=mqs->end(); it++)
- {
- MessageQueue mq = *it;
- bool noNewMsg = false;
- while (!noNewMsg)
- {
- try
- {
- RMQ_DEBUG("consumer.fetchConsumeOffset");
- long long offset = consumer.fetchConsumeOffset(mq, false);
- if (offset < 0)
- {
- offset = consumer.maxOffset(mq);
- if (offset < 0)
- {
- offset = LLONG_MAX;
- }
- }
-
- RMQ_DEBUG("consumer.pullBlockIfNotFound");
- //PullResult* pullResult = consumer.pullBlockIfNotFound(mq, "*", offset, 32);
- PullResult* pullResult = consumer.pull(mq, "*", offset, 32);
- PrintResult(*pullResult);
-
- RMQ_DEBUG("consumer.updateConsumeOffset");
- consumer.updateConsumeOffset(mq, pullResult->nextBeginOffset);
-
- switch (pullResult->pullStatus)
- {
- case FOUND:
- // TODO
- break;
- case NO_MATCHED_MSG:
- break;
- case NO_NEW_MSG:
- noNewMsg = true;
- break;
- case OFFSET_ILLEGAL:
- break;
- default:
- break;
- }
-
- delete pullResult;
- }
- catch (MQException& e)
- {
- std::cout<<e<<std::endl;
- }
- }
- }
- delete mqs;
-
- RMQ_DEBUG("consumer.shutdown");
- consumer.shutdown();
-
- return 0;
-}
diff --git a/rocketmq-client4cpp/example/demo/PushConsumer.cpp b/rocketmq-client4cpp/example/demo/PushConsumer.cpp
deleted file mode 100755
index 1a8bfed9..00000000
--- a/rocketmq-client4cpp/example/demo/PushConsumer.cpp
+++ /dev/null
@@ -1,256 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "Common.h"
-#include "DefaultMQPushConsumer.h"
-using namespace rmq;
-
-volatile long long g_lastCnt = 0;
-volatile long long g_totalCnt = 0;
-long long g_lastUpdateTime = 0;
-
-static std::string bin2str(const std::string& strBin)
-{
- if(strBin.size() == 0)
- {
- return "";
- }
-
- std::string sOut;
- const char *p = (const char *)strBin.data();
- size_t len = strBin.size();
-
- char sBuf[255];
- for (size_t i = 0; i < len; ++i, ++p)
- {
- snprintf(sBuf, sizeof(sBuf), "%02x", (unsigned char) *p);
- sOut += sBuf;
- }
-
- return sOut;
-}
-
-
-class MsgListener : public MessageListenerConcurrently
-{
-public:
- MsgListener()
- {
- consumeTimes = 0;
- }
-
- ~MsgListener()
- {
-
- }
-
- /**
- * consume messages
- * ！！！Notice：multi-thread call, need to pay attention to dealing with multi-threaded re-entry problem
- * @param msgs message list
- * @param context context for consumer
- * @return [CONSUME_SUCCESS- success，RECONSUME_LATER-consume fail and retry later]
- */
- ConsumeConcurrentlyStatus consumeMessage(std::list<MessageExt*>& msgs,
- ConsumeConcurrentlyContext& context)
- {
- int cnt = __sync_fetch_and_add(&g_totalCnt, 1);
- long long now = MyUtil::getNowMs();
- long long old = g_lastUpdateTime;
- if ((now - old) >= 1000)
- {
- if (__sync_bool_compare_and_swap(&g_lastUpdateTime, old, now))
- {
- long long time = now - old;
- int tps = (int)((g_totalCnt - g_lastCnt) * 1.0 / time * 1000.0);
- g_lastCnt = g_totalCnt;
-
- MYDEBUG("[consume]msgcount: %lld, TPS: %d\n", g_totalCnt, tps);
- }
- }
-
-
- MessageExt* msg = msgs.front();
- long long offset = msg->getQueueOffset();
- std::string maxOffset = msg->getProperty(Message::PROPERTY_MAX_OFFSET);
-
- long long diff = MyUtil::str2ll(maxOffset.c_str()) - offset;
- if (diff > 100000)
- {
- if (diff % 10000 == 0)
- {
- MYDEBUG("overload, offset:%lld, diff:%lld\n", offset, diff);
- }
- // return CONSUME_SUCCESS;
- }
-
- std::list<MessageExt*>::iterator it = msgs.begin();
- for (;it != msgs.end();it++)
- {
- MessageExt* me = *it;
- std::string str;
- str.assign(me->getBody(),me->getBodyLen());
-
- MYLOG("[%d]|%s|%s\n", cnt, me->toString().c_str(), str.c_str());
- }
-
- consumeTimes++;
-
- /*
- if ((consumeTimes % 2) == 0)
- {
- return RECONSUME_LATER;
- }
- else if ((consumeTimes % 3) == 0)
- {
- context.delayLevelWhenNextConsume = 5;
- return RECONSUME_LATER;
- }
- */
-
- // context.ackIndex = msgs.size() - 1;
- return CONSUME_SUCCESS;
- }
-
- int consumeTimes;
-};
-
-
-void Usage(const char* program)
-{
- printf("Usage:%s ip:port [-g group] [-t topic] [-w logpath]\n", program);
- printf("\t -g consumer group\n");
- printf("\t -t topic\n");
- printf("\t -w log path\n");
-}
-
-
-int main(int argc, char* argv[])
-{
- if (argc < 2)
- {
- Usage(argv[0]);
- return 0;
- }
-
- std::string namesrv = argv[1];
- std::string group = "cg_test_push_group";
- std::string topic = "topic_test";
- for (int i=2; i< argc; i++)
- {
- if (strcmp(argv[i],"-g")==0)
- {
- if (i+1 < argc)
- {
- group = argv[i+1];
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-t")==0)
- {
- if (i+1 < argc)
- {
- topic = argv[i+1];
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else if (strcmp(argv[i],"-w")==0)
- {
- if (i+1 < argc)
- {
- MyUtil::initLog(argv[i+1]);
- i++;
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
- else
- {
- Usage(argv[0]);
- return 0;
- }
- }
-
- // init client api log, here is not necessary, need to debug the api need to be initialized, you can consider comment it
- // Here only the default print warning, error log, the log will be rolling by day, if you need to modify the log level, please set the environment variable, export ROCKETMQ_LOGLEVEL = loglevel
- // The log level is as follows:
- // 0 - close the log
- // 1 - write error log
- // 2 - write error, warning log
- // 3 - write error, warning, info log
- // 4 - write errors, warnings, info, debug logs
- RocketMQUtil::initLog("/tmp/rocketmq_pushconsumer.log");
-
- RMQ_DEBUG("consumer.new: %s", group.c_str());
- DefaultMQPushConsumer consumer(group);
-
- RMQ_DEBUG("consumer.setNamesrvAddr: %s", namesrv.c_str());
- consumer.setNamesrvAddr(namesrv);
-
- RMQ_DEBUG("consumer.setMessageModel: %s", getMessageModelString(CLUSTERING));
- consumer.setMessageModel(CLUSTERING);
-
- RMQ_DEBUG("consumer.subscribe");
- consumer.subscribe(topic, "*");
-
- consumer.setConsumeFromWhere(CONSUME_FROM_LAST_OFFSET);
-
- // Set the number of each consumption message, the default is 1
- // consumer.setConsumeMessageBatchMaxSize(1);
-
- // The number of consumer thread pool, the default minimum 5, the maximum 25, the proposed set to the same, more stable
- // consumer.setConsumeThreadMin(25);
- // consumer.setConsumeThreadMax(25);
-
- // Single message consume timeout, default is 15 minutes
- // When the consumption times out, message will be send back to the retry queue and re-delivered
- // consumer.setConsumeTimeout(15);
-
- RMQ_DEBUG("consumer.registerMessageListener");
- MsgListener* listener = new MsgListener();
- consumer.registerMessageListener(listener);
-
- RMQ_DEBUG("consumer.start");
- consumer.start();
-
- while(1)
- {
- if (getchar()=='e'&&getchar()=='x'&&getchar()=='i'&&getchar()=='t')
- {
- break;
- }
- ::sleep(1);
- }
-
- RMQ_DEBUG("consumer.shutdown");
- consumer.shutdown();
- delete listener;
-
- return 0;
-}
diff --git a/rocketmq-client4cpp/include/AllocateMessageQueueStrategy.h b/rocketmq-client4cpp/include/AllocateMessageQueueStrategy.h
deleted file mode 100755
index fc10072b..00000000
--- a/rocketmq-client4cpp/include/AllocateMessageQueueStrategy.h
+++ /dev/null
@@ -1,54 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_ALLOCATEMESSAGEQUEUESTRATEGY_H__
-#define __RMQ_ALLOCATEMESSAGEQUEUESTRATEGY_H__
-
-#include <vector>
-#include <string>
-#include <list>
-
-#include "RocketMQClient.h"
-#include "MessageQueue.h"
-
-namespace rmq
-{
- /**
- * Consumer Queue Automatic Assignment Policy
- *
- */
- class AllocateMessageQueueStrategy
- {
- public:
- virtual ~AllocateMessageQueueStrategy() {}
-
- /**
- * Assign queues to the current ConsumerId
- *
- * @param [currentCID] Current ConsumerId
- * @param [mqAll] All queues of the current Topic, no duplicate data, and orderly
- * @param [cidAll] All subscription groups for the current subscription group, without duplication of data, and orderly
- * @return allocation results, no duplicate data
- */
- virtual std::vector<MessageQueue>* allocate(
- const std::string& consumerGroup,
- const std::string& currentCID,
- std::vector<MessageQueue>& mqAll,
- std::list<std::string>& cidAll)=0;
- virtual std::string getName()=0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/ClientConfig.h b/rocketmq-client4cpp/include/ClientConfig.h
deleted file mode 100755
index ca368307..00000000
--- a/rocketmq-client4cpp/include/ClientConfig.h
+++ /dev/null
@@ -1,75 +0,0 @@
-/**
- * Copyright (C) 2010-2013 kangliqiang <ka...@163.com>
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __RMQ_CLIENTCONFIG_H__
-#define __RMQ_CLIENTCONFIG_H__
-
-#include <string>
-#include "RocketMQClient.h"
-
-namespace rmq
-{
- /**
- * Producer and Consumer common configuration
- *
- */
- class ClientConfig
- {
- public:
- ClientConfig();
- virtual ~ClientConfig();
-
- std::string buildMQClientId();
- void changeInstanceNameToPID();
-
- void resetClientConfig(const ClientConfig& cc);
- ClientConfig cloneClientConfig();
-
- std::string getNamesrvAddr();
- void setNamesrvAddr(const std::string& namesrvAddr);
-
- std::string getClientIP();
- void setClientIP(const std::string& clientIP);
-
- std::string getInstanceName();
- void setInstanceName(const std::string& instanceName);
-
- int getClientCallbackExecutorThreads();
- void setClientCallbackExecutorThreads(int clientCallbackExecutorThreads);
-
- int getPollNameServerInterval();
-
- void setPollNameServerInterval(int pollNameServerInterval);
-
- int getHeartbeatBrokerInterval();
- void setHeartbeatBrokerInterval(int heartbeatBrokerInterval);
-
- int getPersistConsumerOffsetInterval();
- void setPersistConsumerOffsetInterval(int persistConsumerOffsetInterval);
-
- std::string toString() const;
-
- private:
- int m_clientCallbackExecutorThreads;
- int m_pollNameServerInterval;
- int m_heartbeatBrokerInterval;
- int m_persistConsumerOffsetInterval;
- std::string m_clientIP;
- std::string m_instanceName;
- std::string m_namesrvAddr;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/ConsumeMessageHook.h b/rocketmq-client4cpp/include/ConsumeMessageHook.h
deleted file mode 100644
index c13e6c71..00000000
--- a/rocketmq-client4cpp/include/ConsumeMessageHook.h
+++ /dev/null
@@ -1,45 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_CONSUMEMESSAGEHOOK_H__
-#define __RMQ_CONSUMEMESSAGEHOOK_H__
-
-#include <list>
-
-#include "RocketMQClient.h"
-#include "MessageQueue.h"
-
-namespace rmq
-{
- typedef struct
- {
- std::string consumerGroup;
- std::list<MessageExt*> msgList;
- MessageQueue mq;
- bool success;
- void* arg;
- } ConsumeMessageContext;
-
- class ConsumeMessageHook
- {
- public:
- virtual ~ConsumeMessageHook() {}
- virtual std::string hookName()=0;
- virtual void consumeMessageBefore(const ConsumeMessageContext& context)=0;
- virtual void consumeMessageAfter(const ConsumeMessageContext& context)=0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/ConsumeType.h b/rocketmq-client4cpp/include/ConsumeType.h
deleted file mode 100755
index a4748ab9..00000000
--- a/rocketmq-client4cpp/include/ConsumeType.h
+++ /dev/null
@@ -1,56 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_CONSUMETYPE_H__
-#define __RMQ_CONSUMETYPE_H__
-
-#include "RocketMQClient.h"
-
-namespace rmq
-{
- enum ConsumeType
- {
- /**
- * Active comsume
- */
- CONSUME_ACTIVELY,
- /**
- * Passive comsume
- */
- CONSUME_PASSIVELY,
- };
-
- enum ConsumeFromWhere
- {
- CONSUME_FROM_LAST_OFFSET,
- CONSUME_FROM_LAST_OFFSET_AND_FROM_MIN_WHEN_BOOT_FIRST,
- CONSUME_FROM_MIN_OFFSET,
- CONSUME_FROM_MAX_OFFSET,
- CONSUME_FROM_FIRST_OFFSET,
- CONSUME_FROM_TIMESTAMP,
- };
-
- enum MessageModel
- {
- BROADCASTING,
- CLUSTERING,
- };
-
- const char* getConsumeTypeString(ConsumeType type);
- const char* getConsumeFromWhereString(ConsumeFromWhere type);
- const char* getMessageModelString(MessageModel type);
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/DefaultMQProducer.h b/rocketmq-client4cpp/include/DefaultMQProducer.h
deleted file mode 100755
index 9bf2f74d..00000000
--- a/rocketmq-client4cpp/include/DefaultMQProducer.h
+++ /dev/null
@@ -1,129 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RMQ_DEFAULTMQPRODUCER_H__
-#define __RMQ_DEFAULTMQPRODUCER_H__
-
-#include <string>
-#include <list>
-#include <vector>
-
-#include "RocketMQClient.h"
-#include "MQClientException.h"
-#include "Message.h"
-#include "SendResult.h"
-#include "ClientConfig.h"
-#include "MQProducer.h"
-
-namespace rmq
-{
- class MessageQueue;
- class MessageQueueSelector;
- class MQClientException;
- class Message;
- class DefaultMQProducerImpl;
-
- /**
- * Message producer
- *
- */
- class DefaultMQProducer : public ClientConfig ,public MQProducer
- {
- public:
- DefaultMQProducer();
- DefaultMQProducer(const std::string& producerGroup);
- ~DefaultMQProducer();
-
- //begin MQProducer
- void start();
- void shutdown();
-
- std::vector<MessageQueue>* fetchPublishMessageQueues(const std::string& topic);
-
- SendResult send(Message& msg);
- SendResult send(Message& msg, MessageQueue& mq);
- SendResult send(Message& msg, MessageQueueSelector* selector, void* arg);
- void send(Message& msg, SendCallback* pSendCallback);
- void send(Message& msg, MessageQueue& mq, SendCallback* pSendCallback);
- void send(Message& msg, MessageQueueSelector* selector, void* arg, SendCallback* pSendCallback);
- void sendOneway(Message& msg);
- void sendOneway(Message& msg, MessageQueue& mq);
- void sendOneway(Message& msg, MessageQueueSelector* selector, void* arg);
-
- TransactionSendResult sendMessageInTransaction(Message& msg,
- LocalTransactionExecuter* pTranExecuter,
- void* arg);
- //end MQProducer
-
- void createTopic(const std::string& key, const std::string& newTopic, int queueNum) ;
- long long searchOffset(const MessageQueue& mq, long long timestamp);
- long long maxOffset(const MessageQueue& mq);
- long long minOffset(const MessageQueue& mq);
- long long earliestMsgStoreTime(const MessageQueue& mq);
- MessageExt* viewMessage(const std::string& msgId) ;
- QueryResult queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end);
-
- std::string getProducerGroup();
- void setProducerGroup(const std::string& producerGroup);
-
- std::string getCreateTopicKey();
- void setCreateTopicKey(const std::string& createTopicKey);
-
- int getSendMsgTimeout();
- void setSendMsgTimeout(int sendMsgTimeout) ;
-
- int getCompressMsgBodyOverHowmuch();
- void setCompressMsgBodyOverHowmuch(int compressMsgBodyOverHowmuch);
-
- int getCompressLevel();
- void setCompressLevel(int compressLevel);
-
- DefaultMQProducerImpl* getDefaultMQProducerImpl();
-
- bool isRetryAnotherBrokerWhenNotStoreOK();
- void setRetryAnotherBrokerWhenNotStoreOK(bool retryAnotherBrokerWhenNotStoreOK);
-
- int getMaxMessageSize();
- void setMaxMessageSize(int maxMessageSize);
-
- int getDefaultTopicQueueNums();
- void setDefaultTopicQueueNums(int defaultTopicQueueNums);
-
- int getRetryTimesWhenSendFailed();
- void setRetryTimesWhenSendFailed(int retryTimesWhenSendFailed);
-
- protected:
- DefaultMQProducerImpl* m_pDefaultMQProducerImpl;
-
- private:
- std::string m_producerGroup;
- std::string m_createTopicKey;
-
- int m_defaultTopicQueueNums;
- int m_sendMsgTimeout;
- int m_compressMsgBodyOverHowmuch;
- int m_retryTimesWhenSendFailed;
- bool m_retryAnotherBrokerWhenNotStoreOK;
- int m_maxMessageSize;
- int m_compressLevel;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/DefaultMQPullConsumer.h b/rocketmq-client4cpp/include/DefaultMQPullConsumer.h
deleted file mode 100755
index d9952c5e..00000000
--- a/rocketmq-client4cpp/include/DefaultMQPullConsumer.h
+++ /dev/null
@@ -1,154 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RMQ_DEFAULTMQPULLCONSUMER_H__
-#define __RMQ_DEFAULTMQPULLCONSUMER_H__
-
-#include <list>
-#include <string>
-
-#include "RocketMQClient.h"
-#include "MQClientException.h"
-#include "MessageQueue.h"
-#include "MessageExt.h"
-#include "ClientConfig.h"
-#include "MQPullConsumer.h"
-
-namespace rmq
-{
- class OffsetStore;
- class DefaultMQPullConsumerImpl;
- class AllocateMessageQueueStrategy;
-
- /**
- * Pull Consumer
- *
- */
- class DefaultMQPullConsumer : public ClientConfig , public MQPullConsumer
- {
- public:
- DefaultMQPullConsumer();
- DefaultMQPullConsumer(const std::string& consumerGroup);
- ~DefaultMQPullConsumer();
-
- //MQAdmin
- void createTopic(const std::string& key, const std::string& newTopic, int queueNum);
- long long searchOffset(const MessageQueue& mq, long long timestamp);
- long long maxOffset(const MessageQueue& mq);
- long long minOffset(const MessageQueue& mq);
- long long earliestMsgStoreTime(const MessageQueue& mq);
- MessageExt* viewMessage(const std::string& msgId);
- QueryResult queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end);
- // MQadmin end
-
- AllocateMessageQueueStrategy* getAllocateMessageQueueStrategy();
- void setAllocateMessageQueueStrategy(AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy);
- int getBrokerSuspendMaxTimeMillis() ;
- void setBrokerSuspendMaxTimeMillis(int brokerSuspendMaxTimeMillis);
- std::string getConsumerGroup();
- void setConsumerGroup(const std::string& consumerGroup);
- int getConsumerPullTimeoutMillis();
- void setConsumerPullTimeoutMillis(int consumerPullTimeoutMillis);
- int getConsumerTimeoutMillisWhenSuspend() ;
- void setConsumerTimeoutMillisWhenSuspend(int consumerTimeoutMillisWhenSuspend);
- MessageModel getMessageModel();
- void setMessageModel(MessageModel messageModel);
- MessageQueueListener* getMessageQueueListener();
- void setMessageQueueListener(MessageQueueListener* pMessageQueueListener);
- std::set<std::string> getRegisterTopics();
- void setRegisterTopics( std::set<std::string> registerTopics);
-
- //MQConsumer
- void sendMessageBack(MessageExt& msg, int delayLevel);
- void sendMessageBack(MessageExt& msg, int delayLevel, const std::string& brokerName);
- std::set<MessageQueue>* fetchSubscribeMessageQueues(const std::string& topic);
- void start();
- void shutdown() ;
- //MQConsumer end
-
- //MQPullConsumer
- void registerMessageQueueListener(const std::string& topic, MessageQueueListener* pListener);
- PullResult* pull(MessageQueue& mq, const std::string& subExpression, long long offset,int maxNums);
- void pull(MessageQueue& mq,
- const std::string& subExpression,
- long long offset,
- int maxNums,
- PullCallback* pPullCallback);
-
- PullResult* pullBlockIfNotFound(MessageQueue& mq,
- const std::string& subExpression,
- long long offset,
- int maxNums);
-
- void pullBlockIfNotFound(MessageQueue& mq,
- const std::string& subExpression,
- long long offset,
- int maxNums,
- PullCallback* pPullCallback);
-
- void updateConsumeOffset(MessageQueue& mq, long long offset);
-
- long long fetchConsumeOffset(MessageQueue& mq, bool fromStore);
-
- std::set<MessageQueue>* fetchMessageQueuesInBalance(const std::string& topic);
- //MQPullConsumer end
-
- OffsetStore* getOffsetStore();
- void setOffsetStore(OffsetStore* offsetStore);
-
- DefaultMQPullConsumerImpl* getDefaultMQPullConsumerImpl();
-
- bool isUnitMode();
- void setUnitMode(bool isUnitMode);
-
- int getMaxReconsumeTimes();
- void setMaxReconsumeTimes(int maxReconsumeTimes);
-
- protected:
- DefaultMQPullConsumerImpl* m_pDefaultMQPullConsumerImpl;
-
- private:
- std::string m_consumerGroup;
- int m_brokerSuspendMaxTimeMillis ;
-
- int m_consumerTimeoutMillisWhenSuspend;
- int m_consumerPullTimeoutMillis;
-
- MessageModel m_messageModel;
- MessageQueueListener* m_pMessageQueueListener;
-
- OffsetStore* m_pOffsetStore;
-
- std::set<std::string> m_registerTopics;
- AllocateMessageQueueStrategy* m_pAllocateMessageQueueStrategy;
-
- /**
- * Whether the unit of subscription group
- */
- bool m_unitMode;
-
- /**
- * max retry times��default is 15
- */
- int m_maxReconsumeTimes;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/DefaultMQPushConsumer.h b/rocketmq-client4cpp/include/DefaultMQPushConsumer.h
deleted file mode 100755
index 25ef4fbb..00000000
--- a/rocketmq-client4cpp/include/DefaultMQPushConsumer.h
+++ /dev/null
@@ -1,181 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_DEFAULTMQPUSHCONSUMER_H__
-#define __RMQ_DEFAULTMQPUSHCONSUMER_H__
-
-#include <list>
-#include <string>
-
-#include "RocketMQClient.h"
-#include "MQClientException.h"
-#include "Message.h"
-#include "MessageExt.h"
-#include "MessageQueue.h"
-#include "MessageListener.h"
-#include "PullResult.h"
-#include "ClientConfig.h"
-#include "MQPushConsumer.h"
-
-namespace rmq
-{
- class AllocateMessageQueueStrategy;
- class DefaultMQPushConsumerImpl;
- class OffsetStore;
-
- /**
- * Push Consumer
- *
- */
- class DefaultMQPushConsumer : public ClientConfig ,public MQPushConsumer
- {
- public:
- DefaultMQPushConsumer();
- DefaultMQPushConsumer(const std::string& consumerGroup);
- ~DefaultMQPushConsumer();
-
- //MQAdmin
- void createTopic(const std::string& key, const std::string& newTopic, int queueNum);
- long long searchOffset(const MessageQueue& mq, long long timestamp);
- long long maxOffset(const MessageQueue& mq);
- long long minOffset(const MessageQueue& mq);
- long long earliestMsgStoreTime(const MessageQueue& mq);
- MessageExt* viewMessage(const std::string& msgId);
- QueryResult queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end);
-
- // MQadmin end
-
- AllocateMessageQueueStrategy* getAllocateMessageQueueStrategy();
- void setAllocateMessageQueueStrategy(AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy);
-
- int getConsumeConcurrentlyMaxSpan();
- void setConsumeConcurrentlyMaxSpan(int consumeConcurrentlyMaxSpan);
-
- ConsumeFromWhere getConsumeFromWhere();
- void setConsumeFromWhere(ConsumeFromWhere consumeFromWhere);
-
- int getConsumeMessageBatchMaxSize();
- void setConsumeMessageBatchMaxSize(int consumeMessageBatchMaxSize);
-
- std::string getConsumerGroup();
- void setConsumerGroup(const std::string& consumerGroup) ;
-
- int getConsumeThreadMax() ;
- void setConsumeThreadMax(int consumeThreadMax);
-
- int getConsumeThreadMin();
- void setConsumeThreadMin(int consumeThreadMin);
-
- MessageListener* getMessageListener();
- void setMessageListener(MessageListener* pMessageListener);
-
- MessageModel getMessageModel();
- void setMessageModel(MessageModel messageModel) ;
-
- int getPullBatchSize() ;
- void setPullBatchSize(int pullBatchSize);
-
- long getPullInterval();
- void setPullInterval(long pullInterval);
-
- int getPullThresholdForQueue();
- void setPullThresholdForQueue(int pullThresholdForQueue);
-
- std::map<std::string, std::string>& getSubscription();
- void setSubscription(const std::map<std::string, std::string>& subscription);
-
- //MQConsumer
- void sendMessageBack(MessageExt& msg, int delayLevel);
- void sendMessageBack(MessageExt& msg, int delayLevel, const std::string brokerName);
- std::set<MessageQueue>* fetchSubscribeMessageQueues(const std::string& topic);
-
- void start();
- void shutdown();
- //MQConsumer end
-
- //MQPushConsumer
- void registerMessageListener(MessageListener* pMessageListener);
-
- void subscribe(const std::string& topic, const std::string& subExpression);
- void unsubscribe(const std::string& topic);
-
- void updateCorePoolSize(int corePoolSize);
-
- void suspend() ;
- void resume();
- //MQPushConsumer end
-
- OffsetStore* getOffsetStore();
- void setOffsetStore(OffsetStore* offsetStore);
-
- std::string getConsumeTimestamp();
- void setConsumeTimestamp(std::string consumeTimestamp);
-
- DefaultMQPushConsumerImpl* getDefaultMQPushConsumerImpl();
-
- bool isPostSubscriptionWhenPull();
- void setPostSubscriptionWhenPull(bool postSubscriptionWhenPull);
-
- bool isUnitMode();
- void setUnitMode(bool isUnitMode);
-
- int getMaxReconsumeTimes();
- void setMaxReconsumeTimes(int maxReconsumeTimes);
-
- int getSuspendCurrentQueueTimeMillis();
- void setSuspendCurrentQueueTimeMillis(int suspendCurrentQueueTimeMillis);
-
- int getConsumeTimeout();
- void setConsumeTimeout(int consumeTimeout);
-
- protected:
- DefaultMQPushConsumerImpl* m_pDefaultMQPushConsumerImpl;
-
- private:
- std::string m_consumerGroup;
- MessageModel m_messageModel;
- ConsumeFromWhere m_consumeFromWhere;
- std::string m_consumeTimestamp;
-
- AllocateMessageQueueStrategy* m_pAllocateMessageQueueStrategy ;
- std::map<std::string /* topic */, std::string /* sub expression */> m_subscription ;
-
- MessageListener* m_pMessageListener;
- OffsetStore* m_pOffsetStore;
-
- int m_consumeThreadMin;
- int m_consumeThreadMax;
-
- int m_consumeConcurrentlyMaxSpan;
- int m_pullThresholdForQueue;
- long m_pullInterval;
-
- int m_consumeMessageBatchMaxSize;
- int m_pullBatchSize;
-
- bool m_postSubscriptionWhenPull;
- bool m_unitMode;
- int m_maxReconsumeTimes;
-
- long m_suspendCurrentQueueTimeMillis;
- long m_consumeTimeout;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/MQAdmin.h b/rocketmq-client4cpp/include/MQAdmin.h
deleted file mode 100755
index 552a468d..00000000
--- a/rocketmq-client4cpp/include/MQAdmin.h
+++ /dev/null
@@ -1,66 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RMQ_MQADMIN_H__
-#define __RMQ_MQADMIN_H__
-
-#include <string>
-
-#include "RocketMQClient.h"
-#include "MessageExt.h"
-
-namespace rmq
-{
- class MQClientException;
- class RemotingException;
- class MQBrokerException;
- class InterruptedException;
- class MessageQueue;
- class QueryResult;
-
- /**
- * MQ Admin
- *
- */
- class MQAdmin
- {
- public:
- MQAdmin()
- {
- }
-
- virtual ~MQAdmin()
- {
- }
-
- virtual void createTopic(const std::string& key, const std::string& newTopic, int queueNum)=0;
-
- virtual long long searchOffset(const MessageQueue& mq, long long timestamp)=0;
- virtual long long maxOffset(const MessageQueue& mq)=0;
- virtual long long minOffset(const MessageQueue& mq)=0;
-
- virtual long long earliestMsgStoreTime(const MessageQueue& mq)=0;
-
- virtual MessageExt* viewMessage(const std::string& msgId)=0;
- virtual QueryResult queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end)=0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/MQClientException.h b/rocketmq-client4cpp/include/MQClientException.h
deleted file mode 100755
index f1d1d045..00000000
--- a/rocketmq-client4cpp/include/MQClientException.h
+++ /dev/null
@@ -1,105 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-#ifndef __RMQ_MQCLIENTEXCEPTION_H__
-#define __RMQ_MQCLIENTEXCEPTION_H__
-
-#include <string>
-#include <ostream>
-#include <sstream>
-#include <exception>
-
-#include "RocketMQClient.h"
-
-namespace rmq
-{
- class MQException : public std::exception
- {
- public:
- MQException(const std::string& msg, int error,const char* file,int line)throw()
- : m_error(error),m_line(line),m_file(file)
- {
- try
- {
- std::stringstream ss;
- ss << "[" << file << ":" << line <<"]|error: " << error << "|msg:" << msg;
- m_msg = ss.str();
- }
- catch (...)
- {
- }
- }
-
- virtual ~MQException()throw()
- {
- }
-
- const char* what() const throw()
- {
- return m_msg.c_str();
- }
-
- int GetError() const throw()
- {
- return m_error;
- }
-
- virtual const char* GetType() const throw()
- {
- return "MQException";
- }
-
- protected:
- int m_error;
- int m_line;
- std::string m_msg;
- std::string m_file;
- };
-
- inline std::ostream& operator<<(std::ostream& os, const MQException& e)
- {
- os <<"Type:"<<e.GetType() << e.what();
- return os;
- }
-
- #define DEFINE_MQCLIENTEXCEPTION(name, parent) \
- class name : public parent \
- {\
- public:\
- name(const std::string& msg, int error,const char* file,int line) throw ()\
- : parent(msg, error, file, line) {}\
- virtual const char* GetType() const throw()\
- {\
- return #name;\
- }\
- };
-
- DEFINE_MQCLIENTEXCEPTION(MQClientException, MQException)
- DEFINE_MQCLIENTEXCEPTION(MQBrokerException, MQException)
- DEFINE_MQCLIENTEXCEPTION(InterruptedException, MQException)
- DEFINE_MQCLIENTEXCEPTION(UnknownHostException, MQException)
-
- DEFINE_MQCLIENTEXCEPTION(RemotingException, MQException)
- DEFINE_MQCLIENTEXCEPTION(RemotingCommandException, RemotingException)
- DEFINE_MQCLIENTEXCEPTION(RemotingConnectException, RemotingException)
- DEFINE_MQCLIENTEXCEPTION(RemotingSendRequestException, RemotingException)
- DEFINE_MQCLIENTEXCEPTION(RemotingTimeoutException, RemotingException)
- DEFINE_MQCLIENTEXCEPTION(RemotingTooMuchRequestException, RemotingException)
-
- #define THROW_MQEXCEPTION(e,msg,err) throw e(msg,err,__FILE__,__LINE__)
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/MQConsumer.h b/rocketmq-client4cpp/include/MQConsumer.h
deleted file mode 100755
index 87efe977..00000000
--- a/rocketmq-client4cpp/include/MQConsumer.h
+++ /dev/null
@@ -1,48 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RMQ_MQCONSUMER_H__
-#define __RMQ_MQCONSUMER_H__
-
-#include <set>
-#include <string>
-
-#include "RocketMQClient.h"
-#include "MQAdmin.h"
-#include "ConsumeType.h"
-
-
-namespace rmq
-{
- class MessageExt;
-
- /**
- * Consumer interface
- *
- */
- class MQConsumer : public MQAdmin
- {
- public:
- virtual ~MQConsumer(){}
-
- virtual void start()=0;
- virtual void shutdown()=0;
-
- virtual void sendMessageBack(MessageExt& msg, int delayLevel)=0;
- virtual std::set<MessageQueue>* fetchSubscribeMessageQueues(const std::string& topic)=0;
- };
-}
-#endif
diff --git a/rocketmq-client4cpp/include/MQProducer.h b/rocketmq-client4cpp/include/MQProducer.h
deleted file mode 100755
index b353aba5..00000000
--- a/rocketmq-client4cpp/include/MQProducer.h
+++ /dev/null
@@ -1,71 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License")=0;
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RMQ_MQPRODUCER_H__
-#define __RMQ_MQPRODUCER_H__
-
-#include <vector>
-#include <string>
-
-#include "RocketMQClient.h"
-#include "MQAdmin.h"
-#include "SendResult.h"
-
-namespace rmq
-{
- class MessageQueue;
- class SendCallback;
- class LocalTransactionExecuter;
- class MessageQueueSelector;
-
- /**
- * Producer interface
- *
- */
- class MQProducer : public MQAdmin
- {
- public:
- MQProducer()
- {
- }
-
- virtual ~MQProducer()
- {
- }
-
- virtual void start()=0;
- virtual void shutdown()=0;
-
- virtual std::vector<MessageQueue>* fetchPublishMessageQueues(const std::string& topic)=0;
-
- virtual SendResult send(Message& msg)=0;
- virtual void send(Message& msg, SendCallback* sendCallback)=0;
- virtual void sendOneway(Message& msg)=0;
-
- virtual SendResult send(Message& msg, MessageQueue& mq)=0;
- virtual void send(Message& msg, MessageQueue& mq, SendCallback* sendCallback)=0;
- virtual void sendOneway(Message& msg, MessageQueue& mq)=0;
-
- virtual SendResult send(Message& msg, MessageQueueSelector* selector, void* arg)=0;
- virtual void send(Message& msg, MessageQueueSelector* selector, void* arg, SendCallback* sendCallback)=0;
- virtual void sendOneway(Message& msg, MessageQueueSelector* selector, void* arg)=0;
-
- virtual TransactionSendResult sendMessageInTransaction(Message& msg,
- LocalTransactionExecuter* tranExecuter,
- void* arg)=0;
- };
-}
-#endif
diff --git a/rocketmq-client4cpp/include/MQPullConsumer.h b/rocketmq-client4cpp/include/MQPullConsumer.h
deleted file mode 100755
index ffb2ac5f..00000000
--- a/rocketmq-client4cpp/include/MQPullConsumer.h
+++ /dev/null
@@ -1,54 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_MQPULLCONSUMER_H__
-#define __RMQ_MQPULLCONSUMER_H__
-
-#include <set>
-#include <string>
-
-#include "RocketMQClient.h"
-#include "MQConsumer.h"
-#include "PullResult.h"
-
-namespace rmq
-{
- class MessageQueueListener;
- class MessageQueue;
- class PullCallback;
-
- /**
- * Pull Consumer
- *
- */
- class MQPullConsumer : public MQConsumer
- {
- public:
- virtual ~MQPullConsumer(){}
- virtual void registerMessageQueueListener(const std::string& topic, MessageQueueListener* pListener)=0;
-
- virtual PullResult* pull(MessageQueue& mq, const std::string& subExpression, long long offset,int maxNums)=0;
- virtual void pull(MessageQueue& mq, const std::string& subExpression, long long offset, int maxNums, PullCallback* pPullCallback)=0;
-
- virtual PullResult* pullBlockIfNotFound(MessageQueue& mq, const std::string& subExpression, long long offset, int maxNums)=0;
- virtual void pullBlockIfNotFound(MessageQueue& mq, const std::string& subExpression, long long offset, int maxNums, PullCallback* pPullCallback)=0;
-
- virtual void updateConsumeOffset(MessageQueue& mq, long long offset)=0;
- virtual long long fetchConsumeOffset(MessageQueue& mq, bool fromStore)=0;
-
- virtual std::set<MessageQueue>* fetchMessageQueuesInBalance(const std::string& topic)=0;
- };
-}
-#endif
diff --git a/rocketmq-client4cpp/include/MQPushConsumer.h b/rocketmq-client4cpp/include/MQPushConsumer.h
deleted file mode 100755
index fe6d4a0c..00000000
--- a/rocketmq-client4cpp/include/MQPushConsumer.h
+++ /dev/null
@@ -1,49 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_MQPUSHCONSUMER_H__
-#define __RMQ_MQPUSHCONSUMER_H__
-
-#include <set>
-#include <string>
-
-#include "RocketMQClient.h"
-#include "MQConsumer.h"
-#include "PullResult.h"
-
-namespace rmq
-{
- class MessageListener;
-
- /**
- * Push Consumer
- *
- */
- class MQPushConsumer : public MQConsumer
- {
- public:
- virtual void registerMessageListener(MessageListener* pMessageListener)=0;
-
-
- virtual void subscribe(const std::string& topic, const std::string& subExpression)=0;
- virtual void unsubscribe(const std::string& topic)=0;
-
-
- virtual void updateCorePoolSize(int corePoolSize)=0;
- virtual void suspend()=0;
- virtual void resume()=0;
- };
-}
-#endif
diff --git a/rocketmq-client4cpp/include/Message.h b/rocketmq-client4cpp/include/Message.h
deleted file mode 100755
index 441b4e5a..00000000
--- a/rocketmq-client4cpp/include/Message.h
+++ /dev/null
@@ -1,136 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RMQ_MESSAGE_H__
-#define __RMQ_MESSAGE_H__
-
-#include <map>
-#include <string>
-#include <list>
-#include "RocketMQClient.h"
-
-namespace rmq
-{
- /**
- * Message
- *
- */
- class Message
- {
- public:
- Message();
- Message(const std::string& topic, const char* body,int len);
- Message(const std::string& topic, const std::string& tags, const char* body,int len);
- Message(const std::string& topic, const std::string& tags,const std::string& keys, const char* body,int len);
- Message(const std::string& topic,
- const std::string& tags,
- const std::string& keys,
- const int flag,
- const char* body,
- int len,
- bool waitStoreMsgOK);
-
- virtual ~Message();
- Message(const Message& other);
- Message& operator=(const Message& other);
-
- void clearProperty(const std::string& name);
- void putProperty(const std::string& name, const std::string& value);
- std::string getProperty(const std::string& name);
-
- std::string getTopic()const;
- void setTopic(const std::string& topic);
-
- std::string getTags();
- void setTags(const std::string& tags);
-
- std::string getKeys();
- void setKeys(const std::string& keys);
- void setKeys(const std::list<std::string> keys);
-
- int getDelayTimeLevel();
- void setDelayTimeLevel(int level);
-
- bool isWaitStoreMsgOK();
- void setWaitStoreMsgOK(bool waitStoreMsgOK);
-
- int getFlag();
- void setFlag(int flag);
-
- const char* getBody() const;
- int getBodyLen() const;
- void setBody(const char* body, int len);
-
- bool tryToCompress(int compressLevel);
- const char* getCompressBody() const;
- int getCompressBodyLen() const;
-
- std::map<std::string, std::string>& getProperties();
- void setProperties(const std::map<std::string, std::string>& properties);
-
- std::string toString() const;
-
- protected:
- void Init(const std::string& topic,
- const std::string& tags,
- const std::string& keys,
- const int flag,
- const char* body,
- int len,
- bool waitStoreMsgOK);
-
- public:
- static const std::string PROPERTY_KEYS;
- static const std::string PROPERTY_TAGS;
- static const std::string PROPERTY_WAIT_STORE_MSG_OK;
- static const std::string PROPERTY_DELAY_TIME_LEVEL;
-
- /**
- * for inner use
- */
- static const std::string PROPERTY_RETRY_TOPIC;
- static const std::string PROPERTY_REAL_TOPIC;
- static const std::string PROPERTY_REAL_QUEUE_ID;
- static const std::string PROPERTY_TRANSACTION_PREPARED;
- static const std::string PROPERTY_PRODUCER_GROUP;
- static const std::string PROPERTY_MIN_OFFSET;
- static const std::string PROPERTY_MAX_OFFSET;
- static const std::string PROPERTY_BUYER_ID;
- static const std::string PROPERTY_ORIGIN_MESSAGE_ID;
- static const std::string PROPERTY_TRANSFER_FLAG;
- static const std::string PROPERTY_CORRECTION_FLAG;
- static const std::string PROPERTY_MQ2_FLAG;
- static const std::string PROPERTY_RECONSUME_TIME;
- static const std::string PROPERTY_MSG_REGION;
- static const std::string PROPERTY_UNIQ_CLIENT_MESSAGE_ID_KEYIDX;
- static const std::string PROPERTY_MAX_RECONSUME_TIMES;
- static const std::string PROPERTY_CONSUME_START_TIMESTAMP;
-
- static const std::string KEY_SEPARATOR;
- private:
- std::string m_topic;
- int m_flag;
- std::map<std::string, std::string> m_properties;
-
- char* m_body;
- int m_bodyLen;
-
- char* m_compressBody;
- int m_compressBodyLen;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/MessageExt.h b/rocketmq-client4cpp/include/MessageExt.h
deleted file mode 100755
index f70041c3..00000000
--- a/rocketmq-client4cpp/include/MessageExt.h
+++ /dev/null
@@ -1,108 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_MESSAGEEXT_H__
-#define __RMQ_MESSAGEEXT_H__
-
-#include <sys/socket.h>
-#include <string>
-#include "Message.h"
-#include "TopicFilterType.h"
-#include "RocketMQClient.h"
-
-namespace rmq
- {
- /**
- * Message extend
- *
- */
- class MessageExt : public Message
- {
- public:
- MessageExt();
-
- MessageExt(int queueId,
- long long bornTimestamp,
- sockaddr bornHost,
- long long storeTimestamp,
- sockaddr storeHost,
- std::string msgId);
-
- ~MessageExt();
-
- static TopicFilterType parseTopicFilterType(int sysFlag);
-
- int getQueueId();
- void setQueueId(int queueId);
-
- long long getBornTimestamp();
- void setBornTimestamp(long long bornTimestamp);
-
- sockaddr getBornHost();
- std::string getBornHostString();
- std::string getBornHostNameString();
- void setBornHost(const sockaddr& bornHost);
-
- long long getStoreTimestamp();
- void setStoreTimestamp(long long storeTimestamp);
-
- sockaddr getStoreHost();
- std::string getStoreHostString();
- void setStoreHost(const sockaddr& storeHost);
-
- std::string getMsgId();
- void setMsgId(const std::string& msgId);
-
- int getSysFlag();
- void setSysFlag(int sysFlag);
-
- int getBodyCRC();
- void setBodyCRC(int bodyCRC);
-
- long long getQueueOffset();
- void setQueueOffset(long long queueOffset);
-
- long long getCommitLogOffset();
- void setCommitLogOffset(long long physicOffset);
-
- int getStoreSize();
- void setStoreSize(int storeSize);
-
- int getReconsumeTimes();
- void setReconsumeTimes(int reconsumeTimes);
-
- long long getPreparedTransactionOffset();
- void setPreparedTransactionOffset(long long preparedTransactionOffset);
-
- std::string toString() const;
-
- private:
- long long m_queueOffset;
- long long m_commitLogOffset;
- long long m_bornTimestamp;
- long long m_storeTimestamp;
- long long m_preparedTransactionOffset;
- int m_queueId;
- int m_storeSize;
- int m_sysFlag;
- int m_bodyCRC;
- int m_reconsumeTimes;
- sockaddr m_bornHost;
- sockaddr m_storeHost;
- std::string m_msgId;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/MessageListener.h b/rocketmq-client4cpp/include/MessageListener.h
deleted file mode 100755
index 130a2198..00000000
--- a/rocketmq-client4cpp/include/MessageListener.h
+++ /dev/null
@@ -1,94 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RMQ_MESSAGELISTENER_H__
-#define __RMQ_MESSAGELISTENER_H__
-
-#include <limits.h>
-#include <list>
-
-#include "MessageExt.h"
-#include "MessageQueue.h"
-
-namespace rmq
-{
- /**
- * Message Listener
- *
- */
- class MessageListener
- {
- public:
- virtual ~MessageListener(){}
- };
-
- enum ConsumeOrderlyStatus
- {
- SUCCESS,
- ROLLBACK,
- COMMIT,
- SUSPEND_CURRENT_QUEUE_A_MOMENT,
- };
-
- typedef struct tagConsumeOrderlyContext
- {
- tagConsumeOrderlyContext(MessageQueue& mq)
- :messageQueue(mq),
- autoCommit(true),
- suspendCurrentQueueTimeMillis(1000)
- {
- }
-
- MessageQueue messageQueue;///< Ҫ���ѵ���Ϣ�����ĸ�����
- bool autoCommit;///< ��ϢOffset�Ƿ��Զ��ύ
- long suspendCurrentQueueTimeMillis;
- }ConsumeOrderlyContext;
-
- class MessageListenerOrderly : public MessageListener
- {
- public:
- virtual ConsumeOrderlyStatus consumeMessage(std::list<MessageExt*>& msgs,
- ConsumeOrderlyContext& context)=0;
- };
-
- enum ConsumeConcurrentlyStatus
- {
- CONSUME_SUCCESS,
- RECONSUME_LATER,
- };
-
- struct ConsumeConcurrentlyContext
- {
- ConsumeConcurrentlyContext(MessageQueue& mq)
- :messageQueue(mq),
- delayLevelWhenNextConsume(0),
- ackIndex(INT_MAX)
- {
- }
- MessageQueue messageQueue;
- int delayLevelWhenNextConsume;
- int ackIndex;
- };
-
- class MessageListenerConcurrently : public MessageListener
- {
- public:
- virtual ConsumeConcurrentlyStatus consumeMessage(std::list<MessageExt*>& msgs,
- ConsumeConcurrentlyContext& context)=0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/MessageQueue.h b/rocketmq-client4cpp/include/MessageQueue.h
deleted file mode 100755
index 89ddf58b..00000000
--- a/rocketmq-client4cpp/include/MessageQueue.h
+++ /dev/null
@@ -1,70 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RMQ_MESSAGEQUEUE_H__
-#define __RMQ_MESSAGEQUEUE_H__
-
-#include <iostream>
-#include <string>
-#include <sstream>
-
-#include "RocketMQClient.h"
-
-namespace rmq
-{
- /**
- * Message Queue
- *
- */
- class MessageQueue
- {
- public:
- MessageQueue();
- ~MessageQueue(){};
-
- MessageQueue(const std::string& topic, const std::string& brokerName, int queueId);
-
- std::string getTopic()const;
- void setTopic(const std::string& topic);
-
- std::string getBrokerName()const;
- void setBrokerName(const std::string& brokerName);
-
- int getQueueId()const;
- void setQueueId(int queueId);
-
- int hashCode();
- std::string toString() const;
- std::string toJsonString() const;
-
- bool operator==(const MessageQueue& mq) const;
- bool operator<(const MessageQueue& mq) const;
- int compareTo(const MessageQueue& mq) const;
-
- private:
- std::string m_topic;
- std::string m_brokerName;
- int m_queueId;
- };
-
- inline std::ostream& operator<<(std::ostream& os, const MessageQueue& obj)
- {
- os << obj.toString();
- return os;
- }
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/MessageQueueListener.h b/rocketmq-client4cpp/include/MessageQueueListener.h
deleted file mode 100755
index 9f04c3ef..00000000
--- a/rocketmq-client4cpp/include/MessageQueueListener.h
+++ /dev/null
@@ -1,38 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __RMQ_MESSAGEQUEUELISTENER_H__
-#define __RMQ_MESSAGEQUEUELISTENER_H__
-
-#include <set>
-#include "RocketMQClient.h"
-
-namespace rmq
-{
- /**
- * Message Queue Listener
- *
- */
- class MessageQueueListener
- {
- public:
- virtual ~MessageQueueListener() {}
- virtual void messageQueueChanged(const std::string& topic,
- std::set<MessageQueue>& mqAll,
- std::set<MessageQueue>& mqDivided)=0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/OffsetStore.h b/rocketmq-client4cpp/include/OffsetStore.h
deleted file mode 100755
index a533750f..00000000
--- a/rocketmq-client4cpp/include/OffsetStore.h
+++ /dev/null
@@ -1,58 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_OFFSETSTORE_H__
-#define __RMQ_OFFSETSTORE_H__
-
-#include <set>
-#include <map>
-
-#include "RocketMQClient.h"
-
-namespace rmq
-{
- class MessageQueue;
-
- enum ReadOffsetType
- {
- READ_FROM_MEMORY,
- READ_FROM_STORE,
- MEMORY_FIRST_THEN_STORE,
- };
-
- /**
- * Consumer Offset Store
- *
- */
- class OffsetStore
- {
- public:
- virtual ~OffsetStore() {}
-
- virtual void load()=0;
-
- virtual void updateOffset(const MessageQueue& mq, long long offset, bool increaseOnly)=0;
- virtual long long readOffset(const MessageQueue& mq, ReadOffsetType type)=0;
-
- virtual void persistAll(std::set<MessageQueue>& mqs)=0;
- virtual void persist(const MessageQueue& mq)=0;
-
- virtual void removeOffset(const MessageQueue& mq)=0;
-
- virtual std::map<MessageQueue, long long> cloneOffsetTable(const std::string& topic) = 0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/PullCallback.h b/rocketmq-client4cpp/include/PullCallback.h
deleted file mode 100755
index 47ade682..00000000
--- a/rocketmq-client4cpp/include/PullCallback.h
+++ /dev/null
@@ -1,39 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __RMQ_PULLCALLBACK_H__
-#define __RMQ_PULLCALLBACK_H__
-
-#include "RocketMQClient.h"
-#include "PullResult.h"
-
-namespace rmq
-{
- class MQException;
-
- /**
- * PullCallback
- *
- */
- class PullCallback
- {
- public:
- virtual ~PullCallback() {}
- virtual void onSuccess(PullResult& pullResult)=0;
- virtual void onException(MQException& e)=0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/PullResult.h b/rocketmq-client4cpp/include/PullResult.h
deleted file mode 100755
index 42c13ca2..00000000
--- a/rocketmq-client4cpp/include/PullResult.h
+++ /dev/null
@@ -1,91 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_PULLRESULT_H__
-#define __RMQ_PULLRESULT_H__
-
-#include <list>
-#include <string>
-#include <sstream>
-
-#include "RocketMQClient.h"
-#include "MessageExt.h"
-
-namespace rmq
-{
- enum PullStatus
- {
- FOUND,
- NO_NEW_MSG,
- NO_MATCHED_MSG,
- OFFSET_ILLEGAL
- };
-
- /**
- * PullResult
- *
- */
- struct PullResult
- {
- PullResult()
- {
-
- }
-
- PullResult(PullStatus pullStatus,
- long long nextBeginOffset,
- long long minOffset,
- long long maxOffset,
- std::list<MessageExt*>& msgFoundList)
- :pullStatus(pullStatus),
- nextBeginOffset(nextBeginOffset),
- minOffset(minOffset),
- maxOffset(maxOffset),
- msgFoundList(msgFoundList)
- {
-
- }
-
- ~PullResult()
- {
- std::list<MessageExt*>::iterator it = msgFoundList.begin();
-
- for (;it!=msgFoundList.end();it++)
- {
- delete *it;
- }
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{pullStatus=" << pullStatus
- << ",nextBeginOffset=" << nextBeginOffset
- << ",minOffset=" << nextBeginOffset
- << ",maxOffset=" << nextBeginOffset
- << ",msgFoundList.size=" << msgFoundList.size()
- <<"}";
- return ss.str();
- }
-
- PullStatus pullStatus;
- long long nextBeginOffset;
- long long minOffset;
- long long maxOffset;
- std::list<MessageExt*> msgFoundList;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/QueryResult.h b/rocketmq-client4cpp/include/QueryResult.h
deleted file mode 100644
index 13164e42..00000000
--- a/rocketmq-client4cpp/include/QueryResult.h
+++ /dev/null
@@ -1,56 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RMQ_QUERYRESULT_H__
-#define __RMQ_QUERYRESULT_H__
-
-#include <list>
-
-#include "RocketMQClient.h"
-#include "MessageExt.h"
-
-namespace rmq
-{
- /**
- * QueryResult
- *
- */
- class QueryResult
- {
- public:
- QueryResult(long long indexLastUpdateTimestamp, const std::list<MessageExt*>& messageList)
- {
- m_indexLastUpdateTimestamp = indexLastUpdateTimestamp;
- m_messageList = messageList;
- }
-
- long long getIndexLastUpdateTimestamp()
- {
- return m_indexLastUpdateTimestamp;
- }
-
- std::list<MessageExt*>& getMessageList()
- {
- return m_messageList;
- }
-
- private:
- long long m_indexLastUpdateTimestamp;
- std::list<MessageExt*> m_messageList;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/RocketMQClient.h b/rocketmq-client4cpp/include/RocketMQClient.h
deleted file mode 100755
index e4c71c9e..00000000
--- a/rocketmq-client4cpp/include/RocketMQClient.h
+++ /dev/null
@@ -1,100 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_ROCKETMQCLIENT_H__
-#define __RMQ_ROCKETMQCLIENT_H__
-
-#include <stdlib.h>
-#include <stdio.h>
-#include <stdint.h>
-#include <string.h>
-#include <assert.h>
-#include <time.h>
-#include <stdarg.h>
-#include <fcntl.h>
-#include <errno.h>
-#include <signal.h>
-#include <pthread.h>
-
-#include <sys/time.h>
-#include <sys/timeb.h>
-#include <sys/types.h>
-#include <sys/stat.h>
-#include <sys/file.h>
-#include <sys/syscall.h>
-#include <linux/unistd.h>
-
-#include <cstdio>
-#include <iostream>
-#include <string>
-#include <sstream>
-#include <vector>
-#include <map>
-#include <set>
-
-
-class RocketMQUtil
-{
-public:
- enum
- {
- NONE_LOG = 0,
- ERROR_LOG = 1,
- WARN_LOG = 2,
- INFO_LOG = 3,
- DEBUG_LOG = 4,
- };
-
-public:
- static pid_t getPid();
- static pid_t getTid();
-
- static int getDiffDays(time_t tmFirst, time_t tmSecond);
- static std::string tm2str(const time_t &t, const std::string &sFormat);
- static std::string now2str(const std::string &sFormat);
- static std::string now2str();
- static int64_t getNowMs();
- static std::string str2fmt(const char* format, ...)__attribute__((format(__printf__,1,2)));
-
- static int initLog(const std::string& sLogPath);
- static void setLogLevel(int logLevel);
- static void writeLog(const char* fmt, ...) __attribute__((format(__printf__,1,2)));
- static inline bool isNeedLog(int level)
- {
- return (level <= _logLevel);
- };
-
-public:
- static volatile int _logFd;
- static int _logLevel;
- static std::string _logPath;
-};
-
-#define RMQ_AUTO(name, value) typeof(value) name = value
-#define RMQ_FOR_EACH(container, it) \
- for(typeof((container).begin()) it = (container).begin();it!=(container).end(); ++it)
-
-
-
-#define RMQ_DEBUG(fmt, args...) do{ if(RocketMQUtil::isNeedLog(RocketMQUtil::DEBUG_LOG)) RocketMQUtil::writeLog("%d-%d|[%s][%s:%s:%d][DEBUG]|"fmt"\n", RocketMQUtil::getPid(), RocketMQUtil::getTid(), RocketMQUtil::now2str().c_str(), __FILE__, __func__,__LINE__, ##args);}while(0)
-#define RMQ_INFO(fmt, args...) do{ if(RocketMQUtil::isNeedLog(RocketMQUtil::INFO_LOG)) RocketMQUtil::writeLog("%d-%d|[%s][%s:%s:%d][INFO]|"fmt"\n", RocketMQUtil::getPid(), RocketMQUtil::getTid(), RocketMQUtil::now2str().c_str(), __FILE__, __func__, __LINE__, ##args);}while(0)
-#define RMQ_WARN(fmt, args...) do{ if(RocketMQUtil::isNeedLog(RocketMQUtil::WARN_LOG)) RocketMQUtil::writeLog("%d-%d|[%s][%s:%s:%d][WARN]|"fmt"\n", RocketMQUtil::getPid(), RocketMQUtil::getTid(), RocketMQUtil::now2str().c_str(), __FILE__, __func__, __LINE__, ##args);}while(0)
-#define RMQ_ERROR(fmt, args...) do{ if(RocketMQUtil::isNeedLog(RocketMQUtil::ERROR_LOG)) RocketMQUtil::writeLog("%d-%d|[%s][%s:%s:%d][ERROR]|"fmt"\n", RocketMQUtil::getPid(), RocketMQUtil::getTid(), RocketMQUtil::now2str().c_str(), __FILE__, __func__, __LINE__, ##args);}while(0)
-
-#define RMQ_PRINT(fmt, args...) do{ printf("%d|[%s][%s:%s:%d][DEBUG]|"fmt"\n", RocketMQUtil::getTid(), RocketMQUtil::now2str().c_str(), __FILE__, __func__,__LINE__, ##args);}while(0)
-
-
-#endif
-
diff --git a/rocketmq-client4cpp/include/SendCallback.h b/rocketmq-client4cpp/include/SendCallback.h
deleted file mode 100755
index 0feb5a18..00000000
--- a/rocketmq-client4cpp/include/SendCallback.h
+++ /dev/null
@@ -1,39 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_SENDCALLBACK_H__
-#define __RMQ_SENDCALLBACK_H__
-
-#include "SendResult.h"
-#include "RocketMQClient.h"
-
-namespace rmq
-{
- class MQException;
-
- /**
- * Send Mesage Callback
- *
- */
- class SendCallback
- {
- public:
- virtual ~SendCallback() {}
- virtual void onSuccess(SendResult& sendResult)=0;
- virtual void onException(MQException& e)=0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/SendMessageHook.h b/rocketmq-client4cpp/include/SendMessageHook.h
deleted file mode 100644
index 9869aa6a..00000000
--- a/rocketmq-client4cpp/include/SendMessageHook.h
+++ /dev/null
@@ -1,50 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_SENDMESSAGEHOOK_H__
-#define __RMQ_SENDMESSAGEHOOK_H__
-
-#include <string>
-
-#include "RocketMQClient.h"
-#include "Message.h"
-#include "MQClientException.h"
-
-namespace rmq
-{
- class SendMessageContext
- {
- public:
- std::string producerGroup;
- Message msg;
- MessageQueue mq;
- std::string brokerAddr;
- CommunicationMode communicationMode;
- SendResult sendResult;
- MQException* pException;
- void* pArg;
- };
-
- class SendMessageHook
- {
- public:
- virtual ~SendMessageHook() {}
- virtual std::string hookName()=0;
- virtual void sendMessageBefore(const SendMessageContext& context)=0;
- virtual void sendMessageAfter(const SendMessageContext& context)=0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/SendResult.h b/rocketmq-client4cpp/include/SendResult.h
deleted file mode 100755
index d6a31745..00000000
--- a/rocketmq-client4cpp/include/SendResult.h
+++ /dev/null
@@ -1,89 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __RMQ_SENDRESULT_H__
-#define __RMQ_SENDRESULT_H__
-
-#include "RocketMQClient.h"
-#include "MessageQueue.h"
-
-namespace rmq
-{
- enum SendStatus
- {
- SEND_OK,
- FLUSH_DISK_TIMEOUT,
- FLUSH_SLAVE_TIMEOUT,
- SLAVE_NOT_AVAILABLE
- };
-
- /**
- * Send Message Result
- *
- */
- class SendResult
- {
- public:
- SendResult();
- SendResult(const SendStatus& sendStatus,
- const std::string& msgId,
- MessageQueue& messageQueue,
- long long queueOffset,
- std::string& projectGroupPrefix);
-
- const std::string& getMsgId();
- void setMsgId(const std::string& msgId);
- SendStatus getSendStatus();
- void setSendStatus(const SendStatus& sendStatus);
- MessageQueue& getMessageQueue();
- void setMessageQueue(MessageQueue& messageQueue);
- long long getQueueOffset();
- void setQueueOffset(long long queueOffset);
- bool hasResult();
-
- std::string toString() const;
- std::string toJsonString() const;
-
- private:
- SendStatus m_sendStatus;
- std::string m_msgId;
- MessageQueue m_messageQueue;
- long long m_queueOffset;
- };
-
- enum LocalTransactionState
- {
- COMMIT_MESSAGE,
- ROLLBACK_MESSAGE,
- UNKNOW,
- };
-
- /**
- * Send transaction message result
- *
- */
- class TransactionSendResult : public SendResult
- {
- public:
- TransactionSendResult();
- LocalTransactionState getLocalTransactionState();
- void setLocalTransactionState(LocalTransactionState localTransactionState);
-
- private:
- LocalTransactionState m_localTransactionState;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/include/TopicFilterType.h b/rocketmq-client4cpp/include/TopicFilterType.h
deleted file mode 100755
index e51ae20b..00000000
--- a/rocketmq-client4cpp/include/TopicFilterType.h
+++ /dev/null
@@ -1,32 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __RMQ_TOPICFILTERTYPE_H__
-#define __RMQ_TOPICFILTERTYPE_H__
-
-namespace rmq
-{
- /**
- * Topic filter type
- *
- */
- enum TopicFilterType
- {
- SINGLE_TAG,
- MULTI_TAG
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/rocketmq.mk b/rocketmq-client4cpp/rocketmq.mk
deleted file mode 100644
index eecc4582..00000000
--- a/rocketmq-client4cpp/rocketmq.mk
+++ /dev/null
@@ -1,6 +0,0 @@
-ROCKETMQ_PATH := /data/libs/rocketmq
-
-INCLUDE += -I$(ROCKETMQ_PATH)/include
-INCLUDE_32 += -I$(ROCKETMQ_PATH)/include -march=i686
-LIB_32 += -L$(ROCKETMQ_PATH)/lib32 -lrocketmq -lz -lrt -lpthread
-LIB_64 += -L$(ROCKETMQ_PATH)/lib64 -lrocketmq -lz -lrt -lpthread
diff --git a/rocketmq-client4cpp/src/ClientConfig.cpp b/rocketmq-client4cpp/src/ClientConfig.cpp
deleted file mode 100755
index 986d67da..00000000
--- a/rocketmq-client4cpp/src/ClientConfig.cpp
+++ /dev/null
@@ -1,168 +0,0 @@
-/**
- * Copyright (C) 2010-2013 kangliqiang, kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include <stdlib.h>
-#include <sstream>
-
-#include "MQClientException.h"
-#include "SocketUtil.h"
-#include "ClientConfig.h"
-#include "UtilAll.h"
-#include "MixAll.h"
-
-namespace rmq
-{
-
-ClientConfig::ClientConfig()
-{
- char* addr = getenv(MixAll::NAMESRV_ADDR_ENV.c_str());
- if (addr)
- {
- m_namesrvAddr = addr;
- }
- else
- {
- m_namesrvAddr = "";
- }
-
- m_clientIP = getLocalAddress();
- m_instanceName = "DEFAULT";
- m_clientCallbackExecutorThreads = UtilAll::availableProcessors();
- m_pollNameServerInterval = 1000 * 30;
- m_heartbeatBrokerInterval = 1000 * 30;
- m_persistConsumerOffsetInterval = 1000 * 5;
-}
-
-ClientConfig::~ClientConfig()
-{
-}
-
-std::string ClientConfig::buildMQClientId()
-{
- return m_clientIP + "@" + m_instanceName;
-}
-
-void ClientConfig::changeInstanceNameToPID()
-{
- if (m_instanceName == "DEFAULT")
- {
- m_instanceName = UtilAll::toString(UtilAll::getPid());
- }
-}
-
-
-void ClientConfig::resetClientConfig(const ClientConfig& cc)
-{
- m_namesrvAddr = cc.m_namesrvAddr;
- m_clientIP = cc.m_clientIP;
- m_instanceName = cc.m_instanceName;
- m_clientCallbackExecutorThreads = cc.m_clientCallbackExecutorThreads;
- m_pollNameServerInterval = cc.m_pollNameServerInterval;
- m_heartbeatBrokerInterval = cc.m_heartbeatBrokerInterval;
- m_persistConsumerOffsetInterval = cc.m_persistConsumerOffsetInterval;
-}
-
-ClientConfig ClientConfig::cloneClientConfig()
-{
- return *this;
-}
-
-std::string ClientConfig::getNamesrvAddr()
-{
- return m_namesrvAddr;
-}
-
-void ClientConfig::setNamesrvAddr(const std::string& namesrvAddr)
-{
- m_namesrvAddr = namesrvAddr;
-}
-
-std::string ClientConfig::getClientIP()
-{
- return m_clientIP;
-}
-
-void ClientConfig::setClientIP(const std::string& clientIP)
-{
- m_clientIP = clientIP;
-}
-
-std::string ClientConfig::getInstanceName()
-{
- return m_instanceName;
-}
-
-void ClientConfig::setInstanceName(const std::string& instanceName)
-{
- m_instanceName = instanceName;
-}
-
-int ClientConfig::getClientCallbackExecutorThreads()
-{
- return m_clientCallbackExecutorThreads;
-}
-
-void ClientConfig::setClientCallbackExecutorThreads(int clientCallbackExecutorThreads)
-{
- m_clientCallbackExecutorThreads = clientCallbackExecutorThreads;
-}
-
-int ClientConfig::getPollNameServerInterval()
-{
- return m_pollNameServerInterval;
-}
-
-void ClientConfig::setPollNameServerInterval(int pollNameServerInterval)
-{
- m_pollNameServerInterval = pollNameServerInterval;
-}
-
-int ClientConfig::getHeartbeatBrokerInterval()
-{
- return m_heartbeatBrokerInterval;
-}
-
-void ClientConfig::setHeartbeatBrokerInterval(int heartbeatBrokerInterval)
-{
- m_heartbeatBrokerInterval = heartbeatBrokerInterval;
-}
-
-int ClientConfig:: getPersistConsumerOffsetInterval()
-{
- return m_persistConsumerOffsetInterval;
-}
-
-void ClientConfig::setPersistConsumerOffsetInterval(int persistConsumerOffsetInterval)
-{
- m_persistConsumerOffsetInterval = persistConsumerOffsetInterval;
-}
-
-
-std::string ClientConfig::toString() const
-{
- std::stringstream ss;
- ss << "{namesrvAddr=" << m_namesrvAddr
- << ",clientIP=" << m_clientIP
- << ",instanceName=" << m_instanceName
- << ",clientCallbackExecutorThreads=" << m_clientCallbackExecutorThreads
- << ",pollNameServerInteval=" << m_pollNameServerInterval
- << ",heartbeatBrokerInterval=" << m_heartbeatBrokerInterval
- << ",persistConsumerOffsetInterval=" << m_persistConsumerOffsetInterval
- <<"}";
- return ss.str();
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/ClientRemotingProcessor.cpp b/rocketmq-client4cpp/src/ClientRemotingProcessor.cpp
deleted file mode 100755
index ae88de52..00000000
--- a/rocketmq-client4cpp/src/ClientRemotingProcessor.cpp
+++ /dev/null
@@ -1,154 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "ClientRemotingProcessor.h"
-#include "MQProtos.h"
-#include "TcpTransport.h"
-#include "RemotingCommand.h"
-#include "MQClientFactory.h"
-#include "CommandCustomHeader.h"
-#include "ConsumerRunningInfo.h"
-
-
-
-namespace rmq
-{
-
-ClientRemotingProcessor::ClientRemotingProcessor(MQClientFactory* pMQClientFactory)
- : m_pMQClientFactory(pMQClientFactory)
-{
-
-}
-
-RemotingCommand* ClientRemotingProcessor::processRequest(TcpTransport* pTts, RemotingCommand* pRequest)
-{
- int code = pRequest->getCode();
- switch (code)
- {
- case CHECK_TRANSACTION_STATE_VALUE:
- return checkTransactionState(pTts, pRequest);
- case NOTIFY_CONSUMER_IDS_CHANGED_VALUE:
- return notifyConsumerIdsChanged(pTts, pRequest);
- case RESET_CONSUMER_CLIENT_OFFSET_VALUE:
- return resetOffset(pTts, pRequest);
- case GET_CONSUMER_STATUS_FROM_CLIENT_VALUE:
- return getConsumeStatus(pTts, pRequest);
- case GET_CONSUMER_RUNNING_INFO_VALUE:
- return getConsumerRunningInfo(pTts, pRequest);
- case CONSUME_MESSAGE_DIRECTLY_VALUE:
- return consumeMessageDirectly(pTts, pRequest);
- default:
- break;
- }
-
- return NULL;
-}
-
-RemotingCommand* ClientRemotingProcessor::checkTransactionState(TcpTransport* pTts, RemotingCommand* pRequest)
-{
- //TODO
- return NULL;
-}
-
-RemotingCommand* ClientRemotingProcessor::notifyConsumerIdsChanged(TcpTransport* pTts, RemotingCommand* pRequest)
-{
- try
- {
- NotifyConsumerIdsChangedRequestHeader* extHeader = (NotifyConsumerIdsChangedRequestHeader*)pRequest->getCommandCustomHeader();
- RMQ_INFO("receive broker's notification[{%s}], the consumer group: {%s} changed, rebalance immediately",
- pTts->getServerAddr().c_str(),
- extHeader->consumerGroup.c_str());
- m_pMQClientFactory->rebalanceImmediately();
- }
- catch (std::exception& e)
- {
- RMQ_ERROR("notifyConsumerIdsChanged exception: %s", e.what());
- }
-
- return NULL;
-}
-
-RemotingCommand* ClientRemotingProcessor::resetOffset(TcpTransport* pTts, RemotingCommand* pRequest)
-{
- //TODO
- return NULL;
-}
-
-
-RemotingCommand* ClientRemotingProcessor::getConsumeStatus(TcpTransport* pTts, RemotingCommand* pRequest)
-{
- //TODO
- return NULL;
-}
-
-
-RemotingCommand* ClientRemotingProcessor::getConsumerRunningInfo(TcpTransport* pTts, RemotingCommand* pRequest)
-{
- return NULL;
-
- /*
- GetConsumerRunningInfoRequestHeader* requestHeader = (GetConsumerRunningInfoRequestHeader)pRequest->getCommandCustomHeader();
- RemotingCommand* pResponse = RemotingCommand::createResponseCommand(NULL);
-
- pResponse = RemotingCommand::createResponseCommand(
- REQUEST_CODE_NOT_SUPPORTED_VALUE, "request type not supported", NULL);
- pResponse->setOpaque(pCmd->getOpaque());
-
- ConsumerRunningInfo* consumerRunningInfo = m_pMQClientFactory->consumerRunningInfo(requestHeader->consumerGroup);
- if (NULL != consumerRunningInfo) {
- response.setCode(ResponseCode.SUCCESS);
- response.setBody(consumerRunningInfo.encode());
- } else {
- response.setCode(ResponseCode.SYSTEM_ERROR);
- response.setRemark(String.format("The Consumer Group <%s> not exist in this consumer",
- requestHeader.getConsumerGroup()));
- }
- return pResponse;
-
- // java
- final RemotingCommand response = RemotingCommand.createResponseCommand(null);
- final GetConsumerRunningInfoRequestHeader requestHeader =
- (GetConsumerRunningInfoRequestHeader) request
- .decodeCommandCustomHeader(GetConsumerRunningInfoRequestHeader.class);
-
- ConsumerRunningInfo consumerRunningInfo =
- this.mqClientFactory.consumerRunningInfo(requestHeader.getConsumerGroup());
- if (null != consumerRunningInfo) {
- if (requestHeader.isJstackEnable()) {
- String jstack = UtilAll.jstack();
- consumerRunningInfo.setJstack(jstack);
- }
-
- response.setCode(ResponseCode.SUCCESS);
- response.setBody(consumerRunningInfo.encode());
- } else {
- response.setCode(ResponseCode.SYSTEM_ERROR);
- response.setRemark(String.format("The Consumer Group <%s> not exist in this consumer",
- requestHeader.getConsumerGroup()));
- }
-
- return response;
- */
-}
-
-
-RemotingCommand* ClientRemotingProcessor::consumeMessageDirectly(TcpTransport* pTts, RemotingCommand* pRequest)
-{
- //TODO
- return NULL;
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/ClientRemotingProcessor.h b/rocketmq-client4cpp/src/ClientRemotingProcessor.h
deleted file mode 100755
index 4cd28733..00000000
--- a/rocketmq-client4cpp/src/ClientRemotingProcessor.h
+++ /dev/null
@@ -1,45 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __CLIENTREMOTINGPROCESSOR_H__
-#define __CLIENTREMOTINGPROCESSOR_H__
-
-#include "TcpRequestProcessor.h"
-
-namespace rmq
-{
- class MQClientFactory;
- class RemotingCommand;
-
- class ClientRemotingProcessor : public TcpRequestProcessor
- {
- public:
- ClientRemotingProcessor(MQClientFactory* pMQClientFactory);
-
- RemotingCommand* processRequest(TcpTransport* pTts, RemotingCommand* pRequest);
- RemotingCommand* checkTransactionState(TcpTransport* pTts, RemotingCommand* pRequest);
- RemotingCommand* notifyConsumerIdsChanged(TcpTransport* pTts, RemotingCommand* pRequest);
- RemotingCommand* resetOffset(TcpTransport* pTts, RemotingCommand* pRequest);
- RemotingCommand* getConsumeStatus(TcpTransport* pTts, RemotingCommand* pRequest);
- RemotingCommand* getConsumerRunningInfo(TcpTransport* pTts, RemotingCommand* pRequest);
- RemotingCommand* consumeMessageDirectly(TcpTransport* pTts, RemotingCommand* pRequest);
-
- private:
- MQClientFactory* m_pMQClientFactory;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/CommunicationMode.h b/rocketmq-client4cpp/src/CommunicationMode.h
deleted file mode 100755
index 43b29412..00000000
--- a/rocketmq-client4cpp/src/CommunicationMode.h
+++ /dev/null
@@ -1,34 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-#ifndef __COMMUNICATIONMODE_H__
-#define __COMMUNICATIONMODE_H__
-
-namespace rmq
-{
- /**
- * Communication Mode
- *
- */
- enum CommunicationMode
- {
- SYNC,
- ASYNC,
- ONEWAY
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/FindBrokerResult.h b/rocketmq-client4cpp/src/FindBrokerResult.h
deleted file mode 100644
index 51a9845e..00000000
--- a/rocketmq-client4cpp/src/FindBrokerResult.h
+++ /dev/null
@@ -1,28 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __FINDBROKERRESULT_H__
-#define __FINDBROKERRESULT_H__
-
-namespace rmq
-{
- typedef struct
- {
- std::string brokerAddr;
- bool slave;
- } FindBrokerResult;
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/MQAdminImpl.cpp b/rocketmq-client4cpp/src/MQAdminImpl.cpp
deleted file mode 100755
index 2a6b5979..00000000
--- a/rocketmq-client4cpp/src/MQAdminImpl.cpp
+++ /dev/null
@@ -1,295 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include <list>
-#include "SocketUtil.h"
-#include "MQAdminImpl.h"
-#include "MQClientFactory.h"
-#include "MQClientAPIImpl.h"
-#include "MQClientException.h"
-#include "TopicConfig.h"
-#include "TopicPublishInfo.h"
-#include "MessageId.h"
-#include "MessageDecoder.h"
-
-namespace rmq
-{
-
-
-MQAdminImpl::MQAdminImpl(MQClientFactory* pMQClientFactory)
-{
- m_pMQClientFactory = pMQClientFactory;
-}
-
-MQAdminImpl::~MQAdminImpl()
-{
-
-}
-
-void MQAdminImpl::createTopic(const std::string& key, const std::string& newTopic,
- int queueNum)
-{
- return createTopic(key, newTopic, queueNum, 0);
-}
-
-
-void MQAdminImpl::createTopic(const std::string& key, const std::string& newTopic,
- int queueNum, int topicSysFlag)
-{
- try
- {
- MQClientAPIImpl* api = m_pMQClientFactory->getMQClientAPIImpl();
- TopicRouteDataPtr topicRouteData = api->getTopicRouteInfoFromNameServer(key, 1000 * 3);
-
- std::list<BrokerData> brokerDataList = topicRouteData->getBrokerDatas();
- if (!brokerDataList.empty())
- {
- brokerDataList.sort();
-
- MQClientException exception("", 0, "", 0);
- bool hasException = false;
-
- std::list<BrokerData>::iterator it = brokerDataList.begin();
-
- for (; it != brokerDataList.end(); it++)
- {
- std::map<int, std::string>::iterator it1 = (*it).brokerAddrs.find(MixAll::MASTER_ID);
- if (it1 != (*it).brokerAddrs.end())
- {
- std::string addr = it1->second;
-
- TopicConfig topicConfig(newTopic);
- topicConfig.setReadQueueNums(queueNum);
- topicConfig.setWriteQueueNums(queueNum);
- topicConfig.setTopicSysFlag(topicSysFlag);
-
- try
- {
- api->createTopic(addr, key, topicConfig, 1000 * 3);
- }
- catch (MQClientException& e)
- {
- hasException = true;
- exception = e;
- }
- }
- }
-
- if (hasException)
- {
- throw exception;
- }
- }
- else
- {
- THROW_MQEXCEPTION(MQClientException, "Not found broker, maybe key is wrong", -1);
- }
- }
- catch (MQClientException e)
- {
- THROW_MQEXCEPTION(MQClientException, "create new topic failed", -1);
- }
-}
-
-std::vector<MessageQueue>* MQAdminImpl::fetchPublishMessageQueues(const std::string& topic)
-{
- try
- {
- MQClientAPIImpl* api = m_pMQClientFactory->getMQClientAPIImpl();
- TopicRouteDataPtr topicRouteData = api->getTopicRouteInfoFromNameServer(topic, 1000 * 3);
-
- if (topicRouteData.ptr() != NULL)
- {
- TopicPublishInfoPtr topicPublishInfo =
- MQClientFactory::topicRouteData2TopicPublishInfo(topic, *topicRouteData);
- if (topicPublishInfo.ptr() != NULL && topicPublishInfo->ok())
- {
- std::vector<MessageQueue>* ret = new std::vector<MessageQueue>();
- (*ret) = topicPublishInfo->getMessageQueueList();
-
- /*
- std::vector<MessageQueue>& mqs = ;
- std::vector<MessageQueue>::iterator it = mqs.begin();
- for (; it != mqs.end(); it++)
- {
- ret->push_back(*it);
- }
- */
-
- return ret;
- }
- }
- }
- catch (MQClientException e)
- {
- THROW_MQEXCEPTION(MQClientException, "Can not find Message Queue for this topic" + topic, -1);
- }
-
- THROW_MQEXCEPTION(MQClientException, "Unknow why, Can not find Message Queue for this topic, " + topic, -1);
-}
-
-std::set<MessageQueue>* MQAdminImpl::fetchSubscribeMessageQueues(const std::string& topic)
-{
- try
- {
- TopicRouteDataPtr topicRouteData =
- m_pMQClientFactory->getMQClientAPIImpl()->getTopicRouteInfoFromNameServer(topic, 1000 * 3);
- if (topicRouteData.ptr() != NULL)
- {
- std::set<MessageQueue>* mqList =
- MQClientFactory::topicRouteData2TopicSubscribeInfo(topic, *topicRouteData);
- if (!mqList->empty())
- {
- return mqList;
- }
- else
- {
- THROW_MQEXCEPTION(MQClientException, "Can not find Message Queue for this topic" + topic, -1);
- }
- }
- }
- catch (MQClientException e)
- {
- THROW_MQEXCEPTION(MQClientException, "Can not find Message Queue for this topic" + topic, -1);
- }
-
- THROW_MQEXCEPTION(MQClientException, "Unknow why, Can not find Message Queue for this topic: " + topic, -1);
-}
-
-long long MQAdminImpl::searchOffset(const MessageQueue& mq, long long timestamp)
-{
- std::string brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- if (brokerAddr.empty())
- {
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic());
- brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- }
-
- if (!brokerAddr.empty())
- {
- try
- {
- return m_pMQClientFactory->getMQClientAPIImpl()->searchOffset(brokerAddr, mq.getTopic(),
- mq.getQueueId(), timestamp, 1000 * 3);
- }
- catch (MQClientException e)
- {
- THROW_MQEXCEPTION(MQClientException, "Invoke Broker[" + brokerAddr + "] exception", -1);
- }
- }
- THROW_MQEXCEPTION(MQClientException, "The broker[" + mq.getBrokerName() + "] not exist", -1);
-}
-
-long long MQAdminImpl::maxOffset(const MessageQueue& mq)
-{
- std::string brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- if (brokerAddr.empty())
- {
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic());
- brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- }
-
- if (!brokerAddr.empty())
- {
- try
- {
- return m_pMQClientFactory->getMQClientAPIImpl()->getMaxOffset(brokerAddr, mq.getTopic(),
- mq.getQueueId(), 1000 * 3);
- }
- catch (MQClientException e)
- {
- THROW_MQEXCEPTION(MQClientException, "Invoke Broker[" + brokerAddr + "] exception", -1);
- }
- }
- THROW_MQEXCEPTION(MQClientException, "The broker[" + mq.getBrokerName() + "] not exist", -1);
-}
-
-long long MQAdminImpl::minOffset(const MessageQueue& mq)
-{
- std::string brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- if (brokerAddr.empty())
- {
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic());
- brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- }
-
- if (!brokerAddr.empty())
- {
- try
- {
- return m_pMQClientFactory->getMQClientAPIImpl()->getMinOffset(brokerAddr, mq.getTopic(),
- mq.getQueueId(), 1000 * 3);
- }
- catch (MQClientException e)
- {
- THROW_MQEXCEPTION(MQClientException, "Invoke Broker[" + brokerAddr + "] exception", -1);
- }
- }
-
- THROW_MQEXCEPTION(MQClientException, "The broker[" + mq.getBrokerName() + "] not exist", -1);
-}
-
-long long MQAdminImpl::earliestMsgStoreTime(const MessageQueue& mq)
-{
- std::string brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- if (brokerAddr.empty())
- {
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic());
- brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- }
-
- if (!brokerAddr.empty())
- {
- try
- {
- return m_pMQClientFactory->getMQClientAPIImpl()->getEarliestMsgStoretime(brokerAddr,
- mq.getTopic(), mq.getQueueId(), 1000 * 3);
- }
- catch (MQClientException e)
- {
- THROW_MQEXCEPTION(MQClientException, "Invoke Broker[" + brokerAddr + "] exception", -1);
- }
- }
-
- THROW_MQEXCEPTION(MQClientException, "The broker[" + mq.getBrokerName() + "] not exist", -1);
-}
-
-MessageExt* MQAdminImpl::viewMessage(const std::string& msgId)
-{
- try
- {
- MessageId messageId = MessageDecoder::decodeMessageId(msgId);
- return m_pMQClientFactory->getMQClientAPIImpl()->viewMessage(
- socketAddress2String(messageId.getAddress()), messageId.getOffset(), 1000 * 3);
- }
- catch (UnknownHostException e)
- {
- THROW_MQEXCEPTION(MQClientException, "message id illegal", -1);
- }
-}
-
-QueryResult MQAdminImpl::queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum, long long begin, long long end)
-{
- //TODO
- std::list<MessageExt*> messageList;
- QueryResult result(0, messageList);
-
- return result;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/MQAdminImpl.h b/rocketmq-client4cpp/src/MQAdminImpl.h
deleted file mode 100755
index 907d61e1..00000000
--- a/rocketmq-client4cpp/src/MQAdminImpl.h
+++ /dev/null
@@ -1,63 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MQADMINIMPL_H__
-#define __MQADMINIMPL_H__
-
-#include <string>
-#include <list>
-#include <set>
-#include <vector>
-
-#include "MessageExt.h"
-#include "QueryResult.h"
-
-namespace rmq
-{
- class MQClientFactory;
- class MessageQueue;
-
- class MQAdminImpl
- {
- public:
- MQAdminImpl(MQClientFactory* pMQClientFactory);
- ~MQAdminImpl();
-
- void createTopic(const std::string& key, const std::string& newTopic, int queueNum);
- void createTopic(const std::string& key, const std::string& newTopic, int queueNum, int topicSysFlag);
-
- std::vector<MessageQueue>* fetchPublishMessageQueues(const std::string& topic);
- std::set<MessageQueue>* fetchSubscribeMessageQueues(const std::string& topic);
- long long searchOffset(const MessageQueue& mq, long long timestamp);
- long long maxOffset(const MessageQueue& mq);
- long long minOffset(const MessageQueue& mq);
-
- long long earliestMsgStoreTime(const MessageQueue& mq);
-
- MessageExt* viewMessage(const std::string& msgId);
-
- QueryResult queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end);
-
- private:
- MQClientFactory* m_pMQClientFactory;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/MQClientAPIImpl.cpp b/rocketmq-client4cpp/src/MQClientAPIImpl.cpp
deleted file mode 100755
index fa5a2b9c..00000000
--- a/rocketmq-client4cpp/src/MQClientAPIImpl.cpp
+++ /dev/null
@@ -1,1323 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include <assert.h>
-
-#include "MQClientAPIImpl.h"
-#include "MQClientException.h"
-#include "SocketUtil.h"
-#include "UtilAll.h"
-#include "TcpRemotingClient.h"
-#include "MQProtos.h"
-#include "PullResultExt.h"
-#include "ConsumerInvokeCallback.h"
-#include "NamesrvUtil.h"
-#include "VirtualEnvUtil.h"
-#include "ClientRemotingProcessor.h"
-#include "CommandCustomHeader.h"
-#include "TopicList.h"
-#include "ProducerInvokeCallback.h"
-#include "MessageDecoder.h"
-#include "MessageSysFlag.h"
-#include "GetConsumerListByGroupResponseBody.h"
-
-
-namespace rmq
-{
-
-
-MQClientAPIImpl::MQClientAPIImpl(ClientConfig& clientConfig,
- const RemoteClientConfig& remoteClientConfig,
- ClientRemotingProcessor* pClientRemotingProcessor)
- : m_pClientRemotingProcessor(pClientRemotingProcessor)
-{
- m_pRemotingClient = new TcpRemotingClient(remoteClientConfig);
-
- m_pRemotingClient->registerProcessor(CHECK_TRANSACTION_STATE_VALUE, m_pClientRemotingProcessor);
- m_pRemotingClient->registerProcessor(NOTIFY_CONSUMER_IDS_CHANGED_VALUE, m_pClientRemotingProcessor);
- m_pRemotingClient->registerProcessor(RESET_CONSUMER_CLIENT_OFFSET_VALUE, m_pClientRemotingProcessor);
- m_pRemotingClient->registerProcessor(GET_CONSUMER_STATUS_FROM_CLIENT_VALUE, m_pClientRemotingProcessor);
- m_pRemotingClient->registerProcessor(GET_CONSUMER_RUNNING_INFO_VALUE, m_pClientRemotingProcessor);
- m_pRemotingClient->registerProcessor(CONSUME_MESSAGE_DIRECTLY_VALUE, m_pClientRemotingProcessor);
-}
-
-MQClientAPIImpl::~MQClientAPIImpl()
-{
-}
-
-std::string MQClientAPIImpl::getProjectGroupPrefix()
-{
- return m_projectGroupPrefix;
-}
-
-std::vector<std::string> MQClientAPIImpl::getNameServerAddressList()
-{
- return m_pRemotingClient->getNameServerAddressList();
-}
-
-TcpRemotingClient* MQClientAPIImpl::getRemotingClient()
-{
- return m_pRemotingClient;
-}
-
-std::string MQClientAPIImpl::fetchNameServerAddr()
-{
- try
- {
- std::string addrs = m_topAddressing.fetchNSAddr();
- if (!addrs.empty())
- {
- if (addrs != m_nameSrvAddr)
- {
- RMQ_INFO("name server address changed, %s -> %s",
- m_nameSrvAddr.c_str(), addrs.c_str());
- updateNameServerAddressList(addrs);
- m_nameSrvAddr = addrs;
- return m_nameSrvAddr;
- }
- }
- }
- catch (...)
- {
- RMQ_ERROR("fetchNameServerAddr Exception");
- }
-
- return m_nameSrvAddr;
-}
-
-void MQClientAPIImpl::updateNameServerAddressList(const std::string& addrs)
-{
- m_nameSrvAddr = addrs;
- std::vector<std::string> av;
- UtilAll::Split(av, addrs, ";");
- if (av.size() > 0)
- {
- m_pRemotingClient->updateNameServerAddressList(av);
- }
-}
-
-void MQClientAPIImpl::start()
-{
- m_pRemotingClient->start();
-
- try
- {
- std::string localAddress = getLocalAddress();
- m_projectGroupPrefix = getProjectGroupByIp(localAddress, 3000);
- }
- catch (std::exception e)
- {
- }
-}
-
-void MQClientAPIImpl::shutdown()
-{
- m_pRemotingClient->shutdown();
-}
-
-void MQClientAPIImpl::createSubscriptionGroup(const std::string& addr,
- SubscriptionGroupConfig config,
- int timeoutMillis)
-{
- //TODO
-}
-
-
-void MQClientAPIImpl::createTopic(const std::string& addr,
- const std::string& defaultTopic,
- TopicConfig topicConfig,
- int timeoutMillis)
-{
- std::string topicWithProjectGroup = topicConfig.getTopicName();
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- topicWithProjectGroup =
- VirtualEnvUtil::buildWithProjectGroup(topicConfig.getTopicName(), m_projectGroupPrefix);
- }
-
- CreateTopicRequestHeader* requestHeader = new CreateTopicRequestHeader();
- requestHeader->topic = (topicWithProjectGroup);
- requestHeader->defaultTopic = (defaultTopic);
- requestHeader->readQueueNums = (topicConfig.getReadQueueNums());
- requestHeader->writeQueueNums = (topicConfig.getWriteQueueNums());
- requestHeader->perm = (topicConfig.getPerm());
- requestHeader->topicFilterType = (topicConfig.getTopicFilterType());
- requestHeader->topicSysFlag = (topicConfig.getTopicSysFlag());
- requestHeader->order = (topicConfig.isOrder());
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(UPDATE_AND_CREATE_TOPIC_VALUE, requestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- return;
- }
- default:
- break;
- }
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "createTopic failed", -1);
-}
-
-SendResult MQClientAPIImpl::sendMessage(const std::string& addr,
- const std::string& brokerName,
- Message& msg,
- SendMessageRequestHeader* pRequestHeader,
- int timeoutMillis,
- CommunicationMode communicationMode,
- SendCallback* pSendCallback)
-{
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- msg.setTopic(VirtualEnvUtil::buildWithProjectGroup(msg.getTopic(), m_projectGroupPrefix));
- pRequestHeader->producerGroup = (VirtualEnvUtil::buildWithProjectGroup(pRequestHeader->producerGroup,
- m_projectGroupPrefix));
- pRequestHeader->topic = (VirtualEnvUtil::buildWithProjectGroup(pRequestHeader->topic,
- m_projectGroupPrefix));
- }
-
- bool sendSmartMsg = true;
- RemotingCommandPtr request = NULL;
- if (sendSmartMsg)
- {
- SendMessageRequestHeaderV2* pRequestHeaderV2 = SendMessageRequestHeaderV2::createSendMessageRequestHeaderV2(pRequestHeader);
- request = RemotingCommand::createRequestCommand(SEND_MESSAGE_V2_VALUE, pRequestHeaderV2);
- delete pRequestHeader;
- }
- else
- {
- request = RemotingCommand::createRequestCommand(SEND_MESSAGE_VALUE, pRequestHeader);
- }
-
- if (msg.getCompressBody() != NULL)
- {
- request->setBody((char*)msg.getCompressBody(), msg.getCompressBodyLen(), false);
- }
- else
- {
- request->setBody((char*)msg.getBody(), msg.getBodyLen(), false);
- }
-
- SendResult result;
- switch (communicationMode)
- {
- case ONEWAY:
- m_pRemotingClient->invokeOneway(addr, request, timeoutMillis);
- return result;
- case ASYNC:
- sendMessageAsync(addr, brokerName, msg, timeoutMillis, request, pSendCallback);
- return result;
- case SYNC:
- {
- SendResult* r = sendMessageSync(addr, brokerName, msg, timeoutMillis, request);
- if (r)
- {
- result = *r;
- delete r;
- }
- return result;
- }
- default:
- break;
- }
- return result;
-}
-
-PullResult* MQClientAPIImpl::pullMessage(const std::string& addr,
- PullMessageRequestHeader* pRequestHeader,
- int timeoutMillis,
- CommunicationMode communicationMode,
- PullCallback* pPullCallback)
-{
-
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- pRequestHeader->consumerGroup = (VirtualEnvUtil::buildWithProjectGroup(
- pRequestHeader->consumerGroup, m_projectGroupPrefix));
- pRequestHeader->topic = (VirtualEnvUtil::buildWithProjectGroup(pRequestHeader->topic,
- m_projectGroupPrefix));
- }
-
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(PULL_MESSAGE_VALUE, pRequestHeader);
-
- PullResult* result = NULL;
- switch (communicationMode)
- {
- case ONEWAY:
- break;
- case ASYNC:
- pullMessageAsync(addr, request, timeoutMillis, pPullCallback);
- break;
- case SYNC:
- result = pullMessageSync(addr, request, timeoutMillis);
- break;
- default:
- assert(false);
- break;
- }
-
- return result;
-}
-
-MessageExt* MQClientAPIImpl::viewMessage(const std::string& addr, long long phyoffset, int timeoutMillis)
-{
- ViewMessageRequestHeader* requestHeader = new ViewMessageRequestHeader();
- requestHeader->offset = phyoffset;
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(VIEW_MESSAGE_BY_ID_VALUE, requestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- if (response->getBody() != NULL)
- {
- int len = 0;
- MessageExt* messageExt = MessageDecoder::decode((char*)response->getBody(),
- response->getBodyLen(), len);
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- messageExt->setTopic(VirtualEnvUtil::clearProjectGroup(messageExt->getTopic(),
- m_projectGroupPrefix));
- }
- return messageExt;
- }
- }
- default:
- break;
- }
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "viewMessage failed", -1);
-}
-
-long long MQClientAPIImpl::searchOffset(const std::string& addr,
- const std::string& topic,
- int queueId,
- long long timestamp,
- int timeoutMillis)
-{
- std::string topicWithProjectGroup = topic;
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- topicWithProjectGroup = VirtualEnvUtil::buildWithProjectGroup(topic, m_projectGroupPrefix);
- }
-
- SearchOffsetRequestHeader* pRequestHeader = new SearchOffsetRequestHeader();
- pRequestHeader->topic = topicWithProjectGroup;
- pRequestHeader->queueId = queueId;
- pRequestHeader->timestamp = timestamp;
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(SEARCH_OFFSET_BY_TIMESTAMP_VALUE, pRequestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- SearchOffsetResponseHeader* ret = (SearchOffsetResponseHeader*)response->getCommandCustomHeader();
- return ret->offset;
- }
- default:
- break;
- }
- //THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- //THROW_MQEXCEPTION(MQClientException, "searchOffset failed", -1);
- return -1;
-}
-
-long long MQClientAPIImpl::getMaxOffset(const std::string& addr,
- const std::string& topic,
- int queueId,
- int timeoutMillis)
-{
- std::string topicWithProjectGroup = topic;
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- topicWithProjectGroup = VirtualEnvUtil::buildWithProjectGroup(topic, m_projectGroupPrefix);
- }
-
- GetMaxOffsetRequestHeader* pRequestHeader = new GetMaxOffsetRequestHeader();
- pRequestHeader->topic = topicWithProjectGroup;
- pRequestHeader->queueId = queueId;
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(GET_MAX_OFFSET_VALUE, pRequestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- GetMaxOffsetResponseHeader* ret = (GetMaxOffsetResponseHeader*)response->getCommandCustomHeader();
- return ret->offset;
- }
- default:
- break;
- }
- //THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- //THROW_MQEXCEPTION(MQClientException, "getMaxOffset failed", -1);
- return -1;
-}
-
-
-std::list<std::string> MQClientAPIImpl::getConsumerIdListByGroup(const std::string& addr,
- const std::string& consumerGroup,
- int timeoutMillis)
-{
- std::string consumerGroupWithProjectGroup = consumerGroup;
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- consumerGroupWithProjectGroup =
- VirtualEnvUtil::buildWithProjectGroup(consumerGroup, m_projectGroupPrefix);
- }
-
- GetConsumerListByGroupRequestHeader* requestHeader = new GetConsumerListByGroupRequestHeader();
- requestHeader->consumerGroup = consumerGroupWithProjectGroup;
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(GET_CONSUMER_LIST_BY_GROUP_VALUE, requestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- if (response->getBody() != NULL)
- {
- GetConsumerListByGroupResponseBody* body =
- GetConsumerListByGroupResponseBody::decode((char*)response->getBody(), response->getBodyLen());
- std::list<std::string> ret = body->getConsumerIdList();
- delete body;
- return ret;
- }
- }
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "getConsumerIdListByGroup failed", -1);
-}
-
-long long MQClientAPIImpl::getMinOffset(const std::string& addr,
- const std::string& topic,
- int queueId,
- int timeoutMillis)
-{
- std::string topicWithProjectGroup = topic;
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- topicWithProjectGroup = VirtualEnvUtil::buildWithProjectGroup(topic, m_projectGroupPrefix);
- }
-
- GetMinOffsetRequestHeader* pRequestHeader = new GetMinOffsetRequestHeader();
- pRequestHeader->topic = topicWithProjectGroup;
- pRequestHeader->queueId = queueId;
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(GET_MIN_OFFSET_VALUE, pRequestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- GetMinOffsetResponseHeader* ret = (GetMinOffsetResponseHeader*)response->getCommandCustomHeader();
- return ret->offset;
- }
- default:
- break;
- }
- //THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- //THROW_MQEXCEPTION(MQClientException, "getMinOffset failed", -1);
- return -1;
-}
-
-long long MQClientAPIImpl::getEarliestMsgStoretime(const std::string& addr,
- const std::string& topic,
- int queueId,
- int timeoutMillis)
-{
- std::string topicWithProjectGroup = topic;
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- topicWithProjectGroup = VirtualEnvUtil::buildWithProjectGroup(topic, m_projectGroupPrefix);
- }
-
- GetEarliestMsgStoretimeRequestHeader* pRequestHeader = new GetEarliestMsgStoretimeRequestHeader();
- pRequestHeader->topic = topicWithProjectGroup;
- pRequestHeader->queueId = queueId;
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(GET_EARLIEST_MSG_STORETIME_VALUE, pRequestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- GetEarliestMsgStoretimeResponseHeader* ret = (GetEarliestMsgStoretimeResponseHeader*)response->getCommandCustomHeader();
- return ret->timestamp;
- }
- default:
- break;
- }
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "getEarliestMsgStoretime failed", -1);
-}
-
-long long MQClientAPIImpl::queryConsumerOffset(const std::string& addr,
- QueryConsumerOffsetRequestHeader* pRequestHeader,
- int timeoutMillis)
-{
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- pRequestHeader->consumerGroup = VirtualEnvUtil::buildWithProjectGroup(
- pRequestHeader->consumerGroup, m_projectGroupPrefix);
- pRequestHeader->topic = VirtualEnvUtil::buildWithProjectGroup(pRequestHeader->topic,
- m_projectGroupPrefix);
- }
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(QUERY_CONSUMER_OFFSET_VALUE, pRequestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- QueryConsumerOffsetResponseHeader* ret = (QueryConsumerOffsetResponseHeader*)response->getCommandCustomHeader();
- long long offset = ret->offset;
- return offset;
- }
- default:
- break;
- }
- THROW_MQEXCEPTION(MQBrokerException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "queryConsumerOffset failed", -1);
- return -1;
-}
-
-void MQClientAPIImpl::updateConsumerOffset(const std::string& addr,
- UpdateConsumerOffsetRequestHeader* pRequestHeader,
- int timeoutMillis)
-{
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- pRequestHeader->consumerGroup = VirtualEnvUtil::buildWithProjectGroup(
- pRequestHeader->consumerGroup, m_projectGroupPrefix);
- pRequestHeader->topic = VirtualEnvUtil::buildWithProjectGroup(
- pRequestHeader->topic, m_projectGroupPrefix);
- }
-
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(UPDATE_CONSUMER_OFFSET_VALUE, pRequestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- return;
- }
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "updateConsumerOffset failed", -1);
-}
-
-void MQClientAPIImpl::updateConsumerOffsetOneway(const std::string& addr,
- UpdateConsumerOffsetRequestHeader* pRequestHeader,
- int timeoutMillis)
-{
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- pRequestHeader->consumerGroup = VirtualEnvUtil::buildWithProjectGroup(
- pRequestHeader->consumerGroup, m_projectGroupPrefix);
- pRequestHeader->topic = VirtualEnvUtil::buildWithProjectGroup(pRequestHeader->topic,
- m_projectGroupPrefix);
- }
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(UPDATE_CONSUMER_OFFSET_VALUE, pRequestHeader);
-
- m_pRemotingClient->invokeOneway(addr, request, timeoutMillis);
-}
-
-void MQClientAPIImpl::sendHearbeat(const std::string& addr, HeartbeatData* pHeartbeatData, int timeoutMillis)
-{
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- std::set<ConsumerData>& consumerDatas = pHeartbeatData->getConsumerDataSet();
- std::set<ConsumerData>::iterator it = consumerDatas.begin();
- for (; it != consumerDatas.end(); it++)
- {
- ConsumerData& consumerData = (ConsumerData&)(*it);
- consumerData.groupName = VirtualEnvUtil::buildWithProjectGroup(consumerData.groupName,
- m_projectGroupPrefix);
-
- std::set<SubscriptionData>& subscriptionDatas = consumerData.subscriptionDataSet;
- std::set<SubscriptionData>::iterator itsub = subscriptionDatas.begin();
- for (; itsub != subscriptionDatas.end(); itsub++)
- {
- SubscriptionData& subscriptionData = (SubscriptionData&)(*itsub);
- subscriptionData.setTopic(VirtualEnvUtil::buildWithProjectGroup(
- subscriptionData.getTopic(), m_projectGroupPrefix));
- }
- }
-
- std::set<ProducerData>& producerDatas = pHeartbeatData->getProducerDataSet();
- std::set<ProducerData>::iterator itp = producerDatas.begin();
- for (; itp != producerDatas.end(); itp++)
- {
- ProducerData& producerData = (ProducerData&)(*itp);
- producerData.groupName = VirtualEnvUtil::buildWithProjectGroup(producerData.groupName,
- m_projectGroupPrefix);
- }
- }
-
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(HEART_BEAT_VALUE, NULL);
-
- std::string body;
- pHeartbeatData->encode(body);
- request->setBody((char*)body.data(), body.length(), true);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- return;
- }
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "sendHearbeat failed", -1);
-}
-
-void MQClientAPIImpl::unregisterClient(const std::string& addr,
- const std::string& clientID,
- const std::string& producerGroup,
- const std::string& consumerGroup,
- int timeoutMillis)
-{
- std::string producerGroupWithProjectGroup = producerGroup;
- std::string consumerGroupWithProjectGroup = consumerGroup;
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- producerGroupWithProjectGroup =
- VirtualEnvUtil::buildWithProjectGroup(producerGroup, m_projectGroupPrefix);
- consumerGroupWithProjectGroup =
- VirtualEnvUtil::buildWithProjectGroup(consumerGroup, m_projectGroupPrefix);
- }
-
- UnregisterClientRequestHeader* requestHeader = new UnregisterClientRequestHeader();
- requestHeader->clientID = (clientID);
- requestHeader->producerGroup = (producerGroupWithProjectGroup);
- requestHeader->consumerGroup = (consumerGroupWithProjectGroup);
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(UNREGISTER_CLIENT_VALUE, requestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- return;
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "unregisterClient failed", -1);
-}
-
-void MQClientAPIImpl::endTransactionOneway(const std::string& addr,
- EndTransactionRequestHeader* pRequestHeader,
- const std::string& remark,
- int timeoutMillis)
-{
- //TODO
-}
-
-void MQClientAPIImpl::queryMessage(const std::string& addr,
- QueryMessageRequestHeader* pRequestHeader,
- int timeoutMillis,
- InvokeCallback* pInvokeCallback)
-{
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- pRequestHeader->topic = VirtualEnvUtil::buildWithProjectGroup(pRequestHeader->topic,
- m_projectGroupPrefix);
- }
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(QUERY_MESSAGE_VALUE, pRequestHeader);
-
- m_pRemotingClient->invokeAsync(addr, request, timeoutMillis, pInvokeCallback);
- return;
-}
-
-bool MQClientAPIImpl::registerClient(const std::string& addr, HeartbeatData& heartbeat, int timeoutMillis)
-{
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- std::set<ConsumerData>& consumerDatas = heartbeat.getConsumerDataSet();
- std::set<ConsumerData>::iterator it = consumerDatas.begin();
-
- for (; it != consumerDatas.end(); it++)
- {
- ConsumerData& consumerData = (ConsumerData&)(*it);
-
- consumerData.groupName = VirtualEnvUtil::buildWithProjectGroup(consumerData.groupName,
- m_projectGroupPrefix);
- std::set<SubscriptionData>& subscriptionDatas = consumerData.subscriptionDataSet;
- std::set<SubscriptionData>::iterator itsub = subscriptionDatas.begin();
-
- for (; itsub != subscriptionDatas.end(); itsub++)
- {
- SubscriptionData& subscriptionData = (SubscriptionData&)(*itsub);
- subscriptionData.setTopic(VirtualEnvUtil::buildWithProjectGroup(
- subscriptionData.getTopic(), m_projectGroupPrefix));
- }
- }
-
- std::set<ProducerData>& producerDatas = heartbeat.getProducerDataSet();
- std::set<ProducerData>::iterator itp = producerDatas.begin();
- for (; itp != producerDatas.end(); itp++)
- {
- ProducerData& producerData = (ProducerData&)(*itp);
- producerData.groupName = VirtualEnvUtil::buildWithProjectGroup(producerData.groupName,
- m_projectGroupPrefix);
- }
- }
-
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(HEART_BEAT_VALUE, NULL);
-
- std::string body;
- heartbeat.encode(body);
-
- request->setBody((char*)body.data(), body.length(), true);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- return (response && response->getCode() == SUCCESS_VALUE);
-}
-
-void MQClientAPIImpl::consumerSendMessageBack(
- const std::string& addr,
- MessageExt& msg,
- const std::string& consumerGroup,
- int delayLevel,
- int timeoutMillis)
-{
- std::string consumerGroupWithProjectGroup = consumerGroup;
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- consumerGroupWithProjectGroup =
- VirtualEnvUtil::buildWithProjectGroup(consumerGroup, m_projectGroupPrefix);
- msg.setTopic(VirtualEnvUtil::buildWithProjectGroup(msg.getTopic(), m_projectGroupPrefix));
- }
-
- ConsumerSendMsgBackRequestHeader* requestHeader = new ConsumerSendMsgBackRequestHeader();
- requestHeader->group = consumerGroupWithProjectGroup;
- requestHeader->offset = msg.getCommitLogOffset();
- requestHeader->delayLevel = delayLevel;
-
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(CONSUMER_SEND_MSG_BACK_VALUE, requestHeader);
-
- std::string brokerAddr = addr.empty() ? socketAddress2IPPort(msg.getStoreHost()) : addr;
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(brokerAddr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- return;
- break;
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "consumerSendMessageBack failed", -1);
-}
-
-std::set<MessageQueue> MQClientAPIImpl::lockBatchMQ(const std::string& addr,
- LockBatchRequestBody* pRequestBody,
- int timeoutMillis)
-{
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- pRequestBody->setConsumerGroup((VirtualEnvUtil::buildWithProjectGroup(
- pRequestBody->getConsumerGroup(), m_projectGroupPrefix)));
- std::set<MessageQueue>& messageQueues = pRequestBody->getMqSet();
- std::set<MessageQueue>::iterator it = messageQueues.begin();
-
- for (; it != messageQueues.end(); it++)
- {
- MessageQueue& messageQueue = (MessageQueue&)(*it);
- messageQueue.setTopic(VirtualEnvUtil::buildWithProjectGroup(messageQueue.getTopic(),
- m_projectGroupPrefix));
- }
- }
-
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(LOCK_BATCH_MQ_VALUE, NULL);
-
- std::string body;
- pRequestBody->encode(body);
- request->setBody((char*)body.data(), body.length(), true);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- LockBatchResponseBody* responseBody =
- LockBatchResponseBody::decode(response->getBody(), response->getBodyLen());
- std::set<MessageQueue> messageQueues = responseBody->getLockOKMQSet();
-
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- std::set<MessageQueue>::iterator it = messageQueues.begin();
-
- for (; it != messageQueues.end(); it++)
- {
- MessageQueue& messageQueue = (MessageQueue&)(*it);
- messageQueue.setTopic(VirtualEnvUtil::clearProjectGroup(messageQueue.getTopic(),
- m_projectGroupPrefix));
- }
- }
- return messageQueues;
- }
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "lockBatchMQ failed", -1);
-}
-
-void MQClientAPIImpl::unlockBatchMQ(const std::string& addr,
- UnlockBatchRequestBody* pRequestBody,
- int timeoutMillis,
- bool oneway)
-{
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- pRequestBody->setConsumerGroup((VirtualEnvUtil::buildWithProjectGroup(
- pRequestBody->getConsumerGroup(), m_projectGroupPrefix)));
- std::set<MessageQueue>& messageQueues = pRequestBody->getMqSet();
- std::set<MessageQueue>::iterator it = messageQueues.begin();
-
- for (; it != messageQueues.end(); it++)
- {
- MessageQueue& messageQueue = (MessageQueue&)(*it);
- messageQueue.setTopic(VirtualEnvUtil::buildWithProjectGroup(messageQueue.getTopic(),
- m_projectGroupPrefix));
- }
- }
-
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(UNLOCK_BATCH_MQ_VALUE, NULL);
-
- std::string body;
- pRequestBody->encode(body);
- request->setBody((char*)body.data(), body.length(), true);
-
- if (oneway)
- {
- m_pRemotingClient->invokeOneway(addr, request, timeoutMillis);
- }
- else
- {
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- return;
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "unlockBatchMQ failed", -1);
- }
-}
-
-TopicStatsTable MQClientAPIImpl::getTopicStatsInfo(const std::string& addr,
- const std::string& topic,
- int timeoutMillis)
-{
- //TODO
- TopicStatsTable t;
- return t;
-}
-
-ConsumeStats MQClientAPIImpl::getConsumeStats(const std::string& addr,
- const std::string& consumerGroup,
- int timeoutMillis)
-{
- //TODO
- ConsumeStats cs;
- return cs;
-}
-
-ProducerConnection* MQClientAPIImpl::getProducerConnectionList(const std::string& addr,
- const std::string& producerGroup,
- int timeoutMillis)
-{
- //TODO
- return NULL;
-}
-
-ConsumerConnection* MQClientAPIImpl::getConsumerConnectionList(const std::string& addr,
- const std::string& consumerGroup,
- int timeoutMillis)
-{
- //TODO
- return NULL;
-}
-
-KVTable MQClientAPIImpl::getBrokerRuntimeInfo(const std::string& addr, int timeoutMillis)
-{
- //TODO
- KVTable kv;
- return kv;
-}
-
-void MQClientAPIImpl::updateBrokerConfig(const std::string& addr,
- const std::map<std::string, std::string>& properties,
- int timeoutMillis)
-{
- //TODO
-}
-
-ClusterInfo* MQClientAPIImpl::getBrokerClusterInfo(int timeoutMillis)
-{
- //TODO
- return NULL;
-}
-
-TopicRouteData* MQClientAPIImpl::getDefaultTopicRouteInfoFromNameServer(const std::string& topic,
- int timeoutMillis)
-{
- GetRouteInfoRequestHeader* requestHeader = new GetRouteInfoRequestHeader();
- requestHeader->topic = topic;
-
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(GET_ROUTEINTO_BY_TOPIC_VALUE, requestHeader);
- RemotingCommandPtr response = m_pRemotingClient->invokeSync("", request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case TOPIC_NOT_EXIST_VALUE:
- {
- // TODO LOG
- break;
- }
- case SUCCESS_VALUE:
- {
- int bodyLen = response->getBodyLen();
- const char* body = response->getBody();
- if (body)
- {
- TopicRouteData* ret = TopicRouteData::encode(body, bodyLen);
- return ret;
- }
- }
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- return NULL;
-}
-
-TopicRouteData* MQClientAPIImpl::getTopicRouteInfoFromNameServer(const std::string& topic, int timeoutMillis)
-{
- std::string topicWithProjectGroup = topic;
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- topicWithProjectGroup = VirtualEnvUtil::buildWithProjectGroup(topic, m_projectGroupPrefix);
- }
-
- GetRouteInfoRequestHeader* requestHeader = new GetRouteInfoRequestHeader();
- requestHeader->topic = topicWithProjectGroup;
-
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(GET_ROUTEINTO_BY_TOPIC_VALUE, requestHeader);
- RemotingCommandPtr response = m_pRemotingClient->invokeSync("", request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case TOPIC_NOT_EXIST_VALUE:
- {
- if (topic != MixAll::DEFAULT_TOPIC)
- {
- RMQ_WARN("get Topic [{%s}] RouteInfoFromNameServer is not exist value", topic.c_str());
- }
- break;
- }
- case SUCCESS_VALUE:
- {
- int bodyLen = response->getBodyLen();
- const char* body = response->getBody();
- if (body)
- {
- TopicRouteData* ret = TopicRouteData::encode(body, bodyLen);
- return ret;
- }
- }
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- return NULL;
-}
-
-TopicList* MQClientAPIImpl::getTopicListFromNameServer(int timeoutMillis)
-{
- RemotingCommandPtr request = RemotingCommand::createRequestCommand(GET_ALL_TOPIC_LIST_FROM_NAMESERVER_VALUE, NULL);
- RemotingCommandPtr response = m_pRemotingClient->invokeSync("", request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- char* body = (char*)response->getBody();
- if (body != NULL)
- {
- TopicList* topicList = TopicList::decode(body, response->getBodyLen());
-
- if (!UtilAll::isBlank(m_projectGroupPrefix))
- {
- std::set<std::string> newTopicSet;
-
- const std::set<std::string>& topics = topicList->getTopicList();
- std::set<std::string>::const_iterator it = topics.begin();
- for (; it != topics.end(); it++)
- {
- std::string topic = *it;
- newTopicSet.insert(VirtualEnvUtil::clearProjectGroup(topic, m_projectGroupPrefix));
- }
-
- topicList->setTopicList(newTopicSet);
- }
-
- return topicList;
- }
- }
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- return NULL;
-}
-
-int MQClientAPIImpl::wipeWritePermOfBroker(const std::string& namesrvAddr,
- const std::string& brokerName,
- int timeoutMillis)
-{
- //TODO
- return 0;
-}
-
-void MQClientAPIImpl::deleteTopicInBroker(const std::string& addr,
- const std::string& topic,
- int timeoutMillis)
-{
- //TODO
-}
-
-void MQClientAPIImpl::deleteTopicInNameServer(const std::string& addr,
- const std::string& topic,
- int timeoutMillis)
-{
- //TODO
-}
-
-void MQClientAPIImpl::deleteSubscriptionGroup(const std::string& addr,
- const std::string& groupName,
- int timeoutMillis)
-{
- //TODO
-}
-
-std::string MQClientAPIImpl::getKVConfigValue(const std::string& projectNamespace,
- const std::string& key,
- int timeoutMillis)
-{
- GetKVConfigRequestHeader* pRequestHeader = new GetKVConfigRequestHeader();
- pRequestHeader->namespace_ = projectNamespace;
- pRequestHeader->key = key;
-
- RemotingCommandPtr request =
- RemotingCommand::createRequestCommand(GET_KV_CONFIG_VALUE, pRequestHeader);
-
- RemotingCommandPtr response = m_pRemotingClient->invokeSync("", request, timeoutMillis);
- if (response)
- {
- switch (response->getCode())
- {
- case SUCCESS_VALUE:
- {
- GetKVConfigResponseHeader* ret = (GetKVConfigResponseHeader*)response->getCommandCustomHeader();
- return ret->value;
- }
- default:
- break;
- }
- THROW_MQEXCEPTION(MQClientException, response->getRemark(), response->getCode());
- }
-
- THROW_MQEXCEPTION(MQClientException, "getKVConfigValue failed", -1);
-}
-
-void MQClientAPIImpl::putKVConfigValue(const std::string& projectNamespace,
- const std::string& key,
- const std::string& value,
- int timeoutMillis)
-{
- //TODO
-}
-
-void MQClientAPIImpl::deleteKVConfigValue(const std::string& projectNamespace,
- const std::string& key,
- int timeoutMillis)
-{
- //TODO
-}
-
-std::string MQClientAPIImpl::getProjectGroupByIp(const std::string& ip, int timeoutMillis)
-{
- return getKVConfigValue(NamesrvUtil::NAMESPACE_PROJECT_CONFIG, ip, timeoutMillis);
-}
-
-std::string MQClientAPIImpl::getKVConfigByValue(const std::string& projectNamespace,
- const std::string& projectGroup,
- int timeoutMillis)
-{
- //TODO
- return "";
-}
-
-KVTable MQClientAPIImpl::getKVListByNamespace(const std::string& projectNamespace, int timeoutMillis)
-{
- //TODO
- return KVTable();
-}
-
-void MQClientAPIImpl::deleteKVConfigByValue(const std::string& projectNamespace,
- const std::string& projectGroup,
- int timeoutMillis)
-{
- //TODO
-}
-
-SendResult* MQClientAPIImpl::sendMessageSync(const std::string& addr,
- const std::string& brokerName,
- Message& msg,
- int timeoutMillis,
- RemotingCommand* request)
-{
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, request, timeoutMillis);
- return processSendResponse(brokerName, msg.getTopic(), response);
-}
-
-void MQClientAPIImpl::sendMessageAsync(const std::string& addr,
- const std::string& brokerName,
- Message& msg,
- int timeoutMillis,
- RemotingCommand* request,
- SendCallback* pSendCallback)
-{
- ProducerInvokeCallback* callback = new ProducerInvokeCallback(pSendCallback, this, msg.getTopic(), brokerName);
- m_pRemotingClient->invokeAsync(addr, request, timeoutMillis, callback);
-}
-
-SendResult* MQClientAPIImpl::processSendResponse(const std::string& brokerName,
- const std::string& topic,
- RemotingCommand* pResponse)
-{
- if (pResponse == NULL)
- {
- return NULL;
- }
-
- switch (pResponse->getCode())
- {
- case FLUSH_DISK_TIMEOUT_VALUE:
- case FLUSH_SLAVE_TIMEOUT_VALUE:
- case SLAVE_NOT_AVAILABLE_VALUE:
- {
- // TODO LOG
- }
- case SUCCESS_VALUE:
- {
- SendStatus sendStatus = SEND_OK;
- switch (pResponse->getCode())
- {
- case FLUSH_DISK_TIMEOUT_VALUE:
- sendStatus = FLUSH_DISK_TIMEOUT;
- break;
- case FLUSH_SLAVE_TIMEOUT_VALUE:
- sendStatus = FLUSH_SLAVE_TIMEOUT;
- break;
- case SLAVE_NOT_AVAILABLE_VALUE:
- sendStatus = SLAVE_NOT_AVAILABLE;
- break;
- case SUCCESS_VALUE:
- sendStatus = SEND_OK;
- break;
- default:
- //assert false;
- break;
- }
-
- SendMessageResponseHeader* responseHeader = (SendMessageResponseHeader*)pResponse->getCommandCustomHeader();
- MessageQueue messageQueue(topic, brokerName, responseHeader->queueId);
- SendResult* ret = new SendResult(sendStatus, responseHeader->msgId, messageQueue,
- responseHeader->queueOffset, m_projectGroupPrefix);
-
- return ret;
- }
- default:
- break;
- }
-
- THROW_MQEXCEPTION(MQClientException, pResponse->getRemark(), pResponse->getCode());
-}
-
-void MQClientAPIImpl::pullMessageAsync(const std::string& addr,
- RemotingCommand* pRequest,
- int timeoutMillis,
- PullCallback* pPullCallback)
-{
- ConsumerInvokeCallback* callback = new ConsumerInvokeCallback(pPullCallback, this);
- m_pRemotingClient->invokeAsync(addr, pRequest, timeoutMillis, callback);
-}
-
-PullResult* MQClientAPIImpl::processPullResponse(RemotingCommand* pResponse)
-{
- PullStatus pullStatus = NO_NEW_MSG;
- switch (pResponse->getCode())
- {
- case SUCCESS_VALUE:
- pullStatus = FOUND;
- break;
- case PULL_NOT_FOUND_VALUE:
- pullStatus = NO_NEW_MSG;
- break;
- case PULL_RETRY_IMMEDIATELY_VALUE:
- pullStatus = NO_MATCHED_MSG;
- break;
- case PULL_OFFSET_MOVED_VALUE:
- pullStatus = OFFSET_ILLEGAL;
- break;
- default:
- THROW_MQEXCEPTION(MQBrokerException, pResponse->getRemark(), pResponse->getCode());
- break;
- }
-
- PullMessageResponseHeader* responseHeader = (PullMessageResponseHeader*) pResponse->getCommandCustomHeader();
- std::list<MessageExt*> msgFoundList;
- return new PullResultExt(pullStatus, responseHeader->nextBeginOffset,
- responseHeader->minOffset, responseHeader->maxOffset, msgFoundList,
- responseHeader->suggestWhichBrokerId, pResponse->getBody(), pResponse->getBodyLen());
-}
-
-PullResult* MQClientAPIImpl::pullMessageSync(const std::string& addr,
- RemotingCommand* pRequest,
- int timeoutMillis)
-{
- RemotingCommandPtr response = m_pRemotingClient->invokeSync(addr, pRequest, timeoutMillis);
- PullResult* result = processPullResponse(response);
-
- response->setBody(NULL, 0, false);
- return result;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/MQClientAPIImpl.h b/rocketmq-client4cpp/src/MQClientAPIImpl.h
deleted file mode 100755
index 88defb58..00000000
--- a/rocketmq-client4cpp/src/MQClientAPIImpl.h
+++ /dev/null
@@ -1,280 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MQCLIENTAPIIMPL_H__
-#define __MQCLIENTAPIIMPL_H__
-
-#include <string>
-#include <map>
-#include <list>
-#include <set>
-
-#include "ClientConfig.h"
-#include "RemoteClientConfig.h"
-#include "SubscriptionGroupConfig.h"
-#include "TopicConfig.h"
-#include "ConsumeStats.h"
-#include "TopicStatsTable.h"
-#include "KVTable.h"
-#include "TopicRouteData.h"
-#include "SendResult.h"
-#include "PullResult.h"
-#include "MessageExt.h"
-#include "CommunicationMode.h"
-#include "TopAddressing.h"
-#include "HeartbeatData.h"
-#include "LockBatchBody.h"
-
-namespace rmq
-{
-class ClientConfig;
-class TcpRemotingClient;
-class QueryConsumerOffsetRequestHeader;
-class UpdateConsumerOffsetRequestHeader;
-class EndTransactionRequestHeader;
-class SendMessageRequestHeader;
-class PullMessageRequestHeader;
-class QueryMessageRequestHeader;
-class ProducerConnection;
-class ConsumerConnection;
-class ClusterInfo;
-class TopicList;
-class InvokeCallback;
-class RemotingCommand;
-class PullCallback;
-class SendCallback;
-class ClientRemotingProcessor;
-
-class MQClientAPIImpl
-{
- public:
- MQClientAPIImpl(ClientConfig& clientConfig,
- const RemoteClientConfig& remoteClientConfig,
- ClientRemotingProcessor* pClientRemotingProcessor);
- ~MQClientAPIImpl();
-
- void start();
- void shutdown();
-
- std::string getProjectGroupPrefix();
- std::vector<std::string> getNameServerAddressList();
- void updateNameServerAddressList(const std::string& addrs);
- std::string fetchNameServerAddr();
-
- void createSubscriptionGroup(const std::string& addr,
- SubscriptionGroupConfig config,
- int timeoutMillis);
-
- void createTopic(const std::string& addr,
- const std::string& defaultTopic,
- TopicConfig topicConfig,
- int timeoutMillis);
-
- SendResult sendMessage(const std::string& addr,
- const std::string& brokerName,
- Message& msg,
- SendMessageRequestHeader* pRequestHeader,
- int timeoutMillis,
- CommunicationMode communicationMode,
- SendCallback* pSendCallback);
-
- PullResult* pullMessage(const std::string& addr,
- PullMessageRequestHeader* pRequestHeader,
- int timeoutMillis,
- CommunicationMode communicationMode,
- PullCallback* pPullCallback);
-
- MessageExt* viewMessage(const std::string& addr, long long phyoffset, int timeoutMillis);
-
-
- long long searchOffset(const std::string& addr,
- const std::string& topic,
- int queueId,
- long long timestamp,
- int timeoutMillis);
-
- long long getMaxOffset(const std::string& addr,
- const std::string& topic,
- int queueId,
- int timeoutMillis);
-
- std::list<std::string> getConsumerIdListByGroup(const std::string& addr,
- const std::string& consumerGroup,
- int timeoutMillis);
-
- long long getMinOffset(const std::string& addr,
- const std::string& topic,
- int queueId,
- int timeoutMillis);
-
- long long getEarliestMsgStoretime(const std::string& addr,
- const std::string& topic,
- int queueId,
- int timeoutMillis);
-
- long long queryConsumerOffset(const std::string& addr,
- QueryConsumerOffsetRequestHeader* pRequestHeader,
- int timeoutMillis);
-
- void updateConsumerOffset(const std::string& addr,
- UpdateConsumerOffsetRequestHeader* pRequestHeader,
- int timeoutMillis);
-
- void updateConsumerOffsetOneway(const std::string& addr,
- UpdateConsumerOffsetRequestHeader* pRequestHeader,
- int timeoutMillis);
-
- void sendHearbeat(const std::string& addr, HeartbeatData* pHeartbeatData, int timeoutMillis);
-
- void unregisterClient(const std::string& addr,
- const std::string& clientID,
- const std::string& producerGroup,
- const std::string& consumerGroup,
- int timeoutMillis);
-
- void endTransactionOneway(const std::string& addr,
- EndTransactionRequestHeader* pRequestHeader,
- const std::string& remark,
- int timeoutMillis);
-
- void queryMessage(const std::string& addr,
- QueryMessageRequestHeader* pRequestHeader,
- int timeoutMillis,
- InvokeCallback* pInvokeCallback);
-
- bool registerClient(const std::string& addr,
- HeartbeatData& heartbeat,
- int timeoutMillis);
-
- void consumerSendMessageBack(const std::string& addr,
- MessageExt& msg,
- const std::string& consumerGroup,
- int delayLevel,
- int timeoutMillis);
-
- std::set<MessageQueue> lockBatchMQ(const std::string& addr,
- LockBatchRequestBody* pRequestBody,
- int timeoutMillis);
-
- void unlockBatchMQ(const std::string& addr,
- UnlockBatchRequestBody* pRequestBody,
- int timeoutMillis,
- bool oneway);
-
- TopicStatsTable getTopicStatsInfo(const std::string& addr,
- const std::string& topic,
- int timeoutMillis);
-
- ConsumeStats getConsumeStats(const std::string& addr,
- const std::string& consumerGroup,
- int timeoutMillis);
-
- ProducerConnection* getProducerConnectionList(const std::string& addr,
- const std::string& producerGroup,
- int timeoutMillis);
-
- ConsumerConnection* getConsumerConnectionList(const std::string& addr,
- const std::string& consumerGroup,
- int timeoutMillis);
-
- KVTable getBrokerRuntimeInfo(const std::string& addr, int timeoutMillis);
-
- void updateBrokerConfig(const std::string& addr,
- const std::map<std::string, std::string>& properties,
- int timeoutMillis);
-
- ClusterInfo* getBrokerClusterInfo(int timeoutMillis);
-
- TopicRouteData* getDefaultTopicRouteInfoFromNameServer(const std::string& topic, int timeoutMillis);
-
- TopicRouteData* getTopicRouteInfoFromNameServer(const std::string& topic, int timeoutMillis);
-
- TopicList* getTopicListFromNameServer(int timeoutMillis);
-
- int wipeWritePermOfBroker(const std::string& namesrvAddr,
- const std::string& brokerName,
- int timeoutMillis);
-
- void deleteTopicInBroker(const std::string& addr, const std::string& topic, int timeoutMillis);
- void deleteTopicInNameServer(const std::string& addr, const std::string& topic, int timeoutMillis);
- void deleteSubscriptionGroup(const std::string& addr,
- const std::string& groupName,
- int timeoutMillis);
-
- std::string getKVConfigValue(const std::string& projectNamespace,
- const std::string& key,
- int timeoutMillis);
-
- void putKVConfigValue(const std::string& projectNamespace,
- const std::string& key,
- const std::string& value,
- int timeoutMillis);
-
- void deleteKVConfigValue(const std::string& projectNamespace, const std::string& key, int timeoutMillis);
-
- std::string getProjectGroupByIp(const std::string& ip, int timeoutMillis);
-
- std::string getKVConfigByValue(const std::string& projectNamespace,
- const std::string& projectGroup,
- int timeoutMillis);
-
- KVTable getKVListByNamespace(const std::string& projectNamespace, int timeoutMillis);
-
- void deleteKVConfigByValue(const std::string& projectNamespace,
- const std::string& projectGroup,
- int timeoutMillis);
-
- TcpRemotingClient* getRemotingClient();
-
- SendResult* processSendResponse(const std::string& brokerName,
- const std::string& topic,
- RemotingCommand* pResponse);
-
- PullResult* processPullResponse(RemotingCommand* pResponse);
-
- private:
- SendResult* sendMessageSync(const std::string& addr,
- const std::string& brokerName,
- Message& msg,
- int timeoutMillis,
- RemotingCommand* request);
-
- void sendMessageAsync(const std::string& addr,
- const std::string& brokerName,
- Message& msg,
- int timeoutMillis,
- RemotingCommand* request,
- SendCallback* pSendCallback);
-
- void pullMessageAsync(const std::string& addr,
- RemotingCommand* pRequest,
- int timeoutMillis,
- PullCallback* pPullCallback);
-
- PullResult* pullMessageSync(const std::string& addr,
- RemotingCommand* pRequest,
- int timeoutMillis);
-
- private:
- TcpRemotingClient* m_pRemotingClient;
- TopAddressing m_topAddressing;
- ClientRemotingProcessor* m_pClientRemotingProcessor;
- std::string m_nameSrvAddr;
- std::string m_projectGroupPrefix;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/MQClientFactory.cpp b/rocketmq-client4cpp/src/MQClientFactory.cpp
deleted file mode 100755
index 2b8208b6..00000000
--- a/rocketmq-client4cpp/src/MQClientFactory.cpp
+++ /dev/null
@@ -1,1258 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include <math.h>
-#include <set>
-#include <string>
-#include <iostream>
-#include <vector>
-
-#include "MQClientFactory.h"
-#include "RemoteClientConfig.h"
-#include "ClientRemotingProcessor.h"
-#include "MQClientAPIImpl.h"
-#include "MQAdminImpl.h"
-#include "DefaultMQProducer.h"
-#include "PullMessageService.h"
-#include "RebalanceService.h"
-#include "ScopedLock.h"
-#include "KPRUtil.h"
-#include "DefaultMQProducerImpl.h"
-#include "DefaultMQPushConsumerImpl.h"
-#include "MQClientException.h"
-#include "MQConsumerInner.h"
-#include "MQProducerInner.h"
-#include "UtilAll.h"
-#include "PermName.h"
-#include "MQClientManager.h"
-#include "ConsumerStatManage.h"
-#include "TopicPublishInfo.h"
-#include "MQVersion.h"
-
-namespace rmq
-{
-
-
-long MQClientFactory::LockTimeoutMillis = 3000;
-
-MQClientFactory::MQClientFactory(ClientConfig& clientConfig, int factoryIndex, const std::string& clientId)
-{
- m_clientConfig = clientConfig;
- m_factoryIndex = factoryIndex;
- m_pRemoteClientConfig = new RemoteClientConfig();
- m_pRemoteClientConfig->clientCallbackExecutorThreads = clientConfig.getClientCallbackExecutorThreads();
- m_pClientRemotingProcessor = new ClientRemotingProcessor(this);
- m_pMQClientAPIImpl = new MQClientAPIImpl(m_clientConfig, *m_pRemoteClientConfig, m_pClientRemotingProcessor);
-
- if (!m_clientConfig.getNamesrvAddr().empty())
- {
- m_pMQClientAPIImpl->updateNameServerAddressList(m_clientConfig.getNamesrvAddr());
- RMQ_INFO("user specified name server address: {%s}", m_clientConfig.getNamesrvAddr().c_str());
- }
-
- m_clientId = clientId;
-
- m_pMQAdminImpl = new MQAdminImpl(this);
- m_pPullMessageService = new PullMessageService(this);
- m_pRebalanceService = new RebalanceService(this);
- m_pDefaultMQProducer = new DefaultMQProducer(MixAll::CLIENT_INNER_PRODUCER_GROUP);
- m_pDefaultMQProducer->resetClientConfig(clientConfig);
- m_bootTimestamp = KPRUtil::GetCurrentTimeMillis();
-
- m_pFetchNameServerAddrTask = new ScheduledTask(this, &MQClientFactory::fetchNameServerAddr);
- m_pUpdateTopicRouteInfoFromNameServerTask = new ScheduledTask(this, &MQClientFactory::updateTopicRouteInfoFromNameServerTask);
- m_pCleanBrokerTask = new ScheduledTask(this, &MQClientFactory::cleanBroker);
- m_pPersistAllConsumerOffsetTask = new ScheduledTask(this, &MQClientFactory::persistAllConsumerOffsetTask);
- m_pRecordSnapshotPeriodicallyTask = new ScheduledTask(this, &MQClientFactory::recordSnapshotPeriodicallyTask);
- m_pLogStatsPeriodicallyTask = new ScheduledTask(this, &MQClientFactory::logStatsPeriodicallyTask);
-
- m_serviceState = CREATE_JUST;
-
- RMQ_INFO("created a new client Instance, FactoryIndex: {%d} ClinetID: {%s} Config: {%s} Version: {%s}",
- m_factoryIndex,
- m_clientId.c_str(),
- m_clientConfig.toString().c_str(),
- MQVersion::getVersionDesc(MQVersion::s_CurrentVersion));
-}
-
-MQClientFactory::~MQClientFactory()
-{
- delete m_pRemoteClientConfig;
- delete m_pClientRemotingProcessor;
- delete m_pMQClientAPIImpl;
- delete m_pMQAdminImpl;
- delete m_pPullMessageService;
- delete m_pRebalanceService;
- delete m_pDefaultMQProducer;
-}
-
-void MQClientFactory::start()
-{
- RMQ_DEBUG("MQClientFactory::start()");
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- switch (m_serviceState)
- {
- case CREATE_JUST:
- makesureInstanceNameIsOnly(m_clientConfig.getInstanceName());
-
- m_serviceState = START_FAILED;
- if (m_clientConfig.getNamesrvAddr().empty())
- {
- m_clientConfig.setNamesrvAddr(m_pMQClientAPIImpl->fetchNameServerAddr());
- }
-
- m_pMQClientAPIImpl->start();
- m_timerTaskManager.Init(5, 1000);
- startScheduledTask();
- m_pPullMessageService->Start();
- m_pRebalanceService->Start();
- m_pDefaultMQProducer->getDefaultMQProducerImpl()->start(false);
-
- RMQ_INFO("the client factory [%s] start OK", m_clientId.c_str());
- m_serviceState = RUNNING;
- break;
- case RUNNING:
- RMQ_WARN("MQClientFactory is already running.");
- break;
- case SHUTDOWN_ALREADY:
- RMQ_ERROR("MQClientFactory should have already been shutted down");
- break;
- case START_FAILED:
- RMQ_ERROR("MQClientFactory started failed.");
- THROW_MQEXCEPTION(MQClientException, "The Factory object start failed", -1);
- default:
- break;
- }
-}
-
-
-void MQClientFactory::shutdown()
-{
- RMQ_DEBUG("MQClientFactory::shutdown()");
- // Consumer
- if (!m_consumerTable.empty())
- {
- return;
- }
-
- // AdminExt
- if (!m_adminExtTable.empty())
- {
- return;
- }
-
- // Producer
- if (m_producerTable.size() > 1)
- {
- return;
- }
-
- RMQ_DEBUG("MQClientFactory::shutdown_begin");
- {
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- switch (m_serviceState)
- {
- case CREATE_JUST:
- break;
- case RUNNING:
- m_pDefaultMQProducer->getDefaultMQProducerImpl()->shutdown(false);
-
- for (int i = 0; i < 6; i++)
- {
- m_timerTaskManager.UnRegisterTimer(m_scheduledTaskIds[i]);
- }
-
- m_timerTaskManager.Stop();
-
- m_pPullMessageService->stop();
- m_pPullMessageService->Join();
-
- m_pMQClientAPIImpl->shutdown();
- m_pRebalanceService->stop();
- m_pRebalanceService->Join();
-
- //closesocket(m_datagramSocket);
-
- MQClientManager::getInstance()->removeClientFactory(m_clientId);
- m_serviceState = SHUTDOWN_ALREADY;
- break;
- case SHUTDOWN_ALREADY:
- break;
- default:
- break;
- }
- }
-}
-
-
-void MQClientFactory::sendHeartbeatToAllBrokerWithLock()
-{
- RMQ_DEBUG("TryLock m_lockHeartbeat: %p", &m_lockHeartbeat);
- if (m_lockHeartbeat.TryLock())
- {
- try
- {
- RMQ_DEBUG("TryLock m_lockHeartbeat ok");
- sendHeartbeatToAllBroker();
- }
- catch (...)
- {
- RMQ_ERROR("sendHeartbeatToAllBroker exception");
- }
- m_lockHeartbeat.Unlock();
- }
- else
- {
- RMQ_WARN("TryLock heartBeat fail");
- }
-}
-
-void MQClientFactory::updateTopicRouteInfoFromNameServer()
-{
- std::set<std::string> topicList;
-
- // Consumer
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_consumerTableLock);
- std::map<std::string, MQConsumerInner*>::iterator it = m_consumerTable.begin();
- for (; it != m_consumerTable.end(); it++)
- {
- MQConsumerInner* inner = it->second;
- std::set<SubscriptionData> subList = inner->subscriptions();
- std::set<SubscriptionData>::iterator it1 = subList.begin();
- for (; it1 != subList.end(); it1++)
- {
- topicList.insert((*it1).getTopic());
- }
- }
- }
-
- // Producer
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_producerTableLock);
- std::map<std::string, MQProducerInner*>::iterator it = m_producerTable.begin();
- for (; it != m_producerTable.end(); it++)
- {
- MQProducerInner* inner = it->second;
- std::set<std::string> pubList = inner->getPublishTopicList();
- topicList.insert(pubList.begin(), pubList.end());
- }
- }
-
- std::set<std::string>::iterator it2 = topicList.begin();
- for (; it2 != topicList.end(); it2++)
- {
- updateTopicRouteInfoFromNameServer(*it2);
- }
-}
-
-bool MQClientFactory::updateTopicRouteInfoFromNameServer(const std::string& topic)
-{
- return updateTopicRouteInfoFromNameServer(topic, false, NULL);
-}
-
-bool MQClientFactory::updateTopicRouteInfoFromNameServer(const std::string& topic,
- bool isDefault,
- DefaultMQProducer* pDefaultMQProducer)
-{
- RMQ_DEBUG("TryLock m_lockNamesrv: 0x%p, topic: [%s]", &m_lockNamesrv, topic.c_str());
- if (m_lockNamesrv.TryLock(MQClientFactory::LockTimeoutMillis))
- {
- RMQ_DEBUG("TryLock m_lockNamesrv ok");
- TopicRouteDataPtr topicRouteData = NULL;
- try
- {
- if (isDefault && pDefaultMQProducer != NULL)
- {
- topicRouteData =
- m_pMQClientAPIImpl->getDefaultTopicRouteInfoFromNameServer(
- pDefaultMQProducer->getCreateTopicKey(), 1000 * 3);
- if (topicRouteData.ptr() != NULL)
- {
- std::list<QueueData> dataList = topicRouteData->getQueueDatas();
-
- std::list<QueueData>::iterator it = dataList.begin();
- for (; it != dataList.end(); it++)
- {
- QueueData data = *it;
-
- int queueNums =
- std::min<int>(pDefaultMQProducer->getDefaultTopicQueueNums(),
- data.readQueueNums);
- data.readQueueNums = (queueNums);
- data.writeQueueNums = (queueNums);
- }
- }
- }
- else
- {
- topicRouteData =
- m_pMQClientAPIImpl->getTopicRouteInfoFromNameServer(topic, 1000 * 3);
- }
-
- if (topicRouteData.ptr() != NULL)
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_topicRouteTableLock);
- std::map<std::string, TopicRouteData>::iterator it = m_topicRouteTable.find(topic);
- bool changed = false;
-
- if (it != m_topicRouteTable.end())
- {
- changed = topicRouteDataIsChange(it->second, *topicRouteData);
- if (!changed)
- {
- changed = isNeedUpdateTopicRouteInfo(topic);
- if (changed)
- {
- RMQ_INFO("the topic[{%s}] route info changed, old[{%s}] ,new[{%s}]",
- topic.c_str(), it->second.toString().c_str(),
- topicRouteData->toString().c_str());
- }
- }
- }
- else
- {
- changed = true;
- }
-
- if (changed)
- {
- TopicRouteData cloneTopicRouteData = *topicRouteData;
-
- std::list<BrokerData> dataList = topicRouteData->getBrokerDatas();
-
- std::list<BrokerData>::iterator it = dataList.begin();
- for (; it != dataList.end(); it++)
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_brokerAddrTableLock);
- m_brokerAddrTable[(*it).brokerName] = (*it).brokerAddrs;
- }
-
- {
- TopicPublishInfoPtr publishInfo =
- topicRouteData2TopicPublishInfo(topic, *topicRouteData);
- publishInfo->setHaveTopicRouterInfo(true);
-
- kpr::ScopedRLock<kpr::RWMutex> lock(m_producerTableLock);
- std::map<std::string, MQProducerInner*>::iterator it = m_producerTable.begin();
- for (; it != m_producerTable.end(); it++)
- {
- MQProducerInner* impl = it->second;
- if (impl)
- {
- impl->updateTopicPublishInfo(topic, *publishInfo);
- }
- }
- }
-
- {
- std::set<MessageQueue>* subscribeInfo =
- topicRouteData2TopicSubscribeInfo(topic, *topicRouteData);
-
- kpr::ScopedRLock<kpr::RWMutex> lock(m_consumerTableLock);
- std::map<std::string, MQConsumerInner*>::iterator it = m_consumerTable.begin();
- for (; it != m_consumerTable.end(); it++)
- {
- MQConsumerInner* impl = it->second;
- if (impl)
- {
- impl->updateTopicSubscribeInfo(topic, *subscribeInfo);
- }
- }
- delete subscribeInfo;
- }
-
- m_topicRouteTable[topic] = cloneTopicRouteData;
- m_lockNamesrv.Unlock();
- RMQ_DEBUG("UnLock m_lockNamesrv ok");
-
- RMQ_INFO("topicRouteTable.put[%s] = TopicRouteData[%s]",
- topic.c_str(), cloneTopicRouteData.toString().c_str());
- return true;
- }
- }
- else
- {
- //TODO log?
- RMQ_WARN("updateTopicRouteInfoFromNameServer, getTopicRouteInfoFromNameServer return null, Topic: {%s}",
- topic.c_str());
- }
- }
- catch (const std::exception& e)
- {
- if (!(topic.find(MixAll::RETRY_GROUP_TOPIC_PREFIX) == 0) && topic != MixAll::DEFAULT_TOPIC)
- {
- RMQ_WARN("updateTopicRouteInfoFromNameServer Exception: %s", e.what());
- }
- }
- catch (...)
- {
- RMQ_WARN("updateTopicRouteInfoFromNameServer unknow Exception");
- }
-
- m_lockNamesrv.Unlock();
- RMQ_DEBUG("UnLock m_lockNamesrv ok");
- }
- else
- {
- RMQ_WARN("TryLock m_lockNamesrv timeout %ldms", MQClientFactory::LockTimeoutMillis);
- }
-
- return false;
-}
-
-TopicPublishInfo* MQClientFactory::topicRouteData2TopicPublishInfo(const std::string& topic,
- TopicRouteData& route)
-{
- TopicPublishInfo* info = new TopicPublishInfo();
- if (!route.getOrderTopicConf().empty())
- {
- std::vector<std::string> brokers;
- UtilAll::Split(brokers, route.getOrderTopicConf(), ";");
- for (size_t i = 0; i < brokers.size(); i++)
- {
- std::vector<std::string> item;
- UtilAll::Split(item, brokers[i], ":");
- int nums = atoi(item[1].c_str());
- for (int i = 0; i < nums; i++)
- {
- MessageQueue mq(topic, item[0], i);
- info->getMessageQueueList().push_back(mq);
- }
- }
-
- info->setOrderTopic(true);
- }
- else
- {
- std::list<QueueData> qds = route.getQueueDatas();
- qds.sort();
- std::list<QueueData>::iterator it = qds.begin();
- for (; it != qds.end(); it++)
- {
- QueueData& qd = (*it);
- if (PermName::isWriteable(qd.perm))
- {
- bool find = false;
- BrokerData brokerData;
- std::list<BrokerData> bds = route.getBrokerDatas();
- std::list<BrokerData>::iterator it1 = bds.begin();
-
- for (; it1 != bds.end(); it1++)
- {
- BrokerData& bd = (*it1);
- if (bd.brokerName == qd.brokerName)
- {
- brokerData = bd;
- find = true;
- break;
- }
- }
-
- if (!find)
- {
- continue;
- }
-
- if (brokerData.brokerAddrs.find(MixAll::MASTER_ID) == brokerData.brokerAddrs.end())
- {
- continue;
- }
-
- for (int i = 0; i < qd.writeQueueNums; i++)
- {
- MessageQueue mq(topic, qd.brokerName, i);
- info->getMessageQueueList().push_back(mq);
- }
- }
- }
-
- info->setOrderTopic(false);
- }
-
- return info;
-}
-
-std::set<MessageQueue>* MQClientFactory::topicRouteData2TopicSubscribeInfo(const std::string& topic,
- TopicRouteData& route)
-{
- std::set<MessageQueue>* mqList = new std::set<MessageQueue>();
- std::list<QueueData> qds = route.getQueueDatas();
- std::list<QueueData>::iterator it = qds.begin();
- for (; it != qds.end(); it++)
- {
- QueueData& qd = (*it);
- if (PermName::isReadable(qd.perm))
- {
- for (int i = 0; i < qd.readQueueNums; i++)
- {
- MessageQueue mq(topic, qd.brokerName, i);
- mqList->insert(mq);
- }
- }
- }
-
- return mqList;
-}
-
-bool MQClientFactory::registerConsumer(const std::string& group, MQConsumerInner* pConsumer)
-{
- if (group.empty() || pConsumer == NULL)
- {
- return false;
- }
-
- kpr::ScopedWLock<kpr::RWMutex> lock(m_consumerTableLock);
- if (m_consumerTable.find(group) != m_consumerTable.end())
- {
- return false;
- }
- m_consumerTable[group] = pConsumer;
-
- return true;
-}
-
-void MQClientFactory::unregisterConsumer(const std::string& group)
-{
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_consumerTableLock);
- m_consumerTable.erase(group);
- }
- unregisterClientWithLock("", group);
-}
-
-bool MQClientFactory::registerProducer(const std::string& group, DefaultMQProducerImpl* pProducer)
-{
- if (group.empty() || pProducer == NULL)
- {
- return false;
- }
-
- kpr::ScopedWLock<kpr::RWMutex> lock(m_producerTableLock);
- if (m_producerTable.find(group) != m_producerTable.end())
- {
- return false;
- }
- m_producerTable[group] = pProducer;
-
- return true;
-}
-
-void MQClientFactory::unregisterProducer(const std::string& group)
-{
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_producerTableLock);
- m_producerTable.erase(group);
- }
- unregisterClientWithLock(group, "");
-}
-
-bool MQClientFactory::registerAdminExt(const std::string& group, MQAdminExtInner* pAdmin)
-{
- if (group.empty() || pAdmin == NULL)
- {
- return false;
- }
-
- kpr::ScopedWLock<kpr::RWMutex> lock(m_adminExtTableLock);
- if (m_adminExtTable.find(group) != m_adminExtTable.end())
- {
- return false;
- }
- m_adminExtTable[group] = pAdmin;
-
- return true;
-}
-
-void MQClientFactory::unregisterAdminExt(const std::string& group)
-{
- kpr::ScopedWLock<kpr::RWMutex> lock(m_adminExtTableLock);
- m_adminExtTable.erase(group);
-}
-
-void MQClientFactory::rebalanceImmediately()
-{
- m_pRebalanceService->wakeup();
-}
-
-void MQClientFactory::doRebalance()
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_consumerTableLock);
- std::map<std::string, MQConsumerInner*>::iterator it = m_consumerTable.begin();
- for (; it != m_consumerTable.end(); it++)
- {
- MQConsumerInner* impl = it->second;
- if (impl != NULL)
- {
- try
- {
- impl->doRebalance();
- }
- catch (std::exception& e)
- {
- RMQ_ERROR("doRebalance exception, %s", e.what());
- }
- catch (...)
- {
- RMQ_ERROR("doRebalance unknow exception");
- }
- }
- }
-}
-
-MQProducerInner* MQClientFactory::selectProducer(const std::string& group)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_producerTableLock);
- std::map<std::string, MQProducerInner*>::iterator it = m_producerTable.find(group);
- if (it != m_producerTable.end())
- {
- return it->second;
- }
-
- return NULL;
-}
-
-MQConsumerInner* MQClientFactory::selectConsumer(const std::string& group)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_consumerTableLock);
- std::map<std::string, MQConsumerInner*>::iterator it = m_consumerTable.find(group);
- if (it != m_consumerTable.end())
- {
- return it->second;
- }
-
- return NULL;
-}
-
-FindBrokerResult MQClientFactory::findBrokerAddressInAdmin(const std::string& brokerName)
-{
- //TODO
- FindBrokerResult result;
- std::string brokerAddr;
- bool slave = false;
- bool found = false;
-
- kpr::ScopedRLock<kpr::RWMutex> lock(m_brokerAddrTableLock);
- typeof(m_brokerAddrTable.begin()) it = m_brokerAddrTable.find(brokerName);
- if (it != m_brokerAddrTable.end())
- {
- // TODO more slave
- typeof(it->second.begin()) it1 = it->second.begin();
- for (; it1 != it->second.end(); it1++)
- {
- int brockerId = it1->first;
- brokerAddr = it1->second;
- if (!brokerAddr.empty())
- {
- found = true;
- if (MixAll::MASTER_ID == brockerId)
- {
- slave = false;
- }
- else
- {
- slave = true;
- }
- break;
- }
- }
- }
-
- if (found)
- {
- result.brokerAddr = brokerAddr;
- result.slave = slave;
- }
-
- return result;
-}
-
-std::string MQClientFactory::findBrokerAddressInPublish(const std::string& brokerName)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_brokerAddrTableLock);
- std::map<std::string, std::map<int, std::string> >::iterator it = m_brokerAddrTable.find(brokerName);
- if (it != m_brokerAddrTable.end())
- {
- std::map<int, std::string>::iterator it1 = it->second.find(MixAll::MASTER_ID);
- if (it1 != it->second.end())
- {
- return it1->second;
- }
- }
-
- return "";
-}
-
-FindBrokerResult MQClientFactory::findBrokerAddressInSubscribe(const std::string& brokerName,
- long brokerId,
- bool onlyThisBroker)
-{
- std::string brokerAddr = "";
- bool slave = false;
- bool found = false;
-
- kpr::ScopedRLock<kpr::RWMutex> lock(m_brokerAddrTableLock);
- std::map<std::string, std::map<int, std::string> >::iterator it = m_brokerAddrTable.find(brokerName);
- if (it != m_brokerAddrTable.end())
- {
- std::map<int, std::string>::iterator it1 = it->second.find(brokerId);
- if (it1 != it->second.end())
- {
- brokerAddr = it1->second;
- slave = (brokerId != MixAll::MASTER_ID);
- found = true;
- }
- else
- {
- it1 = it->second.begin();
- brokerAddr = it1->second;
- slave = (brokerId != MixAll::MASTER_ID);
- found = true;
- }
- }
-
- FindBrokerResult result;
- result.brokerAddr = brokerAddr;
- result.slave = slave;
-
- return result;
-}
-
-std::list<std::string> MQClientFactory::findConsumerIdList(const std::string& topic, const std::string& group)
-{
- std::string brokerAddr = findBrokerAddrByTopic(topic);
-
- if (brokerAddr.empty())
- {
- updateTopicRouteInfoFromNameServer(topic);
- brokerAddr = findBrokerAddrByTopic(topic);
- }
-
- if (!brokerAddr.empty())
- {
- try
- {
- return m_pMQClientAPIImpl->getConsumerIdListByGroup(brokerAddr, group, 3000);
- }
- catch (...)
- {
- RMQ_WARN("getConsumerIdListByGroup exception, %s, %s", brokerAddr.c_str(), group.c_str());
- }
- }
-
- std::list<std::string> ids;
-
- return ids;
-}
-
-std::string MQClientFactory::findBrokerAddrByTopic(const std::string& topic)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_topicRouteTableLock);
-
- std::map<std::string, TopicRouteData>::iterator it = m_topicRouteTable.find(topic);
- if (it != m_topicRouteTable.end())
- {
- const std::list<BrokerData>& brokers = it->second.getBrokerDatas();
-
- if (!brokers.empty())
- {
- BrokerData bd = brokers.front();
- return TopicRouteData::selectBrokerAddr(bd);
- }
- }
-
- return "";
-}
-
-TopicRouteData MQClientFactory::getAnExistTopicRouteData(const std::string& topic)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_topicRouteTableLock);
-
- std::map<std::string, TopicRouteData>::iterator it = m_topicRouteTable.find(topic);
- if (it != m_topicRouteTable.end())
- {
- return it->second;
- }
-
- TopicRouteData data;
- return data;
-}
-
-MQClientAPIImpl* MQClientFactory::getMQClientAPIImpl()
-{
- return m_pMQClientAPIImpl;
-}
-
-MQAdminImpl* MQClientFactory::getMQAdminImpl()
-{
- return m_pMQAdminImpl;
-}
-
-std::string MQClientFactory::getClientId()
-{
- return m_clientId;
-}
-
-long long MQClientFactory::getBootTimestamp()
-{
- return m_bootTimestamp;
-}
-
-PullMessageService* MQClientFactory::getPullMessageService()
-{
- return m_pPullMessageService;
-}
-
-
-DefaultMQProducer* MQClientFactory::getDefaultMQProducer()
-{
- return m_pDefaultMQProducer;
-}
-
-void MQClientFactory::sendHeartbeatToAllBroker()
-{
- RMQ_DEBUG("sendHeartbeatToAllBroker begin");
-
- HeartbeatData heartbeatData;
- this->prepareHeartbeatData(heartbeatData);
-
- bool producerEmpty = heartbeatData.getProducerDataSet().empty();
- bool consumerEmpty = heartbeatData.getConsumerDataSet().empty();
- if (producerEmpty && consumerEmpty)
- {
- RMQ_ERROR("sending hearbeat, but no consumer and no producer");
- return;
- }
-
- RMQ_DEBUG("clientId=%s, m_brokerAddrTable=%u", heartbeatData.getClientID().c_str(), (unsigned)m_brokerAddrTable.size());
-
- kpr::ScopedRLock<kpr::RWMutex> lock(m_brokerAddrTableLock);
- std::map<std::string, std::map<int, std::string> >::iterator it = m_brokerAddrTable.begin();
- for (; it != m_brokerAddrTable.end(); it++)
- {
- std::map<int, std::string>::iterator it1 = it->second.begin();
- for (; it1 != it->second.end(); it1++)
- {
- std::string& addr = it1->second;
- if (!addr.empty())
- {
- if (consumerEmpty)
- {
- if (it1->first != MixAll::MASTER_ID)
- {
- continue;
- }
- }
-
- try
- {
- m_pMQClientAPIImpl->sendHearbeat(addr, &heartbeatData, 3000);
- RMQ_INFO("send heartbeat to broker[{%s} {%d} {%s}] success",
- it->first.c_str(), it1->first, addr.c_str());
- RMQ_INFO("HeartbeatData %s", heartbeatData.toString().c_str());
- }
- catch (...)
- {
- RMQ_ERROR("send heart beat to broker exception");
- }
- }
- }
- }
-
- RMQ_DEBUG("sendHeartbeatToAllBroker end");
-}
-
-void MQClientFactory::prepareHeartbeatData(HeartbeatData& heartbeatData)
-{
- // clientID
- heartbeatData.setClientID(m_clientId);
-
- // Consumer
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_consumerTableLock);
- std::map<std::string, MQConsumerInner*>::iterator it = m_consumerTable.begin();
- for (; it != m_consumerTable.end(); it++)
- {
- MQConsumerInner* inner = it->second;
- if (inner)
- {
- ConsumerData consumerData;
- consumerData.groupName = inner->groupName();
- consumerData.consumeType = inner->consumeType();
- consumerData.messageModel = inner->messageModel();
- consumerData.consumeFromWhere = inner->consumeFromWhere();
- consumerData.subscriptionDataSet = inner->subscriptions();
-
- heartbeatData.getConsumerDataSet().insert(consumerData);
- }
- }
- }
-
- // Producer
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_producerTableLock);
- std::map<std::string, MQProducerInner*>::iterator it = m_producerTable.begin();
- for (; it != m_producerTable.end(); it++)
- {
- MQProducerInner* inner = it->second;
- if (inner)
- {
- ProducerData producerData;
- producerData.groupName = (it->first);
-
- heartbeatData.getProducerDataSet().insert(producerData);
- }
- }
- }
-
- return;
-}
-
-void MQClientFactory::makesureInstanceNameIsOnly(const std::string& instanceName)
-{
- //TODO
-}
-
-
-void MQClientFactory::fetchNameServerAddr()
-{
- //1000 * 10, 1000 * 60 * 2
- try
- {
- RMQ_DEBUG("Task: fetchNameServerAddr");
- m_pMQClientAPIImpl->fetchNameServerAddr();
- }
- catch (...)
- {
- RMQ_ERROR("Task: fetchNameServerAddr exception");
- }
-}
-
-void MQClientFactory::updateTopicRouteInfoFromNameServerTask()
-{
- //10, 1000 * 30, m_clientConfig.getPollNameServerInteval()
- try
- {
- RMQ_DEBUG("Task: updateTopicRouteInfoFromNameServerTask");
- updateTopicRouteInfoFromNameServer();
- }
- catch (...)
- {
- RMQ_ERROR("Task: fetchNameServerAddr exception");
- }
-}
-
-void MQClientFactory::cleanBroker()
-{
- //1000, 1000 * 30, m_clientConfig.getHeartbeatBrokerInterval()
- try
- {
- RMQ_DEBUG("Task: cleanBroker");
- cleanOfflineBroker();
- sendHeartbeatToAllBrokerWithLock();
- }
- catch (...)
- {
- RMQ_ERROR("Task: cleanBroker exception");
- }
-}
-
-void MQClientFactory::persistAllConsumerOffsetTask()
-{
- //1000 * 10, 1000 * 5, m_clientConfig.getPersistConsumerOffsetInterval()
- try
- {
- RMQ_DEBUG("Task: persistAllConsumerOffsetTask");
- persistAllConsumerOffset();
- }
- catch (...)
- {
- RMQ_ERROR("Task: persistAllConsumerOffsetTask exception");
- }
-}
-
-void MQClientFactory::recordSnapshotPeriodicallyTask()
-{
- // 1000 * 10, 1000,
- try
- {
- //RMQ_DEBUG("Task: recordSnapshotPeriodicallyTask");
- recordSnapshotPeriodically();
- }
- catch (...)
- {
- RMQ_ERROR("Task: recordSnapshotPeriodically exception");
- }
-}
-
-void MQClientFactory::logStatsPeriodicallyTask()
-{
- // 1000 * 10, 1000 * 60
- try
- {
- RMQ_DEBUG("Task: logStatsPeriodicallyTask");
- logStatsPeriodically();
- }
- catch (...)
- {
- RMQ_ERROR("Task: logStatsPeriodicallyTask exception");
- }
-}
-
-void MQClientFactory::startScheduledTask()
-{
- m_scheduledTaskIds[0] = m_timerTaskManager.RegisterTimer(1000 * 10, 1000 * 60 * 2, m_pFetchNameServerAddrTask);
-
- m_scheduledTaskIds[1] = m_timerTaskManager.RegisterTimer(10, m_clientConfig.getPollNameServerInterval(), m_pUpdateTopicRouteInfoFromNameServerTask);
-
- m_scheduledTaskIds[2] = m_timerTaskManager.RegisterTimer(1000, m_clientConfig.getHeartbeatBrokerInterval(), m_pCleanBrokerTask);
-
- m_scheduledTaskIds[3] = m_timerTaskManager.RegisterTimer(1000 * 10, m_clientConfig.getPersistConsumerOffsetInterval(), m_pPersistAllConsumerOffsetTask);
-
- m_scheduledTaskIds[4] = m_timerTaskManager.RegisterTimer(1000 * 10, 1000, m_pRecordSnapshotPeriodicallyTask);
- m_scheduledTaskIds[5] = m_timerTaskManager.RegisterTimer(1000 * 10, 1000 * 60, m_pLogStatsPeriodicallyTask);
-}
-
-void MQClientFactory::cleanOfflineBroker()
-{
- RMQ_DEBUG("TryLock m_lockNamesrv: 0x%p", &m_lockNamesrv);
- if (m_lockNamesrv.TryLock(MQClientFactory::LockTimeoutMillis))
- {
- RMQ_DEBUG("TryLock m_lockNamesrv ok");
- std::map<std::string, std::map<int, std::string> > updatedTable;
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_brokerAddrTableLock);
- std::map<std::string, std::map<int, std::string> >::iterator it = m_brokerAddrTable.begin();
-
- for (; it != m_brokerAddrTable.end(); it++)
- {
- std::map<int, std::string> cloneTable = it->second;
-
- std::map<int, std::string>::iterator it1 = cloneTable.begin();
-
- for (; it1 != cloneTable.end();)
- {
- std::string& addr = it1->second;
- if (!isBrokerAddrExistInTopicRouteTable(addr))
- {
- std::map<int, std::string>::iterator itTmp = it1;
- it1++;
- cloneTable.erase(itTmp);
- continue;
- }
-
- it1++;
- }
-
- if (!cloneTable.empty())
- {
- updatedTable[it->first] = cloneTable;
- }
- }
- }
-
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_brokerAddrTableLock);
- m_brokerAddrTable.clear();
- m_brokerAddrTable = updatedTable;
- }
-
- m_lockNamesrv.Unlock();
- RMQ_DEBUG("UnLock m_lockNamesrv ok");
- }
- else
- {
- RMQ_DEBUG("TryLock m_lockNamesrv fail");
- }
-}
-
-bool MQClientFactory::isBrokerAddrExistInTopicRouteTable(const std::string& addr)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_topicRouteTableLock);
-
- std::map<std::string, TopicRouteData>::iterator it = m_topicRouteTable.begin();
- for (; it != m_topicRouteTable.end(); it++)
- {
- const std::list<BrokerData>& brokers = it->second.getBrokerDatas();
- std::list<BrokerData>::const_iterator it1 = brokers.begin();
-
- for (; it1 != brokers.end(); it1++)
- {
- std::map<int, std::string>::const_iterator it2 = (*it1).brokerAddrs.begin();
- for (; it2 != (*it1).brokerAddrs.end(); it2++)
- {
- if (it2->second.find(addr) != std::string::npos)
- {
- return true;
- }
- }
- }
- }
-
- return false;
-}
-
-void MQClientFactory::recordSnapshotPeriodically()
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_consumerTableLock);
- std::map<std::string, MQConsumerInner*>::iterator it = m_consumerTable.begin();
- for (; it != m_consumerTable.end(); it++)
- {
- MQConsumerInner* inner = it->second;
- if (inner)
- {
- DefaultMQPushConsumerImpl* consumer = dynamic_cast<DefaultMQPushConsumerImpl*>(inner);
- if (consumer)
- {
- consumer->getConsumerStatManager()->recordSnapshotPeriodically();
- }
- }
- }
-}
-
-void MQClientFactory::logStatsPeriodically()
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_consumerTableLock);
- std::map<std::string, MQConsumerInner*>::iterator it = m_consumerTable.begin();
- for (; it != m_consumerTable.end(); it++)
- {
- MQConsumerInner* inner = it->second;
- if (inner)
- {
- DefaultMQPushConsumerImpl* consumer = dynamic_cast<DefaultMQPushConsumerImpl*>(inner);
- if (consumer)
- {
- std::string group = it->first;
- consumer->getConsumerStatManager()->logStatsPeriodically(group, m_clientId);
- }
- }
- }
-}
-
-void MQClientFactory::persistAllConsumerOffset()
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_consumerTableLock);
- RMQ_DEBUG("persistAllConsumerOffset, m_consumerTable.size=%u", (unsigned)m_consumerTable.size());
- std::map<std::string, MQConsumerInner*>::iterator it = m_consumerTable.begin();
- for (; it != m_consumerTable.end(); it++)
- {
- MQConsumerInner* inner = it->second;
- if (inner)
- {
- inner->persistConsumerOffset();
- }
- }
-}
-
-bool MQClientFactory::topicRouteDataIsChange(TopicRouteData& olddata, TopicRouteData& nowdata)
-{
- TopicRouteData old = olddata;
- TopicRouteData now = nowdata;
-
- old.getQueueDatas().sort();
- old.getBrokerDatas().sort();
- now.getQueueDatas().sort();
- now.getBrokerDatas().sort();
-
- return !(old == now);
-
-}
-
-bool MQClientFactory::isNeedUpdateTopicRouteInfo(const std::string& topic)
-{
- bool result = false;
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_producerTableLock);
- std::map<std::string, MQProducerInner*>::iterator it = m_producerTable.begin();
- for (; it != m_producerTable.end(); it++)
- {
- MQProducerInner* inner = it->second;
- if (inner)
- {
- result = inner->isPublishTopicNeedUpdate(topic);
- }
- }
- }
-
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_consumerTableLock);
- std::map<std::string, MQConsumerInner*>::iterator it = m_consumerTable.begin();
- for (; it != m_consumerTable.end(); it++)
- {
- MQConsumerInner* inner = it->second;
- if (inner)
- {
- result = inner->isSubscribeTopicNeedUpdate(topic);
- }
- }
- }
-
- return result;
-}
-
-void MQClientFactory::unregisterClientWithLock(const std::string& producerGroup, const std::string& consumerGroup)
-{
- RMQ_DEBUG("TryLock m_lockHeartbeat: 0x%p", &m_lockHeartbeat);
- if (m_lockHeartbeat.TryLock(MQClientFactory::LockTimeoutMillis))
- {
- try
- {
- RMQ_DEBUG("TryLock m_lockHeartbeat ok");
- unregisterClient(producerGroup, consumerGroup);
- }
- catch (...)
- {
- RMQ_ERROR("unregisterClientWithLock exception, %s %s",
- producerGroup.c_str(), consumerGroup.c_str());
- }
- m_lockHeartbeat.Unlock();
- RMQ_DEBUG("Unlock m_lockHeartbeat ok");
- }
- else
- {
- RMQ_WARN("TryLock m_lockHeartbeat fail");
- }
-}
-
-void MQClientFactory::unregisterClient(const std::string& producerGroup, const std::string& consumerGroup)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_brokerAddrTableLock);
- std::map<std::string, std::map<int, std::string> >::iterator it = m_brokerAddrTable.begin();
- for (; it != m_brokerAddrTable.end(); it++)
- {
- std::map<int, std::string>::iterator it1 = it->second.begin();
-
- for (; it1 != it->second.end(); it1++)
- {
- std::string& addr = it1->second;
-
- if (!addr.empty())
- {
- try
- {
- m_pMQClientAPIImpl->unregisterClient(addr, m_clientId, producerGroup,
- consumerGroup, 3000);
- }
- catch (...)
- {
- RMQ_ERROR("unregister client exception from broker: %s", addr.c_str());
- }
- }
- }
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/MQClientFactory.h b/rocketmq-client4cpp/src/MQClientFactory.h
deleted file mode 100755
index 8f56a277..00000000
--- a/rocketmq-client4cpp/src/MQClientFactory.h
+++ /dev/null
@@ -1,214 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MQCLIENTFACTORY_H__
-#define __MQCLIENTFACTORY_H__
-
-#include <set>
-#include <string>
-#include <list>
-
-#include "SocketUtil.h"
-#include "TopicRouteData.h"
-#include "FindBrokerResult.h"
-#include "ClientConfig.h"
-#include "Mutex.h"
-#include "ServiceState.h"
-#include "TimerTaskManager.h"
-
-namespace rmq
-{
- class ClientConfig;
- class MessageQueue;
- class MQAdminExtInner;
- class MQClientAPIImpl;
- class MQAdminImpl;
- class PullMessageService;
- class HeartbeatData;
- class RemoteClientConfig;
- class ClientRemotingProcessor;
- class RebalanceService;
- class DefaultMQProducer;
- class TopicPublishInfo;
- class MQProducerInner;
- class MQConsumerInner;
- class DefaultMQProducerImpl;
-
- class MQClientFactory
- {
- public:
- MQClientFactory(ClientConfig& clientConfig, int factoryIndex, const std::string& clientId);
- ~MQClientFactory();
-
- void start();
- void shutdown();
- void sendHeartbeatToAllBrokerWithLock();
- void updateTopicRouteInfoFromNameServer();
- bool updateTopicRouteInfoFromNameServer(const std::string& topic);
-
- bool updateTopicRouteInfoFromNameServer(const std::string& topic, bool isDefault,
- DefaultMQProducer* pDefaultMQProducer);
-
- static TopicPublishInfo* topicRouteData2TopicPublishInfo(const std::string& topic,
- TopicRouteData& route);
-
- static std::set<MessageQueue>* topicRouteData2TopicSubscribeInfo(const std::string& topic,
- TopicRouteData& route);
-
- bool registerConsumer(const std::string& group, MQConsumerInner* pConsumer);
- void unregisterConsumer(const std::string& group);
-
- bool registerProducer(const std::string& group, DefaultMQProducerImpl* pProducer);
- void unregisterProducer(const std::string& group);
-
- bool registerAdminExt(const std::string& group, MQAdminExtInner* pAdmin);
- void unregisterAdminExt(const std::string& group);
-
- void rebalanceImmediately();
- void doRebalance();
-
- MQProducerInner* selectProducer(const std::string& group);
- MQConsumerInner* selectConsumer(const std::string& group);
-
- FindBrokerResult findBrokerAddressInAdmin(const std::string& brokerName);
- std::string findBrokerAddressInPublish(const std::string& brokerName);
- FindBrokerResult findBrokerAddressInSubscribe(//
- const std::string& brokerName,//
- long brokerId,//
- bool onlyThisBroker);
-
- std::list<std::string> findConsumerIdList(const std::string& topic, const std::string& group);
- std::string findBrokerAddrByTopic(const std::string& topic);
- TopicRouteData getAnExistTopicRouteData(const std::string& topic);
- MQClientAPIImpl* getMQClientAPIImpl();
- MQAdminImpl* getMQAdminImpl();
- std::string getClientId();
- long long getBootTimestamp();
- PullMessageService* getPullMessageService();
- DefaultMQProducer* getDefaultMQProducer();
-
- private:
- void sendHeartbeatToAllBroker();
- //HeartbeatData* prepareHeartbeatData();
- void prepareHeartbeatData(HeartbeatData& heartbeatData);
-
- void makesureInstanceNameIsOnly(const std::string& instanceName);
- void startScheduledTask();
-
-
- void cleanOfflineBroker();
- bool isBrokerAddrExistInTopicRouteTable(const std::string& addr);
- void recordSnapshotPeriodically();
- void logStatsPeriodically();
- void persistAllConsumerOffset();
- bool topicRouteDataIsChange(TopicRouteData& olddata, TopicRouteData& nowdata);
- bool isNeedUpdateTopicRouteInfo(const std::string& topic);
- void unregisterClientWithLock(const std::string& producerGroup, const std::string& consumerGroup);
- void unregisterClient(const std::string& producerGroup, const std::string& consumerGroup);
-
- typedef void (MQClientFactory::*pScheduledFunc)();
-
- class ScheduledTask : public kpr::TimerTask
- {
- public:
- ScheduledTask(MQClientFactory* pMQClientFactory, pScheduledFunc pScheduled)
- : m_pMQClientFactory(pMQClientFactory), m_pScheduled(pScheduled)
- {
- }
-
- virtual void DoTask()
- {
- (m_pMQClientFactory->*m_pScheduled)();
- }
-
- private:
- MQClientFactory* m_pMQClientFactory;
- pScheduledFunc m_pScheduled;
- };
- typedef kpr::RefHandleT<ScheduledTask> ScheduledTaskPtr;
-
- // schedule task
- void fetchNameServerAddr();
- void updateTopicRouteInfoFromNameServerTask();
- void cleanBroker();
- void persistAllConsumerOffsetTask();
- void recordSnapshotPeriodicallyTask();
- void logStatsPeriodicallyTask();
-
- private:
- static long LockTimeoutMillis;
- ClientConfig m_clientConfig;
- int m_factoryIndex;
- std::string m_clientId;
- long long m_bootTimestamp;
-
- // Producer
- //group --> MQProducerInner
- std::map<std::string, MQProducerInner*> m_producerTable;
- kpr::RWMutex m_producerTableLock;
-
- // Consumer
- //group --> MQConsumerInner
- std::map<std::string, MQConsumerInner*> m_consumerTable;
- kpr::RWMutex m_consumerTableLock;
-
- // AdminExt
- // group --> MQAdminExtInner
- std::map<std::string, MQAdminExtInner*> m_adminExtTable;
- kpr::RWMutex m_adminExtTableLock;
-
- RemoteClientConfig* m_pRemoteClientConfig;
-
- MQClientAPIImpl* m_pMQClientAPIImpl;
- MQAdminImpl* m_pMQAdminImpl;
-
- /// Topic---> TopicRouteData
- std::map<std::string, TopicRouteData> m_topicRouteTable;
- kpr::RWMutex m_topicRouteTableLock;
-
- kpr::Mutex m_mutex;
- kpr::Mutex m_lockNamesrv;
-
- kpr::Mutex m_lockHeartbeat;
-
- //-----brokerName
- // ------brokerid addr
- // ------brokerid addr
- std::map<std::string, std::map<int, std::string> > m_brokerAddrTable;
- kpr::RWMutex m_brokerAddrTableLock;
-
- // ��ʱ�߳�
- kpr::TimerTaskManager m_timerTaskManager;
- ScheduledTaskPtr m_pFetchNameServerAddrTask;
- ScheduledTaskPtr m_pUpdateTopicRouteInfoFromNameServerTask;
- ScheduledTaskPtr m_pCleanBrokerTask;
- ScheduledTaskPtr m_pPersistAllConsumerOffsetTask;
- ScheduledTaskPtr m_pRecordSnapshotPeriodicallyTask;
- ScheduledTaskPtr m_pLogStatsPeriodicallyTask;
-
- int m_scheduledTaskIds[6];
-
- ClientRemotingProcessor* m_pClientRemotingProcessor;
- PullMessageService* m_pPullMessageService;
- RebalanceService* m_pRebalanceService;
- DefaultMQProducer* m_pDefaultMQProducer;
- ServiceState m_serviceState;
-
- //SOCKET m_datagramSocket;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/MQClientManager.cpp b/rocketmq-client4cpp/src/MQClientManager.cpp
deleted file mode 100755
index b3041fcf..00000000
--- a/rocketmq-client4cpp/src/MQClientManager.cpp
+++ /dev/null
@@ -1,75 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "MQClientManager.h"
-#include "ScopedLock.h"
-#include "MQClientFactory.h"
-#include "ClientConfig.h"
-
-namespace rmq
-{
-
-
-MQClientManager* MQClientManager::s_instance = new MQClientManager();
-
-MQClientManager::MQClientManager()
-{
-
-}
-
-MQClientManager::~MQClientManager()
-{
-
-}
-
-MQClientManager* MQClientManager::getInstance()
-{
- return s_instance;
-}
-
-MQClientFactory* MQClientManager::getAndCreateMQClientFactory(ClientConfig& clientConfig)
-{
- std::string clientId = clientConfig.buildMQClientId();
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- std::map<std::string, MQClientFactory*>::iterator it = m_factoryTable.find(clientId);
-
- if (it != m_factoryTable.end())
- {
- return it->second;
- }
- else
- {
- MQClientFactory* factory = new MQClientFactory(clientConfig, m_factoryIndexGenerator++, clientId);
-
- m_factoryTable[clientId] = factory;
-
- return factory;
- }
-}
-
-void MQClientManager::removeClientFactory(const std::string& clientId)
-{
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- std::map<std::string, MQClientFactory*>::iterator it = m_factoryTable.find(clientId);
-
- if (it != m_factoryTable.end())
- {
- //delete it->second;
- m_factoryTable.erase(it);
- }
-}
-
-}
-
diff --git a/rocketmq-client4cpp/src/MQClientManager.h b/rocketmq-client4cpp/src/MQClientManager.h
deleted file mode 100755
index 742f8bb9..00000000
--- a/rocketmq-client4cpp/src/MQClientManager.h
+++ /dev/null
@@ -1,49 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MQCLIENTMANAGER_H__
-#define __MQCLIENTMANAGER_H__
-
-#include <string>
-#include <map>
-#include "Mutex.h"
-#include "AtomicValue.h"
-
-namespace rmq
-{
- class MQClientFactory;
- class ClientConfig;
-
- class MQClientManager
- {
- public:
- ~MQClientManager();
- static MQClientManager* getInstance();
- MQClientFactory* getAndCreateMQClientFactory(ClientConfig& clientConfig);
- void removeClientFactory(const std::string& clientId);
-
- private:
- MQClientManager();
-
- private:
- static MQClientManager* s_instance;
- kpr::AtomicInteger m_factoryIndexGenerator;
- std::map<std::string, MQClientFactory*> m_factoryTable;
- kpr::Mutex m_mutex;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/Makefile b/rocketmq-client4cpp/src/Makefile
deleted file mode 100644
index 5d5f43b5..00000000
--- a/rocketmq-client4cpp/src/Makefile
+++ /dev/null
@@ -1,26 +0,0 @@
-#-----------------------------------------------------------------------
-TARGET := librocketmq.a
-CONFIG :=
-STRIP_FLAG := N
-MFLAGS := ${BIT}
-CFLAGS += -g -fPIC -Wno-deprecated -fno-strict-aliasing -fno-omit-frame-pointer
-CFLAGS_32 += -march=i686
-INCLUDE += -I../include -I./common -I./kpr -I./protocol -I./message -I./transport -I./producer -I./consumer \
- -I./jsoncpp
-LIB += -lz -lrt -lpthread
-LIB32 +=
-LIB64 +=
-#-----------------------------------------------------------------------
-
-LOCAL_SRC += $(wildcard jsoncpp/*.cpp)
-LOCAL_SRC += $(wildcard kpr/*.cpp)
-LOCAL_SRC += $(wildcard common/*.cpp)
-LOCAL_SRC += $(wildcard protocol/*.cpp)
-LOCAL_SRC += $(wildcard message/*.cpp)
-LOCAL_SRC += $(wildcard transport/*.cpp)
-LOCAL_SRC += $(wildcard producer/*.cpp)
-LOCAL_SRC += $(wildcard consumer/*.cpp)
-
-include ./Makefile.std
-#-----------------------------------------------------------------------
-
diff --git a/rocketmq-client4cpp/src/Makefile.std b/rocketmq-client4cpp/src/Makefile.std
deleted file mode 100755
index b23f2605..00000000
--- a/rocketmq-client4cpp/src/Makefile.std
+++ /dev/null
@@ -1,127 +0,0 @@
-#-------------------------------------------------------------------------------
-CC = gcc
-CXX = g++
-CFLAGS += -g -fPIC -Wno-deprecated -Wall -pipe -fno-ident -fno-strict-aliasing -MMD -D_GNU_SOURCE -D_REENTRANT
-
-#-------------------------------------------------------------------------------
-INCLUDE += -I./
-LIB_32 += -L./
-LIB_64 += -L./
-
-LOCAL_SRC += $(sort $(wildcard *.cpp *.cc *.c))
-LOCAL_OBJ += $(patsubst %.cpp,%.o, $(patsubst %.cc,%.o, $(patsubst %.c,%.o, $(LOCAL_SRC))))
-DEP_FILE := $(foreach obj, $(LOCAL_OBJ), $(dir $(obj))$(basename $(notdir $(obj))).d)
-
-#-----------------------------------------------------------------------------
-PLATFORM := $(strip $(shell echo `uname -m`))
-ifneq ($(MFLAGS),64)
- ifneq ($(MFLAGS),32)
- ifeq ($(PLATFORM),x86_64)
- MFLAGS := 64
- else
- MFLAGS := 32
- endif
- endif
-endif
-
-ifeq ($(MFLAGS),64)
- ifneq ($(PLATFORM),x86_64)
- MFLAGS := 32
- endif
-endif
-
-ifeq ($(MFLAGS),32)
- CFLAGS += -D_SYS_EPOLL_ $(CFLAGS_32)
-else
- CFLAGS += $(CFLAGS_64)
-endif
-
-#-----------------------------------------------------------------------------
-ifneq ($(PLATFORM),x86_64)
- MFLAGS := 32
- LIB := $(LIB) $(LIB_32)
-else
- DEP_FILE_32 := $(foreach obj, $(DEP_FILE),$(patsubst %.d,%.32.d, $(obj)))
- DEP_FILE_64 := $(foreach obj, $(DEP_FILE),$(patsubst %.d,%.64.d, $(obj)))
-
- LOCAL_OBJ_32 := $(foreach obj, $(LOCAL_OBJ),$(patsubst %.o,%.32.o,$(obj)))
- LOCAL_OBJ_64 := $(foreach obj, $(LOCAL_OBJ),$(patsubst %.o,%.64.o,$(obj)))
-
- LOCAL_MOCK_OBJ_32 += $(filter-out %Server.32.o, $(LOCAL_OBJ_32)) UnitTest.32.o
- LOCAL_MOCK_OBJ_64 += $(filter-out %Server.64.o, $(LOCAL_OBJ_64)) UnitTest.64.o
-
- CLEANFILE := $(LOCAL_OBJ_32) $(LOCAL_OBJ_64)
-
- ifeq ($(MFLAGS),64)
- DEP_FILE := $(DEP_FILE_64)
- LOCAL_OBJ := $(LOCAL_OBJ_64)
- LIB := $(LIB) $(LIB_64)
- LOCAL_MOCK_OBJ := $(LOCAL_MOCK_OBJ_64)
- else
- DEP_FILE := $(DEP_FILE_32)
- LOCAL_OBJ := $(LOCAL_OBJ_32)
- LIB := $(LIB) $(LIB_32)
- LOCAL_MOCK_OBJ := $(LOCAL_MOCK_OBJ_32)
- endif
-endif
-
-#-------------------------------------------------------------------------------
-all : $(LOCAL_OBJ) $(TARGET) $(TARGETS)
-
-$(filter %.a,$(TARGET)) : $(LOCAL_OBJ)
- ar r $@ $(LOCAL_OBJ)
-
-$(filter %.so,$(TARGET)) : $(LOCAL_OBJ)
- $(CXX) -m$(MFLAGS) $(CFLAGS) -shared -o $@ $^ $(INCLUDE) $(LIB)
-
-$(filter-out %.so %.a,$(TARGET)) : $(LOCAL_OBJ)
- $(CXX) -m$(MFLAGS) $(CFLAGS) -o $@ $^ $(INCLUDE) $(LIB)
-
-$(filter-out %.so %.a %.y,$(TARGETS)) : % : %.$(MFLAGS).o
- $(CXX) -m$(MFLAGS) $(CFLAGS) -o $@ $^ $(INCLUDE) $(LIB)
-
-utest : $(LOCAL_MOCK_OBJ)
- $(CXX) -m$(MFLAGS) $(CFLAGS) -o UnitTest $^ $(INCLUDE) $(LIB)
-
-#----------------------------------------------------------------------------------
-uclean:
- rm -vf $(LOCAL_MOCK_OBJ) $(TARGET) $(TARGETS) ${CLEANFILE} *.d.tmp gmon.out UnitTest
-
-clean:
- rm -vf $(LOCAL_OBJ) $(TARGET) $(TARGETS) ${CLEANFILE} *.d.tmp gmon.out UnitTest
-
-cleanall:
- rm -vf $(LOCAL_OBJ) $(TARGET) $(TARGETS) $(DEP_FILE) ${CLEANFILE} *.o *.d.tmp *.d gmon.out UnitTest
-
-ifneq ($(DEP_FILE),)
--include $(DEP_FILE)
-endif
-
-#-------------------------------------------------------------------------------
-%.32.o: %.cpp
- $(CXX) -m32 $(CFLAGS) $(INCLUDE) -o $@ -c $<
-
-%.32.o: %.cc
- $(CXX) -m32 $(CFLAGS) $(INCLUDE) -o $@ -c $<
-
-%.32.o: %.c
- $(CC) -m32 $(CFLAGS) $(INCLUDE) -o $@ -c $<
-#-------------------------------------------------------------------------------
-%.64.o: %.cpp
- $(CXX) -m64 $(CFLAGS) $(INCLUDE) -o $@ -c $<
-
-%.64.o: %.cc
- $(CXX) -m64 $(CFLAGS) $(INCLUDE) -o $@ -c $<
-
-%.64.o: %.c
- $(CC) -m64 $(CFLAGS) $(INCLUDE) -o $@ -c $<
-#----------------------------------------------------------------------------------
-%.o: %.cpp
- $(CXX) -m$(MFLAGS) $(CFLAGS) $(INCLUDE) -o $@ -c $<
-
-%.o: %.cc
- $(CXX) -m$(MFLAGS) $(CFLAGS) $(INCLUDE) -o $@ -c $<
-
-%.o: %.c
- $(CC) -m$(MFLAGS) $(CFLAGS) $(INCLUDE) -o $@ -c $<
-#----------------------------------------------------------------------------------
diff --git a/rocketmq-client4cpp/src/RocketMQClient.cpp b/rocketmq-client4cpp/src/RocketMQClient.cpp
deleted file mode 100755
index ec377b38..00000000
--- a/rocketmq-client4cpp/src/RocketMQClient.cpp
+++ /dev/null
@@ -1,186 +0,0 @@
-#include "RocketMQClient.h"
-#include "AtomicValue.h"
-#include "FileUtil.h"
-
-volatile int RocketMQUtil::_logFd = -1;
-int RocketMQUtil::_logLevel = 0;
-std::string RocketMQUtil::_logPath = "";
-
-pid_t RocketMQUtil::getPid()
-{
- static __thread pid_t pid = 0;
- if (!pid)
- {
- pid = getpid();
- }
- return pid;
-}
-
-pid_t RocketMQUtil::getTid()
-{
- static __thread pid_t pid = 0;
- static __thread pid_t tid = 0;
- if (!pid || !tid || pid != getpid())
- {
- pid = getpid();
- tid = syscall(__NR_gettid);
- }
- return tid;
-}
-
-int RocketMQUtil::getDiffDays(time_t tmFirst, time_t tmSecond)
-{
- static struct timeb g_tb;
- static bool g_tbInit = false;
-
- if(!g_tbInit)
- {
- ftime(&g_tb);
- g_tbInit = true;
- }
-
- return (tmSecond - g_tb.timezone*60)/86400 - (tmFirst - g_tb.timezone*60)/86400;
-};
-
-
-std::string RocketMQUtil::tm2str(const time_t& t, const std::string& sFormat)
-{
- struct tm stTm;
- localtime_r(&t, &stTm);
-
- char sTimeString[255] = "\0";
- strftime(sTimeString, sizeof(sTimeString), sFormat.c_str(), &stTm);
-
- return std::string(sTimeString);
-}
-
-std::string RocketMQUtil::now2str(const std::string& sFormat)
-{
- time_t t = time(NULL);
- return tm2str(t, sFormat.c_str());
-}
-
-std::string RocketMQUtil::now2str()
-{
- return now2str("%Y-%m-%d %H:%M:%S");
-}
-
-int64_t RocketMQUtil::getNowMs()
-{
- struct timeval tv;
- gettimeofday(&tv, NULL);
- return tv.tv_sec * (int64_t)1000 + tv.tv_usec / 1000;
-}
-
-
-std::string RocketMQUtil::str2fmt(const char* format, ...)
-{
- int dataLen = 0;
- va_list args;
- char buffer[8092];
- buffer[0] = buffer[sizeof(buffer) - 1] = '\0';
-
- va_start( args, format );
- dataLen = ::vsnprintf(buffer, sizeof(buffer), format, args);
- va_end(args);
-
- return std::string(buffer);
-};
-
-
-int RocketMQUtil::initLog(const std::string& sLogPath)
-{
- if (sLogPath.empty())
- {
- return 0;
- }
-
- const char *pLogLevel = getenv("ROCKETMQ_LOGLEVEL");
- if (pLogLevel != NULL)
- {
- int logLevel = atoi(pLogLevel);
- _logLevel = logLevel;
- _logPath = sLogPath;
- }
- else
- {
- _logLevel = WARN_LOG;
- _logPath = sLogPath;
- }
-
- std::string logDir = kpr::FileUtil::extractFilePath(_logPath);
- if (!kpr::FileUtil::isFileExist(logDir, S_IFDIR))
- {
- kpr::FileUtil::makeDirRecursive(logDir);
- }
-
- return 0;
-}
-
-void RocketMQUtil::setLogLevel(int logLevel)
-{
- _logLevel = logLevel;
-}
-
-
-void RocketMQUtil::writeLog(const char* fmt, ...)
-{
- if (_logPath.empty())
- {
- return;
- }
-
- static volatile time_t last_time = 0;
- static std::string last_time_str = "";
- time_t old = last_time;
- time_t now = time(NULL);
-
- if (now - last_time >= 5)
- {
- if (__sync_bool_compare_and_swap(&last_time, old, now))
- {
- std::string time_str = tm2str(now, "%Y%m%d");
- if (_logFd < 0 || time_str != last_time_str)
- {
- int oldFd = _logFd;
- std::string logFullPath = _logPath + "." + time_str;
- _logFd = open(logFullPath.c_str(), O_CREAT | O_RDWR | O_APPEND, 0666);
- if (_logFd > 0)
- {
- last_time_str = time_str;
- }
-
- if (oldFd > 0)
- {
- close(oldFd);
- }
- }
- }
- }
-
- char buf[1024*128];
- buf[0] = buf[sizeof(buf) - 1] = '\0';
-
- va_list ap;
- va_start(ap, fmt);
- int size = vsnprintf(buf, sizeof(buf), fmt, ap);
- va_end(ap);
-
- int logFd = _logFd;
- if (logFd > 0 && (size > 0 && size < (int)sizeof(buf)))
- {
- int ret = write(logFd, buf, size);
- if (ret < 0)
- {
- if (errno == EBADF)
- {
- write(_logFd, buf, size);
- }
- }
- }
-
- return;
-}
-
-
-
diff --git a/rocketmq-client4cpp/src/common/ConsumeStats.h b/rocketmq-client4cpp/src/common/ConsumeStats.h
deleted file mode 100755
index 34ea8173..00000000
--- a/rocketmq-client4cpp/src/common/ConsumeStats.h
+++ /dev/null
@@ -1,95 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __CONSUMESTATS_H__
-#define __CONSUMESTATS_H__
-
-#include <map>
-#include "MessageQueue.h"
-
-namespace rmq
-{
- typedef struct
- {
- long long brokerOffset;
- long long consumerOffset;
- long long lastTimestamp;
- } OffsetWrapper;
-
- /**
- * Consumer progress
- *
- * @author kangliqiang<ka...@163.com>
- */
- class ConsumeStats
- {
- public:
- ConsumeStats()
- : m_consumeTps(0)
- {
- }
-
- ~ConsumeStats()
- {
- }
-
- long long computeTotalDiff()
- {
-
- long long diffTotal = 0L;
-
- //Iterator<Entry<MessageQueue, OffsetWrapper>> it = m_offsetTable.entrySet().iterator();
- //while (it.hasNext()) {
- // Entry<MessageQueue, OffsetWrapper> next = it.next();
- // long long diff = next.getValue().getBrokerOffset() - next.getValue().getConsumerOffset();
- // diffTotal += diff;
- //}
-
- return diffTotal;
- }
-
-
- std::map<MessageQueue*, OffsetWrapper> getOffsetTable()
- {
- return m_offsetTable;
- }
-
-
- void setOffsetTable(const std::map<MessageQueue*, OffsetWrapper> offsetTable)
- {
- m_offsetTable = offsetTable;
- }
-
-
- long long getConsumeTps()
- {
- return m_consumeTps;
- }
-
-
- void setConsumeTps(long long consumeTps)
- {
- m_consumeTps = consumeTps;
- }
-
- private:
-
- std::map<MessageQueue*, OffsetWrapper> m_offsetTable;
- long long m_consumeTps;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/FilterAPI.h b/rocketmq-client4cpp/src/common/FilterAPI.h
deleted file mode 100755
index 3d873060..00000000
--- a/rocketmq-client4cpp/src/common/FilterAPI.h
+++ /dev/null
@@ -1,72 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __FILTERAPI_H__
-#define __FILTERAPI_H__
-
-#include <string>
-#include "SubscriptionData.h"
-#include "UtilAll.h"
-#include "MQClientException.h"
-
-namespace rmq
-{
- class FilterAPI
- {
- public:
- static SubscriptionData* buildSubscriptionData(const std::string topic, const std::string& subString)
- {
- SubscriptionData* subscriptionData = new SubscriptionData();
- subscriptionData->setTopic(topic);
- subscriptionData->setSubString(subString);
-
- if (subString.empty() || subString == SubscriptionData::SUB_ALL)
- {
- subscriptionData->setSubString(SubscriptionData::SUB_ALL);
- }
- else
- {
- std::vector<std::string> out;
-
- UtilAll::Split(out, subString, "||");
-
- if (out.empty())
- {
- THROW_MQEXCEPTION(MQClientException, "FilterAPI subString split error", -1);
- }
-
- for (size_t i = 0; i < out.size(); i++)
- {
- std::string tag = out[i];
- if (!tag.empty())
- {
- std::string trimString = UtilAll::Trim(tag);
-
- if (!trimString.empty())
- {
- subscriptionData->getTagsSet().insert(trimString);
- subscriptionData->getCodeSet().insert(UtilAll::hashCode(trimString));
- }
- }
- }
- }
-
- return subscriptionData;
- }
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/MQVersion.cpp b/rocketmq-client4cpp/src/common/MQVersion.cpp
deleted file mode 100755
index 1a03fa66..00000000
--- a/rocketmq-client4cpp/src/common/MQVersion.cpp
+++ /dev/null
@@ -1,88 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "MQVersion.h"
-
-namespace rmq
-{
-
-int MQVersion::s_CurrentVersion = MQVersion::V3_2_6;
-
-const char* MQVersion::getVersionDesc(int value)
-{
- switch (value)
- {
- case V3_0_0_BETA9_SNAPSHOT:
- return "V3_0_0_BETA9_SNAPSHOT";
- case V3_0_0_BETA9:
- return "V3_0_0_BETA9";
- case V3_0_0_FINAL:
- return "V3_0_0_FINAL";
- case V3_0_1_SNAPSHOT:
- return "V3_0_1_SNAPSHOT";
- case V3_0_1:
- return "V3_0_1";
- case V3_0_2_SNAPSHOT:
- return "V3_0_2_SNAPSHOT";
- case V3_0_2:
- return "V3_0_2";
- case V3_0_3:
- return "V3_0_3";
- case V3_0_4_SNAPSHOT:
- return "V3_0_4_SNAPSHOT";
- case V3_0_4:
- return "V3_0_4";
- case V3_0_5_SNAPSHOT:
- return "V3_0_5_SNAPSHOT";
- case V3_0_5:
- return "V3_0_5";
- case V3_0_6_SNAPSHOT:
- return "V3_0_6_SNAPSHOT";
- case V3_0_6:
- return "V3_0_6";
- case V3_0_7_SNAPSHOT:
- return "V3_0_7_SNAPSHOT";
- case V3_0_7:
- return "V3_0_7";
-
- case V3_2_6_SNAPSHOT:
- return "V3_2_6_SNAPSHOT";
- case V3_2_6:
- return "V3_2_6";
- case V3_2_7_SNAPSHOT:
- return "V3_2_7_SNAPSHOT";
- case V3_2_7:
- return "V3_2_7";
- case V3_2_8_SNAPSHOT:
- return "V3_2_8_SNAPSHOT";
- case V3_2_8:
- return "V3_2_8";
- case V3_5_8_SNAPSHOT:
- return "V3_5_8_SNAPSHOT";
- case V3_5_8:
- return "V3_5_8";
- }
-
- return "";
-}
-
-
-MQVersion::Version MQVersion::value2Version(int value)
-{
- return (MQVersion::Version)value;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/common/MQVersion.h b/rocketmq-client4cpp/src/common/MQVersion.h
deleted file mode 100755
index d92957c4..00000000
--- a/rocketmq-client4cpp/src/common/MQVersion.h
+++ /dev/null
@@ -1,184 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MQVERSION_H__
-#define __MQVERSION_H__
-
-#include <string>
-
-namespace rmq
-{
- /**
- * Version Info
- *
- */
- class MQVersion
- {
- public:
- enum Version
- {
- V3_0_0_SNAPSHOT,
- V3_0_0_ALPHA1,
- V3_0_0_BETA1,
- V3_0_0_BETA2,
- V3_0_0_BETA3,
- V3_0_0_BETA4,
- V3_0_0_BETA5,
- V3_0_0_BETA6_SNAPSHOT,
- V3_0_0_BETA6,
- V3_0_0_BETA7_SNAPSHOT,
- V3_0_0_BETA7,
- V3_0_0_BETA8_SNAPSHOT,
- V3_0_0_BETA8,
- V3_0_0_BETA9_SNAPSHOT,
- V3_0_0_BETA9,
- V3_0_0_FINAL,
- V3_0_1_SNAPSHOT,
- V3_0_1,
- V3_0_2_SNAPSHOT,
- V3_0_2,
-
- V3_0_3_SNAPSHOT,
- V3_0_3,
- V3_0_4_SNAPSHOT,
- V3_0_4,
- V3_0_5_SNAPSHOT,
- V3_0_5,
- V3_0_6_SNAPSHOT,
- V3_0_6,
- V3_0_7_SNAPSHOT,
- V3_0_7,
- V3_0_8_SNAPSHOT,
- V3_0_8,
- V3_0_9_SNAPSHOT,
- V3_0_9,
- V3_0_10_SNAPSHOT,
- V3_0_10,
- V3_0_11_SNAPSHOT,
- V3_0_11,
- V3_0_12_SNAPSHOT,
- V3_0_12,
- V3_0_13_SNAPSHOT,
- V3_0_13,
- V3_0_14_SNAPSHOT,
- V3_0_14,
- V3_0_15_SNAPSHOT,
- V3_0_15,
- V3_1_0_SNAPSHOT,
- V3_1_0,
- V3_1_1_SNAPSHOT,
- V3_1_1,
- V3_1_2_SNAPSHOT,
- V3_1_2,
- V3_1_3_SNAPSHOT,
- V3_1_3,
- V3_1_4_SNAPSHOT,
- V3_1_4,
- V3_1_5_SNAPSHOT,
- V3_1_5,
- V3_1_6_SNAPSHOT,
- V3_1_6,
- V3_1_7_SNAPSHOT,
- V3_1_7,
- V3_1_8_SNAPSHOT,
- V3_1_8,
- V3_1_9_SNAPSHOT,
- V3_1_9,
- V3_2_0_SNAPSHOT,
- V3_2_0,
- V3_2_1_SNAPSHOT,
- V3_2_1,
- V3_2_2_SNAPSHOT,
- V3_2_2,
- V3_2_3_SNAPSHOT,
- V3_2_3,
- V3_2_4_SNAPSHOT,
- V3_2_4,
- V3_2_5_SNAPSHOT,
- V3_2_5,
- V3_2_6_SNAPSHOT,
- V3_2_6,
- V3_2_7_SNAPSHOT,
- V3_2_7,
- V3_2_8_SNAPSHOT,
- V3_2_8,
- V3_2_9_SNAPSHOT,
- V3_2_9,
- V3_3_1_SNAPSHOT,
- V3_3_1,
- V3_3_2_SNAPSHOT,
- V3_3_2,
- V3_3_3_SNAPSHOT,
- V3_3_3,
- V3_3_4_SNAPSHOT,
- V3_3_4,
- V3_3_5_SNAPSHOT,
- V3_3_5,
- V3_3_6_SNAPSHOT,
- V3_3_6,
- V3_3_7_SNAPSHOT,
- V3_3_7,
- V3_3_8_SNAPSHOT,
- V3_3_8,
- V3_3_9_SNAPSHOT,
- V3_3_9,
- V3_4_1_SNAPSHOT,
- V3_4_1,
- V3_4_2_SNAPSHOT,
- V3_4_2,
- V3_4_3_SNAPSHOT,
- V3_4_3,
- V3_4_4_SNAPSHOT,
- V3_4_4,
- V3_4_5_SNAPSHOT,
- V3_4_5,
- V3_4_6_SNAPSHOT,
- V3_4_6,
- V3_4_7_SNAPSHOT,
- V3_4_7,
- V3_4_8_SNAPSHOT,
- V3_4_8,
- V3_4_9_SNAPSHOT,
- V3_4_9,
- V3_5_1_SNAPSHOT,
- V3_5_1,
- V3_5_2_SNAPSHOT,
- V3_5_2,
- V3_5_3_SNAPSHOT,
- V3_5_3,
- V3_5_4_SNAPSHOT,
- V3_5_4,
- V3_5_5_SNAPSHOT,
- V3_5_5,
- V3_5_6_SNAPSHOT,
- V3_5_6,
- V3_5_7_SNAPSHOT,
- V3_5_7,
- V3_5_8_SNAPSHOT,
- V3_5_8,
- V3_5_9_SNAPSHOT,
- V3_5_9,
- };
-
- static const char* getVersionDesc(int value);
- static Version value2Version(int value);
-
- public:
- static int s_CurrentVersion;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/MessageSysFlag.cpp b/rocketmq-client4cpp/src/common/MessageSysFlag.cpp
deleted file mode 100755
index 329b71b2..00000000
--- a/rocketmq-client4cpp/src/common/MessageSysFlag.cpp
+++ /dev/null
@@ -1,47 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "MessageSysFlag.h"
-
-namespace rmq
-{
-
-/**
-* SysFlag
-*/
-int MessageSysFlag::CompressedFlag = (0x1 << 0);
-int MessageSysFlag::MultiTagsFlag = (0x1 << 1);
-
-/**
-* 7 6 5 4 3 2 1 0<br>
-* SysFlag for transaction
-*/
-int MessageSysFlag::TransactionNotType = (0x0 << 2);
-int MessageSysFlag::TransactionPreparedType = (0x1 << 2);
-int MessageSysFlag::TransactionCommitType = (0x2 << 2);
-int MessageSysFlag::TransactionRollbackType = (0x3 << 2);
-
-int MessageSysFlag::getTransactionValue(int flag)
-{
- return flag & TransactionRollbackType;
-}
-
-int MessageSysFlag::resetTransactionValue(int flag, int type)
-{
- return (flag & (~TransactionRollbackType)) | type;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/common/MessageSysFlag.h b/rocketmq-client4cpp/src/common/MessageSysFlag.h
deleted file mode 100755
index 3950564f..00000000
--- a/rocketmq-client4cpp/src/common/MessageSysFlag.h
+++ /dev/null
@@ -1,46 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MESSAGESYSFLAG_H__
-#define __MESSAGESYSFLAG_H__
-
-namespace rmq
-{
- class MessageSysFlag
- {
- public:
- static int getTransactionValue(int flag);
- static int resetTransactionValue(int flag, int type);
-
- public:
- /**
- * SysFlag
- */
- static int CompressedFlag;
- static int MultiTagsFlag;
-
- /**
- * 7 6 5 4 3 2 1 0<br>
- * SysFlag for transaction
- */
- static int TransactionNotType;
- static int TransactionPreparedType;
- static int TransactionCommitType;
- static int TransactionRollbackType;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/MixAll.cpp b/rocketmq-client4cpp/src/common/MixAll.cpp
deleted file mode 100755
index 417a5e57..00000000
--- a/rocketmq-client4cpp/src/common/MixAll.cpp
+++ /dev/null
@@ -1,88 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-#include "MixAll.h"
-#include "FileUtil.h"
-
-namespace rmq
-{
-
-const std::string MixAll::DEFAULT_TOPIC = "TBW102";
-const std::string MixAll::BENCHMARK_TOPIC = "BenchmarkTest";
-const std::string MixAll::DEFAULT_PRODUCER_GROUP = "DEFAULT_PRODUCER";
-const std::string MixAll::DEFAULT_CONSUMER_GROUP = "DEFAULT_CONSUMER";
-const std::string MixAll::TOOLS_CONSUMER_GROUP = "TOOLS_CONSUMER";
-const std::string MixAll::CLIENT_INNER_PRODUCER_GROUP = "CLIENT_INNER_PRODUCER";
-const std::string MixAll::SELF_TEST_TOPIC = "SELF_TEST_TOPIC";
-const std::string MixAll::RETRY_GROUP_TOPIC_PREFIX = "%RETRY%";
-const std::string MixAll::DLQ_GROUP_TOPIC_PREFIX = "%DLQ%";
-const std::string MixAll::NAMESRV_ADDR_ENV = "NAMESRV_ADDR";
-const std::string MixAll::ROCKETMQ_HOME_ENV = "ROCKETMQ_HOME";
-const std::string MixAll::ROCKETMQ_HOME_PROPERTY = "rocketmq.home.dir";
-const std::string MixAll::MESSAGE_COMPRESS_LEVEL = "rocketmq.message.compressLevel";
-const std::string MixAll::ROCKETMQ_NAMESRV_DOMAIN = "172.30.30.125";
-
-std::string MixAll::getRetryTopic(const std::string& consumerGroup)
-{
- return RETRY_GROUP_TOPIC_PREFIX + consumerGroup;
-}
-
-bool MixAll::compareAndIncreaseOnly(kpr::AtomicLong& target, long long value)
-{
- long long current = target.get();
- while (value > current)
- {
- long long tmp = target.getAndSet(current, value);
-
- if (tmp == current)
- {
- return true;
- }
-
- current = target.get();
- }
-
- return false;
-}
-
-
-std::string MixAll::file2String(const std::string& fileName)
-{
- return kpr::FileUtil::load2str(fileName);
-}
-
-void MixAll::string2File(const std::string& fileName, const std::string& fileData)
-{
- // write tmp file
- std::string tmpFile = fileName + ".tmp";
- kpr::FileUtil::save2file(tmpFile, fileData);
-
- // backup old file
- std::string bakFile = fileName + ".bak";
- std::string oldFileData = kpr::FileUtil::load2str(fileName);
- if (!oldFileData.empty())
- {
- kpr::FileUtil::save2file(bakFile, oldFileData);
- }
-
- // delete old file
- std::remove(fileName.c_str());
-
- // rename file
- std::rename(tmpFile.c_str(), fileName.c_str());
-}
-
-}
diff --git a/rocketmq-client4cpp/src/common/MixAll.h b/rocketmq-client4cpp/src/common/MixAll.h
deleted file mode 100755
index 797a0ae9..00000000
--- a/rocketmq-client4cpp/src/common/MixAll.h
+++ /dev/null
@@ -1,62 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-#ifndef __MIXALL_H__
-#define __MIXALL_H__
-
-#include <string>
-#include <vector>
-#include <iostream>
-#include <fstream>
-#include <unistd.h>
-#include <sys/stat.h>
-#include <sys/types.h>
-#include <dirent.h>
-#include <fnmatch.h>
-#include <arpa/inet.h>
-#include <ifaddrs.h>
-
-#include "AtomicValue.h"
-
-namespace rmq
-{
- class MixAll
- {
- public:
- static const long MASTER_ID = 0L;
- static const std::string DEFAULT_TOPIC;
- static const std::string BENCHMARK_TOPIC;
- static const std::string DEFAULT_PRODUCER_GROUP;
- static const std::string DEFAULT_CONSUMER_GROUP;
- static const std::string TOOLS_CONSUMER_GROUP;
- static const std::string CLIENT_INNER_PRODUCER_GROUP;
- static const std::string SELF_TEST_TOPIC;
- static const std::string RETRY_GROUP_TOPIC_PREFIX;
- static const std::string DLQ_GROUP_TOPIC_PREFIX;
- static const std::string NAMESRV_ADDR_ENV;
- static const std::string ROCKETMQ_HOME_ENV;
- static const std::string ROCKETMQ_HOME_PROPERTY;
- static const std::string MESSAGE_COMPRESS_LEVEL;
- static const std::string ROCKETMQ_NAMESRV_DOMAIN;
-
- static std::string getRetryTopic(const std::string& consumerGroup);
- static bool compareAndIncreaseOnly(kpr::AtomicLong& target, long long value);
- static std::string file2String(const std::string& fileName);
- static void string2File(const std::string& fileName, const std::string& fileData);
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/NamesrvConfig.h b/rocketmq-client4cpp/src/common/NamesrvConfig.h
deleted file mode 100755
index 608a4d9b..00000000
--- a/rocketmq-client4cpp/src/common/NamesrvConfig.h
+++ /dev/null
@@ -1,72 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang, kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __NAMESRVCONFIG_H__
-#define __NAMESRVCONFIG_H__
-
-#include <stdlib.h>
-#include <string>
-
-namespace rmq
-{
-/**
- * Name server Config
- *
- */
-class NamesrvConfig
-{
-public:
- NamesrvConfig()
- {
- m_kvConfigPath = "";
-
- char* home = getenv(MixAll::ROCKETMQ_HOME_ENV.c_str());
- if (home)
- {
- m_rocketmqHome = home;
- }
- else
- {
- m_rocketmqHome = "";
- }
- }
-
- const std::string& getRocketmqHome()
- {
- return m_rocketmqHome;
- }
-
- void setRocketmqHome(const std::string& rocketmqHome)
- {
- m_rocketmqHome = rocketmqHome;
- }
-
- const std::string& getKvConfigPath()
- {
- return m_kvConfigPath;
- }
-
- void setKvConfigPath(const std::string& kvConfigPath)
- {
- m_kvConfigPath = kvConfigPath;
- }
-
-private:
- std::string m_rocketmqHome;
- std::string m_kvConfigPath;
-};
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/NamesrvUtil.h b/rocketmq-client4cpp/src/common/NamesrvUtil.h
deleted file mode 100755
index 4f3639ca..00000000
--- a/rocketmq-client4cpp/src/common/NamesrvUtil.h
+++ /dev/null
@@ -1,29 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang, kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __NAMESRVUTIL_H__
-#define __NAMESRVUTIL_H__
-
-namespace rmq
-{
- namespace NamesrvUtil
- {
- const char* NAMESPACE_ORDER_TOPIC_CONFIG = "ORDER_TOPIC_CONFIG";
- const char* NAMESPACE_PROJECT_CONFIG = "PROJECT_CONFIG";
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/PermName.cpp b/rocketmq-client4cpp/src/common/PermName.cpp
deleted file mode 100644
index 084de799..00000000
--- a/rocketmq-client4cpp/src/common/PermName.cpp
+++ /dev/null
@@ -1,63 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "PermName.h"
-
-namespace rmq
-{
-
-int PermName::PERM_PRIORITY = 0x1 << 3;
-int PermName::PERM_READ = 0x1 << 2;
-int PermName::PERM_WRITE = 0x1 << 1;
-int PermName::PERM_INHERIT = 0x1 << 0;
-
-bool PermName::isReadable(int perm)
-{
- return (perm & PERM_READ) == PERM_READ;
-}
-
-bool PermName::isWriteable(int perm)
-{
- return (perm & PERM_WRITE) == PERM_WRITE;
-}
-
-bool PermName::isInherited(int perm)
-{
- return (perm & PERM_INHERIT) == PERM_INHERIT;
-}
-
-std::string PermName::perm2String(int perm)
-{
- std::string pm("---");
- if (isReadable(perm))
- {
- pm.replace(0, 1, "R");
- }
-
- if (isWriteable(perm))
- {
- pm.replace(1, 2, "W");
- }
-
- if (isInherited(perm))
- {
- pm.replace(2, 3, "X");
- }
-
- return pm;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/common/PermName.h b/rocketmq-client4cpp/src/common/PermName.h
deleted file mode 100644
index 364ddeb3..00000000
--- a/rocketmq-client4cpp/src/common/PermName.h
+++ /dev/null
@@ -1,39 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __PERMNAME_H__
-#define __PERMNAME_H__
-
-#include <string>
-
-namespace rmq
-{
- class PermName
- {
- public:
- static int PERM_PRIORITY;
- static int PERM_READ;
- static int PERM_WRITE;
- static int PERM_INHERIT;
-
- static bool isReadable(int perm);
- static bool isWriteable(int perm);
- static bool isInherited(int perm);
- static std::string perm2String(int perm);
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/PullSysFlag.cpp b/rocketmq-client4cpp/src/common/PullSysFlag.cpp
deleted file mode 100644
index f6fc1c26..00000000
--- a/rocketmq-client4cpp/src/common/PullSysFlag.cpp
+++ /dev/null
@@ -1,68 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "PullSysFlag.h"
-
-namespace rmq
-{
-
-int PullSysFlag::FLAG_COMMIT_OFFSET = 0x1 << 0;
-int PullSysFlag::FLAG_SUSPEND = 0x1 << 1;
-int PullSysFlag::FLAG_SUBSCRIPTION = 0x1 << 2;
-
-int PullSysFlag::buildSysFlag(bool commitOffset, bool suspend, bool subscription)
-{
- int flag = 0;
-
- if (commitOffset)
- {
- flag |= FLAG_COMMIT_OFFSET;
- }
-
- if (suspend)
- {
- flag |= FLAG_SUSPEND;
- }
-
- if (subscription)
- {
- flag |= FLAG_SUBSCRIPTION;
- }
-
- return flag;
-}
-
-int PullSysFlag::clearCommitOffsetFlag(int sysFlag)
-{
- return sysFlag & (~FLAG_COMMIT_OFFSET);
-}
-
-bool PullSysFlag::hasCommitOffsetFlag(int sysFlag)
-{
- return (sysFlag & FLAG_COMMIT_OFFSET) == FLAG_COMMIT_OFFSET;
-}
-
-bool PullSysFlag::hasSuspendFlag(int sysFlag)
-{
- return (sysFlag & FLAG_SUSPEND) == FLAG_SUSPEND;
-}
-
-bool PullSysFlag::hasSubscriptionFlag(int sysFlag)
-{
- return (sysFlag & FLAG_SUBSCRIPTION) == FLAG_SUBSCRIPTION;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/common/PullSysFlag.h b/rocketmq-client4cpp/src/common/PullSysFlag.h
deleted file mode 100755
index c19eac39..00000000
--- a/rocketmq-client4cpp/src/common/PullSysFlag.h
+++ /dev/null
@@ -1,38 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __PULLSYSFLAG_H__
-#define __PULLSYSFLAG_H__
-
-namespace rmq
-{
- class PullSysFlag
- {
- public:
- static int buildSysFlag(bool commitOffset, bool suspend, bool subscription);
- static int clearCommitOffsetFlag(int sysFlag);
- static bool hasCommitOffsetFlag(int sysFlag);
- static bool hasSuspendFlag(int sysFlag);
- static bool hasSubscriptionFlag(int sysFlag);
-
- private:
- static int FLAG_COMMIT_OFFSET;
- static int FLAG_SUSPEND;
- static int FLAG_SUBSCRIPTION;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/SendResult.cpp b/rocketmq-client4cpp/src/common/SendResult.cpp
deleted file mode 100755
index 5263d291..00000000
--- a/rocketmq-client4cpp/src/common/SendResult.cpp
+++ /dev/null
@@ -1,132 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "SendResult.h"
-#include "UtilAll.h"
-#include "VirtualEnvUtil.h"
-
-namespace rmq
-{
-
-SendResult::SendResult()
- : m_sendStatus(SEND_OK),m_queueOffset(0)
-{
-}
-
-SendResult::SendResult(const SendStatus& sendStatus,
- const std::string& msgId,
- MessageQueue& messageQueue,
- long long queueOffset,
- std::string& projectGroupPrefix)
- : m_sendStatus(sendStatus),
- m_msgId(msgId),
- m_messageQueue(messageQueue),
- m_queueOffset(queueOffset)
-{
- if (!UtilAll::isBlank(projectGroupPrefix))
- {
- m_messageQueue.setTopic(VirtualEnvUtil::clearProjectGroup(m_messageQueue.getTopic(),
- projectGroupPrefix));
- }
-}
-
-const std::string& SendResult::getMsgId()
-{
- return m_msgId;
-}
-
-void SendResult::setMsgId(const std::string& msgId)
-{
- m_msgId = msgId;
-}
-
-SendStatus SendResult::getSendStatus()
-{
- return m_sendStatus;
-}
-
-void SendResult::setSendStatus(const SendStatus& sendStatus)
-{
- m_sendStatus = sendStatus;
-}
-
-MessageQueue& SendResult::getMessageQueue()
-{
- return m_messageQueue;
-}
-
-void SendResult::setMessageQueue(MessageQueue& messageQueue)
-{
- m_messageQueue = messageQueue;
-}
-
-long long SendResult::getQueueOffset()
-{
- return m_queueOffset;
-}
-
-void SendResult::setQueueOffset(long long queueOffset)
-{
- m_queueOffset = queueOffset;
-}
-
-
-bool SendResult::hasResult()
-{
- return !m_msgId.empty();
-}
-
-
-
-std::string SendResult::toString() const
-{
- std::stringstream ss;
- ss << "{sendStatus=" << m_sendStatus
- << ",msgId=" << m_msgId
- << ",messageQueue=" << m_messageQueue.toString()
- << ",queueOffset=" << m_queueOffset
- << "}";
- return ss.str();
-}
-
-
-std::string SendResult::toJsonString() const
-{
- std::stringstream ss;
- ss << "{\"sendStatus\":\"" << m_sendStatus
- << "\",\"msgId\":\"" << m_msgId
- << "\",\"messageQueue\":" << m_messageQueue.toJsonString()
- << ",\"queueOffset\":\"" << m_queueOffset
- << "}";
- return ss.str();
-}
-
-
-
-TransactionSendResult::TransactionSendResult()
-{
-}
-
-LocalTransactionState TransactionSendResult::getLocalTransactionState()
-{
- return m_localTransactionState;
-}
-
-void TransactionSendResult::setLocalTransactionState(LocalTransactionState localTransactionState)
-{
- m_localTransactionState = localTransactionState;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/common/ServiceState.h b/rocketmq-client4cpp/src/common/ServiceState.h
deleted file mode 100755
index 7b41add2..00000000
--- a/rocketmq-client4cpp/src/common/ServiceState.h
+++ /dev/null
@@ -1,31 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-#ifndef __SERVICESTATE_H__
-#define __SERVICESTATE_H__
-
-namespace rmq
-{
- enum ServiceState
- {
- CREATE_JUST,
- RUNNING,
- SHUTDOWN_ALREADY,
- START_FAILED
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/ServiceThread.cpp b/rocketmq-client4cpp/src/common/ServiceThread.cpp
deleted file mode 100644
index 1abff9f5..00000000
--- a/rocketmq-client4cpp/src/common/ServiceThread.cpp
+++ /dev/null
@@ -1,73 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "ServiceThread.h"
-#include "Monitor.h"
-#include "ScopedLock.h"
-
-namespace rmq
-{
-
-ServiceThread::ServiceThread(const char* name)
- : kpr::Thread(name),
- m_notified(false),
- m_stoped(false)
-{
-
-}
-
-ServiceThread::~ServiceThread()
-{
-
-}
-
-void ServiceThread::stop()
-{
- m_stoped = true;
- wakeup();
-}
-
-void ServiceThread::wakeup()
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
-
- if (!m_notified)
- {
- m_notified = true;
- Notify();
- }
-}
-
-void ServiceThread::waitForRunning(long interval)
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- if (m_notified)
- {
- m_notified = false;
- return;
- }
-
- try
- {
- Wait(interval);
- }
- catch (...)
- {
- m_notified = false;
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/common/ServiceThread.h b/rocketmq-client4cpp/src/common/ServiceThread.h
deleted file mode 100755
index d7ec3efc..00000000
--- a/rocketmq-client4cpp/src/common/ServiceThread.h
+++ /dev/null
@@ -1,50 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __SERVICETHREAD_H__
-#define __SERVICETHREAD_H__
-
-#include <string>
-#include "Thread.h"
-#include "Monitor.h"
-
-namespace rmq
-{
- const long JoinTime = 90 * 1000;
-
- /**
- * service thread base class
- *
- */
- class ServiceThread : public kpr::Thread, public kpr::Monitor
- {
- public:
- ServiceThread(const char* name = NULL);
- virtual ~ServiceThread();
-
- virtual std::string getServiceName() = 0;
-
- void stop();
- void wakeup();
- void waitForRunning(long interval);
-
- protected:
- volatile bool m_notified;
- volatile bool m_stoped;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/SubscriptionGroupConfig.h b/rocketmq-client4cpp/src/common/SubscriptionGroupConfig.h
deleted file mode 100755
index 12bd48a7..00000000
--- a/rocketmq-client4cpp/src/common/SubscriptionGroupConfig.h
+++ /dev/null
@@ -1,50 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang, kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __SUBSCRIPTIONGROUPCONFIG_H__
-#define __SUBSCRIPTIONGROUPCONFIG_H__
-
-#include <string>
-#include "MixAll.h"
-
-namespace rmq
-{
- class SubscriptionGroupConfig
- {
- public:
- SubscriptionGroupConfig(const std::string& groupName)
- {
- this->groupName = groupName;
- consumeEnable = true;
- consumeFromMinEnable = true;
- consumeBroadcastEnable = true;
- retryQueueNums = 1;
- retryMaxTimes = 5;
- brokerId = MixAll::MASTER_ID;
- whichBrokerWhenConsumeSlowly = 1;
- }
-
- std::string groupName;
- bool consumeEnable;
- bool consumeFromMinEnable;
- bool consumeBroadcastEnable;
- int retryQueueNums;
- int retryMaxTimes;
- long brokerId;
- long whichBrokerWhenConsumeSlowly;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/TopAddressing.h b/rocketmq-client4cpp/src/common/TopAddressing.h
deleted file mode 100755
index 07b0c0cd..00000000
--- a/rocketmq-client4cpp/src/common/TopAddressing.h
+++ /dev/null
@@ -1,54 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang, kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __TOPADDRESSING_H__
-#define __TOPADDRESSING_H__
-
-#include <string>
-#include <sstream>
-#include "SocketUtil.h"
-
-namespace rmq
-{
- class TopAddressing
- {
- public:
- TopAddressing()
- : m_nsAddr("")
- {
- }
-
- const std::string& getNsAddr()
- {
- return m_nsAddr;
- }
-
- void setNsAddr(std::string& nsAddr)
- {
- m_nsAddr = nsAddr;
- }
-
- std::string fetchNSAddr()
- {
-
- return "";
- }
-
- private:
- std::string m_nsAddr;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/TopicConfig.cpp b/rocketmq-client4cpp/src/common/TopicConfig.cpp
deleted file mode 100644
index 036b41ca..00000000
--- a/rocketmq-client4cpp/src/common/TopicConfig.cpp
+++ /dev/null
@@ -1,167 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include <stdlib.h>
-#include <sstream>
-
-#include "TopicConfig.h"
-#include "PermName.h"
-
-namespace rmq
-{
-
-int TopicConfig::DefaultReadQueueNums = 16;
-int TopicConfig::DefaultWriteQueueNums = 16;
-std::string TopicConfig::SEPARATOR = " ";
-
-TopicConfig::TopicConfig()
- : m_topicName(""),
- m_readQueueNums(DefaultReadQueueNums),
- m_writeQueueNums(DefaultWriteQueueNums),
- m_perm(PermName::PERM_READ | PermName::PERM_WRITE),
- m_topicFilterType(SINGLE_TAG),
- m_topicSysFlag(0),
- m_order(false)
-{
-
-}
-
-TopicConfig::TopicConfig(const std::string& topicName)
- : m_topicName(topicName),
- m_readQueueNums(DefaultReadQueueNums),
- m_writeQueueNums(DefaultWriteQueueNums),
- m_perm(PermName::PERM_READ | PermName::PERM_WRITE),
- m_topicFilterType(SINGLE_TAG),
- m_topicSysFlag(0),
- m_order(false)
-{
-
-}
-
-TopicConfig::TopicConfig(const std::string& topicName, int readQueueNums, int writeQueueNums, int perm)
- : m_topicName(topicName),
- m_readQueueNums(readQueueNums),
- m_writeQueueNums(writeQueueNums),
- m_perm(perm),
- m_topicFilterType(SINGLE_TAG),
- m_topicSysFlag(0),
- m_order(false)
-{
-}
-
-TopicConfig::~TopicConfig()
-{
-}
-
-std::string TopicConfig::encode()
-{
- std::stringstream ss;
- ss << m_topicName << SEPARATOR
- << m_readQueueNums << SEPARATOR
- << m_writeQueueNums << SEPARATOR
- << m_perm << SEPARATOR
- << m_topicFilterType;
-
- return ss.str();
-}
-
-bool TopicConfig::decode(const std::string& in)
-{
- std::stringstream ss(in);
-
- ss >> m_topicName;
- ss >> m_readQueueNums;
- ss >> m_writeQueueNums;
- ss >> m_perm;
-
- int type;
- ss >> type;
- m_topicFilterType = (TopicFilterType)type;
-
- return true;
-}
-
-const std::string& TopicConfig::getTopicName()
-{
- return m_topicName;
-}
-
-void TopicConfig::setTopicName(const std::string& topicName)
-{
- m_topicName = topicName;
-}
-
-int TopicConfig::getReadQueueNums()
-{
- return m_readQueueNums;
-}
-
-void TopicConfig::setReadQueueNums(int readQueueNums)
-{
- m_readQueueNums = readQueueNums;
-}
-
-int TopicConfig::getWriteQueueNums()
-{
- return m_writeQueueNums;
-}
-
-void TopicConfig::setWriteQueueNums(int writeQueueNums)
-{
- m_writeQueueNums = writeQueueNums;
-}
-
-int TopicConfig::getPerm()
-{
- return m_perm;
-}
-
-void TopicConfig::setPerm(int perm)
-{
- m_perm = perm;
-}
-
-TopicFilterType TopicConfig::getTopicFilterType()
-{
- return m_topicFilterType;
-}
-
-void TopicConfig::setTopicFilterType(TopicFilterType topicFilterType)
-{
- m_topicFilterType = topicFilterType;
-}
-
-int TopicConfig::getTopicSysFlag()
-{
- return m_topicSysFlag;
-}
-
-void TopicConfig::setTopicSysFlag(int perm)
-{
- m_topicSysFlag = perm;
-}
-
-bool TopicConfig::isOrder()
-{
- return m_order;
-}
-
-void TopicConfig::setOrder(bool order)
-{
- m_order = order;
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/common/TopicConfig.h b/rocketmq-client4cpp/src/common/TopicConfig.h
deleted file mode 100644
index b9f2bcb2..00000000
--- a/rocketmq-client4cpp/src/common/TopicConfig.h
+++ /dev/null
@@ -1,71 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __TOPICCONFIG_H__
-#define __TOPICCONFIG_H__
-
-#include <string>
-#include "TopicFilterType.h"
-
-namespace rmq
- {
- /**
- * Topic
- *
- */
- class TopicConfig
- {
- public:
- TopicConfig();
- TopicConfig(const std::string& topicName);
- TopicConfig(const std::string& topicName, int readQueueNums, int writeQueueNums, int perm);
- ~TopicConfig();
-
- std::string encode();
- bool decode(const std::string& in);
- const std::string& getTopicName();
- void setTopicName(const std::string& topicName);
- int getReadQueueNums();
- void setReadQueueNums(int readQueueNums);
- int getWriteQueueNums();
- void setWriteQueueNums(int writeQueueNums);
- int getPerm();
- void setPerm(int perm);
- TopicFilterType getTopicFilterType();
- void setTopicFilterType(TopicFilterType topicFilterType);
- int getTopicSysFlag();
- void setTopicSysFlag(int topicSysFlag);
- bool isOrder();
- void setOrder(bool order);
-
- public:
- static int DefaultReadQueueNums;
- static int DefaultWriteQueueNums;
-
- private:
- static std::string SEPARATOR;
-
- std::string m_topicName;
- int m_readQueueNums;
- int m_writeQueueNums;
- int m_perm;
- TopicFilterType m_topicFilterType;
- int m_topicSysFlag;
- bool m_order;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/TopicStatsTable.h b/rocketmq-client4cpp/src/common/TopicStatsTable.h
deleted file mode 100755
index 4319e54b..00000000
--- a/rocketmq-client4cpp/src/common/TopicStatsTable.h
+++ /dev/null
@@ -1,51 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __TOPICSTATSTABLE_H__
-#define __TOPICSTATSTABLE_H__
-
-#include <map>
-
-namespace rmq
-{
- class MessageQueue;
-
- typedef struct
- {
- long long minOffset;
- long long maxOffset;
- long long lastUpdateTimestamp;
- } TopicOffset;
-
- class TopicStatsTable
- {
- public:
- std::map<MessageQueue*, TopicOffset> getOffsetTable()
- {
- return m_offsetTable;
- }
-
- void setOffsetTable(const std::map<MessageQueue*, TopicOffset>& offsetTable)
- {
- m_offsetTable = offsetTable;
- }
-
- private:
- std::map<MessageQueue*, TopicOffset> m_offsetTable;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/UtilAll.h b/rocketmq-client4cpp/src/common/UtilAll.h
deleted file mode 100755
index b239edbb..00000000
--- a/rocketmq-client4cpp/src/common/UtilAll.h
+++ /dev/null
@@ -1,608 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __UTILALL_H__
-#define __UTILALL_H__
-
-#include <stdlib.h>
-#include <stdio.h>
-#include <string.h>
-#include <assert.h>
-#include <time.h>
-
-#include <string>
-#include <sstream>
-#include <vector>
-#include <list>
-#include <set>
-#include <map>
-
-#include "RocketMQClient.h"
-#include "zlib.h"
-#include "json/value.h"
-#include "json/writer.h"
-
-namespace rmq
-{
- const std::string WHITESPACE = " \t\r\n";
- const int CHUNK = 8192;
- const std::string yyyy_MM_dd_HH_mm_ss = "yyyy-MM-dd HH:mm:ss";
- const std::string yyyy_MM_dd_HH_mm_ss_SSS = "yyyy-MM-dd#HH:mm:ss:SSS";
- const std::string yyyyMMddHHmmss = "yyyyMMddHHmmss";
-
- class UtilAll
- {
- public:
- static pid_t getPid()
- {
- static __thread pid_t pid = 0;
- if (!pid || pid != getpid())
- {
- pid = getpid();
- }
- return pid;
- }
-
- static pid_t getTid()
- {
- static __thread pid_t pid = 0;
- static __thread pid_t tid = 0;
- if (!pid || !tid || pid != getpid())
- {
- pid = getpid();
- tid = syscall(__NR_gettid);
- }
- return tid;
- }
-
- static int Split(std::vector<std::string>& out, const std::string& in, const std::string& delimiter)
- {
- std::string::size_type left = 0;
- for (size_t i = 1; i < in.size(); i++)
- {
- std::string::size_type right = in.find(delimiter, left);
-
- if (right == std::string::npos)
- {
- break;
- }
-
- out.push_back(in.substr(left, right - left));
-
- left = right + delimiter.length();
- }
-
- out.push_back(in.substr(left));
-
- return out.size();
- }
-
- static int Split(std::vector<std::string>& out, const std::string& in, const char delimiter)
- {
- std::string::size_type left = 0;
- for (size_t i = 1; i < in.size(); i++)
- {
- std::string::size_type right = in.find(delimiter, left);
-
- if (right == std::string::npos)
- {
- break;
- }
-
- out.push_back(in.substr(left, right - left));
-
- left = right + 1;
- }
-
- out.push_back(in.substr(left));
-
- return out.size();
- }
-
- static std::string Trim(const std::string& str)
- {
- if (str.empty())
- {
- return str;
- }
-
- std::string::size_type left = str.find_first_not_of(WHITESPACE);
-
- if (left == std::string::npos)
- {
- return "";
- }
-
- std::string::size_type right = str.find_last_not_of(WHITESPACE);
-
- if (right == std::string::npos)
- {
- return str.substr(left);
- }
-
- return str.substr(left, right + 1 - left);
- }
-
- static bool isBlank(const std::string& str)
- {
- if (str.empty())
- {
- return true;
- }
-
- std::string::size_type left = str.find_first_not_of(WHITESPACE);
-
- if (left == std::string::npos)
- {
- return true;
- }
-
- return false;
- }
-
- static int availableProcessors()
- {
- return 4;
- }
-
-
- static int hashCode(const char* pData, int len)
- {
- int h = 0;
- if (pData != NULL && len > 0)
- {
- unsigned char c;
- for (int i = 0; i < len; i++)
- {
- c = (unsigned char)pData[i];
- h = 31 * h + c;
- }
- }
-
- return h;
- }
-
- static int hashCode(const std::string& s)
- {
- return hashCode(s.c_str(), s.length());
- }
-
- static int hashCode(const char* pData)
- {
- return hashCode(std::string(pData));
- }
-
- static int hashCode(char x)
- {
- return x;
- }
-
- static int hashCode(unsigned char x)
- {
- return x;
- }
-
- static int hashCode(short x)
- {
- return x;
- }
-
- static int hashCode(unsigned short x)
- {
- return x;
- }
-
- static int hashCode(int x)
- {
- return x;
- }
-
- static int hashCode(unsigned int x)
- {
- return x;
- }
-
- static int hashCode(long x)
- {
- return x;
- }
-
- static int hashCode(unsigned long x)
- {
- return x;
- }
-
- template <typename T>
- static int hashCode(const std::vector<T>& v)
- {
- int h = 0;
- typeof(v.begin()) it = v.begin();
- while (it != v.end())
- {
- h += hashCode(*it);
- ++it;
- }
- return h;
- }
-
- template <typename T>
- static int hashCode(const std::set<T>& v)
- {
- int h = 0;
- typeof(v.begin()) it = v.begin();
- while (it != v.end())
- {
- h += hashCode(*it);
- ++it;
- }
- return h;
- }
-
- static std::string toString(Json::Value& json)
- {
- Json::FastWriter fastWriter;
- return fastWriter.write(json);
- }
-
- template<typename T>
- static std::string toString(const T& v)
- {
- std::ostringstream ss;
- ss << v;
- return ss.str();
- }
-
- template<typename T>
- static std::string toString(const std::vector<T>& v)
- {
- std::string s;
- s.append("[");
- typeof(v.begin()) it = v.begin();
- while (it != v.end())
- {
- s.append(toString(*it));
- s.append(",");
- ++it;
- }
- if (s.size() > 1)
- {
- s.erase(s.size() - 1, 1);
- }
- s.append("]");
- return s;
- }
-
-
- template <typename T>
- static std::string toString(const std::list<T>& v)
- {
- std::string s;
- s.append("[");
- typeof(v.begin()) it = v.begin();
- while (it != v.end())
- {
- s.append(toString(*it));
- s.append(",");
- ++it;
- }
- if (s.size() > 1)
- {
- s.erase(s.size() - 1, 1);
- }
- s.append("]");
-
- return s;
- }
-
- template <typename T>
- static std::string toString(const std::set<T>& v)
- {
- std::string s;
- s.append("[");
- typeof(v.begin()) it = v.begin();
- while (it != v.end())
- {
- s.append(toString(*it));
- s.append(",");
- ++it;
- }
- if (s.size() > 1)
- {
- s.erase(s.size() - 1, 1);
- }
- s.append("]");
- return s;
- }
-
- template<typename K, typename V, typename D, typename A>
- static std::string toString(const std::map<K, V, D, A>& v)
- {
- std::string s;
- s.append("{");
- typeof(v.begin()) it = v.begin();
- while (it != v.end())
- {
- s.append(toString(it->first));
- s.append("=");
- s.append(toString(it->second));
- s.append(",");
- ++it;
- }
- if (s.size() > 1)
- {
- s.erase(s.size() - 1, 1);
- }
- s.append("}");
- return s;
- }
-
- template<typename out_type, typename in_type>
- static out_type convert(const in_type& t)
- {
- out_type result;
- std::stringstream stream;
- stream << t;
- stream >> result;
- return result;
- }
-
- static bool compress(const char* pIn, int inLen, unsigned char** pOut, int* pOutLen, int level)
- {
- int ret, flush;
- int have;
- z_stream strm;
- unsigned char out[CHUNK];
-
- /* allocate deflate state */
- strm.zalloc = Z_NULL;
- strm.zfree = Z_NULL;
- strm.opaque = Z_NULL;
- ret = deflateInit(&strm, level);
- if (ret != Z_OK)
- {
- return false;
- }
-
- int outBufferLen = inLen;
- unsigned char* outData = (unsigned char*)malloc(outBufferLen);
- int left = inLen;
- int used = 0;
- int outDataLen = 0;
-
- /* compress until end of buffer */
- do
- {
- strm.avail_in = left > CHUNK ? CHUNK : left;
- flush = left <= CHUNK ? Z_FINISH : Z_NO_FLUSH;
- strm.next_in = (unsigned char*)pIn + used;
- used += strm.avail_in;
- left -= strm.avail_in;
-
- /* run deflate() on input until output buffer not full, finish
- compression if all of source has been read in */
- do
- {
- strm.avail_out = CHUNK;
- strm.next_out = out;
- ret = deflate(&strm, flush); /* no bad return value */
- assert(ret != Z_STREAM_ERROR); /* state not clobbered */
- have = CHUNK - strm.avail_out;
-
- if (outDataLen + have > outBufferLen)
- {
- outBufferLen = outDataLen + have;
- outBufferLen <<= 1;
- unsigned char* tmp = (unsigned char*)realloc(outData, outBufferLen);
- if (!tmp)
- {
- free(outData);
- return false;
- }
-
- outData = tmp;
- }
-
- memcpy(outData + outDataLen, out, have);
- outDataLen += have;
-
- }
- while (strm.avail_out == 0);
- assert(strm.avail_in == 0); /* all input will be used */
-
- /* done when last data in file processed */
- }
- while (flush != Z_FINISH);
- assert(ret == Z_STREAM_END); /* stream will be complete */
-
- *pOutLen = outDataLen;
- *pOut = outData;
-
- /* clean up and return */
- (void)deflateEnd(&strm);
- return true;
- }
-
- static bool decompress(const char* pIn, int inLen, unsigned char** pOut, int* pOutLen)
- {
- int ret;
- int have;
- z_stream strm;
-
- unsigned char out[CHUNK];
-
- /* allocate inflate state */
- strm.zalloc = Z_NULL;
- strm.zfree = Z_NULL;
- strm.opaque = Z_NULL;
- strm.avail_in = 0;
- strm.next_in = Z_NULL;
- ret = inflateInit(&strm);
- if (ret != Z_OK)
- {
- return false;
- }
-
- int outBufferLen = inLen << 2;
- unsigned char* outData = (unsigned char*)malloc(outBufferLen);
-
- int left = inLen;
- int used = 0;
- int outDataLen = 0;
-
- /* decompress until deflate stream ends or end of buffer */
- do
- {
- strm.avail_in = left > CHUNK ? CHUNK : left;
- if (strm.avail_in <= 0)
- {
- break;
- }
-
- strm.next_in = (unsigned char*)pIn + used;
- used += strm.avail_in;
- left -= strm.avail_in;
-
- /* run inflate() on input until output buffer not full */
- do
- {
- strm.avail_out = CHUNK;
- strm.next_out = out;
- ret = inflate(&strm, Z_NO_FLUSH);
- assert(ret != Z_STREAM_ERROR); /* state not clobbered */
- switch (ret)
- {
- case Z_NEED_DICT:
- ret = Z_DATA_ERROR; /* and fall through */
- case Z_DATA_ERROR:
- case Z_MEM_ERROR:
- (void)inflateEnd(&strm);
- free(outData);
- return false;
- }
- have = CHUNK - strm.avail_out;
-
- if (outDataLen + have > outBufferLen)
- {
- outBufferLen = outDataLen + have;
- outBufferLen <<= 1;
- unsigned char* tmp = (unsigned char*)realloc(outData, outBufferLen);
- if (!tmp)
- {
- free(outData);
- return false;
- }
-
- outData = tmp;
- }
-
- memcpy(outData + outDataLen, out, have);
- outDataLen += have;
-
- }
- while (strm.avail_out == 0);
-
- /* done when inflate() says it's done */
- }
- while (ret != Z_STREAM_END);
-
- /* clean up and return */
- (void)inflateEnd(&strm);
-
- if (ret == Z_STREAM_END)
- {
- *pOutLen = outDataLen;
- *pOut = outData;
-
- return true;
- }
- else
- {
- free(outData);
-
- return false;
- }
- }
-
- static unsigned long long hexstr2ull(const char* str)
- {
- char* end;
- return strtoull(str, &end, 16);
- }
-
- static long long str2ll(const char *str)
- {
- return atoll(str);
- }
-
-
- static std::string tm2str(const time_t& t, const std::string& sFormat)
- {
- struct tm stTm;
- localtime_r(&t, &stTm);
-
- char sTimeString[255] = "\0";
- strftime(sTimeString, sizeof(sTimeString), sFormat.c_str(), &stTm);
-
- return std::string(sTimeString);
- }
-
- static std::string now2str(const std::string& sFormat)
- {
- time_t t = time(NULL);
- return tm2str(t, sFormat.c_str());
- }
-
- static std::string now2str()
- {
- return now2str("%Y-%m-%d %H:%M:%S");
- }
-
- static int64_t now2ms()
- {
- struct timeval tv;
- gettimeofday(&tv, NULL);
- return tv.tv_sec * (int64_t)1000 + tv.tv_usec / 1000;
- }
-
- static int64_t now2us()
- {
- struct timeval tv;
- gettimeofday(&tv, NULL);
- return tv.tv_sec * (int64_t)1000*1000 + tv.tv_usec;
- }
-
- static int str2tm(const std::string &sString, const std::string &sFormat, struct tm &stTm)
- {
- char *p = strptime(sString.c_str(), sFormat.c_str(), &stTm);
- return (p != NULL) ? 0 : -1;
- }
-
- static time_t str2tm(const std::string &sString, const std::string &sFormat)
- {
- struct tm stTm;
- if (str2tm(sString, sFormat, stTm) == 0)
- {
- time_t t = mktime(&stTm);
- return t;
- }
- else
- {
- return -1;
- }
- }
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/Validators.cpp b/rocketmq-client4cpp/src/common/Validators.cpp
deleted file mode 100755
index 29f36a03..00000000
--- a/rocketmq-client4cpp/src/common/Validators.cpp
+++ /dev/null
@@ -1,132 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang, kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "Validators.h"
-
-#include <stdlib.h>
-#include <stdio.h>
-#include "MQClientException.h"
-#include "UtilAll.h"
-#include "MixAll.h"
-#include "Message.h"
-#include "MQProtos.h"
-#include "DefaultMQProducer.h"
-
-namespace rmq
-{
-
-const std::string Validators::validPatternStr = "^[a-zA-Z0-9_-]+$";
-const size_t Validators::CHARACTER_MAX_LENGTH = 255;
-
-bool Validators::regularExpressionMatcher(const std::string& origin, const std::string& patternStr)
-{
- if (UtilAll::isBlank(origin))
- {
- return false;
- }
-
- if (UtilAll::isBlank(patternStr))
- {
- return true;
- }
-
- //Pattern pattern = Pattern.compile(patternStr);
- //Matcher matcher = pattern.matcher(origin);
-
- //return matcher.matches();
- return true;
-}
-
-std::string Validators::getGroupWithRegularExpression(const std::string& origin, const std::string& patternStr)
-{
- /*Pattern pattern = Pattern.compile(patternStr);
- Matcher matcher = pattern.matcher(origin);
- while (matcher.find()) {
- return matcher.group(0);
- }*/
- return "";
-}
-
-void Validators::checkTopic(const std::string& topic)
-{
- if (UtilAll::isBlank(topic))
- {
- THROW_MQEXCEPTION(MQClientException, "the specified topic is blank", -1);
- }
-
- if (topic.length() > CHARACTER_MAX_LENGTH)
- {
- THROW_MQEXCEPTION(MQClientException, "the specified topic is longer than topic max length 255.", -1);
- }
-
- // Topic�����Ƿ��뱣���ֶγ�ͻ
- if (topic == MixAll::DEFAULT_TOPIC)
- {
- THROW_MQEXCEPTION(MQClientException, "the topic[" + topic + "] is conflict with default topic.", -1);
- }
-
- if (!regularExpressionMatcher(topic, validPatternStr))
- {
- std::string str;
- str = "the specified topic[" + topic + "] contains illegal characters, allowing only" + validPatternStr;
-
- THROW_MQEXCEPTION(MQClientException, str.c_str(), -1);
- }
-}
-
-void Validators::checkGroup(const std::string& group)
-{
- if (UtilAll::isBlank(group))
- {
- THROW_MQEXCEPTION(MQClientException, "the specified group is blank", -1);
- }
-
- if (!regularExpressionMatcher(group, validPatternStr))
- {
- std::string str;
- str = "the specified group[" + group + "] contains illegal characters, allowing only" + validPatternStr;
-
- THROW_MQEXCEPTION(MQClientException, str.c_str(), -1);
- }
- if (group.length() > CHARACTER_MAX_LENGTH)
- {
- THROW_MQEXCEPTION(MQClientException, "the specified group is longer than group max length 255.", -1);
- }
-}
-
-void Validators::checkMessage(const Message& msg, DefaultMQProducer* pDefaultMQProducer)
-{
- checkTopic(msg.getTopic());
-
- //// body
- if (msg.getBody() == NULL)
- {
- THROW_MQEXCEPTION(MQClientException, "the message body is null", MESSAGE_ILLEGAL_VALUE);
- }
-
- if (msg.getBodyLen() == 0)
- {
- THROW_MQEXCEPTION(MQClientException, "the message body length is zero", MESSAGE_ILLEGAL_VALUE);
- }
-
- if (msg.getBodyLen() > pDefaultMQProducer->getMaxMessageSize())
- {
- char info[256];
- snprintf(info, sizeof(info), "the message body size over max value, MAX: %d", pDefaultMQProducer->getMaxMessageSize());
- THROW_MQEXCEPTION(MQClientException, info, MESSAGE_ILLEGAL_VALUE);
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/common/Validators.h b/rocketmq-client4cpp/src/common/Validators.h
deleted file mode 100755
index 36ab299c..00000000
--- a/rocketmq-client4cpp/src/common/Validators.h
+++ /dev/null
@@ -1,49 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang, kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __VALIDATORST_H__
-#define __VALIDATORST_H__
-
-#include <string>
-
-namespace rmq
-{
- class MQClientException;
- class DefaultMQProducer;
- class Message;
-
- /**
- * Validator class
- *
- * @author manhong.yqd<jo...@gmail.com>
- * @since 2013-8-28
- */
- class Validators
- {
- public:
- static bool regularExpressionMatcher(const std::string& origin, const std::string& patternStr);
- static std::string getGroupWithRegularExpression(const std::string& origin, const std::string& patternStr);
-
- static void checkTopic(const std::string& topic);
- static void checkGroup(const std::string& group);
- static void checkMessage(const Message& msg, DefaultMQProducer* pDefaultMQProducer);
-
- public:
- static const std::string validPatternStr;
- static const size_t CHARACTER_MAX_LENGTH;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/common/VirtualEnvUtil.cpp b/rocketmq-client4cpp/src/common/VirtualEnvUtil.cpp
deleted file mode 100755
index c68bfc8a..00000000
--- a/rocketmq-client4cpp/src/common/VirtualEnvUtil.cpp
+++ /dev/null
@@ -1,66 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang, kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "VirtualEnvUtil.h"
-
-#include <stdlib.h>
-#include <stdio.h>
-#include "UtilAll.h"
-
-namespace rmq
-{
-
-const char* VirtualEnvUtil::VIRTUAL_APPGROUP_PREFIX = "%%PROJECT_%s%%";
-
-std::string VirtualEnvUtil::buildWithProjectGroup(const std::string& origin, const std::string& projectGroup)
-{
- if (!UtilAll::isBlank(projectGroup))
- {
- char prefix[1024];
- snprintf(prefix, sizeof(prefix), VIRTUAL_APPGROUP_PREFIX, projectGroup.c_str());
-
- if (origin.find_last_of(prefix) == std::string::npos)
- {
- return origin + prefix;
- }
- else
- {
- return origin;
- }
- }
- else
- {
- return origin;
- }
-}
-
-
-std::string VirtualEnvUtil::clearProjectGroup(const std::string& origin, const std::string& projectGroup)
-{
- char prefix[1024];
- snprintf(prefix, sizeof(prefix), VIRTUAL_APPGROUP_PREFIX, projectGroup.c_str());
- std::string::size_type pos = origin.find_last_of(prefix);
-
- if (!UtilAll::isBlank(prefix) && pos != std::string::npos)
- {
- return origin.substr(0, pos);
- }
- else
- {
- return origin;
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/common/VirtualEnvUtil.h b/rocketmq-client4cpp/src/common/VirtualEnvUtil.h
deleted file mode 100755
index 10ca0cde..00000000
--- a/rocketmq-client4cpp/src/common/VirtualEnvUtil.h
+++ /dev/null
@@ -1,41 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang, kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __VIRTUALENVUTIL_H__
-#define __VIRTUALENVUTIL_H__
-
-#include <string>
-
-namespace rmq
-{
- /**
- * VirtualEnv API
- *
- * @author manhong.yqd<jo...@gmail.com>
- * @since 2013-8-26
- */
- class VirtualEnvUtil
- {
- public:
- static std::string buildWithProjectGroup(const std::string& origin, const std::string& projectGroup);
- static std::string clearProjectGroup(const std::string& origin, const std::string& projectGroup);
-
- public:
- static const char* VIRTUAL_APPGROUP_PREFIX;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/AllocateMessageQueueStrategyInner.h b/rocketmq-client4cpp/src/consumer/AllocateMessageQueueStrategyInner.h
deleted file mode 100755
index 49e1e7c0..00000000
--- a/rocketmq-client4cpp/src/consumer/AllocateMessageQueueStrategyInner.h
+++ /dev/null
@@ -1,205 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __ALLOCATEMESSAGEQUEUESTRATEGYINNER_H__
-#define __ALLOCATEMESSAGEQUEUESTRATEGYINNER_H__
-
-#include <algorithm>
-
-#include "AllocateMessageQueueStrategy.h"
-#include "MQClientException.h"
-#include "UtilAll.h"
-
-
-namespace rmq
-{
-
- class AllocateMessageQueueAveragely : public AllocateMessageQueueStrategy
- {
- public:
- virtual ~AllocateMessageQueueAveragely() {}
- virtual std::vector<MessageQueue>* allocate(
- const std::string& consumerGroup,
- const std::string& currentCID,
- std::vector<MessageQueue>& mqAll,
- std::list<std::string>& cidAll)
- {
- if (currentCID.empty())
- {
- THROW_MQEXCEPTION(MQClientException, "currentCID is empty", -1);
- }
-
- if (mqAll.empty())
- {
- THROW_MQEXCEPTION(MQClientException, "mqAll is empty", -1);
- }
-
- if (cidAll.empty())
- {
- THROW_MQEXCEPTION(MQClientException, "cidAll is empty", -1);
- }
-
- int index = -1;
- int cidAllSize = cidAll.size();
-
- std::list<std::string>::iterator it = cidAll.begin();
- for (int i = 0; it != cidAll.end(); it++, i++)
- {
- if (*it == currentCID)
- {
- index = i;
- break;
- }
- }
-
- if (index == -1)
- {
- RMQ_ERROR("[BUG] ConsumerGroup: {%s} The consumerId: {%s} not in cidAll: {%s}", //
- consumerGroup.c_str(),
- currentCID.c_str(),
- UtilAll::toString(cidAll).c_str());
- return NULL;
- }
-
- int mqAllSize = mqAll.size();
- int mod = mqAllSize % cidAllSize;
- int averageSize =
- mqAllSize <= cidAllSize ? 1 : (mod > 0 && index < mod ? mqAllSize / cidAllSize
- + 1 : mqAllSize / cidAllSize);
- int startIndex = (mod > 0 && index < mod) ? index * averageSize : index * averageSize + mod;
-
- std::vector<MessageQueue>* result = new std::vector<MessageQueue>();
- int range = std::min<int>(averageSize, mqAllSize - startIndex);
-
- for (int i = 0; i < range; i++)
- {
- result->push_back(mqAll.at((startIndex + i) % mqAllSize));
- }
-
- return result;
- }
-
- virtual std::string getName()
- {
- return "AVG";
- }
- };
-
-
- class AllocateMessageQueueAveragelyByCircle : public AllocateMessageQueueStrategy
- {
- public:
- virtual ~AllocateMessageQueueAveragelyByCircle() {}
- virtual std::vector<MessageQueue>* allocate(
- const std::string& consumerGroup,
- const std::string& currentCID,
- std::vector<MessageQueue>& mqAll,
- std::list<std::string>& cidAll)
- {
- if (currentCID.empty())
- {
- THROW_MQEXCEPTION(MQClientException, "currentCID is empty", -1);
- }
-
- if (mqAll.empty())
- {
- THROW_MQEXCEPTION(MQClientException, "mqAll is empty", -1);
- }
-
- if (cidAll.empty())
- {
- THROW_MQEXCEPTION(MQClientException, "cidAll is empty", -1);
- }
-
- int index = -1;
- std::list<std::string>::iterator it = cidAll.begin();
- for (int i = 0; it != cidAll.end(); it++, i++)
- {
- if (*it == currentCID)
- {
- index = i;
- break;
- }
- }
-
- if (index == -1)
- {
- RMQ_ERROR("[BUG] ConsumerGroup: {%s} The consumerId: {%s} not in cidAll: {%s}", //
- consumerGroup.c_str(),
- currentCID.c_str(),
- UtilAll::toString(cidAll).c_str());
- return NULL;
- }
-
- std::vector<MessageQueue>* result = new std::vector<MessageQueue>();
- for (int i = index; i < (int)mqAll.size(); i++)
- {
- if (i % (int)cidAll.size() == index)
- {
- result->push_back(mqAll.at(i));
- }
- }
-
- return result;
- }
-
- virtual std::string getName()
- {
- return "AVG_BY_CIRCLE";
- }
- };
-
-
- class AllocateMessageQueueByConfig : public AllocateMessageQueueStrategy
- {
- public:
- virtual ~AllocateMessageQueueByConfig() {}
- virtual std::vector<MessageQueue>* allocate(
- const std::string& consumerGroup,
- const std::string& currentCID,
- std::vector<MessageQueue>& mqAll,
- std::list<std::string>& cidAll)
- {
- return NULL;
- }
-
- virtual std::string getName()
- {
- return "CONFIG";
- }
- };
-
-
- class AllocateMessageQueueByMachineRoom : public AllocateMessageQueueStrategy
- {
- public:
- virtual ~AllocateMessageQueueByMachineRoom() {}
- virtual std::vector<MessageQueue>* allocate(
- const std::string& consumerGroup,
- const std::string& currentCID,
- std::vector<MessageQueue>& mqAll,
- std::list<std::string>& cidAll)
- {
- return NULL;
- }
-
- virtual std::string getName()
- {
- return "MACHINE_ROOM";
- }
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/ConsumeMessageConcurrentlyService.cpp b/rocketmq-client4cpp/src/consumer/ConsumeMessageConcurrentlyService.cpp
deleted file mode 100755
index 7550acbe..00000000
--- a/rocketmq-client4cpp/src/consumer/ConsumeMessageConcurrentlyService.cpp
+++ /dev/null
@@ -1,476 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "ConsumeMessageConcurrentlyService.h"
-
-#include "DefaultMQPushConsumerImpl.h"
-#include "MessageListener.h"
-#include "MessageQueue.h"
-#include "RebalanceImpl.h"
-#include "DefaultMQPushConsumer.h"
-#include "MixAll.h"
-#include "KPRUtil.h"
-#include "UtilAll.h"
-#include "OffsetStore.h"
-
-namespace rmq
-{
-
-
-class SubmitConsumeRequestLater : public kpr::TimerHandler
-{
-public:
- SubmitConsumeRequestLater(std::list<MessageExt*>& msgs,
- ProcessQueue* pProcessQueue,
- MessageQueue messageQueue,
- ConsumeMessageConcurrentlyService* pService)
- : m_msgs(msgs),
- m_pProcessQueue(pProcessQueue),
- m_messageQueue(messageQueue),
- m_pService(pService)
- {
-
- }
-
- void OnTimeOut(unsigned int timerID)
- {
- try
- {
- m_pService->submitConsumeRequest(m_msgs, m_pProcessQueue, m_messageQueue, true);
- }
- catch(...)
- {
- RMQ_ERROR("SubmitConsumeRequestLater OnTimeOut exception");
- }
-
- delete this;
- }
-
-private:
- std::list<MessageExt*> m_msgs;
- ProcessQueue* m_pProcessQueue;
- MessageQueue m_messageQueue;
- ConsumeMessageConcurrentlyService* m_pService;
-};
-
-
-class CleanExpireMsgTask : public kpr::TimerHandler
-{
-public:
- CleanExpireMsgTask(ConsumeMessageConcurrentlyService* pService)
- : m_pService(pService)
- {
-
- }
-
- void OnTimeOut(unsigned int timerID)
- {
- try
- {
- m_pService->cleanExpireMsg();
- }
- catch(...)
- {
- RMQ_ERROR("CleanExpireMsgTask OnTimeOut exception");
- }
- }
-
-private:
- ConsumeMessageConcurrentlyService* m_pService;
-};
-
-
-
-ConsumeMessageConcurrentlyService::ConsumeMessageConcurrentlyService(
- DefaultMQPushConsumerImpl* pDefaultMQPushConsumerImpl,
- MessageListenerConcurrently* pMessageListener)
-{
- m_pDefaultMQPushConsumerImpl = pDefaultMQPushConsumerImpl;
- m_pMessageListener = pMessageListener;
- m_pDefaultMQPushConsumer = m_pDefaultMQPushConsumerImpl->getDefaultMQPushConsumer();
- m_consumerGroup = m_pDefaultMQPushConsumer->getConsumerGroup();
- m_pConsumeExecutor = new kpr::ThreadPool("ConsumeMessageThreadPool", 5,
- m_pDefaultMQPushConsumer->getConsumeThreadMin(), m_pDefaultMQPushConsumer->getConsumeThreadMax());
- m_pScheduledExecutorService = new kpr::TimerThread("ConsumeMessageConcurrentlyService", 1000);
- m_pCleanExpireMsgExecutors = new kpr::TimerThread("CleanExpireMsgService", 1000);
- m_pCleanExpireMsgTask = new CleanExpireMsgTask(this);
-}
-
-ConsumeMessageConcurrentlyService::~ConsumeMessageConcurrentlyService()
-{
- delete m_pCleanExpireMsgTask;
-}
-
-
-void ConsumeMessageConcurrentlyService::start()
-{
- m_pCleanExpireMsgExecutors->RegisterTimer(60 * 1000, 60 * 1000, m_pCleanExpireMsgTask, true);
- m_pScheduledExecutorService->Start();
- m_pCleanExpireMsgExecutors->Start();
-}
-
-void ConsumeMessageConcurrentlyService::shutdown()
-{
- m_pConsumeExecutor->Destroy();
- m_pScheduledExecutorService->Stop();
- m_pScheduledExecutorService->Join();
-
- m_pCleanExpireMsgExecutors->Stop();
- m_pCleanExpireMsgExecutors->Join();
-}
-
-
-void ConsumeMessageConcurrentlyService::cleanExpireMsg()
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_pDefaultMQPushConsumerImpl->getRebalanceImpl()->getProcessQueueTableLock());
- std::map<MessageQueue, ProcessQueue*>& processQueueTable
- = m_pDefaultMQPushConsumerImpl->getRebalanceImpl()->getProcessQueueTable();
- RMQ_FOR_EACH(processQueueTable, it)
- {
- ProcessQueue* pq = it->second;
- if (!pq->isDropped())
- {
- pq->cleanExpiredMsg(m_pDefaultMQPushConsumer);
- }
- }
-}
-
-
-ConsumerStat& ConsumeMessageConcurrentlyService::getConsumerStat()
-{
- return m_pDefaultMQPushConsumerImpl->getConsumerStatManager()->getConsumertat();
-}
-
-bool ConsumeMessageConcurrentlyService::sendMessageBack(MessageExt& msg,
- ConsumeConcurrentlyContext& context)
-{
- try
- {
- m_pDefaultMQPushConsumerImpl->sendMessageBack(msg,
- context.delayLevelWhenNextConsume, context.messageQueue.getBrokerName());
- return true;
- }
- catch (...)
- {
- RMQ_ERROR("sendMessageBack exception, group: %s, msg: %s",
- m_consumerGroup.c_str(), msg.toString().c_str());
- }
-
- return false;
-}
-
-void ConsumeMessageConcurrentlyService::submitConsumeRequestLater(std::list<MessageExt*>& msgs,
- ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue)
-{
- SubmitConsumeRequestLater* sc = new SubmitConsumeRequestLater(msgs, pProcessQueue, messageQueue, this);
- m_pScheduledExecutorService->RegisterTimer(0, 5000, sc, false);
-}
-
-void ConsumeMessageConcurrentlyService::submitConsumeRequest(std::list<MessageExt*>& msgs,
- ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue,
- bool dispathToConsume)
-{
- size_t consumeBatchSize = m_pDefaultMQPushConsumer->getConsumeMessageBatchMaxSize();
-
- RMQ_DEBUG("submitConsumeRequest begin, msgs.size=%d, messageQueue=%s, consumeBatchSize=%d, dispathToConsume=%d",
- (int)msgs.size(), messageQueue.toString().c_str(), (int)consumeBatchSize, dispathToConsume
- );
-
- if (msgs.size() <= consumeBatchSize)
- {
- kpr::ThreadPoolWorkPtr consumeRequest = new ConsumeConcurrentlyRequest(msgs, pProcessQueue, messageQueue, this);
- m_pConsumeExecutor->AddWork(consumeRequest);
- }
- else
- {
- std::list<MessageExt*>::iterator it = msgs.begin();
- for (; it != msgs.end();)
- {
- std::list<MessageExt*> msgThis;
- for (size_t i = 0; i < consumeBatchSize; i++, it++)
- {
- if (it != msgs.end())
- {
- msgThis.push_back(*it);
- }
- else
- {
- break;
- }
- }
-
- kpr::ThreadPoolWorkPtr consumeRequest = new ConsumeConcurrentlyRequest(msgThis, pProcessQueue, messageQueue, this);
- m_pConsumeExecutor->AddWork(consumeRequest);
- }
- }
-
- RMQ_DEBUG("submitConsumeRequest end");
-}
-
-void ConsumeMessageConcurrentlyService::updateCorePoolSize(int corePoolSize)
-{
- //todo
-}
-
-void ConsumeMessageConcurrentlyService::processConsumeResult(ConsumeConcurrentlyStatus status,
- ConsumeConcurrentlyContext& context,
- ConsumeConcurrentlyRequest& consumeRequest)
-{
- int ackIndex = context.ackIndex;
-
- if (consumeRequest.getMsgs().empty())
- {
- return;
- }
-
- int msgsSize = consumeRequest.getMsgs().size();
-
- switch (status)
- {
- case CONSUME_SUCCESS:
- {
- if (ackIndex >= msgsSize)
- {
- ackIndex = msgsSize - 1;
- }
-
- int ok = ackIndex + 1;
- int failed = msgsSize - ok;
- getConsumerStat().consumeMsgOKTotal.fetchAndAdd(ok);
- getConsumerStat().consumeMsgFailedTotal.fetchAndAdd(failed);
- }
-
- break;
- case RECONSUME_LATER:
- ackIndex = -1;
- getConsumerStat().consumeMsgFailedTotal.fetchAndAdd(msgsSize);
- break;
- default:
- break;
- }
-
- std::list<MessageExt*>& msgs = consumeRequest.getMsgs();
- std::list<MessageExt*>::iterator it = msgs.begin();
-
- for (int i = 0; i < ackIndex + 1 && it != msgs.end(); i++)
- {
- it++;
- }
-
- switch (m_pDefaultMQPushConsumer->getMessageModel())
- {
- case BROADCASTING:
- for (; it != msgs.end(); it++)
- {
- MessageExt* msg = *it;
- RMQ_WARN("BROADCASTING, the message consume failed, drop it, %s", msg->toString().c_str());
- }
- break;
- case CLUSTERING:
- {
- std::list<MessageExt*> msgBackFailed;
- for (; it != msgs.end(); it++)
- {
- MessageExt* msg = *it;
- bool result = sendMessageBack(*msg, context);
- if (!result)
- {
- msg->setReconsumeTimes(msg->getReconsumeTimes() + 1);
- msgBackFailed.push_back(msg);
- }
- }
-
- if (!msgBackFailed.empty())
- {
- it = msgs.begin();
-
- for (; it != msgs.end();)
- {
- bool find = false;
- std::list<MessageExt*>::iterator itFailed = msgBackFailed.begin();
- for (; itFailed != msgBackFailed.end(); itFailed++)
- {
- if (*it == *itFailed)
- {
- it = msgs.erase(it);
- find = true;
- break;
- }
- }
-
- if (!find)
- {
- it++;
- }
- }
-
- submitConsumeRequestLater(msgBackFailed, consumeRequest.getProcessQueue(),
- consumeRequest.getMessageQueue());
- }
- }
- break;
- default:
- break;
- }
-
- long long offset = consumeRequest.getProcessQueue()->removeMessage(consumeRequest.getMsgs());
- if (offset >= 0 && !(consumeRequest.getProcessQueue()->isDropped()))
- {
- m_pDefaultMQPushConsumerImpl->getOffsetStore()->updateOffset(consumeRequest.getMessageQueue(),
- offset, true);
- }
-}
-
-std::string& ConsumeMessageConcurrentlyService::getConsumerGroup()
-{
- return m_consumerGroup;
-}
-
-MessageListenerConcurrently* ConsumeMessageConcurrentlyService::getMessageListener()
-{
- return m_pMessageListener;
-}
-
-DefaultMQPushConsumerImpl* ConsumeMessageConcurrentlyService::getDefaultMQPushConsumerImpl()
-{
- return m_pDefaultMQPushConsumerImpl;
-}
-
-ConsumeConcurrentlyRequest::ConsumeConcurrentlyRequest(std::list<MessageExt*>& msgs,
- ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue,
- ConsumeMessageConcurrentlyService* pService)
-{
- m_msgs = msgs;
- m_pProcessQueue = pProcessQueue;
- m_pService = pService;
- m_messageQueue = messageQueue;
-}
-
-ConsumeConcurrentlyRequest::~ConsumeConcurrentlyRequest()
-{
- m_msgs.clear();
-}
-
-void ConsumeConcurrentlyRequest::Do()
-{
- RMQ_DEBUG("consumeMessage begin, m_msgs.size=%d", (int)m_msgs.size());
-
- if (m_pProcessQueue->isDropped())
- {
- RMQ_WARN("the message queue not be able to consume, because it's droped, {%s}",
- m_messageQueue.toString().c_str());
- return;
- }
-
- try
- {
- MessageListenerConcurrently* listener = m_pService->getMessageListener();
- ConsumeConcurrentlyContext context(m_messageQueue);
- ConsumeConcurrentlyStatus status = RECONSUME_LATER;
-
- ConsumeMessageContext consumeMessageContext;
- if (m_pService->getDefaultMQPushConsumerImpl()->hasHook())
- {
- consumeMessageContext.consumerGroup = m_pService->getConsumerGroup();
- consumeMessageContext.mq = m_messageQueue;
- consumeMessageContext.msgList = m_msgs;
- consumeMessageContext.success = false;
- m_pService->getDefaultMQPushConsumerImpl()->executeHookBefore(consumeMessageContext);
- }
-
- long long beginTimestamp = KPRUtil::GetCurrentTimeMillis();
- try
- {
- resetRetryTopic(m_msgs);
- if (!m_msgs.empty())
- {
- std::list<MessageExt*>::iterator it = m_msgs.begin();
- for (; it != m_msgs.end(); it++)
- {
- MessageExt* msg = (*it);
- msg->putProperty(Message::PROPERTY_CONSUME_START_TIMESTAMP,
- UtilAll::toString(KPRUtil::GetCurrentTimeMillis()));
- }
- }
- status = listener->consumeMessage(m_msgs, context);
- }
- catch (...)
- {
- RMQ_WARN("consumeMessage exception, Group: {%s} Msgs: {%d} MQ: {%s}",
- m_pService->getConsumerGroup().c_str(),
- (int)m_msgs.size(),
- m_messageQueue.toString().c_str()
- );
- }
-
- long long consumeRT = KPRUtil::GetCurrentTimeMillis() - beginTimestamp;
-
- if (m_pService->getDefaultMQPushConsumerImpl()->hasHook())
- {
- consumeMessageContext.success = (status == CONSUME_SUCCESS);
- m_pService->getDefaultMQPushConsumerImpl()->executeHookAfter(consumeMessageContext);
- }
-
- m_pService->getConsumerStat().consumeMsgRTTotal.fetchAndAdd(consumeRT);
- bool updated = MixAll::compareAndIncreaseOnly(m_pService->getConsumerStat().consumeMsgRTMax, consumeRT);
- if (updated)
- {
- RMQ_WARN("consumeMessage RT new max: %lld, Group: %s, Msgs: %d, MQ: %s",
- consumeRT,
- m_pService->getConsumerGroup().c_str(),
- (int)m_msgs.size(),
- m_messageQueue.toString().c_str()
- );
- }
-
- if (!m_pProcessQueue->isDropped())
- {
- m_pService->processConsumeResult(status, context, *this);
- }
- else
- {
- RMQ_WARN("processQueue is dropped without process consume result, messageQueue={%s}, msgs.size={%d}",
- m_messageQueue.toString().c_str(), (int)m_msgs.size());
- }
- }
- catch(...)
- {
- RMQ_WARN("ConsumeConcurrentlyRequest exception");
- }
- RMQ_DEBUG("consumeMessage end, m_msgs.size=%d", (int)m_msgs.size());
-
- return;
-}
-
-void ConsumeConcurrentlyRequest::resetRetryTopic(std::list<MessageExt*>& msgs)
-{
- std::string groupTopic = MixAll::getRetryTopic(m_pService->getConsumerGroup());
- std::list<MessageExt*>::iterator it = msgs.begin();
-
- for (; it != msgs.end(); it++)
- {
- MessageExt* msg = (*it);
- std::string retryTopic = msg->getProperty(Message::PROPERTY_RETRY_TOPIC);
- if (!retryTopic.empty() && groupTopic == msg->getTopic())
- {
- msg->setTopic(retryTopic);
- }
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/ConsumeMessageConcurrentlyService.h b/rocketmq-client4cpp/src/consumer/ConsumeMessageConcurrentlyService.h
deleted file mode 100755
index acb75383..00000000
--- a/rocketmq-client4cpp/src/consumer/ConsumeMessageConcurrentlyService.h
+++ /dev/null
@@ -1,120 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __CONSUMEMESSAGECONCURRENTLYSERVICE_H__
-#define __CONSUMEMESSAGECONCURRENTLYSERVICE_H__
-
-#include "ConsumeMessageService.h"
-
-#include <list>
-#include <string>
-#include "MessageQueueLock.h"
-#include "ConsumerStatManage.h"
-#include "MessageExt.h"
-#include "MessageListener.h"
-#include "ProcessQueue.h"
-#include "ThreadPool.h"
-#include "TimerThread.h"
-
-namespace rmq
-{
- class DefaultMQPushConsumerImpl;
- class DefaultMQPushConsumer;
- class MessageListenerConcurrently;
- class ConsumeMessageConcurrentlyService;
-
- class ConsumeConcurrentlyRequest: public kpr::ThreadPoolWork
- {
- public:
- ConsumeConcurrentlyRequest(std::list<MessageExt*>& msgs,
- ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue,
- ConsumeMessageConcurrentlyService* pService);
- ~ConsumeConcurrentlyRequest();
- virtual void Do();
-
- std::list<MessageExt*>& getMsgs()
- {
- return m_msgs;
- }
-
- ProcessQueue* getProcessQueue()
- {
- return m_pProcessQueue;
- }
-
- MessageQueue getMessageQueue()
- {
- return m_messageQueue;
- }
-
- private:
- void resetRetryTopic(std::list<MessageExt*>& msgs);
-
- private:
- std::list<MessageExt*> m_msgs;
- ProcessQueue* m_pProcessQueue;
- MessageQueue m_messageQueue;
- ConsumeMessageConcurrentlyService* m_pService;
- };
-
-
- class ConsumeMessageConcurrentlyService : public ConsumeMessageService
- {
- public:
- ConsumeMessageConcurrentlyService(DefaultMQPushConsumerImpl* pDefaultMQPushConsumerImpl,
- MessageListenerConcurrently* pMessageListener);
- ~ConsumeMessageConcurrentlyService();
-
- void start();
- void shutdown();
-
- void cleanExpireMsg();
- ConsumerStat& getConsumerStat();
-
- bool sendMessageBack(MessageExt& msg, ConsumeConcurrentlyContext& context);
- void processConsumeResult(ConsumeConcurrentlyStatus status,
- ConsumeConcurrentlyContext& context,
- ConsumeConcurrentlyRequest& consumeRequest);
-
- void submitConsumeRequestLater(std::list<MessageExt*>& pMsgs,
- ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue);
-
- void submitConsumeRequest(std::list<MessageExt*>& pMsgs,
- ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue,
- bool dispathToConsume);
-
- void updateCorePoolSize(int corePoolSize);
-
- std::string& getConsumerGroup();
- MessageListenerConcurrently* getMessageListener();
- DefaultMQPushConsumerImpl* getDefaultMQPushConsumerImpl();
-
- private:
- DefaultMQPushConsumerImpl* m_pDefaultMQPushConsumerImpl;
- DefaultMQPushConsumer* m_pDefaultMQPushConsumer;
- MessageListenerConcurrently* m_pMessageListener;
- std::string m_consumerGroup;
- kpr::ThreadPoolPtr m_pConsumeExecutor;
- kpr::TimerThreadPtr m_pScheduledExecutorService;
- kpr::TimerThreadPtr m_pCleanExpireMsgExecutors;
- kpr::TimerHandler* m_pCleanExpireMsgTask;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/ConsumeMessageOrderlyService.cpp b/rocketmq-client4cpp/src/consumer/ConsumeMessageOrderlyService.cpp
deleted file mode 100755
index c7d96957..00000000
--- a/rocketmq-client4cpp/src/consumer/ConsumeMessageOrderlyService.cpp
+++ /dev/null
@@ -1,574 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include <list>
-#include <string>
-
-#include "ConsumeMessageOrderlyService.h"
-#include "DefaultMQPushConsumerImpl.h"
-#include "MQClientFactory.h"
-#include "DefaultMQProducer.h"
-#include "MessageListener.h"
-#include "MessageQueue.h"
-#include "RebalanceImpl.h"
-#include "DefaultMQPushConsumer.h"
-#include "OffsetStore.h"
-#include "ScopedLock.h"
-#include "KPRUtil.h"
-#include "MixAll.h"
-#include "UtilAll.h"
-
-namespace rmq
-{
-
-class LockMq : public kpr::TimerHandler
-{
-public:
- LockMq(ConsumeMessageOrderlyService* pService)
- : m_pService(pService)
- {
-
- }
-
- void OnTimeOut(unsigned int timerID)
- {
- m_pService->lockMQPeriodically();
-
- // can not delete
- //delete this;
- }
-
-private:
- ConsumeMessageOrderlyService* m_pService;
-};
-
-class SubmitConsumeRequestLaterOrderly : public kpr::TimerHandler
-{
-public:
- SubmitConsumeRequestLaterOrderly(ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue,
- ConsumeMessageOrderlyService* pService)
- : m_pProcessQueue(pProcessQueue),
- m_messageQueue(messageQueue),
- m_pService(pService)
- {
-
- }
-
- void OnTimeOut(unsigned int timerID)
- {
- try
- {
- std::list<MessageExt*> msgs;
- m_pService->submitConsumeRequest(msgs, m_pProcessQueue, m_messageQueue, true);
- }
- catch(...)
- {
- RMQ_ERROR("SubmitConsumeRequestLaterOrderly OnTimeOut exception");
- }
-
- delete this;
- }
-
-private:
- ProcessQueue* m_pProcessQueue;
- MessageQueue m_messageQueue;
- ConsumeMessageOrderlyService* m_pService;
-};
-
-
-class TryLockLaterAndReconsume : public kpr::TimerHandler
-{
-public:
- TryLockLaterAndReconsume(ProcessQueue* pProcessQueue,
- MessageQueue& messageQueue,
- ConsumeMessageOrderlyService* pService)
- : m_pProcessQueue(pProcessQueue),
- m_messageQueue(messageQueue),
- m_pService(pService)
- {
-
- }
-
- void OnTimeOut(unsigned int timerID)
- {
- try
- {
- bool lockOK = m_pService->lockOneMQ(m_messageQueue);
- if (lockOK)
- {
- m_pService->submitConsumeRequestLater(m_pProcessQueue, m_messageQueue, 10);
- }
- else
- {
- m_pService->submitConsumeRequestLater(m_pProcessQueue, m_messageQueue, 3000);
- }
- }
- catch(...)
- {
- RMQ_ERROR("TryLockLaterAndReconsume OnTimeOut exception");
- }
-
- delete this;
- }
-
-private:
- ProcessQueue* m_pProcessQueue;
- MessageQueue m_messageQueue;
- ConsumeMessageOrderlyService* m_pService;
-};
-
-
-
-ConsumeMessageOrderlyService::ConsumeMessageOrderlyService(DefaultMQPushConsumerImpl* pDefaultMQPushConsumerImpl,
- MessageListenerOrderly* pMessageListener)
-{
- m_stoped = false;
- m_pDefaultMQPushConsumerImpl = pDefaultMQPushConsumerImpl;
- m_pMessageListener = pMessageListener;
- m_pDefaultMQPushConsumer = m_pDefaultMQPushConsumerImpl->getDefaultMQPushConsumer();
- m_consumerGroup = m_pDefaultMQPushConsumer->getConsumerGroup();
- m_pConsumeExecutor = new kpr::ThreadPool("ConsumeMessageThreadPool", 1,
- m_pDefaultMQPushConsumer->getConsumeThreadMin(), m_pDefaultMQPushConsumer->getConsumeThreadMax());
- m_scheduledExecutorService = new kpr::TimerThread("ConsumeMessageConcurrentlyService", 10);
-}
-
-ConsumeMessageOrderlyService::~ConsumeMessageOrderlyService()
-{
-}
-
-
-void ConsumeMessageOrderlyService::start()
-{
- m_scheduledExecutorService->Start();
-
- LockMq* lm = new LockMq(this);
- m_scheduledExecutorService->RegisterTimer(0, ProcessQueue::s_RebalanceLockInterval, lm, true);
-}
-
-void ConsumeMessageOrderlyService::shutdown()
-{
- m_stoped = true;
- m_pConsumeExecutor->Destroy();
- m_scheduledExecutorService->Stop();
- m_scheduledExecutorService->Join();
- unlockAllMQ();
-}
-
-void ConsumeMessageOrderlyService::unlockAllMQ()
-{
- m_pDefaultMQPushConsumerImpl->getRebalanceImpl()->unlockAll(false);
-}
-
-void ConsumeMessageOrderlyService::lockMQPeriodically()
-{
- if (!m_stoped)
- {
- m_pDefaultMQPushConsumerImpl->getRebalanceImpl()->lockAll();
- }
-}
-
-bool ConsumeMessageOrderlyService::lockOneMQ(MessageQueue& mq)
-{
- if (!m_stoped)
- {
- return m_pDefaultMQPushConsumerImpl->getRebalanceImpl()->lock(mq);
- }
-
- return false;
-}
-
-void ConsumeMessageOrderlyService::tryLockLaterAndReconsume(MessageQueue& messageQueue,
- ProcessQueue* pProcessQueue,
- long long delayMills)
-{
- TryLockLaterAndReconsume* consume = new TryLockLaterAndReconsume(pProcessQueue, messageQueue, this);
- m_scheduledExecutorService->RegisterTimer(0, int(delayMills), consume, false);
-}
-
-ConsumerStat& ConsumeMessageOrderlyService::getConsumerStat()
-{
- return m_pDefaultMQPushConsumerImpl->getConsumerStatManager()->getConsumertat();
-}
-
-void ConsumeMessageOrderlyService::submitConsumeRequestLater(ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue,
- long long suspendTimeMillis)
-{
- long timeMillis = long(suspendTimeMillis);
- if (timeMillis < 10)
- {
- timeMillis = 10;
- }
- else if (timeMillis > 30000)
- {
- timeMillis = 30000;
- }
-
- SubmitConsumeRequestLaterOrderly* sc = new SubmitConsumeRequestLaterOrderly(pProcessQueue, messageQueue, this);
- m_scheduledExecutorService->RegisterTimer(0, timeMillis, sc, false);
-}
-
-void ConsumeMessageOrderlyService::submitConsumeRequest(std::list<MessageExt*>& msgs,
- ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue,
- bool dispathToConsume)
-{
- if (dispathToConsume)
- {
- kpr::ThreadPoolWorkPtr consumeRequest = new ConsumeOrderlyRequest(pProcessQueue, messageQueue, this);
- m_pConsumeExecutor->AddWork(consumeRequest);
- }
-}
-
-void ConsumeMessageOrderlyService::updateCorePoolSize(int corePoolSize)
-{
-}
-
-
-std::string& ConsumeMessageOrderlyService::getConsumerGroup()
-{
- return m_consumerGroup;
-}
-
-MessageListenerOrderly* ConsumeMessageOrderlyService::getMessageListener()
-{
- return m_pMessageListener;
-}
-
-DefaultMQPushConsumerImpl* ConsumeMessageOrderlyService::getDefaultMQPushConsumerImpl()
-{
- return m_pDefaultMQPushConsumerImpl;
-}
-
-bool ConsumeMessageOrderlyService::processConsumeResult(std::list<MessageExt*>& msgs,
- ConsumeOrderlyStatus status,
- ConsumeOrderlyContext& context,
- ConsumeOrderlyRequest& consumeRequest)
-{
- bool continueConsume = true;
- long long commitOffset = -1L;
- int msgsSize = msgs.size();
-
- if (context.autoCommit)
- {
- switch (status)
- {
- case COMMIT:
- case ROLLBACK:
- RMQ_WARN("the message queue consume result is illegal, we think you want to ack these message: %s",
- consumeRequest.getMessageQueue().toString().c_str());
- case SUCCESS:
- getConsumerStat().consumeMsgOKTotal.fetchAndAdd(msgsSize);
- commitOffset = consumeRequest.getProcessQueue()->commit();
- break;
- case SUSPEND_CURRENT_QUEUE_A_MOMENT:
- getConsumerStat().consumeMsgFailedTotal.fetchAndAdd(msgsSize);
- if (checkReconsumeTimes(msgs))
- {
- consumeRequest.getProcessQueue()->makeMessageToCosumeAgain(msgs);
- submitConsumeRequestLater(consumeRequest.getProcessQueue(),
- consumeRequest.getMessageQueue(),
- context.suspendCurrentQueueTimeMillis);
- continueConsume = false;
- }
- else
- {
- commitOffset = consumeRequest.getProcessQueue()->commit();
- }
-
- break;
- default:
- break;
- }
- }
- else
- {
- switch (status)
- {
- case SUCCESS:
- getConsumerStat().consumeMsgOKTotal.fetchAndAdd(msgsSize);
- break;
- case COMMIT:
- commitOffset = consumeRequest.getProcessQueue()->commit();
- break;
- case ROLLBACK:
- consumeRequest.getProcessQueue()->rollback();
- submitConsumeRequestLater(consumeRequest.getProcessQueue(),
- consumeRequest.getMessageQueue(),
- context.suspendCurrentQueueTimeMillis);
- continueConsume = false;
- break;
- case SUSPEND_CURRENT_QUEUE_A_MOMENT:
- getConsumerStat().consumeMsgFailedTotal.fetchAndAdd(msgsSize);
- if (checkReconsumeTimes(msgs))
- {
- consumeRequest.getProcessQueue()->makeMessageToCosumeAgain(msgs);
- submitConsumeRequestLater(consumeRequest.getProcessQueue(),
- consumeRequest.getMessageQueue(),
- context.suspendCurrentQueueTimeMillis);
- continueConsume = false;
- }
- break;
- default:
- break;
- }
- }
-
- if (commitOffset >= 0 && !consumeRequest.getProcessQueue()->isDropped())
- {
- m_pDefaultMQPushConsumerImpl->getOffsetStore()->updateOffset(consumeRequest.getMessageQueue(),
- commitOffset, false);
- }
-
- return continueConsume;
-}
-
-bool ConsumeMessageOrderlyService::checkReconsumeTimes(std::list<MessageExt*>& msgs)
-{
- bool suspend = false;
-
- if (!msgs.empty())
- {
- std::list<MessageExt*>::iterator it = msgs.begin();
- for (; it != msgs.end(); it++)
- {
- MessageExt* msg = *it;
- if (msg->getReconsumeTimes() >= m_pDefaultMQPushConsumer->getMaxReconsumeTimes())
- {
- msg->putProperty(Message::PROPERTY_RECONSUME_TIME, UtilAll::toString(msg->getReconsumeTimes()));
-
- if (!sendMessageBack(*msg))
- {
- suspend = true;
- msg->setReconsumeTimes(msg->getReconsumeTimes() + 1);
- }
- }
- else
- {
- suspend = true;
- msg->setReconsumeTimes(msg->getReconsumeTimes() + 1);
- }
- }
- }
-
- return suspend;
-}
-
-bool ConsumeMessageOrderlyService::sendMessageBack(MessageExt& msg)
-{
- try
- {
- Message newMsg(MixAll::getRetryTopic(m_pDefaultMQPushConsumer->getConsumerGroup()),
- msg.getBody(), msg.getBodyLen());
-
- std::string originMsgId = msg.getProperty(Message::PROPERTY_ORIGIN_MESSAGE_ID);
- newMsg.putProperty(Message::PROPERTY_ORIGIN_MESSAGE_ID, UtilAll::isBlank(originMsgId) ? msg.getMsgId()
- : originMsgId);
-
- newMsg.setFlag(msg.getFlag());
- newMsg.setProperties(msg.getProperties());
- newMsg.putProperty(Message::PROPERTY_RETRY_TOPIC, msg.getTopic());
-
- int reTimes = msg.getReconsumeTimes() + 1;
- newMsg.putProperty(Message::PROPERTY_RECONSUME_TIME, UtilAll::toString(reTimes));
- newMsg.putProperty(Message::PROPERTY_MAX_RECONSUME_TIMES, UtilAll::toString(m_pDefaultMQPushConsumer->getMaxReconsumeTimes()));
- newMsg.setDelayTimeLevel(3 + reTimes);
-
- m_pDefaultMQPushConsumerImpl->getmQClientFactory()->getDefaultMQProducer()->send(newMsg);
-
- return true;
- }
- catch (...)
- {
- RMQ_ERROR("sendMessageBack exception, group: %s, msg: %s",
- m_consumerGroup.c_str(), msg.toString().c_str());
- }
-
- return false;
-}
-
-
-MessageQueueLock& ConsumeMessageOrderlyService::getMessageQueueLock()
-{
- return m_messageQueueLock;
-}
-
-DefaultMQPushConsumer* ConsumeMessageOrderlyService::getDefaultMQPushConsumer()
-{
- return m_pDefaultMQPushConsumer;
-}
-
-ConsumeOrderlyRequest::ConsumeOrderlyRequest(ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue,
- ConsumeMessageOrderlyService* pService)
-{
- m_pProcessQueue = pProcessQueue;
- m_messageQueue = messageQueue;
- m_pService = pService;
-}
-
-ConsumeOrderlyRequest::~ConsumeOrderlyRequest()
-{
-}
-
-void ConsumeOrderlyRequest::Do()
-{
- if (m_pProcessQueue->isDropped())
- {
- RMQ_WARN("run, the message queue not be able to consume, because it's dropped, MQ: %s",
- m_messageQueue.toString().c_str());
- return;
- }
-
- try
- {
- kpr::Mutex* objLock = m_pService->getMessageQueueLock().fetchLockObject(m_messageQueue);
- {
- kpr::ScopedLock<kpr::Mutex> lock(*objLock);
-
- MessageModel messageModel = m_pService->getDefaultMQPushConsumerImpl()->messageModel();
- if (BROADCASTING == messageModel
- || (m_pProcessQueue->isLocked() || !m_pProcessQueue->isLockExpired()))
- {
- long long beginTime = KPRUtil::GetCurrentTimeMillis();
- for (bool continueConsume = true; continueConsume;)
- {
- if (m_pProcessQueue->isDropped())
- {
- RMQ_INFO("the message queue not be able to consume, because it's droped, MQ: %s",
- m_messageQueue.toString().c_str());
- break;
- }
-
- if (CLUSTERING == messageModel
- && !m_pProcessQueue->isLocked())
- {
- RMQ_WARN("the message queue not locked, so consume later, MQ: %s", m_messageQueue.toString().c_str());
- m_pService->tryLockLaterAndReconsume(m_messageQueue, m_pProcessQueue, 10);
- break;
- }
-
- if (CLUSTERING == messageModel
- && m_pProcessQueue->isLockExpired())
- {
- RMQ_WARN("the message queue lock expired, so consume later, MQ: %s", m_messageQueue.toString().c_str());
- m_pService->tryLockLaterAndReconsume(m_messageQueue, m_pProcessQueue, 10);
- break;
- }
-
- long interval = long(KPRUtil::GetCurrentTimeMillis() - beginTime);
- if (interval > ConsumeMessageOrderlyService::s_MaxTimeConsumeContinuously)
- {
- m_pService->submitConsumeRequestLater(m_pProcessQueue, m_messageQueue, 10);
- break;
- }
-
- int consumeBatchSize =
- m_pService->getDefaultMQPushConsumer()->getConsumeMessageBatchMaxSize();
-
- std::list<MessageExt*> msgs = m_pProcessQueue->takeMessages(consumeBatchSize);
- if (!msgs.empty())
- {
- ConsumeOrderlyContext context(m_messageQueue);
-
- ConsumeOrderlyStatus status = SUSPEND_CURRENT_QUEUE_A_MOMENT;
-
- ConsumeMessageContext consumeMessageContext;
- if (m_pService->getDefaultMQPushConsumerImpl()->hasHook())
- {
- consumeMessageContext.consumerGroup = m_pService->getConsumerGroup();
- consumeMessageContext.mq = m_messageQueue;
- consumeMessageContext.msgList = msgs;
- consumeMessageContext.success = false;
- m_pService->getDefaultMQPushConsumerImpl()->executeHookBefore(consumeMessageContext);
- }
-
- long long beginTimestamp = KPRUtil::GetCurrentTimeMillis();
- try
- {
- kpr::ScopedLock<kpr::Mutex> lock(m_pProcessQueue->getLockConsume());
- if (m_pProcessQueue->isDropped())
- {
- RMQ_WARN("consumeMessage, the message queue not be able to consume, because it's dropped, MQ: %s",
- m_messageQueue.toString().c_str());
- break;
- }
-
- status = m_pService->getMessageListener()->consumeMessage(msgs, context);
- }
- catch (...)
- {
- RMQ_WARN("consumeMessage exception, Group: {%s}, Msgs: {%u}, MQ: %s",//
- m_pService->getConsumerGroup().c_str(),
- (unsigned)msgs.size(),
- m_messageQueue.toString().c_str());
- }
-
- long long consumeRT = KPRUtil::GetCurrentTimeMillis() - beginTimestamp;
-
- if (SUSPEND_CURRENT_QUEUE_A_MOMENT == status
- || ROLLBACK == status)
- {
- RMQ_WARN("consumeMessage Orderly return not OK, Group: {%s} Msgs: {%u} MQ: %s",//
- m_pService->getConsumerGroup().c_str(),
- (unsigned)msgs.size(),
- m_messageQueue.toString().c_str());
- //status = ConsumeOrderlyStatus.SUSPEND_CURRENT_QUEUE_A_MOMENT;
- }
-
- if (m_pService->getDefaultMQPushConsumerImpl()->hasHook())
- {
- consumeMessageContext.success = (SUCCESS == status
- || COMMIT == status);
- m_pService->getDefaultMQPushConsumerImpl()->executeHookAfter(consumeMessageContext);
- }
-
- m_pService->getConsumerStat().consumeMsgRTTotal.fetchAndAdd(consumeRT);
- MixAll::compareAndIncreaseOnly(m_pService->getConsumerStat()
- .consumeMsgRTMax, consumeRT);
-
- continueConsume = m_pService->processConsumeResult(msgs, status, context, *this);
- }
- else
- {
- continueConsume = false;
- }
- }
- }
- else
- {
- if (m_pProcessQueue->isDropped())
- {
- RMQ_WARN("consumeMessage, the message queue not be able to consume, because it's dropped, MQ: %s",
- m_messageQueue.toString().c_str());
- return;
- }
-
- m_pService->tryLockLaterAndReconsume(m_messageQueue, m_pProcessQueue, 100);
- }
- }
- }
- catch(...)
- {
- RMQ_WARN("ConsumeOrderlyRequest exception");
- }
-
- return;
-}
-
-}
-
diff --git a/rocketmq-client4cpp/src/consumer/ConsumeMessageOrderlyService.h b/rocketmq-client4cpp/src/consumer/ConsumeMessageOrderlyService.h
deleted file mode 100755
index 0f8628ba..00000000
--- a/rocketmq-client4cpp/src/consumer/ConsumeMessageOrderlyService.h
+++ /dev/null
@@ -1,122 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __CONSUMEMESSAGEORDERLYSERVICE_H__
-#define __CONSUMEMESSAGEORDERLYSERVICE_H__
-
-#include "ConsumeMessageService.h"
-
-#include <list>
-#include <string>
-#include "RocketMQClient.h"
-#include "ConsumerStatManage.h"
-#include "MessageQueueLock.h"
-#include "MessageListener.h"
-#include "ThreadPool.h"
-#include "TimerThread.h"
-
-namespace rmq
-{
-class DefaultMQPushConsumerImpl;
-class MessageListenerOrderly;
-class DefaultMQPushConsumer;
-class ConsumeMessageOrderlyService;
-
-class ConsumeOrderlyRequest: public kpr::ThreadPoolWork
-{
-public:
- ConsumeOrderlyRequest(ProcessQueue *pProcessQueue,
- const MessageQueue &messageQueue,
- ConsumeMessageOrderlyService *pService);
- ~ConsumeOrderlyRequest();
-
- virtual void Do();
-
- ProcessQueue *getProcessQueue()
- {
- return m_pProcessQueue;
- }
-
- MessageQueue &getMessageQueue()
- {
- return m_messageQueue;
- }
-
-private:
- ProcessQueue *m_pProcessQueue;
- MessageQueue m_messageQueue;
- ConsumeMessageOrderlyService *m_pService;
-};
-
-
-class ConsumeMessageOrderlyService : public ConsumeMessageService
-{
-public:
- static const long s_MaxTimeConsumeContinuously = 60000;
-
-public:
- ConsumeMessageOrderlyService(DefaultMQPushConsumerImpl
- *pDefaultMQPushConsumerImpl,
- MessageListenerOrderly *pMessageListener);
- ~ConsumeMessageOrderlyService();
-
- void start();
- void shutdown();
-
- void unlockAllMQ();
- void lockMQPeriodically();
- bool lockOneMQ(MessageQueue &mq);
- void tryLockLaterAndReconsume(MessageQueue &messageQueue,
- ProcessQueue *pProcessQueue,
- long long delayMills);
- bool processConsumeResult(std::list<MessageExt *> &msgs,
- ConsumeOrderlyStatus status,
- ConsumeOrderlyContext &context,
- ConsumeOrderlyRequest &consumeRequest);
- bool checkReconsumeTimes(std::list<MessageExt *> &msgs);
- bool sendMessageBack(MessageExt &msg);
- ConsumerStat& getConsumerStat();
-
- void submitConsumeRequestLater(ProcessQueue *pProcessQueue,
- const MessageQueue &messageQueue,
- long long suspendTimeMillis);
-
- void submitConsumeRequest(std::list<MessageExt *> &msgs,
- ProcessQueue *pProcessQueue,
- const MessageQueue &messageQueue,
- bool dispathToConsume);
-
- void updateCorePoolSize(int corePoolSize);
- MessageQueueLock &getMessageQueueLock();
- std::string &getConsumerGroup();
- MessageListenerOrderly *getMessageListener();
- DefaultMQPushConsumerImpl *getDefaultMQPushConsumerImpl();
- DefaultMQPushConsumer *getDefaultMQPushConsumer();
-
-private:
- volatile bool m_stoped;
- DefaultMQPushConsumerImpl *m_pDefaultMQPushConsumerImpl;
- DefaultMQPushConsumer *m_pDefaultMQPushConsumer;
- MessageListenerOrderly *m_pMessageListener;
- std::string m_consumerGroup;
- MessageQueueLock m_messageQueueLock;
-
- kpr::ThreadPoolPtr m_pConsumeExecutor;
- kpr::TimerThreadPtr m_scheduledExecutorService;
-};
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/ConsumeMessageService.h b/rocketmq-client4cpp/src/consumer/ConsumeMessageService.h
deleted file mode 100755
index 57a9bee4..00000000
--- a/rocketmq-client4cpp/src/consumer/ConsumeMessageService.h
+++ /dev/null
@@ -1,41 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __CONSUMEMESSAGESERVICE_H__
-#define __CONSUMEMESSAGESERVICE_H__
-
-#include <list>
-
-namespace rmq
-{
- class MessageExt;
- class ProcessQueue;
- class MessageQueue;
-
- class ConsumeMessageService
- {
- public:
- virtual ~ConsumeMessageService() {}
- virtual void start() = 0;
- virtual void shutdown() = 0;
- virtual void updateCorePoolSize(int corePoolSize) = 0;
- virtual void submitConsumeRequest(std::list<MessageExt*>& msgs,
- ProcessQueue* pProcessQueue,
- const MessageQueue& messageQueue,
- bool dispathToConsume) = 0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/ConsumeType.cpp b/rocketmq-client4cpp/src/consumer/ConsumeType.cpp
deleted file mode 100755
index 6ef58379..00000000
--- a/rocketmq-client4cpp/src/consumer/ConsumeType.cpp
+++ /dev/null
@@ -1,70 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "ConsumeType.h"
-
-namespace rmq
-{
-
-const char* getConsumeTypeString(ConsumeType type)
-{
- switch (type)
- {
- case CONSUME_ACTIVELY:
- return "CONSUME_ACTIVELY";
- case CONSUME_PASSIVELY:
- return "CONSUME_PASSIVELY";
- }
-
- return "UnknowConsumeType";
-}
-
-const char* getConsumeFromWhereString(ConsumeFromWhere type)
-{
- switch (type)
- {
- case CONSUME_FROM_LAST_OFFSET:
- return "CONSUME_FROM_LAST_OFFSET";
- case CONSUME_FROM_LAST_OFFSET_AND_FROM_MIN_WHEN_BOOT_FIRST:
- return "CONSUME_FROM_LAST_OFFSET_AND_FROM_MIN_WHEN_BOOT_FIRST";
- case CONSUME_FROM_MAX_OFFSET:
- return "CONSUME_FROM_MAX_OFFSET";
- case CONSUME_FROM_MIN_OFFSET:
- return "CONSUME_FROM_MIN_OFFSET";
- case CONSUME_FROM_FIRST_OFFSET:
- return "CONSUME_FROM_FIRST_OFFSET";
- case CONSUME_FROM_TIMESTAMP:
- return "CONSUME_FROM_TIMESTAMP";
- }
-
- return "UnknowConsumeFromWhere";
-}
-
-const char* getMessageModelString(MessageModel type)
-{
- switch (type)
- {
- case CLUSTERING:
- return "CLUSTERING";
- case BROADCASTING:
- return "BROADCASTING";
- }
-
- return "UnknowMessageModel";
-}
-
-}
-
diff --git a/rocketmq-client4cpp/src/consumer/ConsumerInvokeCallback.cpp b/rocketmq-client4cpp/src/consumer/ConsumerInvokeCallback.cpp
deleted file mode 100755
index c9dc304e..00000000
--- a/rocketmq-client4cpp/src/consumer/ConsumerInvokeCallback.cpp
+++ /dev/null
@@ -1,96 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "ConsumerInvokeCallback.h"
-#include "ResponseFuture.h"
-#include "PullResult.h"
-#include "MQClientAPIImpl.h"
-#include "PullCallback.h"
-#include "MQClientException.h"
-#include "RemotingCommand.h"
-
-namespace rmq
-{
-
-ConsumerInvokeCallback::ConsumerInvokeCallback(PullCallback* pPullCallback, MQClientAPIImpl* pMQClientAPIImpl)
- : m_pPullCallback(pPullCallback),
- m_pMQClientAPIImpl(pMQClientAPIImpl)
-{
-}
-
-ConsumerInvokeCallback::~ConsumerInvokeCallback()
-{
- if (m_pPullCallback != NULL)
- {
- delete m_pPullCallback;
- m_pPullCallback = NULL;
- }
-}
-
-void ConsumerInvokeCallback::operationComplete(ResponseFuturePtr pResponseFuture)
-{
- if (m_pPullCallback == NULL)
- {
- delete this;
- return;
- }
-
- RemotingCommand* response = pResponseFuture->getResponseCommand();
- if (response != NULL)
- {
- try
- {
- PullResult* pullResult = m_pMQClientAPIImpl->processPullResponse(response);
- response->setBody(NULL, 0, false);
-
- m_pPullCallback->onSuccess(*pullResult);
-
- pullResult->msgFoundList.clear();
- delete pullResult;
- }
- catch (MQException& e)
- {
- m_pPullCallback->onException(e);
- }
-
- delete response;
- }
- else
- {
- if (!pResponseFuture->isSendRequestOK())
- {
- std::string msg = "send request failed";
- MQClientException e(msg, -1, __FILE__, __LINE__);
- m_pPullCallback->onException(e);
- }
- else if (pResponseFuture->isTimeout())
- {
- std::string msg = "wait response timeout";
- MQClientException e(msg, -1, __FILE__, __LINE__);
- m_pPullCallback->onException(e);
- }
- else
- {
- std::string msg = "unknow reseaon";
- MQClientException e(msg, -1, __FILE__, __LINE__);
- m_pPullCallback->onException(e);
- }
- }
-
- delete this;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/ConsumerInvokeCallback.h b/rocketmq-client4cpp/src/consumer/ConsumerInvokeCallback.h
deleted file mode 100755
index 675f2fd7..00000000
--- a/rocketmq-client4cpp/src/consumer/ConsumerInvokeCallback.h
+++ /dev/null
@@ -1,40 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __CONSUMER_INVOKECALLBACK_H__
-#define __CONSUMER_INVOKECALLBACK_H__
-
-#include "InvokeCallback.h"
-
-namespace rmq
-{
- class PullCallback;
- class MQClientAPIImpl;
-
- class ConsumerInvokeCallback : public InvokeCallback
- {
- public:
- ConsumerInvokeCallback(PullCallback* pPullCallback, MQClientAPIImpl* pMQClientAPIImpl);
- virtual ~ConsumerInvokeCallback();
- virtual void operationComplete(ResponseFuturePtr pResponseFuture);
-
- private:
- PullCallback* m_pPullCallback;
- MQClientAPIImpl* m_pMQClientAPIImpl;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/ConsumerStatManage.h b/rocketmq-client4cpp/src/consumer/ConsumerStatManage.h
deleted file mode 100755
index 92cf74c4..00000000
--- a/rocketmq-client4cpp/src/consumer/ConsumerStatManage.h
+++ /dev/null
@@ -1,132 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __CONSUMERSTAT_H__
-#define __CONSUMERSTAT_H__
-
-#include <list>
-#include <string>
-
-#include "AtomicValue.h"
-#include "KPRUtil.h"
-#include "Mutex.h"
-#include "ScopedLock.h"
-
-namespace rmq
-{
- struct ConsumerStat
- {
- long long createTimestamp;
- kpr::AtomicLong consumeMsgRTMax;
- kpr::AtomicLong consumeMsgRTTotal;
- kpr::AtomicLong consumeMsgOKTotal;
- kpr::AtomicLong consumeMsgFailedTotal;
- kpr::AtomicLong pullRTTotal;
- kpr::AtomicLong pullTimesTotal;
-
- ConsumerStat()
- {
- createTimestamp = KPRUtil::GetCurrentTimeMillis();
- consumeMsgRTMax = 0;
- consumeMsgRTTotal = 0;
- consumeMsgOKTotal = 0;
- consumeMsgFailedTotal = 0;
- pullRTTotal = 0;
- pullTimesTotal = 0;
- }
- };
-
-
- class ConsumerStatManager
- {
- public:
- ConsumerStat& getConsumertat()
- {
- return m_consumertat;
- }
-
- std::list<ConsumerStat>& getSnapshotList()
- {
- return m_snapshotList;
- }
-
- /**
- * every 1s
- */
- void recordSnapshotPeriodically()
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_snapshotListLock);
- m_snapshotList.push_back(m_consumertat);
- if (m_snapshotList.size() > 60)
- {
- m_snapshotList.pop_front();
- }
- }
-
- /**
- * every 1m
- */
- void logStatsPeriodically(std::string& group, std::string& clientId)
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_snapshotListLock);
- if (m_snapshotList.size() >= 60)
- {
- ConsumerStat& first = m_snapshotList.front();
- ConsumerStat& last = m_snapshotList.back();
-
- {
- double avgRT = (last.consumeMsgRTTotal.get() - first.consumeMsgRTTotal.get())
- /
- (double)((last.consumeMsgOKTotal.get() + last.consumeMsgFailedTotal.get())
- - (first.consumeMsgOKTotal.get() + first.consumeMsgFailedTotal.get()));
-
- double tps = ((last.consumeMsgOKTotal.get() + last.consumeMsgFailedTotal.get())
- - (first.consumeMsgOKTotal.get() + first.consumeMsgFailedTotal.get()))
- / (double)(last.createTimestamp - first.createTimestamp);
-
- tps *= 1000;
-
- RMQ_INFO(
- "Consumer, {%s} {%s}, ConsumeAvgRT: {%f} ConsumeMaxRT: {%lld} TotalOKMsg: {%lld} TotalFailedMsg: {%lld} consumeTPS: {%f}",
- group.c_str(),
- clientId.c_str(),
- avgRT,
- last.consumeMsgRTMax.get(),
- last.consumeMsgOKTotal.get(),
- last.consumeMsgFailedTotal.get(),
- tps);
- }
-
- {
- double avgRT = (last.pullRTTotal.get() - first.pullRTTotal.get())
- / (double)(last.pullTimesTotal.get() - first.pullTimesTotal.get());
-
- RMQ_INFO("Consumer, {%s} {%s}, PullAvgRT: {%f} PullTimesTotal: {%lld}",
- group.c_str(),
- clientId.c_str(),
- avgRT,
- last.pullTimesTotal.get());
- }
- }
- }
-
- private:
- ConsumerStat m_consumertat;
- std::list<ConsumerStat> m_snapshotList;
- kpr::RWMutex m_snapshotListLock;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/DefaultMQPullConsumer.cpp b/rocketmq-client4cpp/src/consumer/DefaultMQPullConsumer.cpp
deleted file mode 100755
index 67a8c8cd..00000000
--- a/rocketmq-client4cpp/src/consumer/DefaultMQPullConsumer.cpp
+++ /dev/null
@@ -1,309 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "DefaultMQPullConsumer.h"
-
-#include <list>
-#include <string>
-
-#include "MessageQueue.h"
-#include "MessageExt.h"
-#include "ClientConfig.h"
-#include "DefaultMQPullConsumerImpl.h"
-#include "MixAll.h"
-#include "AllocateMessageQueueStrategyInner.h"
-
-namespace rmq
-{
-
-DefaultMQPullConsumer::DefaultMQPullConsumer()
- : m_consumerGroup(MixAll::DEFAULT_CONSUMER_GROUP),
- m_brokerSuspendMaxTimeMillis(1000 * 20),
- m_consumerTimeoutMillisWhenSuspend(1000 * 30),
- m_consumerPullTimeoutMillis(1000 * 10),
- m_messageModel(CLUSTERING),
- m_pMessageQueueListener(NULL),
- m_pOffsetStore(NULL),
- m_pAllocateMessageQueueStrategy(new AllocateMessageQueueAveragely()),
- m_unitMode(false),
- m_maxReconsumeTimes(16)
-{
- m_pDefaultMQPullConsumerImpl = new DefaultMQPullConsumerImpl(this);
-}
-
-DefaultMQPullConsumer::DefaultMQPullConsumer(const std::string& consumerGroup)
- : m_consumerGroup(consumerGroup),
- m_brokerSuspendMaxTimeMillis(1000 * 20),
- m_consumerTimeoutMillisWhenSuspend(1000 * 30),
- m_consumerPullTimeoutMillis(1000 * 10),
- m_messageModel(CLUSTERING),
- m_pMessageQueueListener(NULL),
- m_pOffsetStore(NULL),
- m_pAllocateMessageQueueStrategy(new AllocateMessageQueueAveragely()),
- m_unitMode(false),
- m_maxReconsumeTimes(16)
-{
- m_pDefaultMQPullConsumerImpl = new DefaultMQPullConsumerImpl(this);
-}
-
-DefaultMQPullConsumer::~DefaultMQPullConsumer()
-{
- //memleak or coredump
- if (m_pAllocateMessageQueueStrategy)
- delete m_pAllocateMessageQueueStrategy;
- if (m_pDefaultMQPullConsumerImpl)
- delete m_pDefaultMQPullConsumerImpl;
-}
-
-//MQAdmin
-void DefaultMQPullConsumer::createTopic(const std::string& key, const std::string& newTopic, int queueNum)
-{
- m_pDefaultMQPullConsumerImpl->createTopic(key, newTopic, queueNum);
-}
-
-long long DefaultMQPullConsumer::searchOffset(const MessageQueue& mq, long long timestamp)
-{
- return m_pDefaultMQPullConsumerImpl->searchOffset(mq, timestamp);
-}
-
-long long DefaultMQPullConsumer::maxOffset(const MessageQueue& mq)
-{
- return m_pDefaultMQPullConsumerImpl->maxOffset(mq);
-}
-
-long long DefaultMQPullConsumer::minOffset(const MessageQueue& mq)
-{
- return m_pDefaultMQPullConsumerImpl->minOffset(mq);
-}
-
-long long DefaultMQPullConsumer::earliestMsgStoreTime(const MessageQueue& mq)
-{
- return m_pDefaultMQPullConsumerImpl->earliestMsgStoreTime(mq);
-}
-
-MessageExt* DefaultMQPullConsumer::viewMessage(const std::string& msgId)
-{
- return m_pDefaultMQPullConsumerImpl->viewMessage(msgId);
-}
-
-QueryResult DefaultMQPullConsumer::queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end)
-{
- return m_pDefaultMQPullConsumerImpl->queryMessage(topic, key, maxNum, begin, end);
-}
-// MQadmin end
-
-AllocateMessageQueueStrategy* DefaultMQPullConsumer::getAllocateMessageQueueStrategy()
-{
- return m_pAllocateMessageQueueStrategy;
-}
-
-void DefaultMQPullConsumer::setAllocateMessageQueueStrategy(AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy)
-{
- m_pAllocateMessageQueueStrategy = pAllocateMessageQueueStrategy;
-}
-
-int DefaultMQPullConsumer::getBrokerSuspendMaxTimeMillis()
-{
- return m_brokerSuspendMaxTimeMillis;
-}
-
-void DefaultMQPullConsumer::setBrokerSuspendMaxTimeMillis(int brokerSuspendMaxTimeMillis)
-{
- m_brokerSuspendMaxTimeMillis = brokerSuspendMaxTimeMillis;
-}
-
-std::string DefaultMQPullConsumer::getConsumerGroup()
-{
- return m_consumerGroup;
-}
-
-void DefaultMQPullConsumer::setConsumerGroup(const std::string& consumerGroup)
-{
- m_consumerGroup = consumerGroup;
-}
-
-int DefaultMQPullConsumer::getConsumerPullTimeoutMillis()
-{
- return m_consumerPullTimeoutMillis;
-}
-
-void DefaultMQPullConsumer::setConsumerPullTimeoutMillis(int consumerPullTimeoutMillis)
-{
- m_consumerPullTimeoutMillis = consumerPullTimeoutMillis;
-}
-
-int DefaultMQPullConsumer::getConsumerTimeoutMillisWhenSuspend()
-{
- return m_consumerTimeoutMillisWhenSuspend;
-}
-
-void DefaultMQPullConsumer::setConsumerTimeoutMillisWhenSuspend(int consumerTimeoutMillisWhenSuspend)
-{
- m_consumerTimeoutMillisWhenSuspend = consumerTimeoutMillisWhenSuspend;
-}
-
-MessageModel DefaultMQPullConsumer::getMessageModel()
-{
- return m_messageModel;
-}
-
-void DefaultMQPullConsumer::setMessageModel(MessageModel messageModel)
-{
- m_messageModel = messageModel;
-}
-
-MessageQueueListener* DefaultMQPullConsumer::getMessageQueueListener()
-{
- return m_pMessageQueueListener;
-}
-
-void DefaultMQPullConsumer::setMessageQueueListener(MessageQueueListener* pMessageQueueListener)
-{
- m_pMessageQueueListener = pMessageQueueListener;
-}
-
-std::set<std::string> DefaultMQPullConsumer::getRegisterTopics()
-{
- return m_registerTopics;
-}
-
-void DefaultMQPullConsumer::setRegisterTopics(std::set<std::string> registerTopics)
-{
- m_registerTopics = registerTopics;
-}
-
-//MQConsumer
-void DefaultMQPullConsumer::sendMessageBack(MessageExt& msg, int delayLevel)
-{
- m_pDefaultMQPullConsumerImpl->sendMessageBack(msg, delayLevel, "");
-}
-
-void DefaultMQPullConsumer::sendMessageBack(MessageExt& msg, int delayLevel, const std::string& brokerName)
-{
- m_pDefaultMQPullConsumerImpl->sendMessageBack(msg, delayLevel, brokerName);
-}
-
-
-
-std::set<MessageQueue>* DefaultMQPullConsumer::fetchSubscribeMessageQueues(const std::string& topic)
-{
- return m_pDefaultMQPullConsumerImpl->fetchSubscribeMessageQueues(topic);
-}
-
-void DefaultMQPullConsumer::start()
-{
- m_pDefaultMQPullConsumerImpl->start();
-}
-
-void DefaultMQPullConsumer::shutdown()
-{
- m_pDefaultMQPullConsumerImpl->shutdown();
-}
-//MQConsumer end
-
-//MQPullConsumer
-void DefaultMQPullConsumer::registerMessageQueueListener(const std::string& topic, MessageQueueListener* pListener)
-{
- m_registerTopics.insert(topic);
-
- if (pListener)
- {
- m_pMessageQueueListener = pListener;
- }
-}
-
-PullResult* DefaultMQPullConsumer::pull(MessageQueue& mq, const std::string& subExpression, long long offset, int maxNums)
-{
- return m_pDefaultMQPullConsumerImpl->pull(mq, subExpression, offset, maxNums);
-}
-
-void DefaultMQPullConsumer::pull(MessageQueue& mq, const std::string& subExpression, long long offset, int maxNums, PullCallback* pPullCallback)
-{
- m_pDefaultMQPullConsumerImpl->pull(mq, subExpression, offset, maxNums, pPullCallback);
-}
-
-PullResult* DefaultMQPullConsumer::pullBlockIfNotFound(MessageQueue& mq, const std::string& subExpression, long long offset, int maxNums)
-{
- return m_pDefaultMQPullConsumerImpl->pullBlockIfNotFound(mq, subExpression, offset, maxNums);
-}
-
-void DefaultMQPullConsumer::pullBlockIfNotFound(MessageQueue& mq,
- const std::string& subExpression,
- long long offset,
- int maxNums,
- PullCallback* pPullCallback)
-{
- m_pDefaultMQPullConsumerImpl->pullBlockIfNotFound(mq, subExpression, offset, maxNums, pPullCallback);
-}
-
-void DefaultMQPullConsumer::updateConsumeOffset(MessageQueue& mq, long long offset)
-{
- m_pDefaultMQPullConsumerImpl->updateConsumeOffset(mq, offset);
-}
-
-long long DefaultMQPullConsumer::fetchConsumeOffset(MessageQueue& mq, bool fromStore)
-{
- return m_pDefaultMQPullConsumerImpl->fetchConsumeOffset(mq, fromStore);
-}
-
-std::set<MessageQueue>* DefaultMQPullConsumer::fetchMessageQueuesInBalance(const std::string& topic)
-{
- return m_pDefaultMQPullConsumerImpl->fetchMessageQueuesInBalance(topic);
-}
-//MQPullConsumer end
-
-OffsetStore* DefaultMQPullConsumer::getOffsetStore()
-{
- return m_pOffsetStore;
-}
-
-void DefaultMQPullConsumer::setOffsetStore(OffsetStore* offsetStore)
-{
- m_pOffsetStore = offsetStore;
-}
-
-DefaultMQPullConsumerImpl* DefaultMQPullConsumer::getDefaultMQPullConsumerImpl()
-{
- return m_pDefaultMQPullConsumerImpl;
-}
-
-bool DefaultMQPullConsumer::isUnitMode()
-{
- return m_unitMode;
-}
-
-void DefaultMQPullConsumer::setUnitMode(bool isUnitMode)
-{
- m_unitMode = isUnitMode;
-}
-
-int DefaultMQPullConsumer::getMaxReconsumeTimes()
-{
- return m_maxReconsumeTimes;
-}
-
-void DefaultMQPullConsumer::setMaxReconsumeTimes(int maxReconsumeTimes)
-{
- m_maxReconsumeTimes = maxReconsumeTimes;
-}
-
-
-}
-
diff --git a/rocketmq-client4cpp/src/consumer/DefaultMQPullConsumerImpl.cpp b/rocketmq-client4cpp/src/consumer/DefaultMQPullConsumerImpl.cpp
deleted file mode 100755
index d6465e90..00000000
--- a/rocketmq-client4cpp/src/consumer/DefaultMQPullConsumerImpl.cpp
+++ /dev/null
@@ -1,630 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "DefaultMQPullConsumerImpl.h"
-
-#include <iostream>
-#include <string>
-#include <set>
-#include "DefaultMQPullConsumer.h"
-#include "DefaultMQProducer.h"
-#include "MQClientFactory.h"
-#include "MQAdminImpl.h"
-#include "RebalancePullImpl.h"
-#include "MQClientAPIImpl.h"
-#include "OffsetStore.h"
-#include "MixAll.h"
-#include "MQClientManager.h"
-#include "LocalFileOffsetStore.h"
-#include "RemoteBrokerOffsetStore.h"
-#include "PullSysFlag.h"
-#include "FilterAPI.h"
-#include "PullAPIWrapper.h"
-#include "MQClientException.h"
-#include "Validators.h"
-#include "ScopedLock.h"
-
-namespace rmq
-{
-
-DefaultMQPullConsumerImpl::DefaultMQPullConsumerImpl(DefaultMQPullConsumer* pDefaultMQPullConsumer)
- : m_pDefaultMQPullConsumer(pDefaultMQPullConsumer),
- m_serviceState(CREATE_JUST)
-{
- m_pMQClientFactory = NULL;
- m_pPullAPIWrapper = NULL;
- m_pOffsetStore = NULL;
- m_pRebalanceImpl = new RebalancePullImpl(this);
-}
-
-DefaultMQPullConsumerImpl::~DefaultMQPullConsumerImpl()
-{
- if (m_pRebalanceImpl)
- delete m_pRebalanceImpl;
- if (m_pPullAPIWrapper)
- delete m_pPullAPIWrapper;
- if (m_pOffsetStore)
- delete m_pOffsetStore;
- //delete m_pMQClientFactory;
-}
-
-void DefaultMQPullConsumerImpl::start()
-{
- RMQ_INFO("DefaultMQPullConsumerImpl::start()");
- switch (m_serviceState)
- {
- case CREATE_JUST:
- {
- RMQ_INFO("the consumer [{%s}] start beginning. messageModel={%s}",
- m_pDefaultMQPullConsumer->getConsumerGroup().c_str(),
- getMessageModelString(m_pDefaultMQPullConsumer->getMessageModel()));
-
- m_serviceState = START_FAILED;
- checkConfig();
- copySubscription();
-
- if (m_pDefaultMQPullConsumer->getMessageModel() == CLUSTERING)
- {
- m_pDefaultMQPullConsumer->changeInstanceNameToPID();
- }
-
- m_pMQClientFactory = MQClientManager::getInstance()->getAndCreateMQClientFactory(*m_pDefaultMQPullConsumer);
-
- m_pRebalanceImpl->setConsumerGroup(m_pDefaultMQPullConsumer->getConsumerGroup());
- m_pRebalanceImpl->setMessageModel(m_pDefaultMQPullConsumer->getMessageModel());
- m_pRebalanceImpl->setAllocateMessageQueueStrategy(m_pDefaultMQPullConsumer->getAllocateMessageQueueStrategy());
- m_pRebalanceImpl->setmQClientFactory(m_pMQClientFactory);
-
- m_pPullAPIWrapper = new PullAPIWrapper(m_pMQClientFactory, m_pDefaultMQPullConsumer->getConsumerGroup());
-
- if (m_pDefaultMQPullConsumer->getOffsetStore() != NULL)
- {
- m_pOffsetStore = m_pDefaultMQPullConsumer->getOffsetStore();
- }
- else
- {
- switch (m_pDefaultMQPullConsumer->getMessageModel())
- {
- case BROADCASTING:
- m_pOffsetStore = new LocalFileOffsetStore(m_pMQClientFactory, m_pDefaultMQPullConsumer->getConsumerGroup());
- break;
- case CLUSTERING:
- m_pOffsetStore = new RemoteBrokerOffsetStore(m_pMQClientFactory, m_pDefaultMQPullConsumer->getConsumerGroup());
- break;
- default:
- break;
- }
- }
-
- m_pOffsetStore->load();
-
- bool registerOK =
- m_pMQClientFactory->registerConsumer(m_pDefaultMQPullConsumer->getConsumerGroup(), this);
- if (!registerOK)
- {
- m_serviceState = CREATE_JUST;
- std::string str = "The consumer group[" + m_pDefaultMQPullConsumer->getConsumerGroup();
- str += "] has been created before, specify another name please.";
- THROW_MQEXCEPTION(MQClientException, str, -1);
- }
-
- m_pMQClientFactory->start();
-
- m_serviceState = RUNNING;
- }
- break;
- case RUNNING:
- case START_FAILED:
- case SHUTDOWN_ALREADY:
- THROW_MQEXCEPTION(MQClientException, "The PullConsumer service state not OK, maybe started once, ", -1);
- default:
- break;
- }
-}
-
-
-void DefaultMQPullConsumerImpl::shutdown()
-{
- RMQ_DEBUG("DefaultMQPullConsumerImpl::shutdown()");
- switch (m_serviceState)
- {
- case CREATE_JUST:
- break;
- case RUNNING:
- persistConsumerOffset();
- m_pMQClientFactory->unregisterConsumer(m_pDefaultMQPullConsumer->getConsumerGroup());
- m_pMQClientFactory->shutdown();
-
- m_serviceState = SHUTDOWN_ALREADY;
- break;
- case SHUTDOWN_ALREADY:
- break;
- default:
- break;
- }
-}
-
-
-void DefaultMQPullConsumerImpl::createTopic(const std::string& key, const std::string& newTopic, int queueNum)
-{
- makeSureStateOK();
- m_pMQClientFactory->getMQAdminImpl()->createTopic(key, newTopic, queueNum);
-}
-
-long long DefaultMQPullConsumerImpl::fetchConsumeOffset(MessageQueue& mq, bool fromStore)
-{
- makeSureStateOK();
- return m_pOffsetStore->readOffset(mq, fromStore ? READ_FROM_STORE : MEMORY_FIRST_THEN_STORE);
-}
-
-std::set<MessageQueue>* DefaultMQPullConsumerImpl::fetchMessageQueuesInBalance(const std::string& topic)
-{
- makeSureStateOK();
- std::set<MessageQueue>* mqResult = new std::set<MessageQueue>;
-
- kpr::ScopedRLock<kpr::RWMutex> lock(m_pRebalanceImpl->getProcessQueueTableLock());
- std::map<MessageQueue, ProcessQueue*>& mqTable = m_pRebalanceImpl->getProcessQueueTable();
- RMQ_FOR_EACH(mqTable, it)
- {
- if (it->first.getTopic() == topic)
- {
- mqResult->insert(it->first);
- }
- }
-
- return mqResult;
-}
-
-std::vector<MessageQueue>* DefaultMQPullConsumerImpl::fetchPublishMessageQueues(const std::string& topic)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->fetchPublishMessageQueues(topic);
-}
-
-std::set<MessageQueue>* DefaultMQPullConsumerImpl::fetchSubscribeMessageQueues(const std::string& topic)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->fetchSubscribeMessageQueues(topic);
-}
-
-long long DefaultMQPullConsumerImpl::earliestMsgStoreTime(const MessageQueue& mq)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->earliestMsgStoreTime(mq);
-}
-
-std::string DefaultMQPullConsumerImpl::groupName()
-{
- return m_pDefaultMQPullConsumer->getConsumerGroup();
-}
-
-MessageModel DefaultMQPullConsumerImpl::messageModel()
-{
- return m_pDefaultMQPullConsumer->getMessageModel();
-}
-
-ConsumeType DefaultMQPullConsumerImpl::consumeType()
-{
- return CONSUME_ACTIVELY;
-}
-
-ConsumeFromWhere DefaultMQPullConsumerImpl::consumeFromWhere()
-{
- return CONSUME_FROM_LAST_OFFSET;
-}
-
-std::set<SubscriptionData> DefaultMQPullConsumerImpl::subscriptions()
-{
- //TODO
- std::set<SubscriptionData> result;
- return result;
-}
-
-void DefaultMQPullConsumerImpl::doRebalance()
-{
- if (m_pRebalanceImpl != NULL)
- {
- m_pRebalanceImpl->doRebalance();
- }
-}
-
-void DefaultMQPullConsumerImpl::persistConsumerOffset()
-{
- try
- {
- makeSureStateOK();
-
- std::set<MessageQueue> mqs;
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_pRebalanceImpl->getProcessQueueTableLock());
- std::map<MessageQueue, ProcessQueue*> processQueueTable = m_pRebalanceImpl->getProcessQueueTable();
- RMQ_FOR_EACH(processQueueTable, it)
- {
- mqs.insert(it->first);
- }
- }
-
- m_pOffsetStore->persistAll(mqs);
- }
- catch (...)
- {
- RMQ_ERROR("group {%s} persistConsumerOffset exception",
- m_pDefaultMQPullConsumer->getConsumerGroup().c_str());
- }
-}
-
-void DefaultMQPullConsumerImpl::updateTopicSubscribeInfo(const std::string& topic, const std::set<MessageQueue>& info)
-{
- std::map<std::string, SubscriptionData>& subTable = m_pRebalanceImpl->getSubscriptionInner();
-
- if (subTable.find(topic) != subTable.end())
- {
- m_pRebalanceImpl->getTopicSubscribeInfoTable().insert(std::pair<std::string, std::set<MessageQueue> >(topic, info));
- }
-}
-
-bool DefaultMQPullConsumerImpl::isSubscribeTopicNeedUpdate(const std::string& topic)
-{
- std::map<std::string, SubscriptionData>& subTable = m_pRebalanceImpl->getSubscriptionInner();
- if (subTable.find(topic) != subTable.end())
- {
- std::map<std::string, std::set<MessageQueue> >& mqs =
- m_pRebalanceImpl->getTopicSubscribeInfoTable();
- return mqs.find(topic) == mqs.end();
- }
-
- return false;
-}
-
-long long DefaultMQPullConsumerImpl::maxOffset(const MessageQueue& mq)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->maxOffset(mq);
-}
-
-long long DefaultMQPullConsumerImpl::minOffset(const MessageQueue& mq)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->minOffset(mq);
-}
-
-PullResult* DefaultMQPullConsumerImpl::pull(MessageQueue& mq,
- const std::string& subExpression,
- long long offset,
- int maxNums)
-{
- return pullSyncImpl(mq, subExpression, offset, maxNums, false);
-}
-
-void DefaultMQPullConsumerImpl::pull(MessageQueue& mq,
- const std::string& subExpression,
- long long offset,
- int maxNums,
- PullCallback* pPullCallback)
-{
- pullAsyncImpl(mq, subExpression, offset, maxNums, pPullCallback, false);
-}
-
-PullResult* DefaultMQPullConsumerImpl::pullBlockIfNotFound(MessageQueue& mq,
- const std::string& subExpression,
- long long offset,
- int maxNums)
-{
- return pullSyncImpl(mq, subExpression, offset, maxNums, true);
-}
-
-void DefaultMQPullConsumerImpl::pullBlockIfNotFound(MessageQueue& mq,
- const std::string& subExpression,
- long long offset,
- int maxNums,
- PullCallback* pPullCallback)
-{
- pullAsyncImpl(mq, subExpression, offset, maxNums, pPullCallback, true);
-}
-
-QueryResult DefaultMQPullConsumerImpl::queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end)
-{
- makeSureStateOK();
-
- QueryResult result(0, std::list<MessageExt*>());
- return m_pMQClientFactory->getMQAdminImpl()->queryMessage(topic, key, maxNum, begin, end);
-}
-
-long long DefaultMQPullConsumerImpl::searchOffset(const MessageQueue& mq, long long timestamp)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->searchOffset(mq, timestamp);
-}
-
-void DefaultMQPullConsumerImpl::sendMessageBack(MessageExt& msg, int delayLevel, const std::string& brokerName)
-{
- return sendMessageBack(msg, delayLevel, brokerName, m_pDefaultMQPullConsumer->getConsumerGroup());
-}
-
-
-void DefaultMQPullConsumerImpl::sendMessageBack(MessageExt& msg, int delayLevel, const std::string& brokerName,
- const std::string& consumerGroup)
-{
- try
- {
- std::string brokerAddr = brokerName.empty() ?
- socketAddress2IPPort(msg.getStoreHost()) : m_pMQClientFactory->findBrokerAddressInPublish(brokerName);
-
- m_pMQClientFactory->getMQClientAPIImpl()->consumerSendMessageBack(brokerAddr, msg,
- consumerGroup.empty() ? m_pDefaultMQPullConsumer->getConsumerGroup() : consumerGroup,
- delayLevel,
- 3000);
- }
- catch (...)
- {
- RMQ_ERROR("sendMessageBack Exception, group: %s", m_pDefaultMQPullConsumer->getConsumerGroup().c_str());
- Message newMsg(MixAll::getRetryTopic(m_pDefaultMQPullConsumer->getConsumerGroup()),
- msg.getBody(), msg.getBodyLen());
-
- std::string originMsgId = msg.getProperty(Message::PROPERTY_ORIGIN_MESSAGE_ID);
- newMsg.putProperty(Message::PROPERTY_ORIGIN_MESSAGE_ID, UtilAll::isBlank(originMsgId) ? msg.getMsgId()
- : originMsgId);
-
- newMsg.setFlag(msg.getFlag());
- newMsg.setProperties(msg.getProperties());
- newMsg.putProperty(Message::PROPERTY_RETRY_TOPIC, msg.getTopic());
-
- int reTimes = msg.getReconsumeTimes() + 1;
- newMsg.putProperty(Message::PROPERTY_RECONSUME_TIME, UtilAll::toString(reTimes));
- newMsg.putProperty(Message::PROPERTY_MAX_RECONSUME_TIMES, UtilAll::toString(m_pDefaultMQPullConsumer->getMaxReconsumeTimes()));
- newMsg.setDelayTimeLevel(3 + reTimes);
-
- m_pMQClientFactory->getDefaultMQProducer()->send(newMsg);
- }
-}
-
-void DefaultMQPullConsumerImpl::updateConsumeOffset(MessageQueue& mq, long long offset)
-{
- makeSureStateOK();
- m_pOffsetStore->updateOffset(mq, offset, false);
-}
-
-MessageExt* DefaultMQPullConsumerImpl::viewMessage(const std::string& msgId)
-{
- makeSureStateOK();
-
- return m_pMQClientFactory->getMQAdminImpl()->viewMessage(msgId);
-}
-
-DefaultMQPullConsumer* DefaultMQPullConsumerImpl::getDefaultMQPullConsumer()
-{
- return m_pDefaultMQPullConsumer;
-}
-
-OffsetStore* DefaultMQPullConsumerImpl::getOffsetStore()
-{
- return m_pOffsetStore;
-}
-
-void DefaultMQPullConsumerImpl::setOffsetStore(OffsetStore* pOffsetStore)
-{
- m_pOffsetStore = pOffsetStore;
-}
-
-void DefaultMQPullConsumerImpl::makeSureStateOK()
-{
- if (m_serviceState != RUNNING)
- {
- THROW_MQEXCEPTION(MQClientException, "The consumer service state not OK, ", -1);
- }
-}
-
-PullResult* DefaultMQPullConsumerImpl::pullSyncImpl(MessageQueue& mq,
- const std::string& subExpression,
- long long offset,
- int maxNums,
- bool block)
-{
- makeSureStateOK();
-
- if (offset < 0)
- {
- THROW_MQEXCEPTION(MQClientException, "offset < 0", -1);
- }
-
- if (maxNums <= 0)
- {
- THROW_MQEXCEPTION(MQClientException, "maxNums <= 0", -1);
- }
-
- subscriptionAutomatically(mq.getTopic());
-
- int sysFlag = PullSysFlag::buildSysFlag(false, block, true);
-
- SubscriptionDataPtr subscriptionData = NULL;
- try
- {
- subscriptionData = FilterAPI::buildSubscriptionData(mq.getTopic(), subExpression);
- }
- catch (...)
- {
- THROW_MQEXCEPTION(MQClientException, "parse subscription error", -1);
- }
-
- int timeoutMillis =
- block ? m_pDefaultMQPullConsumer->getConsumerTimeoutMillisWhenSuspend()
- : m_pDefaultMQPullConsumer->getConsumerPullTimeoutMillis();
-
- PullResult* pullResult = m_pPullAPIWrapper->pullKernelImpl(//
- mq, // 1
- subscriptionData->getSubString(), // 2
- 0L, // 3
- offset, // 4
- maxNums, // 5
- sysFlag, // 6
- 0, // 7
- m_pDefaultMQPullConsumer->getBrokerSuspendMaxTimeMillis(), // 8
- timeoutMillis, // 9
- SYNC, // 10
- NULL// 11
- );
-
- return m_pPullAPIWrapper->processPullResult(mq, *pullResult, *subscriptionData);
-}
-
-void DefaultMQPullConsumerImpl::subscriptionAutomatically(const std::string& topic)
-{
- std::map<std::string, SubscriptionData>& sd = m_pRebalanceImpl->getSubscriptionInner();
- std::map<std::string, SubscriptionData>::iterator it = sd.find(topic);
-
- if (it == sd.end())
- {
- try
- {
- SubscriptionDataPtr subscriptionData =
- FilterAPI::buildSubscriptionData(topic, SubscriptionData::SUB_ALL);
- sd[topic] = *subscriptionData;
- }
- catch (...)
- {
- RMQ_WARN("FilterAPI::buildSubscriptionData exception");
- }
- }
-}
-
-void DefaultMQPullConsumerImpl::pullAsyncImpl(//
- MessageQueue& mq, const std::string& subExpression, long long offset, int maxNums,
- PullCallback* pPullCallback,//
- bool block)
-{
- makeSureStateOK();
-
- if (offset < 0)
- {
- THROW_MQEXCEPTION(MQClientException, "offset < 0", -1);
- }
-
- if (maxNums <= 0)
- {
- THROW_MQEXCEPTION(MQClientException, "maxNums <= 0", -1);
- }
-
- if (pPullCallback == NULL)
- {
- THROW_MQEXCEPTION(MQClientException, "pullCallback is null", -1);
- }
-
- subscriptionAutomatically(mq.getTopic());
- try
- {
- int sysFlag = PullSysFlag::buildSysFlag(false, block, true);
-
- SubscriptionDataPtr subscriptionData = NULL;
- try
- {
- subscriptionData = FilterAPI::buildSubscriptionData(mq.getTopic(), subExpression);
- }
- catch (...)
- {
- THROW_MQEXCEPTION(MQClientException, "parse subscription error", -1);
- }
-
- int timeoutMillis =
- block ? m_pDefaultMQPullConsumer->getConsumerTimeoutMillisWhenSuspend()
- : m_pDefaultMQPullConsumer->getConsumerPullTimeoutMillis();
- DefaultMQPullConsumerImplCallback* callback =
- new DefaultMQPullConsumerImplCallback(*subscriptionData,
- mq, this, pPullCallback);
-
- m_pPullAPIWrapper->pullKernelImpl(
- mq, // 1
- subscriptionData->getSubString(), // 2
- 0L, // 3
- offset, // 4
- maxNums, // 5
- sysFlag, // 6
- 0, // 7
- m_pDefaultMQPullConsumer->getBrokerSuspendMaxTimeMillis(), // 8
- timeoutMillis, // 9
- ASYNC, // 10
- callback// 11
- );
- }
- catch (const MQBrokerException& e)
- {
- THROW_MQEXCEPTION(MQClientException, "pullAsync unknow exception", -1);
- }
-}
-
-
-void DefaultMQPullConsumerImpl::copySubscription()
-{
- try
- {
- std::set<std::string> registerTopics = m_pDefaultMQPullConsumer->getRegisterTopics();
- std::set<std::string>::iterator it = registerTopics.begin();
-
- for (; it != registerTopics.end(); it++)
- {
- SubscriptionDataPtr subscriptionData =
- FilterAPI::buildSubscriptionData(*it, SubscriptionData::SUB_ALL);
- m_pRebalanceImpl->getSubscriptionInner()[*it] = *subscriptionData;
- }
- }
- catch (...)
- {
- THROW_MQEXCEPTION(MQClientException, "subscription exception", -1);
- }
-}
-
-
-void DefaultMQPullConsumerImpl::checkConfig()
-{
- // check consumerGroup
- Validators::checkGroup(m_pDefaultMQPullConsumer->getConsumerGroup());
-
- // consumerGroup
- if (m_pDefaultMQPullConsumer->getConsumerGroup() == MixAll::DEFAULT_CONSUMER_GROUP)
- {
- THROW_MQEXCEPTION(MQClientException, "consumerGroup can not equal "
- + MixAll::DEFAULT_CONSUMER_GROUP //
- + ", please specify another one.", -1);
- }
-
- if (m_pDefaultMQPullConsumer->getMessageModel() != BROADCASTING
- && m_pDefaultMQPullConsumer->getMessageModel() != CLUSTERING)
- {
- THROW_MQEXCEPTION(MQClientException, "messageModel is valid ", -1);
- }
-
- // allocateMessageQueueStrategy
- if (m_pDefaultMQPullConsumer->getAllocateMessageQueueStrategy() == NULL)
- {
- THROW_MQEXCEPTION(MQClientException, "allocateMessageQueueStrategy is null", -1);
- }
-}
-
-ServiceState DefaultMQPullConsumerImpl::getServiceState()
-{
- return m_serviceState;
-}
-
-void DefaultMQPullConsumerImpl::setServiceState(ServiceState serviceState)
-{
- m_serviceState = serviceState;
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/DefaultMQPullConsumerImpl.h b/rocketmq-client4cpp/src/consumer/DefaultMQPullConsumerImpl.h
deleted file mode 100755
index 171565cd..00000000
--- a/rocketmq-client4cpp/src/consumer/DefaultMQPullConsumerImpl.h
+++ /dev/null
@@ -1,174 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __DEFAULTMQPULLCONSUMERIMPL_H__
-#define __DEFAULTMQPULLCONSUMERIMPL_H__
-
-#include <string>
-#include <set>
-#include <map>
-#include <vector>
-#include "MQConsumerInner.h"
-#include "MessageExt.h"
-#include "QueryResult.h"
-#include "ServiceState.h"
-#include "PullRequest.h"
-#include "MessageQueue.h"
-#include "PullResult.h"
-#include "PullCallback.h"
-#include "PullAPIWrapper.h"
-
-namespace rmq
-{
-class DefaultMQPullConsumer;
-class PullCallback;
-class OffsetStore;
-class RebalanceImpl;
-class MQClientFactory;
-class PullAPIWrapper;
-
-/**
-* PullConsumer imp
-*/
-class DefaultMQPullConsumerImpl : public MQConsumerInner
-{
-public:
- DefaultMQPullConsumerImpl(DefaultMQPullConsumer *pDefaultMQPullConsumer);
- ~DefaultMQPullConsumerImpl();
- void createTopic(const std::string &key, const std::string &newTopic,
- int queueNum);
- long long fetchConsumeOffset(MessageQueue &mq, bool fromStore);
- std::set<MessageQueue> *fetchMessageQueuesInBalance(const std::string &topic);
- std::vector<MessageQueue> *fetchPublishMessageQueues(const std::string &topic);
- std::set<MessageQueue> *fetchSubscribeMessageQueues(const std::string &topic);
- long long earliestMsgStoreTime(const MessageQueue &mq);
- std::string groupName();
- MessageModel messageModel();
- ConsumeType consumeType();
- ConsumeFromWhere consumeFromWhere();
- std::set<SubscriptionData> subscriptions();
- void doRebalance();
- void persistConsumerOffset();
- void updateTopicSubscribeInfo(const std::string &topic,
- const std::set<MessageQueue> &info);
- bool isSubscribeTopicNeedUpdate(const std::string &topic);
- long long maxOffset(const MessageQueue &mq);
- long long minOffset(const MessageQueue &mq);
-
- PullResult *pull(MessageQueue &mq,
- const std::string &subExpression,
- long long offset,
- int maxNums);
-
- void pull(MessageQueue &mq,
- const std::string &subExpression,
- long long offset,
- int maxNums,
- PullCallback *pPullCallback);
-
- PullResult *pullBlockIfNotFound(MessageQueue &mq,
- const std::string &subExpression,
- long long offset, int maxNums);
-
- void pullBlockIfNotFound(MessageQueue &mq,
- const std::string &subExpression,
- long long offset, int maxNums,
- PullCallback *pPullCallback);
-
- QueryResult queryMessage(const std::string &topic,
- const std::string &key,
- int maxNum,
- long long begin,
- long long end);
-
- long long searchOffset(const MessageQueue &mq, long long timestamp);
- void sendMessageBack(MessageExt &msg, int delayLevel,
- const std::string &brokerName);
- void sendMessageBack(MessageExt &msg, int delayLevel,
- const std::string &brokerName, const std::string &consumerGroup);
- void shutdown();
- void updateConsumeOffset(MessageQueue &mq, long long offset);
- MessageExt *viewMessage(const std::string &msgId);
- DefaultMQPullConsumer *getDefaultMQPullConsumer();
- OffsetStore *getOffsetStore();
- void setOffsetStore(OffsetStore *pOffsetStore);
- void start();
-
- ServiceState getServiceState();
- void setServiceState(ServiceState serviceState);
-
-private:
- void makeSureStateOK();
- void subscriptionAutomatically(const std::string &topic);
- void copySubscription();
- void checkConfig();
-
- PullResult *pullSyncImpl(MessageQueue &mq,
- const std::string &subExpression,
- long long offset,
- int maxNums,
- bool block) ;
- void pullAsyncImpl(MessageQueue &mq,
- const std::string &subExpression,
- long long offset,
- int maxNums,
- PullCallback *pPullCallback,
- bool block);
-
-private:
- DefaultMQPullConsumer *m_pDefaultMQPullConsumer;
- ServiceState m_serviceState;
- MQClientFactory *m_pMQClientFactory;
- PullAPIWrapper *m_pPullAPIWrapper;
- OffsetStore *m_pOffsetStore;
- RebalanceImpl *m_pRebalanceImpl;
- friend class DefaultMQPullConsumerImplCallback;
-};
-
-class DefaultMQPullConsumerImplCallback : public PullCallback
-{
-public:
- DefaultMQPullConsumerImplCallback(SubscriptionData &subscriptionData,
- MessageQueue &mq,
- DefaultMQPullConsumerImpl *pDefaultMQPullConsumerImpl,
- PullCallback *pCallback)
- : m_subscriptionData(subscriptionData),
- m_mq(mq),
- m_pDefaultMQPullConsumerImpl(pDefaultMQPullConsumerImpl),
- m_pCallback(pCallback)
- {
- }
-
- void onSuccess(PullResult &pullResult)
- {
- m_pCallback->onSuccess(
- *m_pDefaultMQPullConsumerImpl->m_pPullAPIWrapper->
- processPullResult(m_mq, pullResult, m_subscriptionData));
- }
-
- void onException(MQException &e)
- {
- m_pCallback->onException(e);
- }
-
-private:
- SubscriptionData m_subscriptionData;
- MessageQueue m_mq;
- DefaultMQPullConsumerImpl *m_pDefaultMQPullConsumerImpl;
- PullCallback *m_pCallback;
-};
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/DefaultMQPushConsumer.cpp b/rocketmq-client4cpp/src/consumer/DefaultMQPushConsumer.cpp
deleted file mode 100755
index 45ee9073..00000000
--- a/rocketmq-client4cpp/src/consumer/DefaultMQPushConsumer.cpp
+++ /dev/null
@@ -1,399 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "DefaultMQPushConsumer.h"
-#include <list>
-#include <string>
-
-#include "DefaultMQPushConsumerImpl.h"
-#include "MessageQueue.h"
-#include "MessageExt.h"
-#include "ClientConfig.h"
-#include "ConsumerStatManage.h"
-#include "MixAll.h"
-#include "AllocateMessageQueueStrategyInner.h"
-
-namespace rmq
-{
-
-class AllocateMessageQueueStrategy;
-
-DefaultMQPushConsumer::DefaultMQPushConsumer()
-{
- m_consumerGroup = MixAll::DEFAULT_CONSUMER_GROUP;
- m_messageModel = CLUSTERING;
- m_consumeFromWhere = CONSUME_FROM_LAST_OFFSET;
- m_pAllocateMessageQueueStrategy = new AllocateMessageQueueAveragely();
- m_pMessageListener = NULL;
- m_consumeThreadMin = 5;
- m_consumeThreadMax = 25;
- m_consumeConcurrentlyMaxSpan = 2000;
- m_pullThresholdForQueue = 1000;
- m_pullInterval = 0;
- m_consumeMessageBatchMaxSize = 1;
- m_pullBatchSize = 32;
- m_postSubscriptionWhenPull = false;
- m_unitMode = false;
- m_maxReconsumeTimes = 16;
- m_suspendCurrentQueueTimeMillis = 1000;
- m_consumeTimeout = 15;
- m_pOffsetStore = NULL;
- m_pDefaultMQPushConsumerImpl = new DefaultMQPushConsumerImpl(this);
-}
-
-DefaultMQPushConsumer::DefaultMQPushConsumer(const std::string& consumerGroup)
-{
- m_consumerGroup = consumerGroup;
- m_messageModel = CLUSTERING;
- m_consumeFromWhere = CONSUME_FROM_LAST_OFFSET;
- m_pAllocateMessageQueueStrategy = new AllocateMessageQueueAveragely();
- m_pMessageListener = NULL;
- m_consumeThreadMin = 5;
- m_consumeThreadMax = 25;
- m_consumeConcurrentlyMaxSpan = 2000;
- m_pullThresholdForQueue = 1000;
- m_pullInterval = 0;
- m_consumeMessageBatchMaxSize = 1;
- m_pullBatchSize = 32;
- m_postSubscriptionWhenPull = false;
- m_unitMode = false;
- m_maxReconsumeTimes = 16;
- m_suspendCurrentQueueTimeMillis = 1000;
- m_consumeTimeout = 15;
- m_pOffsetStore = NULL;
- m_pDefaultMQPushConsumerImpl = new DefaultMQPushConsumerImpl(this);
-}
-
-DefaultMQPushConsumer::~DefaultMQPushConsumer()
-{
- delete m_pAllocateMessageQueueStrategy;
- delete m_pDefaultMQPushConsumerImpl;
-}
-
-//MQAdmin
-void DefaultMQPushConsumer::createTopic(const std::string& key, const std::string& newTopic, int queueNum)
-{
- m_pDefaultMQPushConsumerImpl->createTopic(key, newTopic, queueNum);
-}
-
-long long DefaultMQPushConsumer::searchOffset(const MessageQueue& mq, long long timestamp)
-{
- return m_pDefaultMQPushConsumerImpl->searchOffset(mq, timestamp);
-}
-
-long long DefaultMQPushConsumer::maxOffset(const MessageQueue& mq)
-{
- return m_pDefaultMQPushConsumerImpl->maxOffset(mq);
-}
-
-long long DefaultMQPushConsumer::minOffset(const MessageQueue& mq)
-{
- return m_pDefaultMQPushConsumerImpl->minOffset(mq);
-}
-
-long long DefaultMQPushConsumer::earliestMsgStoreTime(const MessageQueue& mq)
-{
- return m_pDefaultMQPushConsumerImpl->earliestMsgStoreTime(mq);
-}
-
-MessageExt* DefaultMQPushConsumer::viewMessage(const std::string& msgId)
-{
- return m_pDefaultMQPushConsumerImpl->viewMessage(msgId);
-}
-
-QueryResult DefaultMQPushConsumer::queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end)
-{
- return m_pDefaultMQPushConsumerImpl->queryMessage(topic, key, maxNum, begin, end);
-}
-// MQadmin end
-
-AllocateMessageQueueStrategy* DefaultMQPushConsumer::getAllocateMessageQueueStrategy()
-{
- return m_pAllocateMessageQueueStrategy;
-}
-
-void DefaultMQPushConsumer::setAllocateMessageQueueStrategy(AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy)
-{
- m_pAllocateMessageQueueStrategy = pAllocateMessageQueueStrategy;
-}
-
-int DefaultMQPushConsumer::getConsumeConcurrentlyMaxSpan()
-{
- return m_consumeConcurrentlyMaxSpan;
-}
-
-void DefaultMQPushConsumer::setConsumeConcurrentlyMaxSpan(int consumeConcurrentlyMaxSpan)
-{
- m_consumeConcurrentlyMaxSpan = consumeConcurrentlyMaxSpan;
-}
-
-ConsumeFromWhere DefaultMQPushConsumer::getConsumeFromWhere()
-{
- return m_consumeFromWhere;
-}
-
-void DefaultMQPushConsumer::setConsumeFromWhere(ConsumeFromWhere consumeFromWhere)
-{
- m_consumeFromWhere = consumeFromWhere;
-}
-
-int DefaultMQPushConsumer::getConsumeMessageBatchMaxSize()
-{
- return m_consumeMessageBatchMaxSize;
-}
-
-void DefaultMQPushConsumer::setConsumeMessageBatchMaxSize(int consumeMessageBatchMaxSize)
-{
- m_consumeMessageBatchMaxSize = consumeMessageBatchMaxSize;
-}
-
-std::string DefaultMQPushConsumer::getConsumerGroup()
-{
- return m_consumerGroup;
-}
-
-void DefaultMQPushConsumer::setConsumerGroup(const std::string& consumerGroup)
-{
- m_consumerGroup = consumerGroup;
-}
-
-int DefaultMQPushConsumer::getConsumeThreadMax()
-{
- return m_consumeThreadMax;
-}
-
-void DefaultMQPushConsumer::setConsumeThreadMax(int consumeThreadMax)
-{
- m_consumeThreadMax = consumeThreadMax;
-}
-
-int DefaultMQPushConsumer::getConsumeThreadMin()
-{
- return m_consumeThreadMin;
-}
-
-void DefaultMQPushConsumer::setConsumeThreadMin(int consumeThreadMin)
-{
- m_consumeThreadMin = consumeThreadMin;
-}
-
-DefaultMQPushConsumerImpl* DefaultMQPushConsumer::getDefaultMQPushConsumerImpl()
-{
- return m_pDefaultMQPushConsumerImpl;
-}
-
-MessageListener* DefaultMQPushConsumer::getMessageListener()
-{
- return m_pMessageListener;
-}
-
-void DefaultMQPushConsumer::setMessageListener(MessageListener* pMessageListener)
-{
- m_pMessageListener = pMessageListener;
-}
-
-MessageModel DefaultMQPushConsumer::getMessageModel()
-{
- return m_messageModel;
-}
-
-void DefaultMQPushConsumer::setMessageModel(MessageModel messageModel)
-{
- m_messageModel = messageModel;
-}
-
-int DefaultMQPushConsumer::getPullBatchSize()
-{
- return m_pullBatchSize;
-}
-
-void DefaultMQPushConsumer::setPullBatchSize(int pullBatchSize)
-{
- m_pullBatchSize = pullBatchSize;
-}
-
-long DefaultMQPushConsumer::getPullInterval()
-{
- return m_pullInterval;
-}
-
-void DefaultMQPushConsumer::setPullInterval(long pullInterval)
-{
- m_pullInterval = pullInterval;
-}
-
-int DefaultMQPushConsumer::getPullThresholdForQueue()
-{
- return m_pullThresholdForQueue;
-}
-
-void DefaultMQPushConsumer::setPullThresholdForQueue(int pullThresholdForQueue)
-{
- m_pullThresholdForQueue = pullThresholdForQueue;
-}
-
-std::map<std::string, std::string>& DefaultMQPushConsumer::getSubscription()
-{
- return m_subscription;
-}
-
-void DefaultMQPushConsumer::setSubscription(const std::map<std::string, std::string>& subscription)
-{
- m_subscription = subscription;
-}
-
-//MQConsumer
-void DefaultMQPushConsumer::sendMessageBack(MessageExt& msg, int delayLevel)
-{
- m_pDefaultMQPushConsumerImpl->sendMessageBack(msg, delayLevel, "");
-}
-
-void DefaultMQPushConsumer::sendMessageBack(MessageExt& msg, int delayLevel, const std::string brokerName)
-{
- m_pDefaultMQPushConsumerImpl->sendMessageBack(msg, delayLevel, brokerName);
-}
-
-
-std::set<MessageQueue>* DefaultMQPushConsumer::fetchSubscribeMessageQueues(const std::string& topic)
-{
- return m_pDefaultMQPushConsumerImpl->fetchSubscribeMessageQueues(topic);
-}
-
-void DefaultMQPushConsumer::start()
-{
- m_pDefaultMQPushConsumerImpl->start();
-}
-
-void DefaultMQPushConsumer::shutdown()
-{
- m_pDefaultMQPushConsumerImpl->shutdown();
-}
-//MQConsumer end
-
-//MQPushConsumer
-void DefaultMQPushConsumer::registerMessageListener(MessageListener* pMessageListener)
-{
- m_pMessageListener = pMessageListener;
- m_pDefaultMQPushConsumerImpl->registerMessageListener(pMessageListener);
-}
-
-void DefaultMQPushConsumer::subscribe(const std::string& topic, const std::string& subExpression)
-{
- m_pDefaultMQPushConsumerImpl->subscribe(topic, subExpression);
-}
-
-void DefaultMQPushConsumer::unsubscribe(const std::string& topic)
-{
- m_pDefaultMQPushConsumerImpl->unsubscribe(topic);
-}
-
-void DefaultMQPushConsumer::updateCorePoolSize(int corePoolSize)
-{
- m_pDefaultMQPushConsumerImpl->updateCorePoolSize(corePoolSize);
-}
-
-void DefaultMQPushConsumer::suspend()
-{
- m_pDefaultMQPushConsumerImpl->suspend();
-}
-
-void DefaultMQPushConsumer::resume()
-{
- m_pDefaultMQPushConsumerImpl->resume();
-}
-//MQPushConsumer end
-
-OffsetStore* DefaultMQPushConsumer::getOffsetStore()
-{
- return m_pOffsetStore;
-}
-
-void DefaultMQPushConsumer::setOffsetStore(OffsetStore* pOffsetStore)
-{
- m_pOffsetStore = pOffsetStore;
-}
-
-std::string DefaultMQPushConsumer::getConsumeTimestamp() {
- return m_consumeTimestamp;
-}
-
-void DefaultMQPushConsumer::setConsumeTimestamp(std::string consumeTimestamp) {
- m_consumeTimestamp = consumeTimestamp;
-}
-
-bool DefaultMQPushConsumer::isPostSubscriptionWhenPull()
-{
- return m_postSubscriptionWhenPull;
-}
-
-
-void DefaultMQPushConsumer::setPostSubscriptionWhenPull(bool postSubscriptionWhenPull)
-{
- m_postSubscriptionWhenPull = postSubscriptionWhenPull;
-}
-
-
-bool DefaultMQPushConsumer::isUnitMode()
-{
- return m_unitMode;
-}
-
-
-void DefaultMQPushConsumer::setUnitMode(bool isUnitMode)
-{
- m_unitMode = isUnitMode;
-}
-
-int DefaultMQPushConsumer::getMaxReconsumeTimes()
-{
- return m_maxReconsumeTimes;
-}
-
-
-void DefaultMQPushConsumer::setMaxReconsumeTimes(int maxReconsumeTimes)
-{
- m_maxReconsumeTimes = maxReconsumeTimes;
-}
-
-
-int DefaultMQPushConsumer::getSuspendCurrentQueueTimeMillis()
-{
- return m_suspendCurrentQueueTimeMillis;
-}
-
-
-void DefaultMQPushConsumer::setSuspendCurrentQueueTimeMillis(int suspendCurrentQueueTimeMillis)
-{
- m_suspendCurrentQueueTimeMillis = suspendCurrentQueueTimeMillis;
-}
-
-
-int DefaultMQPushConsumer::getConsumeTimeout()
-{
- return m_consumeTimeout;
-}
-
-void DefaultMQPushConsumer::setConsumeTimeout(int consumeTimeout)
-{
- m_consumeTimeout = consumeTimeout;
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/DefaultMQPushConsumerImpl.cpp b/rocketmq-client4cpp/src/consumer/DefaultMQPushConsumerImpl.cpp
deleted file mode 100755
index 8d7f8a12..00000000
--- a/rocketmq-client4cpp/src/consumer/DefaultMQPushConsumerImpl.cpp
+++ /dev/null
@@ -1,1018 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "DefaultMQPushConsumerImpl.h"
-
-#include <string>
-#include <set>
-#include "DefaultMQPushConsumer.h"
-#include "ConsumerStatManage.h"
-#include "DefaultMQPullConsumer.h"
-#include "DefaultMQProducer.h"
-#include "MQClientFactory.h"
-#include "MQAdminImpl.h"
-#include "RebalancePushImpl.h"
-#include "MQClientAPIImpl.h"
-#include "OffsetStore.h"
-#include "MixAll.h"
-#include "MQClientManager.h"
-#include "LocalFileOffsetStore.h"
-#include "RemoteBrokerOffsetStore.h"
-#include "PullSysFlag.h"
-#include "FilterAPI.h"
-#include "PullAPIWrapper.h"
-#include "MQClientException.h"
-#include "Validators.h"
-#include "MessageListener.h"
-#include "ConsumeMessageHook.h"
-#include "PullMessageService.h"
-#include "ConsumeMessageOrderlyService.h"
-#include "ConsumeMessageConcurrentlyService.h"
-#include "KPRUtil.h"
-#include "TimerThread.h"
-
-namespace rmq
-{
-
-/* RemoveProcessQueueLater */
-class RemoveProcessQueueLater : public kpr::TimerHandler
-{
-public:
- RemoveProcessQueueLater(DefaultMQPushConsumerImpl* pConsumerImp, PullRequest* pPullRequest)
- : m_pConsumerImp(pConsumerImp), m_pPullRequest(pPullRequest)
- {
- }
-
- void OnTimeOut(unsigned int timerID)
- {
- try
- {
- m_pConsumerImp->getOffsetStore()->updateOffset(m_pPullRequest->getMessageQueue(), m_pPullRequest->getNextOffset(), false);
- m_pConsumerImp->getOffsetStore()->persist(m_pPullRequest->getMessageQueue());
- m_pConsumerImp->getRebalanceImpl()->removeProcessQueue(m_pPullRequest->getMessageQueue());
-
- RMQ_WARN("fix the pull request offset, {%s}", m_pPullRequest->toString().c_str());
- }
- catch(...)
- {
- RMQ_ERROR("RemoveProcessQueueLater OnTimeOut Exception");
- }
-
- delete this;
- }
-
-private:
- DefaultMQPushConsumerImpl* m_pConsumerImp;
- PullRequest* m_pPullRequest;
-};
-
-
-/* DefaultMQPushConsumerImplCallback */
-class DefaultMQPushConsumerImplCallback : public PullCallback
-{
-public:
- DefaultMQPushConsumerImplCallback(SubscriptionData& subscriptionData,
- DefaultMQPushConsumerImpl* pDefaultMQPushConsumerImpl,
- PullRequest* pPullRequest)
- : m_subscriptionData(subscriptionData),
- m_pDefaultMQPushConsumerImpl(pDefaultMQPushConsumerImpl),
- m_pPullRequest(pPullRequest)
- {
- m_beginTimestamp = KPRUtil::GetCurrentTimeMillis();
- }
-
- void onSuccess(PullResult& pullResult)
- {
- RMQ_DEBUG("onSuccess begin: %s", pullResult.toString().c_str());
- PullResult* pPullResult = &pullResult;
- if (pPullResult != NULL)
- {
- pPullResult =
- m_pDefaultMQPushConsumerImpl->m_pPullAPIWrapper->processPullResult(
- m_pPullRequest->getMessageQueue(), *pPullResult, m_subscriptionData);
-
- switch (pPullResult->pullStatus)
- {
- case FOUND:
- {
- m_pPullRequest->setNextOffset(pPullResult->nextBeginOffset);
-
- long long pullRT = KPRUtil::GetCurrentTimeMillis() - m_beginTimestamp;
- m_pDefaultMQPushConsumerImpl->getConsumerStatManager()->getConsumertat()
- .pullTimesTotal++;
- m_pDefaultMQPushConsumerImpl->getConsumerStatManager()->getConsumertat()
- .pullRTTotal.fetchAndAdd(pullRT);
-
- ProcessQueue* processQueue = m_pPullRequest->getProcessQueue();
- bool dispatchToConsume = processQueue->putMessage(pPullResult->msgFoundList);
-
- m_pDefaultMQPushConsumerImpl->m_pConsumeMessageService->submitConsumeRequest(//
- pPullResult->msgFoundList, //
- processQueue, //
- m_pPullRequest->getMessageQueue(), //
- dispatchToConsume);
-
- if (m_pDefaultMQPushConsumerImpl->m_pDefaultMQPushConsumer->getPullInterval() > 0)
- {
- m_pDefaultMQPushConsumerImpl->executePullRequestLater(m_pPullRequest,
- m_pDefaultMQPushConsumerImpl->m_pDefaultMQPushConsumer->getPullInterval());
- }
- else
- {
- m_pDefaultMQPushConsumerImpl->executePullRequestImmediately(m_pPullRequest);
- }
- }
- break;
- case NO_NEW_MSG:
- m_pPullRequest->setNextOffset(pPullResult->nextBeginOffset);
- m_pDefaultMQPushConsumerImpl->correctTagsOffset(*m_pPullRequest);
- m_pDefaultMQPushConsumerImpl->executePullRequestImmediately(m_pPullRequest);
- break;
- case NO_MATCHED_MSG:
- m_pPullRequest->setNextOffset(pPullResult->nextBeginOffset);
- m_pDefaultMQPushConsumerImpl->correctTagsOffset(*m_pPullRequest);
- m_pDefaultMQPushConsumerImpl->executePullRequestImmediately(m_pPullRequest);
- break;
- case OFFSET_ILLEGAL:
- RMQ_WARN("the pull request offset illegal, %s, %s",
- m_pPullRequest->toString().c_str(), pPullResult->toString().c_str());
-
- /*
- if (m_pPullRequest->getNextOffset() < pPullResult->minOffset)
- {
- m_pPullRequest->setNextOffset(pPullResult->minOffset);
- }
- else if (m_pPullRequest->getNextOffset() > pPullResult->maxOffset)
- {
- m_pPullRequest->setNextOffset(pPullResult->maxOffset);
- }
- m_pDefaultMQPushConsumerImpl->m_pOffsetStore->updateOffset(
- m_pPullRequest->getMessageQueue(), m_pPullRequest->getNextOffset(), false);
- m_pDefaultMQPushConsumerImpl->executePullRequestImmediately(m_pPullRequest);
- */
-
- // todo
- m_pPullRequest->setNextOffset(pPullResult->nextBeginOffset);
- m_pPullRequest->getProcessQueue()->setDropped(true);
-
- m_pDefaultMQPushConsumerImpl->executeTaskLater(new RemoveProcessQueueLater(
- m_pDefaultMQPushConsumerImpl, m_pPullRequest), 10000);
- break;
- default:
- break;
- }
- }
- else
- {
- RMQ_WARN("Warning: PullRequest is null!");
- }
- RMQ_DEBUG("onSuccess end");
- }
-
- void onException(MQException& e)
- {
- std::string topic = m_pPullRequest->getMessageQueue().getTopic();
- if (topic.find(MixAll::RETRY_GROUP_TOPIC_PREFIX) != std::string::npos)
- {
- RMQ_WARN("execute the pull request exception:%s", e.what());
- }
-
- m_pDefaultMQPushConsumerImpl->executePullRequestLater(m_pPullRequest,
- DefaultMQPushConsumerImpl::s_PullTimeDelayMillsWhenException);
- }
-
-private:
- SubscriptionData m_subscriptionData;
- DefaultMQPushConsumerImpl* m_pDefaultMQPushConsumerImpl;
- PullRequest* m_pPullRequest;
- unsigned long long m_beginTimestamp;
-};
-
-
-DefaultMQPushConsumerImpl::DefaultMQPushConsumerImpl(DefaultMQPushConsumer* pDefaultMQPushConsumer)
-{
- m_pDefaultMQPushConsumer = pDefaultMQPushConsumer;
- m_serviceState = CREATE_JUST;
- flowControlTimes1 = 0;
- flowControlTimes2 = 0;
- m_pause = false;
- m_consumeOrderly = false;
-
- m_pMQClientFactory = NULL;
- m_pPullAPIWrapper = NULL;
- m_pMessageListenerInner = NULL;
- m_pOffsetStore = NULL;
- m_pRebalanceImpl = new RebalancePushImpl(this);
- m_pConsumerStatManager = new ConsumerStatManager();
- m_pConsumeMessageService = NULL;
-}
-
-DefaultMQPushConsumerImpl::~DefaultMQPushConsumerImpl()
-{
- //delete m_pMessageListenerInner;
- if (m_pPullAPIWrapper)
- delete m_pPullAPIWrapper;
- if (m_pRebalanceImpl)
- delete m_pRebalanceImpl;
- if (m_pConsumerStatManager)
- delete m_pConsumerStatManager;
- if (m_pConsumeMessageService)
- delete m_pConsumeMessageService;
- if (m_pOffsetStore)
- delete m_pOffsetStore;
- //delete m_pMQClientFactory;
-}
-
-void DefaultMQPushConsumerImpl::start()
-{
- RMQ_DEBUG("DefaultMQPushConsumerImpl::start()");
- switch (m_serviceState)
- {
- case CREATE_JUST:
- {
- RMQ_INFO("the consumer [{%s}] start beginning. messageModel={%s}",
- m_pDefaultMQPushConsumer->getConsumerGroup().c_str(),
- getMessageModelString(m_pDefaultMQPushConsumer->getMessageModel()));
-
- m_serviceState = START_FAILED;
- checkConfig();
- copySubscription();
-
- if (m_pDefaultMQPushConsumer->getMessageModel() == CLUSTERING)
- {
- m_pDefaultMQPushConsumer->changeInstanceNameToPID();
- }
-
- m_pMQClientFactory = MQClientManager::getInstance()->getAndCreateMQClientFactory(*m_pDefaultMQPushConsumer);
-
- m_pRebalanceImpl->setConsumerGroup(m_pDefaultMQPushConsumer->getConsumerGroup());
- m_pRebalanceImpl->setMessageModel(m_pDefaultMQPushConsumer->getMessageModel());
- m_pRebalanceImpl->setAllocateMessageQueueStrategy(m_pDefaultMQPushConsumer->getAllocateMessageQueueStrategy());
- m_pRebalanceImpl->setmQClientFactory(m_pMQClientFactory);
-
- m_pPullAPIWrapper = new PullAPIWrapper(m_pMQClientFactory, m_pDefaultMQPushConsumer->getConsumerGroup());
-
- if (m_pDefaultMQPushConsumer->getOffsetStore() != NULL)
- {
- m_pOffsetStore = m_pDefaultMQPushConsumer->getOffsetStore();
- }
- else
- {
- switch (m_pDefaultMQPushConsumer->getMessageModel())
- {
- case BROADCASTING:
- m_pOffsetStore = new LocalFileOffsetStore(m_pMQClientFactory, m_pDefaultMQPushConsumer->getConsumerGroup());
- break;
- case CLUSTERING:
- m_pOffsetStore = new RemoteBrokerOffsetStore(m_pMQClientFactory, m_pDefaultMQPushConsumer->getConsumerGroup());
- break;
- default:
- break;
- }
- }
-
- m_pOffsetStore->load();
-
- if (dynamic_cast<MessageListenerOrderly*>(m_pMessageListenerInner) != NULL)
- {
- m_consumeOrderly = true;
- m_pConsumeMessageService =
- new ConsumeMessageOrderlyService(this, (MessageListenerOrderly*)m_pMessageListenerInner);
- }
- else if (dynamic_cast<MessageListenerConcurrently*>(m_pMessageListenerInner) != NULL)
- {
- m_consumeOrderly = false;
- m_pConsumeMessageService =
- new ConsumeMessageConcurrentlyService(this, (MessageListenerConcurrently*)m_pMessageListenerInner);
- }
- m_pConsumeMessageService->start();
-
- bool registerOK = m_pMQClientFactory->registerConsumer(m_pDefaultMQPushConsumer->getConsumerGroup(), this);
- if (!registerOK)
- {
- m_serviceState = CREATE_JUST;
- m_pConsumeMessageService->shutdown();
- std::string str = "The consumer group[" + m_pDefaultMQPushConsumer->getConsumerGroup();
- str += "] has been created before, specify another name please.";
- THROW_MQEXCEPTION(MQClientException, str, -1);
- }
- m_pMQClientFactory->start();
-
- RMQ_INFO("the consumer [%s] start OK.", m_pDefaultMQPushConsumer->getConsumerGroup().c_str());
- m_serviceState = RUNNING;
- }
- break;
- case RUNNING:
- case START_FAILED:
- case SHUTDOWN_ALREADY:
- THROW_MQEXCEPTION(MQClientException, "The PullConsumer service state not OK, maybe started once, ", -1);
- default:
- break;
- }
-
- updateTopicSubscribeInfoWhenSubscriptionChanged();
- m_pMQClientFactory->sendHeartbeatToAllBrokerWithLock();
- m_pMQClientFactory->rebalanceImmediately();
-}
-
-
-void DefaultMQPushConsumerImpl::shutdown()
-{
- RMQ_DEBUG("DefaultMQPushConsumerImpl::shutdown()");
- switch (m_serviceState)
- {
- case CREATE_JUST:
- break;
- case RUNNING:
- m_pConsumeMessageService->shutdown();
- persistConsumerOffset();
- m_pMQClientFactory->unregisterConsumer(m_pDefaultMQPushConsumer->getConsumerGroup());
- m_pMQClientFactory->shutdown();
-
- m_serviceState = SHUTDOWN_ALREADY;
- break;
- case SHUTDOWN_ALREADY:
- break;
- default:
- break;
- }
-}
-
-
-
-
-bool DefaultMQPushConsumerImpl::hasHook()
-{
- return !m_hookList.empty();
-}
-
-void DefaultMQPushConsumerImpl::registerHook(ConsumeMessageHook* pHook)
-{
- m_hookList.push_back(pHook);
-}
-
-void DefaultMQPushConsumerImpl::executeHookBefore(ConsumeMessageContext& context)
-{
- std::list<ConsumeMessageHook*>::iterator it = m_hookList.begin();
- for (; it != m_hookList.end(); it++)
- {
- try
- {
- (*it)->consumeMessageBefore(context);
- }
- catch (...)
- {
- RMQ_WARN("consumeMessageBefore exception");
- }
- }
-}
-
-void DefaultMQPushConsumerImpl::executeHookAfter(ConsumeMessageContext& context)
-{
- std::list<ConsumeMessageHook*>::iterator it = m_hookList.begin();
- for (; it != m_hookList.end(); it++)
- {
- try
- {
- (*it)->consumeMessageAfter(context);
- }
- catch (...)
- {
- RMQ_WARN("consumeMessageAfter exception");
- }
- }
-}
-
-void DefaultMQPushConsumerImpl::createTopic(const std::string& key, const std::string& newTopic, int queueNum)
-{
- m_pMQClientFactory->getMQAdminImpl()->createTopic(key, newTopic, queueNum);
-}
-
-std::set<MessageQueue>* DefaultMQPushConsumerImpl::fetchSubscribeMessageQueues(const std::string& topic)
-{
- std::map<std::string, std::set<MessageQueue> >& mqs = m_pRebalanceImpl->getTopicSubscribeInfoTable();
- std::map<std::string, std::set<MessageQueue> >::iterator it = mqs.find(topic);
-
- if (it == mqs.end())
- {
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(topic);
- mqs = m_pRebalanceImpl->getTopicSubscribeInfoTable();
- it = mqs.find(topic);
- }
-
- if (it == mqs.end())
- {
- THROW_MQEXCEPTION(MQClientException, "The topic[" + topic + "] not exist", -1);
- }
-
- std::set<MessageQueue>* result = new std::set<MessageQueue>(it->second.begin(), it->second.end());
- return result;
-}
-
-DefaultMQPushConsumer* DefaultMQPushConsumerImpl::getDefaultMQPushConsumer()
-{
- return m_pDefaultMQPushConsumer;
-}
-
-long long DefaultMQPushConsumerImpl::earliestMsgStoreTime(const MessageQueue& mq)
-{
- return m_pMQClientFactory->getMQAdminImpl()->earliestMsgStoreTime(mq);
-}
-
-long long DefaultMQPushConsumerImpl::maxOffset(const MessageQueue& mq)
-{
- return m_pMQClientFactory->getMQAdminImpl()->maxOffset(mq);
-}
-
-long long DefaultMQPushConsumerImpl::minOffset(const MessageQueue& mq)
-{
- return m_pMQClientFactory->getMQAdminImpl()->minOffset(mq);
-}
-
-OffsetStore* DefaultMQPushConsumerImpl::getOffsetStore()
-{
- return m_pOffsetStore;
-}
-
-void DefaultMQPushConsumerImpl::setOffsetStore(OffsetStore* pOffsetStore)
-{
- m_pOffsetStore = pOffsetStore;
-}
-
-//MQConsumerInner
-std::string DefaultMQPushConsumerImpl::groupName()
-{
- return m_pDefaultMQPushConsumer->getConsumerGroup();
-}
-
-MessageModel DefaultMQPushConsumerImpl::messageModel()
-{
- return m_pDefaultMQPushConsumer->getMessageModel();
-}
-
-ConsumeType DefaultMQPushConsumerImpl::consumeType()
-{
- return CONSUME_PASSIVELY;
-}
-
-ConsumeFromWhere DefaultMQPushConsumerImpl::consumeFromWhere()
-{
- return m_pDefaultMQPushConsumer->getConsumeFromWhere();
-}
-
-std::set<SubscriptionData> DefaultMQPushConsumerImpl::subscriptions()
-{
- std::set<SubscriptionData> sds;
- std::map<std::string, SubscriptionData>& subscription = m_pRebalanceImpl->getSubscriptionInner();
- std::map<std::string, SubscriptionData>::iterator it = subscription.begin();
- for (; it != subscription.end(); it++)
- {
- sds.insert(it->second);
- }
-
- return sds;
-}
-
-void DefaultMQPushConsumerImpl::doRebalance()
-{
- if (m_pRebalanceImpl != NULL)
- {
- m_pRebalanceImpl->doRebalance();
- }
-}
-
-void DefaultMQPushConsumerImpl::persistConsumerOffset()
-{
- try
- {
- makeSureStateOK();
-
- std::set<MessageQueue> mqs;
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_pRebalanceImpl->getProcessQueueTableLock());
- std::map<MessageQueue, ProcessQueue*>& processQueueTable = m_pRebalanceImpl->getProcessQueueTable();
- RMQ_FOR_EACH(processQueueTable, it)
- {
- mqs.insert(it->first);
- }
- }
-
- m_pOffsetStore->persistAll(mqs);
- }
- catch (...)
- {
- RMQ_ERROR("persistConsumerOffset exception, group: %s",
- m_pDefaultMQPushConsumer->getConsumerGroup().c_str());
- }
-}
-
-void DefaultMQPushConsumerImpl::updateTopicSubscribeInfo(const std::string& topic, const std::set<MessageQueue>& info)
-{
- std::map<std::string, SubscriptionData>& subTable = getSubscriptionInner();
-
- if (subTable.find(topic) != subTable.end())
- {
- m_pRebalanceImpl->getTopicSubscribeInfoTable().insert(std::pair<std::string, std::set<MessageQueue> >(topic, info));
- }
-}
-
-std::map<std::string, SubscriptionData>& DefaultMQPushConsumerImpl::getSubscriptionInner()
-{
- return m_pRebalanceImpl->getSubscriptionInner();
-}
-
-bool DefaultMQPushConsumerImpl::isSubscribeTopicNeedUpdate(const std::string& topic)
-{
- std::map<std::string, SubscriptionData>& subTable = getSubscriptionInner();
-
- if (subTable.find(topic) != subTable.end())
- {
- std::map<std::string, std::set<MessageQueue> >& mqs =
- m_pRebalanceImpl->getTopicSubscribeInfoTable();
-
- return mqs.find(topic) == mqs.end();
- }
-
- return false;
-}
-
-bool DefaultMQPushConsumerImpl::isPause()
-{
- return m_pause;
-}
-
-void DefaultMQPushConsumerImpl::setPause(bool pause)
-{
- m_pause = pause;
-}
-
-
-void DefaultMQPushConsumerImpl::correctTagsOffset(PullRequest& pullRequest)
-{
- if (pullRequest.getProcessQueue()->getMsgCount().get() == 0)
- {
- m_pOffsetStore->updateOffset(pullRequest.getMessageQueue(), pullRequest.getNextOffset(), true);
- }
-}
-
-void DefaultMQPushConsumerImpl::pullMessage(PullRequest* pPullRequest)
-{
- RMQ_DEBUG("pullMessage begin: %s", pPullRequest->toString().c_str());
-
- ProcessQueue* processQueue = pPullRequest->getProcessQueue();
- if (processQueue->isDropped())
- {
- RMQ_WARN("the pull request[%s] is dropped.", pPullRequest->toString().c_str());
- delete pPullRequest;
- return;
- }
-
- pPullRequest->getProcessQueue()->setLastPullTimestamp(KPRUtil::GetCurrentTimeMillis());
-
- try
- {
- makeSureStateOK();
- }
- catch (const MQException& e)
- {
- RMQ_WARN("pullMessage exception [%s], consumer state not ok", e.what());
- executePullRequestLater(pPullRequest, s_PullTimeDelayMillsWhenException);
- return;
- }
-
- if (isPause())
- {
- RMQ_WARN("consumer was paused, execute pull request later. instanceName={%s}",
- m_pDefaultMQPushConsumer->getInstanceName().c_str());
- executePullRequestLater(pPullRequest, s_PullTimeDelayMillsWhenSuspend);
- return;
- }
-
- long size = processQueue->getMsgCount().get();
- if (size > m_pDefaultMQPushConsumer->getPullThresholdForQueue())
- {
- executePullRequestLater(pPullRequest, s_PullTimeDelayMillsWhenFlowControl);
- if ((flowControlTimes1++ % 3000) == 0)
- {
- RMQ_WARN("the consumer message buffer is full, so do flow control, {%ld} {%s} {%lld}", size,
- pPullRequest->toString().c_str(), flowControlTimes1);
- }
- return;
- }
-
- if (!m_consumeOrderly)
- {
- if (processQueue->getMaxSpan() > m_pDefaultMQPushConsumer->getConsumeConcurrentlyMaxSpan())
- {
- executePullRequestLater(pPullRequest, s_PullTimeDelayMillsWhenFlowControl);
- if ((flowControlTimes2++ % 3000) == 0)
- {
- RMQ_WARN("the queue's messages, span too long, so do flow control, size: {%ld}, pullRequest: {%s}, times: {%lld}, maxspan: {%lld}",
- size, pPullRequest->toString().c_str(), flowControlTimes2, processQueue->getMaxSpan());
- }
- return;
- }
- }
-
- std::map<std::string, SubscriptionData>& subTable = getSubscriptionInner();
- std::string topic = pPullRequest->getMessageQueue().getTopic();
- std::map<std::string, SubscriptionData>::iterator it = subTable.find(topic);
- if (it == subTable.end())
- {
- executePullRequestLater(pPullRequest, s_PullTimeDelayMillsWhenException);
- RMQ_WARN("find the consumer's subscription failed, {%s}", pPullRequest->toString().c_str());
- return;
- }
-
- SubscriptionData subscriptionData = it->second;
- PullCallback* pullCallback = new DefaultMQPushConsumerImplCallback(subTable[topic], this, pPullRequest);
-
- bool commitOffsetEnable = false;
- long commitOffsetValue = 0L;
- if (CLUSTERING == m_pDefaultMQPushConsumer->getMessageModel())
- {
- commitOffsetValue = m_pOffsetStore->readOffset(pPullRequest->getMessageQueue(),
- READ_FROM_MEMORY);
- if (commitOffsetValue > 0)
- {
- commitOffsetEnable = true;
- }
- }
-
- int sysFlag = PullSysFlag::buildSysFlag(
- commitOffsetEnable, // commitOffset
- true, // suspend
- false// subscription
- );
- try
- {
- m_pPullAPIWrapper->pullKernelImpl(
- pPullRequest->getMessageQueue(), // 1
- "", // 2
- subscriptionData.getSubVersion(), // 3
- pPullRequest->getNextOffset(), // 4
- m_pDefaultMQPushConsumer->getPullBatchSize(), // 5
- sysFlag, // 6
- commitOffsetValue,// 7
- s_BrokerSuspendMaxTimeMillis, // 8
- s_ConsumerTimeoutMillisWhenSuspend, // 9
- ASYNC, // 10
- pullCallback// 11
- );
- }
- catch (...)
- {
- RMQ_ERROR("pullKernelImpl exception");
- executePullRequestLater(pPullRequest, s_PullTimeDelayMillsWhenException);
- }
-
- RMQ_DEBUG("pullMessage end");
-}
-
-void DefaultMQPushConsumerImpl::executePullRequestImmediately(PullRequest* pullRequest)
-{
- m_pMQClientFactory->getPullMessageService()->executePullRequestImmediately(pullRequest);
-}
-
-void DefaultMQPushConsumerImpl::executePullRequestLater(PullRequest* pullRequest, long timeDelay)
-{
- m_pMQClientFactory->getPullMessageService()->executePullRequestLater(pullRequest, timeDelay);
-}
-
-void DefaultMQPushConsumerImpl::executeTaskLater(kpr::TimerHandler* handler, long timeDelay)
-{
- m_pMQClientFactory->getPullMessageService()->executeTaskLater(handler, timeDelay);
-}
-
-
-void DefaultMQPushConsumerImpl::makeSureStateOK()
-{
- if (m_serviceState != RUNNING)
- {
- THROW_MQEXCEPTION(MQClientException, "The consumer service state not OK, ", -1);
- }
-}
-
-ConsumerStatManager* DefaultMQPushConsumerImpl::getConsumerStatManager()
-{
- return m_pConsumerStatManager;
-}
-
-QueryResult DefaultMQPushConsumerImpl::queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end)
-{
- return m_pMQClientFactory->getMQAdminImpl()->queryMessage(topic, key, maxNum, begin, end);
-}
-
-void DefaultMQPushConsumerImpl::registerMessageListener(MessageListener* pMessageListener)
-{
- m_pMessageListenerInner = pMessageListener;
-}
-
-void DefaultMQPushConsumerImpl::resume()
-{
- m_pause = false;
-}
-
-long long DefaultMQPushConsumerImpl::searchOffset(const MessageQueue& mq, long long timestamp)
-{
- return m_pMQClientFactory->getMQAdminImpl()->searchOffset(mq, timestamp);
-}
-
-void DefaultMQPushConsumerImpl::sendMessageBack(MessageExt& msg, int delayLevel, const std::string& brokerName)
-{
- try
- {
- std::string brokerAddr = brokerName.empty() ?
- socketAddress2IPPort(msg.getStoreHost()) : m_pMQClientFactory->findBrokerAddressInPublish(brokerName);
-
- m_pMQClientFactory->getMQClientAPIImpl()->consumerSendMessageBack(brokerAddr, msg,
- m_pDefaultMQPushConsumer->getConsumerGroup(),
- delayLevel,
- 5000);
- }
- catch (...)
- {
- RMQ_ERROR("sendMessageBack Exception, group: %s", m_pDefaultMQPushConsumer->getConsumerGroup().c_str());
- Message newMsg(MixAll::getRetryTopic(m_pDefaultMQPushConsumer->getConsumerGroup()),
- msg.getBody(), msg.getBodyLen());
-
- std::string originMsgId = msg.getProperty(Message::PROPERTY_ORIGIN_MESSAGE_ID);
- newMsg.putProperty(Message::PROPERTY_ORIGIN_MESSAGE_ID, UtilAll::isBlank(originMsgId) ? msg.getMsgId()
- : originMsgId);
-
- newMsg.setFlag(msg.getFlag());
- newMsg.setProperties(msg.getProperties());
- newMsg.putProperty(Message::PROPERTY_RETRY_TOPIC, msg.getTopic());
-
- int reTimes = msg.getReconsumeTimes() + 1;
- newMsg.putProperty(Message::PROPERTY_RECONSUME_TIME, UtilAll::toString(reTimes));
- newMsg.putProperty(Message::PROPERTY_MAX_RECONSUME_TIMES, UtilAll::toString(m_pDefaultMQPushConsumer->getMaxReconsumeTimes()));
- newMsg.setDelayTimeLevel(3 + reTimes);
-
- m_pMQClientFactory->getDefaultMQProducer()->send(newMsg);
- }
-}
-
-void DefaultMQPushConsumerImpl::checkConfig()
-{
- // consumerGroup check
- Validators::checkGroup(m_pDefaultMQPushConsumer->getConsumerGroup());
-
- // consumerGroup
- if (m_pDefaultMQPushConsumer->getConsumerGroup() == MixAll::DEFAULT_CONSUMER_GROUP)
- {
- THROW_MQEXCEPTION(MQClientException, "consumerGroup can not equal "
- + MixAll::DEFAULT_CONSUMER_GROUP //
- + ", please specify another one.", -1);
- }
-
- if (m_pDefaultMQPushConsumer->getMessageModel() != BROADCASTING
- && m_pDefaultMQPushConsumer->getMessageModel() != CLUSTERING)
- {
- THROW_MQEXCEPTION(MQClientException, "messageModel is invalid ", -1);
- }
-
- // allocateMessageQueueStrategy
- if (m_pDefaultMQPushConsumer->getAllocateMessageQueueStrategy() == NULL)
- {
- THROW_MQEXCEPTION(MQClientException, "allocateMessageQueueStrategy is null", -1);
- }
-
- // consumeFromWhereOffset
- if (m_pDefaultMQPushConsumer->getConsumeFromWhere() < CONSUME_FROM_LAST_OFFSET
- || m_pDefaultMQPushConsumer->getConsumeFromWhere() > CONSUME_FROM_MAX_OFFSET)
- {
- THROW_MQEXCEPTION(MQClientException, "consumeFromWhere is invalid", -1);
- }
-
- // subscription
- /*
- if (m_pDefaultMQPushConsumer->getSubscription().size() == 0)
- {
- THROW_MQEXCEPTION(MQClientException,"subscription is null" ,-1);
- }
- */
-
- // messageListener
- if (m_pDefaultMQPushConsumer->getMessageListener() == NULL)
- {
- THROW_MQEXCEPTION(MQClientException, "messageListener is null", -1);
- }
-
- MessageListener* listener = m_pDefaultMQPushConsumer->getMessageListener();
- MessageListener* orderly = (dynamic_cast<MessageListenerOrderly*>(listener)) ;
- MessageListener* concurrently = (dynamic_cast<MessageListenerConcurrently*>(listener)) ;
-
- if (!orderly && !concurrently)
- {
- THROW_MQEXCEPTION(MQClientException,
- "messageListener must be instanceof MessageListenerOrderly or MessageListenerConcurrently" ,
- -1);
- }
-
- // consumeThreadMin
- if (m_pDefaultMQPushConsumer->getConsumeThreadMin() < 1
- || m_pDefaultMQPushConsumer->getConsumeThreadMin() > 1000
- || m_pDefaultMQPushConsumer->getConsumeThreadMin() > m_pDefaultMQPushConsumer->getConsumeThreadMax()
- )
- {
- THROW_MQEXCEPTION(MQClientException, "consumeThreadMin Out of range [1, 1000]", -1);
- }
-
- // consumeThreadMax
- if (m_pDefaultMQPushConsumer->getConsumeThreadMax() < 1
- || m_pDefaultMQPushConsumer->getConsumeThreadMax() > 1000)
- {
- THROW_MQEXCEPTION(MQClientException, "consumeThreadMax Out of range [1, 1000]", -1);
- }
-
- // consumeConcurrentlyMaxSpan
- if (m_pDefaultMQPushConsumer->getConsumeConcurrentlyMaxSpan() < 1
- || m_pDefaultMQPushConsumer->getConsumeConcurrentlyMaxSpan() > 65535)
- {
- THROW_MQEXCEPTION(MQClientException, "consumeConcurrentlyMaxSpan Out of range [1, 65535]" , -1);
- }
-
- // pullThresholdForQueue
- if (m_pDefaultMQPushConsumer->getPullThresholdForQueue() < 1
- || m_pDefaultMQPushConsumer->getPullThresholdForQueue() > 65535)
- {
- THROW_MQEXCEPTION(MQClientException, "pullThresholdForQueue Out of range [1, 65535]", -1);
- }
-
- // pullInterval
- if (m_pDefaultMQPushConsumer->getPullInterval() < 0
- || m_pDefaultMQPushConsumer->getPullInterval() > 65535)
- {
- THROW_MQEXCEPTION(MQClientException, "pullInterval Out of range [0, 65535]", -1);
- }
-
- // consumeMessageBatchMaxSize
- if (m_pDefaultMQPushConsumer->getConsumeMessageBatchMaxSize() < 1
- || m_pDefaultMQPushConsumer->getConsumeMessageBatchMaxSize() > 1024)
- {
- THROW_MQEXCEPTION(MQClientException, "consumeMessageBatchMaxSize Out of range [1, 1024]", -1);
- }
-
- // pullBatchSize
- if (m_pDefaultMQPushConsumer->getPullBatchSize() < 1
- || m_pDefaultMQPushConsumer->getPullBatchSize() > 1024)
- {
- THROW_MQEXCEPTION(MQClientException, "pullBatchSize Out of range [1, 1024]", -1);
- }
-}
-
-void DefaultMQPushConsumerImpl::copySubscription()
-{
- try
- {
- std::map<std::string, std::string>& sub = m_pDefaultMQPushConsumer->getSubscription();
- std::map<std::string, std::string>::iterator it = sub.begin();
- for (; it != sub.end(); it++)
- {
- SubscriptionDataPtr subscriptionData = FilterAPI::buildSubscriptionData(it->first, it->second);
- m_pRebalanceImpl->getSubscriptionInner()[it->first] = *subscriptionData;
- }
-
- if (m_pMessageListenerInner == NULL)
- {
- m_pMessageListenerInner = m_pDefaultMQPushConsumer->getMessageListener();
- }
-
- switch (m_pDefaultMQPushConsumer->getMessageModel())
- {
- case BROADCASTING:
- break;
- case CLUSTERING:
- {
- std::string retryTopic = MixAll::getRetryTopic(m_pDefaultMQPushConsumer->getConsumerGroup());
- SubscriptionDataPtr subscriptionData =
- FilterAPI::buildSubscriptionData(retryTopic, SubscriptionData::SUB_ALL);
- m_pRebalanceImpl->getSubscriptionInner()[retryTopic] = *subscriptionData;
- }
-
- break;
- default:
- break;
- }
- }
- catch (...)
- {
- THROW_MQEXCEPTION(MQClientException, "subscription exception", -1);
- }
-}
-
-void DefaultMQPushConsumerImpl::updateTopicSubscribeInfoWhenSubscriptionChanged()
-{
- std::map<std::string, SubscriptionData> subTable = getSubscriptionInner();
- std::map<std::string, SubscriptionData>::iterator it = subTable.begin();
- for (; it != subTable.end(); it++)
- {
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(it->first);
- }
-}
-
-MessageListener* DefaultMQPushConsumerImpl::getMessageListenerInner()
-{
- return m_pMessageListenerInner;
-}
-
-void DefaultMQPushConsumerImpl::subscribe(const std::string& topic, const std::string& subExpression)
-{
- try
- {
- SubscriptionDataPtr subscriptionData = FilterAPI::buildSubscriptionData(topic, subExpression);
- m_pRebalanceImpl->getSubscriptionInner()[topic] = *subscriptionData;
-
- if (m_pMQClientFactory)
- {
- m_pMQClientFactory->sendHeartbeatToAllBrokerWithLock();
- }
- }
- catch (...)
- {
- THROW_MQEXCEPTION(MQClientException, "subscription exception", -1);
- }
-}
-
-void DefaultMQPushConsumerImpl::suspend()
-{
- m_pause = true;
-}
-
-void DefaultMQPushConsumerImpl::unsubscribe(const std::string& topic)
-{
- m_pRebalanceImpl->getSubscriptionInner().erase(topic);
-}
-
-void DefaultMQPushConsumerImpl::updateConsumeOffset(MessageQueue& mq, long long offset)
-{
- m_pOffsetStore->updateOffset(mq, offset, false);
-}
-
-void DefaultMQPushConsumerImpl::updateCorePoolSize(int corePoolSize)
-{
- m_pConsumeMessageService->updateCorePoolSize(corePoolSize);
-}
-
-MessageExt* DefaultMQPushConsumerImpl::viewMessage(const std::string& msgId)
-{
- return m_pMQClientFactory->getMQAdminImpl()->viewMessage(msgId);
-}
-
-RebalanceImpl* DefaultMQPushConsumerImpl::getRebalanceImpl()
-{
- return m_pRebalanceImpl;
-}
-
-bool DefaultMQPushConsumerImpl::isConsumeOrderly()
-{
- return m_consumeOrderly;
-}
-
-void DefaultMQPushConsumerImpl::setConsumeOrderly(bool consumeOrderly)
-{
- m_consumeOrderly = consumeOrderly;
-}
-
-
-MQClientFactory* DefaultMQPushConsumerImpl::getmQClientFactory()
-{
- return m_pMQClientFactory;
-}
-
-void DefaultMQPushConsumerImpl::setmQClientFactory(MQClientFactory* mQClientFactory)
-{
- m_pMQClientFactory = mQClientFactory;
-}
-
-
-ServiceState DefaultMQPushConsumerImpl::getServiceState()
-{
- return m_serviceState;
-}
-
-void DefaultMQPushConsumerImpl::setServiceState(ServiceState serviceState)
-{
- m_serviceState = serviceState;
-}
-
-}
-
diff --git a/rocketmq-client4cpp/src/consumer/DefaultMQPushConsumerImpl.h b/rocketmq-client4cpp/src/consumer/DefaultMQPushConsumerImpl.h
deleted file mode 100755
index 53705861..00000000
--- a/rocketmq-client4cpp/src/consumer/DefaultMQPushConsumerImpl.h
+++ /dev/null
@@ -1,169 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __DEFAULTMQPUSHCONSUMERIMPL_H__
-#define __DEFAULTMQPUSHCONSUMERIMPL_H__
-
-#include <string>
-#include <set>
-#include <map>
-
-#include "MQConsumerInner.h"
-#include "MessageExt.h"
-#include "QueryResult.h"
-#include "ServiceState.h"
-#include "PullResult.h"
-#include "ConsumeMessageHook.h"
-#include "MixAll.h"
-#include "PullCallback.h"
-#include "TimerThread.h"
-
-namespace rmq
-{
- class DefaultMQPushConsumer;
- class ConsumeMessageHook;
- class OffsetStore;
- class RebalanceImpl;
- class ConsumerStatManager;
- class ConsumeMessageService;
- class MessageListener;
- class PullRequest;
- class MQClientFactory;
- class PullAPIWrapper;
- class PullMessageService;
- class DefaultMQPushConsumerImplCallback;
- class MQException;
-
- /**
- * Push Consumer Impl
- *
- */
- class DefaultMQPushConsumerImpl : public MQConsumerInner
- {
- public:
- DefaultMQPushConsumerImpl(DefaultMQPushConsumer* pDefaultMQPushConsumer);
- ~DefaultMQPushConsumerImpl();
-
- void start();
- void suspend();
- void resume();
- void shutdown();
- bool isPause();
- void setPause(bool pause);
-
- bool hasHook();
- void registerHook(ConsumeMessageHook* pHook);
- void executeHookBefore(ConsumeMessageContext& context);
- void executeHookAfter(ConsumeMessageContext& context);
-
- void createTopic(const std::string& key, const std::string& newTopic, int queueNum);
- std::set<MessageQueue>* fetchSubscribeMessageQueues(const std::string& topic);
-
- long long earliestMsgStoreTime(const MessageQueue& mq);
- long long maxOffset(const MessageQueue& mq);
- long long minOffset(const MessageQueue& mq);
- OffsetStore* getOffsetStore() ;
- void setOffsetStore(OffsetStore* pOffsetStore);
-
- //MQConsumerInner
- std::string groupName() ;
- MessageModel messageModel() ;
- ConsumeType consumeType();
- ConsumeFromWhere consumeFromWhere();
- std::set<SubscriptionData> subscriptions();
- void doRebalance() ;
- void persistConsumerOffset() ;
- void updateTopicSubscribeInfo(const std::string& topic, const std::set<MessageQueue>& info);
- std::map<std::string, SubscriptionData>& getSubscriptionInner() ;
- bool isSubscribeTopicNeedUpdate(const std::string& topic);
-
- MessageExt* viewMessage(const std::string& msgId);
- QueryResult queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end);
-
- void registerMessageListener(MessageListener* pMessageListener);
- long long searchOffset(const MessageQueue& mq, long long timestamp);
- void sendMessageBack(MessageExt& msg, int delayLevel, const std::string& brokerName);
-
- void subscribe(const std::string& topic, const std::string& subExpression);
- void unsubscribe(const std::string& topic);
-
- void updateConsumeOffset(MessageQueue& mq, long long offset);
- void updateCorePoolSize(int corePoolSize);
- bool isConsumeOrderly();
- void setConsumeOrderly(bool consumeOrderly);
-
- RebalanceImpl* getRebalanceImpl() ;
- MessageListener* getMessageListenerInner();
- DefaultMQPushConsumer* getDefaultMQPushConsumer() ;
- ConsumerStatManager* getConsumerStatManager();
-
- MQClientFactory* getmQClientFactory();
- void setmQClientFactory(MQClientFactory* mQClientFactory);
-
- ServiceState getServiceState();
- void setServiceState(ServiceState serviceState);
-
- private:
- void correctTagsOffset(PullRequest& pullRequest) ;
-
- void pullMessage(PullRequest* pPullRequest);
-
-
- void executePullRequestImmediately(PullRequest* pullRequest);
-
-
- void executePullRequestLater(PullRequest* pullRequest, long timeDelay);
- void executeTaskLater(kpr::TimerHandler* handler, long timeDelay);
-
- void makeSureStateOK();
- void checkConfig();
- void copySubscription() ;
- void updateTopicSubscribeInfoWhenSubscriptionChanged();
-
- private:
- static const int s_PullTimeDelayMillsWhenException = 3000;
- static const int s_PullTimeDelayMillsWhenFlowControl = 50;
- static const int s_PullTimeDelayMillsWhenSuspend = 1000;
- static const int s_BrokerSuspendMaxTimeMillis = 15000;
- static const int s_ConsumerTimeoutMillisWhenSuspend = 30000;
-
- long long flowControlTimes1;
- long long flowControlTimes2;
- ServiceState m_serviceState;
- volatile bool m_pause;
- bool m_consumeOrderly;
- DefaultMQPushConsumer* m_pDefaultMQPushConsumer;
- MQClientFactory* m_pMQClientFactory;
- PullAPIWrapper* m_pPullAPIWrapper;
- MessageListener* m_pMessageListenerInner;
- OffsetStore* m_pOffsetStore;
- RebalanceImpl* m_pRebalanceImpl;
- ConsumerStatManager* m_pConsumerStatManager;
- ConsumeMessageService* m_pConsumeMessageService;
-
- std::list<ConsumeMessageHook*> m_hookList;
- friend class PullMessageService;
- friend class RebalancePushImpl;
- friend class DefaultMQPushConsumerImplCallback;
- };
-}
-
-#endif
-
diff --git a/rocketmq-client4cpp/src/consumer/LocalFileOffsetStore.cpp b/rocketmq-client4cpp/src/consumer/LocalFileOffsetStore.cpp
deleted file mode 100755
index 40e9d652..00000000
--- a/rocketmq-client4cpp/src/consumer/LocalFileOffsetStore.cpp
+++ /dev/null
@@ -1,257 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "LocalFileOffsetStore.h"
-
-#include "MQClientFactory.h"
-#include "OffsetSerializeWrapper.h"
-#include "ScopedLock.h"
-#include "FileUtil.h"
-#include "MixAll.h"
-#include "Exception.h"
-#include "MQClientException.h"
-
-namespace rmq
-{
-
-LocalFileOffsetStore::LocalFileOffsetStore(MQClientFactory* pMQClientFactory,
- const std::string& groupName)
-{
- m_pMQClientFactory = pMQClientFactory;
- m_groupName = groupName;
- std::string homePath = getenv("HOME");
- m_storePath = homePath + "/.rocketmq_offsets/" + m_pMQClientFactory->getClientId()
- + "/" + m_groupName + "/offsets.json";
-}
-
-void LocalFileOffsetStore::load()
-{
- OffsetSerializeWrapperPtr offsetSerializeWrapper = this->readLocalOffset();
- if (offsetSerializeWrapper.ptr() != NULL
- && offsetSerializeWrapper->getOffsetTable().size() > 0)
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_tableMutex);
- m_offsetTable = offsetSerializeWrapper->getOffsetTable();
- RMQ_FOR_EACH(m_offsetTable, it)
- {
- const MessageQueue& mq = it->first;
- const kpr::AtomicLong& offset = it->second;
- RMQ_INFO("load consumer's offset, {%s} {%s} {%lld}",
- m_groupName.c_str(),
- mq.toString().c_str(),
- offset.get());
- }
- }
-}
-
-
-void LocalFileOffsetStore::updateOffset(const MessageQueue& mq, long long offset, bool increaseOnly)
-{
- RMQ_DEBUG("updateOffset, MQ:%s, offset:%lld", mq.toString().c_str(), offset);
- kpr::ScopedWLock<kpr::RWMutex> lock(m_tableMutex);
- typeof(m_offsetTable.begin()) it = m_offsetTable.find(mq);
- if (it == m_offsetTable.end())
- {
- m_offsetTable[mq] = offset;
- it = m_offsetTable.find(mq);
- }
-
- kpr::AtomicLong& offsetOld = it->second;
- if (increaseOnly)
- {
- MixAll::compareAndIncreaseOnly(offsetOld, offset);
- }
- else
- {
- offsetOld.set(offset);
- }
-}
-
-long long LocalFileOffsetStore::readOffset(const MessageQueue& mq, ReadOffsetType type)
-{
- RMQ_DEBUG("readOffset, MQ:%s, type:%d", mq.toString().c_str(), type);
- switch (type)
- {
- case MEMORY_FIRST_THEN_STORE:
- case READ_FROM_MEMORY:
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_tableMutex);
- typeof(m_offsetTable.begin()) it = m_offsetTable.find(mq);
- if (it != m_offsetTable.end())
- {
- return it->second.get();
- }
- else if (READ_FROM_MEMORY == type)
- {
- RMQ_WARN("No offset in memory, MQ:%s", mq.toString().c_str());
- return -1;
- }
- }
- case READ_FROM_STORE:
- {
- OffsetSerializeWrapperPtr offsetSerializeWrapper;
- try
- {
- offsetSerializeWrapper = this->readLocalOffset();
- }
- catch (std::exception& e)
- {
- RMQ_WARN("load offset file fail, MQ:%s, exception:%s", mq.toString().c_str(), e.what());
- return -1;
- }
-
- if (offsetSerializeWrapper.ptr() != NULL)
- {
- std::map<MessageQueue, kpr::AtomicLong>& offsetTable = offsetSerializeWrapper->getOffsetTable();
- typeof(offsetTable.begin()) it = offsetTable.find(mq);
- if (it != offsetTable.end())
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_tableMutex);
- m_offsetTable[mq] = it->second.get();
- return it->second.get();
- }
- }
- return -1;
- }
- default:
- break;
- }
-
- return -1;
-}
-
-
-void LocalFileOffsetStore::persistAll(std::set<MessageQueue>& mqs)
-{
- RMQ_DEBUG("persistAll, mqs.size={%u}, mqs=%s",
- (unsigned)mqs.size(), UtilAll::toString(mqs).c_str());
- if (mqs.empty())
- {
- return;
- }
- RMQ_DEBUG("persistAll, m_offsetTable.size={%u}, m_offsetTable=%s",
- (unsigned)m_offsetTable.size(), UtilAll::toString(m_offsetTable).c_str());
-
- OffsetSerializeWrapper offsetSerializeWrapper;
- std::map<MessageQueue, kpr::AtomicLong>& offsetTable = offsetSerializeWrapper.getOffsetTable();
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_tableMutex);
- RMQ_FOR_EACH(m_offsetTable, it)
- {
- MessageQueue mq = it->first;
- kpr::AtomicLong& offset = it->second;
- if (mqs.find(mq) != mqs.end())
- {
- offsetTable[mq] = offset;
- }
- }
- }
-
- RMQ_DEBUG("persistAll, offsetTable.size={%u}, offsetTable=%s",
- (unsigned)offsetTable.size(), UtilAll::toString(offsetTable).c_str());
-
- std::string jsonString;
- offsetSerializeWrapper.encode(jsonString);
- RMQ_DEBUG("persistAll, json=%s", jsonString.c_str());
-
- if (!jsonString.empty())
- {
- try
- {
- kpr::FileUtil::makeDirRecursive(kpr::FileUtil::extractFilePath(m_storePath));
- MixAll::string2File(m_storePath, jsonString);
- }
- catch (const std::exception& e)
- {
- RMQ_ERROR("persistAll consumer offset Exception, %s, %s", m_storePath.c_str(), e.what());
- }
- }
-}
-
-void LocalFileOffsetStore::persist(const MessageQueue& mq)
-{
-}
-
-void LocalFileOffsetStore::removeOffset(const MessageQueue& mq)
-{
-}
-
-
-std::map<MessageQueue, long long> LocalFileOffsetStore::cloneOffsetTable(const std::string& topic)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_tableMutex);
- std::map<MessageQueue, long long> cloneOffsetTable;
- RMQ_FOR_EACH(m_offsetTable, it)
- {
- MessageQueue mq = it->first;
- kpr::AtomicLong& offset = it->second;
- if (topic == mq.getTopic())
- {
- cloneOffsetTable[mq] = offset.get();
- }
- }
-
- return cloneOffsetTable;
-}
-
-
-OffsetSerializeWrapper* LocalFileOffsetStore::readLocalOffset()
-{
- std::string content = MixAll::file2String(m_storePath);
- if (content.length() == 0)
- {
- return this->readLocalOffsetBak();
- }
- else
- {
- OffsetSerializeWrapper* offsetSerializeWrapper = NULL;
- try
- {
- offsetSerializeWrapper = OffsetSerializeWrapper::decode(content.c_str(), content.size());
- }
- catch (const MQException& e)
- {
- RMQ_WARN("readLocalOffset Exception, and try to correct, %s", e.what());
- return this->readLocalOffsetBak();
- }
-
- return offsetSerializeWrapper;
- }
-}
-
-
-OffsetSerializeWrapper* LocalFileOffsetStore::readLocalOffsetBak()
-{
- std::string content = MixAll::file2String(m_storePath + ".bak");
- if (content.length() > 0)
- {
- OffsetSerializeWrapper* offsetSerializeWrapper = NULL;
- try
- {
- offsetSerializeWrapper = OffsetSerializeWrapper::decode(content.c_str(), content.size());
- }
- catch (const MQException& e)
- {
- RMQ_WARN("readLocalOffset Exception, maybe json content invalid, %s", e.what());
- }
-
- return offsetSerializeWrapper;
- }
-
- return NULL;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/LocalFileOffsetStore.h b/rocketmq-client4cpp/src/consumer/LocalFileOffsetStore.h
deleted file mode 100755
index c4efb76e..00000000
--- a/rocketmq-client4cpp/src/consumer/LocalFileOffsetStore.h
+++ /dev/null
@@ -1,61 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __LOCALFILEOFFSETSTORE_H__
-#define __LOCALFILEOFFSETSTORE_H__
-#include <map>
-#include <string>
-#include <set>
-
-#include "RocketMQClient.h"
-#include "OffsetStore.h"
-#include "MessageQueue.h"
-#include "AtomicValue.h"
-#include "Mutex.h"
-
-namespace rmq
-{
- class MQClientFactory;
- class MessageQueue;
- class OffsetSerializeWrapper;
-
- class LocalFileOffsetStore : public OffsetStore
- {
- public:
- LocalFileOffsetStore(MQClientFactory* pMQClientFactory, const std::string& groupName);
-
- void load();
- void updateOffset(const MessageQueue& mq, long long offset, bool increaseOnly);
- long long readOffset(const MessageQueue& mq, ReadOffsetType type);
- void persistAll(std::set<MessageQueue>& mqs);
- void persist(const MessageQueue& mq);
- void removeOffset(const MessageQueue& mq) ;
- std::map<MessageQueue, long long> cloneOffsetTable(const std::string& topic);
-
- private:
- OffsetSerializeWrapper* readLocalOffset();
- OffsetSerializeWrapper* readLocalOffsetBak();
-
- private:
- MQClientFactory* m_pMQClientFactory;
- std::string m_groupName;
- std::string m_storePath;
- std::map<MessageQueue, kpr::AtomicLong> m_offsetTable;
- kpr::RWMutex m_tableMutex;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/MQConsumerInner.h b/rocketmq-client4cpp/src/consumer/MQConsumerInner.h
deleted file mode 100755
index ed836211..00000000
--- a/rocketmq-client4cpp/src/consumer/MQConsumerInner.h
+++ /dev/null
@@ -1,46 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-#ifndef __MQCONSUMERINNER_H__
-#define __MQCONSUMERINNER_H__
-
-#include <string>
-#include <set>
-
-#include "ConsumeType.h"
-#include "SubscriptionData.h"
-
-namespace rmq
-{
- class MessageQueue;
-
- class MQConsumerInner
- {
- public:
- virtual ~MQConsumerInner() {}
- virtual std::string groupName() = 0;
- virtual MessageModel messageModel() = 0;
- virtual ConsumeType consumeType() = 0;
- virtual ConsumeFromWhere consumeFromWhere() = 0;
- virtual std::set<SubscriptionData> subscriptions() = 0;
- virtual void doRebalance() = 0;
- virtual void persistConsumerOffset() = 0;
- virtual void updateTopicSubscribeInfo(const std::string& topic, const std::set<MessageQueue>& info) = 0;
- virtual bool isSubscribeTopicNeedUpdate(const std::string& topic) = 0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/MessageQueueLock.h b/rocketmq-client4cpp/src/consumer/MessageQueueLock.h
deleted file mode 100755
index 65af99e7..00000000
--- a/rocketmq-client4cpp/src/consumer/MessageQueueLock.h
+++ /dev/null
@@ -1,68 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MESSAGEQUEUELOCK_H__
-#define __MESSAGEQUEUELOCK_H__
-
-#include <map>
-#include "Mutex.h"
-#include "ScopedLock.h"
-#include "MessageQueue.h"
-
-namespace rmq
-{
- class MessageQueueLock
- {
- public:
- MessageQueueLock()
- {
-
- }
-
- ~MessageQueueLock()
- {
- std::map<MessageQueue, kpr::Mutex*>::iterator it = m_mqLockTable.begin();
-
- for (; it != m_mqLockTable.end(); it++)
- {
- delete it->second;
- }
- }
-
- kpr::Mutex* fetchLockObject(MessageQueue& mq)
- {
- kpr::ScopedLock<kpr::Mutex> lock(m_lock);
- std::map<MessageQueue, kpr::Mutex*>::iterator it = m_mqLockTable.find(mq);
- kpr::Mutex* objLock;
- if (it == m_mqLockTable.end())
- {
- objLock = new kpr::Mutex();
- m_mqLockTable[mq] = objLock;
- }
- else
- {
- objLock = it->second;
- }
-
- return objLock;
- }
-
- private:
- std::map<MessageQueue, kpr::Mutex*> m_mqLockTable;
- kpr::Mutex m_lock;
- };
-}
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/ProcessQueue.cpp b/rocketmq-client4cpp/src/consumer/ProcessQueue.cpp
deleted file mode 100755
index f90e5021..00000000
--- a/rocketmq-client4cpp/src/consumer/ProcessQueue.cpp
+++ /dev/null
@@ -1,445 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "ProcessQueue.h"
-#include "MessageExt.h"
-#include "KPRUtil.h"
-#include "UtilAll.h"
-#include "ScopedLock.h"
-#include "DefaultMQPushConsumer.h"
-#include "DefaultMQPushConsumerImpl.h"
-
-namespace rmq
-{
-
-ProcessQueue::ProcessQueue()
-{
- m_lastPullTimestamp = KPRUtil::GetCurrentTimeMillis();
- m_lastConsumeTimestamp = KPRUtil::GetCurrentTimeMillis();
- m_queueOffsetMax = 0L;
- m_msgCount = 0;
- m_dropped = false;
- m_locked = false;
- m_lastLockTimestamp = KPRUtil::GetCurrentTimeMillis();
- m_consuming = false;
-}
-
-bool ProcessQueue::isLockExpired()
-{
- bool result = (KPRUtil::GetCurrentTimeMillis() - m_lastLockTimestamp) >
- s_RebalanceLockMaxLiveTime;
- return result;
-}
-
-bool ProcessQueue::isPullExpired()
-{
- bool result = (KPRUtil::GetCurrentTimeMillis() - m_lastPullTimestamp) >
- s_PullMaxIdleTime;
- return result;
-}
-
-
-void ProcessQueue::cleanExpiredMsg(DefaultMQPushConsumer* pPushConsumer)
-{
- if (pPushConsumer->getDefaultMQPushConsumerImpl()->isConsumeOrderly())
- {
- return;
- }
-
- long long now = KPRUtil::GetCurrentTimeMillis();
- int loop = m_msgTreeMap.size() < 16 ? m_msgTreeMap.size() : 16;
- for (int i = 0; i < loop; i++)
- {
- MessageExt* msg = NULL;
- try
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_lockTreeMap);
- if (m_msgTreeMap.empty())
- {
- return;
- }
-
- MessageExt* firstMsg = m_msgTreeMap.begin()->second;
- long long startTimestamp = UtilAll::str2ll(firstMsg->getProperty(Message::PROPERTY_CONSUME_START_TIMESTAMP).c_str());
- if (startTimestamp > 0 && (now - startTimestamp) > (pPushConsumer->getConsumeTimeout() * 60 * 1000))
- {
- msg = firstMsg;
- }
- else
- {
- return;
- }
- }
- catch (...)
- {
- RMQ_ERROR("getExpiredMsg exception");
- }
-
- try
- {
- pPushConsumer->sendMessageBack((*msg), 3);
- RMQ_WARN("send expire msg back. topic={%s}, msgId={%s}, storeHost={%s}, queueId={%d}, queueOffset={%lld}",
- msg->getTopic().c_str(), msg->getMsgId().c_str(), msg->getStoreHostString().c_str(),
- msg->getQueueId(), msg->getQueueOffset());
-
- try
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_lockTreeMap);
- if (!m_msgTreeMap.empty() && msg->getQueueOffset() == m_msgTreeMap.begin()->first)
- {
- try
- {
- m_msgTreeMap.erase(m_msgTreeMap.begin());
- m_msgCount -= 1;
- // if free msg, may be coredump
- //delete msg;
- }
- catch (...)
- {
- RMQ_ERROR("send expired msg exception");
- }
- }
-
- }
- catch (...)
- {
- RMQ_ERROR("delExpiredMsg exception");
- }
- }
- catch (...)
- {
- RMQ_ERROR("send expired msg exception");
- }
- }
-}
-
-
-bool ProcessQueue::putMessage(const std::list<MessageExt *> &msgs)
-{
- bool dispathToConsume = false;
-
- try
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_lockTreeMap);
- int validMsgCnt = 0;
- std::list<MessageExt *>::const_iterator it = msgs.begin();
-
- for (; it != msgs.end(); it++)
- {
- MessageExt *msg = (*it);
-
- if (m_msgTreeMap.find(msg->getQueueOffset()) == m_msgTreeMap.end())
- {
- validMsgCnt++;
- m_queueOffsetMax = msg->getQueueOffset();
- }
-
- m_msgTreeMap[msg->getQueueOffset()] = msg;
- }
-
- m_msgCount += validMsgCnt;
-
- if (!m_msgTreeMap.empty() && !m_consuming)
- {
- dispathToConsume = true;
- m_consuming = true;
- }
- }
- catch (...)
- {
- RMQ_ERROR("putMessage exception");
- }
-
- return dispathToConsume;
-}
-
-long long ProcessQueue::getMaxSpan()
-{
- try
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_lockTreeMap);
-
- if (!m_msgTreeMap.empty())
- {
- std::map<long long, MessageExt *>::iterator it1 = m_msgTreeMap.begin();
- std::map<long long, MessageExt *>::iterator it2 = m_msgTreeMap.end();
- it2--;
- return it2->first - it1->first;
- }
- }
- catch (...)
- {
- RMQ_ERROR("getMaxSpan exception");
- }
-
- return 0;
-}
-
-long long ProcessQueue::removeMessage(std::list<MessageExt *> &msgs)
-{
- long long result = -1;
- unsigned long long now = KPRUtil::GetCurrentTimeMillis();
-
- try
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_lockTreeMap);
- m_lastConsumeTimestamp = now;
-
- if (!m_msgTreeMap.empty())
- {
- result = m_queueOffsetMax + 1;
- int removedCnt = 0;
- std::list<MessageExt *>::iterator it = msgs.begin();
-
- for (; it != msgs.end();)
- {
- MessageExt *msg = (*it);
-
- if (m_msgTreeMap.find(msg->getQueueOffset()) != m_msgTreeMap.end())
- {
- removedCnt++;
- }
-
- m_msgTreeMap.erase(msg->getQueueOffset());
- //TODO delete message?
- it = msgs.erase(it);
- delete msg;
- }
-
- m_msgCount -= removedCnt;
-
- if (!m_msgTreeMap.empty())
- {
- std::map<long long, MessageExt *>::iterator it = m_msgTreeMap.begin();
- result = it->first;
- }
- }
- }
- catch (...)
- {
- RMQ_ERROR("removeMessage exception");
- }
-
- return result;
-}
-
-
-void ProcessQueue::clear()
-{
- try
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_lockTreeMap);
- m_msgTreeMap.clear();
- m_msgTreeMapTemp.clear();
- m_msgCount.set(0);
- m_queueOffsetMax = 0;
- }
- catch (...)
- {
- RMQ_ERROR("clear exception");
- }
-
- return;
-}
-
-
-std::map<long long, MessageExt *> ProcessQueue::getMsgTreeMap()
-{
- return m_msgTreeMap;
-}
-
-kpr::AtomicInteger ProcessQueue::getMsgCount()
-{
- return m_msgCount;
-}
-
-bool ProcessQueue::isDropped()
-{
- return m_dropped;
-}
-
-void ProcessQueue::setDropped(bool dropped)
-{
- m_dropped = dropped;
-}
-
-unsigned long long ProcessQueue::getLastPullTimestamp()
-{
- return m_lastPullTimestamp;
-}
-
-
-void ProcessQueue::setLastPullTimestamp(unsigned long long lastPullTimestamp)
-{
- m_lastPullTimestamp = lastPullTimestamp;
-}
-
-
-unsigned long long ProcessQueue::getLastConsumeTimestamp()
-{
- return m_lastConsumeTimestamp;
-}
-
-
-void ProcessQueue::setLastConsumeTimestamp(unsigned long long
- lastConsumeTimestamp)
-{
- m_lastConsumeTimestamp = lastConsumeTimestamp;
-}
-
-
-/**
-* ========================================================================
-*/
-kpr::Mutex &ProcessQueue::getLockConsume()
-{
- return m_lockConsume;
-}
-
-void ProcessQueue::setLocked(bool locked)
-{
- m_locked = locked;
-}
-
-bool ProcessQueue::isLocked()
-{
- return m_locked;
-}
-
-long long ProcessQueue::getTryUnlockTimes()
-{
- return m_tryUnlockTimes.get();
-}
-
-void ProcessQueue::incTryUnlockTimes()
-{
- m_tryUnlockTimes++;
-}
-
-
-void ProcessQueue::rollback()
-{
- try
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_lockTreeMap);
- m_msgTreeMap = m_msgTreeMapTemp;
- m_msgTreeMapTemp.clear();
- }
- catch (...)
- {
- RMQ_ERROR("rollback exception");
- }
-}
-
-long long ProcessQueue::commit()
-{
- try
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_lockTreeMap);
-
- if (!m_msgTreeMapTemp.empty())
- {
- std::map<long long, MessageExt *>::iterator it = m_msgTreeMapTemp.end();
- it--;
- long long offset = it->first;
- m_msgCount -= m_msgTreeMapTemp.size();
- m_msgTreeMapTemp.clear();
- return offset + 1;
- }
- }
- catch (...)
- {
- RMQ_ERROR("commit exception");
- }
-
- return -1;
-}
-
-void ProcessQueue::makeMessageToCosumeAgain(const std::list<MessageExt *> &msgs)
-{
- try
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_lockTreeMap);
- std::list<MessageExt *>::const_iterator it = msgs.begin();
-
- for (; it != msgs.end(); it++)
- {
- MessageExt *msg = (*it);
- m_msgTreeMapTemp.erase(msg->getQueueOffset());
- m_msgTreeMap[msg->getQueueOffset()] = msg;
- }
- }
- catch (...)
- {
- RMQ_ERROR("makeMessageToCosumeAgain exception");
- }
-}
-
-std::list<MessageExt *> ProcessQueue::takeMessages(int batchSize)
-{
- std::list<MessageExt *> result;
- unsigned long long now = KPRUtil::GetCurrentTimeMillis();
-
- try
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_lockTreeMap);
- m_lastConsumeTimestamp = now;
-
- if (!m_msgTreeMap.empty())
- {
- for (int i = 0; i < batchSize; i++)
- {
- std::map<long long, MessageExt *>::iterator it = m_msgTreeMap.begin();
-
- if (it != m_msgTreeMap.end())
- {
- result.push_back(it->second);
- m_msgTreeMapTemp[it->first] = it->second;
- m_msgTreeMap.erase(it);
- }
- else
- {
- break;
- }
- }
-
- if (result.empty())
- {
- m_consuming = false;
- }
- }
- }
- catch (...)
- {
- RMQ_ERROR("takeMessags exception");
- }
-
- return result;
-}
-
-long long ProcessQueue::getLastLockTimestamp()
-{
- return m_lastLockTimestamp;
-}
-
-void ProcessQueue::setLastLockTimestamp(long long lastLockTimestamp)
-{
- m_lastLockTimestamp = lastLockTimestamp;
-}
-
-
-}
-
diff --git a/rocketmq-client4cpp/src/consumer/ProcessQueue.h b/rocketmq-client4cpp/src/consumer/ProcessQueue.h
deleted file mode 100755
index 559dd7f9..00000000
--- a/rocketmq-client4cpp/src/consumer/ProcessQueue.h
+++ /dev/null
@@ -1,102 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __PROCESSQUEUE_H__
-#define __PROCESSQUEUE_H__
-
-#include <list>
-#include <map>
-#include "Mutex.h"
-#include "AtomicValue.h"
-
-namespace rmq
-{
- class MessageExt;
- class DefaultMQPushConsumer;
-
- class ProcessQueue
- {
- public:
- static const unsigned int s_RebalanceLockMaxLiveTime = 30000;
- static const unsigned int s_RebalanceLockInterval = 20000;
- static const unsigned int s_PullMaxIdleTime = 120000;
-
- public:
- ProcessQueue();
-
- bool isLockExpired();
- bool isPullExpired();
-
- void cleanExpiredMsg(DefaultMQPushConsumer* pPushConsumer);
- bool putMessage(const std::list<MessageExt*>& msgs);
-
- long long getMaxSpan();
- long long removeMessage(std::list<MessageExt*>& msgs);
-
- void clear();
-
- std::map<long long, MessageExt*> getMsgTreeMap();
- kpr::AtomicInteger getMsgCount();
- bool isDropped();
- void setDropped(bool dropped);
-
- unsigned long long getLastPullTimestamp();
- void setLastPullTimestamp(unsigned long long lastPullTimestamp);
-
- unsigned long long getLastConsumeTimestamp();
- void setLastConsumeTimestamp(unsigned long long lastConsumeTimestamp);
-
- /**
- * ========================================================================
- */
- kpr::Mutex& getLockConsume();
- void setLocked(bool locked);
- bool isLocked();
- long long getTryUnlockTimes();
- void incTryUnlockTimes();
-
- void rollback();
- long long commit();
- void makeMessageToCosumeAgain(const std::list<MessageExt*>& msgs);
-
- std::list<MessageExt*> takeMessages(int batchSize);
-
- long long getLastLockTimestamp();
- void setLastLockTimestamp(long long lastLockTimestamp);
-
-
- private:
- kpr::RWMutex m_lockTreeMap;
- std::map<long long, MessageExt*> m_msgTreeMap;
- volatile long long m_queueOffsetMax ;
- kpr::AtomicInteger m_msgCount;
- volatile bool m_dropped;
- volatile unsigned long long m_lastPullTimestamp;
- volatile unsigned long long m_lastConsumeTimestamp;
-
- /**
- * order message
- */
- kpr::Mutex m_lockConsume;
- volatile bool m_locked;
- volatile unsigned long long m_lastLockTimestamp;
- volatile bool m_consuming;
- std::map<long long, MessageExt*> m_msgTreeMapTemp;
- kpr::AtomicInteger m_tryUnlockTimes;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/PullAPIWrapper.cpp b/rocketmq-client4cpp/src/consumer/PullAPIWrapper.cpp
deleted file mode 100755
index c520e4ca..00000000
--- a/rocketmq-client4cpp/src/consumer/PullAPIWrapper.cpp
+++ /dev/null
@@ -1,222 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "PullAPIWrapper.h"
-
-#include <stdlib.h>
-#include <list>
-#include <set>
-#include "ScopedLock.h"
-#include "MQClientFactory.h"
-#include "PullCallback.h"
-#include "MixAll.h"
-#include "PullSysFlag.h"
-#include "CommandCustomHeader.h"
-#include "MQClientAPIImpl.h"
-#include "MQClientException.h"
-#include "SubscriptionData.h"
-#include "UtilAll.h"
-#include "MessageExt.h"
-#include "PullResultExt.h"
-#include "MessageDecoder.h"
-#include "VirtualEnvUtil.h"
-
-namespace rmq
-{
-
-PullAPIWrapper::PullAPIWrapper(MQClientFactory* pMQClientFactory, const std::string& consumerGroup)
-{
- m_pMQClientFactory = pMQClientFactory;
- m_consumerGroup = consumerGroup;
-}
-
-void PullAPIWrapper::updatePullFromWhichNode(MessageQueue& mq, long brokerId)
-{
- std::map<MessageQueue, kpr::AtomicInteger>::iterator it;
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_pullFromWhichNodeTableLock);
- it = m_pullFromWhichNodeTable.find(mq);
- if (it != m_pullFromWhichNodeTable.end())
- {
- it->second.set(brokerId);
- return;
- }
- }
-
- kpr::ScopedWLock<kpr::RWMutex> lock(m_pullFromWhichNodeTableLock);
- m_pullFromWhichNodeTable[mq] = kpr::AtomicInteger(brokerId);
-}
-
-PullResult* PullAPIWrapper::processPullResult(MessageQueue& mq,
- PullResult& pullResult,
- SubscriptionData& subscriptionData)
-{
- std::string projectGroupPrefix = m_pMQClientFactory->getMQClientAPIImpl()->getProjectGroupPrefix();
- PullResultExt& pullResultExt = (PullResultExt&) pullResult;
-
- updatePullFromWhichNode(mq, pullResultExt.suggestWhichBrokerId);
-
- if (pullResult.pullStatus == FOUND)
- {
- std::list<MessageExt*> msgList =
- MessageDecoder::decodes(pullResultExt.messageBinary, pullResultExt.messageBinaryLen);
-
- std::list<MessageExt*> msgListFilterAgain;
-
- if (!subscriptionData.getTagsSet().empty())
- {
- std::list<MessageExt*>::iterator it = msgList.begin();
- for (; it != msgList.end();)
- {
- MessageExt* msg = *it;
- if (!msg->getTags().empty())
- {
- std::set<std::string>& tags = subscriptionData.getTagsSet();
- if (tags.find(msg->getTags()) != tags.end())
- {
- msgListFilterAgain.push_back(msg);
- it = msgList.erase(it);
- }
- else
- {
- it++;
- }
- }
- }
- }
- else
- {
- msgListFilterAgain.assign(msgList.begin(), msgList.end());
- msgList.clear();
- }
-
- if (!UtilAll::isBlank(projectGroupPrefix))
- {
- subscriptionData.setTopic(VirtualEnvUtil::clearProjectGroup(subscriptionData.getTopic(),
- projectGroupPrefix));
- mq.setTopic(VirtualEnvUtil::clearProjectGroup(mq.getTopic(), projectGroupPrefix));
-
- std::list<MessageExt*>::iterator it = msgListFilterAgain.begin();
- for (; it != msgListFilterAgain.end(); it++)
- {
- MessageExt* msg = *it;
- msg->setTopic(VirtualEnvUtil::clearProjectGroup(msg->getTopic(), projectGroupPrefix));
-
- msg->putProperty(Message::PROPERTY_MIN_OFFSET, UtilAll::toString(pullResult.minOffset));
- msg->putProperty(Message::PROPERTY_MAX_OFFSET, UtilAll::toString(pullResult.maxOffset));
- }
- }
- else
- {
- std::list<MessageExt*>::iterator it = msgListFilterAgain.begin();
- for (; it != msgListFilterAgain.end(); it++)
- {
- MessageExt* msg = *it;
-
- msg->putProperty(Message::PROPERTY_MIN_OFFSET, UtilAll::toString(pullResult.minOffset));
- msg->putProperty(Message::PROPERTY_MAX_OFFSET, UtilAll::toString(pullResult.maxOffset));
- }
- }
-
- std::list<MessageExt*>::iterator it = msgListFilterAgain.begin();
- for (; it != msgListFilterAgain.end(); it++)
- {
- pullResultExt.msgFoundList.push_back(*it);
- }
-
- it = msgList.begin();
- for (; it != msgList.end(); it++)
- {
- delete *it;
- }
-
- delete[] pullResultExt.messageBinary;
- pullResultExt.messageBinary = NULL;
- pullResultExt.messageBinaryLen = 0;
- }
-
- return &pullResult;
-}
-
-long PullAPIWrapper::recalculatePullFromWhichNode(MessageQueue& mq)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_pullFromWhichNodeTableLock);
- std::map<MessageQueue, kpr::AtomicInteger>::iterator it = m_pullFromWhichNodeTable.find(mq);
- if (it != m_pullFromWhichNodeTable.end())
- {
- return it->second.get();
- }
-
- return MixAll::MASTER_ID;
-}
-
-PullResult* PullAPIWrapper::pullKernelImpl(MessageQueue& mq,
- const std::string& subExpression,
- long long subVersion,
- long long offset,
- int maxNums,
- int sysFlag,
- long long commitOffset,
- long long brokerSuspendMaxTimeMillis,
- int timeoutMillis,
- CommunicationMode communicationMode,
- PullCallback* pPullCallback)
-{
- FindBrokerResult findBrokerResult =
- m_pMQClientFactory->findBrokerAddressInSubscribe(mq.getBrokerName(),
- recalculatePullFromWhichNode(mq), false);
- if (findBrokerResult.brokerAddr.empty())
- {
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic());
- findBrokerResult = m_pMQClientFactory->findBrokerAddressInSubscribe(mq.getBrokerName(),
- recalculatePullFromWhichNode(mq), false);
- }
-
- if (!findBrokerResult.brokerAddr.empty())
- {
- int sysFlagInner = sysFlag;
-
- if (findBrokerResult.slave)
- {
- sysFlagInner = PullSysFlag::clearCommitOffsetFlag(sysFlagInner);
- }
-
- PullMessageRequestHeader* requestHeader = new PullMessageRequestHeader();
- requestHeader->consumerGroup = m_consumerGroup;
- requestHeader->topic = mq.getTopic();
- requestHeader->queueId = mq.getQueueId();
- requestHeader->queueOffset = offset;
- requestHeader->maxMsgNums = maxNums;
- requestHeader->sysFlag = sysFlagInner;
- requestHeader->commitOffset = commitOffset;
- requestHeader->suspendTimeoutMillis = brokerSuspendMaxTimeMillis;
- requestHeader->subscription = subExpression;
- requestHeader->subVersion = subVersion;
-
- PullResult* pullResult = m_pMQClientFactory->getMQClientAPIImpl()->pullMessage(//
- findBrokerResult.brokerAddr,//
- requestHeader,//
- timeoutMillis,//
- communicationMode,//
- pPullCallback);
-
- return pullResult;
- }
-
- THROW_MQEXCEPTION(MQClientException, "The broker[" + mq.getBrokerName() + "] not exist", -1);
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/PullAPIWrapper.h b/rocketmq-client4cpp/src/consumer/PullAPIWrapper.h
deleted file mode 100755
index d5ec7874..00000000
--- a/rocketmq-client4cpp/src/consumer/PullAPIWrapper.h
+++ /dev/null
@@ -1,67 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __PULLAPIWRAPPER_H__
-#define __PULLAPIWRAPPER_H__
-
-#include <string>
-#include <map>
-
-#include "AtomicValue.h"
-#include "PullResult.h"
-#include "MessageQueue.h"
-#include "CommunicationMode.h"
-#include "Mutex.h"
-
-namespace rmq
-{
- class MQClientFactory;
- class PullCallback;
- class SubscriptionData;
-
- class PullAPIWrapper
- {
- public:
- PullAPIWrapper(MQClientFactory* pMQClientFactory, const std::string& consumerGroup);
- void updatePullFromWhichNode(MessageQueue& mq, long brokerId);
-
-
- PullResult* processPullResult(MessageQueue& mq,
- PullResult& pullResult,
- SubscriptionData& subscriptionData);
- long recalculatePullFromWhichNode(MessageQueue& mq);
-
- PullResult* pullKernelImpl(MessageQueue& mq,
- const std::string& subExpression,
- long long subVersion,
- long long offset,
- int maxNums,
- int sysFlag,
- long long commitOffset,
- long long brokerSuspendMaxTimeMillis,
- int timeoutMillis,
- CommunicationMode communicationMode,
- PullCallback* pPullCallback);
-
- private:
- std::map<MessageQueue, kpr::AtomicInteger> m_pullFromWhichNodeTable;
- kpr::RWMutex m_pullFromWhichNodeTableLock;
- MQClientFactory* m_pMQClientFactory;
- std::string m_consumerGroup;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/PullMessageService.cpp b/rocketmq-client4cpp/src/consumer/PullMessageService.cpp
deleted file mode 100755
index 6d9972e4..00000000
--- a/rocketmq-client4cpp/src/consumer/PullMessageService.cpp
+++ /dev/null
@@ -1,171 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "PullMessageService.h"
-#include <list>
-#include "MQClientFactory.h"
-#include "MQConsumerInner.h"
-#include "PullRequest.h"
-#include "DefaultMQPushConsumerImpl.h"
-#include "ScopedLock.h"
-
-namespace rmq
-{
-
-class SubmitPullRequestLater : public kpr::TimerHandler
-{
-public:
- SubmitPullRequestLater(PullMessageService* pService, PullRequest* pPullRequest)
- : m_pService(pService), m_pPullRequest(pPullRequest)
- {
-
- }
-
- void OnTimeOut(unsigned int timerID)
- {
- try
- {
- m_pService->executePullRequestImmediately(m_pPullRequest);
- }
- catch(...)
- {
- RMQ_ERROR("SubmitPullRequestLater OnTimeOut exception");
- }
-
- delete this;
- }
-
-private:
- PullMessageService* m_pService;
- PullRequest* m_pPullRequest;
-};
-
-
-PullMessageService::PullMessageService(MQClientFactory* pMQClientFactory)
- : ServiceThread("PullMessageService"),
- m_pMQClientFactory(pMQClientFactory)
-{
- m_TimerThread = new kpr::TimerThread("PullMessageService-timer", 10);
- m_TimerThread->Start();
-}
-
-
-PullMessageService::~PullMessageService()
-{
-
-}
-
-
-void PullMessageService::executePullRequestLater(PullRequest* pPullRequest, long timeDelay)
-{
- SubmitPullRequestLater* pHandler = new SubmitPullRequestLater(this, pPullRequest);
- m_TimerThread->RegisterTimer(0, timeDelay, pHandler, false);
-}
-
-
-void PullMessageService::executeTaskLater(kpr::TimerHandler* pHandler, long timeDelay)
-{
- m_TimerThread->RegisterTimer(0, timeDelay, pHandler, false);
-}
-
-
-void PullMessageService::executePullRequestImmediately(PullRequest* pPullRequest)
-{
- try
- {
- {
- kpr::ScopedLock<kpr::Mutex> lock(m_lock);
- m_pullRequestQueue.push_back(pPullRequest);
- }
-
- wakeup();
- }
- catch (...)
- {
- RMQ_ERROR("executePullRequestImmediately pullRequestQueue.push");
- }
-}
-
-void PullMessageService::Run()
-{
- RMQ_INFO("%s service started", getServiceName().c_str());
-
- while (!m_stoped)
- {
- try
- {
- bool wait = false;
- {
- kpr::ScopedLock<kpr::Mutex> lock(m_lock);
- if (m_pullRequestQueue.empty())
- {
- wait = true;
- }
- }
-
- if (wait)
- {
- waitForRunning(5000);
- }
-
- PullRequest* pullRequest = NULL;
- {
- kpr::ScopedLock<kpr::Mutex> lock(m_lock);
- if (!m_pullRequestQueue.empty())
- {
- pullRequest = m_pullRequestQueue.front();
- m_pullRequestQueue.pop_front();
- }
- }
-
- if (pullRequest != NULL)
- {
- pullMessage(pullRequest);
- }
- }
- catch (...)
- {
- RMQ_ERROR("Pull Message Service Run Method exception");
- }
- }
-
- m_TimerThread->Stop();
- m_TimerThread->Join();
-
- RMQ_INFO("%s service end", getServiceName().c_str());
-}
-
-std::string PullMessageService::getServiceName()
-{
- return "PullMessageService";
-}
-
-
-void PullMessageService::pullMessage(PullRequest* pPullRequest)
-{
- MQConsumerInner* consumer = m_pMQClientFactory->selectConsumer(pPullRequest->getConsumerGroup());
- if (consumer != NULL)
- {
- DefaultMQPushConsumerImpl* impl = (DefaultMQPushConsumerImpl*) consumer;
- impl->pullMessage(pPullRequest);
- }
- else
- {
- RMQ_WARN("No matched consumer for the PullRequest {%s}, drop it", pPullRequest->toString().c_str());
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/PullMessageService.h b/rocketmq-client4cpp/src/consumer/PullMessageService.h
deleted file mode 100755
index d6ebceec..00000000
--- a/rocketmq-client4cpp/src/consumer/PullMessageService.h
+++ /dev/null
@@ -1,56 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __PULLMESSAGESERVICE_H__
-#define __PULLMESSAGESERVICE_H__
-
-#include <list>
-#include "RocketMQClient.h"
-#include "ServiceThread.h"
-#include "TimerThread.h"
-#include "PullRequest.h"
-
-namespace rmq
-{
- class MQClientFactory;
- class MQConsumerInner;
- class PullRequest;
-
- class PullMessageService : public ServiceThread
- {
- public:
- PullMessageService(MQClientFactory* pMQClientFactory);
- ~PullMessageService();
-
- void executePullRequestLater(PullRequest* pPullRequest, long timeDelay);
- void executeTaskLater(kpr::TimerHandler* pHandler, long timeDelay);
-
- void executePullRequestImmediately(PullRequest* pPullRequest);
- std::string getServiceName();
-
- void Run();
- private:
- void pullMessage(PullRequest* pPullRequest);
-
- private:
- std::list<PullRequest*> m_pullRequestQueue;
- kpr::Mutex m_lock;
- MQClientFactory* m_pMQClientFactory;
- kpr::TimerThreadPtr m_TimerThread;
- };
- typedef kpr::RefHandleT<PullMessageService> PullMessageServicePtr;
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/PullRequest.cpp b/rocketmq-client4cpp/src/consumer/PullRequest.cpp
deleted file mode 100755
index b8650c64..00000000
--- a/rocketmq-client4cpp/src/consumer/PullRequest.cpp
+++ /dev/null
@@ -1,108 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "PullRequest.h"
-#include "UtilAll.h"
-
-namespace rmq
-{
-
-PullRequest::~PullRequest()
-{
-
-}
-
-std::string PullRequest::getConsumerGroup()
-{
- return m_consumerGroup;
-}
-
-void PullRequest::setConsumerGroup(const std::string& consumerGroup)
-{
- m_consumerGroup = consumerGroup;
-}
-
-MessageQueue& PullRequest::getMessageQueue()
-{
- return m_messageQueue;
-}
-
-void PullRequest::setMessageQueue(const MessageQueue& messageQueue)
-{
- m_messageQueue = messageQueue;
-}
-
-long long PullRequest::getNextOffset()
-{
- return m_nextOffset;
-}
-
-void PullRequest::setNextOffset(long long nextOffset)
-{
- m_nextOffset = nextOffset;
-}
-
-int PullRequest::hashCode()
-{
- /*
- final int prime = 31;
- int result = 1;
- result = prime * result + ((consumerGroup == null) ? 0 : consumerGroup.hashCode());
- result = prime * result + ((messageQueue == null) ? 0 : messageQueue.hashCode());
- return result;
- */
- std::stringstream ss;
- ss << m_consumerGroup
- << m_messageQueue.hashCode();
- return UtilAll::hashCode(ss.str());
-}
-
-std::string PullRequest::toString() const
-{
- std::stringstream ss;
- ss << "{consumerGroup=" << m_consumerGroup
- << ",messageQueue=" << m_messageQueue.toString()
- << ",nextOffset=" << m_nextOffset << "}";
- return ss.str();
-}
-
-
-bool PullRequest::operator==(const PullRequest& other)
-{
- if (m_consumerGroup != other.m_consumerGroup)
- {
- return false;
- }
-
- if (!(m_messageQueue == other.m_messageQueue))
- {
- return false;
- }
-
- return true;
-}
-
-ProcessQueue* PullRequest::getProcessQueue()
-{
- return m_pProcessQueue;
-}
-
-void PullRequest::setProcessQueue(ProcessQueue* pProcessQueue)
-{
- m_pProcessQueue = pProcessQueue;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/PullRequest.h b/rocketmq-client4cpp/src/consumer/PullRequest.h
deleted file mode 100755
index 3fb83676..00000000
--- a/rocketmq-client4cpp/src/consumer/PullRequest.h
+++ /dev/null
@@ -1,59 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __PULLREQUEST_H__
-#define __PULLREQUEST_H__
-
-#include <string>
-#include <sstream>
-
-#include "MessageQueue.h"
-#include "ProcessQueue.h"
-
-namespace rmq
-{
- class PullRequest
- {
- public:
- virtual ~PullRequest();
-
- std::string getConsumerGroup();
- void setConsumerGroup(const std::string& consumerGroup);
-
- MessageQueue& getMessageQueue();
- void setMessageQueue(const MessageQueue& messageQueue);
-
- long long getNextOffset();
- void setNextOffset(long long nextOffset);
-
- int hashCode();
- std::string toString() const;
-
- bool operator==(const PullRequest& other);
-
- ProcessQueue* getProcessQueue();
- void setProcessQueue(ProcessQueue* pProcessQueue);
-
- private:
- std::string m_consumerGroup;
- MessageQueue m_messageQueue;
-
- ProcessQueue* m_pProcessQueue;
- long long m_nextOffset;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/PullResultExt.h b/rocketmq-client4cpp/src/consumer/PullResultExt.h
deleted file mode 100755
index 24235b2c..00000000
--- a/rocketmq-client4cpp/src/consumer/PullResultExt.h
+++ /dev/null
@@ -1,53 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __PULLRESULTEXT_H__
-#define __PULLRESULTEXT_H__
-
-#include "PullResult.h"
-
-namespace rmq
-{
-
- struct PullResultExt : public PullResult
- {
- PullResultExt(PullStatus pullStatus,
- long long nextBeginOffset,
- long long minOffset,
- long long maxOffset,
- std::list<MessageExt*>& msgFoundList,
- long suggestWhichBrokerId,
- const char* messageBinary,
- int messageBinaryLen)
- : PullResult(pullStatus,
- nextBeginOffset,
- minOffset,
- maxOffset,
- msgFoundList),
- suggestWhichBrokerId(suggestWhichBrokerId),
- messageBinary(messageBinary),
- messageBinaryLen(messageBinaryLen)
- {
-
- }
-
- long suggestWhichBrokerId;
- const char* messageBinary;
- int messageBinaryLen;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/RebalanceImpl.cpp b/rocketmq-client4cpp/src/consumer/RebalanceImpl.cpp
deleted file mode 100755
index efdc1cc3..00000000
--- a/rocketmq-client4cpp/src/consumer/RebalanceImpl.cpp
+++ /dev/null
@@ -1,613 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "RebalanceImpl.h"
-#include "AllocateMessageQueueStrategy.h"
-#include "MQClientFactory.h"
-#include "MixAll.h"
-#include "LockBatchBody.h"
-#include "MQClientAPIImpl.h"
-#include "KPRUtil.h"
-#include "ScopedLock.h"
-
-namespace rmq
-{
-
-RebalanceImpl::RebalanceImpl(const std::string& consumerGroup,
- MessageModel messageModel,
- AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy,
- MQClientFactory* pMQClientFactory)
- : m_consumerGroup(consumerGroup),
- m_messageModel(messageModel),
- m_pAllocateMessageQueueStrategy(pAllocateMessageQueueStrategy),
- m_pMQClientFactory(pMQClientFactory)
-{
-
-}
-
-RebalanceImpl::~RebalanceImpl()
-{
-}
-
-void RebalanceImpl::unlock(MessageQueue& mq, bool oneway)
-{
- FindBrokerResult findBrokerResult =
- m_pMQClientFactory->findBrokerAddressInSubscribe(mq.getBrokerName(), MixAll::MASTER_ID, true);
- if (!findBrokerResult.brokerAddr.empty())
- {
- UnlockBatchRequestBody* requestBody = new UnlockBatchRequestBody();
- requestBody->setConsumerGroup(m_consumerGroup);
- requestBody->setClientId(m_pMQClientFactory->getClientId());
- requestBody->getMqSet().insert(mq);
-
- try
- {
- m_pMQClientFactory->getMQClientAPIImpl()->unlockBatchMQ(findBrokerResult.brokerAddr,
- requestBody, 1000, oneway);
- }
- catch (...)
- {
- RMQ_ERROR("unlockBatchMQ exception, MQ: {%s}" , mq.toString().c_str());
- }
- }
-}
-
-void RebalanceImpl::unlockAll(bool oneway)
-{
- std::map<std::string, std::set<MessageQueue> > brokerMqs = buildProcessQueueTableByBrokerName();
- std::map<std::string, std::set<MessageQueue> >::iterator it = brokerMqs.begin();
-
- for (; it != brokerMqs.end(); it++)
- {
- std::string brokerName = it->first;
- std::set<MessageQueue> mqs = it->second;
-
- if (mqs.empty())
- {
- continue;
- }
-
- FindBrokerResult findBrokerResult =
- m_pMQClientFactory->findBrokerAddressInSubscribe(brokerName, MixAll::MASTER_ID, true);
-
- if (!findBrokerResult.brokerAddr.empty())
- {
- UnlockBatchRequestBody* requestBody = new UnlockBatchRequestBody();
- requestBody->setConsumerGroup(m_consumerGroup);
- requestBody->setClientId(m_pMQClientFactory->getClientId());
- requestBody->setMqSet(mqs);
-
- try
- {
- m_pMQClientFactory->getMQClientAPIImpl()->unlockBatchMQ(findBrokerResult.brokerAddr,
- requestBody, 1000, oneway);
-
- kpr::ScopedRLock<kpr::RWMutex> lock(m_processQueueTableLock);
- std::set<MessageQueue>::iterator itm = mqs.begin();
- for (; itm != mqs.end(); itm++)
- {
- std::map<MessageQueue, ProcessQueue*>::iterator itp = m_processQueueTable.find(*itm);
- if (itp != m_processQueueTable.end())
- {
- itp->second->setLocked(false);
- RMQ_INFO("the message queue unlock OK, Group: {%s}, MQ: {%s}",
- m_consumerGroup.c_str(), (*itm).toString().c_str());
- }
- }
- }
- catch (...)
- {
- RMQ_ERROR("unlockBatchMQ exception, mqs.size: {%u} ", (unsigned)mqs.size());
- }
- }
- }
-}
-
-bool RebalanceImpl::lock(MessageQueue& mq)
-{
- FindBrokerResult findBrokerResult =
- m_pMQClientFactory->findBrokerAddressInSubscribe(mq.getBrokerName(), MixAll::MASTER_ID, true);
- if (!findBrokerResult.brokerAddr.empty())
- {
- LockBatchRequestBody* requestBody = new LockBatchRequestBody();
- requestBody->setConsumerGroup(m_consumerGroup);
- requestBody->setClientId(m_pMQClientFactory->getClientId());
- requestBody->getMqSet().insert(mq);
-
- try
- {
- std::set<MessageQueue> lockedMq =
- m_pMQClientFactory->getMQClientAPIImpl()->lockBatchMQ(
- findBrokerResult.brokerAddr, requestBody, 1000);
-
- std::set<MessageQueue>::iterator it = lockedMq.begin();
- for (; it != lockedMq.end(); it++)
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_processQueueTableLock);
- MessageQueue mmqq = *it;
- std::map<MessageQueue, ProcessQueue*>::iterator itt = m_processQueueTable.find(mmqq);
- if (itt != m_processQueueTable.end())
- {
- itt->second->setLocked(true);
- itt->second->setLastLockTimestamp(KPRUtil::GetCurrentTimeMillis());
- }
- }
-
- it = lockedMq.find(mq);
- bool lockOK = (it != lockedMq.end());
-
- RMQ_INFO("the message queue lock {%s}, {%s}, {%s}",//
- (lockOK ? "OK" : "Failed"), //
- m_consumerGroup.c_str(), //
- mq.toString().c_str());
- return lockOK;
- }
- catch (...)
- {
- RMQ_ERROR("lockBatchMQ exception, MQ: {%s}", mq.toString().c_str());
- }
- }
-
- return false;
-}
-
-void RebalanceImpl::lockAll()
-{
- std::map<std::string, std::set<MessageQueue> > brokerMqs = buildProcessQueueTableByBrokerName();
-
- std::map<std::string, std::set<MessageQueue> >::iterator it = brokerMqs.begin();
- for (; it != brokerMqs.end(); it++)
- {
- std::string brokerName = it->first;
- std::set<MessageQueue> mqs = it->second;
-
- if (mqs.empty())
- {
- continue;
- }
-
- FindBrokerResult findBrokerResult =
- m_pMQClientFactory->findBrokerAddressInSubscribe(brokerName, MixAll::MASTER_ID, true);
- if (!findBrokerResult.brokerAddr.empty())
- {
- LockBatchRequestBody* requestBody = new LockBatchRequestBody();
- requestBody->setConsumerGroup(m_consumerGroup);
- requestBody->setClientId(m_pMQClientFactory->getClientId());
- requestBody->setMqSet(mqs);
-
- try
- {
- std::set<MessageQueue> lockOKMQSet =
- m_pMQClientFactory->getMQClientAPIImpl()->lockBatchMQ(
- findBrokerResult.brokerAddr, requestBody, 1000);
-
- std::set<MessageQueue>::iterator its = lockOKMQSet.begin();
- for (; its != lockOKMQSet.end(); its++)
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_processQueueTableLock);
- MessageQueue mq = *its;
- std::map<MessageQueue, ProcessQueue*>::iterator itt = m_processQueueTable.find(mq);
- if (itt != m_processQueueTable.end())
- {
- ProcessQueue* processQueue = itt->second;
- if (!processQueue->isLocked())
- {
- RMQ_INFO("the message queue locked OK, Group: {%s}, MQ: %s",
- m_consumerGroup.c_str(),
- mq.toString().c_str());
- }
-
- processQueue->setLocked(true);
- processQueue->setLastLockTimestamp(KPRUtil::GetCurrentTimeMillis());
- }
- }
-
- its = mqs.begin();
- for (; its != mqs.end(); its++)
- {
- MessageQueue mq = *its;
- std::set<MessageQueue>::iterator itf = lockOKMQSet.find(mq);
- if (itf == lockOKMQSet.end())
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_processQueueTableLock);
- std::map<MessageQueue, ProcessQueue*>::iterator itt = m_processQueueTable.find(mq);
- if (itt != m_processQueueTable.end())
- {
- itt->second->setLocked(false);
- RMQ_WARN("the message queue locked Failed, Group: {%s}, MQ: %s",
- m_consumerGroup.c_str(),
- mq.toString().c_str());
- }
- }
- }
- }
- catch (std::exception& e)
- {
- RMQ_ERROR("lockBatchMQ exception: %s", e.what());
- }
- }
- }
-}
-
-void RebalanceImpl::doRebalance()
-{
- std::map<std::string, SubscriptionData> subTable = getSubscriptionInner();
- std::map<std::string, SubscriptionData>::iterator it = subTable.begin();
- for (; it != subTable.end(); it++)
- {
- std::string topic = it->first;
- try
- {
- rebalanceByTopic(topic);
- }
- catch (std::exception& e)
- {
- if (topic.find(MixAll::RETRY_GROUP_TOPIC_PREFIX) != 0)
- {
- RMQ_WARN("rebalanceByTopic Exception: %s", e.what());
- }
- }
- }
-
- truncateMessageQueueNotMyTopic();
-}
-
-std::map<std::string, SubscriptionData>& RebalanceImpl::getSubscriptionInner()
-{
- return m_subscriptionInner;
-}
-
-std::map<MessageQueue, ProcessQueue*>& RebalanceImpl::getProcessQueueTable()
-{
- return m_processQueueTable;
-}
-
-
-kpr::RWMutex& RebalanceImpl::getProcessQueueTableLock()
-{
- return m_processQueueTableLock;
-}
-
-
-std::map<std::string, std::set<MessageQueue> >& RebalanceImpl::getTopicSubscribeInfoTable()
-{
- return m_topicSubscribeInfoTable;
-}
-
-std::string& RebalanceImpl::getConsumerGroup()
-{
- return m_consumerGroup;
-}
-
-void RebalanceImpl::setConsumerGroup(const std::string& consumerGroup)
-{
- m_consumerGroup = consumerGroup;
-}
-
-MessageModel RebalanceImpl::getMessageModel()
-{
- return m_messageModel;
-}
-
-void RebalanceImpl::setMessageModel(MessageModel messageModel)
-{
- m_messageModel = messageModel;
-}
-
-AllocateMessageQueueStrategy* RebalanceImpl::getAllocateMessageQueueStrategy()
-{
- return m_pAllocateMessageQueueStrategy;
-}
-
-void RebalanceImpl::setAllocateMessageQueueStrategy(AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy)
-{
- m_pAllocateMessageQueueStrategy = pAllocateMessageQueueStrategy;
-}
-
-MQClientFactory* RebalanceImpl::getmQClientFactory()
-{
- return m_pMQClientFactory;
-}
-
-void RebalanceImpl::setmQClientFactory(MQClientFactory* pMQClientFactory)
-{
- m_pMQClientFactory = pMQClientFactory;
-}
-
-std::map<std::string, std::set<MessageQueue> > RebalanceImpl::buildProcessQueueTableByBrokerName()
-{
- std::map<std::string, std::set<MessageQueue> > result ;
- kpr::ScopedRLock<kpr::RWMutex> lock(m_processQueueTableLock);
- std::map<MessageQueue, ProcessQueue*>::iterator it = m_processQueueTable.begin();
- for (; it != m_processQueueTable.end();)
- {
- MessageQueue mq = it->first;
- std::map<std::string, std::set<MessageQueue> >::iterator itm = result.find(mq.getBrokerName());
- if (itm == result.end())
- {
- std::set<MessageQueue> mqs ;
- mqs.insert(mq);
- result[mq.getBrokerName()] = mqs;
- }
- else
- {
- itm->second.insert(mq);
- }
- }
-
- return result;
-}
-
-void RebalanceImpl::rebalanceByTopic(const std::string& topic)
-{
- RMQ_DEBUG("rebalanceByTopic begin, topic={%s}", topic.c_str());
- switch (m_messageModel)
- {
- case BROADCASTING:
- {
- //kpr::ScopedLock<kpr::Mutex> lock(m_topicSubscribeInfoTableLock);
- std::map<std::string, std::set<MessageQueue> >::iterator it = m_topicSubscribeInfoTable.find(topic);
- if (it != m_topicSubscribeInfoTable.end())
- {
- std::set<MessageQueue> mqSet = it->second;
- bool changed = updateProcessQueueTableInRebalance(topic, mqSet);
- if (changed)
- {
- messageQueueChanged(topic, mqSet, mqSet);
- RMQ_INFO("messageQueueChanged {%s} {%s} {%s} {%s}",
- m_consumerGroup.c_str(),
- topic.c_str(),
- UtilAll::toString(mqSet).c_str(),
- UtilAll::toString(mqSet).c_str());
- }
- }
- else
- {
- RMQ_WARN("doRebalance, {%s}, but the topic[%s] not exist.", m_consumerGroup.c_str(), topic.c_str());
- }
- break;
- }
- case CLUSTERING:
- {
- //kpr::ScopedLock<kpr::Mutex> lock(m_topicSubscribeInfoTableLock);
- std::map<std::string, std::set<MessageQueue> >::iterator it = m_topicSubscribeInfoTable.find(topic);
- if (it == m_topicSubscribeInfoTable.end())
- {
- if (topic.find(MixAll::RETRY_GROUP_TOPIC_PREFIX) != 0)
- {
- RMQ_WARN("doRebalance, %s, but the topic[%s] not exist.", m_consumerGroup.c_str(), topic.c_str());
- }
- }
-
- std::list<std::string> cidAll = m_pMQClientFactory->findConsumerIdList(topic, m_consumerGroup);
- if (cidAll.empty())
- {
- RMQ_WARN("doRebalance, %s:%s, get consumer id list failed.", m_consumerGroup.c_str(), topic.c_str());
- }
-
- if (it != m_topicSubscribeInfoTable.end() && !cidAll.empty())
- {
- std::vector<MessageQueue> mqAll;
- std::set<MessageQueue> mqSet = it->second;
- std::set<MessageQueue>::iterator its = mqSet.begin();
-
- for (; its != mqSet.end(); its++)
- {
- mqAll.push_back(*its);
- }
-
- cidAll.sort();
-
- AllocateMessageQueueStrategy* strategy = m_pAllocateMessageQueueStrategy;
-
- std::vector<MessageQueue>* allocateResult = NULL;
- try
- {
- allocateResult = strategy->allocate(m_consumerGroup,
- m_pMQClientFactory->getClientId(), mqAll, cidAll);
- }
- catch (std::exception& e)
- {
- RMQ_ERROR("AllocateMessageQueueStrategy.allocate Exception, allocateMessageQueueStrategyName={%s}, mqAll={%s}, cidAll={%s}, %s",
- strategy->getName().c_str(), UtilAll::toString(mqAll).c_str(), UtilAll::toString(cidAll).c_str(), e.what());
- return;
- }
-
- std::set<MessageQueue> allocateResultSet;
- if (allocateResult != NULL)
- {
- for (size_t i = 0; i < allocateResult->size(); i++)
- {
- allocateResultSet.insert(allocateResult->at(i));
- }
-
- delete allocateResult;
- }
-
- bool changed = updateProcessQueueTableInRebalance(topic, allocateResultSet);
- if (changed)
- {
- RMQ_INFO("rebalanced result changed. allocateMessageQueueStrategyName={%s}, group={%s}, topic={%s}, ConsumerId={%s}, "
- "rebalanceSize={%u}, rebalanceMqSet={%s}, mqAllSize={%u}, cidAllSize={%u}, mqAll={%s}, cidAll={%s}",
- strategy->getName().c_str(), m_consumerGroup.c_str(), topic.c_str(), m_pMQClientFactory->getClientId().c_str(),
- (unsigned)allocateResultSet.size(), UtilAll::toString(allocateResultSet).c_str(),
- (unsigned)mqAll.size(), (unsigned)cidAll.size(), UtilAll::toString(mqAll).c_str(), UtilAll::toString(cidAll).c_str()
- );
-
- messageQueueChanged(topic, mqSet, allocateResultSet);
- }
- }
- }
- break;
- default:
- break;
- }
- RMQ_DEBUG("rebalanceByTopic end");
-}
-
-
-void RebalanceImpl::removeProcessQueue(const MessageQueue& mq)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_processQueueTableLock);
- std::map<MessageQueue, ProcessQueue*>::iterator it = m_processQueueTable.find(mq);
- if (it != m_processQueueTable.end())
- {
- MessageQueue mq = it->first;
- ProcessQueue* pq = it->second;
- bool isDroped = pq->isDropped();
-
- this->removeUnnecessaryMessageQueue(mq, *pq);
- RMQ_INFO("Fix Offset, {%s}, remove unnecessary mq, {%s} Droped: {%d}",
- m_consumerGroup.c_str(), mq.toString().c_str(), isDroped);
- }
-}
-
-
-bool RebalanceImpl::updateProcessQueueTableInRebalance(const std::string& topic, std::set<MessageQueue>& mqSet)
-{
- RMQ_DEBUG("updateProcessQueueTableInRebalance begin, topic={%s}", topic.c_str());
- bool changed = false;
-
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_processQueueTableLock);
- std::map<MessageQueue, ProcessQueue*>::iterator it = m_processQueueTable.begin();
- for (; it != m_processQueueTable.end();)
- {
- std::map<MessageQueue, ProcessQueue*>::iterator itCur = it++;
- MessageQueue mq = itCur->first;
- ProcessQueue* pq = itCur->second;
- if (mq.getTopic() == topic)
- {
- std::set<MessageQueue>::iterator itMq = mqSet.find(mq);
- if (itMq == mqSet.end())
- {
- pq->setDropped(true);
- if (this->removeUnnecessaryMessageQueue(mq, *pq))
- {
- changed = true;
- m_processQueueTable.erase(itCur);
-
- RMQ_WARN("doRebalance, {%s}, remove unnecessary mq, {%s}",
- m_consumerGroup.c_str(), mq.toString().c_str());
- }
- }
- else if (pq->isPullExpired())
- {
- switch(this->consumeType())
- {
- case CONSUME_ACTIVELY:
- break;
- case CONSUME_PASSIVELY:
- pq->setDropped(true);
- if (this->removeUnnecessaryMessageQueue(mq, *pq))
- {
- changed = true;
- m_processQueueTable.erase(itCur);
-
- RMQ_ERROR("[BUG]doRebalance, {%s}, remove unnecessary mq, {%s}, because pull is pause, so try to fixed it",
- m_consumerGroup.c_str(), mq.toString().c_str());
- }
- break;
- default:
- break;
- }
- }
- }
- }
- }
-
- std::list<PullRequest*> pullRequestList;
- std::set<MessageQueue>::iterator its = mqSet.begin();
- for (; its != mqSet.end(); its++)
- {
- MessageQueue mq = *its;
- bool find = false;
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_processQueueTableLock);
- std::map<MessageQueue, ProcessQueue*>::iterator itm = m_processQueueTable.find(mq);
- if (itm != m_processQueueTable.end())
- {
- find = true;
- }
- }
-
- if (!find)
- {
- //todo: memleak
- PullRequest* pullRequest = new PullRequest();
- pullRequest->setConsumerGroup(m_consumerGroup);
- pullRequest->setMessageQueue(mq);
- pullRequest->setProcessQueue(new ProcessQueue());//todo: memleak
-
- long long nextOffset = computePullFromWhere(mq);
- if (nextOffset >= 0)
- {
- pullRequest->setNextOffset(nextOffset);
- pullRequestList.push_back(pullRequest);
- changed = true;
-
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_processQueueTableLock);
- m_processQueueTable[mq] = pullRequest->getProcessQueue();
- RMQ_INFO("doRebalance, {%s}, add a new mq, {%s}, pullRequst: %s",
- m_consumerGroup.c_str(), mq.toString().c_str(), pullRequest->toString().c_str());
- }
- }
- else
- {
- RMQ_WARN("doRebalance, {%s}, add new mq failed, {%s}",
- m_consumerGroup.c_str(), mq.toString().c_str());
- }
- }
- }
-
- //todo memleak
- dispatchPullRequest(pullRequestList);
- RMQ_DEBUG("updateProcessQueueTableInRebalance end");
-
- return changed;
-}
-
-void RebalanceImpl::truncateMessageQueueNotMyTopic()
-{
- std::map<std::string, SubscriptionData> subTable = getSubscriptionInner();
-
- kpr::ScopedWLock<kpr::RWMutex> lock(m_processQueueTableLock);
- std::map<MessageQueue, ProcessQueue*>::iterator it = m_processQueueTable.begin();
- for (; it != m_processQueueTable.end();)
- {
- MessageQueue mq = it->first;
- std::map<std::string, SubscriptionData>::iterator itt = subTable.find(mq.getTopic());
-
- if (itt == subTable.end())
- {
- ProcessQueue* pq = it->second;
- if (pq != NULL)
- {
- pq->setDropped(true);
- RMQ_WARN("doRebalance, {%s}, truncateMessageQueueNotMyTopic remove unnecessary mq, {%s}",
- m_consumerGroup.c_str(), mq.toString().c_str());
- }
- m_processQueueTable.erase(it++);
- }
- else
- {
- it++;
- }
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/RebalanceImpl.h b/rocketmq-client4cpp/src/consumer/RebalanceImpl.h
deleted file mode 100755
index 577a031c..00000000
--- a/rocketmq-client4cpp/src/consumer/RebalanceImpl.h
+++ /dev/null
@@ -1,102 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __REBALANCEIMPL_H__
-#define __REBALANCEIMPL_H__
-
-#include <map>
-#include <string>
-#include <set>
-#include <list>
-
-#include "ConsumeType.h"
-#include "MessageQueue.h"
-#include "ProcessQueue.h"
-#include "PullRequest.h"
-#include "SubscriptionData.h"
-
-namespace rmq
-{
- class AllocateMessageQueueStrategy;
- class MQClientFactory;
-
- class RebalanceImpl
- {
- public:
- RebalanceImpl(const std::string& consumerGroup,
- MessageModel messageModel,
- AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy,
- MQClientFactory* pMQClientFactory);
- virtual ~RebalanceImpl();
-
- virtual void messageQueueChanged(const std::string& topic,
- std::set<MessageQueue>& mqAll,
- std::set<MessageQueue>& mqDivided) = 0;
- virtual bool removeUnnecessaryMessageQueue(MessageQueue& mq, ProcessQueue& pq) = 0;
- virtual void dispatchPullRequest(std::list<PullRequest*>& pullRequestList) = 0;
- virtual long long computePullFromWhere(MessageQueue& mq) = 0;
- virtual ConsumeType consumeType() = 0;
-
- bool lock(MessageQueue& mq);
- void lockAll();
-
- void unlock(MessageQueue& mq, bool oneway);
- void unlockAll(bool oneway);
-
- void doRebalance();
-
- std::map<MessageQueue, ProcessQueue*>& getProcessQueueTable();
- kpr::RWMutex& getProcessQueueTableLock();
- std::map<std::string, SubscriptionData>& getSubscriptionInner();
- std::map<std::string, std::set<MessageQueue> >& getTopicSubscribeInfoTable();
-
- std::string& getConsumerGroup();
- void setConsumerGroup(const std::string& consumerGroup);
-
- MessageModel getMessageModel();
- void setMessageModel(MessageModel messageModel);
-
- AllocateMessageQueueStrategy* getAllocateMessageQueueStrategy();
- void setAllocateMessageQueueStrategy(AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy);
-
- MQClientFactory* getmQClientFactory();
- void setmQClientFactory(MQClientFactory* pMQClientFactory);
-
- void removeProcessQueue(const MessageQueue& mq);
-
- private:
- std::map<std::string, std::set<MessageQueue> > buildProcessQueueTableByBrokerName();
- void rebalanceByTopic(const std::string& topic);
- bool updateProcessQueueTableInRebalance(const std::string& topic, std::set<MessageQueue>& mqSet);
- void truncateMessageQueueNotMyTopic();
-
- protected:
- std::map<MessageQueue, ProcessQueue*> m_processQueueTable;
- kpr::RWMutex m_processQueueTableLock;
-
- std::map<std::string, std::set<MessageQueue> > m_topicSubscribeInfoTable;
- kpr::Mutex m_topicSubscribeInfoTableLock;
-
- std::map<std::string, SubscriptionData> m_subscriptionInner;
- kpr::Mutex m_subscriptionInnerLock;
-
- std::string m_consumerGroup;
- MessageModel m_messageModel;
- AllocateMessageQueueStrategy* m_pAllocateMessageQueueStrategy;
- MQClientFactory* m_pMQClientFactory;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/RebalancePullImpl.cpp b/rocketmq-client4cpp/src/consumer/RebalancePullImpl.cpp
deleted file mode 100755
index 1aa287b3..00000000
--- a/rocketmq-client4cpp/src/consumer/RebalancePullImpl.cpp
+++ /dev/null
@@ -1,79 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "RebalancePullImpl.h"
-#include "DefaultMQPullConsumerImpl.h"
-#include "AllocateMessageQueueStrategy.h"
-#include "MQClientFactory.h"
-#include "MessageQueueListener.h"
-#include "OffsetStore.h"
-#include "DefaultMQPullConsumer.h"
-
-namespace rmq
-{
-
-RebalancePullImpl::RebalancePullImpl(DefaultMQPullConsumerImpl* pDefaultMQPullConsumerImpl)
- : RebalanceImpl("", BROADCASTING, NULL, NULL),
- m_pDefaultMQPullConsumerImpl(pDefaultMQPullConsumerImpl)
-{
-}
-
-RebalancePullImpl::RebalancePullImpl(const std::string& consumerGroup,
- MessageModel messageModel,
- AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy,
- MQClientFactory* pMQClientFactory,
- DefaultMQPullConsumerImpl* pDefaultMQPullConsumerImpl)
- : RebalanceImpl(consumerGroup, messageModel, pAllocateMessageQueueStrategy, pMQClientFactory),
- m_pDefaultMQPullConsumerImpl(pDefaultMQPullConsumerImpl)
-{
-}
-
-long long RebalancePullImpl::computePullFromWhere(MessageQueue& mq)
-{
- return 0;
-}
-
-void RebalancePullImpl::dispatchPullRequest(std::list<PullRequest*>& pullRequestList)
-{
-}
-
-void RebalancePullImpl::messageQueueChanged(const std::string& topic,
- std::set<MessageQueue>& mqAll,
- std::set<MessageQueue>& mqDivided)
-{
- MessageQueueListener* messageQueueListener =
- m_pDefaultMQPullConsumerImpl->getDefaultMQPullConsumer()->getMessageQueueListener();
- if (messageQueueListener != NULL)
- {
- try
- {
- messageQueueListener->messageQueueChanged(topic, mqAll, mqDivided);
- }
- catch (...)
- {
- RMQ_ERROR("messageQueueChanged exception, %s", topic.c_str());
- }
- }
-}
-
-bool RebalancePullImpl::removeUnnecessaryMessageQueue(MessageQueue& mq, ProcessQueue& pq)
-{
- m_pDefaultMQPullConsumerImpl->getOffsetStore()->persist(mq);
- m_pDefaultMQPullConsumerImpl->getOffsetStore()->removeOffset(mq);
- return true;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/RebalancePullImpl.h b/rocketmq-client4cpp/src/consumer/RebalancePullImpl.h
deleted file mode 100755
index 46dbcd15..00000000
--- a/rocketmq-client4cpp/src/consumer/RebalancePullImpl.h
+++ /dev/null
@@ -1,56 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __REBALANCEPULLIMPL_H__
-#define __REBALANCEPULLIMPL_H__
-
-#include "RebalanceImpl.h"
-
-namespace rmq
-{
-class DefaultMQPullConsumerImpl;
-
-class RebalancePullImpl : public RebalanceImpl
-{
-public:
- RebalancePullImpl(DefaultMQPullConsumerImpl *pDefaultMQPullConsumerImpl);
-
- RebalancePullImpl(const std::string &consumerGroup,
- MessageModel messageModel,
- AllocateMessageQueueStrategy *pAllocateMessageQueueStrategy,
- MQClientFactory *pMQClientFactory,
- DefaultMQPullConsumerImpl *pDefaultMQPullConsumerImpl);
-
- long long computePullFromWhere(MessageQueue &mq);
-
- void dispatchPullRequest(std::list<PullRequest *> &pullRequestList);
-
- void messageQueueChanged(const std::string &topic,
- std::set<MessageQueue> &mqAll,
- std::set<MessageQueue> &mqDivided);
-
- bool removeUnnecessaryMessageQueue(MessageQueue &mq, ProcessQueue &pq);
-
- ConsumeType consumeType()
- {
- return CONSUME_ACTIVELY;
- };
-
-private:
- DefaultMQPullConsumerImpl *m_pDefaultMQPullConsumerImpl;
-};
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/RebalancePushImpl.cpp b/rocketmq-client4cpp/src/consumer/RebalancePushImpl.cpp
deleted file mode 100755
index fde770d1..00000000
--- a/rocketmq-client4cpp/src/consumer/RebalancePushImpl.cpp
+++ /dev/null
@@ -1,217 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "RebalancePushImpl.h"
-
-#include <string.h>
-#include <limits.h>
-
-#include "DefaultMQPushConsumerImpl.h"
-#include "AllocateMessageQueueStrategy.h"
-#include "MQClientFactory.h"
-#include "MessageQueueListener.h"
-#include "OffsetStore.h"
-#include "DefaultMQPushConsumer.h"
-#include "MQAdminImpl.h"
-
-
-namespace rmq
-{
-
-RebalancePushImpl::RebalancePushImpl(DefaultMQPushConsumerImpl* pDefaultMQPushConsumerImpl)
- : RebalanceImpl("", BROADCASTING, NULL, NULL),
- m_pDefaultMQPushConsumerImpl(pDefaultMQPushConsumerImpl)
-{
-}
-
-RebalancePushImpl::RebalancePushImpl(const std::string& consumerGroup,
- MessageModel messageModel,
- AllocateMessageQueueStrategy* pAllocateMessageQueueStrategy,
- MQClientFactory* pMQClientFactory,
- DefaultMQPushConsumerImpl* pDefaultMQPushConsumerImpl)
- : RebalanceImpl(consumerGroup, messageModel, pAllocateMessageQueueStrategy, pMQClientFactory),
- m_pDefaultMQPushConsumerImpl(pDefaultMQPushConsumerImpl)
-{
-}
-
-void RebalancePushImpl::dispatchPullRequest(std::list<PullRequest*>& pullRequestList)
-{
- std::list<PullRequest*>::iterator it = pullRequestList.begin();
- for (; it != pullRequestList.end(); it++)
- {
- m_pDefaultMQPushConsumerImpl->executePullRequestImmediately(*it);
- RMQ_INFO("doRebalance, {%s}, add a new pull request {%s}",
- m_consumerGroup.c_str(), (*it)->toString().c_str());
- }
-}
-
-long long RebalancePushImpl::computePullFromWhere(MessageQueue& mq)
-{
- long long result = -1;
- ConsumeFromWhere consumeFromWhere =
- m_pDefaultMQPushConsumerImpl->getDefaultMQPushConsumer()->getConsumeFromWhere();
- OffsetStore* offsetStore = m_pDefaultMQPushConsumerImpl->getOffsetStore();
-
- switch (consumeFromWhere)
- {
- case CONSUME_FROM_FIRST_OFFSET:
- {
- long long lastOffset = offsetStore->readOffset(mq, READ_FROM_STORE);
- if (lastOffset >= 0)
- {
- result = lastOffset;
- }
- else if (-1 == lastOffset)
- {
- result = 0L;
- }
- else
- {
- result = -1;
- }
- break;
- }
- case CONSUME_FROM_LAST_OFFSET:
- {
- long long lastOffset = offsetStore->readOffset(mq, READ_FROM_STORE);
- if (lastOffset >= 0)
- {
- result = lastOffset;
- }
- else if (-1 == lastOffset)
- {
- if (strncmp(MixAll::RETRY_GROUP_TOPIC_PREFIX.c_str(), mq.getTopic().c_str(), MixAll::RETRY_GROUP_TOPIC_PREFIX.size()) == 0)
- {
- result = 0L;
- }
- else
- {
- //result = LLONG_MAX;
- try
- {
- result = m_pMQClientFactory->getMQAdminImpl()->maxOffset(mq);
- }
- catch(...)
- {
- result = -1;
- }
- }
- }
- else
- {
- result = -1;
- }
- break;
- }
-
- case CONSUME_FROM_MAX_OFFSET:
- result = LLONG_MAX;
- break;
- case CONSUME_FROM_MIN_OFFSET:
- result = 0L;
- break;
- case CONSUME_FROM_TIMESTAMP:
- {
- long long lastOffset = offsetStore->readOffset(mq, READ_FROM_STORE);
- if (lastOffset >= 0)
- {
- result = lastOffset;
- }
- else if (-1 == lastOffset)
- {
- if (strncmp(MixAll::RETRY_GROUP_TOPIC_PREFIX.c_str(), mq.getTopic().c_str(), MixAll::RETRY_GROUP_TOPIC_PREFIX.size()) == 0)
- {
- //result = LLONG_MAX;
- try
- {
- result = m_pMQClientFactory->getMQAdminImpl()->maxOffset(mq);
- }
- catch(...)
- {
- result = -1;
- }
- }
- else
- {
- try
- {
- long timestamp = UtilAll::str2tm(
- m_pDefaultMQPushConsumerImpl->getDefaultMQPushConsumer()->getConsumeTimestamp(),
- rmq::yyyyMMddHHmmss);
- result = m_pMQClientFactory->getMQAdminImpl()->searchOffset(mq, timestamp);
- }
- catch(...)
- {
- result = -1;
- }
- }
- }
- else
- {
- result = -1;
- }
- break;
- }
- break;
- default:
- break;
- }
-
- return result;
-}
-
-void RebalancePushImpl::messageQueueChanged(const std::string& topic,
- std::set<MessageQueue>& mqAll,
- std::set<MessageQueue>& mqDivided)
-{
-}
-
-
-bool RebalancePushImpl::removeUnnecessaryMessageQueue(MessageQueue& mq, ProcessQueue& pq)
-{
- m_pDefaultMQPushConsumerImpl->getOffsetStore()->persist(mq);
- m_pDefaultMQPushConsumerImpl->getOffsetStore()->removeOffset(mq);
- if (m_pDefaultMQPushConsumerImpl->isConsumeOrderly()
- && m_pDefaultMQPushConsumerImpl->messageModel() == CLUSTERING)
- {
- if (pq.getLockConsume().TryLock(1000))
- {
- try
- {
- this->unlock(mq, true);
- }
- catch (std::exception& e)
- {
- RMQ_ERROR("removeUnnecessaryMessageQueue Exception: %s", e.what());
- }
- pq.getLockConsume().Unlock();
- }
- else
- {
- RMQ_WARN("[WRONG]mq is consuming, so can not unlock it, MQ:%s, maybe hanged for a while, times:{%lld}",
- mq.toString().c_str(),
- pq.getTryUnlockTimes());
-
- pq.incTryUnlockTimes();
- }
-
- return false;
- }
-
- return true;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/RebalancePushImpl.h b/rocketmq-client4cpp/src/consumer/RebalancePushImpl.h
deleted file mode 100755
index 0aa2b0ec..00000000
--- a/rocketmq-client4cpp/src/consumer/RebalancePushImpl.h
+++ /dev/null
@@ -1,55 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __REBALANCEPUSHIMPL_H__
-#define __REBALANCEPUSHIMPL_H__
-
-#include "RebalanceImpl.h"
-
-namespace rmq
-{
-class DefaultMQPushConsumerImpl;
-
-class RebalancePushImpl : public RebalanceImpl
-{
-public:
- RebalancePushImpl(DefaultMQPushConsumerImpl *pDefaultMQPushConsumerImpl);
-
- RebalancePushImpl(const std::string &consumerGroup,
- MessageModel messageModel,
- AllocateMessageQueueStrategy *pAllocateMessageQueueStrategy,
- MQClientFactory *pMQClientFactory,
- DefaultMQPushConsumerImpl *pDefaultMQPushConsumerImpl);
-
- void dispatchPullRequest(std::list<PullRequest *> &pullRequestList);
- long long computePullFromWhere(MessageQueue &mq);
- void messageQueueChanged(const std::string &topic,
- std::set<MessageQueue> &mqAll,
- std::set<MessageQueue> &mqDivided);
- bool removeUnnecessaryMessageQueue(MessageQueue &mq, ProcessQueue &pq);
-
-
- ConsumeType consumeType()
- {
- return CONSUME_PASSIVELY;
- };
-
-private:
- DefaultMQPushConsumerImpl *m_pDefaultMQPushConsumerImpl;
-};
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/RebalanceService.cpp b/rocketmq-client4cpp/src/consumer/RebalanceService.cpp
deleted file mode 100644
index 013fefba..00000000
--- a/rocketmq-client4cpp/src/consumer/RebalanceService.cpp
+++ /dev/null
@@ -1,55 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "RebalanceService.h"
-#include "MQClientFactory.h"
-
-namespace rmq
-{
-
-long RebalanceService::s_WaitInterval = 1000 * 10;
-
-RebalanceService::RebalanceService(MQClientFactory* pMQClientFactory)
- : ServiceThread("RebalanceService"),
- m_pMQClientFactory(pMQClientFactory)
-{
-}
-
-
-RebalanceService::~RebalanceService()
-{
-
-}
-
-void RebalanceService::Run()
-{
- RMQ_INFO("%s service started", getServiceName().c_str());
-
- while (!m_stoped)
- {
- waitForRunning(s_WaitInterval);
- m_pMQClientFactory->doRebalance();
- }
-
- RMQ_INFO("%s service end", getServiceName().c_str());
-}
-
-std::string RebalanceService::getServiceName()
-{
- return "RebalanceService";
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/RebalanceService.h b/rocketmq-client4cpp/src/consumer/RebalanceService.h
deleted file mode 100755
index ef4d746c..00000000
--- a/rocketmq-client4cpp/src/consumer/RebalanceService.h
+++ /dev/null
@@ -1,44 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __REBALANCESERVICE_H__
-#define __REBALANCESERVICE_H__
-
-#include "ServiceThread.h"
-
-namespace rmq
-{
- class MQClientFactory;
-
- /**
- * Rebalance service
- *
- */
- class RebalanceService : public ServiceThread
- {
- public:
- RebalanceService(MQClientFactory* pMQClientFactory);
- ~RebalanceService();
-
- void Run();
- std::string getServiceName();
-
- private:
- MQClientFactory* m_pMQClientFactory;
- static long s_WaitInterval;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/RemoteBrokerOffsetStore.cpp b/rocketmq-client4cpp/src/consumer/RemoteBrokerOffsetStore.cpp
deleted file mode 100755
index 1c4fd230..00000000
--- a/rocketmq-client4cpp/src/consumer/RemoteBrokerOffsetStore.cpp
+++ /dev/null
@@ -1,266 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "RemoteBrokerOffsetStore.h"
-#include "MQClientFactory.h"
-#include "ScopedLock.h"
-#include "MQClientException.h"
-#include "CommandCustomHeader.h"
-#include "MQClientAPIImpl.h"
-
-namespace rmq
-{
-
-RemoteBrokerOffsetStore::RemoteBrokerOffsetStore(MQClientFactory* pMQClientFactory, const std::string& groupName)
-{
- m_pMQClientFactory = pMQClientFactory;
- m_groupName = groupName;
-}
-
-void RemoteBrokerOffsetStore::load()
-{
-
-}
-
-void RemoteBrokerOffsetStore::updateOffset(const MessageQueue& mq, long long offset, bool increaseOnly)
-{
- kpr::ScopedWLock<kpr::RWMutex> lock(m_tableMutex);
- typeof(m_offsetTable.begin()) it = m_offsetTable.find(mq);
- if (it == m_offsetTable.end())
- {
- m_offsetTable[mq] = offset;
- it = m_offsetTable.find(mq);
- }
-
- kpr::AtomicLong& offsetOld = it->second;
- if (increaseOnly)
- {
- MixAll::compareAndIncreaseOnly(offsetOld, offset);
- }
- else
- {
- offsetOld.set(offset);
- }
-}
-
-long long RemoteBrokerOffsetStore::readOffset(const MessageQueue& mq, ReadOffsetType type)
-{
- RMQ_DEBUG("readOffset, MQ:%s, type:%d", mq.toString().c_str(), type);
- switch (type)
- {
- case MEMORY_FIRST_THEN_STORE:
- case READ_FROM_MEMORY:
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_tableMutex);
- typeof(m_offsetTable.begin()) it = m_offsetTable.find(mq);
- if (it != m_offsetTable.end())
- {
- return it->second.get();
- }
- else if (READ_FROM_MEMORY == type)
- {
- RMQ_DEBUG("No offset in memory, MQ:%s", mq.toString().c_str());
- return -1;
- }
- }
- case READ_FROM_STORE:
- {
- try
- {
- long long brokerOffset = this->fetchConsumeOffsetFromBroker(mq);
- RMQ_DEBUG("fetchConsumeOffsetFromBroker, MQ:%s, brokerOffset:%lld",
- mq.toString().c_str(), brokerOffset);
- if (brokerOffset >= 0)
- {
- this->updateOffset(mq, brokerOffset, false);
- }
- return brokerOffset;
- }
- // No offset in broker
- catch (const MQBrokerException& e)
- {
- RMQ_WARN("No offset in broker, MQ:%s, exception:%s", mq.toString().c_str(), e.what());
- return -1;
- }
- catch (const std::exception& e)
- {
- RMQ_ERROR("fetchConsumeOffsetFromBroker exception, MQ:%s, msg:%s",
- mq.toString().c_str(), e.what());
- return -2;
- }
- catch (...)
- {
- RMQ_ERROR("fetchConsumeOffsetFromBroker unknow exception, MQ:%s",
- mq.toString().c_str());
- return -2;
- }
- }
- default:
- break;
- }
-
- return -1;
-}
-
-void RemoteBrokerOffsetStore::persistAll(std::set<MessageQueue>& mqs)
-{
- if (mqs.empty())
- {
- return;
- }
-
- std::set<MessageQueue> unusedMQ;
- long long times = m_storeTimesTotal.fetchAndAdd(1);
-
- kpr::ScopedRLock<kpr::RWMutex> lock(m_tableMutex);
- for (typeof(m_offsetTable.begin()) it = m_offsetTable.begin();
- it != m_offsetTable.end(); it++)
- {
- MessageQueue mq = it->first;
- kpr::AtomicLong& offset = it->second;
- if (mqs.find(mq) != mqs.end())
- {
- try
- {
- this->updateConsumeOffsetToBroker(mq, offset.get());
- if ((times % 12) == 0)
- {
- RMQ_INFO("updateConsumeOffsetToBroker, Group: {%s} ClientId: {%s} mq:{%s} offset {%llu}",
- m_groupName.c_str(),
- m_pMQClientFactory->getClientId().c_str(),
- mq.toString().c_str(),
- offset.get());
- }
- }
- catch (...)
- {
- RMQ_ERROR("updateConsumeOffsetToBroker exception, mq=%s", mq.toString().c_str());
- }
- }
- else
- {
- unusedMQ.insert(mq);
- }
- }
-
- if (!unusedMQ.empty())
- {
- for (typeof(unusedMQ.begin()) it = unusedMQ.begin(); it != unusedMQ.end(); it++)
- {
- m_offsetTable.erase(*it);
- RMQ_INFO("remove unused mq, %s, %s", it->toString().c_str(), m_groupName.c_str());
- }
- }
-}
-
-void RemoteBrokerOffsetStore::persist(const MessageQueue& mq)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_tableMutex);
- typeof(m_offsetTable.begin()) it = m_offsetTable.find(mq);
- if (it != m_offsetTable.end())
- {
- try
- {
- this->updateConsumeOffsetToBroker(mq, it->second.get());
- RMQ_DEBUG("updateConsumeOffsetToBroker ok, mq=%s, offset=%lld", mq.toString().c_str(), it->second.get());
- }
- catch (...)
- {
- RMQ_ERROR("updateConsumeOffsetToBroker exception, mq=%s", mq.toString().c_str());
- }
- }
-}
-
-void RemoteBrokerOffsetStore::removeOffset(const MessageQueue& mq)
-{
- kpr::ScopedWLock<kpr::RWMutex> lock(m_tableMutex);
- m_offsetTable.erase(mq);
- RMQ_INFO("remove unnecessary messageQueue offset. mq=%s, offsetTableSize=%u",
- mq.toString().c_str(), (unsigned)m_offsetTable.size());
-}
-
-
-std::map<MessageQueue, long long> RemoteBrokerOffsetStore::cloneOffsetTable(const std::string& topic)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_tableMutex);
- std::map<MessageQueue, long long> cloneOffsetTable;
- RMQ_FOR_EACH(m_offsetTable, it)
- {
- MessageQueue mq = it->first;
- kpr::AtomicLong& offset = it->second;
- if (topic == mq.getTopic())
- {
- cloneOffsetTable[mq] = offset.get();
- }
- }
-
- return cloneOffsetTable;
-}
-
-
-void RemoteBrokerOffsetStore::updateConsumeOffsetToBroker(const MessageQueue& mq, long long offset)
-{
- FindBrokerResult findBrokerResult = m_pMQClientFactory->findBrokerAddressInAdmin(mq.getBrokerName());
- if (findBrokerResult.brokerAddr.empty())
- {
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic());
- findBrokerResult = m_pMQClientFactory->findBrokerAddressInAdmin(mq.getBrokerName());
- }
-
- if (!findBrokerResult.brokerAddr.empty())
- {
- UpdateConsumerOffsetRequestHeader* requestHeader = new UpdateConsumerOffsetRequestHeader();
- requestHeader->topic = mq.getTopic();
- requestHeader->consumerGroup = this->m_groupName;
- requestHeader->queueId = mq.getQueueId();
- requestHeader->commitOffset = offset;
-
- m_pMQClientFactory->getMQClientAPIImpl()->updateConsumerOffsetOneway(
- findBrokerResult.brokerAddr, requestHeader, 1000 * 5);
- }
- else
- {
- THROW_MQEXCEPTION(MQClientException, "The broker[" + mq.getBrokerName() + "] not exist", -1);
- }
-}
-
-long long RemoteBrokerOffsetStore::fetchConsumeOffsetFromBroker(const MessageQueue& mq)
-{
- FindBrokerResult findBrokerResult = m_pMQClientFactory->findBrokerAddressInAdmin(mq.getBrokerName());
- if (findBrokerResult.brokerAddr.empty())
- {
- // TODO Here may be heavily overhead for Name Server,need tuning
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic());
- findBrokerResult = m_pMQClientFactory->findBrokerAddressInAdmin(mq.getBrokerName());
- }
-
- if (!findBrokerResult.brokerAddr.empty())
- {
- QueryConsumerOffsetRequestHeader* requestHeader = new QueryConsumerOffsetRequestHeader();
- requestHeader->topic = mq.getTopic();
- requestHeader->consumerGroup = this->m_groupName;
- requestHeader->queueId = mq.getQueueId();
-
- return m_pMQClientFactory->getMQClientAPIImpl()->queryConsumerOffset(
- findBrokerResult.brokerAddr, requestHeader, 1000 * 5);
- }
- else
- {
- THROW_MQEXCEPTION(MQClientException, "The broker[" + mq.getBrokerName() + "] not exist", -1);
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/RemoteBrokerOffsetStore.h b/rocketmq-client4cpp/src/consumer/RemoteBrokerOffsetStore.h
deleted file mode 100755
index b613084b..00000000
--- a/rocketmq-client4cpp/src/consumer/RemoteBrokerOffsetStore.h
+++ /dev/null
@@ -1,61 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __REMOTEBROKEROFFSETSTORE_H__
-#define __REMOTEBROKEROFFSETSTORE_H__
-
-#include "OffsetStore.h"
-#include <map>
-#include <string>
-#include <set>
-#include "MessageQueue.h"
-#include "AtomicValue.h"
-#include "Mutex.h"
-
-namespace rmq
-{
- class MQClientFactory;
-
- /**
- * offset remote store
- *
- */
- class RemoteBrokerOffsetStore : public OffsetStore
- {
- public:
- RemoteBrokerOffsetStore(MQClientFactory* pMQClientFactory, const std::string& groupName) ;
-
- void load();
- void updateOffset(const MessageQueue& mq, long long offset, bool increaseOnly);
- long long readOffset(const MessageQueue& mq, ReadOffsetType type);
- void persistAll(std::set<MessageQueue>& mqs);
- void persist(const MessageQueue& mq);
- void removeOffset(const MessageQueue& mq) ;
- std::map<MessageQueue, long long> cloneOffsetTable(const std::string& topic);
-
- private:
- void updateConsumeOffsetToBroker(const MessageQueue& mq, long long offset);
- long long fetchConsumeOffsetFromBroker(const MessageQueue& mq);
-
- private:
- MQClientFactory* m_pMQClientFactory;
- std::string m_groupName;
- kpr::AtomicInteger m_storeTimesTotal;
- std::map<MessageQueue, kpr::AtomicLong> m_offsetTable;
- kpr::RWMutex m_tableMutex;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/consumer/SubscriptionData.cpp b/rocketmq-client4cpp/src/consumer/SubscriptionData.cpp
deleted file mode 100755
index ed5cf12e..00000000
--- a/rocketmq-client4cpp/src/consumer/SubscriptionData.cpp
+++ /dev/null
@@ -1,201 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "SubscriptionData.h"
-
-#include <sstream>
-#include "KPRUtil.h"
-#include "UtilAll.h"
-
-namespace rmq
-{
-
-std::string SubscriptionData::SUB_ALL = "*";
-
-SubscriptionData::SubscriptionData()
-{
- m_subVersion = KPRUtil::GetCurrentTimeMillis();
-}
-
-SubscriptionData::SubscriptionData(const std::string& topic, const std::string& subString)
- : m_topic(topic),
- m_subString(subString)
-{
- m_subVersion = KPRUtil::GetCurrentTimeMillis();
-}
-
-std::string SubscriptionData::getTopic()const
-{
- return m_topic;
-}
-
-void SubscriptionData::setTopic(const std::string& topic)
-{
- m_topic = topic;
-}
-
-std::string SubscriptionData::getSubString()
-{
- return m_subString;
-}
-
-void SubscriptionData::setSubString(const std::string& subString)
-{
- m_subString = subString;
-}
-
-std::set<std::string>& SubscriptionData::getTagsSet()
-{
- return m_tagsSet;
-}
-
-void SubscriptionData::setTagsSet(const std::set<std::string>& tagsSet)
-{
- m_tagsSet = tagsSet;
-}
-
-long long SubscriptionData::getSubVersion()
-{
- return m_subVersion;
-}
-
-void SubscriptionData::setSubVersion(long long subVersion)
-{
- m_subVersion = subVersion;
-}
-
-std::set<int>& SubscriptionData::getCodeSet()
-{
- return m_codeSet;
-}
-
-void SubscriptionData::setCodeSet(const std::set<int>& codeSet)
-{
- m_codeSet = codeSet;
-}
-
-int SubscriptionData::hashCode()
-{
- /*
- final int prime = 31;
- int result = 1;
- result = prime * result + (classFilterMode ? 1231 : 1237);
- result = prime * result + ((codeSet == null) ? 0 : codeSet.hashCode());
- result = prime * result + ((subString == null) ? 0 : subString.hashCode());
- result = prime * result + ((tagsSet == null) ? 0 : tagsSet.hashCode());
- result = prime * result + ((topic == null) ? 0 : topic.hashCode());
- return result;
- */
- std::stringstream ss;
- ss << UtilAll::hashCode(m_codeSet)
- << m_subString
- << UtilAll::hashCode(m_tagsSet)
- << m_topic;
- return UtilAll::hashCode(ss.str());
-}
-
-
-
-
-bool SubscriptionData::operator==(const SubscriptionData& other)
-{
- if (m_codeSet != other.m_codeSet)
- {
- return false;
- }
-
- if (m_subString != other.m_subString)
- {
- return false;
- }
-
- if (m_subVersion != other.m_subVersion)
- {
- return false;
- }
-
- if (m_tagsSet != other.m_tagsSet)
- {
- return false;
- }
-
- if (m_topic != other.m_topic)
- {
- return false;
- }
-
- return true;
-}
-
-bool SubscriptionData::operator<(const SubscriptionData& other)const
-{
- if (m_topic < other.m_topic)
- {
- return true;
- }
- else if (m_topic == other.m_topic)
- {
- if (m_subString < other.m_subString)
- {
- return true;
- }
- else
- {
- return false;
- }
- }
- else
- {
- return false;
- }
-}
-
-void SubscriptionData::toJson(Json::Value& obj) const
-{
- obj["classFilterMode"] = false;
- obj["topic"] = m_topic;
- obj["subString"] = m_subString;
- obj["subVersion"] = (long long)m_subVersion;
-
- Json::Value tagSet(Json::arrayValue);
- RMQ_FOR_EACH(m_tagsSet, it)
- {
- tagSet.append(*it);
- }
- obj["tagsSet"] = tagSet;
-
- Json::Value codeSet(Json::arrayValue);
- RMQ_FOR_EACH(m_codeSet, it)
- {
- codeSet.append(*it);
- }
- obj["codeSet"] = codeSet;
-}
-
-std::string SubscriptionData::toString() const
-{
- std::stringstream ss;
- ss << "{classFilterMode=" << false
- << ",topic=" << m_topic
- << ",subString=" << m_subString
- << ",subVersion=" << m_subVersion
- << ",tagsSet=" << UtilAll::toString(m_tagsSet)
- << ",codeSet=" << UtilAll::toString(m_codeSet)
- << "}";
- return ss.str();
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/consumer/SubscriptionData.h b/rocketmq-client4cpp/src/consumer/SubscriptionData.h
deleted file mode 100755
index 4796fb77..00000000
--- a/rocketmq-client4cpp/src/consumer/SubscriptionData.h
+++ /dev/null
@@ -1,76 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __SUBSCRIPTIONDATA_H__
-#define __SUBSCRIPTIONDATA_H__
-
-#include <string>
-#include <set>
-
-#include "RocketMQClient.h"
-#include "RemotingSerializable.h"
-#include "RefHandle.h"
-#include "json/json.h"
-
-namespace rmq
-{
- class SubscriptionData : public kpr::RefCount
- {
- public:
- SubscriptionData();
- SubscriptionData(const std::string& topic, const std::string& subString);
-
- std::string getTopic()const;
- void setTopic(const std::string& topic);
-
- std::string getSubString();
- void setSubString(const std::string& subString);
-
- std::set<std::string>& getTagsSet();
- void setTagsSet(const std::set<std::string>& tagsSet);
-
- long long getSubVersion();
- void setSubVersion(long long subVersion);
-
- std::set<int>& getCodeSet();
- void setCodeSet(const std::set<int>& codeSet);
-
- int hashCode();
- void toJson(Json::Value& obj) const;
- std::string toString() const;
-
- bool operator==(const SubscriptionData& other);
- bool operator<(const SubscriptionData& other)const;
-
- public:
- static std::string SUB_ALL;
-
- private:
- std::string m_topic;
- std::string m_subString;
- std::set<std::string> m_tagsSet;
- std::set<int> m_codeSet;
- long long m_subVersion ;
- };
- typedef kpr::RefHandleT<SubscriptionData> SubscriptionDataPtr;
-
- inline std::ostream& operator<<(std::ostream& os, const SubscriptionData& obj)
- {
- os << obj.toString();
- return os;
- }
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/jsoncpp/AUTHORS b/rocketmq-client4cpp/src/jsoncpp/AUTHORS
deleted file mode 100755
index e69de29b..00000000
diff --git a/rocketmq-client4cpp/src/jsoncpp/LICENSE b/rocketmq-client4cpp/src/jsoncpp/LICENSE
deleted file mode 100755
index 403d0966..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/LICENSE
+++ /dev/null
@@ -1 +0,0 @@
-The json-cpp library and this documentation are in Public Domain.
\ No newline at end of file
diff --git a/rocketmq-client4cpp/src/jsoncpp/README.txt b/rocketmq-client4cpp/src/jsoncpp/README.txt
deleted file mode 100755
index 379d3761..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/README.txt
+++ /dev/null
@@ -1,117 +0,0 @@
-* Introduction:
- =============
-
-JSON (JavaScript Object Notation) is a lightweight data-interchange format.
-It can represent integer, real number, string, an ordered sequence of
-value, and a collection of name/value pairs.
-
-JsonCpp is a simple API to manipulate JSON value, handle serialization
-and unserialization to string.
-
-It can also preserve existing comment in unserialization/serialization steps,
-making it a convenient format to store user input files.
-
-Unserialization parsing is user friendly and provides precise error reports.
-
-
-* Building/Testing:
- =================
-
-JsonCpp uses Scons (http://www.scons.org) as a build system. Scons requires
-python to be installed (http://www.python.org).
-
-You download scons-local distribution from the following url:
-http://sourceforge.net/project/showfiles.php?group_id=30337&package_id=67375
-
-Unzip it in the directory where you found this README file. scons.py Should be
-at the same level as README.
-
-python scons.py platform=PLTFRM [TARGET]
-where PLTFRM may be one of:
- suncc Sun C++ (Solaris)
- vacpp Visual Age C++ (AIX)
- mingw
- msvc6 Microsoft Visual Studio 6 service pack 5-6
- msvc70 Microsoft Visual Studio 2002
- msvc71 Microsoft Visual Studio 2003
- msvc80 Microsoft Visual Studio 2005
- linux-gcc Gnu C++ (linux, also reported to work for Mac OS X)
-
-adding platform is fairly simple. You need to change the Sconstruct file
-to do so.
-
-and TARGET may be:
- check: build library and run unit tests.
-
-
-* Running the test manually:
- ==========================
-
-cd test
-# This will run the Reader/Writer tests
-python runjsontests.py "path to jsontest.exe"
-
-# This will run the Reader/Writer tests, using JSONChecker test suite
-# (http://www.json.org/JSON_checker/).
-# Notes: not all tests pass: JsonCpp is too lenient (for example,
-# it allows an integer to start with '0'). The goal is to improve
-# strict mode parsing to get all tests to pass.
-python runjsontests.py --with-json-checker "path to jsontest.exe"
-
-# This will run the unit tests (mostly Value)
-python rununittests.py "path to test_lib_json.exe"
-
-You can run the tests using valgrind:
-python rununittests.py --valgrind "path to test_lib_json.exe"
-
-
-* Building the documentation:
- ===========================
-
-Run the python script doxybuild.py from the top directory:
-
-python doxybuild.py --open --with-dot
-
-See doxybuild.py --help for options.
-
-
-* Adding a reader/writer test:
- ============================
-
-To add a test, you need to create two files in test/data:
-- a TESTNAME.json file, that contains the input document in JSON format.
-- a TESTNAME.expected file, that contains a flatened representation of
- the input document.
-
-TESTNAME.expected file format:
-- each line represents a JSON element of the element tree represented
- by the input document.
-- each line has two parts: the path to access the element separated from
- the element value by '='. Array and object values are always empty
- (e.g. represented by either [] or {}).
-- element path: '.' represented the root element, and is used to separate
- object members. [N] is used to specify the value of an array element
- at index N.
-See test_complex_01.json and test_complex_01.expected to better understand
-element path.
-
-
-* Understanding reader/writer test output:
- ========================================
-
-When a test is run, output files are generated aside the input test files.
-Below is a short description of the content of each file:
-
-- test_complex_01.json: input JSON document
-- test_complex_01.expected: flattened JSON element tree used to check if
- parsing was corrected.
-
-- test_complex_01.actual: flattened JSON element tree produced by
- jsontest.exe from reading test_complex_01.json
-- test_complex_01.rewrite: JSON document written by jsontest.exe using the
- Json::Value parsed from test_complex_01.json and serialized using
- Json::StyledWritter.
-- test_complex_01.actual-rewrite: flattened JSON element tree produced by
- jsontest.exe from reading test_complex_01.rewrite.
-test_complex_01.process-output: jsontest.exe output, typically useful to
- understand parsing error.
\ No newline at end of file
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/allocator.h b/rocketmq-client4cpp/src/jsoncpp/json/allocator.h
deleted file mode 100755
index 1235a3e4..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/allocator.h
+++ /dev/null
@@ -1,96 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef CPPTL_JSON_ALLOCATOR_H_INCLUDED
-#define CPPTL_JSON_ALLOCATOR_H_INCLUDED
-
-#include <cstring>
-#include <memory>
-
-namespace rmq {
-namespace Json {
-template<typename T>
-class SecureAllocator {
- public:
- // Type definitions
- using value_type = T;
- using pointer = T*;
- using const_pointer = const T*;
- using reference = T&;
- using const_reference = const T&;
- using size_type = std::size_t;
- using difference_type = std::ptrdiff_t;
-
- /**
- * Allocate memory for N items using the standard allocator.
- */
- pointer allocate(size_type n) {
- // allocate using "global operator new"
- return static_cast<pointer>(::operator new(n * sizeof(T)));
- }
-
- /**
- * Release memory which was allocated for N items at pointer P.
- *
- * The memory block is filled with zeroes before being released.
- * The pointer argument is tagged as "volatile" to prevent the
- * compiler optimizing out this critical step.
- */
- void deallocate(volatile pointer p, size_type n) {
- std::memset(p, 0, n * sizeof(T));
- // free using "global operator delete"
- ::operator delete(p);
- }
-
- /**
- * Construct an item in-place at pointer P.
- */
- template<typename... Args>
- void construct(pointer p, Args&&... args) {
- // construct using "placement new" and "perfect forwarding"
- ::new (static_cast<void*>(p)) T(std::forward<Args>(args)...);
- }
-
- size_type max_size() const {
- return size_t(-1) / sizeof(T);
- }
-
- pointer address( reference x ) const {
- return std::addressof(x);
- }
-
- const_pointer address( const_reference x ) const {
- return std::addressof(x);
- }
-
- /**
- * Destroy an item in-place at pointer P.
- */
- void destroy(pointer p) {
- // destroy using "explicit destructor"
- p->~T();
- }
-
- // Boilerplate
- SecureAllocator() {}
- template<typename U> SecureAllocator(const SecureAllocator<U>&) {}
- template<typename U> struct rebind { using other = SecureAllocator<U>; };
-};
-
-
-template<typename T, typename U>
-bool operator==(const SecureAllocator<T>&, const SecureAllocator<U>&) {
- return true;
-}
-
-template<typename T, typename U>
-bool operator!=(const SecureAllocator<T>&, const SecureAllocator<U>&) {
- return false;
-}
-
-} //namespace Json
-} //namespace rmq
-
-#endif // CPPTL_JSON_ALLOCATOR_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/assertions.h b/rocketmq-client4cpp/src/jsoncpp/json/assertions.h
deleted file mode 100755
index dc67b27f..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/assertions.h
+++ /dev/null
@@ -1,54 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef CPPTL_JSON_ASSERTIONS_H_INCLUDED
-#define CPPTL_JSON_ASSERTIONS_H_INCLUDED
-
-#include <stdlib.h>
-#include <sstream>
-
-#if !defined(JSON_IS_AMALGAMATION)
-#include "config.h"
-#endif // if !defined(JSON_IS_AMALGAMATION)
-
-/** It should not be possible for a maliciously designed file to
- * cause an abort() or seg-fault, so these macros are used only
- * for pre-condition violations and internal logic errors.
- */
-#if JSON_USE_EXCEPTION
-
-// @todo <= add detail about condition in exception
-# define JSON_ASSERT(condition) \
- {if (!(condition)) {rmq::Json::throwLogicError( "assert json failed" );}}
-
-# define JSON_FAIL_MESSAGE(message) \
- { \
- JSONCPP_OSTRINGSTREAM oss; oss << message; \
- rmq::Json::throwLogicError(oss.str()); \
- abort(); \
- }
-
-#else // JSON_USE_EXCEPTION
-
-# define JSON_ASSERT(condition) assert(condition)
-
-// The call to assert() will show the failure message in debug builds. In
-// release builds we abort, for a core-dump or debugger.
-# define JSON_FAIL_MESSAGE(message) \
- { \
- JSONCPP_OSTRINGSTREAM oss; oss << message; \
- assert(false && oss.str().c_str()); \
- abort(); \
- }
-
-
-#endif
-
-#define JSON_ASSERT_MESSAGE(condition, message) \
- if (!(condition)) { \
- JSON_FAIL_MESSAGE(message); \
- }
-
-#endif // CPPTL_JSON_ASSERTIONS_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/autolink.h b/rocketmq-client4cpp/src/jsoncpp/json/autolink.h
deleted file mode 100644
index 6fcc8afa..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/autolink.h
+++ /dev/null
@@ -1,25 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef JSON_AUTOLINK_H_INCLUDED
-#define JSON_AUTOLINK_H_INCLUDED
-
-#include "config.h"
-
-#ifdef JSON_IN_CPPTL
-#include <cpptl/cpptl_autolink.h>
-#endif
-
-#if !defined(JSON_NO_AUTOLINK) && !defined(JSON_DLL_BUILD) && \
- !defined(JSON_IN_CPPTL)
-#define CPPTL_AUTOLINK_NAME "json"
-#undef CPPTL_AUTOLINK_DLL
-#ifdef JSON_DLL
-#define CPPTL_AUTOLINK_DLL
-#endif
-#include "autolink.h"
-#endif
-
-#endif // JSON_AUTOLINK_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/config.h b/rocketmq-client4cpp/src/jsoncpp/json/config.h
deleted file mode 100755
index 55d50d96..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/config.h
+++ /dev/null
@@ -1,182 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef JSON_CONFIG_H_INCLUDED
-#define JSON_CONFIG_H_INCLUDED
-#include <stddef.h>
-#include <string> //typedef String
-#include <stdint.h> //typedef int64_t, uint64_t
-
-/// If defined, indicates that json library is embedded in CppTL library.
-//# define JSON_IN_CPPTL 1
-
-/// If defined, indicates that json may leverage CppTL library
-//# define JSON_USE_CPPTL 1
-/// If defined, indicates that cpptl vector based map should be used instead of
-/// std::map
-/// as Value container.
-//# define JSON_USE_CPPTL_SMALLMAP 1
-
-// If non-zero, the library uses exceptions to report bad input instead of C
-// assertion macros. The default is to use exceptions.
-#ifndef JSON_USE_EXCEPTION
-#define JSON_USE_EXCEPTION 1
-#endif
-
-/// If defined, indicates that the source file is amalgated
-/// to prevent private header inclusion.
-/// Remarks: it is automatically defined in the generated amalgated header.
-// #define JSON_IS_AMALGAMATION
-
-#ifdef JSON_IN_CPPTL
-#include <cpptl/config.h>
-#ifndef JSON_USE_CPPTL
-#define JSON_USE_CPPTL 1
-#endif
-#endif
-
-#ifdef JSON_IN_CPPTL
-#define JSON_API CPPTL_API
-#elif defined(JSON_DLL_BUILD)
-#if defined(_MSC_VER) || defined(__MINGW32__)
-#define JSON_API __declspec(dllexport)
-#define JSONCPP_DISABLE_DLL_INTERFACE_WARNING
-#endif // if defined(_MSC_VER)
-#elif defined(JSON_DLL)
-#if defined(_MSC_VER) || defined(__MINGW32__)
-#define JSON_API __declspec(dllimport)
-#define JSONCPP_DISABLE_DLL_INTERFACE_WARNING
-#endif // if defined(_MSC_VER)
-#endif // ifdef JSON_IN_CPPTL
-#if !defined(JSON_API)
-#define JSON_API
-#endif
-
-// If JSON_NO_INT64 is defined, then Json only support C++ "int" type for
-// integer
-// Storages, and 64 bits integer support is disabled.
-// #define JSON_NO_INT64 1
-
-#if defined(_MSC_VER) // MSVC
-# if _MSC_VER <= 1200 // MSVC 6
- // Microsoft Visual Studio 6 only support conversion from __int64 to double
- // (no conversion from unsigned __int64).
-# define JSON_USE_INT64_DOUBLE_CONVERSION 1
- // Disable warning 4786 for VS6 caused by STL (identifier was truncated to '255'
- // characters in the debug information)
- // All projects I've ever seen with VS6 were using this globally (not bothering
- // with pragma push/pop).
-# pragma warning(disable : 4786)
-# endif // MSVC 6
-
-# if _MSC_VER >= 1500 // MSVC 2008
- /// Indicates that the following function is deprecated.
-# define JSONCPP_DEPRECATED(message) __declspec(deprecated(message))
-# endif
-
-#endif // defined(_MSC_VER)
-
-// In c++11 the override keyword allows you to explicity define that a function
-// is intended to override the base-class version. This makes the code more
-// managable and fixes a set of common hard-to-find bugs.
-#if __cplusplus >= 201103L
-# define JSONCPP_OVERRIDE override
-#elif defined(_MSC_VER) && _MSC_VER > 1600
-# define JSONCPP_OVERRIDE override
-#else
-# define JSONCPP_OVERRIDE
-#endif
-
-#ifndef JSON_HAS_RVALUE_REFERENCES
-
-#if defined(_MSC_VER) && _MSC_VER >= 1600 // MSVC >= 2010
-#define JSON_HAS_RVALUE_REFERENCES 1
-#endif // MSVC >= 2010
-
-#ifdef __clang__
-#if __has_feature(cxx_rvalue_references)
-#define JSON_HAS_RVALUE_REFERENCES 1
-#endif // has_feature
-
-#elif defined __GNUC__ // not clang (gcc comes later since clang emulates gcc)
-#if defined(__GXX_EXPERIMENTAL_CXX0X__) || (__cplusplus >= 201103L)
-#define JSON_HAS_RVALUE_REFERENCES 1
-#endif // GXX_EXPERIMENTAL
-
-#endif // __clang__ || __GNUC__
-
-#endif // not defined JSON_HAS_RVALUE_REFERENCES
-
-#ifndef JSON_HAS_RVALUE_REFERENCES
-#define JSON_HAS_RVALUE_REFERENCES 0
-#endif
-
-#ifdef __clang__
-#elif defined __GNUC__ // not clang (gcc comes later since clang emulates gcc)
-# if (__GNUC__ > 4 || (__GNUC__ == 4 && __GNUC_MINOR__ >= 5))
-# define JSONCPP_DEPRECATED(message) __attribute__ ((deprecated(message)))
-# elif (__GNUC__ > 3 || (__GNUC__ == 3 && __GNUC_MINOR__ >= 1))
-# define JSONCPP_DEPRECATED(message) __attribute__((__deprecated__))
-# endif // GNUC version
-#endif // __clang__ || __GNUC__
-
-#if !defined(JSONCPP_DEPRECATED)
-#define JSONCPP_DEPRECATED(message)
-#endif // if !defined(JSONCPP_DEPRECATED)
-
-#if __GNUC__ >= 6
-# define JSON_USE_INT64_DOUBLE_CONVERSION 1
-#endif
-
-#if !defined(JSON_IS_AMALGAMATION)
-
-# include "version.h"
-
-# if JSONCPP_USING_SECURE_MEMORY
-# include "allocator.h" //typedef Allocator
-# endif
-
-#endif // if !defined(JSON_IS_AMALGAMATION)
-
-namespace rmq {
-namespace Json {
-
-typedef int Int;
-typedef unsigned int UInt;
-#if defined(JSON_NO_INT64)
-typedef int LargestInt;
-typedef unsigned int LargestUInt;
-#undef JSON_HAS_INT64
-#else // if defined(JSON_NO_INT64)
-// For Microsoft Visual use specific types as long long is not supported
-#if defined(_MSC_VER) // Microsoft Visual Studio
-typedef __int64 Int64;
-typedef unsigned __int64 UInt64;
-#else // if defined(_MSC_VER) // Other platforms, use long long
- typedef long long int Int64;
- typedef unsigned long long int UInt64;
-#endif // if defined(_MSC_VER)
-typedef Int64 LargestInt;
-typedef UInt64 LargestUInt;
-#define JSON_HAS_INT64
-#endif // if defined(JSON_NO_INT64)
-#if JSONCPP_USING_SECURE_MEMORY
-#define JSONCPP_STRING std::basic_string<char, std::char_traits<char>, rmq::Json::SecureAllocator<char> >
-#define JSONCPP_OSTRINGSTREAM std::basic_ostringstream<char, std::char_traits<char>, rmq::Json::SecureAllocator<char> >
-#define JSONCPP_OSTREAM std::basic_ostream<char, std::char_traits<char>>
-#define JSONCPP_ISTRINGSTREAM std::basic_istringstream<char, std::char_traits<char>, rmq::Json::SecureAllocator<char> >
-#define JSONCPP_ISTREAM std::istream
-#else
-#define JSONCPP_STRING std::string
-#define JSONCPP_OSTRINGSTREAM std::ostringstream
-#define JSONCPP_OSTREAM std::ostream
-#define JSONCPP_ISTRINGSTREAM std::istringstream
-#define JSONCPP_ISTREAM std::istream
-#endif // if JSONCPP_USING_SECURE_MEMORY
-
-} // end namespace Json
-} // end namespace rmq
-
-#endif // JSON_CONFIG_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/features.h b/rocketmq-client4cpp/src/jsoncpp/json/features.h
deleted file mode 100755
index d1097903..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/features.h
+++ /dev/null
@@ -1,59 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef CPPTL_JSON_FEATURES_H_INCLUDED
-#define CPPTL_JSON_FEATURES_H_INCLUDED
-
-#if !defined(JSON_IS_AMALGAMATION)
-#include "forwards.h"
-#endif // if !defined(JSON_IS_AMALGAMATION)
-
-namespace rmq {
-namespace Json {
-
-/** \brief Configuration passed to reader and writer.
- * This configuration object can be used to force the Reader or Writer
- * to behave in a standard conforming way.
- */
-class JSON_API Features {
-public:
- /** \brief A configuration that allows all features and assumes all strings
- * are UTF-8.
- * - C & C++ comments are allowed
- * - Root object can be any JSON value
- * - Assumes Value strings are encoded in UTF-8
- */
- static Features all();
-
- /** \brief A configuration that is strictly compatible with the JSON
- * specification.
- * - Comments are forbidden.
- * - Root object must be either an array or an object value.
- * - Assumes Value strings are encoded in UTF-8
- */
- static Features strictMode();
-
- /** \brief Initialize the configuration like JsonConfig::allFeatures;
- */
- Features();
-
- /// \c true if comments are allowed. Default: \c true.
- bool allowComments_;
-
- /// \c true if root must be either an array or an object value. Default: \c
- /// false.
- bool strictRoot_;
-
- /// \c true if dropped null placeholders are allowed. Default: \c false.
- bool allowDroppedNullPlaceholders_;
-
- /// \c true if numeric object key are allowed. Default: \c false.
- bool allowNumericKeys_;
-};
-
-} // namespace Json
-} // namespace rmq
-
-#endif // CPPTL_JSON_FEATURES_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/forwards.h b/rocketmq-client4cpp/src/jsoncpp/json/forwards.h
deleted file mode 100755
index 71f59a38..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/forwards.h
+++ /dev/null
@@ -1,39 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef JSON_FORWARDS_H_INCLUDED
-#define JSON_FORWARDS_H_INCLUDED
-
-#if !defined(JSON_IS_AMALGAMATION)
-#include "config.h"
-#endif // if !defined(JSON_IS_AMALGAMATION)
-
-namespace rmq {
-namespace Json {
-
-// writer.h
-class FastWriter;
-class StyledWriter;
-
-// reader.h
-class Reader;
-
-// features.h
-class Features;
-
-// value.h
-typedef unsigned int ArrayIndex;
-class StaticString;
-class Path;
-class PathArgument;
-class Value;
-class ValueIteratorBase;
-class ValueIterator;
-class ValueConstIterator;
-
-} // namespace Json
-} // namespace rmq
-
-#endif // JSON_FORWARDS_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/json.h b/rocketmq-client4cpp/src/jsoncpp/json/json.h
deleted file mode 100644
index 8f10ac2b..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/json.h
+++ /dev/null
@@ -1,15 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef JSON_JSON_H_INCLUDED
-#define JSON_JSON_H_INCLUDED
-
-#include "autolink.h"
-#include "value.h"
-#include "reader.h"
-#include "writer.h"
-#include "features.h"
-
-#endif // JSON_JSON_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/reader.h b/rocketmq-client4cpp/src/jsoncpp/json/reader.h
deleted file mode 100755
index 846251bf..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/reader.h
+++ /dev/null
@@ -1,406 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef CPPTL_JSON_READER_H_INCLUDED
-#define CPPTL_JSON_READER_H_INCLUDED
-
-#if !defined(JSON_IS_AMALGAMATION)
-#include "features.h"
-#include "value.h"
-#endif // if !defined(JSON_IS_AMALGAMATION)
-#include <deque>
-#include <iosfwd>
-#include <stack>
-#include <string>
-#include <istream>
-
-// Disable warning C4251: <data member>: <type> needs to have dll-interface to
-// be used by...
-#if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-#pragma warning(push)
-#pragma warning(disable : 4251)
-#endif // if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-
-namespace rmq {
-namespace Json {
-
-/** \brief Unserialize a <a HREF="http://www.json.org">JSON</a> document into a
- *Value.
- *
- * \deprecated Use CharReader and CharReaderBuilder.
- */
-class JSON_API Reader {
-public:
- typedef char Char;
- typedef const Char* Location;
-
- /** \brief An error tagged with where in the JSON text it was encountered.
- *
- * The offsets give the [start, limit) range of bytes within the text. Note
- * that this is bytes, not codepoints.
- *
- */
- struct StructuredError {
- ptrdiff_t offset_start;
- ptrdiff_t offset_limit;
- JSONCPP_STRING message;
- };
-
- /** \brief Constructs a Reader allowing all features
- * for parsing.
- */
- Reader();
-
- /** \brief Constructs a Reader allowing the specified feature set
- * for parsing.
- */
- Reader(const Features& features);
-
- /** \brief Read a Value from a <a HREF="http://www.json.org">JSON</a>
- * document.
- * \param document UTF-8 encoded string containing the document to read.
- * \param root [out] Contains the root value of the document if it was
- * successfully parsed.
- * \param collectComments \c true to collect comment and allow writing them
- * back during
- * serialization, \c false to discard comments.
- * This parameter is ignored if
- * Features::allowComments_
- * is \c false.
- * \return \c true if the document was successfully parsed, \c false if an
- * error occurred.
- */
- bool
- parse(const std::string& document, Value& root, bool collectComments = true);
-
- /** \brief Read a Value from a <a HREF="http://www.json.org">JSON</a>
- document.
- * \param beginDoc Pointer on the beginning of the UTF-8 encoded string of the
- document to read.
- * \param endDoc Pointer on the end of the UTF-8 encoded string of the
- document to read.
- * Must be >= beginDoc.
- * \param root [out] Contains the root value of the document if it was
- * successfully parsed.
- * \param collectComments \c true to collect comment and allow writing them
- back during
- * serialization, \c false to discard comments.
- * This parameter is ignored if
- Features::allowComments_
- * is \c false.
- * \return \c true if the document was successfully parsed, \c false if an
- error occurred.
- */
- bool parse(const char* beginDoc,
- const char* endDoc,
- Value& root,
- bool collectComments = true);
-
- /// \brief Parse from input stream.
- /// \see Json::operator>>(std::istream&, Json::Value&).
- bool parse(JSONCPP_ISTREAM& is, Value& root, bool collectComments = true);
-
- /** \brief Returns a user friendly string that list errors in the parsed
- * document.
- * \return Formatted error message with the list of errors with their location
- * in
- * the parsed document. An empty string is returned if no error
- * occurred
- * during parsing.
- * \deprecated Use getFormattedErrorMessages() instead (typo fix).
- */
- JSONCPP_DEPRECATED("Use getFormattedErrorMessages() instead.")
- JSONCPP_STRING getFormatedErrorMessages() const;
-
- /** \brief Returns a user friendly string that list errors in the parsed
- * document.
- * \return Formatted error message with the list of errors with their location
- * in
- * the parsed document. An empty string is returned if no error
- * occurred
- * during parsing.
- */
- JSONCPP_STRING getFormattedErrorMessages() const;
-
- /** \brief Returns a vector of structured erros encounted while parsing.
- * \return A (possibly empty) vector of StructuredError objects. Currently
- * only one error can be returned, but the caller should tolerate
- * multiple
- * errors. This can occur if the parser recovers from a non-fatal
- * parse error and then encounters additional errors.
- */
- std::vector<StructuredError> getStructuredErrors() const;
-
- /** \brief Add a semantic error message.
- * \param value JSON Value location associated with the error
- * \param message The error message.
- * \return \c true if the error was successfully added, \c false if the
- * Value offset exceeds the document size.
- */
- bool pushError(const Value& value, const JSONCPP_STRING& message);
-
- /** \brief Add a semantic error message with extra context.
- * \param value JSON Value location associated with the error
- * \param message The error message.
- * \param extra Additional JSON Value location to contextualize the error
- * \return \c true if the error was successfully added, \c false if either
- * Value offset exceeds the document size.
- */
- bool pushError(const Value& value, const JSONCPP_STRING& message, const Value& extra);
-
- /** \brief Return whether there are any errors.
- * \return \c true if there are no errors to report \c false if
- * errors have occurred.
- */
- bool good() const;
-
-private:
- enum TokenType {
- tokenEndOfStream = 0,
- tokenObjectBegin,
- tokenObjectEnd,
- tokenArrayBegin,
- tokenArrayEnd,
- tokenString,
- tokenNumber,
- tokenTrue,
- tokenFalse,
- tokenNull,
- tokenArraySeparator,
- tokenMemberSeparator,
- tokenComment,
- tokenError
- };
-
- class Token {
- public:
- TokenType type_;
- Location start_;
- Location end_;
- };
-
- class ErrorInfo {
- public:
- Token token_;
- JSONCPP_STRING message_;
- Location extra_;
- };
-
- typedef std::deque<ErrorInfo> Errors;
-
- bool readToken(Token& token);
- void skipSpaces();
- bool match(Location pattern, int patternLength);
- bool readComment();
- bool readCStyleComment();
- bool readCppStyleComment();
- bool readString();
- void readNumber();
- bool readValue();
- bool readObject(Token& token);
- bool readArray(Token& token);
- bool decodeNumber(Token& token);
- bool decodeNumber(Token& token, Value& decoded);
- bool decodeString(Token& token);
- bool decodeString(Token& token, JSONCPP_STRING& decoded);
- bool decodeDouble(Token& token);
- bool decodeDouble(Token& token, Value& decoded);
- bool decodeUnicodeCodePoint(Token& token,
- Location& current,
- Location end,
- unsigned int& unicode);
- bool decodeUnicodeEscapeSequence(Token& token,
- Location& current,
- Location end,
- unsigned int& unicode);
- bool addError(const JSONCPP_STRING& message, Token& token, Location extra = 0);
- bool recoverFromError(TokenType skipUntilToken);
- bool addErrorAndRecover(const JSONCPP_STRING& message,
- Token& token,
- TokenType skipUntilToken);
- void skipUntilSpace();
- Value& currentValue();
- Char getNextChar();
- void
- getLocationLineAndColumn(Location location, int& line, int& column) const;
- JSONCPP_STRING getLocationLineAndColumn(Location location) const;
- void addComment(Location begin, Location end, CommentPlacement placement);
- void skipCommentTokens(Token& token);
-
- typedef std::stack<Value*> Nodes;
- Nodes nodes_;
- Errors errors_;
- JSONCPP_STRING document_;
- Location begin_;
- Location end_;
- Location current_;
- Location lastValueEnd_;
- Value* lastValue_;
- JSONCPP_STRING commentsBefore_;
- Features features_;
- bool collectComments_;
-}; // Reader
-
-/** Interface for reading JSON from a char array.
- */
-class JSON_API CharReader {
-public:
- virtual ~CharReader() {}
- /** \brief Read a Value from a <a HREF="http://www.json.org">JSON</a>
- document.
- * The document must be a UTF-8 encoded string containing the document to read.
- *
- * \param beginDoc Pointer on the beginning of the UTF-8 encoded string of the
- document to read.
- * \param endDoc Pointer on the end of the UTF-8 encoded string of the
- document to read.
- * Must be >= beginDoc.
- * \param root [out] Contains the root value of the document if it was
- * successfully parsed.
- * \param errs [out] Formatted error messages (if not NULL)
- * a user friendly string that lists errors in the parsed
- * document.
- * \return \c true if the document was successfully parsed, \c false if an
- error occurred.
- */
- virtual bool parse(
- char const* beginDoc, char const* endDoc,
- Value* root, JSONCPP_STRING* errs) = 0;
-
- class JSON_API Factory {
- public:
- virtual ~Factory() {}
- /** \brief Allocate a CharReader via operator new().
- * \throw std::exception if something goes wrong (e.g. invalid settings)
- */
- virtual CharReader* newCharReader() const = 0;
- }; // Factory
-}; // CharReader
-
-/** \brief Build a CharReader implementation.
-
-Usage:
-\code
- using namespace Json;
- CharReaderBuilder builder;
- builder["collectComments"] = false;
- Value value;
- JSONCPP_STRING errs;
- bool ok = parseFromStream(builder, std::cin, &value, &errs);
-\endcode
-*/
-class JSON_API CharReaderBuilder : public CharReader::Factory {
-public:
- // Note: We use a Json::Value so that we can add data-members to this class
- // without a major version bump.
- /** Configuration of this builder.
- These are case-sensitive.
- Available settings (case-sensitive):
- - `"collectComments": false or true`
- - true to collect comment and allow writing them
- back during serialization, false to discard comments.
- This parameter is ignored if allowComments is false.
- - `"allowComments": false or true`
- - true if comments are allowed.
- - `"strictRoot": false or true`
- - true if root must be either an array or an object value
- - `"allowDroppedNullPlaceholders": false or true`
- - true if dropped null placeholders are allowed. (See StreamWriterBuilder.)
- - `"allowNumericKeys": false or true`
- - true if numeric object keys are allowed.
- - `"allowSingleQuotes": false or true`
- - true if '' are allowed for strings (both keys and values)
- - `"stackLimit": integer`
- - Exceeding stackLimit (recursive depth of `readValue()`) will
- cause an exception.
- - This is a security issue (seg-faults caused by deeply nested JSON),
- so the default is low.
- - `"failIfExtra": false or true`
- - If true, `parse()` returns false when extra non-whitespace trails
- the JSON value in the input string.
- - `"rejectDupKeys": false or true`
- - If true, `parse()` returns false when a key is duplicated within an object.
- - `"allowSpecialFloats": false or true`
- - If true, special float values (NaNs and infinities) are allowed
- and their values are lossfree restorable.
-
- You can examine 'settings_` yourself
- to see the defaults. You can also write and read them just like any
- JSON Value.
- \sa setDefaults()
- */
- Value settings_;
-
- CharReaderBuilder();
- ~CharReaderBuilder() JSONCPP_OVERRIDE;
-
- CharReader* newCharReader() const JSONCPP_OVERRIDE;
-
- /** \return true if 'settings' are legal and consistent;
- * otherwise, indicate bad settings via 'invalid'.
- */
- bool validate(Value* invalid) const;
-
- /** A simple way to update a specific setting.
- */
- Value& operator[](JSONCPP_STRING key);
-
- /** Called by ctor, but you can use this to reset settings_.
- * \pre 'settings' != NULL (but Json::null is fine)
- * \remark Defaults:
- * \snippet src/lib_json/json_reader.cpp CharReaderBuilderDefaults
- */
- static void setDefaults(Value* settings);
- /** Same as old Features::strictMode().
- * \pre 'settings' != NULL (but Json::null is fine)
- * \remark Defaults:
- * \snippet src/lib_json/json_reader.cpp CharReaderBuilderStrictMode
- */
- static void strictMode(Value* settings);
-};
-
-/** Consume entire stream and use its begin/end.
- * Someday we might have a real StreamReader, but for now this
- * is convenient.
- */
-bool JSON_API parseFromStream(
- CharReader::Factory const&,
- JSONCPP_ISTREAM&,
- Value* root, std::string* errs);
-
-/** \brief Read from 'sin' into 'root'.
-
- Always keep comments from the input JSON.
-
- This can be used to read a file into a particular sub-object.
- For example:
- \code
- Json::Value root;
- cin >> root["dir"]["file"];
- cout << root;
- \endcode
- Result:
- \verbatim
- {
- "dir": {
- "file": {
- // The input stream JSON would be nested here.
- }
- }
- }
- \endverbatim
- \throw std::exception on parse error.
- \see Json::operator<<()
-*/
-JSON_API JSONCPP_ISTREAM& operator>>(JSONCPP_ISTREAM&, Value&);
-
-} // namespace Json
-} // namespace rmq
-
-#if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-#pragma warning(pop)
-#endif // if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-
-#endif // CPPTL_JSON_READER_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/value.h b/rocketmq-client4cpp/src/jsoncpp/json/value.h
deleted file mode 100755
index 07ba7c69..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/value.h
+++ /dev/null
@@ -1,868 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef CPPTL_JSON_H_INCLUDED
-#define CPPTL_JSON_H_INCLUDED
-
-#if !defined(JSON_IS_AMALGAMATION)
-#include "forwards.h"
-#endif // if !defined(JSON_IS_AMALGAMATION)
-#include <string>
-#include <vector>
-#include <exception>
-
-#ifndef JSON_USE_CPPTL_SMALLMAP
-#include <map>
-#else
-#include <cpptl/smallmap.h>
-#endif
-#ifdef JSON_USE_CPPTL
-#include <cpptl/forwards.h>
-#endif
-
-//Conditional NORETURN attribute on the throw functions would:
-// a) suppress false positives from static code analysis
-// b) possibly improve optimization opportunities.
-#if !defined(JSONCPP_NORETURN)
-# if defined(_MSC_VER)
-# define JSONCPP_NORETURN __declspec(noreturn)
-# elif defined(__GNUC__)
-# define JSONCPP_NORETURN __attribute__ ((__noreturn__))
-# else
-# define JSONCPP_NORETURN
-# endif
-#endif
-
-// Disable warning C4251: <data member>: <type> needs to have dll-interface to
-// be used by...
-#if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-#pragma warning(push)
-#pragma warning(disable : 4251)
-#endif // if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-
-/** \brief JSON (JavaScript Object Notation).
- */
-namespace rmq {
-namespace Json {
-
-/** Base class for all exceptions we throw.
- *
- * We use nothing but these internally. Of course, STL can throw others.
- */
-class JSON_API Exception : public std::exception {
-public:
- Exception(JSONCPP_STRING const& msg);
- ~Exception() throw() JSONCPP_OVERRIDE;
- char const* what() const throw() JSONCPP_OVERRIDE;
-protected:
- JSONCPP_STRING msg_;
-};
-
-/** Exceptions which the user cannot easily avoid.
- *
- * E.g. out-of-memory (when we use malloc), stack-overflow, malicious input
- *
- * \remark derived from Json::Exception
- */
-class JSON_API RuntimeError : public Exception {
-public:
- RuntimeError(JSONCPP_STRING const& msg);
-};
-
-/** Exceptions thrown by JSON_ASSERT/JSON_FAIL macros.
- *
- * These are precondition-violations (user bugs) and internal errors (our bugs).
- *
- * \remark derived from Json::Exception
- */
-class JSON_API LogicError : public Exception {
-public:
- LogicError(JSONCPP_STRING const& msg);
-};
-
-/// used internally
-JSONCPP_NORETURN void throwRuntimeError(JSONCPP_STRING const& msg);
-/// used internally
-JSONCPP_NORETURN void throwLogicError(JSONCPP_STRING const& msg);
-
-/** \brief Type of the value held by a Value object.
- */
-enum ValueType {
- nullValue = 0, ///< 'null' value
- intValue, ///< signed integer value
- uintValue, ///< unsigned integer value
- realValue, ///< double value
- stringValue, ///< UTF-8 string value
- booleanValue, ///< bool value
- arrayValue, ///< array value (ordered list)
- objectValue ///< object value (collection of name/value pairs).
-};
-
-enum CommentPlacement {
- commentBefore = 0, ///< a comment placed on the line before a value
- commentAfterOnSameLine, ///< a comment just after a value on the same line
- commentAfter, ///< a comment on the line after a value (only make sense for
- /// root value)
- numberOfCommentPlacement
-};
-
-//# ifdef JSON_USE_CPPTL
-// typedef CppTL::AnyEnumerator<const char *> EnumMemberNames;
-// typedef CppTL::AnyEnumerator<const Value &> EnumValues;
-//# endif
-
-/** \brief Lightweight wrapper to tag static string.
- *
- * Value constructor and objectValue member assignement takes advantage of the
- * StaticString and avoid the cost of string duplication when storing the
- * string or the member name.
- *
- * Example of usage:
- * \code
- * Json::Value aValue( StaticString("some text") );
- * Json::Value object;
- * static const StaticString code("code");
- * object[code] = 1234;
- * \endcode
- */
-class JSON_API StaticString {
-public:
- explicit StaticString(const char* czstring) : c_str_(czstring) {}
-
- operator const char*() const { return c_str_; }
-
- const char* c_str() const { return c_str_; }
-
-private:
- const char* c_str_;
-};
-
-/** \brief Represents a <a HREF="http://www.json.org">JSON</a> value.
- *
- * This class is a discriminated union wrapper that can represents a:
- * - signed integer [range: Value::minInt - Value::maxInt]
- * - unsigned integer (range: 0 - Value::maxUInt)
- * - double
- * - UTF-8 string
- * - boolean
- * - 'null'
- * - an ordered list of Value
- * - collection of name/value pairs (javascript object)
- *
- * The type of the held value is represented by a #ValueType and
- * can be obtained using type().
- *
- * Values of an #objectValue or #arrayValue can be accessed using operator[]()
- * methods.
- * Non-const methods will automatically create the a #nullValue element
- * if it does not exist.
- * The sequence of an #arrayValue will be automatically resized and initialized
- * with #nullValue. resize() can be used to enlarge or truncate an #arrayValue.
- *
- * The get() methods can be used to obtain default value in the case the
- * required element does not exist.
- *
- * It is possible to iterate over the list of a #objectValue values using
- * the getMemberNames() method.
- *
- * \note #Value string-length fit in size_t, but keys must be < 2^30.
- * (The reason is an implementation detail.) A #CharReader will raise an
- * exception if a bound is exceeded to avoid security holes in your app,
- * but the Value API does *not* check bounds. That is the responsibility
- * of the caller.
- */
-class JSON_API Value {
- friend class ValueIteratorBase;
-public:
- typedef std::vector<JSONCPP_STRING> Members;
- typedef ValueIterator iterator;
- typedef ValueConstIterator const_iterator;
- typedef rmq::Json::UInt UInt;
- typedef rmq::Json::Int Int;
-#if defined(JSON_HAS_INT64)
- typedef rmq::Json::UInt64 UInt64;
- typedef rmq::Json::Int64 Int64;
-#endif // defined(JSON_HAS_INT64)
- typedef rmq::Json::LargestInt LargestInt;
- typedef rmq::Json::LargestUInt LargestUInt;
- typedef rmq::Json::ArrayIndex ArrayIndex;
-
- static const Value& null; ///< We regret this reference to a global instance; prefer the simpler Value().
- static const Value& nullRef; ///< just a kludge for binary-compatibility; same as null
- static Value const& nullSingleton(); ///< Prefer this to null or nullRef.
-
- /// Minimum signed integer value that can be stored in a Json::Value.
- static const LargestInt minLargestInt;
- /// Maximum signed integer value that can be stored in a Json::Value.
- static const LargestInt maxLargestInt;
- /// Maximum unsigned integer value that can be stored in a Json::Value.
- static const LargestUInt maxLargestUInt;
-
- /// Minimum signed int value that can be stored in a Json::Value.
- static const Int minInt;
- /// Maximum signed int value that can be stored in a Json::Value.
- static const Int maxInt;
- /// Maximum unsigned int value that can be stored in a Json::Value.
- static const UInt maxUInt;
-
-#if defined(JSON_HAS_INT64)
- /// Minimum signed 64 bits int value that can be stored in a Json::Value.
- static const Int64 minInt64;
- /// Maximum signed 64 bits int value that can be stored in a Json::Value.
- static const Int64 maxInt64;
- /// Maximum unsigned 64 bits int value that can be stored in a Json::Value.
- static const UInt64 maxUInt64;
-#endif // defined(JSON_HAS_INT64)
-
-private:
-#ifndef JSONCPP_DOC_EXCLUDE_IMPLEMENTATION
- class CZString {
- public:
- enum DuplicationPolicy {
- noDuplication = 0,
- duplicate,
- duplicateOnCopy
- };
- CZString(ArrayIndex index);
- CZString(char const* str, unsigned length, DuplicationPolicy allocate);
- CZString(CZString const& other);
-#if JSON_HAS_RVALUE_REFERENCES
- CZString(CZString&& other);
-#endif
- ~CZString();
- CZString& operator=(CZString other);
- bool operator<(CZString const& other) const;
- bool operator==(CZString const& other) const;
- ArrayIndex index() const;
- //const char* c_str() const; ///< \deprecated
- char const* data() const;
- unsigned length() const;
- bool isStaticString() const;
-
- private:
- void swap(CZString& other);
-
- struct StringStorage {
- unsigned policy_: 2;
- unsigned length_: 30; // 1GB max
- };
-
- char const* cstr_; // actually, a prefixed string, unless policy is noDup
- union {
- ArrayIndex index_;
- StringStorage storage_;
- };
- };
-
-public:
-#ifndef JSON_USE_CPPTL_SMALLMAP
- typedef std::map<CZString, Value> ObjectValues;
-#else
- typedef CppTL::SmallMap<CZString, Value> ObjectValues;
-#endif // ifndef JSON_USE_CPPTL_SMALLMAP
-#endif // ifndef JSONCPP_DOC_EXCLUDE_IMPLEMENTATION
-
-public:
- /** \brief Create a default Value of the given type.
-
- This is a very useful constructor.
- To create an empty array, pass arrayValue.
- To create an empty object, pass objectValue.
- Another Value can then be set to this one by assignment.
-This is useful since clear() and resize() will not alter types.
-
- Examples:
-\code
-Json::Value null_value; // null
-Json::Value arr_value(Json::arrayValue); // []
-Json::Value obj_value(Json::objectValue); // {}
-\endcode
- */
- Value(ValueType type = nullValue);
- Value(Int value);
- Value(UInt value);
-#if defined(JSON_HAS_INT64)
- Value(Int64 value);
- Value(UInt64 value);
-#endif // if defined(JSON_HAS_INT64)
- Value(double value);
- Value(const char* value); ///< Copy til first 0. (NULL causes to seg-fault.)
- Value(const char* begin, const char* end); ///< Copy all, incl zeroes.
- /** \brief Constructs a value from a static string.
-
- * Like other value string constructor but do not duplicate the string for
- * internal storage. The given string must remain alive after the call to this
- * constructor.
- * \note This works only for null-terminated strings. (We cannot change the
- * size of this class, so we have nowhere to store the length,
- * which might be computed later for various operations.)
- *
- * Example of usage:
- * \code
- * static StaticString foo("some text");
- * Json::Value aValue(foo);
- * \endcode
- */
- Value(const StaticString& value);
- Value(const JSONCPP_STRING& value); ///< Copy data() til size(). Embedded zeroes too.
-#ifdef JSON_USE_CPPTL
- Value(const CppTL::ConstString& value);
-#endif
- Value(bool value);
- /// Deep copy.
- Value(const Value& other);
-#if JSON_HAS_RVALUE_REFERENCES
- /// Move constructor
- Value(Value&& other);
-#endif
- ~Value();
-
- /// Deep copy, then swap(other).
- /// \note Over-write existing comments. To preserve comments, use #swapPayload().
- Value& operator=(Value other);
- /// Swap everything.
- void swap(Value& other);
- /// Swap values but leave comments and source offsets in place.
- void swapPayload(Value& other);
-
- ValueType type() const;
-
- /// Compare payload only, not comments etc.
- bool operator<(const Value& other) const;
- bool operator<=(const Value& other) const;
- bool operator>=(const Value& other) const;
- bool operator>(const Value& other) const;
- bool operator==(const Value& other) const;
- bool operator!=(const Value& other) const;
- int compare(const Value& other) const;
-
- const char* asCString() const; ///< Embedded zeroes could cause you trouble!
-#if JSONCPP_USING_SECURE_MEMORY
- unsigned getCStringLength() const; //Allows you to understand the length of the CString
-#endif
- JSONCPP_STRING asString() const; ///< Embedded zeroes are possible.
- /** Get raw char* of string-value.
- * \return false if !string. (Seg-fault if str or end are NULL.)
- */
- bool getString(
- char const** begin, char const** end) const;
-#ifdef JSON_USE_CPPTL
- CppTL::ConstString asConstString() const;
-#endif
- Int asInt() const;
- UInt asUInt() const;
-#if defined(JSON_HAS_INT64)
- Int64 asInt64() const;
- UInt64 asUInt64() const;
-#endif // if defined(JSON_HAS_INT64)
- LargestInt asLargestInt() const;
- LargestUInt asLargestUInt() const;
- float asFloat() const;
- double asDouble() const;
- bool asBool() const;
-
- bool isNull() const;
- bool isBool() const;
- bool isInt() const;
- bool isInt64() const;
- bool isUInt() const;
- bool isUInt64() const;
- bool isIntegral() const;
- bool isDouble() const;
- bool isNumeric() const;
- bool isString() const;
- bool isArray() const;
- bool isObject() const;
-
- bool isConvertibleTo(ValueType other) const;
-
- /// Number of values in array or object
- ArrayIndex size() const;
-
- /// \brief Return true if empty array, empty object, or null;
- /// otherwise, false.
- bool empty() const;
-
- /// Return isNull()
- bool operator!() const;
-
- /// Remove all object members and array elements.
- /// \pre type() is arrayValue, objectValue, or nullValue
- /// \post type() is unchanged
- void clear();
-
- /// Resize the array to size elements.
- /// New elements are initialized to null.
- /// May only be called on nullValue or arrayValue.
- /// \pre type() is arrayValue or nullValue
- /// \post type() is arrayValue
- void resize(ArrayIndex size);
-
- /// Access an array element (zero based index ).
- /// If the array contains less than index element, then null value are
- /// inserted
- /// in the array so that its size is index+1.
- /// (You may need to say 'value[0u]' to get your compiler to distinguish
- /// this from the operator[] which takes a string.)
- Value& operator[](ArrayIndex index);
-
- /// Access an array element (zero based index ).
- /// If the array contains less than index element, then null value are
- /// inserted
- /// in the array so that its size is index+1.
- /// (You may need to say 'value[0u]' to get your compiler to distinguish
- /// this from the operator[] which takes a string.)
- //Value& operator[](int index);
-
- /// Access an array element (zero based index )
- /// (You may need to say 'value[0u]' to get your compiler to distinguish
- /// this from the operator[] which takes a string.)
- const Value& operator[](ArrayIndex index) const;
-
- /// Access an array element (zero based index )
- /// (You may need to say 'value[0u]' to get your compiler to distinguish
- /// this from the operator[] which takes a string.)
- //const Value& operator[](int index) const;
-
- /// If the array contains at least index+1 elements, returns the element
- /// value,
- /// otherwise returns defaultValue.
- Value get(ArrayIndex index, const Value& defaultValue) const;
- /// Return true if index < size().
- bool isValidIndex(ArrayIndex index) const;
- /// \brief Append value to array at the end.
- ///
- /// Equivalent to jsonvalue[jsonvalue.size()] = value;
- Value& append(const Value& value);
-
- /// Access an object value by name, create a null member if it does not exist.
- /// \note Because of our implementation, keys are limited to 2^30 -1 chars.
- /// Exceeding that will cause an exception.
- Value& operator[](const char* key);
- /// Access an object value by name, returns null if there is no member with
- /// that name.
- const Value& operator[](const char* key) const;
- /// Access an object value by name, create a null member if it does not exist.
- /// \param key may contain embedded nulls.
- Value& operator[](const JSONCPP_STRING& key);
- /// Access an object value by name, returns null if there is no member with
- /// that name.
- /// \param key may contain embedded nulls.
- const Value& operator[](const JSONCPP_STRING& key) const;
- /** \brief Access an object value by name, create a null member if it does not
- exist.
-
- * If the object has no entry for that name, then the member name used to store
- * the new entry is not duplicated.
- * Example of use:
- * \code
- * Json::Value object;
- * static const StaticString code("code");
- * object[code] = 1234;
- * \endcode
- */
- Value& operator[](const StaticString& key);
-#ifdef JSON_USE_CPPTL
- /// Access an object value by name, create a null member if it does not exist.
- Value& operator[](const CppTL::ConstString& key);
- /// Access an object value by name, returns null if there is no member with
- /// that name.
- const Value& operator[](const CppTL::ConstString& key) const;
-#endif
- /// Return the member named key if it exist, defaultValue otherwise.
- /// \note deep copy
- Value get(const char* key, const Value& defaultValue) const;
- /// Return the member named key if it exist, defaultValue otherwise.
- /// \note deep copy
- /// \note key may contain embedded nulls.
- Value get(const char* begin, const char* end, const Value& defaultValue) const;
- /// Return the member named key if it exist, defaultValue otherwise.
- /// \note deep copy
- /// \param key may contain embedded nulls.
- Value get(const JSONCPP_STRING& key, const Value& defaultValue) const;
-#ifdef JSON_USE_CPPTL
- /// Return the member named key if it exist, defaultValue otherwise.
- /// \note deep copy
- Value get(const CppTL::ConstString& key, const Value& defaultValue) const;
-#endif
- /// Most general and efficient version of isMember()const, get()const,
- /// and operator[]const
- /// \note As stated elsewhere, behavior is undefined if (end-begin) >= 2^30
- Value const* find(char const* begin, char const* end) const;
- /// Most general and efficient version of object-mutators.
- /// \note As stated elsewhere, behavior is undefined if (end-begin) >= 2^30
- /// \return non-zero, but JSON_ASSERT if this is neither object nor nullValue.
- Value const* demand(char const* begin, char const* end);
- /// \brief Remove and return the named member.
- ///
- /// Do nothing if it did not exist.
- /// \return the removed Value, or null.
- /// \pre type() is objectValue or nullValue
- /// \post type() is unchanged
- /// \deprecated
- Value removeMember(const char* key);
- /// Same as removeMember(const char*)
- /// \param key may contain embedded nulls.
- /// \deprecated
- Value removeMember(const JSONCPP_STRING& key);
- /// Same as removeMember(const char* begin, const char* end, Value* removed),
- /// but 'key' is null-terminated.
- bool removeMember(const char* key, Value* removed);
- /** \brief Remove the named map member.
-
- Update 'removed' iff removed.
- \param key may contain embedded nulls.
- \return true iff removed (no exceptions)
- */
- bool removeMember(JSONCPP_STRING const& key, Value* removed);
- /// Same as removeMember(JSONCPP_STRING const& key, Value* removed)
- bool removeMember(const char* begin, const char* end, Value* removed);
- /** \brief Remove the indexed array element.
-
- O(n) expensive operations.
- Update 'removed' iff removed.
- \return true iff removed (no exceptions)
- */
- bool removeIndex(ArrayIndex i, Value* removed);
-
- /// Return true if the object has a member named key.
- /// \note 'key' must be null-terminated.
- bool isMember(const char* key) const;
- /// Return true if the object has a member named key.
- /// \param key may contain embedded nulls.
- bool isMember(const JSONCPP_STRING& key) const;
- /// Same as isMember(JSONCPP_STRING const& key)const
- bool isMember(const char* begin, const char* end) const;
-#ifdef JSON_USE_CPPTL
- /// Return true if the object has a member named key.
- bool isMember(const CppTL::ConstString& key) const;
-#endif
-
- /// \brief Return a list of the member names.
- ///
- /// If null, return an empty list.
- /// \pre type() is objectValue or nullValue
- /// \post if type() was nullValue, it remains nullValue
- Members getMemberNames() const;
-
- //# ifdef JSON_USE_CPPTL
- // EnumMemberNames enumMemberNames() const;
- // EnumValues enumValues() const;
- //# endif
-
- /// \deprecated Always pass len.
- JSONCPP_DEPRECATED("Use setComment(JSONCPP_STRING const&) instead.")
- void setComment(const char* comment, CommentPlacement placement);
- /// Comments must be //... or /* ... */
- void setComment(const char* comment, size_t len, CommentPlacement placement);
- /// Comments must be //... or /* ... */
- void setComment(const JSONCPP_STRING& comment, CommentPlacement placement);
- bool hasComment(CommentPlacement placement) const;
- /// Include delimiters and embedded newlines.
- JSONCPP_STRING getComment(CommentPlacement placement) const;
-
- JSONCPP_STRING toStyledString() const;
-
- const_iterator begin() const;
- const_iterator end() const;
-
- iterator begin();
- iterator end();
-
- // Accessors for the [start, limit) range of bytes within the JSON text from
- // which this value was parsed, if any.
- void setOffsetStart(ptrdiff_t start);
- void setOffsetLimit(ptrdiff_t limit);
- ptrdiff_t getOffsetStart() const;
- ptrdiff_t getOffsetLimit() const;
-
-private:
- void initBasic(ValueType type, bool allocated = false);
-
- Value& resolveReference(const char* key);
- Value& resolveReference(const char* key, const char* end);
-
- struct CommentInfo {
- CommentInfo();
- ~CommentInfo();
-
- void setComment(const char* text, size_t len);
-
- char* comment_;
- };
-
- // struct MemberNamesTransform
- //{
- // typedef const char *result_type;
- // const char *operator()( const CZString &name ) const
- // {
- // return name.c_str();
- // }
- //};
-
- union ValueHolder {
- LargestInt int_;
- LargestUInt uint_;
- double real_;
- bool bool_;
- char* string_; // actually ptr to unsigned, followed by str, unless !allocated_
- ObjectValues* map_;
- } value_;
- ValueType type_ : 8;
- unsigned int allocated_ : 1; // Notes: if declared as bool, bitfield is useless.
- // If not allocated_, string_ must be null-terminated.
- CommentInfo* comments_;
-
- // [start, limit) byte offsets in the source JSON text from which this Value
- // was extracted.
- ptrdiff_t start_;
- ptrdiff_t limit_;
-};
-
-/** \brief Experimental and untested: represents an element of the "path" to
- * access a node.
- */
-class JSON_API PathArgument {
-public:
- friend class Path;
-
- PathArgument();
- PathArgument(ArrayIndex index);
- PathArgument(const char* key);
- PathArgument(const JSONCPP_STRING& key);
-
-private:
- enum Kind {
- kindNone = 0,
- kindIndex,
- kindKey
- };
- JSONCPP_STRING key_;
- ArrayIndex index_;
- Kind kind_;
-};
-
-/** \brief Experimental and untested: represents a "path" to access a node.
- *
- * Syntax:
- * - "." => root node
- * - ".[n]" => elements at index 'n' of root node (an array value)
- * - ".name" => member named 'name' of root node (an object value)
- * - ".name1.name2.name3"
- * - ".[0][1][2].name1[3]"
- * - ".%" => member name is provided as parameter
- * - ".[%]" => index is provied as parameter
- */
-class JSON_API Path {
-public:
- Path(const JSONCPP_STRING& path,
- const PathArgument& a1 = PathArgument(),
- const PathArgument& a2 = PathArgument(),
- const PathArgument& a3 = PathArgument(),
- const PathArgument& a4 = PathArgument(),
- const PathArgument& a5 = PathArgument());
-
- const Value& resolve(const Value& root) const;
- Value resolve(const Value& root, const Value& defaultValue) const;
- /// Creates the "path" to access the specified node and returns a reference on
- /// the node.
- Value& make(Value& root) const;
-
-private:
- typedef std::vector<const PathArgument*> InArgs;
- typedef std::vector<PathArgument> Args;
-
- void makePath(const JSONCPP_STRING& path, const InArgs& in);
- void addPathInArg(const JSONCPP_STRING& path,
- const InArgs& in,
- InArgs::const_iterator& itInArg,
- PathArgument::Kind kind);
- void invalidPath(const JSONCPP_STRING& path, int location);
-
- Args args_;
-};
-
-/** \brief base class for Value iterators.
- *
- */
-class JSON_API ValueIteratorBase {
-public:
- typedef std::bidirectional_iterator_tag iterator_category;
- typedef unsigned int size_t;
- typedef int difference_type;
- typedef ValueIteratorBase SelfType;
-
- bool operator==(const SelfType& other) const { return isEqual(other); }
-
- bool operator!=(const SelfType& other) const { return !isEqual(other); }
-
- difference_type operator-(const SelfType& other) const {
- return other.computeDistance(*this);
- }
-
- /// Return either the index or the member name of the referenced value as a
- /// Value.
- Value key() const;
-
- /// Return the index of the referenced Value, or -1 if it is not an arrayValue.
- UInt index() const;
-
- /// Return the member name of the referenced Value, or "" if it is not an
- /// objectValue.
- /// \note Avoid `c_str()` on result, as embedded zeroes are possible.
- JSONCPP_STRING name() const;
-
- /// Return the member name of the referenced Value. "" if it is not an
- /// objectValue.
- /// \deprecated This cannot be used for UTF-8 strings, since there can be embedded nulls.
- JSONCPP_DEPRECATED("Use `key = name();` instead.")
- char const* memberName() const;
- /// Return the member name of the referenced Value, or NULL if it is not an
- /// objectValue.
- /// \note Better version than memberName(). Allows embedded nulls.
- char const* memberName(char const** end) const;
-
-protected:
- Value& deref() const;
-
- void increment();
-
- void decrement();
-
- difference_type computeDistance(const SelfType& other) const;
-
- bool isEqual(const SelfType& other) const;
-
- void copy(const SelfType& other);
-
-private:
- Value::ObjectValues::iterator current_;
- // Indicates that iterator is for a null value.
- bool isNull_;
-
-public:
- // For some reason, BORLAND needs these at the end, rather
- // than earlier. No idea why.
- ValueIteratorBase();
- explicit ValueIteratorBase(const Value::ObjectValues::iterator& current);
-};
-
-/** \brief const iterator for object and array value.
- *
- */
-class JSON_API ValueConstIterator : public ValueIteratorBase {
- friend class Value;
-
-public:
- typedef const Value value_type;
- //typedef unsigned int size_t;
- //typedef int difference_type;
- typedef const Value& reference;
- typedef const Value* pointer;
- typedef ValueConstIterator SelfType;
-
- ValueConstIterator();
- ValueConstIterator(ValueIterator const& other);
-
-private:
-/*! \internal Use by Value to create an iterator.
- */
- explicit ValueConstIterator(const Value::ObjectValues::iterator& current);
-public:
- SelfType& operator=(const ValueIteratorBase& other);
-
- SelfType operator++(int) {
- SelfType temp(*this);
- ++*this;
- return temp;
- }
-
- SelfType operator--(int) {
- SelfType temp(*this);
- --*this;
- return temp;
- }
-
- SelfType& operator--() {
- decrement();
- return *this;
- }
-
- SelfType& operator++() {
- increment();
- return *this;
- }
-
- reference operator*() const { return deref(); }
-
- pointer operator->() const { return &deref(); }
-};
-
-/** \brief Iterator for object and array value.
- */
-class JSON_API ValueIterator : public ValueIteratorBase {
- friend class Value;
-
-public:
- typedef Value value_type;
- typedef unsigned int size_t;
- typedef int difference_type;
- typedef Value& reference;
- typedef Value* pointer;
- typedef ValueIterator SelfType;
-
- ValueIterator();
- explicit ValueIterator(const ValueConstIterator& other);
- ValueIterator(const ValueIterator& other);
-
-private:
-/*! \internal Use by Value to create an iterator.
- */
- explicit ValueIterator(const Value::ObjectValues::iterator& current);
-public:
- SelfType& operator=(const SelfType& other);
-
- SelfType operator++(int) {
- SelfType temp(*this);
- ++*this;
- return temp;
- }
-
- SelfType operator--(int) {
- SelfType temp(*this);
- --*this;
- return temp;
- }
-
- SelfType& operator--() {
- decrement();
- return *this;
- }
-
- SelfType& operator++() {
- increment();
- return *this;
- }
-
- reference operator*() const { return deref(); }
-
- pointer operator->() const { return &deref(); }
-};
-
-} // namespace Json
-} // namespace rmq
-
-namespace std {
-/// Specialize std::swap() for Json::Value.
-template<>
-inline void swap(rmq::Json::Value& a, rmq::Json::Value& b) { a.swap(b); }
-}
-
-
-#if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-#pragma warning(pop)
-#endif // if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-
-#endif // CPPTL_JSON_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/version.h b/rocketmq-client4cpp/src/jsoncpp/json/version.h
deleted file mode 100644
index 24e2b090..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/version.h
+++ /dev/null
@@ -1,20 +0,0 @@
-// DO NOT EDIT. This file (and "version") is generated by CMake.
-// Run CMake configure step to update it.
-#ifndef JSON_VERSION_H_INCLUDED
-# define JSON_VERSION_H_INCLUDED
-
-# define JSONCPP_VERSION_STRING "1.7.7"
-# define JSONCPP_VERSION_MAJOR 1
-# define JSONCPP_VERSION_MINOR 7
-# define JSONCPP_VERSION_PATCH 7
-# define JSONCPP_VERSION_QUALIFIER
-# define JSONCPP_VERSION_HEXA ((JSONCPP_VERSION_MAJOR << 24) | (JSONCPP_VERSION_MINOR << 16) | (JSONCPP_VERSION_PATCH << 8))
-
-#ifdef JSONCPP_USING_SECURE_MEMORY
-#undef JSONCPP_USING_SECURE_MEMORY
-#endif
-#define JSONCPP_USING_SECURE_MEMORY 0
-// If non-zero, the library zeroes any memory that it has allocated before
-// it frees its memory.
-
-#endif // JSON_VERSION_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json/writer.h b/rocketmq-client4cpp/src/jsoncpp/json/writer.h
deleted file mode 100755
index c244cf42..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json/writer.h
+++ /dev/null
@@ -1,333 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef JSON_WRITER_H_INCLUDED
-#define JSON_WRITER_H_INCLUDED
-
-#if !defined(JSON_IS_AMALGAMATION)
-#include "value.h"
-#endif // if !defined(JSON_IS_AMALGAMATION)
-#include <vector>
-#include <string>
-#include <ostream>
-
-// Disable warning C4251: <data member>: <type> needs to have dll-interface to
-// be used by...
-#if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-#pragma warning(push)
-#pragma warning(disable : 4251)
-#endif // if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-
-namespace rmq {
-namespace Json {
-
-class Value;
-
-/**
-
-Usage:
-\code
- using namespace Json;
- void writeToStdout(StreamWriter::Factory const& factory, Value const& value) {
- std::unique_ptr<StreamWriter> const writer(
- factory.newStreamWriter());
- writer->write(value, &std::cout);
- std::cout << std::endl; // add lf and flush
- }
-\endcode
-*/
-class JSON_API StreamWriter {
-protected:
- JSONCPP_OSTREAM* sout_; // not owned; will not delete
-public:
- StreamWriter();
- virtual ~StreamWriter();
- /** Write Value into document as configured in sub-class.
- Do not take ownership of sout, but maintain a reference during function.
- \pre sout != NULL
- \return zero on success (For now, we always return zero, so check the stream instead.)
- \throw std::exception possibly, depending on configuration
- */
- virtual int write(Value const& root, JSONCPP_OSTREAM* sout) = 0;
-
- /** \brief A simple abstract factory.
- */
- class JSON_API Factory {
- public:
- virtual ~Factory();
- /** \brief Allocate a CharReader via operator new().
- * \throw std::exception if something goes wrong (e.g. invalid settings)
- */
- virtual StreamWriter* newStreamWriter() const = 0;
- }; // Factory
-}; // StreamWriter
-
-/** \brief Write into stringstream, then return string, for convenience.
- * A StreamWriter will be created from the factory, used, and then deleted.
- */
-JSONCPP_STRING JSON_API writeString(StreamWriter::Factory const& factory, Value const& root);
-
-
-/** \brief Build a StreamWriter implementation.
-
-Usage:
-\code
- using namespace Json;
- Value value = ...;
- StreamWriterBuilder builder;
- builder["commentStyle"] = "None";
- builder["indentation"] = " "; // or whatever you like
- std::unique_ptr<Json::StreamWriter> writer(
- builder.newStreamWriter());
- writer->write(value, &std::cout);
- std::cout << std::endl; // add lf and flush
-\endcode
-*/
-class JSON_API StreamWriterBuilder : public StreamWriter::Factory {
-public:
- // Note: We use a Json::Value so that we can add data-members to this class
- // without a major version bump.
- /** Configuration of this builder.
- Available settings (case-sensitive):
- - "commentStyle": "None" or "All"
- - "indentation": "<anything>"
- - "enableYAMLCompatibility": false or true
- - slightly change the whitespace around colons
- - "dropNullPlaceholders": false or true
- - Drop the "null" string from the writer's output for nullValues.
- Strictly speaking, this is not valid JSON. But when the output is being
- fed to a browser's Javascript, it makes for smaller output and the
- browser can handle the output just fine.
- - "useSpecialFloats": false or true
- - If true, outputs non-finite floating point values in the following way:
- NaN values as "NaN", positive infinity as "Infinity", and negative infinity
- as "-Infinity".
-
- You can examine 'settings_` yourself
- to see the defaults. You can also write and read them just like any
- JSON Value.
- \sa setDefaults()
- */
- Value settings_;
-
- StreamWriterBuilder();
- ~StreamWriterBuilder() JSONCPP_OVERRIDE;
-
- /**
- * \throw std::exception if something goes wrong (e.g. invalid settings)
- */
- StreamWriter* newStreamWriter() const JSONCPP_OVERRIDE;
-
- /** \return true if 'settings' are legal and consistent;
- * otherwise, indicate bad settings via 'invalid'.
- */
- bool validate(Value* invalid) const;
- /** A simple way to update a specific setting.
- */
- Value& operator[](JSONCPP_STRING key);
-
- /** Called by ctor, but you can use this to reset settings_.
- * \pre 'settings' != NULL (but Json::null is fine)
- * \remark Defaults:
- * \snippet src/lib_json/json_writer.cpp StreamWriterBuilderDefaults
- */
- static void setDefaults(Value* settings);
-};
-
-/** \brief Abstract class for writers.
- * \deprecated Use StreamWriter. (And really, this is an implementation detail.)
- */
-class JSON_API Writer {
-public:
- virtual ~Writer();
-
- virtual JSONCPP_STRING write(const Value& root) = 0;
-};
-
-/** \brief Outputs a Value in <a HREF="http://www.json.org">JSON</a> format
- *without formatting (not human friendly).
- *
- * The JSON document is written in a single line. It is not intended for 'human'
- *consumption,
- * but may be usefull to support feature such as RPC where bandwith is limited.
- * \sa Reader, Value
- * \deprecated Use StreamWriterBuilder.
- */
-class JSON_API FastWriter : public Writer {
-
-public:
- FastWriter();
- ~FastWriter() JSONCPP_OVERRIDE {}
-
- void enableYAMLCompatibility();
-
- /** \brief Drop the "null" string from the writer's output for nullValues.
- * Strictly speaking, this is not valid JSON. But when the output is being
- * fed to a browser's Javascript, it makes for smaller output and the
- * browser can handle the output just fine.
- */
- void dropNullPlaceholders();
-
- void omitEndingLineFeed();
-
-public: // overridden from Writer
- JSONCPP_STRING write(const Value& root) JSONCPP_OVERRIDE;
-
-private:
- void writeValue(const Value& value);
-
- JSONCPP_STRING document_;
- bool yamlCompatiblityEnabled_;
- bool dropNullPlaceholders_;
- bool omitEndingLineFeed_;
-};
-
-/** \brief Writes a Value in <a HREF="http://www.json.org">JSON</a> format in a
- *human friendly way.
- *
- * The rules for line break and indent are as follow:
- * - Object value:
- * - if empty then print {} without indent and line break
- * - if not empty the print '{', line break & indent, print one value per
- *line
- * and then unindent and line break and print '}'.
- * - Array value:
- * - if empty then print [] without indent and line break
- * - if the array contains no object value, empty array or some other value
- *types,
- * and all the values fit on one lines, then print the array on a single
- *line.
- * - otherwise, it the values do not fit on one line, or the array contains
- * object or non empty array, then print one value per line.
- *
- * If the Value have comments then they are outputed according to their
- *#CommentPlacement.
- *
- * \sa Reader, Value, Value::setComment()
- * \deprecated Use StreamWriterBuilder.
- */
-class JSON_API StyledWriter : public Writer {
-public:
- StyledWriter();
- ~StyledWriter() JSONCPP_OVERRIDE {}
-
-public: // overridden from Writer
- /** \brief Serialize a Value in <a HREF="http://www.json.org">JSON</a> format.
- * \param root Value to serialize.
- * \return String containing the JSON document that represents the root value.
- */
- JSONCPP_STRING write(const Value& root) JSONCPP_OVERRIDE;
-
-private:
- void writeValue(const Value& value);
- void writeArrayValue(const Value& value);
- bool isMultineArray(const Value& value);
- void pushValue(const JSONCPP_STRING& value);
- void writeIndent();
- void writeWithIndent(const JSONCPP_STRING& value);
- void indent();
- void unindent();
- void writeCommentBeforeValue(const Value& root);
- void writeCommentAfterValueOnSameLine(const Value& root);
- bool hasCommentForValue(const Value& value);
- static JSONCPP_STRING normalizeEOL(const JSONCPP_STRING& text);
-
- typedef std::vector<JSONCPP_STRING> ChildValues;
-
- ChildValues childValues_;
- JSONCPP_STRING document_;
- JSONCPP_STRING indentString_;
- unsigned int rightMargin_;
- unsigned int indentSize_;
- bool addChildValues_;
-};
-
-/** \brief Writes a Value in <a HREF="http://www.json.org">JSON</a> format in a
- human friendly way,
- to a stream rather than to a string.
- *
- * The rules for line break and indent are as follow:
- * - Object value:
- * - if empty then print {} without indent and line break
- * - if not empty the print '{', line break & indent, print one value per
- line
- * and then unindent and line break and print '}'.
- * - Array value:
- * - if empty then print [] without indent and line break
- * - if the array contains no object value, empty array or some other value
- types,
- * and all the values fit on one lines, then print the array on a single
- line.
- * - otherwise, it the values do not fit on one line, or the array contains
- * object or non empty array, then print one value per line.
- *
- * If the Value have comments then they are outputed according to their
- #CommentPlacement.
- *
- * \param indentation Each level will be indented by this amount extra.
- * \sa Reader, Value, Value::setComment()
- * \deprecated Use StreamWriterBuilder.
- */
-class JSON_API StyledStreamWriter {
-public:
- StyledStreamWriter(JSONCPP_STRING indentation = "\t");
- ~StyledStreamWriter() {}
-
-public:
- /** \brief Serialize a Value in <a HREF="http://www.json.org">JSON</a> format.
- * \param out Stream to write to. (Can be ostringstream, e.g.)
- * \param root Value to serialize.
- * \note There is no point in deriving from Writer, since write() should not
- * return a value.
- */
- void write(JSONCPP_OSTREAM& out, const Value& root);
-
-private:
- void writeValue(const Value& value);
- void writeArrayValue(const Value& value);
- bool isMultineArray(const Value& value);
- void pushValue(const JSONCPP_STRING& value);
- void writeIndent();
- void writeWithIndent(const JSONCPP_STRING& value);
- void indent();
- void unindent();
- void writeCommentBeforeValue(const Value& root);
- void writeCommentAfterValueOnSameLine(const Value& root);
- bool hasCommentForValue(const Value& value);
- static JSONCPP_STRING normalizeEOL(const JSONCPP_STRING& text);
-
- typedef std::vector<JSONCPP_STRING> ChildValues;
-
- ChildValues childValues_;
- JSONCPP_OSTREAM* document_;
- JSONCPP_STRING indentString_;
- unsigned int rightMargin_;
- JSONCPP_STRING indentation_;
- bool addChildValues_ : 1;
- bool indented_ : 1;
-};
-
-#if defined(JSON_HAS_INT64)
-JSONCPP_STRING JSON_API valueToString(Int value);
-JSONCPP_STRING JSON_API valueToString(UInt value);
-#endif // if defined(JSON_HAS_INT64)
-JSONCPP_STRING JSON_API valueToString(LargestInt value);
-JSONCPP_STRING JSON_API valueToString(LargestUInt value);
-JSONCPP_STRING JSON_API valueToString(double value);
-JSONCPP_STRING JSON_API valueToString(bool value);
-JSONCPP_STRING JSON_API valueToQuotedString(const char* value);
-
-/// \brief Output using the StyledStreamWriter.
-/// \see Json::operator>>()
-JSON_API JSONCPP_OSTREAM& operator<<(JSONCPP_OSTREAM&, const Value& root);
-
-} // namespace Json
-} // namespace rmq
-
-#if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-#pragma warning(pop)
-#endif // if defined(JSONCPP_DISABLE_DLL_INTERFACE_WARNING)
-
-#endif // JSON_WRITER_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json_reader.cpp b/rocketmq-client4cpp/src/jsoncpp/json_reader.cpp
deleted file mode 100755
index d6f87e67..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json_reader.cpp
+++ /dev/null
@@ -1,2042 +0,0 @@
-// Copyright 2007-2011 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#if !defined(JSON_IS_AMALGAMATION)
-#include <json/assertions.h>
-#include <json/reader.h>
-#include <json/value.h>
-#include "json_tool.h"
-#endif // if !defined(JSON_IS_AMALGAMATION)
-#include <utility>
-#include <cstdio>
-#include <cassert>
-#include <cstring>
-#include <istream>
-#include <sstream>
-#include <memory>
-#include <set>
-#include <limits>
-
-#if defined(_MSC_VER)
-#if !defined(WINCE) && defined(__STDC_SECURE_LIB__) && _MSC_VER >= 1500 // VC++ 9.0 and above
-#define snprintf sprintf_s
-#elif _MSC_VER >= 1900 // VC++ 14.0 and above
-#define snprintf std::snprintf
-#else
-#define snprintf _snprintf
-#endif
-#elif defined(__ANDROID__) || defined(__QNXNTO__)
-#define snprintf snprintf
-#elif __cplusplus >= 201103L
-#if !defined(__MINGW32__) && !defined(__CYGWIN__)
-#define snprintf std::snprintf
-#endif
-#endif
-
-#if defined(__QNXNTO__)
-#define sscanf std::sscanf
-#endif
-
-#if defined(_MSC_VER) && _MSC_VER >= 1400 // VC++ 8.0
-// Disable warning about strdup being deprecated.
-#pragma warning(disable : 4996)
-#endif
-
-static int const stackLimit_g = 1000;
-static int stackDepth_g = 0; // see readValue()
-
-namespace rmq {
-namespace Json {
-
-#if __cplusplus >= 201103L || (defined(_CPPLIB_VER) && _CPPLIB_VER >= 520)
-typedef std::unique_ptr<CharReader> CharReaderPtr;
-#else
-typedef std::auto_ptr<CharReader> CharReaderPtr;
-#endif
-
-// Implementation of class Features
-// ////////////////////////////////
-
-Features::Features()
- : allowComments_(true), strictRoot_(false),
- allowDroppedNullPlaceholders_(false), allowNumericKeys_(true) {}
-
-Features Features::all() { return Features(); }
-
-Features Features::strictMode() {
- Features features;
- features.allowComments_ = false;
- features.strictRoot_ = true;
- features.allowDroppedNullPlaceholders_ = false;
- features.allowNumericKeys_ = false;
- return features;
-}
-
-// Implementation of class Reader
-// ////////////////////////////////
-
-static bool containsNewLine(Reader::Location begin, Reader::Location end) {
- for (; begin < end; ++begin)
- if (*begin == '\n' || *begin == '\r')
- return true;
- return false;
-}
-
-// Class Reader
-// //////////////////////////////////////////////////////////////////
-
-Reader::Reader()
- : errors_(), document_(), begin_(), end_(), current_(), lastValueEnd_(),
- lastValue_(), commentsBefore_(), features_(Features::all()),
- collectComments_() {}
-
-Reader::Reader(const Features& features)
- : errors_(), document_(), begin_(), end_(), current_(), lastValueEnd_(),
- lastValue_(), commentsBefore_(), features_(features), collectComments_() {
-}
-
-bool
-Reader::parse(const std::string& document, Value& root, bool collectComments) {
- JSONCPP_STRING documentCopy(document.data(), document.data() + document.capacity());
- std::swap(documentCopy, document_);
- const char* begin = document_.c_str();
- const char* end = begin + document_.length();
- return parse(begin, end, root, collectComments);
-}
-
-bool Reader::parse(std::istream& sin, Value& root, bool collectComments) {
- // std::istream_iterator<char> begin(sin);
- // std::istream_iterator<char> end;
- // Those would allow streamed input from a file, if parse() were a
- // template function.
-
- // Since JSONCPP_STRING is reference-counted, this at least does not
- // create an extra copy.
- JSONCPP_STRING doc;
- std::getline(sin, doc, (char)EOF);
- return parse(doc.data(), doc.data() + doc.size(), root, collectComments);
-}
-
-bool Reader::parse(const char* beginDoc,
- const char* endDoc,
- Value& root,
- bool collectComments) {
- if (!features_.allowComments_) {
- collectComments = false;
- }
-
- begin_ = beginDoc;
- end_ = endDoc;
- collectComments_ = collectComments;
- current_ = begin_;
- lastValueEnd_ = 0;
- lastValue_ = 0;
- commentsBefore_ = "";
- errors_.clear();
- while (!nodes_.empty())
- nodes_.pop();
- nodes_.push(&root);
-
- stackDepth_g = 0; // Yes, this is bad coding, but options are limited.
- bool successful = readValue();
- Token token;
- skipCommentTokens(token);
- if (collectComments_ && !commentsBefore_.empty())
- root.setComment(commentsBefore_, commentAfter);
- if (features_.strictRoot_) {
- if (!root.isArray() && !root.isObject()) {
- // Set error location to start of doc, ideally should be first token found
- // in doc
- token.type_ = tokenError;
- token.start_ = beginDoc;
- token.end_ = endDoc;
- addError(
- "A valid JSON document must be either an array or an object value.",
- token);
- return false;
- }
- }
- return successful;
-}
-
-bool Reader::readValue() {
- // This is a non-reentrant way to support a stackLimit. Terrible!
- // But this deprecated class has a security problem: Bad input can
- // cause a seg-fault. This seems like a fair, binary-compatible way
- // to prevent the problem.
- if (stackDepth_g >= stackLimit_g) throwRuntimeError("Exceeded stackLimit in readValue().");
- ++stackDepth_g;
-
- Token token;
- skipCommentTokens(token);
- bool successful = true;
-
- if (collectComments_ && !commentsBefore_.empty()) {
- currentValue().setComment(commentsBefore_, commentBefore);
- commentsBefore_ = "";
- }
-
- switch (token.type_) {
- case tokenObjectBegin:
- successful = readObject(token);
- currentValue().setOffsetLimit(current_ - begin_);
- break;
- case tokenArrayBegin:
- successful = readArray(token);
- currentValue().setOffsetLimit(current_ - begin_);
- break;
- case tokenNumber:
- successful = decodeNumber(token);
- break;
- case tokenString:
- successful = decodeString(token);
- break;
- case tokenTrue:
- {
- Value v(true);
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- }
- break;
- case tokenFalse:
- {
- Value v(false);
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- }
- break;
- case tokenNull:
- {
- Value v;
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- }
- break;
- case tokenArraySeparator:
- case tokenObjectEnd:
- case tokenArrayEnd:
- if (features_.allowDroppedNullPlaceholders_) {
- // "Un-read" the current token and mark the current value as a null
- // token.
- current_--;
- Value v;
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(current_ - begin_ - 1);
- currentValue().setOffsetLimit(current_ - begin_);
- break;
- } // Else, fall through...
- default:
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- return addError("Syntax error: value, object or array expected.", token);
- }
-
- if (collectComments_) {
- lastValueEnd_ = current_;
- lastValue_ = ¤tValue();
- }
-
- --stackDepth_g;
- return successful;
-}
-
-void Reader::skipCommentTokens(Token& token) {
- if (features_.allowComments_) {
- do {
- readToken(token);
- } while (token.type_ == tokenComment);
- } else {
- readToken(token);
- }
-}
-
-bool Reader::readToken(Token& token) {
- skipSpaces();
- token.start_ = current_;
- Char c = getNextChar();
- bool ok = true;
- switch (c) {
- case '{':
- token.type_ = tokenObjectBegin;
- break;
- case '}':
- token.type_ = tokenObjectEnd;
- break;
- case '[':
- token.type_ = tokenArrayBegin;
- break;
- case ']':
- token.type_ = tokenArrayEnd;
- break;
- case '"':
- token.type_ = tokenString;
- ok = readString();
- break;
- case '/':
- token.type_ = tokenComment;
- ok = readComment();
- break;
- case '0':
- case '1':
- case '2':
- case '3':
- case '4':
- case '5':
- case '6':
- case '7':
- case '8':
- case '9':
- case '-':
- token.type_ = tokenNumber;
- readNumber();
- break;
- case 't':
- token.type_ = tokenTrue;
- ok = match("rue", 3);
- break;
- case 'f':
- token.type_ = tokenFalse;
- ok = match("alse", 4);
- break;
- case 'n':
- token.type_ = tokenNull;
- ok = match("ull", 3);
- break;
- case ',':
- token.type_ = tokenArraySeparator;
- break;
- case ':':
- token.type_ = tokenMemberSeparator;
- break;
- case 0:
- token.type_ = tokenEndOfStream;
- break;
- default:
- ok = false;
- break;
- }
- if (!ok)
- token.type_ = tokenError;
- token.end_ = current_;
- return true;
-}
-
-void Reader::skipSpaces() {
- while (current_ != end_) {
- Char c = *current_;
- if (c == ' ' || c == '\t' || c == '\r' || c == '\n')
- ++current_;
- else
- break;
- }
-}
-
-bool Reader::match(Location pattern, int patternLength) {
- if (end_ - current_ < patternLength)
- return false;
- int index = patternLength;
- while (index--)
- if (current_[index] != pattern[index])
- return false;
- current_ += patternLength;
- return true;
-}
-
-bool Reader::readComment() {
- Location commentBegin = current_ - 1;
- Char c = getNextChar();
- bool successful = false;
- if (c == '*')
- successful = readCStyleComment();
- else if (c == '/')
- successful = readCppStyleComment();
- if (!successful)
- return false;
-
- if (collectComments_) {
- CommentPlacement placement = commentBefore;
- if (lastValueEnd_ && !containsNewLine(lastValueEnd_, commentBegin)) {
- if (c != '*' || !containsNewLine(commentBegin, current_))
- placement = commentAfterOnSameLine;
- }
-
- addComment(commentBegin, current_, placement);
- }
- return true;
-}
-
-static JSONCPP_STRING normalizeEOL(Reader::Location begin, Reader::Location end) {
- JSONCPP_STRING normalized;
- normalized.reserve(static_cast<size_t>(end - begin));
- Reader::Location current = begin;
- while (current != end) {
- char c = *current++;
- if (c == '\r') {
- if (current != end && *current == '\n')
- // convert dos EOL
- ++current;
- // convert Mac EOL
- normalized += '\n';
- } else {
- normalized += c;
- }
- }
- return normalized;
-}
-
-void
-Reader::addComment(Location begin, Location end, CommentPlacement placement) {
- assert(collectComments_);
- const JSONCPP_STRING& normalized = normalizeEOL(begin, end);
- if (placement == commentAfterOnSameLine) {
- assert(lastValue_ != 0);
- lastValue_->setComment(normalized, placement);
- } else {
- commentsBefore_ += normalized;
- }
-}
-
-bool Reader::readCStyleComment() {
- while ((current_ + 1) < end_) {
- Char c = getNextChar();
- if (c == '*' && *current_ == '/')
- break;
- }
- return getNextChar() == '/';
-}
-
-bool Reader::readCppStyleComment() {
- while (current_ != end_) {
- Char c = getNextChar();
- if (c == '\n')
- break;
- if (c == '\r') {
- // Consume DOS EOL. It will be normalized in addComment.
- if (current_ != end_ && *current_ == '\n')
- getNextChar();
- // Break on Moc OS 9 EOL.
- break;
- }
- }
- return true;
-}
-
-void Reader::readNumber() {
- const char *p = current_;
- char c = '0'; // stopgap for already consumed character
- // integral part
- while (c >= '0' && c <= '9')
- c = (current_ = p) < end_ ? *p++ : '\0';
- // fractional part
- if (c == '.') {
- c = (current_ = p) < end_ ? *p++ : '\0';
- while (c >= '0' && c <= '9')
- c = (current_ = p) < end_ ? *p++ : '\0';
- }
- // exponential part
- if (c == 'e' || c == 'E') {
- c = (current_ = p) < end_ ? *p++ : '\0';
- if (c == '+' || c == '-')
- c = (current_ = p) < end_ ? *p++ : '\0';
- while (c >= '0' && c <= '9')
- c = (current_ = p) < end_ ? *p++ : '\0';
- }
-}
-
-bool Reader::readString() {
- Char c = '\0';
- while (current_ != end_) {
- c = getNextChar();
- if (c == '\\')
- getNextChar();
- else if (c == '"')
- break;
- }
- return c == '"';
-}
-
-bool Reader::readObject(Token& tokenStart) {
- Token tokenName;
- JSONCPP_STRING name;
- Value init(objectValue);
- currentValue().swapPayload(init);
- currentValue().setOffsetStart(tokenStart.start_ - begin_);
- while (readToken(tokenName)) {
- bool initialTokenOk = true;
- while (tokenName.type_ == tokenComment && initialTokenOk)
- initialTokenOk = readToken(tokenName);
- if (!initialTokenOk)
- break;
- if (tokenName.type_ == tokenObjectEnd && name.empty()) // empty object
- return true;
- name = "";
- if (tokenName.type_ == tokenString) {
- if (!decodeString(tokenName, name))
- return recoverFromError(tokenObjectEnd);
- } else if (tokenName.type_ == tokenNumber && features_.allowNumericKeys_) {
- Value numberName;
- if (!decodeNumber(tokenName, numberName))
- return recoverFromError(tokenObjectEnd);
- name = numberName.asString();
- } else {
- break;
- }
-
- Token colon;
- if (!readToken(colon) || colon.type_ != tokenMemberSeparator) {
- return addErrorAndRecover(
- "Missing ':' after object member name", colon, tokenObjectEnd);
- }
- Value& value = currentValue()[name];
- nodes_.push(&value);
- bool ok = readValue();
- nodes_.pop();
- if (!ok) // error already set
- return recoverFromError(tokenObjectEnd);
-
- Token comma;
- if (!readToken(comma) ||
- (comma.type_ != tokenObjectEnd && comma.type_ != tokenArraySeparator &&
- comma.type_ != tokenComment)) {
- return addErrorAndRecover(
- "Missing ',' or '}' in object declaration", comma, tokenObjectEnd);
- }
- bool finalizeTokenOk = true;
- while (comma.type_ == tokenComment && finalizeTokenOk)
- finalizeTokenOk = readToken(comma);
- if (comma.type_ == tokenObjectEnd)
- return true;
- }
- return addErrorAndRecover(
- "Missing '}' or object member name", tokenName, tokenObjectEnd);
-}
-
-bool Reader::readArray(Token& tokenStart) {
- Value init(arrayValue);
- currentValue().swapPayload(init);
- currentValue().setOffsetStart(tokenStart.start_ - begin_);
- skipSpaces();
- if (current_ != end_ && *current_ == ']') // empty array
- {
- Token endArray;
- readToken(endArray);
- return true;
- }
- int index = 0;
- for (;;) {
- Value& value = currentValue()[index++];
- nodes_.push(&value);
- bool ok = readValue();
- nodes_.pop();
- if (!ok) // error already set
- return recoverFromError(tokenArrayEnd);
-
- Token token;
- // Accept Comment after last item in the array.
- ok = readToken(token);
- while (token.type_ == tokenComment && ok) {
- ok = readToken(token);
- }
- bool badTokenType =
- (token.type_ != tokenArraySeparator && token.type_ != tokenArrayEnd);
- if (!ok || badTokenType) {
- return addErrorAndRecover(
- "Missing ',' or ']' in array declaration", token, tokenArrayEnd);
- }
- if (token.type_ == tokenArrayEnd)
- break;
- }
- return true;
-}
-
-bool Reader::decodeNumber(Token& token) {
- Value decoded;
- if (!decodeNumber(token, decoded))
- return false;
- currentValue().swapPayload(decoded);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- return true;
-}
-
-bool Reader::decodeNumber(Token& token, Value& decoded) {
- // Attempts to parse the number as an integer. If the number is
- // larger than the maximum supported value of an integer then
- // we decode the number as a double.
- Location current = token.start_;
- bool isNegative = *current == '-';
- if (isNegative)
- ++current;
- // TODO: Help the compiler do the div and mod at compile time or get rid of them.
- Value::LargestUInt maxIntegerValue =
- isNegative ? Value::LargestUInt(Value::maxLargestInt) + 1
- : Value::maxLargestUInt;
- Value::LargestUInt threshold = maxIntegerValue / 10;
- Value::LargestUInt value = 0;
- while (current < token.end_) {
- Char c = *current++;
- if (c < '0' || c > '9')
- return decodeDouble(token, decoded);
- Value::UInt digit(static_cast<Value::UInt>(c - '0'));
- if (value >= threshold) {
- // We've hit or exceeded the max value divided by 10 (rounded down). If
- // a) we've only just touched the limit, b) this is the last digit, and
- // c) it's small enough to fit in that rounding delta, we're okay.
- // Otherwise treat this number as a double to avoid overflow.
- if (value > threshold || current != token.end_ ||
- digit > maxIntegerValue % 10) {
- return decodeDouble(token, decoded);
- }
- }
- value = value * 10 + digit;
- }
- if (isNegative && value == maxIntegerValue)
- decoded = Value::minLargestInt;
- else if (isNegative)
- decoded = -Value::LargestInt(value);
- else if (value <= Value::LargestUInt(Value::maxInt))
- decoded = Value::LargestInt(value);
- else
- decoded = value;
- return true;
-}
-
-bool Reader::decodeDouble(Token& token) {
- Value decoded;
- if (!decodeDouble(token, decoded))
- return false;
- currentValue().swapPayload(decoded);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- return true;
-}
-
-bool Reader::decodeDouble(Token& token, Value& decoded) {
- double value = 0;
- JSONCPP_STRING buffer(token.start_, token.end_);
- JSONCPP_ISTRINGSTREAM is(buffer);
- if (!(is >> value))
- return addError("'" + JSONCPP_STRING(token.start_, token.end_) +
- "' is not a number.",
- token);
- decoded = value;
- return true;
-}
-
-bool Reader::decodeString(Token& token) {
- JSONCPP_STRING decoded_string;
- if (!decodeString(token, decoded_string))
- return false;
- Value decoded(decoded_string);
- currentValue().swapPayload(decoded);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- return true;
-}
-
-bool Reader::decodeString(Token& token, JSONCPP_STRING& decoded) {
- decoded.reserve(static_cast<size_t>(token.end_ - token.start_ - 2));
- Location current = token.start_ + 1; // skip '"'
- Location end = token.end_ - 1; // do not include '"'
- while (current != end) {
- Char c = *current++;
- if (c == '"')
- break;
- else if (c == '\\') {
- if (current == end)
- return addError("Empty escape sequence in string", token, current);
- Char escape = *current++;
- switch (escape) {
- case '"':
- decoded += '"';
- break;
- case '/':
- decoded += '/';
- break;
- case '\\':
- decoded += '\\';
- break;
- case 'b':
- decoded += '\b';
- break;
- case 'f':
- decoded += '\f';
- break;
- case 'n':
- decoded += '\n';
- break;
- case 'r':
- decoded += '\r';
- break;
- case 't':
- decoded += '\t';
- break;
- case 'u': {
- unsigned int unicode;
- if (!decodeUnicodeCodePoint(token, current, end, unicode))
- return false;
- decoded += codePointToUTF8(unicode);
- } break;
- default:
- return addError("Bad escape sequence in string", token, current);
- }
- } else {
- decoded += c;
- }
- }
- return true;
-}
-
-bool Reader::decodeUnicodeCodePoint(Token& token,
- Location& current,
- Location end,
- unsigned int& unicode) {
-
- if (!decodeUnicodeEscapeSequence(token, current, end, unicode))
- return false;
- if (unicode >= 0xD800 && unicode <= 0xDBFF) {
- // surrogate pairs
- if (end - current < 6)
- return addError(
- "additional six characters expected to parse unicode surrogate pair.",
- token,
- current);
- unsigned int surrogatePair;
- if (*(current++) == '\\' && *(current++) == 'u') {
- if (decodeUnicodeEscapeSequence(token, current, end, surrogatePair)) {
- unicode = 0x10000 + ((unicode & 0x3FF) << 10) + (surrogatePair & 0x3FF);
- } else
- return false;
- } else
- return addError("expecting another \\u token to begin the second half of "
- "a unicode surrogate pair",
- token,
- current);
- }
- return true;
-}
-
-bool Reader::decodeUnicodeEscapeSequence(Token& token,
- Location& current,
- Location end,
- unsigned int& ret_unicode) {
- if (end - current < 4)
- return addError(
- "Bad unicode escape sequence in string: four digits expected.",
- token,
- current);
- int unicode = 0;
- for (int index = 0; index < 4; ++index) {
- Char c = *current++;
- unicode *= 16;
- if (c >= '0' && c <= '9')
- unicode += c - '0';
- else if (c >= 'a' && c <= 'f')
- unicode += c - 'a' + 10;
- else if (c >= 'A' && c <= 'F')
- unicode += c - 'A' + 10;
- else
- return addError(
- "Bad unicode escape sequence in string: hexadecimal digit expected.",
- token,
- current);
- }
- ret_unicode = static_cast<unsigned int>(unicode);
- return true;
-}
-
-bool
-Reader::addError(const JSONCPP_STRING& message, Token& token, Location extra) {
- ErrorInfo info;
- info.token_ = token;
- info.message_ = message;
- info.extra_ = extra;
- errors_.push_back(info);
- return false;
-}
-
-bool Reader::recoverFromError(TokenType skipUntilToken) {
- size_t const errorCount = errors_.size();
- Token skip;
- for (;;) {
- if (!readToken(skip))
- errors_.resize(errorCount); // discard errors caused by recovery
- if (skip.type_ == skipUntilToken || skip.type_ == tokenEndOfStream)
- break;
- }
- errors_.resize(errorCount);
- return false;
-}
-
-bool Reader::addErrorAndRecover(const JSONCPP_STRING& message,
- Token& token,
- TokenType skipUntilToken) {
- addError(message, token);
- return recoverFromError(skipUntilToken);
-}
-
-Value& Reader::currentValue() { return *(nodes_.top()); }
-
-Reader::Char Reader::getNextChar() {
- if (current_ == end_)
- return 0;
- return *current_++;
-}
-
-void Reader::getLocationLineAndColumn(Location location,
- int& line,
- int& column) const {
- Location current = begin_;
- Location lastLineStart = current;
- line = 0;
- while (current < location && current != end_) {
- Char c = *current++;
- if (c == '\r') {
- if (*current == '\n')
- ++current;
- lastLineStart = current;
- ++line;
- } else if (c == '\n') {
- lastLineStart = current;
- ++line;
- }
- }
- // column & line start at 1
- column = int(location - lastLineStart) + 1;
- ++line;
-}
-
-JSONCPP_STRING Reader::getLocationLineAndColumn(Location location) const {
- int line, column;
- getLocationLineAndColumn(location, line, column);
- char buffer[18 + 16 + 16 + 1];
- snprintf(buffer, sizeof(buffer), "Line %d, Column %d", line, column);
- return buffer;
-}
-
-// Deprecated. Preserved for backward compatibility
-JSONCPP_STRING Reader::getFormatedErrorMessages() const {
- return getFormattedErrorMessages();
-}
-
-JSONCPP_STRING Reader::getFormattedErrorMessages() const {
- JSONCPP_STRING formattedMessage;
- for (Errors::const_iterator itError = errors_.begin();
- itError != errors_.end();
- ++itError) {
- const ErrorInfo& error = *itError;
- formattedMessage +=
- "* " + getLocationLineAndColumn(error.token_.start_) + "\n";
- formattedMessage += " " + error.message_ + "\n";
- if (error.extra_)
- formattedMessage +=
- "See " + getLocationLineAndColumn(error.extra_) + " for detail.\n";
- }
- return formattedMessage;
-}
-
-std::vector<Reader::StructuredError> Reader::getStructuredErrors() const {
- std::vector<Reader::StructuredError> allErrors;
- for (Errors::const_iterator itError = errors_.begin();
- itError != errors_.end();
- ++itError) {
- const ErrorInfo& error = *itError;
- Reader::StructuredError structured;
- structured.offset_start = error.token_.start_ - begin_;
- structured.offset_limit = error.token_.end_ - begin_;
- structured.message = error.message_;
- allErrors.push_back(structured);
- }
- return allErrors;
-}
-
-bool Reader::pushError(const Value& value, const JSONCPP_STRING& message) {
- ptrdiff_t const length = end_ - begin_;
- if(value.getOffsetStart() > length
- || value.getOffsetLimit() > length)
- return false;
- Token token;
- token.type_ = tokenError;
- token.start_ = begin_ + value.getOffsetStart();
- token.end_ = end_ + value.getOffsetLimit();
- ErrorInfo info;
- info.token_ = token;
- info.message_ = message;
- info.extra_ = 0;
- errors_.push_back(info);
- return true;
-}
-
-bool Reader::pushError(const Value& value, const JSONCPP_STRING& message, const Value& extra) {
- ptrdiff_t const length = end_ - begin_;
- if(value.getOffsetStart() > length
- || value.getOffsetLimit() > length
- || extra.getOffsetLimit() > length)
- return false;
- Token token;
- token.type_ = tokenError;
- token.start_ = begin_ + value.getOffsetStart();
- token.end_ = begin_ + value.getOffsetLimit();
- ErrorInfo info;
- info.token_ = token;
- info.message_ = message;
- info.extra_ = begin_ + extra.getOffsetStart();
- errors_.push_back(info);
- return true;
-}
-
-bool Reader::good() const {
- return !errors_.size();
-}
-
-// exact copy of Features
-class OurFeatures {
-public:
- static OurFeatures all();
- bool allowComments_;
- bool strictRoot_;
- bool allowDroppedNullPlaceholders_;
- bool allowNumericKeys_;
- bool allowSingleQuotes_;
- bool failIfExtra_;
- bool rejectDupKeys_;
- bool allowSpecialFloats_;
- int stackLimit_;
-}; // OurFeatures
-
-// exact copy of Implementation of class Features
-// ////////////////////////////////
-
-OurFeatures OurFeatures::all() { return OurFeatures(); }
-
-// Implementation of class Reader
-// ////////////////////////////////
-
-// exact copy of Reader, renamed to OurReader
-class OurReader {
-public:
- typedef char Char;
- typedef const Char* Location;
- struct StructuredError {
- ptrdiff_t offset_start;
- ptrdiff_t offset_limit;
- JSONCPP_STRING message;
- };
-
- OurReader(OurFeatures const& features);
- bool parse(const char* beginDoc,
- const char* endDoc,
- Value& root,
- bool collectComments = true);
- JSONCPP_STRING getFormattedErrorMessages() const;
- std::vector<StructuredError> getStructuredErrors() const;
- bool pushError(const Value& value, const JSONCPP_STRING& message);
- bool pushError(const Value& value, const JSONCPP_STRING& message, const Value& extra);
- bool good() const;
-
-private:
- OurReader(OurReader const&); // no impl
- void operator=(OurReader const&); // no impl
-
- enum TokenType {
- tokenEndOfStream = 0,
- tokenObjectBegin,
- tokenObjectEnd,
- tokenArrayBegin,
- tokenArrayEnd,
- tokenString,
- tokenNumber,
- tokenTrue,
- tokenFalse,
- tokenNull,
- tokenNaN,
- tokenPosInf,
- tokenNegInf,
- tokenArraySeparator,
- tokenMemberSeparator,
- tokenComment,
- tokenError
- };
-
- class Token {
- public:
- TokenType type_;
- Location start_;
- Location end_;
- };
-
- class ErrorInfo {
- public:
- Token token_;
- JSONCPP_STRING message_;
- Location extra_;
- };
-
- typedef std::deque<ErrorInfo> Errors;
-
- bool readToken(Token& token);
- void skipSpaces();
- bool match(Location pattern, int patternLength);
- bool readComment();
- bool readCStyleComment();
- bool readCppStyleComment();
- bool readString();
- bool readStringSingleQuote();
- bool readNumber(bool checkInf);
- bool readValue();
- bool readObject(Token& token);
- bool readArray(Token& token);
- bool decodeNumber(Token& token);
- bool decodeNumber(Token& token, Value& decoded);
- bool decodeString(Token& token);
- bool decodeString(Token& token, JSONCPP_STRING& decoded);
- bool decodeDouble(Token& token);
- bool decodeDouble(Token& token, Value& decoded);
- bool decodeUnicodeCodePoint(Token& token,
- Location& current,
- Location end,
- unsigned int& unicode);
- bool decodeUnicodeEscapeSequence(Token& token,
- Location& current,
- Location end,
- unsigned int& unicode);
- bool addError(const JSONCPP_STRING& message, Token& token, Location extra = 0);
- bool recoverFromError(TokenType skipUntilToken);
- bool addErrorAndRecover(const JSONCPP_STRING& message,
- Token& token,
- TokenType skipUntilToken);
- void skipUntilSpace();
- Value& currentValue();
- Char getNextChar();
- void
- getLocationLineAndColumn(Location location, int& line, int& column) const;
- JSONCPP_STRING getLocationLineAndColumn(Location location) const;
- void addComment(Location begin, Location end, CommentPlacement placement);
- void skipCommentTokens(Token& token);
-
- typedef std::stack<Value*> Nodes;
- Nodes nodes_;
- Errors errors_;
- JSONCPP_STRING document_;
- Location begin_;
- Location end_;
- Location current_;
- Location lastValueEnd_;
- Value* lastValue_;
- JSONCPP_STRING commentsBefore_;
- int stackDepth_;
-
- OurFeatures const features_;
- bool collectComments_;
-}; // OurReader
-
-// complete copy of Read impl, for OurReader
-
-OurReader::OurReader(OurFeatures const& features)
- : errors_(), document_(), begin_(), end_(), current_(), lastValueEnd_(),
- lastValue_(), commentsBefore_(),
- stackDepth_(0),
- features_(features), collectComments_() {
-}
-
-bool OurReader::parse(const char* beginDoc,
- const char* endDoc,
- Value& root,
- bool collectComments) {
- if (!features_.allowComments_) {
- collectComments = false;
- }
-
- begin_ = beginDoc;
- end_ = endDoc;
- collectComments_ = collectComments;
- current_ = begin_;
- lastValueEnd_ = 0;
- lastValue_ = 0;
- commentsBefore_ = "";
- errors_.clear();
- while (!nodes_.empty())
- nodes_.pop();
- nodes_.push(&root);
-
- stackDepth_ = 0;
- bool successful = readValue();
- Token token;
- skipCommentTokens(token);
- if (features_.failIfExtra_) {
- if ((features_.strictRoot_ || token.type_ != tokenError) && token.type_ != tokenEndOfStream) {
- addError("Extra non-whitespace after JSON value.", token);
- return false;
- }
- }
- if (collectComments_ && !commentsBefore_.empty())
- root.setComment(commentsBefore_, commentAfter);
- if (features_.strictRoot_) {
- if (!root.isArray() && !root.isObject()) {
- // Set error location to start of doc, ideally should be first token found
- // in doc
- token.type_ = tokenError;
- token.start_ = beginDoc;
- token.end_ = endDoc;
- addError(
- "A valid JSON document must be either an array or an object value.",
- token);
- return false;
- }
- }
- return successful;
-}
-
-bool OurReader::readValue() {
- if (stackDepth_ >= features_.stackLimit_) throwRuntimeError("Exceeded stackLimit in readValue().");
- ++stackDepth_;
- Token token;
- skipCommentTokens(token);
- bool successful = true;
-
- if (collectComments_ && !commentsBefore_.empty()) {
- currentValue().setComment(commentsBefore_, commentBefore);
- commentsBefore_ = "";
- }
-
- switch (token.type_) {
- case tokenObjectBegin:
- successful = readObject(token);
- currentValue().setOffsetLimit(current_ - begin_);
- break;
- case tokenArrayBegin:
- successful = readArray(token);
- currentValue().setOffsetLimit(current_ - begin_);
- break;
- case tokenNumber:
- successful = decodeNumber(token);
- break;
- case tokenString:
- successful = decodeString(token);
- break;
- case tokenTrue:
- {
- Value v(true);
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- }
- break;
- case tokenFalse:
- {
- Value v(false);
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- }
- break;
- case tokenNull:
- {
- Value v;
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- }
- break;
- case tokenNaN:
- {
- Value v(std::numeric_limits<double>::quiet_NaN());
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- }
- break;
- case tokenPosInf:
- {
- Value v(std::numeric_limits<double>::infinity());
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- }
- break;
- case tokenNegInf:
- {
- Value v(-std::numeric_limits<double>::infinity());
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- }
- break;
- case tokenArraySeparator:
- case tokenObjectEnd:
- case tokenArrayEnd:
- if (features_.allowDroppedNullPlaceholders_) {
- // "Un-read" the current token and mark the current value as a null
- // token.
- current_--;
- Value v;
- currentValue().swapPayload(v);
- currentValue().setOffsetStart(current_ - begin_ - 1);
- currentValue().setOffsetLimit(current_ - begin_);
- break;
- } // else, fall through ...
- default:
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- return addError("Syntax error: value, object or array expected.", token);
- }
-
- if (collectComments_) {
- lastValueEnd_ = current_;
- lastValue_ = ¤tValue();
- }
-
- --stackDepth_;
- return successful;
-}
-
-void OurReader::skipCommentTokens(Token& token) {
- if (features_.allowComments_) {
- do {
- readToken(token);
- } while (token.type_ == tokenComment);
- } else {
- readToken(token);
- }
-}
-
-bool OurReader::readToken(Token& token) {
- skipSpaces();
- token.start_ = current_;
- Char c = getNextChar();
- bool ok = true;
- switch (c) {
- case '{':
- token.type_ = tokenObjectBegin;
- break;
- case '}':
- token.type_ = tokenObjectEnd;
- break;
- case '[':
- token.type_ = tokenArrayBegin;
- break;
- case ']':
- token.type_ = tokenArrayEnd;
- break;
- case '"':
- token.type_ = tokenString;
- ok = readString();
- break;
- case '\'':
- if (features_.allowSingleQuotes_) {
- token.type_ = tokenString;
- ok = readStringSingleQuote();
- break;
- } // else continue
- case '/':
- token.type_ = tokenComment;
- ok = readComment();
- break;
- case '0':
- case '1':
- case '2':
- case '3':
- case '4':
- case '5':
- case '6':
- case '7':
- case '8':
- case '9':
- token.type_ = tokenNumber;
- readNumber(false);
- break;
- case '-':
- if (readNumber(true)) {
- token.type_ = tokenNumber;
- } else {
- token.type_ = tokenNegInf;
- ok = features_.allowSpecialFloats_ && match("nfinity", 7);
- }
- break;
- case 't':
- token.type_ = tokenTrue;
- ok = match("rue", 3);
- break;
- case 'f':
- token.type_ = tokenFalse;
- ok = match("alse", 4);
- break;
- case 'n':
- token.type_ = tokenNull;
- ok = match("ull", 3);
- break;
- case 'N':
- if (features_.allowSpecialFloats_) {
- token.type_ = tokenNaN;
- ok = match("aN", 2);
- } else {
- ok = false;
- }
- break;
- case 'I':
- if (features_.allowSpecialFloats_) {
- token.type_ = tokenPosInf;
- ok = match("nfinity", 7);
- } else {
- ok = false;
- }
- break;
- case ',':
- token.type_ = tokenArraySeparator;
- break;
- case ':':
- token.type_ = tokenMemberSeparator;
- break;
- case 0:
- token.type_ = tokenEndOfStream;
- break;
- default:
- ok = false;
- break;
- }
- if (!ok)
- token.type_ = tokenError;
- token.end_ = current_;
- return true;
-}
-
-void OurReader::skipSpaces() {
- while (current_ != end_) {
- Char c = *current_;
- if (c == ' ' || c == '\t' || c == '\r' || c == '\n')
- ++current_;
- else
- break;
- }
-}
-
-bool OurReader::match(Location pattern, int patternLength) {
- if (end_ - current_ < patternLength)
- return false;
- int index = patternLength;
- while (index--)
- if (current_[index] != pattern[index])
- return false;
- current_ += patternLength;
- return true;
-}
-
-bool OurReader::readComment() {
- Location commentBegin = current_ - 1;
- Char c = getNextChar();
- bool successful = false;
- if (c == '*')
- successful = readCStyleComment();
- else if (c == '/')
- successful = readCppStyleComment();
- if (!successful)
- return false;
-
- if (collectComments_) {
- CommentPlacement placement = commentBefore;
- if (lastValueEnd_ && !containsNewLine(lastValueEnd_, commentBegin)) {
- if (c != '*' || !containsNewLine(commentBegin, current_))
- placement = commentAfterOnSameLine;
- }
-
- addComment(commentBegin, current_, placement);
- }
- return true;
-}
-
-void
-OurReader::addComment(Location begin, Location end, CommentPlacement placement) {
- assert(collectComments_);
- const JSONCPP_STRING& normalized = normalizeEOL(begin, end);
- if (placement == commentAfterOnSameLine) {
- assert(lastValue_ != 0);
- lastValue_->setComment(normalized, placement);
- } else {
- commentsBefore_ += normalized;
- }
-}
-
-bool OurReader::readCStyleComment() {
- while ((current_ + 1) < end_) {
- Char c = getNextChar();
- if (c == '*' && *current_ == '/')
- break;
- }
- return getNextChar() == '/';
-}
-
-bool OurReader::readCppStyleComment() {
- while (current_ != end_) {
- Char c = getNextChar();
- if (c == '\n')
- break;
- if (c == '\r') {
- // Consume DOS EOL. It will be normalized in addComment.
- if (current_ != end_ && *current_ == '\n')
- getNextChar();
- // Break on Moc OS 9 EOL.
- break;
- }
- }
- return true;
-}
-
-bool OurReader::readNumber(bool checkInf) {
- const char *p = current_;
- if (checkInf && p != end_ && *p == 'I') {
- current_ = ++p;
- return false;
- }
- char c = '0'; // stopgap for already consumed character
- // integral part
- while (c >= '0' && c <= '9')
- c = (current_ = p) < end_ ? *p++ : '\0';
- // fractional part
- if (c == '.') {
- c = (current_ = p) < end_ ? *p++ : '\0';
- while (c >= '0' && c <= '9')
- c = (current_ = p) < end_ ? *p++ : '\0';
- }
- // exponential part
- if (c == 'e' || c == 'E') {
- c = (current_ = p) < end_ ? *p++ : '\0';
- if (c == '+' || c == '-')
- c = (current_ = p) < end_ ? *p++ : '\0';
- while (c >= '0' && c <= '9')
- c = (current_ = p) < end_ ? *p++ : '\0';
- }
- return true;
-}
-bool OurReader::readString() {
- Char c = 0;
- while (current_ != end_) {
- c = getNextChar();
- if (c == '\\')
- getNextChar();
- else if (c == '"')
- break;
- }
- return c == '"';
-}
-
-
-bool OurReader::readStringSingleQuote() {
- Char c = 0;
- while (current_ != end_) {
- c = getNextChar();
- if (c == '\\')
- getNextChar();
- else if (c == '\'')
- break;
- }
- return c == '\'';
-}
-
-bool OurReader::readObject(Token& tokenStart) {
- Token tokenName;
- JSONCPP_STRING name;
- Value init(objectValue);
- currentValue().swapPayload(init);
- currentValue().setOffsetStart(tokenStart.start_ - begin_);
- while (readToken(tokenName)) {
- bool initialTokenOk = true;
- while (tokenName.type_ == tokenComment && initialTokenOk)
- initialTokenOk = readToken(tokenName);
- if (!initialTokenOk)
- break;
- if (tokenName.type_ == tokenObjectEnd && name.empty()) // empty object
- return true;
- name = "";
- if (tokenName.type_ == tokenString) {
- if (!decodeString(tokenName, name))
- return recoverFromError(tokenObjectEnd);
- } else if (tokenName.type_ == tokenNumber && features_.allowNumericKeys_) {
- Value numberName;
- if (!decodeNumber(tokenName, numberName))
- return recoverFromError(tokenObjectEnd);
- name = numberName.asString();
- } else {
- break;
- }
-
- Token colon;
- if (!readToken(colon) || colon.type_ != tokenMemberSeparator) {
- return addErrorAndRecover(
- "Missing ':' after object member name", colon, tokenObjectEnd);
- }
- if (name.length() >= (1U<<30)) throwRuntimeError("keylength >= 2^30");
- if (features_.rejectDupKeys_ && currentValue().isMember(name)) {
- JSONCPP_STRING msg = "Duplicate key: '" + name + "'";
- return addErrorAndRecover(
- msg, tokenName, tokenObjectEnd);
- }
- Value& value = currentValue()[name];
- nodes_.push(&value);
- bool ok = readValue();
- nodes_.pop();
- if (!ok) // error already set
- return recoverFromError(tokenObjectEnd);
-
- Token comma;
- if (!readToken(comma) ||
- (comma.type_ != tokenObjectEnd && comma.type_ != tokenArraySeparator &&
- comma.type_ != tokenComment)) {
- return addErrorAndRecover(
- "Missing ',' or '}' in object declaration", comma, tokenObjectEnd);
- }
- bool finalizeTokenOk = true;
- while (comma.type_ == tokenComment && finalizeTokenOk)
- finalizeTokenOk = readToken(comma);
- if (comma.type_ == tokenObjectEnd)
- return true;
- }
- return addErrorAndRecover(
- "Missing '}' or object member name", tokenName, tokenObjectEnd);
-}
-
-bool OurReader::readArray(Token& tokenStart) {
- Value init(arrayValue);
- currentValue().swapPayload(init);
- currentValue().setOffsetStart(tokenStart.start_ - begin_);
- skipSpaces();
- if (current_ != end_ && *current_ == ']') // empty array
- {
- Token endArray;
- readToken(endArray);
- return true;
- }
- int index = 0;
- for (;;) {
- Value& value = currentValue()[index++];
- nodes_.push(&value);
- bool ok = readValue();
- nodes_.pop();
- if (!ok) // error already set
- return recoverFromError(tokenArrayEnd);
-
- Token token;
- // Accept Comment after last item in the array.
- ok = readToken(token);
- while (token.type_ == tokenComment && ok) {
- ok = readToken(token);
- }
- bool badTokenType =
- (token.type_ != tokenArraySeparator && token.type_ != tokenArrayEnd);
- if (!ok || badTokenType) {
- return addErrorAndRecover(
- "Missing ',' or ']' in array declaration", token, tokenArrayEnd);
- }
- if (token.type_ == tokenArrayEnd)
- break;
- }
- return true;
-}
-
-bool OurReader::decodeNumber(Token& token) {
- Value decoded;
- if (!decodeNumber(token, decoded))
- return false;
- currentValue().swapPayload(decoded);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- return true;
-}
-
-bool OurReader::decodeNumber(Token& token, Value& decoded) {
- // Attempts to parse the number as an integer. If the number is
- // larger than the maximum supported value of an integer then
- // we decode the number as a double.
- Location current = token.start_;
- bool isNegative = *current == '-';
- if (isNegative)
- ++current;
- // TODO: Help the compiler do the div and mod at compile time or get rid of them.
- Value::LargestUInt maxIntegerValue =
- isNegative ? Value::LargestUInt(-Value::minLargestInt)
- : Value::maxLargestUInt;
- Value::LargestUInt threshold = maxIntegerValue / 10;
- Value::LargestUInt value = 0;
- while (current < token.end_) {
- Char c = *current++;
- if (c < '0' || c > '9')
- return decodeDouble(token, decoded);
- Value::UInt digit(static_cast<Value::UInt>(c - '0'));
- if (value >= threshold) {
- // We've hit or exceeded the max value divided by 10 (rounded down). If
- // a) we've only just touched the limit, b) this is the last digit, and
- // c) it's small enough to fit in that rounding delta, we're okay.
- // Otherwise treat this number as a double to avoid overflow.
- if (value > threshold || current != token.end_ ||
- digit > maxIntegerValue % 10) {
- return decodeDouble(token, decoded);
- }
- }
- value = value * 10 + digit;
- }
- if (isNegative)
- decoded = -Value::LargestInt(value);
- else if (value <= Value::LargestUInt(Value::maxInt))
- decoded = Value::LargestInt(value);
- else
- decoded = value;
- return true;
-}
-
-bool OurReader::decodeDouble(Token& token) {
- Value decoded;
- if (!decodeDouble(token, decoded))
- return false;
- currentValue().swapPayload(decoded);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- return true;
-}
-
-bool OurReader::decodeDouble(Token& token, Value& decoded) {
- double value = 0;
- const int bufferSize = 32;
- int count;
- ptrdiff_t const length = token.end_ - token.start_;
-
- // Sanity check to avoid buffer overflow exploits.
- if (length < 0) {
- return addError("Unable to parse token length", token);
- }
- size_t const ulength = static_cast<size_t>(length);
-
- // Avoid using a string constant for the format control string given to
- // sscanf, as this can cause hard to debug crashes on OS X. See here for more
- // info:
- //
- // http://developer.apple.com/library/mac/#DOCUMENTATION/DeveloperTools/gcc-4.0.1/gcc/Incompatibilities.html
- char format[] = "%lf";
-
- if (length <= bufferSize) {
- Char buffer[bufferSize + 1];
- memcpy(buffer, token.start_, ulength);
- buffer[length] = 0;
- fixNumericLocaleInput(buffer, buffer + length);
- count = sscanf(buffer, format, &value);
- } else {
- JSONCPP_STRING buffer(token.start_, token.end_);
- count = sscanf(buffer.c_str(), format, &value);
- }
-
- if (count != 1)
- return addError("'" + JSONCPP_STRING(token.start_, token.end_) +
- "' is not a number.",
- token);
- decoded = value;
- return true;
-}
-
-bool OurReader::decodeString(Token& token) {
- JSONCPP_STRING decoded_string;
- if (!decodeString(token, decoded_string))
- return false;
- Value decoded(decoded_string);
- currentValue().swapPayload(decoded);
- currentValue().setOffsetStart(token.start_ - begin_);
- currentValue().setOffsetLimit(token.end_ - begin_);
- return true;
-}
-
-bool OurReader::decodeString(Token& token, JSONCPP_STRING& decoded) {
- decoded.reserve(static_cast<size_t>(token.end_ - token.start_ - 2));
- Location current = token.start_ + 1; // skip '"'
- Location end = token.end_ - 1; // do not include '"'
- while (current != end) {
- Char c = *current++;
- if (c == '"')
- break;
- else if (c == '\\') {
- if (current == end)
- return addError("Empty escape sequence in string", token, current);
- Char escape = *current++;
- switch (escape) {
- case '"':
- decoded += '"';
- break;
- case '/':
- decoded += '/';
- break;
- case '\\':
- decoded += '\\';
- break;
- case 'b':
- decoded += '\b';
- break;
- case 'f':
- decoded += '\f';
- break;
- case 'n':
- decoded += '\n';
- break;
- case 'r':
- decoded += '\r';
- break;
- case 't':
- decoded += '\t';
- break;
- case 'u': {
- unsigned int unicode;
- if (!decodeUnicodeCodePoint(token, current, end, unicode))
- return false;
- decoded += codePointToUTF8(unicode);
- } break;
- default:
- return addError("Bad escape sequence in string", token, current);
- }
- } else {
- decoded += c;
- }
- }
- return true;
-}
-
-bool OurReader::decodeUnicodeCodePoint(Token& token,
- Location& current,
- Location end,
- unsigned int& unicode) {
-
- if (!decodeUnicodeEscapeSequence(token, current, end, unicode))
- return false;
- if (unicode >= 0xD800 && unicode <= 0xDBFF) {
- // surrogate pairs
- if (end - current < 6)
- return addError(
- "additional six characters expected to parse unicode surrogate pair.",
- token,
- current);
- unsigned int surrogatePair;
- if (*(current++) == '\\' && *(current++) == 'u') {
- if (decodeUnicodeEscapeSequence(token, current, end, surrogatePair)) {
- unicode = 0x10000 + ((unicode & 0x3FF) << 10) + (surrogatePair & 0x3FF);
- } else
- return false;
- } else
- return addError("expecting another \\u token to begin the second half of "
- "a unicode surrogate pair",
- token,
- current);
- }
- return true;
-}
-
-bool OurReader::decodeUnicodeEscapeSequence(Token& token,
- Location& current,
- Location end,
- unsigned int& ret_unicode) {
- if (end - current < 4)
- return addError(
- "Bad unicode escape sequence in string: four digits expected.",
- token,
- current);
- int unicode = 0;
- for (int index = 0; index < 4; ++index) {
- Char c = *current++;
- unicode *= 16;
- if (c >= '0' && c <= '9')
- unicode += c - '0';
- else if (c >= 'a' && c <= 'f')
- unicode += c - 'a' + 10;
- else if (c >= 'A' && c <= 'F')
- unicode += c - 'A' + 10;
- else
- return addError(
- "Bad unicode escape sequence in string: hexadecimal digit expected.",
- token,
- current);
- }
- ret_unicode = static_cast<unsigned int>(unicode);
- return true;
-}
-
-bool
-OurReader::addError(const JSONCPP_STRING& message, Token& token, Location extra) {
- ErrorInfo info;
- info.token_ = token;
- info.message_ = message;
- info.extra_ = extra;
- errors_.push_back(info);
- return false;
-}
-
-bool OurReader::recoverFromError(TokenType skipUntilToken) {
- size_t errorCount = errors_.size();
- Token skip;
- for (;;) {
- if (!readToken(skip))
- errors_.resize(errorCount); // discard errors caused by recovery
- if (skip.type_ == skipUntilToken || skip.type_ == tokenEndOfStream)
- break;
- }
- errors_.resize(errorCount);
- return false;
-}
-
-bool OurReader::addErrorAndRecover(const JSONCPP_STRING& message,
- Token& token,
- TokenType skipUntilToken) {
- addError(message, token);
- return recoverFromError(skipUntilToken);
-}
-
-Value& OurReader::currentValue() { return *(nodes_.top()); }
-
-OurReader::Char OurReader::getNextChar() {
- if (current_ == end_)
- return 0;
- return *current_++;
-}
-
-void OurReader::getLocationLineAndColumn(Location location,
- int& line,
- int& column) const {
- Location current = begin_;
- Location lastLineStart = current;
- line = 0;
- while (current < location && current != end_) {
- Char c = *current++;
- if (c == '\r') {
- if (*current == '\n')
- ++current;
- lastLineStart = current;
- ++line;
- } else if (c == '\n') {
- lastLineStart = current;
- ++line;
- }
- }
- // column & line start at 1
- column = int(location - lastLineStart) + 1;
- ++line;
-}
-
-JSONCPP_STRING OurReader::getLocationLineAndColumn(Location location) const {
- int line, column;
- getLocationLineAndColumn(location, line, column);
- char buffer[18 + 16 + 16 + 1];
- snprintf(buffer, sizeof(buffer), "Line %d, Column %d", line, column);
- return buffer;
-}
-
-JSONCPP_STRING OurReader::getFormattedErrorMessages() const {
- JSONCPP_STRING formattedMessage;
- for (Errors::const_iterator itError = errors_.begin();
- itError != errors_.end();
- ++itError) {
- const ErrorInfo& error = *itError;
- formattedMessage +=
- "* " + getLocationLineAndColumn(error.token_.start_) + "\n";
- formattedMessage += " " + error.message_ + "\n";
- if (error.extra_)
- formattedMessage +=
- "See " + getLocationLineAndColumn(error.extra_) + " for detail.\n";
- }
- return formattedMessage;
-}
-
-std::vector<OurReader::StructuredError> OurReader::getStructuredErrors() const {
- std::vector<OurReader::StructuredError> allErrors;
- for (Errors::const_iterator itError = errors_.begin();
- itError != errors_.end();
- ++itError) {
- const ErrorInfo& error = *itError;
- OurReader::StructuredError structured;
- structured.offset_start = error.token_.start_ - begin_;
- structured.offset_limit = error.token_.end_ - begin_;
- structured.message = error.message_;
- allErrors.push_back(structured);
- }
- return allErrors;
-}
-
-bool OurReader::pushError(const Value& value, const JSONCPP_STRING& message) {
- ptrdiff_t length = end_ - begin_;
- if(value.getOffsetStart() > length
- || value.getOffsetLimit() > length)
- return false;
- Token token;
- token.type_ = tokenError;
- token.start_ = begin_ + value.getOffsetStart();
- token.end_ = end_ + value.getOffsetLimit();
- ErrorInfo info;
- info.token_ = token;
- info.message_ = message;
- info.extra_ = 0;
- errors_.push_back(info);
- return true;
-}
-
-bool OurReader::pushError(const Value& value, const JSONCPP_STRING& message, const Value& extra) {
- ptrdiff_t length = end_ - begin_;
- if(value.getOffsetStart() > length
- || value.getOffsetLimit() > length
- || extra.getOffsetLimit() > length)
- return false;
- Token token;
- token.type_ = tokenError;
- token.start_ = begin_ + value.getOffsetStart();
- token.end_ = begin_ + value.getOffsetLimit();
- ErrorInfo info;
- info.token_ = token;
- info.message_ = message;
- info.extra_ = begin_ + extra.getOffsetStart();
- errors_.push_back(info);
- return true;
-}
-
-bool OurReader::good() const {
- return !errors_.size();
-}
-
-
-class OurCharReader : public CharReader {
- bool const collectComments_;
- OurReader reader_;
-public:
- OurCharReader(
- bool collectComments,
- OurFeatures const& features)
- : collectComments_(collectComments)
- , reader_(features)
- {}
- bool parse(
- char const* beginDoc, char const* endDoc,
- Value* root, JSONCPP_STRING* errs) JSONCPP_OVERRIDE {
- bool ok = reader_.parse(beginDoc, endDoc, *root, collectComments_);
- if (errs) {
- *errs = reader_.getFormattedErrorMessages();
- }
- return ok;
- }
-};
-
-CharReaderBuilder::CharReaderBuilder()
-{
- setDefaults(&settings_);
-}
-CharReaderBuilder::~CharReaderBuilder()
-{}
-CharReader* CharReaderBuilder::newCharReader() const
-{
- bool collectComments = settings_["collectComments"].asBool();
- OurFeatures features = OurFeatures::all();
- features.allowComments_ = settings_["allowComments"].asBool();
- features.strictRoot_ = settings_["strictRoot"].asBool();
- features.allowDroppedNullPlaceholders_ = settings_["allowDroppedNullPlaceholders"].asBool();
- features.allowNumericKeys_ = settings_["allowNumericKeys"].asBool();
- features.allowSingleQuotes_ = settings_["allowSingleQuotes"].asBool();
- features.stackLimit_ = settings_["stackLimit"].asInt();
- features.failIfExtra_ = settings_["failIfExtra"].asBool();
- features.rejectDupKeys_ = settings_["rejectDupKeys"].asBool();
- features.allowSpecialFloats_ = settings_["allowSpecialFloats"].asBool();
- return new OurCharReader(collectComments, features);
-}
-static void getValidReaderKeys(std::set<JSONCPP_STRING>* valid_keys)
-{
- valid_keys->clear();
- valid_keys->insert("collectComments");
- valid_keys->insert("allowComments");
- valid_keys->insert("strictRoot");
- valid_keys->insert("allowDroppedNullPlaceholders");
- valid_keys->insert("allowNumericKeys");
- valid_keys->insert("allowSingleQuotes");
- valid_keys->insert("stackLimit");
- valid_keys->insert("failIfExtra");
- valid_keys->insert("rejectDupKeys");
- valid_keys->insert("allowSpecialFloats");
-}
-bool CharReaderBuilder::validate(Value* invalid) const
-{
- Value my_invalid;
- if (!invalid) invalid = &my_invalid; // so we do not need to test for NULL
- Value& inv = *invalid;
- std::set<JSONCPP_STRING> valid_keys;
- getValidReaderKeys(&valid_keys);
- Value::Members keys = settings_.getMemberNames();
- size_t n = keys.size();
- for (size_t i = 0; i < n; ++i) {
- JSONCPP_STRING const& key = keys[i];
- if (valid_keys.find(key) == valid_keys.end()) {
- inv[key] = settings_[key];
- }
- }
- return 0u == inv.size();
-}
-Value& CharReaderBuilder::operator[](JSONCPP_STRING key)
-{
- return settings_[key];
-}
-// static
-void CharReaderBuilder::strictMode(Value* settings)
-{
-//! [CharReaderBuilderStrictMode]
- (*settings)["allowComments"] = false;
- (*settings)["strictRoot"] = true;
- (*settings)["allowDroppedNullPlaceholders"] = false;
- (*settings)["allowNumericKeys"] = false;
- (*settings)["allowSingleQuotes"] = false;
- (*settings)["stackLimit"] = 1000;
- (*settings)["failIfExtra"] = true;
- (*settings)["rejectDupKeys"] = true;
- (*settings)["allowSpecialFloats"] = false;
-//! [CharReaderBuilderStrictMode]
-}
-// static
-void CharReaderBuilder::setDefaults(Value* settings)
-{
-//! [CharReaderBuilderDefaults]
- (*settings)["collectComments"] = true;
- (*settings)["allowComments"] = true;
- (*settings)["strictRoot"] = false;
- (*settings)["allowDroppedNullPlaceholders"] = false;
- (*settings)["allowNumericKeys"] = false;
- (*settings)["allowSingleQuotes"] = false;
- (*settings)["stackLimit"] = 1000;
- (*settings)["failIfExtra"] = false;
- (*settings)["rejectDupKeys"] = false;
- (*settings)["allowSpecialFloats"] = false;
-//! [CharReaderBuilderDefaults]
-}
-
-//////////////////////////////////
-// global functions
-
-bool parseFromStream(
- CharReader::Factory const& fact, JSONCPP_ISTREAM& sin,
- Value* root, JSONCPP_STRING* errs)
-{
- JSONCPP_OSTRINGSTREAM ssin;
- ssin << sin.rdbuf();
- JSONCPP_STRING doc = ssin.str();
- char const* begin = doc.data();
- char const* end = begin + doc.size();
- // Note that we do not actually need a null-terminator.
- CharReaderPtr const reader(fact.newCharReader());
- return reader->parse(begin, end, root, errs);
-}
-
-JSONCPP_ISTREAM& operator>>(JSONCPP_ISTREAM& sin, Value& root) {
- CharReaderBuilder b;
- JSONCPP_STRING errs;
- bool ok = parseFromStream(b, sin, &root, &errs);
- if (!ok) {
- fprintf(stderr,
- "Error from reader: %s",
- errs.c_str());
-
- throwRuntimeError(errs);
- }
- return sin;
-}
-
-} // namespace Json
-} // namespace rmq
-
diff --git a/rocketmq-client4cpp/src/jsoncpp/json_tool.h b/rocketmq-client4cpp/src/jsoncpp/json_tool.h
deleted file mode 100755
index fa4a473b..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json_tool.h
+++ /dev/null
@@ -1,113 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#ifndef LIB_JSONCPP_JSON_TOOL_H_INCLUDED
-#define LIB_JSONCPP_JSON_TOOL_H_INCLUDED
-
-#ifndef NO_LOCALE_SUPPORT
-#include <clocale>
-#endif
-
-/* This header provides common string manipulation support, such as UTF-8,
- * portable conversion from/to string...
- *
- * It is an internal header that must not be exposed.
- */
-
-namespace rmq {
-namespace Json {
-static char getDecimalPoint() {
-#ifdef NO_LOCALE_SUPPORT
- return '\0';
-#else
- struct lconv* lc = localeconv();
- return lc ? *(lc->decimal_point) : '\0';
-#endif
-}
-
-/// Converts a unicode code-point to UTF-8.
-static inline JSONCPP_STRING codePointToUTF8(unsigned int cp) {
- JSONCPP_STRING result;
-
- // based on description from http://en.wikipedia.org/wiki/UTF-8
-
- if (cp <= 0x7f) {
- result.resize(1);
- result[0] = static_cast<char>(cp);
- } else if (cp <= 0x7FF) {
- result.resize(2);
- result[1] = static_cast<char>(0x80 | (0x3f & cp));
- result[0] = static_cast<char>(0xC0 | (0x1f & (cp >> 6)));
- } else if (cp <= 0xFFFF) {
- result.resize(3);
- result[2] = static_cast<char>(0x80 | (0x3f & cp));
- result[1] = static_cast<char>(0x80 | (0x3f & (cp >> 6)));
- result[0] = static_cast<char>(0xE0 | (0xf & (cp >> 12)));
- } else if (cp <= 0x10FFFF) {
- result.resize(4);
- result[3] = static_cast<char>(0x80 | (0x3f & cp));
- result[2] = static_cast<char>(0x80 | (0x3f & (cp >> 6)));
- result[1] = static_cast<char>(0x80 | (0x3f & (cp >> 12)));
- result[0] = static_cast<char>(0xF0 | (0x7 & (cp >> 18)));
- }
-
- return result;
-}
-
-/// Returns true if ch is a control character (in range [1,31]).
-static inline bool isControlCharacter(char ch) { return ch > 0 && ch <= 0x1F; }
-
-enum {
- /// Constant that specify the size of the buffer that must be passed to
- /// uintToString.
- uintToStringBufferSize = 3 * sizeof(LargestUInt) + 1
-};
-
-// Defines a char buffer for use with uintToString().
-typedef char UIntToStringBuffer[uintToStringBufferSize];
-
-/** Converts an unsigned integer to string.
- * @param value Unsigned interger to convert to string
- * @param current Input/Output string buffer.
- * Must have at least uintToStringBufferSize chars free.
- */
-static inline void uintToString(LargestUInt value, char*& current) {
- *--current = 0;
- do {
- *--current = static_cast<char>(value % 10U + static_cast<unsigned>('0'));
- value /= 10;
- } while (value != 0);
-}
-
-/** Change ',' to '.' everywhere in buffer.
- *
- * We had a sophisticated way, but it did not work in WinCE.
- * @see https://github.com/open-source-parsers/jsoncpp/pull/9
- */
-static inline void fixNumericLocale(char* begin, char* end) {
- while (begin < end) {
- if (*begin == ',') {
- *begin = '.';
- }
- ++begin;
- }
-}
-
-static inline void fixNumericLocaleInput(char* begin, char* end) {
- char decimalPoint = getDecimalPoint();
- if (decimalPoint != '\0' && decimalPoint != '.') {
- while (begin < end) {
- if (*begin == '.') {
- *begin = decimalPoint;
- }
- ++begin;
- }
- }
-}
-
-} // namespace Json
-} // namespace rmq
-
-#endif // LIB_JSONCPP_JSON_TOOL_H_INCLUDED
diff --git a/rocketmq-client4cpp/src/jsoncpp/json_value.cpp b/rocketmq-client4cpp/src/jsoncpp/json_value.cpp
deleted file mode 100755
index 427e854f..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json_value.cpp
+++ /dev/null
@@ -1,1612 +0,0 @@
-// Copyright 2011 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#if !defined(JSON_IS_AMALGAMATION)
-#include <json/assertions.h>
-#include <json/value.h>
-#include <json/writer.h>
-#endif // if !defined(JSON_IS_AMALGAMATION)
-#include <math.h>
-#include <sstream>
-#include <utility>
-#include <cstring>
-#include <cassert>
-#ifdef JSON_USE_CPPTL
-#include <cpptl/conststring.h>
-#endif
-#include <cstddef> // size_t
-#include <algorithm> // min()
-
-#define JSON_ASSERT_UNREACHABLE assert(false)
-
-namespace rmq {
-namespace Json {
-
-// This is a walkaround to avoid the static initialization of Value::null.
-// kNull must be word-aligned to avoid crashing on ARM. We use an alignment of
-// 8 (instead of 4) as a bit of future-proofing.
-#if defined(__ARMEL__)
-#define ALIGNAS(byte_alignment) __attribute__((aligned(byte_alignment)))
-#else
-#define ALIGNAS(byte_alignment)
-#endif
-//static const unsigned char ALIGNAS(8) kNull[sizeof(Value)] = { 0 };
-//const unsigned char& kNullRef = kNull[0];
-//const Value& Value::null = reinterpret_cast<const Value&>(kNullRef);
-//const Value& Value::nullRef = null;
-
-// static
-Value const& Value::nullSingleton()
-{
- static Value const nullStatic;
- return nullStatic;
-}
-
-// for backwards compatibility, we'll leave these global references around, but DO NOT
-// use them in JSONCPP library code any more!
-Value const& Value::null = Value::nullSingleton();
-Value const& Value::nullRef = Value::nullSingleton();
-
-const Int Value::minInt = Int(~(UInt(-1) / 2));
-const Int Value::maxInt = Int(UInt(-1) / 2);
-const UInt Value::maxUInt = UInt(-1);
-#if defined(JSON_HAS_INT64)
-const Int64 Value::minInt64 = Int64(~(UInt64(-1) / 2));
-const Int64 Value::maxInt64 = Int64(UInt64(-1) / 2);
-const UInt64 Value::maxUInt64 = UInt64(-1);
-// The constant is hard-coded because some compiler have trouble
-// converting Value::maxUInt64 to a double correctly (AIX/xlC).
-// Assumes that UInt64 is a 64 bits integer.
-static const double maxUInt64AsDouble = 18446744073709551615.0;
-#endif // defined(JSON_HAS_INT64)
-const LargestInt Value::minLargestInt = LargestInt(~(LargestUInt(-1) / 2));
-const LargestInt Value::maxLargestInt = LargestInt(LargestUInt(-1) / 2);
-const LargestUInt Value::maxLargestUInt = LargestUInt(-1);
-
-#if !defined(JSON_USE_INT64_DOUBLE_CONVERSION)
-template <typename T, typename U>
-static inline bool InRange(double d, T min, U max) {
- // The casts can lose precision, but we are looking only for
- // an approximate range. Might fail on edge cases though. ~cdunn
- //return d >= static_cast<double>(min) && d <= static_cast<double>(max);
- return d >= min && d <= max;
-}
-#else // if !defined(JSON_USE_INT64_DOUBLE_CONVERSION)
-static inline double integerToDouble(UInt64 value) {
- return static_cast<double>(Int64(value / 2)) * 2.0 + static_cast<double>(Int64(value & 1));
-}
-
-template <typename T> static inline double integerToDouble(T value) {
- return static_cast<double>(value);
-}
-
-template <typename T, typename U>
-static inline bool InRange(double d, T min, U max) {
- return d >= integerToDouble(min) && d <= integerToDouble(max);
-}
-#endif // if !defined(JSON_USE_INT64_DOUBLE_CONVERSION)
-
-/** Duplicates the specified string value.
- * @param value Pointer to the string to duplicate. Must be zero-terminated if
- * length is "unknown".
- * @param length Length of the value. if equals to unknown, then it will be
- * computed using strlen(value).
- * @return Pointer on the duplicate instance of string.
- */
-static inline char* duplicateStringValue(const char* value,
- size_t length)
-{
- // Avoid an integer overflow in the call to malloc below by limiting length
- // to a sane value.
- if (length >= static_cast<size_t>(Value::maxInt))
- length = Value::maxInt - 1;
-
- char* newString = static_cast<char*>(malloc(length + 1));
- if (newString == NULL) {
- throwRuntimeError(
- "in Json::Value::duplicateStringValue(): "
- "Failed to allocate string value buffer");
- }
- memcpy(newString, value, length);
- newString[length] = 0;
- return newString;
-}
-
-/* Record the length as a prefix.
- */
-static inline char* duplicateAndPrefixStringValue(
- const char* value,
- unsigned int length)
-{
- // Avoid an integer overflow in the call to malloc below by limiting length
- // to a sane value.
- JSON_ASSERT_MESSAGE(length <= static_cast<unsigned>(Value::maxInt) - sizeof(unsigned) - 1U,
- "in Json::Value::duplicateAndPrefixStringValue(): "
- "length too big for prefixing");
- unsigned actualLength = length + static_cast<unsigned>(sizeof(unsigned)) + 1U;
- char* newString = static_cast<char*>(malloc(actualLength));
- if (newString == 0) {
- throwRuntimeError(
- "in Json::Value::duplicateAndPrefixStringValue(): "
- "Failed to allocate string value buffer");
- }
- *reinterpret_cast<unsigned*>(newString) = length;
- memcpy(newString + sizeof(unsigned), value, length);
- newString[actualLength - 1U] = 0; // to avoid buffer over-run accidents by users later
- return newString;
-}
-inline static void decodePrefixedString(
- bool isPrefixed, char const* prefixed,
- unsigned* length, char const** value)
-{
- if (!isPrefixed) {
- *length = static_cast<unsigned>(strlen(prefixed));
- *value = prefixed;
- } else {
- *length = *reinterpret_cast<unsigned const*>(prefixed);
- *value = prefixed + sizeof(unsigned);
- }
-}
-/** Free the string duplicated by duplicateStringValue()/duplicateAndPrefixStringValue().
- */
-#if JSONCPP_USING_SECURE_MEMORY
-static inline void releasePrefixedStringValue(char* value) {
- unsigned length = 0;
- char const* valueDecoded;
- decodePrefixedString(true, value, &length, &valueDecoded);
- size_t const size = sizeof(unsigned) + length + 1U;
- memset(value, 0, size);
- free(value);
-}
-static inline void releaseStringValue(char* value, unsigned length) {
- // length==0 => we allocated the strings memory
- size_t size = (length==0) ? strlen(value) : length;
- memset(value, 0, size);
- free(value);
-}
-#else // !JSONCPP_USING_SECURE_MEMORY
-static inline void releasePrefixedStringValue(char* value) {
- free(value);
-}
-static inline void releaseStringValue(char* value, unsigned) {
- free(value);
-}
-#endif // JSONCPP_USING_SECURE_MEMORY
-
-} // namespace Json
-} // namespace rmq
-
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// ValueInternals...
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-#if !defined(JSON_IS_AMALGAMATION)
-
-#include "json_valueiterator.inl"
-#endif // if !defined(JSON_IS_AMALGAMATION)
-
-namespace rmq {
-namespace Json {
-
-Exception::Exception(JSONCPP_STRING const& msg)
- : msg_(msg)
-{}
-Exception::~Exception() throw()
-{}
-char const* Exception::what() const throw()
-{
- return msg_.c_str();
-}
-RuntimeError::RuntimeError(JSONCPP_STRING const& msg)
- : Exception(msg)
-{}
-LogicError::LogicError(JSONCPP_STRING const& msg)
- : Exception(msg)
-{}
-JSONCPP_NORETURN void throwRuntimeError(JSONCPP_STRING const& msg)
-{
- throw RuntimeError(msg);
-}
-JSONCPP_NORETURN void throwLogicError(JSONCPP_STRING const& msg)
-{
- throw LogicError(msg);
-}
-
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// class Value::CommentInfo
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-
-Value::CommentInfo::CommentInfo() : comment_(0)
-{}
-
-Value::CommentInfo::~CommentInfo() {
- if (comment_)
- releaseStringValue(comment_, 0u);
-}
-
-void Value::CommentInfo::setComment(const char* text, size_t len) {
- if (comment_) {
- releaseStringValue(comment_, 0u);
- comment_ = 0;
- }
- JSON_ASSERT(text != 0);
- JSON_ASSERT_MESSAGE(
- text[0] == '\0' || text[0] == '/',
- "in Json::Value::setComment(): Comments must start with /");
- // It seems that /**/ style comments are acceptable as well.
- comment_ = duplicateStringValue(text, len);
-}
-
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// class Value::CZString
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-
-// Notes: policy_ indicates if the string was allocated when
-// a string is stored.
-
-Value::CZString::CZString(ArrayIndex aindex) : cstr_(0), index_(aindex) {}
-
-Value::CZString::CZString(char const* str, unsigned ulength, DuplicationPolicy allocate)
- : cstr_(str) {
- // allocate != duplicate
- storage_.policy_ = allocate & 0x3;
- storage_.length_ = ulength & 0x3FFFFFFF;
-}
-
-Value::CZString::CZString(const CZString& other) {
- cstr_ = (other.storage_.policy_ != noDuplication && other.cstr_ != 0
- ? duplicateStringValue(other.cstr_, other.storage_.length_)
- : other.cstr_);
- storage_.policy_ = static_cast<unsigned>(other.cstr_
- ? (static_cast<DuplicationPolicy>(other.storage_.policy_) == noDuplication
- ? noDuplication : duplicate)
- : static_cast<DuplicationPolicy>(other.storage_.policy_)) & 3U;
- storage_.length_ = other.storage_.length_;
-}
-
-#if JSON_HAS_RVALUE_REFERENCES
-Value::CZString::CZString(CZString&& other)
- : cstr_(other.cstr_), index_(other.index_) {
- other.cstr_ = nullptr;
-}
-#endif
-
-Value::CZString::~CZString() {
- if (cstr_ && storage_.policy_ == duplicate) {
- releaseStringValue(const_cast<char*>(cstr_), storage_.length_ + 1u); //+1 for null terminating character for sake of completeness but not actually necessary
- }
-}
-
-void Value::CZString::swap(CZString& other) {
- std::swap(cstr_, other.cstr_);
- std::swap(index_, other.index_);
-}
-
-Value::CZString& Value::CZString::operator=(CZString other) {
- swap(other);
- return *this;
-}
-
-bool Value::CZString::operator<(const CZString& other) const {
- if (!cstr_) return index_ < other.index_;
- //return strcmp(cstr_, other.cstr_) < 0;
- // Assume both are strings.
- unsigned this_len = this->storage_.length_;
- unsigned other_len = other.storage_.length_;
- unsigned min_len = std::min(this_len, other_len);
- JSON_ASSERT(this->cstr_ && other.cstr_);
- int comp = memcmp(this->cstr_, other.cstr_, min_len);
- if (comp < 0) return true;
- if (comp > 0) return false;
- return (this_len < other_len);
-}
-
-bool Value::CZString::operator==(const CZString& other) const {
- if (!cstr_) return index_ == other.index_;
- //return strcmp(cstr_, other.cstr_) == 0;
- // Assume both are strings.
- unsigned this_len = this->storage_.length_;
- unsigned other_len = other.storage_.length_;
- if (this_len != other_len) return false;
- JSON_ASSERT(this->cstr_ && other.cstr_);
- int comp = memcmp(this->cstr_, other.cstr_, this_len);
- return comp == 0;
-}
-
-ArrayIndex Value::CZString::index() const { return index_; }
-
-//const char* Value::CZString::c_str() const { return cstr_; }
-const char* Value::CZString::data() const { return cstr_; }
-unsigned Value::CZString::length() const { return storage_.length_; }
-bool Value::CZString::isStaticString() const { return storage_.policy_ == noDuplication; }
-
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// class Value::Value
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-
-/*! \internal Default constructor initialization must be equivalent to:
- * memset( this, 0, sizeof(Value) )
- * This optimization is used in ValueInternalMap fast allocator.
- */
-Value::Value(ValueType vtype) {
- static char const empty[] = "";
- initBasic(vtype);
- switch (vtype) {
- case nullValue:
- break;
- case intValue:
- case uintValue:
- value_.int_ = 0;
- break;
- case realValue:
- value_.real_ = 0.0;
- break;
- case stringValue:
- // allocated_ == false, so this is safe.
- value_.string_ = const_cast<char*>(static_cast<char const*>(empty));
- break;
- case arrayValue:
- case objectValue:
- value_.map_ = new ObjectValues();
- break;
- case booleanValue:
- value_.bool_ = false;
- break;
- default:
- JSON_ASSERT_UNREACHABLE;
- }
-}
-
-Value::Value(Int value) {
- initBasic(intValue);
- value_.int_ = value;
-}
-
-Value::Value(UInt value) {
- initBasic(uintValue);
- value_.uint_ = value;
-}
-#if defined(JSON_HAS_INT64)
-Value::Value(Int64 value) {
- initBasic(intValue);
- value_.int_ = value;
-}
-Value::Value(UInt64 value) {
- initBasic(uintValue);
- value_.uint_ = value;
-}
-#endif // defined(JSON_HAS_INT64)
-
-Value::Value(double value) {
- initBasic(realValue);
- value_.real_ = value;
-}
-
-Value::Value(const char* value) {
- initBasic(stringValue, true);
- value_.string_ = duplicateAndPrefixStringValue(value, static_cast<unsigned>(strlen(value)));
-}
-
-Value::Value(const char* beginValue, const char* endValue) {
- initBasic(stringValue, true);
- value_.string_ =
- duplicateAndPrefixStringValue(beginValue, static_cast<unsigned>(endValue - beginValue));
-}
-
-Value::Value(const JSONCPP_STRING& value) {
- initBasic(stringValue, true);
- value_.string_ =
- duplicateAndPrefixStringValue(value.data(), static_cast<unsigned>(value.length()));
-}
-
-Value::Value(const StaticString& value) {
- initBasic(stringValue);
- value_.string_ = const_cast<char*>(value.c_str());
-}
-
-#ifdef JSON_USE_CPPTL
-Value::Value(const CppTL::ConstString& value) {
- initBasic(stringValue, true);
- value_.string_ = duplicateAndPrefixStringValue(value, static_cast<unsigned>(value.length()));
-}
-#endif
-
-Value::Value(bool value) {
- initBasic(booleanValue);
- value_.bool_ = value;
-}
-
-Value::Value(Value const& other)
- : type_(other.type_), allocated_(false)
- ,
- comments_(0), start_(other.start_), limit_(other.limit_)
-{
- switch (type_) {
- case nullValue:
- case intValue:
- case uintValue:
- case realValue:
- case booleanValue:
- value_ = other.value_;
- break;
- case stringValue:
- if (other.value_.string_ && other.allocated_) {
- unsigned len;
- char const* str;
- decodePrefixedString(other.allocated_, other.value_.string_,
- &len, &str);
- value_.string_ = duplicateAndPrefixStringValue(str, len);
- allocated_ = true;
- } else {
- value_.string_ = other.value_.string_;
- allocated_ = false;
- }
- break;
- case arrayValue:
- case objectValue:
- value_.map_ = new ObjectValues(*other.value_.map_);
- break;
- default:
- JSON_ASSERT_UNREACHABLE;
- }
- if (other.comments_) {
- comments_ = new CommentInfo[numberOfCommentPlacement];
- for (int comment = 0; comment < numberOfCommentPlacement; ++comment) {
- const CommentInfo& otherComment = other.comments_[comment];
- if (otherComment.comment_)
- comments_[comment].setComment(
- otherComment.comment_, strlen(otherComment.comment_));
- }
- }
-}
-
-#if JSON_HAS_RVALUE_REFERENCES
-// Move constructor
-Value::Value(Value&& other) {
- initBasic(nullValue);
- swap(other);
-}
-#endif
-
-Value::~Value() {
- switch (type_) {
- case nullValue:
- case intValue:
- case uintValue:
- case realValue:
- case booleanValue:
- break;
- case stringValue:
- if (allocated_)
- releasePrefixedStringValue(value_.string_);
- break;
- case arrayValue:
- case objectValue:
- delete value_.map_;
- break;
- default:
- JSON_ASSERT_UNREACHABLE;
- }
-
- delete[] comments_;
-
- value_.uint_ = 0;
-}
-
-Value& Value::operator=(Value other) {
- swap(other);
- return *this;
-}
-
-void Value::swapPayload(Value& other) {
- ValueType temp = type_;
- type_ = other.type_;
- other.type_ = temp;
- std::swap(value_, other.value_);
- int temp2 = allocated_;
- allocated_ = other.allocated_;
- other.allocated_ = temp2 & 0x1;
-}
-
-void Value::swap(Value& other) {
- swapPayload(other);
- std::swap(comments_, other.comments_);
- std::swap(start_, other.start_);
- std::swap(limit_, other.limit_);
-}
-
-ValueType Value::type() const { return type_; }
-
-int Value::compare(const Value& other) const {
- if (*this < other)
- return -1;
- if (*this > other)
- return 1;
- return 0;
-}
-
-bool Value::operator<(const Value& other) const {
- int typeDelta = type_ - other.type_;
- if (typeDelta)
- return typeDelta < 0 ? true : false;
- switch (type_) {
- case nullValue:
- return false;
- case intValue:
- return value_.int_ < other.value_.int_;
- case uintValue:
- return value_.uint_ < other.value_.uint_;
- case realValue:
- return value_.real_ < other.value_.real_;
- case booleanValue:
- return value_.bool_ < other.value_.bool_;
- case stringValue:
- {
- if ((value_.string_ == 0) || (other.value_.string_ == 0)) {
- if (other.value_.string_) return true;
- else return false;
- }
- unsigned this_len;
- unsigned other_len;
- char const* this_str;
- char const* other_str;
- decodePrefixedString(this->allocated_, this->value_.string_, &this_len, &this_str);
- decodePrefixedString(other.allocated_, other.value_.string_, &other_len, &other_str);
- unsigned min_len = std::min(this_len, other_len);
- JSON_ASSERT(this_str && other_str);
- int comp = memcmp(this_str, other_str, min_len);
- if (comp < 0) return true;
- if (comp > 0) return false;
- return (this_len < other_len);
- }
- case arrayValue:
- case objectValue: {
- int delta = int(value_.map_->size() - other.value_.map_->size());
- if (delta)
- return delta < 0;
- return (*value_.map_) < (*other.value_.map_);
- }
- default:
- JSON_ASSERT_UNREACHABLE;
- }
- return false; // unreachable
-}
-
-bool Value::operator<=(const Value& other) const { return !(other < *this); }
-
-bool Value::operator>=(const Value& other) const { return !(*this < other); }
-
-bool Value::operator>(const Value& other) const { return other < *this; }
-
-bool Value::operator==(const Value& other) const {
- // if ( type_ != other.type_ )
- // GCC 2.95.3 says:
- // attempt to take address of bit-field structure member `Json::Value::type_'
- // Beats me, but a temp solves the problem.
- int temp = other.type_;
- if (type_ != temp)
- return false;
- switch (type_) {
- case nullValue:
- return true;
- case intValue:
- return value_.int_ == other.value_.int_;
- case uintValue:
- return value_.uint_ == other.value_.uint_;
- case realValue:
- return value_.real_ == other.value_.real_;
- case booleanValue:
- return value_.bool_ == other.value_.bool_;
- case stringValue:
- {
- if ((value_.string_ == 0) || (other.value_.string_ == 0)) {
- return (value_.string_ == other.value_.string_);
- }
- unsigned this_len;
- unsigned other_len;
- char const* this_str;
- char const* other_str;
- decodePrefixedString(this->allocated_, this->value_.string_, &this_len, &this_str);
- decodePrefixedString(other.allocated_, other.value_.string_, &other_len, &other_str);
- if (this_len != other_len) return false;
- JSON_ASSERT(this_str && other_str);
- int comp = memcmp(this_str, other_str, this_len);
- return comp == 0;
- }
- case arrayValue:
- case objectValue:
- return value_.map_->size() == other.value_.map_->size() &&
- (*value_.map_) == (*other.value_.map_);
- default:
- JSON_ASSERT_UNREACHABLE;
- }
- return false; // unreachable
-}
-
-bool Value::operator!=(const Value& other) const { return !(*this == other); }
-
-const char* Value::asCString() const {
- JSON_ASSERT_MESSAGE(type_ == stringValue,
- "in Json::Value::asCString(): requires stringValue");
- if (value_.string_ == 0) return 0;
- unsigned this_len;
- char const* this_str;
- decodePrefixedString(this->allocated_, this->value_.string_, &this_len, &this_str);
- return this_str;
-}
-
-#if JSONCPP_USING_SECURE_MEMORY
-unsigned Value::getCStringLength() const {
- JSON_ASSERT_MESSAGE(type_ == stringValue,
- "in Json::Value::asCString(): requires stringValue");
- if (value_.string_ == 0) return 0;
- unsigned this_len;
- char const* this_str;
- decodePrefixedString(this->allocated_, this->value_.string_, &this_len, &this_str);
- return this_len;
-}
-#endif
-
-bool Value::getString(char const** str, char const** cend) const {
- if (type_ != stringValue) return false;
- if (value_.string_ == 0) return false;
- unsigned length;
- decodePrefixedString(this->allocated_, this->value_.string_, &length, str);
- *cend = *str + length;
- return true;
-}
-
-JSONCPP_STRING Value::asString() const {
- switch (type_) {
- case nullValue:
- return "";
- case stringValue:
- {
- if (value_.string_ == 0) return "";
- unsigned this_len;
- char const* this_str;
- decodePrefixedString(this->allocated_, this->value_.string_, &this_len, &this_str);
- return JSONCPP_STRING(this_str, this_len);
- }
- case booleanValue:
- return value_.bool_ ? "true" : "false";
- case intValue:
- return valueToString(value_.int_);
- case uintValue:
- return valueToString(value_.uint_);
- case realValue:
- return valueToString(value_.real_);
- default:
- JSON_FAIL_MESSAGE("Type is not convertible to string");
- }
-}
-
-#ifdef JSON_USE_CPPTL
-CppTL::ConstString Value::asConstString() const {
- unsigned len;
- char const* str;
- decodePrefixedString(allocated_, value_.string_,
- &len, &str);
- return CppTL::ConstString(str, len);
-}
-#endif
-
-Value::Int Value::asInt() const {
- switch (type_) {
- case intValue:
- JSON_ASSERT_MESSAGE(isInt(), "LargestInt out of Int range");
- return Int(value_.int_);
- case uintValue:
- JSON_ASSERT_MESSAGE(isInt(), "LargestUInt out of Int range");
- return Int(value_.uint_);
- case realValue:
- JSON_ASSERT_MESSAGE(InRange(value_.real_, minInt, maxInt),
- "double out of Int range");
- return Int(value_.real_);
- case nullValue:
- return 0;
- case booleanValue:
- return value_.bool_ ? 1 : 0;
- default:
- break;
- }
- JSON_FAIL_MESSAGE("Value is not convertible to Int.");
-}
-
-Value::UInt Value::asUInt() const {
- switch (type_) {
- case intValue:
- JSON_ASSERT_MESSAGE(isUInt(), "LargestInt out of UInt range");
- return UInt(value_.int_);
- case uintValue:
- JSON_ASSERT_MESSAGE(isUInt(), "LargestUInt out of UInt range");
- return UInt(value_.uint_);
- case realValue:
- JSON_ASSERT_MESSAGE(InRange(value_.real_, 0, maxUInt),
- "double out of UInt range");
- return UInt(value_.real_);
- case nullValue:
- return 0;
- case booleanValue:
- return value_.bool_ ? 1 : 0;
- default:
- break;
- }
- JSON_FAIL_MESSAGE("Value is not convertible to UInt.");
-}
-
-#if defined(JSON_HAS_INT64)
-
-Value::Int64 Value::asInt64() const {
- switch (type_) {
- case intValue:
- return Int64(value_.int_);
- case uintValue:
- JSON_ASSERT_MESSAGE(isInt64(), "LargestUInt out of Int64 range");
- return Int64(value_.uint_);
- case realValue:
- JSON_ASSERT_MESSAGE(InRange(value_.real_, minInt64, maxInt64),
- "double out of Int64 range");
- return Int64(value_.real_);
- case nullValue:
- return 0;
- case booleanValue:
- return value_.bool_ ? 1 : 0;
- default:
- break;
- }
- JSON_FAIL_MESSAGE("Value is not convertible to Int64.");
-}
-
-Value::UInt64 Value::asUInt64() const {
- switch (type_) {
- case intValue:
- JSON_ASSERT_MESSAGE(isUInt64(), "LargestInt out of UInt64 range");
- return UInt64(value_.int_);
- case uintValue:
- return UInt64(value_.uint_);
- case realValue:
- JSON_ASSERT_MESSAGE(InRange(value_.real_, 0, maxUInt64),
- "double out of UInt64 range");
- return UInt64(value_.real_);
- case nullValue:
- return 0;
- case booleanValue:
- return value_.bool_ ? 1 : 0;
- default:
- break;
- }
- JSON_FAIL_MESSAGE("Value is not convertible to UInt64.");
-}
-#endif // if defined(JSON_HAS_INT64)
-
-LargestInt Value::asLargestInt() const {
-#if defined(JSON_NO_INT64)
- return asInt();
-#else
- return asInt64();
-#endif
-}
-
-LargestUInt Value::asLargestUInt() const {
-#if defined(JSON_NO_INT64)
- return asUInt();
-#else
- return asUInt64();
-#endif
-}
-
-double Value::asDouble() const {
- switch (type_) {
- case intValue:
- return static_cast<double>(value_.int_);
- case uintValue:
-#if !defined(JSON_USE_INT64_DOUBLE_CONVERSION)
- return static_cast<double>(value_.uint_);
-#else // if !defined(JSON_USE_INT64_DOUBLE_CONVERSION)
- return integerToDouble(value_.uint_);
-#endif // if !defined(JSON_USE_INT64_DOUBLE_CONVERSION)
- case realValue:
- return value_.real_;
- case nullValue:
- return 0.0;
- case booleanValue:
- return value_.bool_ ? 1.0 : 0.0;
- default:
- break;
- }
- JSON_FAIL_MESSAGE("Value is not convertible to double.");
-}
-
-float Value::asFloat() const {
- switch (type_) {
- case intValue:
- return static_cast<float>(value_.int_);
- case uintValue:
-#if !defined(JSON_USE_INT64_DOUBLE_CONVERSION)
- return static_cast<float>(value_.uint_);
-#else // if !defined(JSON_USE_INT64_DOUBLE_CONVERSION)
- // This can fail (silently?) if the value is bigger than MAX_FLOAT.
- return static_cast<float>(integerToDouble(value_.uint_));
-#endif // if !defined(JSON_USE_INT64_DOUBLE_CONVERSION)
- case realValue:
- return static_cast<float>(value_.real_);
- case nullValue:
- return 0.0;
- case booleanValue:
- return value_.bool_ ? 1.0f : 0.0f;
- default:
- break;
- }
- JSON_FAIL_MESSAGE("Value is not convertible to float.");
-}
-
-bool Value::asBool() const {
- switch (type_) {
- case booleanValue:
- return value_.bool_;
- case nullValue:
- return false;
- case intValue:
- return value_.int_ ? true : false;
- case uintValue:
- return value_.uint_ ? true : false;
- case realValue:
- // This is kind of strange. Not recommended.
- return (value_.real_ != 0.0) ? true : false;
- default:
- break;
- }
- JSON_FAIL_MESSAGE("Value is not convertible to bool.");
-}
-
-bool Value::isConvertibleTo(ValueType other) const {
- switch (other) {
- case nullValue:
- return (isNumeric() && asDouble() == 0.0) ||
- (type_ == booleanValue && value_.bool_ == false) ||
- (type_ == stringValue && asString() == "") ||
- (type_ == arrayValue && value_.map_->size() == 0) ||
- (type_ == objectValue && value_.map_->size() == 0) ||
- type_ == nullValue;
- case intValue:
- return isInt() ||
- (type_ == realValue && InRange(value_.real_, minInt, maxInt)) ||
- type_ == booleanValue || type_ == nullValue;
- case uintValue:
- return isUInt() ||
- (type_ == realValue && InRange(value_.real_, 0, maxUInt)) ||
- type_ == booleanValue || type_ == nullValue;
- case realValue:
- return isNumeric() || type_ == booleanValue || type_ == nullValue;
- case booleanValue:
- return isNumeric() || type_ == booleanValue || type_ == nullValue;
- case stringValue:
- return isNumeric() || type_ == booleanValue || type_ == stringValue ||
- type_ == nullValue;
- case arrayValue:
- return type_ == arrayValue || type_ == nullValue;
- case objectValue:
- return type_ == objectValue || type_ == nullValue;
- }
- JSON_ASSERT_UNREACHABLE;
- return false;
-}
-
-/// Number of values in array or object
-ArrayIndex Value::size() const {
- switch (type_) {
- case nullValue:
- case intValue:
- case uintValue:
- case realValue:
- case booleanValue:
- case stringValue:
- return 0;
- case arrayValue: // size of the array is highest index + 1
- if (!value_.map_->empty()) {
- ObjectValues::const_iterator itLast = value_.map_->end();
- --itLast;
- return (*itLast).first.index() + 1;
- }
- return 0;
- case objectValue:
- return ArrayIndex(value_.map_->size());
- }
- JSON_ASSERT_UNREACHABLE;
- return 0; // unreachable;
-}
-
-bool Value::empty() const {
- if (isNull() || isArray() || isObject())
- return size() == 0u;
- else
- return false;
-}
-
-bool Value::operator!() const { return isNull(); }
-
-void Value::clear() {
- JSON_ASSERT_MESSAGE(type_ == nullValue || type_ == arrayValue ||
- type_ == objectValue,
- "in Json::Value::clear(): requires complex value");
- start_ = 0;
- limit_ = 0;
- switch (type_) {
- case arrayValue:
- case objectValue:
- value_.map_->clear();
- break;
- default:
- break;
- }
-}
-
-void Value::resize(ArrayIndex newSize) {
- JSON_ASSERT_MESSAGE(type_ == nullValue || type_ == arrayValue,
- "in Json::Value::resize(): requires arrayValue");
- if (type_ == nullValue)
- *this = Value(arrayValue);
- ArrayIndex oldSize = size();
- if (newSize == 0)
- clear();
- else if (newSize > oldSize)
- (*this)[newSize - 1];
- else {
- for (ArrayIndex index = newSize; index < oldSize; ++index) {
- value_.map_->erase(index);
- }
- JSON_ASSERT(size() == newSize);
- }
-}
-
-Value& Value::operator[](ArrayIndex index) {
- JSON_ASSERT_MESSAGE(
- type_ == nullValue || type_ == arrayValue,
- "in Json::Value::operator[](ArrayIndex): requires arrayValue");
- if (type_ == nullValue)
- *this = Value(arrayValue);
- CZString key(index);
- ObjectValues::iterator it = value_.map_->lower_bound(key);
- if (it != value_.map_->end() && (*it).first == key)
- return (*it).second;
-
- ObjectValues::value_type defaultValue(key, nullSingleton());
- it = value_.map_->insert(it, defaultValue);
- return (*it).second;
-}
-
-#if 0
-Value& Value::operator[](int index) {
- JSON_ASSERT_MESSAGE(
- index >= 0,
- "in Json::Value::operator[](int index): index cannot be negative");
- return (*this)[ArrayIndex(index)];
-}
-#endif
-const Value& Value::operator[](ArrayIndex index) const {
- JSON_ASSERT_MESSAGE(
- type_ == nullValue || type_ == arrayValue,
- "in Json::Value::operator[](ArrayIndex)const: requires arrayValue");
- if (type_ == nullValue)
- return nullSingleton();
- CZString key(index);
- ObjectValues::const_iterator it = value_.map_->find(key);
- if (it == value_.map_->end())
- return nullSingleton();
- return (*it).second;
-}
-
-#if 0
-const Value& Value::operator[](int index) const {
- JSON_ASSERT_MESSAGE(
- index >= 0,
- "in Json::Value::operator[](int index) const: index cannot be negative");
- return (*this)[ArrayIndex(index)];
-}
-#endif
-
-void Value::initBasic(ValueType vtype, bool allocated) {
- type_ = vtype;
- allocated_ = allocated;
- comments_ = 0;
- start_ = 0;
- limit_ = 0;
-}
-
-// Access an object value by name, create a null member if it does not exist.
-// @pre Type of '*this' is object or null.
-// @param key is null-terminated.
-Value& Value::resolveReference(const char* key) {
- JSON_ASSERT_MESSAGE(
- type_ == nullValue || type_ == objectValue,
- "in Json::Value::resolveReference(): requires objectValue");
- if (type_ == nullValue)
- *this = Value(objectValue);
- CZString actualKey(
- key, static_cast<unsigned>(strlen(key)), CZString::noDuplication); // NOTE!
- ObjectValues::iterator it = value_.map_->lower_bound(actualKey);
- if (it != value_.map_->end() && (*it).first == actualKey)
- return (*it).second;
-
- ObjectValues::value_type defaultValue(actualKey, nullSingleton());
- it = value_.map_->insert(it, defaultValue);
- Value& value = (*it).second;
- return value;
-}
-
-// @param key is not null-terminated.
-Value& Value::resolveReference(char const* key, char const* cend)
-{
- JSON_ASSERT_MESSAGE(
- type_ == nullValue || type_ == objectValue,
- "in Json::Value::resolveReference(key, end): requires objectValue");
- if (type_ == nullValue)
- *this = Value(objectValue);
- CZString actualKey(
- key, static_cast<unsigned>(cend-key), CZString::duplicateOnCopy);
- ObjectValues::iterator it = value_.map_->lower_bound(actualKey);
- if (it != value_.map_->end() && (*it).first == actualKey)
- return (*it).second;
-
- ObjectValues::value_type defaultValue(actualKey, nullSingleton());
- it = value_.map_->insert(it, defaultValue);
- Value& value = (*it).second;
- return value;
-}
-
-Value Value::get(ArrayIndex index, const Value& defaultValue) const {
- const Value* value = &((*this)[index]);
- return value == &nullSingleton() ? defaultValue : *value;
-}
-
-bool Value::isValidIndex(ArrayIndex index) const { return index < size(); }
-
-Value const* Value::find(char const* key, char const* cend) const
-{
- JSON_ASSERT_MESSAGE(
- type_ == nullValue || type_ == objectValue,
- "in Json::Value::find(key, end, found): requires objectValue or nullValue");
- if (type_ == nullValue) return NULL;
- CZString actualKey(key, static_cast<unsigned>(cend-key), CZString::noDuplication);
- ObjectValues::const_iterator it = value_.map_->find(actualKey);
- if (it == value_.map_->end()) return NULL;
- return &(*it).second;
-}
-const Value& Value::operator[](const char* key) const
-{
- Value const* found = find(key, key + strlen(key));
- if (!found) return nullSingleton();
- return *found;
-}
-Value const& Value::operator[](JSONCPP_STRING const& key) const
-{
- Value const* found = find(key.data(), key.data() + key.length());
- if (!found) return nullSingleton();
- return *found;
-}
-
-Value& Value::operator[](const char* key) {
- return resolveReference(key, key + strlen(key));
-}
-
-Value& Value::operator[](const JSONCPP_STRING& key) {
- return resolveReference(key.data(), key.data() + key.length());
-}
-
-Value& Value::operator[](const StaticString& key) {
- return resolveReference(key.c_str());
-}
-
-#ifdef JSON_USE_CPPTL
-Value& Value::operator[](const CppTL::ConstString& key) {
- return resolveReference(key.c_str(), key.end_c_str());
-}
-Value const& Value::operator[](CppTL::ConstString const& key) const
-{
- Value const* found = find(key.c_str(), key.end_c_str());
- if (!found) return nullSingleton();
- return *found;
-}
-#endif
-
-Value& Value::append(const Value& value) { return (*this)[size()] = value; }
-
-Value Value::get(char const* key, char const* cend, Value const& defaultValue) const
-{
- Value const* found = find(key, cend);
- return !found ? defaultValue : *found;
-}
-Value Value::get(char const* key, Value const& defaultValue) const
-{
- return get(key, key + strlen(key), defaultValue);
-}
-Value Value::get(JSONCPP_STRING const& key, Value const& defaultValue) const
-{
- return get(key.data(), key.data() + key.length(), defaultValue);
-}
-
-
-bool Value::removeMember(const char* key, const char* cend, Value* removed)
-{
- if (type_ != objectValue) {
- return false;
- }
- CZString actualKey(key, static_cast<unsigned>(cend-key), CZString::noDuplication);
- ObjectValues::iterator it = value_.map_->find(actualKey);
- if (it == value_.map_->end())
- return false;
- *removed = it->second;
- value_.map_->erase(it);
- return true;
-}
-bool Value::removeMember(const char* key, Value* removed)
-{
- return removeMember(key, key + strlen(key), removed);
-}
-bool Value::removeMember(JSONCPP_STRING const& key, Value* removed)
-{
- return removeMember(key.data(), key.data() + key.length(), removed);
-}
-Value Value::removeMember(const char* key)
-{
- JSON_ASSERT_MESSAGE(type_ == nullValue || type_ == objectValue,
- "in Json::Value::removeMember(): requires objectValue");
- if (type_ == nullValue)
- return nullSingleton();
-
- Value removed; // null
- removeMember(key, key + strlen(key), &removed);
- return removed; // still null if removeMember() did nothing
-}
-Value Value::removeMember(const JSONCPP_STRING& key)
-{
- return removeMember(key.c_str());
-}
-
-bool Value::removeIndex(ArrayIndex index, Value* removed) {
- if (type_ != arrayValue) {
- return false;
- }
- CZString key(index);
- ObjectValues::iterator it = value_.map_->find(key);
- if (it == value_.map_->end()) {
- return false;
- }
- *removed = it->second;
- ArrayIndex oldSize = size();
- // shift left all items left, into the place of the "removed"
- for (ArrayIndex i = index; i < (oldSize - 1); ++i){
- CZString keey(i);
- (*value_.map_)[keey] = (*this)[i + 1];
- }
- // erase the last one ("leftover")
- CZString keyLast(oldSize - 1);
- ObjectValues::iterator itLast = value_.map_->find(keyLast);
- value_.map_->erase(itLast);
- return true;
-}
-
-#ifdef JSON_USE_CPPTL
-Value Value::get(const CppTL::ConstString& key,
- const Value& defaultValue) const {
- return get(key.c_str(), key.end_c_str(), defaultValue);
-}
-#endif
-
-bool Value::isMember(char const* key, char const* cend) const
-{
- Value const* value = find(key, cend);
- return NULL != value;
-}
-bool Value::isMember(char const* key) const
-{
- return isMember(key, key + strlen(key));
-}
-bool Value::isMember(JSONCPP_STRING const& key) const
-{
- return isMember(key.data(), key.data() + key.length());
-}
-
-#ifdef JSON_USE_CPPTL
-bool Value::isMember(const CppTL::ConstString& key) const {
- return isMember(key.c_str(), key.end_c_str());
-}
-#endif
-
-Value::Members Value::getMemberNames() const {
- JSON_ASSERT_MESSAGE(
- type_ == nullValue || type_ == objectValue,
- "in Json::Value::getMemberNames(), value must be objectValue");
- if (type_ == nullValue)
- return Value::Members();
- Members members;
- members.reserve(value_.map_->size());
- ObjectValues::const_iterator it = value_.map_->begin();
- ObjectValues::const_iterator itEnd = value_.map_->end();
- for (; it != itEnd; ++it) {
- members.push_back(JSONCPP_STRING((*it).first.data(),
- (*it).first.length()));
- }
- return members;
-}
-//
-//# ifdef JSON_USE_CPPTL
-// EnumMemberNames
-// Value::enumMemberNames() const
-//{
-// if ( type_ == objectValue )
-// {
-// return CppTL::Enum::any( CppTL::Enum::transform(
-// CppTL::Enum::keys( *(value_.map_), CppTL::Type<const CZString &>() ),
-// MemberNamesTransform() ) );
-// }
-// return EnumMemberNames();
-//}
-//
-//
-// EnumValues
-// Value::enumValues() const
-//{
-// if ( type_ == objectValue || type_ == arrayValue )
-// return CppTL::Enum::anyValues( *(value_.map_),
-// CppTL::Type<const Value &>() );
-// return EnumValues();
-//}
-//
-//# endif
-
-static bool IsIntegral(double d) {
- double integral_part;
- return modf(d, &integral_part) == 0.0;
-}
-
-bool Value::isNull() const { return type_ == nullValue; }
-
-bool Value::isBool() const { return type_ == booleanValue; }
-
-bool Value::isInt() const {
- switch (type_) {
- case intValue:
- return value_.int_ >= minInt && value_.int_ <= maxInt;
- case uintValue:
- return value_.uint_ <= UInt(maxInt);
- case realValue:
- return value_.real_ >= minInt && value_.real_ <= maxInt &&
- IsIntegral(value_.real_);
- default:
- break;
- }
- return false;
-}
-
-bool Value::isUInt() const {
- switch (type_) {
- case intValue:
- return value_.int_ >= 0 && LargestUInt(value_.int_) <= LargestUInt(maxUInt);
- case uintValue:
- return value_.uint_ <= maxUInt;
- case realValue:
- return value_.real_ >= 0 && value_.real_ <= maxUInt &&
- IsIntegral(value_.real_);
- default:
- break;
- }
- return false;
-}
-
-bool Value::isInt64() const {
-#if defined(JSON_HAS_INT64)
- switch (type_) {
- case intValue:
- return true;
- case uintValue:
- return value_.uint_ <= UInt64(maxInt64);
- case realValue:
- // Note that maxInt64 (= 2^63 - 1) is not exactly representable as a
- // double, so double(maxInt64) will be rounded up to 2^63. Therefore we
- // require the value to be strictly less than the limit.
- return value_.real_ >= double(minInt64) &&
- value_.real_ < double(maxInt64) && IsIntegral(value_.real_);
- default:
- break;
- }
-#endif // JSON_HAS_INT64
- return false;
-}
-
-bool Value::isUInt64() const {
-#if defined(JSON_HAS_INT64)
- switch (type_) {
- case intValue:
- return value_.int_ >= 0;
- case uintValue:
- return true;
- case realValue:
- // Note that maxUInt64 (= 2^64 - 1) is not exactly representable as a
- // double, so double(maxUInt64) will be rounded up to 2^64. Therefore we
- // require the value to be strictly less than the limit.
- return value_.real_ >= 0 && value_.real_ < maxUInt64AsDouble &&
- IsIntegral(value_.real_);
- default:
- break;
- }
-#endif // JSON_HAS_INT64
- return false;
-}
-
-bool Value::isIntegral() const {
-#if defined(JSON_HAS_INT64)
- return isInt64() || isUInt64();
-#else
- return isInt() || isUInt();
-#endif
-}
-
-bool Value::isDouble() const { return type_ == realValue || isIntegral(); }
-
-bool Value::isNumeric() const { return isIntegral() || isDouble(); }
-
-bool Value::isString() const { return type_ == stringValue; }
-
-bool Value::isArray() const { return type_ == arrayValue; }
-
-bool Value::isObject() const { return type_ == objectValue; }
-
-void Value::setComment(const char* comment, size_t len, CommentPlacement placement) {
- if (!comments_)
- comments_ = new CommentInfo[numberOfCommentPlacement];
- if ((len > 0) && (comment[len-1] == '\n')) {
- // Always discard trailing newline, to aid indentation.
- len -= 1;
- }
- comments_[placement].setComment(comment, len);
-}
-
-void Value::setComment(const char* comment, CommentPlacement placement) {
- setComment(comment, strlen(comment), placement);
-}
-
-void Value::setComment(const JSONCPP_STRING& comment, CommentPlacement placement) {
- setComment(comment.c_str(), comment.length(), placement);
-}
-
-bool Value::hasComment(CommentPlacement placement) const {
- return comments_ != 0 && comments_[placement].comment_ != 0;
-}
-
-JSONCPP_STRING Value::getComment(CommentPlacement placement) const {
- if (hasComment(placement))
- return comments_[placement].comment_;
- return "";
-}
-
-void Value::setOffsetStart(ptrdiff_t start) { start_ = start; }
-
-void Value::setOffsetLimit(ptrdiff_t limit) { limit_ = limit; }
-
-ptrdiff_t Value::getOffsetStart() const { return start_; }
-
-ptrdiff_t Value::getOffsetLimit() const { return limit_; }
-
-JSONCPP_STRING Value::toStyledString() const {
- StyledWriter writer;
- return writer.write(*this);
-}
-
-Value::const_iterator Value::begin() const {
- switch (type_) {
- case arrayValue:
- case objectValue:
- if (value_.map_)
- return const_iterator(value_.map_->begin());
- break;
- default:
- break;
- }
- return const_iterator();
-}
-
-Value::const_iterator Value::end() const {
- switch (type_) {
- case arrayValue:
- case objectValue:
- if (value_.map_)
- return const_iterator(value_.map_->end());
- break;
- default:
- break;
- }
- return const_iterator();
-}
-
-Value::iterator Value::begin() {
- switch (type_) {
- case arrayValue:
- case objectValue:
- if (value_.map_)
- return iterator(value_.map_->begin());
- break;
- default:
- break;
- }
- return iterator();
-}
-
-Value::iterator Value::end() {
- switch (type_) {
- case arrayValue:
- case objectValue:
- if (value_.map_)
- return iterator(value_.map_->end());
- break;
- default:
- break;
- }
- return iterator();
-}
-
-// class PathArgument
-// //////////////////////////////////////////////////////////////////
-
-PathArgument::PathArgument() : key_(), index_(), kind_(kindNone) {}
-
-PathArgument::PathArgument(ArrayIndex index)
- : key_(), index_(index), kind_(kindIndex) {}
-
-PathArgument::PathArgument(const char* key)
- : key_(key), index_(), kind_(kindKey) {}
-
-PathArgument::PathArgument(const JSONCPP_STRING& key)
- : key_(key.c_str()), index_(), kind_(kindKey) {}
-
-// class Path
-// //////////////////////////////////////////////////////////////////
-
-Path::Path(const JSONCPP_STRING& path,
- const PathArgument& a1,
- const PathArgument& a2,
- const PathArgument& a3,
- const PathArgument& a4,
- const PathArgument& a5) {
- InArgs in;
- in.push_back(&a1);
- in.push_back(&a2);
- in.push_back(&a3);
- in.push_back(&a4);
- in.push_back(&a5);
- makePath(path, in);
-}
-
-void Path::makePath(const JSONCPP_STRING& path, const InArgs& in) {
- const char* current = path.c_str();
- const char* end = current + path.length();
- InArgs::const_iterator itInArg = in.begin();
- while (current != end) {
- if (*current == '[') {
- ++current;
- if (*current == '%')
- addPathInArg(path, in, itInArg, PathArgument::kindIndex);
- else {
- ArrayIndex index = 0;
- for (; current != end && *current >= '0' && *current <= '9'; ++current)
- index = index * 10 + ArrayIndex(*current - '0');
- args_.push_back(index);
- }
- if (current == end || *++current != ']')
- invalidPath(path, int(current - path.c_str()));
- } else if (*current == '%') {
- addPathInArg(path, in, itInArg, PathArgument::kindKey);
- ++current;
- } else if (*current == '.' || *current == ']') {
- ++current;
- } else {
- const char* beginName = current;
- while (current != end && !strchr("[.", *current))
- ++current;
- args_.push_back(JSONCPP_STRING(beginName, current));
- }
- }
-}
-
-void Path::addPathInArg(const JSONCPP_STRING& /*path*/,
- const InArgs& in,
- InArgs::const_iterator& itInArg,
- PathArgument::Kind kind) {
- if (itInArg == in.end()) {
- // Error: missing argument %d
- } else if ((*itInArg)->kind_ != kind) {
- // Error: bad argument type
- } else {
- args_.push_back(**itInArg++);
- }
-}
-
-void Path::invalidPath(const JSONCPP_STRING& /*path*/, int /*location*/) {
- // Error: invalid path.
-}
-
-const Value& Path::resolve(const Value& root) const {
- const Value* node = &root;
- for (Args::const_iterator it = args_.begin(); it != args_.end(); ++it) {
- const PathArgument& arg = *it;
- if (arg.kind_ == PathArgument::kindIndex) {
- if (!node->isArray() || !node->isValidIndex(arg.index_)) {
- // Error: unable to resolve path (array value expected at position...
- return Value::null;
- }
- node = &((*node)[arg.index_]);
- } else if (arg.kind_ == PathArgument::kindKey) {
- if (!node->isObject()) {
- // Error: unable to resolve path (object value expected at position...)
- return Value::null;
- }
- node = &((*node)[arg.key_]);
- if (node == &Value::nullSingleton()) {
- // Error: unable to resolve path (object has no member named '' at
- // position...)
- return Value::null;
- }
- }
- }
- return *node;
-}
-
-Value Path::resolve(const Value& root, const Value& defaultValue) const {
- const Value* node = &root;
- for (Args::const_iterator it = args_.begin(); it != args_.end(); ++it) {
- const PathArgument& arg = *it;
- if (arg.kind_ == PathArgument::kindIndex) {
- if (!node->isArray() || !node->isValidIndex(arg.index_))
- return defaultValue;
- node = &((*node)[arg.index_]);
- } else if (arg.kind_ == PathArgument::kindKey) {
- if (!node->isObject())
- return defaultValue;
- node = &((*node)[arg.key_]);
- if (node == &Value::nullSingleton())
- return defaultValue;
- }
- }
- return *node;
-}
-
-Value& Path::make(Value& root) const {
- Value* node = &root;
- for (Args::const_iterator it = args_.begin(); it != args_.end(); ++it) {
- const PathArgument& arg = *it;
- if (arg.kind_ == PathArgument::kindIndex) {
- if (!node->isArray()) {
- // Error: node is not an array at position ...
- }
- node = &((*node)[arg.index_]);
- } else if (arg.kind_ == PathArgument::kindKey) {
- if (!node->isObject()) {
- // Error: node is not an object at position...
- }
- node = &((*node)[arg.key_]);
- }
- }
- return *node;
-}
-
-} // namespace Json
-} // namespace rmq
-
diff --git a/rocketmq-client4cpp/src/jsoncpp/json_valueiterator.inl b/rocketmq-client4cpp/src/jsoncpp/json_valueiterator.inl
deleted file mode 100755
index 50b4aa25..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json_valueiterator.inl
+++ /dev/null
@@ -1,171 +0,0 @@
-// Copyright 2007-2010 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-// included by json_value.cpp
-
-namespace rmq {
-namespace Json {
-
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// class ValueIteratorBase
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-
-ValueIteratorBase::ValueIteratorBase()
- : current_(), isNull_(true) {
-}
-
-ValueIteratorBase::ValueIteratorBase(
- const Value::ObjectValues::iterator& current)
- : current_(current), isNull_(false) {}
-
-Value& ValueIteratorBase::deref() const {
- return current_->second;
-}
-
-void ValueIteratorBase::increment() {
- ++current_;
-}
-
-void ValueIteratorBase::decrement() {
- --current_;
-}
-
-ValueIteratorBase::difference_type
-ValueIteratorBase::computeDistance(const SelfType& other) const {
-#ifdef JSON_USE_CPPTL_SMALLMAP
- return other.current_ - current_;
-#else
- // Iterator for null value are initialized using the default
- // constructor, which initialize current_ to the default
- // std::map::iterator. As begin() and end() are two instance
- // of the default std::map::iterator, they can not be compared.
- // To allow this, we handle this comparison specifically.
- if (isNull_ && other.isNull_) {
- return 0;
- }
-
- // Usage of std::distance is not portable (does not compile with Sun Studio 12
- // RogueWave STL,
- // which is the one used by default).
- // Using a portable hand-made version for non random iterator instead:
- // return difference_type( std::distance( current_, other.current_ ) );
- difference_type myDistance = 0;
- for (Value::ObjectValues::iterator it = current_; it != other.current_;
- ++it) {
- ++myDistance;
- }
- return myDistance;
-#endif
-}
-
-bool ValueIteratorBase::isEqual(const SelfType& other) const {
- if (isNull_) {
- return other.isNull_;
- }
- return current_ == other.current_;
-}
-
-void ValueIteratorBase::copy(const SelfType& other) {
- current_ = other.current_;
- isNull_ = other.isNull_;
-}
-
-Value ValueIteratorBase::key() const {
- const Value::CZString czstring = (*current_).first;
- if (czstring.data()) {
- if (czstring.isStaticString())
- return Value(StaticString(czstring.data()));
- return Value(czstring.data(), czstring.data() + czstring.length());
- }
- return Value(czstring.index());
-}
-
-UInt ValueIteratorBase::index() const {
- const Value::CZString czstring = (*current_).first;
- if (!czstring.data())
- return czstring.index();
- return Value::UInt(-1);
-}
-
-JSONCPP_STRING ValueIteratorBase::name() const {
- char const* keey;
- char const* end;
- keey = memberName(&end);
- if (!keey) return JSONCPP_STRING();
- return JSONCPP_STRING(keey, end);
-}
-
-char const* ValueIteratorBase::memberName() const {
- const char* cname = (*current_).first.data();
- return cname ? cname : "";
-}
-
-char const* ValueIteratorBase::memberName(char const** end) const {
- const char* cname = (*current_).first.data();
- if (!cname) {
- *end = NULL;
- return NULL;
- }
- *end = cname + (*current_).first.length();
- return cname;
-}
-
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// class ValueConstIterator
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-
-ValueConstIterator::ValueConstIterator() {}
-
-ValueConstIterator::ValueConstIterator(
- const Value::ObjectValues::iterator& current)
- : ValueIteratorBase(current) {}
-
-ValueConstIterator::ValueConstIterator(ValueIterator const& other)
- : ValueIteratorBase(other) {}
-
-ValueConstIterator& ValueConstIterator::
-operator=(const ValueIteratorBase& other) {
- copy(other);
- return *this;
-}
-
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// class ValueIterator
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-// //////////////////////////////////////////////////////////////////
-
-ValueIterator::ValueIterator() {}
-
-ValueIterator::ValueIterator(const Value::ObjectValues::iterator& current)
- : ValueIteratorBase(current) {}
-
-ValueIterator::ValueIterator(const ValueConstIterator& other)
- : ValueIteratorBase(other) {
- throwRuntimeError("ConstIterator to Iterator should never be allowed.");
-}
-
-ValueIterator::ValueIterator(const ValueIterator& other)
- : ValueIteratorBase(other) {}
-
-ValueIterator& ValueIterator::operator=(const SelfType& other) {
- copy(other);
- return *this;
-}
-
-} // namespace Json
-} // namespace rmq
-
-
diff --git a/rocketmq-client4cpp/src/jsoncpp/json_writer.cpp b/rocketmq-client4cpp/src/jsoncpp/json_writer.cpp
deleted file mode 100755
index 9d9e0cca..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/json_writer.cpp
+++ /dev/null
@@ -1,1220 +0,0 @@
-// Copyright 2011 Baptiste Lepilleur
-// Distributed under MIT license, or public domain if desired and
-// recognized in your jurisdiction.
-// See file LICENSE for detail or copy at http://jsoncpp.sourceforge.net/LICENSE
-
-#if !defined(JSON_IS_AMALGAMATION)
-#include <json/writer.h>
-#include "json_tool.h"
-#endif // if !defined(JSON_IS_AMALGAMATION)
-#include <iomanip>
-#include <memory>
-#include <sstream>
-#include <utility>
-#include <set>
-#include <cassert>
-#include <cstring>
-#include <cstdio>
-
-#if defined(_MSC_VER) && _MSC_VER >= 1200 && _MSC_VER < 1800 // Between VC++ 6.0 and VC++ 11.0
-#include <float.h>
-#define isfinite _finite
-#elif defined(__sun) && defined(__SVR4) //Solaris
-#if !defined(isfinite)
-#include <ieeefp.h>
-#define isfinite finite
-#endif
-#elif defined(_AIX)
-#if !defined(isfinite)
-#include <math.h>
-#define isfinite finite
-#endif
-#elif defined(__hpux)
-#if !defined(isfinite)
-#if defined(__ia64) && !defined(finite)
-#define isfinite(x) ((sizeof(x) == sizeof(float) ? \
- _Isfinitef(x) : _IsFinite(x)))
-#else
-#include <math.h>
-#define isfinite finite
-#endif
-#endif
-#else
-#include <cmath>
-#if !(defined(__QNXNTO__)) // QNX already defines isfinite
-#define isfinite std::isfinite
-#endif
-#endif
-
-#if defined(_MSC_VER)
-#if !defined(WINCE) && defined(__STDC_SECURE_LIB__) && _MSC_VER >= 1500 // VC++ 9.0 and above
-#define snprintf sprintf_s
-#elif _MSC_VER >= 1900 // VC++ 14.0 and above
-#define snprintf std::snprintf
-#else
-#define snprintf _snprintf
-#endif
-#elif defined(__ANDROID__) || defined(__QNXNTO__)
-#define snprintf snprintf
-#elif __cplusplus >= 201103L
-#if !defined(__MINGW32__) && !defined(__CYGWIN__)
-#define snprintf std::snprintf
-#endif
-#endif
-
-#if defined(__BORLANDC__)
-#include <float.h>
-#define isfinite _finite
-#define snprintf _snprintf
-#endif
-
-#if defined(_MSC_VER) && _MSC_VER >= 1400 // VC++ 8.0
-// Disable warning about strdup being deprecated.
-#pragma warning(disable : 4996)
-#endif
-
-namespace rmq {
-namespace Json {
-
-#if __cplusplus >= 201103L || (defined(_CPPLIB_VER) && _CPPLIB_VER >= 520)
-typedef std::unique_ptr<StreamWriter> StreamWriterPtr;
-#else
-typedef std::auto_ptr<StreamWriter> StreamWriterPtr;
-#endif
-
-static bool containsControlCharacter(const char* str) {
- while (*str) {
- if (isControlCharacter(*(str++)))
- return true;
- }
- return false;
-}
-
-static bool containsControlCharacter0(const char* str, unsigned len) {
- char const* end = str + len;
- while (end != str) {
- if (isControlCharacter(*str) || 0==*str)
- return true;
- ++str;
- }
- return false;
-}
-
-JSONCPP_STRING valueToString(LargestInt value) {
- UIntToStringBuffer buffer;
- char* current = buffer + sizeof(buffer);
- if (value == Value::minLargestInt) {
- uintToString(LargestUInt(Value::maxLargestInt) + 1, current);
- *--current = '-';
- } else if (value < 0) {
- uintToString(LargestUInt(-value), current);
- *--current = '-';
- } else {
- uintToString(LargestUInt(value), current);
- }
- assert(current >= buffer);
- return current;
-}
-
-JSONCPP_STRING valueToString(LargestUInt value) {
- UIntToStringBuffer buffer;
- char* current = buffer + sizeof(buffer);
- uintToString(value, current);
- assert(current >= buffer);
- return current;
-}
-
-#if defined(JSON_HAS_INT64)
-
-JSONCPP_STRING valueToString(Int value) {
- return valueToString(LargestInt(value));
-}
-
-JSONCPP_STRING valueToString(UInt value) {
- return valueToString(LargestUInt(value));
-}
-
-#endif // # if defined(JSON_HAS_INT64)
-
-namespace {
-JSONCPP_STRING valueToString(double value, bool useSpecialFloats, unsigned int precision) {
- // Allocate a buffer that is more than large enough to store the 16 digits of
- // precision requested below.
- char buffer[32];
- int len = -1;
-
- char formatString[10];
- snprintf(formatString, sizeof(formatString), "%%.%dg", precision);
-
- // Print into the buffer. We need not request the alternative representation
- // that always has a decimal point because JSON doesn't distingish the
- // concepts of reals and integers.
- if (isfinite(value)) {
- len = snprintf(buffer, sizeof(buffer), formatString, value);
- } else {
- // IEEE standard states that NaN values will not compare to themselves
- if (value != value) {
- len = snprintf(buffer, sizeof(buffer), useSpecialFloats ? "NaN" : "null");
- } else if (value < 0) {
- len = snprintf(buffer, sizeof(buffer), useSpecialFloats ? "-Infinity" : "-1e+9999");
- } else {
- len = snprintf(buffer, sizeof(buffer), useSpecialFloats ? "Infinity" : "1e+9999");
- }
- // For those, we do not need to call fixNumLoc, but it is fast.
- }
- assert(len >= 0);
- fixNumericLocale(buffer, buffer + len);
- return buffer;
-}
-}
-
-JSONCPP_STRING valueToString(double value) { return valueToString(value, false, 17); }
-
-JSONCPP_STRING valueToString(bool value) { return value ? "true" : "false"; }
-
-JSONCPP_STRING valueToQuotedString(const char* value) {
- if (value == NULL)
- return "";
- // Not sure how to handle unicode...
- if (strpbrk(value, "\"\\\b\f\n\r\t") == NULL &&
- !containsControlCharacter(value))
- return JSONCPP_STRING("\"") + value + "\"";
- // We have to walk value and escape any special characters.
- // Appending to JSONCPP_STRING is not efficient, but this should be rare.
- // (Note: forward slashes are *not* rare, but I am not escaping them.)
- JSONCPP_STRING::size_type maxsize =
- strlen(value) * 2 + 3; // allescaped+quotes+NULL
- JSONCPP_STRING result;
- result.reserve(maxsize); // to avoid lots of mallocs
- result += "\"";
- for (const char* c = value; *c != 0; ++c) {
- switch (*c) {
- case '\"':
- result += "\\\"";
- break;
- case '\\':
- result += "\\\\";
- break;
- case '\b':
- result += "\\b";
- break;
- case '\f':
- result += "\\f";
- break;
- case '\n':
- result += "\\n";
- break;
- case '\r':
- result += "\\r";
- break;
- case '\t':
- result += "\\t";
- break;
- // case '/':
- // Even though \/ is considered a legal escape in JSON, a bare
- // slash is also legal, so I see no reason to escape it.
- // (I hope I am not misunderstanding something.
- // blep notes: actually escaping \/ may be useful in javascript to avoid </
- // sequence.
- // Should add a flag to allow this compatibility mode and prevent this
- // sequence from occurring.
- default:
- if (isControlCharacter(*c)) {
- JSONCPP_OSTRINGSTREAM oss;
- oss << "\\u" << std::hex << std::uppercase << std::setfill('0')
- << std::setw(4) << static_cast<int>(*c);
- result += oss.str();
- } else {
- result += *c;
- }
- break;
- }
- }
- result += "\"";
- return result;
-}
-
-// https://github.com/upcaste/upcaste/blob/master/src/upcore/src/cstring/strnpbrk.cpp
-static char const* strnpbrk(char const* s, char const* accept, size_t n) {
- assert((s || !n) && accept);
-
- char const* const end = s + n;
- for (char const* cur = s; cur < end; ++cur) {
- int const c = *cur;
- for (char const* a = accept; *a; ++a) {
- if (*a == c) {
- return cur;
- }
- }
- }
- return NULL;
-}
-static JSONCPP_STRING valueToQuotedStringN(const char* value, unsigned length) {
- if (value == NULL)
- return "";
- // Not sure how to handle unicode...
- if (strnpbrk(value, "\"\\\b\f\n\r\t", length) == NULL &&
- !containsControlCharacter0(value, length))
- return JSONCPP_STRING("\"") + value + "\"";
- // We have to walk value and escape any special characters.
- // Appending to JSONCPP_STRING is not efficient, but this should be rare.
- // (Note: forward slashes are *not* rare, but I am not escaping them.)
- JSONCPP_STRING::size_type maxsize =
- length * 2 + 3; // allescaped+quotes+NULL
- JSONCPP_STRING result;
- result.reserve(maxsize); // to avoid lots of mallocs
- result += "\"";
- char const* end = value + length;
- for (const char* c = value; c != end; ++c) {
- switch (*c) {
- case '\"':
- result += "\\\"";
- break;
- case '\\':
- result += "\\\\";
- break;
- case '\b':
- result += "\\b";
- break;
- case '\f':
- result += "\\f";
- break;
- case '\n':
- result += "\\n";
- break;
- case '\r':
- result += "\\r";
- break;
- case '\t':
- result += "\\t";
- break;
- // case '/':
- // Even though \/ is considered a legal escape in JSON, a bare
- // slash is also legal, so I see no reason to escape it.
- // (I hope I am not misunderstanding something.)
- // blep notes: actually escaping \/ may be useful in javascript to avoid </
- // sequence.
- // Should add a flag to allow this compatibility mode and prevent this
- // sequence from occurring.
- default:
- if ((isControlCharacter(*c)) || (*c == 0)) {
- JSONCPP_OSTRINGSTREAM oss;
- oss << "\\u" << std::hex << std::uppercase << std::setfill('0')
- << std::setw(4) << static_cast<int>(*c);
- result += oss.str();
- } else {
- result += *c;
- }
- break;
- }
- }
- result += "\"";
- return result;
-}
-
-// Class Writer
-// //////////////////////////////////////////////////////////////////
-Writer::~Writer() {}
-
-// Class FastWriter
-// //////////////////////////////////////////////////////////////////
-
-FastWriter::FastWriter()
- : yamlCompatiblityEnabled_(false), dropNullPlaceholders_(false),
- omitEndingLineFeed_(false) {}
-
-void FastWriter::enableYAMLCompatibility() { yamlCompatiblityEnabled_ = true; }
-
-void FastWriter::dropNullPlaceholders() { dropNullPlaceholders_ = true; }
-
-void FastWriter::omitEndingLineFeed() { omitEndingLineFeed_ = true; }
-
-JSONCPP_STRING FastWriter::write(const Value& root) {
- document_ = "";
- writeValue(root);
- if (!omitEndingLineFeed_)
- document_ += "\n";
- return document_;
-}
-
-void FastWriter::writeValue(const Value& value) {
- switch (value.type()) {
- case nullValue:
- if (!dropNullPlaceholders_)
- document_ += "null";
- break;
- case intValue:
- document_ += valueToString(value.asLargestInt());
- break;
- case uintValue:
- document_ += valueToString(value.asLargestUInt());
- break;
- case realValue:
- document_ += valueToString(value.asDouble());
- break;
- case stringValue:
- {
- // Is NULL possible for value.string_? No.
- char const* str;
- char const* end;
- bool ok = value.getString(&str, &end);
- if (ok) document_ += valueToQuotedStringN(str, static_cast<unsigned>(end-str));
- break;
- }
- case booleanValue:
- document_ += valueToString(value.asBool());
- break;
- case arrayValue: {
- document_ += '[';
- ArrayIndex size = value.size();
- for (ArrayIndex index = 0; index < size; ++index) {
- if (index > 0)
- document_ += ',';
- writeValue(value[index]);
- }
- document_ += ']';
- } break;
- case objectValue: {
- Value::Members members(value.getMemberNames());
- document_ += '{';
- for (Value::Members::iterator it = members.begin(); it != members.end();
- ++it) {
- const JSONCPP_STRING& name = *it;
- if (it != members.begin())
- document_ += ',';
- document_ += valueToQuotedStringN(name.data(), static_cast<unsigned>(name.length()));
- document_ += yamlCompatiblityEnabled_ ? ": " : ":";
- writeValue(value[name]);
- }
- document_ += '}';
- } break;
- }
-}
-
-// Class StyledWriter
-// //////////////////////////////////////////////////////////////////
-
-StyledWriter::StyledWriter()
- : rightMargin_(74), indentSize_(3), addChildValues_() {}
-
-JSONCPP_STRING StyledWriter::write(const Value& root) {
- document_ = "";
- addChildValues_ = false;
- indentString_ = "";
- writeCommentBeforeValue(root);
- writeValue(root);
- writeCommentAfterValueOnSameLine(root);
- document_ += "\n";
- return document_;
-}
-
-void StyledWriter::writeValue(const Value& value) {
- switch (value.type()) {
- case nullValue:
- pushValue("null");
- break;
- case intValue:
- pushValue(valueToString(value.asLargestInt()));
- break;
- case uintValue:
- pushValue(valueToString(value.asLargestUInt()));
- break;
- case realValue:
- pushValue(valueToString(value.asDouble()));
- break;
- case stringValue:
- {
- // Is NULL possible for value.string_? No.
- char const* str;
- char const* end;
- bool ok = value.getString(&str, &end);
- if (ok) pushValue(valueToQuotedStringN(str, static_cast<unsigned>(end-str)));
- else pushValue("");
- break;
- }
- case booleanValue:
- pushValue(valueToString(value.asBool()));
- break;
- case arrayValue:
- writeArrayValue(value);
- break;
- case objectValue: {
- Value::Members members(value.getMemberNames());
- if (members.empty())
- pushValue("{}");
- else {
- writeWithIndent("{");
- indent();
- Value::Members::iterator it = members.begin();
- for (;;) {
- const JSONCPP_STRING& name = *it;
- const Value& childValue = value[name];
- writeCommentBeforeValue(childValue);
- writeWithIndent(valueToQuotedString(name.c_str()));
- document_ += " : ";
- writeValue(childValue);
- if (++it == members.end()) {
- writeCommentAfterValueOnSameLine(childValue);
- break;
- }
- document_ += ',';
- writeCommentAfterValueOnSameLine(childValue);
- }
- unindent();
- writeWithIndent("}");
- }
- } break;
- }
-}
-
-void StyledWriter::writeArrayValue(const Value& value) {
- unsigned size = value.size();
- if (size == 0)
- pushValue("[]");
- else {
- bool isArrayMultiLine = isMultineArray(value);
- if (isArrayMultiLine) {
- writeWithIndent("[");
- indent();
- bool hasChildValue = !childValues_.empty();
- unsigned index = 0;
- for (;;) {
- const Value& childValue = value[index];
- writeCommentBeforeValue(childValue);
- if (hasChildValue)
- writeWithIndent(childValues_[index]);
- else {
- writeIndent();
- writeValue(childValue);
- }
- if (++index == size) {
- writeCommentAfterValueOnSameLine(childValue);
- break;
- }
- document_ += ',';
- writeCommentAfterValueOnSameLine(childValue);
- }
- unindent();
- writeWithIndent("]");
- } else // output on a single line
- {
- assert(childValues_.size() == size);
- document_ += "[ ";
- for (unsigned index = 0; index < size; ++index) {
- if (index > 0)
- document_ += ", ";
- document_ += childValues_[index];
- }
- document_ += " ]";
- }
- }
-}
-
-bool StyledWriter::isMultineArray(const Value& value) {
- ArrayIndex const size = value.size();
- bool isMultiLine = size * 3 >= rightMargin_;
- childValues_.clear();
- for (ArrayIndex index = 0; index < size && !isMultiLine; ++index) {
- const Value& childValue = value[index];
- isMultiLine = ((childValue.isArray() || childValue.isObject()) &&
- childValue.size() > 0);
- }
- if (!isMultiLine) // check if line length > max line length
- {
- childValues_.reserve(size);
- addChildValues_ = true;
- ArrayIndex lineLength = 4 + (size - 1) * 2; // '[ ' + ', '*n + ' ]'
- for (ArrayIndex index = 0; index < size; ++index) {
- if (hasCommentForValue(value[index])) {
- isMultiLine = true;
- }
- writeValue(value[index]);
- lineLength += static_cast<ArrayIndex>(childValues_[index].length());
- }
- addChildValues_ = false;
- isMultiLine = isMultiLine || lineLength >= rightMargin_;
- }
- return isMultiLine;
-}
-
-void StyledWriter::pushValue(const JSONCPP_STRING& value) {
- if (addChildValues_)
- childValues_.push_back(value);
- else
- document_ += value;
-}
-
-void StyledWriter::writeIndent() {
- if (!document_.empty()) {
- char last = document_[document_.length() - 1];
- if (last == ' ') // already indented
- return;
- if (last != '\n') // Comments may add new-line
- document_ += '\n';
- }
- document_ += indentString_;
-}
-
-void StyledWriter::writeWithIndent(const JSONCPP_STRING& value) {
- writeIndent();
- document_ += value;
-}
-
-void StyledWriter::indent() { indentString_ += JSONCPP_STRING(indentSize_, ' '); }
-
-void StyledWriter::unindent() {
- assert(indentString_.size() >= indentSize_);
- indentString_.resize(indentString_.size() - indentSize_);
-}
-
-void StyledWriter::writeCommentBeforeValue(const Value& root) {
- if (!root.hasComment(commentBefore))
- return;
-
- document_ += "\n";
- writeIndent();
- const JSONCPP_STRING& comment = root.getComment(commentBefore);
- JSONCPP_STRING::const_iterator iter = comment.begin();
- while (iter != comment.end()) {
- document_ += *iter;
- if (*iter == '\n' &&
- (iter != comment.end() && *(iter + 1) == '/'))
- writeIndent();
- ++iter;
- }
-
- // Comments are stripped of trailing newlines, so add one here
- document_ += "\n";
-}
-
-void StyledWriter::writeCommentAfterValueOnSameLine(const Value& root) {
- if (root.hasComment(commentAfterOnSameLine))
- document_ += " " + root.getComment(commentAfterOnSameLine);
-
- if (root.hasComment(commentAfter)) {
- document_ += "\n";
- document_ += root.getComment(commentAfter);
- document_ += "\n";
- }
-}
-
-bool StyledWriter::hasCommentForValue(const Value& value) {
- return value.hasComment(commentBefore) ||
- value.hasComment(commentAfterOnSameLine) ||
- value.hasComment(commentAfter);
-}
-
-// Class StyledStreamWriter
-// //////////////////////////////////////////////////////////////////
-
-StyledStreamWriter::StyledStreamWriter(JSONCPP_STRING indentation)
- : document_(NULL), rightMargin_(74), indentation_(indentation),
- addChildValues_() {}
-
-void StyledStreamWriter::write(JSONCPP_OSTREAM& out, const Value& root) {
- document_ = &out;
- addChildValues_ = false;
- indentString_ = "";
- indented_ = true;
- writeCommentBeforeValue(root);
- if (!indented_) writeIndent();
- indented_ = true;
- writeValue(root);
- writeCommentAfterValueOnSameLine(root);
- *document_ << "\n";
- document_ = NULL; // Forget the stream, for safety.
-}
-
-void StyledStreamWriter::writeValue(const Value& value) {
- switch (value.type()) {
- case nullValue:
- pushValue("null");
- break;
- case intValue:
- pushValue(valueToString(value.asLargestInt()));
- break;
- case uintValue:
- pushValue(valueToString(value.asLargestUInt()));
- break;
- case realValue:
- pushValue(valueToString(value.asDouble()));
- break;
- case stringValue:
- {
- // Is NULL possible for value.string_? No.
- char const* str;
- char const* end;
- bool ok = value.getString(&str, &end);
- if (ok) pushValue(valueToQuotedStringN(str, static_cast<unsigned>(end-str)));
- else pushValue("");
- break;
- }
- case booleanValue:
- pushValue(valueToString(value.asBool()));
- break;
- case arrayValue:
- writeArrayValue(value);
- break;
- case objectValue: {
- Value::Members members(value.getMemberNames());
- if (members.empty())
- pushValue("{}");
- else {
- writeWithIndent("{");
- indent();
- Value::Members::iterator it = members.begin();
- for (;;) {
- const JSONCPP_STRING& name = *it;
- const Value& childValue = value[name];
- writeCommentBeforeValue(childValue);
- writeWithIndent(valueToQuotedString(name.c_str()));
- *document_ << " : ";
- writeValue(childValue);
- if (++it == members.end()) {
- writeCommentAfterValueOnSameLine(childValue);
- break;
- }
- *document_ << ",";
- writeCommentAfterValueOnSameLine(childValue);
- }
- unindent();
- writeWithIndent("}");
- }
- } break;
- }
-}
-
-void StyledStreamWriter::writeArrayValue(const Value& value) {
- unsigned size = value.size();
- if (size == 0)
- pushValue("[]");
- else {
- bool isArrayMultiLine = isMultineArray(value);
- if (isArrayMultiLine) {
- writeWithIndent("[");
- indent();
- bool hasChildValue = !childValues_.empty();
- unsigned index = 0;
- for (;;) {
- const Value& childValue = value[index];
- writeCommentBeforeValue(childValue);
- if (hasChildValue)
- writeWithIndent(childValues_[index]);
- else {
- if (!indented_) writeIndent();
- indented_ = true;
- writeValue(childValue);
- indented_ = false;
- }
- if (++index == size) {
- writeCommentAfterValueOnSameLine(childValue);
- break;
- }
- *document_ << ",";
- writeCommentAfterValueOnSameLine(childValue);
- }
- unindent();
- writeWithIndent("]");
- } else // output on a single line
- {
- assert(childValues_.size() == size);
- *document_ << "[ ";
- for (unsigned index = 0; index < size; ++index) {
- if (index > 0)
- *document_ << ", ";
- *document_ << childValues_[index];
- }
- *document_ << " ]";
- }
- }
-}
-
-bool StyledStreamWriter::isMultineArray(const Value& value) {
- ArrayIndex const size = value.size();
- bool isMultiLine = size * 3 >= rightMargin_;
- childValues_.clear();
- for (ArrayIndex index = 0; index < size && !isMultiLine; ++index) {
- const Value& childValue = value[index];
- isMultiLine = ((childValue.isArray() || childValue.isObject()) &&
- childValue.size() > 0);
- }
- if (!isMultiLine) // check if line length > max line length
- {
- childValues_.reserve(size);
- addChildValues_ = true;
- ArrayIndex lineLength = 4 + (size - 1) * 2; // '[ ' + ', '*n + ' ]'
- for (ArrayIndex index = 0; index < size; ++index) {
- if (hasCommentForValue(value[index])) {
- isMultiLine = true;
- }
- writeValue(value[index]);
- lineLength += static_cast<ArrayIndex>(childValues_[index].length());
- }
- addChildValues_ = false;
- isMultiLine = isMultiLine || lineLength >= rightMargin_;
- }
- return isMultiLine;
-}
-
-void StyledStreamWriter::pushValue(const JSONCPP_STRING& value) {
- if (addChildValues_)
- childValues_.push_back(value);
- else
- *document_ << value;
-}
-
-void StyledStreamWriter::writeIndent() {
- // blep intended this to look at the so-far-written string
- // to determine whether we are already indented, but
- // with a stream we cannot do that. So we rely on some saved state.
- // The caller checks indented_.
- *document_ << '\n' << indentString_;
-}
-
-void StyledStreamWriter::writeWithIndent(const JSONCPP_STRING& value) {
- if (!indented_) writeIndent();
- *document_ << value;
- indented_ = false;
-}
-
-void StyledStreamWriter::indent() { indentString_ += indentation_; }
-
-void StyledStreamWriter::unindent() {
- assert(indentString_.size() >= indentation_.size());
- indentString_.resize(indentString_.size() - indentation_.size());
-}
-
-void StyledStreamWriter::writeCommentBeforeValue(const Value& root) {
- if (!root.hasComment(commentBefore))
- return;
-
- if (!indented_) writeIndent();
- const JSONCPP_STRING& comment = root.getComment(commentBefore);
- JSONCPP_STRING::const_iterator iter = comment.begin();
- while (iter != comment.end()) {
- *document_ << *iter;
- if (*iter == '\n' &&
- (iter != comment.end() && *(iter + 1) == '/'))
- // writeIndent(); // would include newline
- *document_ << indentString_;
- ++iter;
- }
- indented_ = false;
-}
-
-void StyledStreamWriter::writeCommentAfterValueOnSameLine(const Value& root) {
- if (root.hasComment(commentAfterOnSameLine))
- *document_ << ' ' << root.getComment(commentAfterOnSameLine);
-
- if (root.hasComment(commentAfter)) {
- writeIndent();
- *document_ << root.getComment(commentAfter);
- }
- indented_ = false;
-}
-
-bool StyledStreamWriter::hasCommentForValue(const Value& value) {
- return value.hasComment(commentBefore) ||
- value.hasComment(commentAfterOnSameLine) ||
- value.hasComment(commentAfter);
-}
-
-//////////////////////////
-// BuiltStyledStreamWriter
-
-/// Scoped enums are not available until C++11.
-struct CommentStyle {
- /// Decide whether to write comments.
- enum Enum {
- None, ///< Drop all comments.
- Most, ///< Recover odd behavior of previous versions (not implemented yet).
- All ///< Keep all comments.
- };
-};
-
-struct BuiltStyledStreamWriter : public StreamWriter
-{
- BuiltStyledStreamWriter(
- JSONCPP_STRING const& indentation,
- CommentStyle::Enum cs,
- JSONCPP_STRING const& colonSymbol,
- JSONCPP_STRING const& nullSymbol,
- JSONCPP_STRING const& endingLineFeedSymbol,
- bool useSpecialFloats,
- unsigned int precision);
- int write(Value const& root, JSONCPP_OSTREAM* sout) JSONCPP_OVERRIDE;
-private:
- void writeValue(Value const& value);
- void writeArrayValue(Value const& value);
- bool isMultineArray(Value const& value);
- void pushValue(JSONCPP_STRING const& value);
- void writeIndent();
- void writeWithIndent(JSONCPP_STRING const& value);
- void indent();
- void unindent();
- void writeCommentBeforeValue(Value const& root);
- void writeCommentAfterValueOnSameLine(Value const& root);
- static bool hasCommentForValue(const Value& value);
-
- typedef std::vector<JSONCPP_STRING> ChildValues;
-
- ChildValues childValues_;
- JSONCPP_STRING indentString_;
- unsigned int rightMargin_;
- JSONCPP_STRING indentation_;
- CommentStyle::Enum cs_;
- JSONCPP_STRING colonSymbol_;
- JSONCPP_STRING nullSymbol_;
- JSONCPP_STRING endingLineFeedSymbol_;
- bool addChildValues_ : 1;
- bool indented_ : 1;
- bool useSpecialFloats_ : 1;
- unsigned int precision_;
-};
-BuiltStyledStreamWriter::BuiltStyledStreamWriter(
- JSONCPP_STRING const& indentation,
- CommentStyle::Enum cs,
- JSONCPP_STRING const& colonSymbol,
- JSONCPP_STRING const& nullSymbol,
- JSONCPP_STRING const& endingLineFeedSymbol,
- bool useSpecialFloats,
- unsigned int precision)
- : rightMargin_(74)
- , indentation_(indentation)
- , cs_(cs)
- , colonSymbol_(colonSymbol)
- , nullSymbol_(nullSymbol)
- , endingLineFeedSymbol_(endingLineFeedSymbol)
- , addChildValues_(false)
- , indented_(false)
- , useSpecialFloats_(useSpecialFloats)
- , precision_(precision)
-{
-}
-int BuiltStyledStreamWriter::write(Value const& root, JSONCPP_OSTREAM* sout)
-{
- sout_ = sout;
- addChildValues_ = false;
- indented_ = true;
- indentString_ = "";
- writeCommentBeforeValue(root);
- if (!indented_) writeIndent();
- indented_ = true;
- writeValue(root);
- writeCommentAfterValueOnSameLine(root);
- *sout_ << endingLineFeedSymbol_;
- sout_ = NULL;
- return 0;
-}
-void BuiltStyledStreamWriter::writeValue(Value const& value) {
- switch (value.type()) {
- case nullValue:
- pushValue(nullSymbol_);
- break;
- case intValue:
- pushValue(valueToString(value.asLargestInt()));
- break;
- case uintValue:
- pushValue(valueToString(value.asLargestUInt()));
- break;
- case realValue:
- pushValue(valueToString(value.asDouble(), useSpecialFloats_, precision_));
- break;
- case stringValue:
- {
- // Is NULL is possible for value.string_? No.
- char const* str;
- char const* end;
- bool ok = value.getString(&str, &end);
- if (ok) pushValue(valueToQuotedStringN(str, static_cast<unsigned>(end-str)));
- else pushValue("");
- break;
- }
- case booleanValue:
- pushValue(valueToString(value.asBool()));
- break;
- case arrayValue:
- writeArrayValue(value);
- break;
- case objectValue: {
- Value::Members members(value.getMemberNames());
- if (members.empty())
- pushValue("{}");
- else {
- writeWithIndent("{");
- indent();
- Value::Members::iterator it = members.begin();
- for (;;) {
- JSONCPP_STRING const& name = *it;
- Value const& childValue = value[name];
- writeCommentBeforeValue(childValue);
- writeWithIndent(valueToQuotedStringN(name.data(), static_cast<unsigned>(name.length())));
- *sout_ << colonSymbol_;
- writeValue(childValue);
- if (++it == members.end()) {
- writeCommentAfterValueOnSameLine(childValue);
- break;
- }
- *sout_ << ",";
- writeCommentAfterValueOnSameLine(childValue);
- }
- unindent();
- writeWithIndent("}");
- }
- } break;
- }
-}
-
-void BuiltStyledStreamWriter::writeArrayValue(Value const& value) {
- unsigned size = value.size();
- if (size == 0)
- pushValue("[]");
- else {
- bool isMultiLine = (cs_ == CommentStyle::All) || isMultineArray(value);
- if (isMultiLine) {
- writeWithIndent("[");
- indent();
- bool hasChildValue = !childValues_.empty();
- unsigned index = 0;
- for (;;) {
- Value const& childValue = value[index];
- writeCommentBeforeValue(childValue);
- if (hasChildValue)
- writeWithIndent(childValues_[index]);
- else {
- if (!indented_) writeIndent();
- indented_ = true;
- writeValue(childValue);
- indented_ = false;
- }
- if (++index == size) {
- writeCommentAfterValueOnSameLine(childValue);
- break;
- }
- *sout_ << ",";
- writeCommentAfterValueOnSameLine(childValue);
- }
- unindent();
- writeWithIndent("]");
- } else // output on a single line
- {
- assert(childValues_.size() == size);
- *sout_ << "[";
- if (!indentation_.empty()) *sout_ << " ";
- for (unsigned index = 0; index < size; ++index) {
- if (index > 0)
- *sout_ << ((!indentation_.empty()) ? ", " : ",");
- *sout_ << childValues_[index];
- }
- if (!indentation_.empty()) *sout_ << " ";
- *sout_ << "]";
- }
- }
-}
-
-bool BuiltStyledStreamWriter::isMultineArray(Value const& value) {
- ArrayIndex const size = value.size();
- bool isMultiLine = size * 3 >= rightMargin_;
- childValues_.clear();
- for (ArrayIndex index = 0; index < size && !isMultiLine; ++index) {
- Value const& childValue = value[index];
- isMultiLine = ((childValue.isArray() || childValue.isObject()) &&
- childValue.size() > 0);
- }
- if (!isMultiLine) // check if line length > max line length
- {
- childValues_.reserve(size);
- addChildValues_ = true;
- ArrayIndex lineLength = 4 + (size - 1) * 2; // '[ ' + ', '*n + ' ]'
- for (ArrayIndex index = 0; index < size; ++index) {
- if (hasCommentForValue(value[index])) {
- isMultiLine = true;
- }
- writeValue(value[index]);
- lineLength += static_cast<ArrayIndex>(childValues_[index].length());
- }
- addChildValues_ = false;
- isMultiLine = isMultiLine || lineLength >= rightMargin_;
- }
- return isMultiLine;
-}
-
-void BuiltStyledStreamWriter::pushValue(JSONCPP_STRING const& value) {
- if (addChildValues_)
- childValues_.push_back(value);
- else
- *sout_ << value;
-}
-
-void BuiltStyledStreamWriter::writeIndent() {
- // blep intended this to look at the so-far-written string
- // to determine whether we are already indented, but
- // with a stream we cannot do that. So we rely on some saved state.
- // The caller checks indented_.
-
- if (!indentation_.empty()) {
- // In this case, drop newlines too.
- *sout_ << '\n' << indentString_;
- }
-}
-
-void BuiltStyledStreamWriter::writeWithIndent(JSONCPP_STRING const& value) {
- if (!indented_) writeIndent();
- *sout_ << value;
- indented_ = false;
-}
-
-void BuiltStyledStreamWriter::indent() { indentString_ += indentation_; }
-
-void BuiltStyledStreamWriter::unindent() {
- assert(indentString_.size() >= indentation_.size());
- indentString_.resize(indentString_.size() - indentation_.size());
-}
-
-void BuiltStyledStreamWriter::writeCommentBeforeValue(Value const& root) {
- if (cs_ == CommentStyle::None) return;
- if (!root.hasComment(commentBefore))
- return;
-
- if (!indented_) writeIndent();
- const JSONCPP_STRING& comment = root.getComment(commentBefore);
- JSONCPP_STRING::const_iterator iter = comment.begin();
- while (iter != comment.end()) {
- *sout_ << *iter;
- if (*iter == '\n' &&
- (iter != comment.end() && *(iter + 1) == '/'))
- // writeIndent(); // would write extra newline
- *sout_ << indentString_;
- ++iter;
- }
- indented_ = false;
-}
-
-void BuiltStyledStreamWriter::writeCommentAfterValueOnSameLine(Value const& root) {
- if (cs_ == CommentStyle::None) return;
- if (root.hasComment(commentAfterOnSameLine))
- *sout_ << " " + root.getComment(commentAfterOnSameLine);
-
- if (root.hasComment(commentAfter)) {
- writeIndent();
- *sout_ << root.getComment(commentAfter);
- }
-}
-
-// static
-bool BuiltStyledStreamWriter::hasCommentForValue(const Value& value) {
- return value.hasComment(commentBefore) ||
- value.hasComment(commentAfterOnSameLine) ||
- value.hasComment(commentAfter);
-}
-
-///////////////
-// StreamWriter
-
-StreamWriter::StreamWriter()
- : sout_(NULL)
-{
-}
-StreamWriter::~StreamWriter()
-{
-}
-StreamWriter::Factory::~Factory()
-{}
-StreamWriterBuilder::StreamWriterBuilder()
-{
- setDefaults(&settings_);
-}
-StreamWriterBuilder::~StreamWriterBuilder()
-{}
-StreamWriter* StreamWriterBuilder::newStreamWriter() const
-{
- JSONCPP_STRING indentation = settings_["indentation"].asString();
- JSONCPP_STRING cs_str = settings_["commentStyle"].asString();
- bool eyc = settings_["enableYAMLCompatibility"].asBool();
- bool dnp = settings_["dropNullPlaceholders"].asBool();
- bool usf = settings_["useSpecialFloats"].asBool();
- unsigned int pre = settings_["precision"].asUInt();
- CommentStyle::Enum cs = CommentStyle::All;
- if (cs_str == "All") {
- cs = CommentStyle::All;
- } else if (cs_str == "None") {
- cs = CommentStyle::None;
- } else {
- throwRuntimeError("commentStyle must be 'All' or 'None'");
- }
- JSONCPP_STRING colonSymbol = " : ";
- if (eyc) {
- colonSymbol = ": ";
- } else if (indentation.empty()) {
- colonSymbol = ":";
- }
- JSONCPP_STRING nullSymbol = "null";
- if (dnp) {
- nullSymbol = "";
- }
- if (pre > 17) pre = 17;
- JSONCPP_STRING endingLineFeedSymbol = "";
- return new BuiltStyledStreamWriter(
- indentation, cs,
- colonSymbol, nullSymbol, endingLineFeedSymbol, usf, pre);
-}
-static void getValidWriterKeys(std::set<JSONCPP_STRING>* valid_keys)
-{
- valid_keys->clear();
- valid_keys->insert("indentation");
- valid_keys->insert("commentStyle");
- valid_keys->insert("enableYAMLCompatibility");
- valid_keys->insert("dropNullPlaceholders");
- valid_keys->insert("useSpecialFloats");
- valid_keys->insert("precision");
-}
-bool StreamWriterBuilder::validate(Value* invalid) const
-{
- Value my_invalid;
- if (!invalid) invalid = &my_invalid; // so we do not need to test for NULL
- Value& inv = *invalid;
- std::set<JSONCPP_STRING> valid_keys;
- getValidWriterKeys(&valid_keys);
- Value::Members keys = settings_.getMemberNames();
- size_t n = keys.size();
- for (size_t i = 0; i < n; ++i) {
- JSONCPP_STRING const& key = keys[i];
- if (valid_keys.find(key) == valid_keys.end()) {
- inv[key] = settings_[key];
- }
- }
- return 0u == inv.size();
-}
-Value& StreamWriterBuilder::operator[](JSONCPP_STRING key)
-{
- return settings_[key];
-}
-// static
-void StreamWriterBuilder::setDefaults(Value* settings)
-{
- //! [StreamWriterBuilderDefaults]
- (*settings)["commentStyle"] = "All";
- (*settings)["indentation"] = "\t";
- (*settings)["enableYAMLCompatibility"] = false;
- (*settings)["dropNullPlaceholders"] = false;
- (*settings)["useSpecialFloats"] = false;
- (*settings)["precision"] = 17;
- //! [StreamWriterBuilderDefaults]
-}
-
-JSONCPP_STRING writeString(StreamWriter::Factory const& builder, Value const& root) {
- JSONCPP_OSTRINGSTREAM sout;
- StreamWriterPtr const writer(builder.newStreamWriter());
- writer->write(root, &sout);
- return sout.str();
-}
-
-JSONCPP_OSTREAM& operator<<(JSONCPP_OSTREAM& sout, Value const& root) {
- StreamWriterBuilder builder;
- StreamWriterPtr const writer(builder.newStreamWriter());
- writer->write(root, &sout);
- return sout;
-}
-
-} // namespace Json
-} // namespace rmq
diff --git a/rocketmq-client4cpp/src/jsoncpp/version b/rocketmq-client4cpp/src/jsoncpp/version
deleted file mode 100755
index 73c8b4f9..00000000
--- a/rocketmq-client4cpp/src/jsoncpp/version
+++ /dev/null
@@ -1 +0,0 @@
-1.7.7
\ No newline at end of file
diff --git a/rocketmq-client4cpp/src/kpr/AtomicValue.cpp b/rocketmq-client4cpp/src/kpr/AtomicValue.cpp
deleted file mode 100755
index 30777f91..00000000
--- a/rocketmq-client4cpp/src/kpr/AtomicValue.cpp
+++ /dev/null
@@ -1,146 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include "AtomicValue.h"
-
-#if !defined(__GCC_HAVE_SYNC_COMPARE_AND_SWAP_8)
-
-#include "Mutex.h"
-
-namespace kpr
-{
-static const size_t kSwapLockCount = 64;
-static Mutex s_swapLocks[kSwapLockCount];
-
-static inline Mutex& getSwapLock(const volatile int64_t* addr)
-{
- return s_swapLocks[(reinterpret_cast<intptr_t>(addr) >> 3U) % kSwapLockCount];
-}
-
-static int64_t atomicAddAndFetch(int64_t volatile* ptr, int64_t step)
-{
- Mutex& mutex = getSwapLock(ptr);
-
- mutex.Lock();
- int64_t value = *ptr + step;
- *ptr = value;
- mutex.Unlock();
-
- return value;
-}
-
-static int64_t atomicFetchAndAdd(int64_t volatile* ptr, int64_t step)
-{
- Mutex& mutex = getSwapLock(ptr);
-
- mutex.Lock();
- int64_t value = *ptr;
- *ptr += step;
- mutex.Unlock();
-
- return value;
-}
-
-static bool atomicBoolCompareAndSwap(int64_t volatile* ptr, int64_t oldval, int64_t newval)
-{
- Mutex& mutex = getSwapLock(ptr);
-
- mutex.Lock();
- if (*ptr == oldval)
- {
- *ptr = newval;
- mutex.Unlock();
- return true;
- }
-
- mutex.Unlock();
- return false;
-}
-
-static int64_t atomicValCompareAndSwap(int64_t volatile* ptr, int64_t oldval, int64_t newval)
-{
- Mutex& mutex = getSwapLock(ptr);
-
- mutex.Lock();
- int64_t value = *ptr;
- if (value == oldval)
- {
- *ptr = newval;
- mutex.Unlock();
- return value;
- }
-
- mutex.Unlock();
- return value;
-}
-
-
-static int64_t atomicTestAndSet(int64_t volatile* ptr, int64_t val)
-{
- Mutex& mutex = getSwapLock(ptr);
-
- mutex.Lock();
- int64_t value = *ptr;
- *ptr = val;
- mutex.Unlock();
-
- return value;
-}
-
-
-
-extern "C" {
-int64_t __sync_add_and_fetch_8(int64_t volatile* ptr, int64_t value)
-{
- return atomicAddAndFetch(ptr, value);
-}
-
-int64_t __sync_sub_and_fetch_8(int64_t volatile* ptr, int64_t value)
-{
- return atomicAddAndFetch(ptr, -value);
-}
-
-int64_t __sync_fetch_and_add_8(int64_t volatile* ptr, int64_t value)
-{
- return atomicFetchAndAdd(ptr, -value);
-}
-
-int64_t __sync_fetch_and_sub_8(int64_t volatile* ptr, int64_t value)
-{
- return atomicFetchAndAdd(ptr, -value);
-}
-
-bool __sync_bool_compare_and_swap_8(volatile int64_t* ptr, int64_t oldval, int64_t newval)
-{
- return atomicBoolCompareAndSwap(ptr, oldval, newval);
-}
-
-int64_t __sync_val_compare_and_swap_8(volatile int64_t* ptr, int64_t oldval, int64_t newval)
-{
- return atomicValCompareAndSwap(ptr, oldval, newval);
-}
-
-bool __sync_lock_test_and_set_8(int64_t volatile* ptr, int64_t value)
-{
- return atomicTestAndSet(ptr, value);
-}
-
-
-} // extern "C"
-
-} // namespace kpr
-#endif
-
-
diff --git a/rocketmq-client4cpp/src/kpr/AtomicValue.h b/rocketmq-client4cpp/src/kpr/AtomicValue.h
deleted file mode 100755
index 50d198e4..00000000
--- a/rocketmq-client4cpp/src/kpr/AtomicValue.h
+++ /dev/null
@@ -1,200 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_ATOMICVALUE_H__
-#define __KPR_ATOMICVALUE_H__
-
-#include "KPRTypes.h"
-
-namespace kpr
-{
-
-template <class T>
-class AtomicValue
-{
-public:
- AtomicValue()
- : value(0)
- {
- }
-
- AtomicValue(T init)
- : value(init)
- {
- }
-
- AtomicValue<T>& operator=(T newValue)
- {
- set(newValue);
- return *this;
- }
-
- AtomicValue<T>& operator=(const AtomicValue<T>& v)
- {
- set(v.get());
-
- return *this;
- }
-
- inline T operator+=(T n)
- {
- return __sync_add_and_fetch(&value, n);
- }
-
- inline T operator-=(T n)
- {
- return __sync_sub_and_fetch(&value, n);
- }
-
- inline T operator++()
- {
- return *this += 1;
- }
-
- inline T operator--()
- {
- return *this -= 1;
- }
-
- inline T fetchAndAdd(T n)
- {
- return __sync_fetch_and_add(&value, n);
- }
-
- inline T fetchAndSub(T n)
- {
- return __sync_fetch_and_sub(&value, n);
- }
-
- inline T operator++(int)
- {
- return fetchAndAdd(1);
- }
-
- inline T operator--(int)
- {
- return fetchAndSub(1);
- }
-
- operator T() const
- {
- return get();
- }
-
- T get() const
- {
- return const_cast<AtomicValue<T>*>(this)->fetchAndAdd(static_cast<T>(0));
- }
-
- void set(T n)
- {
- __sync_lock_test_and_set((T*)&value, n);
- }
-
- inline T getAndSet(T comparand, T exchange)
- {
- return __sync_val_compare_and_swap((T*)&value, comparand, exchange);
- }
-
- inline bool compareAndSet(T comparand, T exchange)
- {
- return __sync_bool_compare_and_swap((T*)&value, comparand, exchange);
- }
-
-private:
- volatile T value;
-};
-
-
-template <class T>
-class AtomicReference
-{
-public:
- AtomicReference() : value(NULL) {}
- AtomicReference(T* init) : value(init) {}
-
- AtomicReference<T>& operator=(T* newValue)
- {
- set(newValue);
- return *this;
- }
-
- AtomicReference<T>& operator=(const AtomicReference<T>& v)
- {
- set(v.get());
-
- return *this;
- }
-
- T* operator->() const
- {
- return get();
- }
-
- T& operator*()
- {
- return *get();
- }
-
- operator T*() const
- {
- return get();
- }
-
- T* get() const
- {
- if (value == NULL)
- {
- return NULL;
- }
- else
- {
- return (T*)(__sync_fetch_and_add((uintptr_t*)&value, 0));
- }
- }
-
- void set(T* n)
- {
- if (value == NULL)
- {
- value = n;
- }
- else
- {
- __sync_lock_test_and_set((uintptr_t*)&value, n);
- }
- }
-
- inline T getAndSet(T* comparand, T* exchange)
- {
- return __sync_val_compare_and_swap((uintptr_t*)&value, comparand, exchange);
- }
-
- inline bool compareAndSet(T* comparand, T* exchange)
- {
- return __sync_bool_compare_and_swap((uintptr_t*)&value, comparand, exchange);
- }
-
-private:
- volatile T* value;
-};
-
-
-typedef AtomicValue<bool> AtomicBoolean;
-typedef AtomicValue<int> AtomicInteger;
-typedef AtomicValue<long long> AtomicLong;
-
-}
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/Condition.cpp b/rocketmq-client4cpp/src/kpr/Condition.cpp
deleted file mode 100755
index c81765ef..00000000
--- a/rocketmq-client4cpp/src/kpr/Condition.cpp
+++ /dev/null
@@ -1,158 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include "Condition.h"
-
-#include <errno.h>
-#include <assert.h>
-
-#include "Mutex.h"
-#include "ScopedLock.h"
-#include "Semaphore.h"
-#include "KPRUtil.h"
-#include "Exception.h"
-
-namespace kpr
-{
-class ConditionHelper
-{
- RecursiveMutex& m_mutex;
- int m_count;
-
-public:
-
- ConditionHelper(RecursiveMutex& mutex, int count)
- : m_mutex(mutex),
- m_count(count)
- {
- }
-
- ~ConditionHelper()
- {
- pthread_mutex_unlock(&m_mutex.m_mutex);
- m_mutex.lock(m_count);
- }
-};
-
-
-Condition::Condition()
-{
- pthread_cond_init(&m_cond, 0);
-}
-
-Condition::~Condition()
-{
- pthread_cond_destroy(&m_cond);
-}
-
-void Condition::Wait(Mutex& mutex)
-{
- wait(mutex, -1);
-}
-
-bool Condition::Wait(Mutex& mutex, long timeout)
-{
- assert(timeout >= 0 && "timeout value is negative");
-
- return wait(mutex, timeout);
-}
-
-void Condition::Wait(RecursiveMutex& mutex)
-{
- wait(mutex, -1);
-}
-
-bool Condition::Wait(RecursiveMutex& mutex, long timeout)
-{
- assert(timeout >= 0 && "timeout value is negative");
-
- return wait(mutex, timeout);
-}
-
-void Condition::Notify()
-{
- pthread_cond_signal(&m_cond);
-}
-
-void Condition::NotifyAll()
-{
- pthread_cond_broadcast(&m_cond);
-}
-
-bool Condition::wait(Mutex& mutex, long timeout)
-{
- int ret = 0;
- if (timeout < 0)
- {
- ret = pthread_cond_wait(&m_cond, &mutex.m_mutex);
- }
- else
- {
- struct timespec abstime = KPRUtil::CalcAbsTime(timeout);
- ret = pthread_cond_timedwait(&m_cond, &mutex.m_mutex, &abstime);
- }
- if (ret == 0)
- {
- return true;
- }
- else
- {
- if (errno == EINTR)
- {
- THROW_EXCEPTION(InterruptedException, "pthread_cond_timedwait failed", errno);
- }
- else if (errno == ETIMEDOUT && timeout >= 0)
- {
- return false;
- }
- }
- return true;
-}
-
-bool Condition::wait(RecursiveMutex& mutex, long timeout)
-{
- unsigned int count = mutex.reset4Condvar();
- ConditionHelper unlock(mutex, count);
-
- int ret = 0;
- if (timeout < 0)
- {
- ret = pthread_cond_wait(&m_cond, &mutex.m_mutex);
- }
- else
- {
- struct timespec abstime = KPRUtil::CalcAbsTime(timeout);
- ret = pthread_cond_timedwait(&m_cond, &mutex.m_mutex, &abstime);
- }
-
- if (ret == 0)
- {
- return true;
- }
- else
- {
- if (errno == EINTR)
- {
- THROW_EXCEPTION(InterruptedException, "pthread_cond_timedwait failed", errno);
- }
- else if (errno == ETIMEDOUT && timeout >= 0)
- {
- return false;
- }
- }
-
- return true;
-}
-}
diff --git a/rocketmq-client4cpp/src/kpr/Condition.h b/rocketmq-client4cpp/src/kpr/Condition.h
deleted file mode 100755
index 901e66c2..00000000
--- a/rocketmq-client4cpp/src/kpr/Condition.h
+++ /dev/null
@@ -1,54 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_CONDITION_H__
-#define __KPR_CONDITION_H__
-
-#include "KPRTypes.h"
-
-namespace kpr
-{
-class Mutex;
-class RWMutex;
-class RecursiveMutex;
-
-class Condition
-{
-public:
- Condition();
- ~Condition();
- void Wait(Mutex& mutex);
-
- bool Wait(Mutex& mutex, long timeout);
-
- void Wait(RecursiveMutex& mutex);
-
- bool Wait(RecursiveMutex& mutex, long timeout);
-
- void Notify();
-
- void NotifyAll();
-
-private:
- bool wait(Mutex&, long timeout);
- bool wait(RecursiveMutex&, long timeout);
-
- Condition(const Condition&);
- void operator=(const Condition&);
-
- pthread_cond_t m_cond;
-};
-}
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/Epoller.cpp b/rocketmq-client4cpp/src/kpr/Epoller.cpp
deleted file mode 100755
index 3c4ddf38..00000000
--- a/rocketmq-client4cpp/src/kpr/Epoller.cpp
+++ /dev/null
@@ -1,96 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "Epoller.h"
-#include <unistd.h>
-
-namespace kpr
-{
-Epoller::Epoller(bool bEt)
-{
- _iEpollfd = -1;
- _pevs = NULL;
- _et = bEt;
- _max_connections = 1024;
-}
-
-Epoller::~Epoller()
-{
- if (_pevs != NULL)
- {
- delete[] _pevs;
- _pevs = NULL;
- }
-
- if (_iEpollfd > 0)
- {
- close(_iEpollfd);
- }
-}
-
-void Epoller::ctrl(int fd, long long data, __uint32_t events, int op)
-{
- struct epoll_event ev;
- ev.data.u64 = data;
- if (_et)
- {
- ev.events = events | EPOLLET;
- }
- else
- {
- ev.events = events;
- }
-
- epoll_ctl(_iEpollfd, op, fd, &ev);
-}
-
-void Epoller::create(int max_connections)
-{
- _max_connections = max_connections;
-
- _iEpollfd = epoll_create(_max_connections + 1);
-
- if (_pevs != NULL)
- {
- delete[] _pevs;
- }
-
- _pevs = new epoll_event[_max_connections + 1];
-}
-
-void Epoller::add(int fd, long long data, __uint32_t event)
-{
- ctrl(fd, data, event, EPOLL_CTL_ADD);
-}
-
-void Epoller::mod(int fd, long long data, __uint32_t event)
-{
- ctrl(fd, data, event, EPOLL_CTL_MOD);
-}
-
-void Epoller::del(int fd, long long data, __uint32_t event)
-{
- ctrl(fd, data, event, EPOLL_CTL_DEL);
-}
-
-int Epoller::wait(int millsecond)
-{
- return epoll_wait(_iEpollfd, _pevs, _max_connections + 1, millsecond);
-}
-
-}
-
-
diff --git a/rocketmq-client4cpp/src/kpr/Epoller.h b/rocketmq-client4cpp/src/kpr/Epoller.h
deleted file mode 100755
index d3d161b4..00000000
--- a/rocketmq-client4cpp/src/kpr/Epoller.h
+++ /dev/null
@@ -1,62 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __KPR_EPOLLER_H_
-#define __KPR_EPOLLER_H_
-
-#include <unistd.h>
-#include <sys/epoll.h>
-#include <cassert>
-
-namespace kpr
-{
-
-
-class Epoller
-{
-public:
- Epoller(bool bEt = true);
- ~Epoller();
-
-
- void create(int max_connections);
-
- void add(int fd, long long data, __uint32_t event);
- void mod(int fd, long long data, __uint32_t event);
- void del(int fd, long long data, __uint32_t event);
-
- int wait(int millsecond);
-
- struct epoll_event& get(int i)
- {
- assert(_pevs != 0);
- return _pevs[i];
- }
-
-protected:
- void ctrl(int fd, long long data, __uint32_t events, int op);
-
-protected:
- int _iEpollfd;
- int _max_connections;
- struct epoll_event* _pevs;
- bool _et;
-};
-
-}
-#endif
-
-
diff --git a/rocketmq-client4cpp/src/kpr/Exception.h b/rocketmq-client4cpp/src/kpr/Exception.h
deleted file mode 100755
index 524af849..00000000
--- a/rocketmq-client4cpp/src/kpr/Exception.h
+++ /dev/null
@@ -1,100 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_EXCEPTION_H
-#define __KPR_EXCEPTION_H
-
-#include "KPRTypes.h"
-#include <exception>
-#include <string>
-#include <sstream>
-
-namespace kpr
-{
-class Exception : public std::exception
-{
-public:
- Exception(const char* msg, int error, const char* file, int line)throw()
- : m_error(error), m_line(line), m_msg(msg), m_file(file)
- {
- try
- {
- std::stringstream ss;
- ss << "[" << file << ":" << line << "]|error: " << error << "|msg:" << msg;
- m_msg = ss.str();
- }
- catch (...)
- {
- }
- }
-
- virtual ~Exception()throw()
- {
- }
-
- const char* what() const throw()
- {
- return m_msg.c_str();
- }
-
- int GetError() const throw()
- {
- return m_error;
- }
-
- virtual const char* GetType() const throw()
- {
- return "Exception";
- }
-
-protected:
- int m_error;
- int m_line;
- std::string m_msg;
- std::string m_file;
-};
-}
-
-inline std::ostream& operator<<(std::ostream& os, const kpr::Exception& e)
-{
- os << "Type:" << e.GetType() << e.what();
- return os;
-}
-
-#define DEFINE_EXCEPTION(name) \
- class name : public kpr::Exception \
- {\
- public:\
- name(const char* msg, int error,const char* file,int line) throw ()\
- : Exception(msg,error,file,line) {}\
- virtual const char* GetType() const throw()\
- {\
- return #name;\
- }\
- };
-
-namespace kpr
-{
-DEFINE_EXCEPTION(SystemCallException);
-DEFINE_EXCEPTION(NotImplementException);
-DEFINE_EXCEPTION(InterruptedException);
-DEFINE_EXCEPTION(FileUtilException);
-DEFINE_EXCEPTION(RefHandleNullException);
-
-};
-
-#define THROW_EXCEPTION(e,msg,err) throw e(msg,err,__FILE__,__LINE__);
-
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/FileUtil.cpp b/rocketmq-client4cpp/src/kpr/FileUtil.cpp
deleted file mode 100755
index aa239e47..00000000
--- a/rocketmq-client4cpp/src/kpr/FileUtil.cpp
+++ /dev/null
@@ -1,523 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include <string.h>
-#include <time.h>
-#include <errno.h>
-#include <unistd.h>
-#include <stdint.h>
-#include <stdlib.h>
-#include <fcntl.h>
-#include <stdarg.h>
-#include <sys/stat.h>
-#include <sys/types.h>
-#include <cassert>
-#include <cstdio>
-#include <string>
-#include <iostream>
-#include <sstream>
-#include <stdexcept>
-#include <algorithm>
-#include <map>
-#include <stack>
-#include <vector>
-
-#include "FileUtil.h"
-#include "KPRUtil.h"
-#include "Exception.h"
-
-
-namespace kpr
-{
-
-std::ifstream::pos_type FileUtil::getFileSize(const std::string& sFullFileName)
-{
- std::ifstream ifs(sFullFileName.c_str());
- ifs.seekg(0, std::ios_base::end);
- return ifs.tellg();
-}
-
-bool FileUtil::isAbsolute(const std::string& sFullFileName)
-{
- if (sFullFileName.empty())
- {
- return false;
- }
-
- unsigned i = 0;
- while (isspace(sFullFileName[i]))
- {
- ++i;
- }
-
- return sFullFileName[i] == '/';
-}
-
-bool FileUtil::isFileExist(const std::string& sFullFileName, mode_t iFileType)
-{
- struct stat f_stat;
-
- if (lstat(sFullFileName.c_str(), &f_stat) == -1)
- {
- return false;
- }
-
- if (!(f_stat.st_mode & iFileType))
- {
- return false;
- }
-
- return true;
-}
-
-bool FileUtil::isFileExistEx(const std::string& sFullFileName, mode_t iFileType)
-{
- struct stat f_stat;
-
- if (stat(sFullFileName.c_str(), &f_stat) == -1)
- {
- return false;
- }
-
- if (!(f_stat.st_mode & iFileType))
- {
- return false;
- }
-
- return true;
-}
-
-bool FileUtil::makeDir(const std::string& sDirectoryPath, mode_t iFlag)
-{
- int iRetCode = mkdir(sDirectoryPath.c_str(), iFlag);
- if (iRetCode < 0 && errno == EEXIST)
- {
- return isFileExistEx(sDirectoryPath, S_IFDIR);
- }
-
- return iRetCode == 0;
-}
-
-bool FileUtil::makeDirRecursive(const std::string& sDirectoryPath, mode_t iFlag)
-{
- std::string simple = simplifyDirectory(sDirectoryPath);
-
- std::string::size_type pos = 0;
- for (; pos != std::string::npos;)
- {
- pos = simple.find("/", pos + 1);
- std::string s;
- if (pos == std::string::npos)
- {
- s = simple.substr(0, simple.size());
- return makeDir(s.c_str(), iFlag);
- }
- else
- {
- s = simple.substr(0, pos);
- if (!makeDir(s.c_str(), iFlag))
- {
- return false;
- }
- }
- }
- return true;
-}
-
-int FileUtil::setExecutable(const std::string& sFullFileName, bool canExecutable)
-{
- struct stat f_stat;
-
- if (stat(sFullFileName.c_str(), &f_stat) == -1)
- {
- return -1;
- }
-
- return chmod(sFullFileName.c_str(), canExecutable ? f_stat.st_mode | S_IXUSR : f_stat.st_mode & ~S_IXUSR);
-}
-
-bool FileUtil::canExecutable(const std::string& sFullFileName)
-{
- struct stat f_stat;
-
- if (stat(sFullFileName.c_str(), &f_stat) == -1)
- {
- return false;
- }
-
- return f_stat.st_mode & S_IXUSR;
-}
-
-int FileUtil::removeFile(const std::string& sFullFileName, bool bRecursive)
-{
- std::string path = simplifyDirectory(sFullFileName);
-
- if (isFileExist(path, S_IFDIR))
- {
- if (bRecursive)
- {
- std::vector<std::string> files;
- listDirectory(path, files, false);
- for (size_t i = 0; i < files.size(); i++)
- {
- removeFile(files[i], bRecursive);
- }
-
- if (path != "/")
- {
- if (::rmdir(path.c_str()) == -1)
- {
- return -1;
- }
- return 0;
- }
- }
- else
- {
- if (::rmdir(path.c_str()) == -1)
- {
- return -1;
- }
- }
- }
- else
- {
- if (::remove(path.c_str()) == -1)
- {
- return -1;
- }
- }
-
- return 0;
-}
-
-std::string FileUtil::simplifyDirectory(const std::string& path)
-{
- std::string result = path;
-
- std::string::size_type pos;
-
- pos = 0;
- while ((pos = result.find("//", pos)) != std::string::npos)
- {
- result.erase(pos, 1);
- }
-
- pos = 0;
- while ((pos = result.find("/./", pos)) != std::string::npos)
- {
- result.erase(pos, 2);
- }
-
- while (result.substr(0, 4) == "/../")
- {
- result.erase(0, 3);
- }
-
- if (result == "/.")
- {
- return result.substr(0, result.size() - 1);
- }
-
- if (result.size() >= 2 && result.substr(result.size() - 2, 2) == "/.")
- {
- result.erase(result.size() - 2, 2);
- }
-
- if (result == "/")
- {
- return result;
- }
-
- if (result.size() >= 1 && result[result.size() - 1] == '/')
- {
- result.erase(result.size() - 1);
- }
-
- if (result == "/..")
- {
- result = "/";
- }
-
- return result;
-}
-
-std::string FileUtil::load2str(const std::string& sFullFileName)
-{
- std::ifstream ifs(sFullFileName.c_str());
- if (!ifs)
- {
- return "";
- }
- return std::string(std::istreambuf_iterator<char>(ifs), std::istreambuf_iterator<char>());
-}
-
-void FileUtil::save2file(const std::string& sFullFileName, const std::string& sFileData)
-{
- std::ofstream ofs((sFullFileName).c_str());
- ofs << sFileData;
- ofs.close();
-}
-
-int FileUtil::save2file(const std::string& sFullFileName, const char* sFileData, size_t length)
-{
- FILE* fp = fopen(sFullFileName.c_str(), "wb");
- if (fp == NULL)
- {
- return -1;
- }
-
- size_t ret = fwrite((void*)sFileData, 1, length, fp);
- fclose(fp);
-
- if (ret == length)
- {
- return 0;
- }
- return -1;
-}
-
-std::string FileUtil::getExePath()
-{
- std::string proc = "/proc/self/exe";
- char buf[2048] = "\0";
-
- int bufsize = sizeof(buf) / sizeof(char);
-
- int count = readlink(proc.c_str(), buf, bufsize);
-
- if (count < 0)
- {
- THROW_EXCEPTION(FileUtilException, "could not get exe path error", errno);
- }
-
- count = (count >= bufsize) ? (bufsize - 1) : count;
-
- buf[count] = '\0';
- return buf;
-}
-
-std::string FileUtil::extractFileName(const std::string& sFullFileName)
-{
- if (sFullFileName.length() <= 0)
- {
- return "";
- }
-
- std::string::size_type pos = sFullFileName.rfind('/');
- if (pos == std::string::npos)
- {
- return sFullFileName;
- }
-
- return sFullFileName.substr(pos + 1);
-}
-
-std::string FileUtil::extractFilePath(const std::string& sFullFileName)
-{
- if (sFullFileName.length() <= 0)
- {
- return "./";
- }
-
- std::string::size_type pos = 0;
-
- for (pos = sFullFileName.length(); pos != 0 ; --pos)
- {
- if (sFullFileName[pos - 1] == '/')
- {
- return sFullFileName.substr(0, pos);
- }
- }
-
- return "./";
-}
-
-std::string FileUtil::extractFileExt(const std::string& sFullFileName)
-{
- std::string::size_type pos;
- if ((pos = sFullFileName.rfind('.')) == std::string::npos)
- {
- return std::string("");
- }
-
- return sFullFileName.substr(pos + 1);
-}
-
-std::string FileUtil::excludeFileExt(const std::string& sFullFileName)
-{
- std::string::size_type pos;
- if ((pos = sFullFileName.rfind('.')) == std::string::npos)
- {
- return sFullFileName;
- }
-
- return sFullFileName.substr(0, pos);
-}
-
-std::string FileUtil::replaceFileExt(const std::string& sFullFileName, const std::string& sExt)
-{
- return excludeFileExt(sFullFileName) + "." + sExt;
-}
-
-std::string FileUtil::extractUrlFilePath(const std::string& sUrl)
-{
- std::string sLowerUrl = KPRUtil::lower(sUrl);
- std::string::size_type pos = sLowerUrl.find("http://");
-
- if (pos == 0)
- {
- pos += strlen("http://");
- }
- else if (pos == std::string::npos)
- {
- pos = 0;
- }
-
- for (; pos < sUrl.length(); ++pos)
- {
- if (sUrl[pos] == '/')
- {
- if (pos < sUrl.length() - 1)
- {
- pos++;
- break;
- }
- else
- {
- return "";
- }
- }
- }
-
- if (pos == std::string::npos || pos == sUrl.length())
- {
- pos = 0;
- }
-
- return sUrl.substr(pos);
-}
-
-size_t FileUtil::scanDir(const std::string& sFilePath, std::vector<std::string>& vtMatchFiles, FILE_SELECT f, int iMaxSize)
-{
- vtMatchFiles.clear();
-
- struct dirent** namelist;
- int n = scandir(sFilePath.c_str(), &namelist, f, alphasort);
-
- if (n < 0)
- {
- return 0;
- }
- else
- {
- while (n--)
- {
- if (iMaxSize > 0 && vtMatchFiles.size() >= (size_t)iMaxSize)
- {
- free(namelist[n]);
- break;
- }
- else
- {
- vtMatchFiles.push_back(namelist[n]->d_name);
- free(namelist[n]);
- }
- }
- free(namelist);
- }
-
- return vtMatchFiles.size();
-}
-
-void FileUtil::listDirectory(const std::string& path, std::vector<std::string>& files, bool bRecursive)
-{
- std::vector<std::string> tf;
- scanDir(path, tf, 0, 0);
-
- for (size_t i = 0; i < tf.size(); i++)
- {
- if (tf[i] == "." || tf[i] == "..")
- {
- continue;
- }
-
- std::string s = path + "/" + tf[i];
-
- if (isFileExist(s, S_IFDIR))
- {
- files.push_back(simplifyDirectory(s));
- if (bRecursive)
- {
- listDirectory(s, files, bRecursive);
- }
- }
- else
- {
- files.push_back(simplifyDirectory(s));
- }
- }
-}
-
-void FileUtil::copyFile(const std::string& sExistFile, const std::string& sNewFile, bool bRemove)
-{
- if (FileUtil::isFileExist(sExistFile, S_IFDIR))
- {
- FileUtil::makeDir(sNewFile);
- std::vector<std::string> tf;
- FileUtil::scanDir(sExistFile, tf, 0, 0);
- for (size_t i = 0; i < tf.size(); i++)
- {
- if (tf[i] == "." || tf[i] == "..")
- {
- continue;
- }
- std::string s = sExistFile + "/" + tf[i];
- std::string d = sNewFile + "/" + tf[i];
- copyFile(s, d, bRemove);
- }
- }
- else
- {
- if (bRemove)
- {
- std::remove(sNewFile.c_str());
- }
- std::ifstream fin(sExistFile.c_str());
- if (!fin)
- {
- THROW_EXCEPTION(FileUtilException, "[FileUtil::copyFile] infile open fail", errno);
- }
- std::ofstream fout(sNewFile.c_str());
- if (!fout)
- {
- THROW_EXCEPTION(FileUtilException, "[FileUtil::copyFile] newfile open fail", errno);
- }
- struct stat f_stat;
- if (stat(sExistFile.c_str(), &f_stat) == -1)
- {
- THROW_EXCEPTION(FileUtilException, "[FileUtil::copyFile] infile stat fail", errno);
- }
- chmod(sNewFile.c_str(), f_stat.st_mode);
- fout << fin.rdbuf();
- fin.close();
- fout.close();
-
- }
-}
-
-}
-
diff --git a/rocketmq-client4cpp/src/kpr/FileUtil.h b/rocketmq-client4cpp/src/kpr/FileUtil.h
deleted file mode 100755
index c1e85187..00000000
--- a/rocketmq-client4cpp/src/kpr/FileUtil.h
+++ /dev/null
@@ -1,90 +0,0 @@
-/**
-* Copyright (C) 2013 suwenkuang ,hooligan_520@qq.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __KPR_FILEUTIL_H_
-#define __KPR_FILEUTIL_H_
-
-#include <iostream>
-#include <fstream>
-#include <unistd.h>
-#include <sys/stat.h>
-#include <sys/types.h>
-#include <dirent.h>
-#include <fnmatch.h>
-
-
-#include <string>
-#include <vector>
-
-
-namespace kpr
-{
-
-class FileUtil
-{
-public:
-
- static std::ifstream::pos_type getFileSize(const std::string& sFullFileName);
-
- static bool isAbsolute(const std::string& sFullFileName);
-
- static bool isFileExist(const std::string& sFullFileName, mode_t iFileType = S_IFREG);
-
- static bool isFileExistEx(const std::string& sFullFileName, mode_t iFileType = S_IFREG);
-
- static std::string simplifyDirectory(const std::string& path);
-
- static bool makeDir(const std::string& sDirectoryPath, mode_t iFlag = S_IRUSR | S_IWUSR | S_IXUSR | S_IRGRP | S_IXGRP | S_IROTH | S_IXOTH);
-
- static bool makeDirRecursive(const std::string& sDirectoryPath, mode_t iFlag = S_IRUSR | S_IWUSR | S_IXUSR | S_IRGRP | S_IXGRP | S_IROTH | S_IXOTH);
-
- static int setExecutable(const std::string& sFullFileName, bool canExecutable);
-
- static bool canExecutable(const std::string& sFullFileName);
-
- static int removeFile(const std::string& sFullFileName, bool bRecursive);
-
- static std::string load2str(const std::string& sFullFileName);
-
- static void save2file(const std::string& sFullFileName, const std::string& sFileData);
-
- static int save2file(const std::string& sFullFileName, const char* sFileData, size_t length);
-
- static std::string getExePath();
-
- static std::string extractFileName(const std::string& sFullFileName);
-
- static std::string extractFilePath(const std::string& sFullFileName);
-
- static std::string extractFileExt(const std::string& sFullFileName);
-
- static std::string excludeFileExt(const std::string& sFullFileName);
-
- static std::string replaceFileExt(const std::string& sFullFileName, const std::string& sExt);
-
- static std::string extractUrlFilePath(const std::string& sUrl);
-
- typedef int (*FILE_SELECT)(const dirent*);
-
- static size_t scanDir(const std::string& sFilePath, std::vector<std::string>& vtMatchFiles, FILE_SELECT f = NULL, int iMaxSize = 0);
-
- static void listDirectory(const std::string& path, std::vector<std::string>& files, bool bRecursive);
-
- static void copyFile(const std::string& sExistFile, const std::string& sNewFile, bool bRemove = false);
-};
-
-}
-#endif // __FILE_UTIL_H_
diff --git a/rocketmq-client4cpp/src/kpr/KPRTypes.h b/rocketmq-client4cpp/src/kpr/KPRTypes.h
deleted file mode 100755
index 0a541236..00000000
--- a/rocketmq-client4cpp/src/kpr/KPRTypes.h
+++ /dev/null
@@ -1,65 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_TYPES_H__
-#define __KPR_TYPES_H__
-
-#include <stdio.h>
-#include <stdlib.h>
-#include <stdint.h>
-#include <unistd.h>
-#include <sys/time.h>
-#include <pthread.h>
-#include <semaphore.h>
-
-
-typedef pthread_key_t ThreadKey;
-
-
-namespace kpr
-{
-class ThreadId
-{
-public:
- ThreadId(pthread_t id = 0)
- : m_threadId(id)
- {
- }
-
- bool operator==(const ThreadId& id) const
- {
- return m_threadId == id.m_threadId;
- }
-
- bool operator!=(const ThreadId& id) const
- {
- return !(*this == id);
- }
-
- operator pthread_t() const
- {
- return m_threadId;
- }
-
- static ThreadId GetCurrentThreadId()
- {
- return ThreadId(pthread_self());
- }
-
- pthread_t m_threadId;
-};
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/KPRUtil.cpp b/rocketmq-client4cpp/src/kpr/KPRUtil.cpp
deleted file mode 100755
index fe2cdd20..00000000
--- a/rocketmq-client4cpp/src/kpr/KPRUtil.cpp
+++ /dev/null
@@ -1,76 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include "KPRUtil.h"
-#include <assert.h>
-
-
-
-unsigned long long KPRUtil::GetCurrentTimeMillis()
-{
- struct timeval tv;
- gettimeofday(&tv, 0);
- return tv.tv_sec * 1000ULL + tv.tv_usec / 1000;
-}
-
-struct timespec KPRUtil::CalcAbsTime(long timeout)
-{
- assert(timeout >= 0);
- struct timeval tv;
- gettimeofday(&tv, 0);
-
- struct timespec abstime;
- abstime.tv_sec = tv.tv_sec + (timeout / 1000);
- abstime.tv_nsec = (tv.tv_usec * 1000) + ((timeout % 1000) * 1000000);
- if (abstime.tv_nsec >= 1000000000)
- {
- ++abstime.tv_sec;
- abstime.tv_nsec -= 1000000000;
- }
-
- return abstime;
-}
-
-long long KPRUtil::str2ll(const char* str)
-{
- return atoll(str);
-}
-
-
-std::string KPRUtil::lower(const std::string& s)
-{
- std::string sString = s;
- for (std::string::iterator iter = sString.begin(); iter != sString.end(); ++iter)
- {
- *iter = tolower(*iter);
- }
-
- return sString;
-}
-
-std::string KPRUtil::upper(const std::string& s)
-{
- std::string sString = s;
-
- for (std::string::iterator iter = sString.begin(); iter != sString.end(); ++iter)
- {
- *iter = toupper(*iter);
- }
-
- return sString;
-}
-
-
-
diff --git a/rocketmq-client4cpp/src/kpr/KPRUtil.h b/rocketmq-client4cpp/src/kpr/KPRUtil.h
deleted file mode 100755
index ae2c529a..00000000
--- a/rocketmq-client4cpp/src/kpr/KPRUtil.h
+++ /dev/null
@@ -1,38 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_UTIL_H__
-#define __KPR_UTIL_H__
-
-#include <stdio.h>
-#include <unistd.h>
-#include <sys/types.h>
-#include <sys/time.h>
-#include <stdlib.h>
-#include <string>
-
-
-class KPRUtil
-{
-public:
- static struct timespec CalcAbsTime(long timeout);
- static unsigned long long GetCurrentTimeMillis();
- static long long str2ll(const char* str);
- static std::string lower(const std::string& s);
- static std::string upper(const std::string& s);
-};
-
-
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/Monitor.cpp b/rocketmq-client4cpp/src/kpr/Monitor.cpp
deleted file mode 100644
index d715f556..00000000
--- a/rocketmq-client4cpp/src/kpr/Monitor.cpp
+++ /dev/null
@@ -1,125 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include "Monitor.h"
-#include <assert.h>
-
-namespace kpr
-{
-Monitor::Monitor()
- : m_notifyCount(0)
-{
-}
-
-Monitor::~Monitor()
-{
-}
-
-void Monitor::Wait()
-{
- validateOwner(m_mutex.GetOwner(), "wait()");
-
- notify(m_notifyCount);
-
- try
- {
- m_condition.Wait(m_mutex);
- }
- catch (...)
- {
- m_notifyCount = 0;
- throw;
- }
- m_notifyCount = 0;
-}
-
-void Monitor::Wait(long timeout)
-{
- validateOwner(m_mutex.GetOwner(), "wait(long)");
-
- notify(m_notifyCount);
- try
- {
- m_condition.Wait(m_mutex, timeout);
- }
- catch (...)
- {
- m_notifyCount = 0;
- throw;
- }
-
- m_notifyCount = 0;
-}
-
-void Monitor::Notify()
-{
- validateOwner(m_mutex.GetOwner(), "notify");
-
- if (m_notifyCount != -1)
- {
- ++m_notifyCount;
- }
-}
-
-void Monitor::NotifyAll()
-{
- validateOwner(m_mutex.GetOwner(), "notifyAll");
-
- m_notifyCount = -1;
-}
-
-void Monitor::Lock() const
-{
- if (m_mutex.Lock())
- {
- m_notifyCount = 0;
- }
-}
-
-void Monitor::Unlock() const
-{
- if (m_mutex.GetCount() == 1)
- {
- ((Monitor*)this)->notify(m_notifyCount);
- }
-
- m_mutex.Unlock();
-}
-
-void Monitor::notify(int nnotify)
-{
- if (nnotify != 0)
- {
- if (nnotify == -1)
- {
- m_condition.NotifyAll();
- return;
- }
- else
- {
- while (nnotify > 0)
- {
- m_condition.Notify();
- --nnotify;
- }
- }
- }
-}
-
-void Monitor::validateOwner(const ThreadId& id, const char* caller) const
-{
- assert(id == ThreadId::GetCurrentThreadId());
-}
-}
diff --git a/rocketmq-client4cpp/src/kpr/Monitor.h b/rocketmq-client4cpp/src/kpr/Monitor.h
deleted file mode 100644
index 345f736a..00000000
--- a/rocketmq-client4cpp/src/kpr/Monitor.h
+++ /dev/null
@@ -1,48 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_MONITOR_H__
-#define __KPR_MONITOR_H__
-
-#include "KPRTypes.h"
-#include "Condition.h"
-#include "Mutex.h"
-namespace kpr
-{
-class Monitor
-{
-public:
- Monitor();
- virtual ~Monitor();
-
- void Wait();
- void Wait(long msec);
-
- void Notify();
- void NotifyAll();
-
- void Lock() const;
- void Unlock() const;
-
-private:
- void notify(int times);
- void validateOwner(const ThreadId& id, const char* caller) const;
-
- RecursiveMutex m_mutex;
- Condition m_condition;
- mutable int m_notifyCount;
-};
-}
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/Mutex.cpp b/rocketmq-client4cpp/src/kpr/Mutex.cpp
deleted file mode 100755
index f98282c2..00000000
--- a/rocketmq-client4cpp/src/kpr/Mutex.cpp
+++ /dev/null
@@ -1,296 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include "Mutex.h"
-
-#include <pthread.h>
-#include <unistd.h>
-#include <stdio.h>
-#include <errno.h>
-#include <time.h>
-
-
-namespace kpr
-{
-Mutex::Mutex()
-{
- ::pthread_mutex_init(&m_mutex, NULL);
-}
-
-Mutex::~Mutex()
-{
- ::pthread_mutex_destroy(&m_mutex);
-}
-
-void Mutex::Lock() const
-{
- ::pthread_mutex_lock(&m_mutex);
-}
-
-bool Mutex::TryLock() const
-{
- int ret = ::pthread_mutex_trylock(&m_mutex);
- return (ret == 0);
-}
-
-bool Mutex::TryLock(int timeout) const
-{
- struct timespec ts;
- clock_gettime(CLOCK_REALTIME, &ts);
- ts.tv_sec += (timeout/1000);
- ts.tv_nsec += (timeout%1000) * 1000 * 1000;
-
- int ret = ::pthread_mutex_timedlock(&m_mutex, &ts);
- return (ret == 0);
-}
-
-
-void Mutex::Unlock() const
-{
- ::pthread_mutex_unlock(&m_mutex);
-}
-
-//***********
-//RWMutex
-//***************
-RWMutex::RWMutex()
-{
- ::pthread_rwlock_init(&m_mutex, NULL);
-}
-
-RWMutex::~RWMutex()
-{
- ::pthread_rwlock_destroy(&m_mutex);
-}
-
-void RWMutex::ReadLock() const
-{
- ::pthread_rwlock_rdlock(&m_mutex);
-}
-
-void RWMutex::WriteLock() const
-{
- ::pthread_rwlock_wrlock(&m_mutex);
-}
-
-bool RWMutex::TryReadLock() const
-{
- int ret = ::pthread_rwlock_tryrdlock(&m_mutex);
- return (ret == 0);
-}
-
-bool RWMutex::TryReadLock(int timeout) const
-{
- struct timespec ts;
- clock_gettime(CLOCK_REALTIME, &ts);
- ts.tv_sec += (timeout/1000);
- ts.tv_nsec += (timeout%1000) * 1000 * 1000;
-
- int ret = ::pthread_rwlock_timedrdlock(&m_mutex, &ts);
- return (ret == 0);
-}
-
-bool RWMutex::TryWriteLock() const
-{
- int ret = ::pthread_rwlock_trywrlock(&m_mutex);
- return (ret == 0);
-}
-
-bool RWMutex::TryWriteLock(int timeout) const
-{
- struct timespec ts;
- clock_gettime(CLOCK_REALTIME, &ts);
- ts.tv_sec += (timeout/1000);
- ts.tv_nsec += (timeout%1000) * 1000 * 1000;
-
- int ret = ::pthread_rwlock_timedwrlock(&m_mutex, &ts);
- return (ret == 0);
-}
-
-
-void RWMutex::Unlock() const
-{
- ::pthread_rwlock_unlock(&m_mutex);
-}
-
-
-//***********
-//RecursiveMutex
-//***************
-RecursiveMutex::RecursiveMutex()
- : m_count(0),
- m_owner(ThreadId())
-{
- ::pthread_mutex_init(&m_mutex, NULL);
-}
-
-RecursiveMutex::~RecursiveMutex()
-{
- ::pthread_mutex_destroy(&m_mutex);
-}
-
-bool RecursiveMutex::Lock()const
-{
- return ((RecursiveMutex*)this)->lock(1);
-}
-
-bool RecursiveMutex::Unlock()const
-{
- return ((RecursiveMutex*)this)->unlock();
-}
-
-bool RecursiveMutex::TryLock()const
-{
- return ((RecursiveMutex*)this)->tryLock();
-}
-
-ThreadId RecursiveMutex::GetOwner()const
-{
- m_internal.Lock();
- ThreadId id;
- if (m_count > 0)
- {
- id = m_owner;
- }
- m_internal.Unlock();
-
- return id;
-}
-
-bool RecursiveMutex::lock(int count)
-{
- bool rc = false;
- bool obtained = false;
-
- while (!obtained)
- {
- m_internal.Lock();
-
- if (m_count == 0)
- {
- m_count = count;
- m_owner = ThreadId::GetCurrentThreadId();
- obtained = true;
- rc = true;
-
- try
- {
- ::pthread_mutex_lock(&m_mutex);
- }
- catch (...)
- {
- try
- {
- m_internal.Unlock();
- }
- catch (...)
- {
- }
- throw;
- }
- }
- else if (m_owner == ThreadId::GetCurrentThreadId())
- {
- m_count += count;
- obtained = true;
- }
-
- m_internal.Unlock();
-
- if (!obtained)
- {
- ::pthread_mutex_lock(&m_mutex);
- ::pthread_mutex_unlock(&m_mutex);
- }
- }
-
- return rc;
-}
-
-bool RecursiveMutex::tryLock()
-{
- bool obtained = false;
-
- m_internal.Lock();
-
- if (m_count == 0)
- {
- m_count = 1;
- m_owner = ThreadId::GetCurrentThreadId();
- obtained = true;
-
- try
- {
- ::pthread_mutex_lock(&m_mutex);
- }
- catch (...)
- {
- try
- {
- m_internal.Unlock();
- }
- catch (...)
- {
- }
- throw;
- }
- }
- else if (m_owner == ThreadId::GetCurrentThreadId())
- {
- ++m_count;
- obtained = true;
- }
-
- m_internal.Unlock();
-
- return obtained;
-}
-
-bool RecursiveMutex::unlock()
-{
- bool rc;
- m_internal.Lock();
-
- if (--m_count == 0)
- {
- m_owner = ThreadId();
-
- ::pthread_mutex_unlock(&m_mutex);
-
- rc = true;
- }
- else
- {
- rc = false;
- }
-
- m_internal.Unlock();
-
- return rc;
-}
-
-unsigned int RecursiveMutex::reset4Condvar()
-{
- m_internal.Lock();
-
- unsigned int count = m_count;
- m_count = 0;
- m_owner = ThreadId();
-
- m_internal.Unlock();
-
- return count;
-}
-}
diff --git a/rocketmq-client4cpp/src/kpr/Mutex.h b/rocketmq-client4cpp/src/kpr/Mutex.h
deleted file mode 100755
index fc3498fc..00000000
--- a/rocketmq-client4cpp/src/kpr/Mutex.h
+++ /dev/null
@@ -1,107 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_MUTEX_H__
-#define __KPR_MUTEX_H__
-
-#include "KPRTypes.h"
-#include <errno.h>
-
-namespace kpr
-{
-class Mutex
-{
-public:
- Mutex();
- ~Mutex();
-
- void Lock()const;
- void Unlock()const;
- bool TryLock()const;
- bool TryLock(int timeout) const;
-
- ThreadId GetOwner()const;
-
-private:
- Mutex(const Mutex&);
- const Mutex& operator=(const Mutex&);
-
- mutable pthread_mutex_t m_mutex;
- friend class Condition;
-};
-
-class RWMutex
-{
-public:
- RWMutex();
- ~RWMutex();
-
- void ReadLock()const;
- void WriteLock()const;
- bool TryReadLock()const;
- bool TryReadLock(int timeout) const;
- bool TryWriteLock()const;
- bool TryWriteLock(int timeout)const;
- void Unlock()const;
-
- ThreadId GetOwner()const;
-
-private:
- RWMutex(const RWMutex&);
- const RWMutex& operator=(const RWMutex&);
-
- mutable pthread_rwlock_t m_mutex;
- friend class Condition;
-};
-
-class RecursiveMutex
-{
-public:
- RecursiveMutex();
- ~RecursiveMutex();
-
- bool Lock()const;
- bool Unlock()const;
- bool TryLock()const;
-
- ThreadId GetOwner()const;
-
- unsigned int GetCount()const
- {
- return m_count;
- }
-
-private:
- RecursiveMutex(const RecursiveMutex&);
-
- const RecursiveMutex& operator=(const RecursiveMutex&);
-
- bool lock(int count);
- bool tryLock();
- bool unlock();
-
- unsigned int reset4Condvar();
-
-private:
- pthread_mutex_t m_mutex;
- Mutex m_internal;
- mutable unsigned int m_count;
- mutable ThreadId m_owner;
-
- friend class Condition;
- friend class ConditionHelper;
-};
-}
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/RefHandle.h b/rocketmq-client4cpp/src/kpr/RefHandle.h
deleted file mode 100644
index fd7d741b..00000000
--- a/rocketmq-client4cpp/src/kpr/RefHandle.h
+++ /dev/null
@@ -1,328 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_REFHANDLET_H__
-#define __KPR_REFHANDLET_H__
-
-#include "KPRTypes.h"
-#include "AtomicValue.h"
-#include "Exception.h"
-
-namespace kpr
-{
-
-class RefCount
-{
-public:
- RefCount& operator=(const RefCount&)
- {
- return *this;
- }
-
- void incRef()
- {
- m_refCount++;
- }
-
- void decRef()
- {
- if (--m_refCount == 0 && !m_noDelete)
- {
- m_noDelete = true;
- delete this;
- }
- }
-
- int getRef() const
- {
- return m_refCount.get();
- }
-
- void setNoDelete(bool b)
- {
- m_noDelete = b;
- }
-
-protected:
- RefCount()
- : m_refCount(0), m_noDelete(false)
- {
- }
-
- RefCount(const RefCount&)
- : m_refCount(0), m_noDelete(false)
- {
- }
-
- virtual ~RefCount()
- {
- }
-
-protected:
- AtomicInteger m_refCount;
- bool m_noDelete;
-};
-
-
-
-template <class T>
-class RefHandleT
-{
-public:
- RefHandleT(T* p = 0)
- {
- m_ptr = p;
-
- if (m_ptr)
- {
- m_ptr->incRef();
- }
- }
-
- template<typename Y>
- RefHandleT(const RefHandleT<Y>& v)
- {
- m_ptr = v.m_ptr;
-
- if (m_ptr)
- {
- m_ptr->incRef();
- }
- }
-
- RefHandleT(const RefHandleT& v)
- {
- m_ptr = v.m_ptr;
-
- if (m_ptr)
- {
- m_ptr->incRef();
- }
- }
-
- ~RefHandleT()
- {
- if (m_ptr)
- {
- m_ptr->decRef();
- }
- }
-
- RefHandleT<T>& operator=(T* p)
- {
- if (m_ptr != p)
- {
- if (p)
- {
- p->incRef();
- }
-
- T* ptr = m_ptr;
- m_ptr = p;
-
- if (ptr)
- {
- ptr->decRef();
- }
- }
-
- return *this;
- }
-
- template<typename Y>
- RefHandleT<T>& operator=(const RefHandleT<Y>& v)
- {
- if (m_ptr != v.m_ptr)
- {
- if (v.m_ptr)
- {
- v.m_ptr->incRef();
- }
-
- T* ptr = m_ptr;
- m_ptr = v.m_ptr;
-
- if (ptr)
- {
- ptr->decRef();
- }
- }
-
- return *this;
- }
-
- RefHandleT<T>& operator=(const RefHandleT<T>& v)
- {
- if (m_ptr != v.m_ptr)
- {
- if (v.m_ptr)
- {
- v.m_ptr->incRef();
- }
-
- T* ptr = m_ptr;
- m_ptr = v.m_ptr;
-
- if (ptr)
- {
- ptr->decRef();
- }
- }
-
- return *this;
- }
-
- T* operator->() const
- {
- if (!m_ptr)
- {
- THROW_EXCEPTION(RefHandleNullException, "autoptr null handle error", -1);
- }
-
- return m_ptr;
- }
-
- T& operator*() const
- {
- if (!m_ptr)
- {
- THROW_EXCEPTION(RefHandleNullException, "autoptr null handle error", -1);
- }
-
- return *m_ptr;
- }
-
- operator T* () const
- {
- return m_ptr;
- }
-
- T* ptr() const
- {
- return m_ptr;
- }
-
- T* retn()
- {
- T* p = m_ptr;
- m_ptr = 0;
-
- return p;
- }
-
- bool operator==(const RefHandleT<T>& v) const
- {
- return m_ptr == v.m_ptr;
- }
-
- bool operator==(T* p) const
- {
- return m_ptr == p;
- }
-
- bool operator!=(const RefHandleT<T>& v) const
- {
- return m_ptr != v.m_ptr;
- }
-
- bool operator!=(T* p) const
- {
- return m_ptr != p;
- }
-
- bool operator!() const
- {
- return m_ptr == 0;
- }
-
- operator bool() const
- {
- return m_ptr != 0;
- }
-
- void swap(RefHandleT& other)
- {
- std::swap(m_ptr, other._ptr);
- }
-
- template<class Y>
- static RefHandleT dynamicCast(const RefHandleT<Y>& r)
- {
- return RefHandleT(dynamic_cast<T*>(r._ptr));
- }
-
- template<class Y>
- static RefHandleT dynamicCast(Y* p)
- {
- return RefHandleT(dynamic_cast<T*>(p));
- }
-
-public:
- T* m_ptr;
-};
-
-
-template<typename T, typename U>
-inline bool operator==(const RefHandleT<T>& lhs, const RefHandleT<U>& rhs)
-{
- T* l = lhs.ptr();
- U* r = rhs.ptr();
- if(l && r)
- {
- return *l == *r;
- }
- else
- {
- return !l && !r;
- }
-}
-
-
-template<typename T, typename U>
-inline bool operator!=(const RefHandleT<T>& lhs, const RefHandleT<U>& rhs)
-{
- T* l = lhs.ptr();
- U* r = rhs.ptr();
- if(l && r)
- {
- return *l != *r;
- }
- else
- {
- return l || r;
- }
-}
-
-
-template<typename T, typename U>
-inline bool operator<(const RefHandleT<T>& lhs, const RefHandleT<U>& rhs)
-{
- T* l = lhs.ptr();
- U* r = rhs.ptr();
- if(l && r)
- {
- return *l < *r;
- }
- else
- {
- return !l && r;
- }
-}
-
-}
-
-#define DECLAREVAR(T) typedef kpr::RefHandleT<T> T ## Ptr;
-
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/ScopedLock.h b/rocketmq-client4cpp/src/kpr/ScopedLock.h
deleted file mode 100755
index 6ff9dd17..00000000
--- a/rocketmq-client4cpp/src/kpr/ScopedLock.h
+++ /dev/null
@@ -1,91 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_SCOPEDLOCK_H__
-#define __KPR_SCOPEDLOCK_H__
-
-namespace kpr
-{
-template <class T>
-class ScopedLock
-{
-public:
- ScopedLock(const T& mutex)
- : m_mutex(mutex)
- {
- m_mutex.Lock();
- }
-
- ~ScopedLock()
- {
- m_mutex.Unlock();
- }
-
-private:
- const T& m_mutex;
-};
-
-
-template <class T>
-class ScopedRLock
-{
-public:
- ScopedRLock(const T& mutex)
- : m_mutex(mutex)
- {
- m_mutex.ReadLock();
- m_acquired = true;
- }
-
- ~ScopedRLock()
- {
- if (m_acquired)
- {
- m_mutex.Unlock();
- }
- }
-
-private:
- const T& m_mutex;
- mutable bool m_acquired;
-};
-
-
-template <class T>
-class ScopedWLock
-{
-public:
- ScopedWLock(const T& mutex)
- : m_mutex(mutex)
- {
- m_mutex.WriteLock();
- m_acquired = true;
- }
-
- ~ScopedWLock()
- {
- if (m_acquired)
- {
- m_mutex.Unlock();
- }
- }
-
-private:
- const T& m_mutex;
- mutable bool m_acquired;
-};
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/Semaphore.cpp b/rocketmq-client4cpp/src/kpr/Semaphore.cpp
deleted file mode 100755
index 59a0eef9..00000000
--- a/rocketmq-client4cpp/src/kpr/Semaphore.cpp
+++ /dev/null
@@ -1,73 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-#include "Semaphore.h"
-
-#include <unistd.h>
-#include <sys/time.h>
-#include "KPRUtil.h"
-
-namespace kpr
-{
-Semaphore::Semaphore(long initial_count)
-{
- sem_init(&m_sem, 0, initial_count);
-}
-
-Semaphore::~Semaphore()
-{
- sem_destroy(&m_sem);
-}
-
-int Semaphore::GetValue()
-{
- int value = 0;
- int rc = sem_getvalue(&m_sem, &value);
- if (rc < 0)
- {
- return rc;
- }
- return value;
-}
-
-bool Semaphore::Wait()
-{
- int rc;
- rc = sem_wait(&m_sem);
- return !rc;
-}
-
-bool Semaphore::Wait(long timeout)
-{
- int rc;
- if (timeout < 0)
- {
- rc = sem_wait(&m_sem);
- }
- else
- {
- struct timespec abstime = KPRUtil::CalcAbsTime(timeout);
- rc = sem_timedwait(&m_sem, &abstime);
- }
-
- return !rc;
-}
-
-void Semaphore::Release(int count)
-{
- sem_post(&m_sem);
-}
-}
diff --git a/rocketmq-client4cpp/src/kpr/Semaphore.h b/rocketmq-client4cpp/src/kpr/Semaphore.h
deleted file mode 100755
index 2a1af7f2..00000000
--- a/rocketmq-client4cpp/src/kpr/Semaphore.h
+++ /dev/null
@@ -1,42 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_SEMAPHORE_H__
-#define __KPR_SEMAPHORE_H__
-
-#include "KPRTypes.h"
-#include <errno.h>
-
-namespace kpr
-{
-
-class Semaphore
-{
-public:
- Semaphore(long initial_count = 0);
- ~Semaphore();
-
- int GetValue();
- bool Wait();
- bool Wait(long timeout);
-
- void Release(int count = 1);
-
-private:
- sem_t m_sem;
-};
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/Thread.cpp b/rocketmq-client4cpp/src/kpr/Thread.cpp
deleted file mode 100755
index d80819ba..00000000
--- a/rocketmq-client4cpp/src/kpr/Thread.cpp
+++ /dev/null
@@ -1,191 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include "Thread.h"
-
-#include <string.h>
-#include <stdlib.h>
-#include <stdio.h>
-#include <errno.h>
-#include <assert.h>
-#include <unistd.h>
-#include <sys/types.h>
-#include <signal.h>
-
-#include "ScopedLock.h"
-#include "Exception.h"
-
-//for log
-#include "RocketMQClient.h"
-
-namespace kpr
-{
-kpr::AtomicInteger Thread::s_threadNumber = 0;
-
-void* Thread::ThreadRoute(void* pArg)
-{
- Thread* tv = ((Thread*)pArg);
-
- try
- {
- tv->Startup();
- }
- catch (...)
- {
- }
-
- try
- {
- tv->Cleanup();
- }
- catch (...)
- {
- }
-
- return 0;
-}
-
-Thread::Thread(const char* name)
-{
- m_started = false;
- m_threadId = ThreadId();
- m_threadNumber = s_threadNumber++;
-
- SetName(name);
-}
-
-Thread::~Thread()
-{
- try
- {
- }
- catch (...)
- {
- }
-}
-
-void Thread::SetName(const char* name)
-{
- ScopedLock<Mutex> guard(m_mutex);
-
- if (name == NULL)
- {
- snprintf(m_name, sizeof(m_name), "Thread-%u", m_threadNumber);
- }
- else
- {
- snprintf(m_name, sizeof(m_name), "%s", name);
- }
-}
-
-const char* Thread::GetName() const
-{
- ScopedLock<Mutex> guard(m_mutex);
- return m_name;
-}
-
-void Thread::Start()
-{
- ScopedLock<Mutex> guard(m_mutex);
-
- if (m_started)
- {
- return;
- }
-
- pthread_attr_t attr;
- int retcode = 0;
- retcode = pthread_attr_init(&attr);
- if (retcode != 0)
- {
- THROW_EXCEPTION(SystemCallException, "pthread_attr_init failed!", errno)
- }
-
- pthread_t id;
- retcode = pthread_create(&id, &attr, ThreadRoute, (void*)this);
- if (retcode != 0)
- {
- THROW_EXCEPTION(SystemCallException, "pthread_create error", errno)
- }
-
- m_threadId = id;
- pthread_attr_destroy(&attr);
- m_started = true;
- RMQ_DEBUG("thread[%s][%ld] start successfully", m_name, (long)id);
-}
-
-void Thread::Run()
-{
- //TODO support runable
-}
-
-bool Thread::IsAlive() const
-{
- if (m_started)
- {
- int retcode = pthread_kill(m_threadId, 0);
- return (retcode == ESRCH);
- }
-
- return false;
-}
-
-void Thread::Join()
-{
- if (m_started)
- {
- pthread_join(m_threadId, NULL);
- }
-}
-
-void Thread::Sleep(long millis, int nanos)
-{
- assert(millis >= 0 && nanos >= 0 && nanos < 999999);
- struct timespec tv;
- tv.tv_sec = millis / 1000;
- tv.tv_nsec = (millis % 1000) * 1000000 + nanos;
- nanosleep(&tv, 0);
-}
-
-void Thread::Yield()
-{
- pthread_yield();
-}
-
-ThreadId Thread::GetId() const
-{
- ScopedLock<Mutex> guard(m_mutex);
- return m_threadId;
-}
-
-void Thread::Startup()
-{
- try
- {
- RMQ_INFO("thread[%s] started", GetName());
- Run();
- }
- catch (...)
- {
- }
-}
-
-void Thread::Cleanup()
-{
- RMQ_INFO("thread[%s] end", GetName());
-}
-
-}
-
diff --git a/rocketmq-client4cpp/src/kpr/Thread.h b/rocketmq-client4cpp/src/kpr/Thread.h
deleted file mode 100755
index ef2590e2..00000000
--- a/rocketmq-client4cpp/src/kpr/Thread.h
+++ /dev/null
@@ -1,68 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_THREAD_H__
-#define __KPR_THREAD_H__
-
-#include "KPRTypes.h"
-#include "RefHandle.h"
-#include "Mutex.h"
-
-#ifdef Yield
-#undef Yield
-#endif
-
-namespace kpr
-{
-class Thread : public virtual kpr::RefCount
-{
-public:
- Thread(const char* name = NULL);
- virtual ~Thread();
-
- virtual void Run();
- void Start();
- bool IsAlive() const;
- void Join();
- ThreadId GetId() const;
-
- void SetName(const char*);
- const char* GetName() const;
-
- void Startup();
- void Cleanup();
-
- static void Sleep(long millis, int nano = 0);
- static void Yield();
-
-private:
- Thread(const Thread&);
- const Thread& operator=(const Thread&);
- static void* ThreadRoute(void* pArg);
-
-private:
- ThreadId m_threadId;
- unsigned int m_threadNumber;
- char m_name[128];
- bool m_started;
- Mutex m_mutex;
-
- static kpr::AtomicInteger s_threadNumber;
-};
-typedef kpr::RefHandleT<Thread> ThreadPtr;
-
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/ThreadLocal.cpp b/rocketmq-client4cpp/src/kpr/ThreadLocal.cpp
deleted file mode 100755
index 32cba5b5..00000000
--- a/rocketmq-client4cpp/src/kpr/ThreadLocal.cpp
+++ /dev/null
@@ -1,56 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include "ThreadLocal.h"
-
-#include <errno.h>
-
-#include "Exception.h"
-
-namespace kpr
-{
-ThreadLocal::ThreadLocal()
- : m_Key(0)
-{
- int retcode = 0;
-
- retcode = pthread_key_create(&m_Key, 0);
- if (retcode != 0)
- {
- THROW_EXCEPTION(SystemCallException, "pthread_key_create error", errno);
- }
-}
-
-ThreadLocal::~ThreadLocal()
-{
- pthread_key_delete(m_Key);
-}
-
-void* ThreadLocal::GetValue()
-{
- void* v;
- v = pthread_getspecific(m_Key);
- return v;
-}
-
-void ThreadLocal::SetValue(void* value)
-{
- int retcode = pthread_setspecific(m_Key, value);
- if (retcode != 0)
- {
- THROW_EXCEPTION(SystemCallException, "pthread_setspecific error", errno);
- }
-}
-}
diff --git a/rocketmq-client4cpp/src/kpr/ThreadLocal.h b/rocketmq-client4cpp/src/kpr/ThreadLocal.h
deleted file mode 100644
index 9ec8f43f..00000000
--- a/rocketmq-client4cpp/src/kpr/ThreadLocal.h
+++ /dev/null
@@ -1,37 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_THREADLOCAL_H__
-#define __KPR_THREADLOCAL_H__
-
-#include "KPRTypes.h"
-
-namespace kpr
-{
-class ThreadLocal
-{
-public:
- ThreadLocal();
- virtual ~ThreadLocal();
-
- void* GetValue();
- void SetValue(void* value);
-
-private:
- ThreadKey m_Key;
-};
-};
-
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/ThreadPool.cpp b/rocketmq-client4cpp/src/kpr/ThreadPool.cpp
deleted file mode 100755
index 32557a86..00000000
--- a/rocketmq-client4cpp/src/kpr/ThreadPool.cpp
+++ /dev/null
@@ -1,418 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include "ThreadPool.h"
-
-#include "RocketMQClient.h"
-#include "ScopedLock.h"
-#include "KPRUtil.h"
-
-namespace kpr
-{
-ThreadPoolWorker:: ThreadPoolWorker(ThreadPool* pThreadPool, const char* strName)
- : kpr::Thread(strName),
- m_pThreadPool(pThreadPool),
- m_canWork(false),
- m_isWaiting(false),
- m_stop(false),
- m_idleTime(0),
- m_idle(true)
-{
-
-}
-
-bool ThreadPoolWorker::IsIdle()
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- return m_idle;
-}
-
-void ThreadPoolWorker:: SetIdle(bool idle)
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- m_idle = idle;
- m_idleTime = 0;
-}
-
-int ThreadPoolWorker::IdleTime(int idleTime)
-{
- if (m_idle)
- {
- m_idleTime += idleTime;
- }
- else
- {
- m_idleTime = 0;
- }
-
- return m_idleTime;
-}
-
-void ThreadPoolWorker::Run()
-{
- while (!m_stop)
- {
- SetIdle(true);
- {
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- while (!m_canWork)
- {
- try
- {
- m_isWaiting = true;
- Wait();
- m_isWaiting = false;
- }
- catch (...)
- {
- }
- }
-
- m_canWork = false;
- }
-
- while (!m_stop)
- {
- ThreadPoolWorkPtr request = m_pThreadPool->GetWork(this);
- if ((ThreadPoolWork*)(NULL) == request)
- {
- break;
- }
-
- SetIdle(false);
-
- try
- {
- request->Do();
- }
- catch(...)
- {
- RMQ_ERROR("thead[%s] doWork exception", GetName());
- }
-
- //delete request;
- request = NULL;
- }
-
- if (m_stop || m_pThreadPool->IsDestroy())
- {
- break;
- }
- }
-
- m_pThreadPool ->RemoveThread(this);
- m_pThreadPool = NULL;
-}
-
-void ThreadPoolWorker::WakeUp()
-{
- SetIdle(false);
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- m_canWork = true;
- Notify();
-}
-
-void ThreadPoolWorker::Stop()
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- m_canWork = true;
- m_stop = true;
- Notify();
-}
-
-bool ThreadPoolWorker:: IsWaiting()
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- return m_isWaiting;
-}
-
-ThreadPool::ThreadPool(const char* name,
- int count,
- int minCount,
- int maxCount,
- int step,
- int maxIdleTime,
- int checkldleThreadsInterval)
-{
- if (name == NULL)
- {
- snprintf(m_name, sizeof(m_name), "ThreadPool");
- }
- else
- {
- snprintf(m_name, sizeof(m_name), "%s", name);
- }
-
- m_destroy = false;
- m_minCount = minCount;
- m_maxCount = maxCount;
- m_maxIdleTime = maxIdleTime;
- m_count = 0;
- m_step = step;
- m_index = 0;
-
- m_lastRemoveIdleThreadsTime = KPRUtil::GetCurrentTimeMillis();
-
- if (m_minCount <= 0)
- {
- m_minCount = MIN_THREAD_COUNT;
- }
-
- if (m_maxCount < 0)
- {
- m_maxCount = MAX_THREAD_COUNT;
- }
-
- if (m_maxIdleTime < 0)
- {
- m_maxIdleTime = MAX_IDLE_THREAD_TIME;
- }
-
- if (m_maxCount != 0 && m_maxCount < m_minCount)
- {
- m_minCount = MIN_THREAD_COUNT;
- }
-
- if ((m_maxCount != 0 && count > m_maxCount) || count < m_minCount)
- {
- count = m_minCount;
- }
-
- if (checkldleThreadsInterval < 0)
- {
- checkldleThreadsInterval = CHECK_IDLE_THREADS_INTERVAL;
- }
-
- AddThreads(count);
-
- char manager_name[32];
- snprintf(manager_name, sizeof(manager_name), "%s-manager", m_name);
- m_manager = new ThreadPoolManage(manager_name, this, checkldleThreadsInterval);
- m_manager->Start();
-}
-
-ThreadPool::~ThreadPool()
-{
- Destroy();
-}
-
-void ThreadPool::AddThreads(int count)
-{
- char threadName[256];
-
- for (int i = 0; i < count; ++i)
- {
- snprintf(threadName, sizeof(threadName), "%s-Worker%d", m_name, m_index);
-
- try
- {
- ThreadPoolWorkerPtr worker = new ThreadPoolWorker(this, threadName);
- worker->Start();
-
- m_workers.push_back(worker);
- while (!worker->IsWaiting())
- {
- kpr::Thread::Sleep(0, 100000);
- }
-
- m_index++;
- m_count++;
- }
- catch (...)
- {
- RMQ_ERROR("ThreadPool thead[%s] new exception", threadName);
- }
- }
-}
-
-void ThreadPool::Destroy()
-{
- std::list<ThreadPoolWorkerPtr> workers;
- {
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- if (m_destroy)
- {
- return;
- }
-
- m_destroy = true;
-
- std::list<ThreadPoolWorkerPtr>::iterator iter;
- for (iter = m_workers.begin(); iter != m_workers.end(); iter++)
- {
- workers.push_back(*iter);
- (*iter)->Stop();
- }
- }
-
- m_manager->Stop();
- m_manager->Join();
-
- std::list<ThreadPoolWorkerPtr>::iterator itThread;
- for (itThread = workers.begin(); itThread != workers.end(); itThread++)
- {
- (*itThread)->Join();
- }
- m_works.clear();
-}
-
-int ThreadPool::AddWork(ThreadPoolWorkPtr pWork)
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- if (m_destroy)
- {
- return -1;
- }
-
- m_works.push_back(pWork);
-
- if (!WakeOneThread())
- {
- if (0 == m_maxCount || m_count < m_maxCount)
- {
- int step = m_step;
-
- if (0 < m_maxCount && m_count + m_step > m_maxCount)
- {
- step = m_maxCount - m_count;
- }
-
- AddThreads(step);
- WakeOneThread();
- }
- }
-
- return 0;
-}
-
-ThreadPoolWorkPtr ThreadPool::GetWork(ThreadPoolWorker* pWorker)
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- ThreadPoolWorkPtr result = NULL;
-
- if (!m_destroy && !m_works.empty())
- {
- result = m_works.front();
- m_works.pop_front();
- }
-
- return result;
-}
-
-bool ThreadPool::IsDestroy()
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- return m_destroy;
-}
-
-void ThreadPool::RemoveThread(ThreadPoolWorker* workerThread)
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
-
- std::list<ThreadPoolWorkerPtr>::iterator it = m_workers.begin();
-
- for (; it != m_workers.end(); it++)
- {
- if ((*it) == workerThread)
- {
- m_workers.erase(it);
- m_count--;
- break;
- }
- }
-}
-
-void ThreadPool::RemoveIdleThreads()
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
-
- if (m_maxIdleTime == 0)
- {
- return;
- }
-
- unsigned long long time = KPRUtil::GetCurrentTimeMillis();
- int interval = (int)(time - m_lastRemoveIdleThreadsTime);
- m_lastRemoveIdleThreadsTime = time;
-
- std::list<ThreadPoolWorkerPtr>::iterator it = m_workers.begin();
- int size = (int)m_workers.size();
- while (size > m_minCount && it != m_workers.end())
- {
- if ((*it)->IdleTime(interval) > m_maxIdleTime)
- {
- (*it)->Stop();
- size--;
- }
-
- it++;
- }
-}
-
-bool ThreadPool::WakeOneThread()
-{
- std::list<ThreadPoolWorkerPtr>::iterator it = m_workers.begin();
- for (; it != m_workers.end(); it++)
- {
- if ((*it)->IsIdle())
- {
- (*it)->WakeUp();
- return true;
- }
- }
-
- return false;
-}
-
-ThreadPoolManage::ThreadPoolManage(const char* name, ThreadPool* pThreadPool, int checkldleThreadsInterval)
- : kpr::Thread(name),
- m_pThreadPool(pThreadPool),
- m_stop(false),
- m_checkIdleThreadsInterval(checkldleThreadsInterval)
-{
-}
-
-ThreadPoolManage::~ThreadPoolManage()
-{
-}
-
-void ThreadPoolManage::Stop()
-{
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- m_stop = true;
- Notify();
-}
-
-void ThreadPoolManage::Run()
-{
- while (!m_stop)
- {
- {
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- if (!m_stop)
- {
- Wait(m_checkIdleThreadsInterval);
- }
-
- if (m_stop)
- {
- break;
- }
- }
-
- m_pThreadPool->RemoveIdleThreads();
- }
-}
-}
diff --git a/rocketmq-client4cpp/src/kpr/ThreadPool.h b/rocketmq-client4cpp/src/kpr/ThreadPool.h
deleted file mode 100755
index 2c7e3ff1..00000000
--- a/rocketmq-client4cpp/src/kpr/ThreadPool.h
+++ /dev/null
@@ -1,124 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_THREADPOOL_H__
-#define __KPR_THREADPOOL_H__
-
-#include<time.h>
-#include <assert.h>
-#include <list>
-#include "Mutex.h"
-#include "Thread.h"
-#include "Monitor.h"
-
-#include "ThreadPoolWork.h"
-
-namespace kpr
-{
-const int MAX_THREAD_COUNT = 300;
-const int MIN_THREAD_COUNT = 1;
-//const int MAX_IDLE_THREAD_TIME = 600000;
-const int MAX_IDLE_THREAD_TIME = 0;
-const int THREAD_STEP = 10;
-const int CHECK_IDLE_THREADS_INTERVAL = 30000;
-
-class ThreadPool;
-class ThreadPoolWorker : public kpr::Thread, public kpr::Monitor
-{
-public:
- ThreadPoolWorker(ThreadPool* pThreadPool, const char* strName);
-
- virtual void Run();
- void WakeUp();
- void Stop();
- bool IsWaiting();
- bool IsIdle();
- void SetIdle(bool idle);
- int IdleTime(int idleTime);
-
-private:
- ThreadPool* m_pThreadPool;
- bool m_canWork;
- bool m_isWaiting;
- bool m_stop;
- int m_idleTime;
- bool m_idle;
-};
-typedef kpr::RefHandleT<ThreadPoolWorker> ThreadPoolWorkerPtr;
-
-class ThreadPoolManage : public kpr::Thread, public kpr::Monitor
-{
-public:
- ThreadPoolManage(const char* name, ThreadPool* pThreadPool, int nCheckldleThreadsInterval);
-
- ~ThreadPoolManage();
- virtual void Run();
- void Stop();
-
-private:
- ThreadPool* m_pThreadPool;
- bool m_stop;
- int m_checkIdleThreadsInterval;
-};
-typedef kpr::RefHandleT<ThreadPoolManage> ThreadPoolManagePtr;
-
-
-class ThreadPool : public kpr::RefCount, public kpr::Monitor
-{
-public:
- ThreadPool(const char* name,
- int initCount,
- int minCount,
- int maxCount,
- int step = THREAD_STEP,
- int maxIdleTime = MAX_IDLE_THREAD_TIME,
- int checkldleThreadsInterval = CHECK_IDLE_THREADS_INTERVAL);
-
- ~ThreadPool();
- void Destroy();
-
- int AddWork(ThreadPoolWorkPtr pWork);
- ThreadPoolWorkPtr GetWork(ThreadPoolWorker* pWorker);
-
- void RemoveIdleThreads();
- void RemoveThread(ThreadPoolWorker* pWorker);
-
- bool WakeOneThread();
- bool IsDestroy();
-
-private:
- void AddThreads(int count);
-
-private:
- bool m_destroy;
- int m_minCount;
- int m_maxCount;
- int m_maxIdleTime;
- int m_count;
- int m_step;
-
- char m_name[128];
- unsigned int m_index;
- unsigned long long m_lastRemoveIdleThreadsTime;
-
- ThreadPoolManagePtr m_manager;
- std::list<ThreadPoolWorkPtr> m_works;
- std::list<ThreadPoolWorkerPtr> m_workers;
-};
-
-typedef kpr::RefHandleT<ThreadPool> ThreadPoolPtr;
-
-}
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/ThreadPoolWork.h b/rocketmq-client4cpp/src/kpr/ThreadPoolWork.h
deleted file mode 100644
index 30dfe6cf..00000000
--- a/rocketmq-client4cpp/src/kpr/ThreadPoolWork.h
+++ /dev/null
@@ -1,34 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __THREADPOOLWORK_H__
-#define __THREADPOOLWORK_H__
-
-#include "RefHandle.h"
-
-namespace kpr
-{
-
-class ThreadPoolWork : public kpr::RefCount
-{
-public:
- virtual ~ThreadPoolWork() {}
- virtual void Do() = 0;
-};
-typedef kpr::RefHandleT<ThreadPoolWork> ThreadPoolWorkPtr;
-
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/TimerTaskManager.cpp b/rocketmq-client4cpp/src/kpr/TimerTaskManager.cpp
deleted file mode 100755
index 42ef672c..00000000
--- a/rocketmq-client4cpp/src/kpr/TimerTaskManager.cpp
+++ /dev/null
@@ -1,91 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "TimerTaskManager.h"
-#include "ThreadPool.h"
-#include "ScopedLock.h"
-
-namespace kpr
-{
-TimerTaskManager::TimerTaskManager()
-{
-}
-
-TimerTaskManager::~TimerTaskManager()
-{
-}
-
-int TimerTaskManager::Init(int maxThreadCount, int checklnteval)
-{
- try
- {
- m_pThreadPool = new ThreadPool("TimerThreadPool", 5, 5, maxThreadCount);
- m_timerThread = new TimerThread("TimerThread", checklnteval);
- m_timerThread->Start();
- }
- catch (...)
- {
- return -1;
- }
-
- return 0;
-}
-
-unsigned int TimerTaskManager::RegisterTimer(unsigned int initialDelay, unsigned int elapse, TimerTaskPtr pTask)
-{
- unsigned int id = m_timerThread->RegisterTimer(initialDelay, elapse, this, true);
-
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- m_timerTasks[id] = pTask;
-
- return id;
-}
-
-bool TimerTaskManager::UnRegisterTimer(unsigned int timerId)
-{
- bool ret = m_timerThread->UnRegisterTimer(timerId);
-
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- m_timerTasks.erase(timerId);
-
- return ret;
-}
-
-bool TimerTaskManager::ResetTimer(unsigned int timerId)
-{
- return m_timerThread->ResetTimer(timerId);
-}
-
-void TimerTaskManager::OnTimeOut(unsigned int timerId)
-{
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- std::map<unsigned int, TimerTaskPtr>::iterator it = m_timerTasks.find(timerId);
- if (it != m_timerTasks.end())
- {
- if (!it->second->IsProcessing())
- {
- it->second->SetProcessing(true);
- m_pThreadPool->AddWork((it->second).ptr());
- }
- }
-}
-
-void TimerTaskManager::Stop()
-{
- m_timerThread->Stop();
- m_timerThread->Join();
- m_pThreadPool->Destroy();
-}
-}
diff --git a/rocketmq-client4cpp/src/kpr/TimerTaskManager.h b/rocketmq-client4cpp/src/kpr/TimerTaskManager.h
deleted file mode 100755
index b9cc2e01..00000000
--- a/rocketmq-client4cpp/src/kpr/TimerTaskManager.h
+++ /dev/null
@@ -1,95 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __KPR_TIMERTASKMANAGER_H__
-#define __KPR_TIMERTASKMANAGER_H__
-
-#include <list>
-#include <map>
-
-#include "RocketMQClient.h"
-#include "TimerThread.h"
-#include "ThreadPool.h"
-#include "ThreadPoolWork.h"
-
-namespace kpr
-{
-
-class TimerTask : public kpr::ThreadPoolWork
-{
-public:
- TimerTask()
- : m_isProcessing(false)
- {
- }
-
- virtual ~TimerTask()
- {
- }
-
- virtual void Do()
- {
- try
- {
- DoTask();
- }
- catch(...)
- {
- RMQ_ERROR("TimerTask exception");
- }
- m_isProcessing = false;
- }
-
- bool IsProcessing()
- {
- return m_isProcessing;
- }
-
- void SetProcessing(bool isProcessing)
- {
- m_isProcessing = isProcessing;
- }
-
- virtual void DoTask() = 0;
-
-private:
- bool m_isProcessing;
-};
-typedef kpr::RefHandleT<TimerTask> TimerTaskPtr;
-
-
-class TimerTaskManager : public TimerHandler
-{
-public:
- TimerTaskManager();
- virtual ~TimerTaskManager();
-
- int Init(int maxThreadCount, int checklnteval);
- unsigned int RegisterTimer(unsigned int initialDelay, unsigned int elapse, TimerTaskPtr pTask);
- bool UnRegisterTimer(unsigned int timerId);
- bool ResetTimer(unsigned int timerId);
- void Stop();
-
- virtual void OnTimeOut(unsigned int timerId);
-
-private:
- std::map<unsigned int, TimerTaskPtr> m_timerTasks;
- kpr::Mutex m_mutex;
- TimerThreadPtr m_timerThread;
- kpr::ThreadPoolPtr m_pThreadPool;
-};
-
-}
-#endif
diff --git a/rocketmq-client4cpp/src/kpr/TimerThread.cpp b/rocketmq-client4cpp/src/kpr/TimerThread.cpp
deleted file mode 100755
index b127074f..00000000
--- a/rocketmq-client4cpp/src/kpr/TimerThread.cpp
+++ /dev/null
@@ -1,186 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "TimerThread.h"
-#include "KPRUtil.h"
-#include "ScopedLock.h"
-
-namespace kpr
-{
-unsigned int TimerThread::s_nextTimerID = 0;
-
-TimerThread::TimerThread(const char* name, unsigned int checklnterval)
- : kpr::Thread(name), m_closed(false), m_checkInterval(checklnterval)
-{
-}
-
-TimerThread::~TimerThread()
-{
-}
-
-void TimerThread::Run()
-{
- unsigned long long lastCheckTime = KPRUtil::GetCurrentTimeMillis();
- unsigned long long currentCheckTime = lastCheckTime;
-
- while (!m_closed)
- {
- currentCheckTime = KPRUtil::GetCurrentTimeMillis();
- unsigned int elapse = (unsigned int)(currentCheckTime - lastCheckTime);
-
- std::list<TimerInfo> timeList;
-
- CheckTimeOut(elapse, timeList);
-
- if (!timeList.empty())
- {
- std::list<TimerInfo>::iterator it = timeList.begin();
- for (; it != timeList.end(); it++)
- {
- try
- {
- it->pTimerHandler->OnTimeOut(it->id);
- }
- catch(...)
- {
- RMQ_ERROR("TimerThread[%s] OnTimeOut exception", GetName());
- }
- }
- }
-
- unsigned long long checkEndTime = KPRUtil::GetCurrentTimeMillis();
- int sleepTime = m_checkInterval - (int)(checkEndTime - currentCheckTime);
- if (sleepTime < 0)
- {
- sleepTime = 0;
- }
-
- lastCheckTime = currentCheckTime;
-
- try
- {
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- Wait(sleepTime);
- }
- catch (...)
- {
- }
- }
-}
-
-void TimerThread::Stop()
-{
- m_closed = true;
- kpr::ScopedLock<kpr::Monitor> lock(*this);
- Notify();
-}
-
-unsigned int TimerThread::RegisterTimer(unsigned int initialDelay, unsigned int elapse, TimerHandler* pHandler, bool persistent)
-{
- TimerInfo info;
- info.elapse = elapse;
- info.outTime = elapse - initialDelay;
- info.pTimerHandler = pHandler;
- info.persistent = persistent;
-
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- info.id = GetNextTimerID();
- m_timers[info.id] = info;
-
- return info.id;
-}
-
-bool TimerThread::UnRegisterTimer(unsigned int timerId)
-{
- bool result = false;
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- std::map<unsigned int, TimerInfo>::iterator it = m_timers.find(timerId);
- if (it != m_timers.end())
- {
- m_timers.erase(it);
- result = true;
- }
-
- return result;
-}
-
-bool TimerThread::ResetTimer(unsigned int timerId)
-{
- bool result = false;
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- std::map<unsigned int, TimerInfo>::iterator it = m_timers.find(timerId);
- if (it != m_timers.end())
- {
- if (it->second.persistent)
- {
- it->second.outTime = it->second.elapse;
- }
- else
- {
- it->second.outTime = 0;
- }
-
- result = true;
- }
-
- return result;
-}
-
-bool TimerThread::CheckTimeOut(unsigned int elapse, std::list<TimerInfo>& timerList)
-{
- bool result = false;
- timerList.clear();
-
- kpr::ScopedLock<kpr::Mutex> lock(m_mutex);
- if (!m_timers.empty())
- {
- std::map<unsigned int, TimerInfo>::iterator it = m_timers.begin();
- while (it != m_timers.end())
- {
- it->second.outTime += elapse;
-
- if (it->second.outTime >= int(it->second.elapse))
- {
- timerList.push_back(it->second);
-
- if (it->second.persistent)
- {
- it->second.outTime = 0;
- ++it;
- }
- else
- {
- std::map<unsigned int, TimerInfo>::iterator it1 = it;
- ++it;
- m_timers.erase(it1);
- }
- }
- else
- {
- ++it;
- }
- }
-
- result = true;
- }
-
- return result;
-}
-
-unsigned int TimerThread::GetNextTimerID()
-{
- return ++s_nextTimerID;
-}
-}
diff --git a/rocketmq-client4cpp/src/kpr/TimerThread.h b/rocketmq-client4cpp/src/kpr/TimerThread.h
deleted file mode 100755
index 7e02a790..00000000
--- a/rocketmq-client4cpp/src/kpr/TimerThread.h
+++ /dev/null
@@ -1,79 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __KPR_TIMERTHREAD_H__
-#define __KPR_TIMERTHREAD_H__
-
-#include <list>
-#include <map>
-
-#include "RocketMQClient.h"
-#include "Thread.h"
-#include "Mutex.h"
-#include "Monitor.h"
-
-namespace kpr
-{
-class TimerHandler
-{
-public:
- TimerHandler()
- {
- }
-
- virtual ~TimerHandler()
- {
- }
-
- virtual void OnTimeOut(unsigned int timerID) = 0;
-};
-
-typedef struct tagTimerlnfo
-{
- unsigned int id;
- unsigned int elapse;
- int outTime;
- bool persistent;
- TimerHandler* pTimerHandler;
-} TimerInfo;
-
-
-class TimerThread : public kpr::Thread, public kpr::Monitor
-{
-public:
- TimerThread(const char* name, unsigned int checklnterval);
- virtual ~TimerThread();
- virtual void Run();
- virtual void Stop();
-
- virtual unsigned int RegisterTimer(unsigned int initialDelay, unsigned int elapse, TimerHandler* pHandler, bool persistent = true);
- virtual bool UnRegisterTimer(unsigned int timerId);
- virtual bool ResetTimer(unsigned int timerId);
-
-private:
- bool CheckTimeOut(unsigned int elapse, std::list<TimerInfo>& timerList);
- static unsigned int GetNextTimerID();
-
-private:
- static unsigned int s_nextTimerID;
- std::map<unsigned int, TimerInfo> m_timers;
- kpr::Mutex m_mutex;
- bool m_closed;
- unsigned int m_checkInterval;
-};
-typedef kpr::RefHandleT<TimerThread> TimerThreadPtr;
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/message/Message.cpp b/rocketmq-client4cpp/src/message/Message.cpp
deleted file mode 100755
index db88c3e0..00000000
--- a/rocketmq-client4cpp/src/message/Message.cpp
+++ /dev/null
@@ -1,379 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#include "Message.h"
-
-#include <string.h>
-#include <stdlib.h>
-#include <stdio.h>
-#include "UtilAll.h"
-
-
-namespace rmq
-{
-
-const std::string Message::PROPERTY_KEYS = "KEYS";
-const std::string Message::PROPERTY_TAGS = "TAGS";
-const std::string Message::PROPERTY_WAIT_STORE_MSG_OK = "WAIT";
-const std::string Message::PROPERTY_DELAY_TIME_LEVEL = "DELAY";
-const std::string Message::PROPERTY_RETRY_TOPIC = "RETRY_TOPIC";
-const std::string Message::PROPERTY_REAL_TOPIC = "REAL_TOPIC";
-const std::string Message::PROPERTY_REAL_QUEUE_ID = "REAL_QID";
-const std::string Message::PROPERTY_TRANSACTION_PREPARED = "TRAN_MSG";
-const std::string Message::PROPERTY_PRODUCER_GROUP = "PGROUP";
-const std::string Message::PROPERTY_MIN_OFFSET = "MIN_OFFSET";
-const std::string Message::PROPERTY_MAX_OFFSET = "MAX_OFFSET";
-const std::string Message::PROPERTY_BUYER_ID = "BUYER_ID";
-const std::string Message::PROPERTY_ORIGIN_MESSAGE_ID = "ORIGIN_MESSAGE_ID";
-const std::string Message::PROPERTY_TRANSFER_FLAG = "TRANSFER_FLAG";
-const std::string Message::PROPERTY_CORRECTION_FLAG = "CORRECTION_FLAG";
-const std::string Message::PROPERTY_MQ2_FLAG = "MQ2_FLAG";
-const std::string Message::PROPERTY_RECONSUME_TIME = "RECONSUME_TIME";
-const std::string Message::PROPERTY_MSG_REGION = "MSG_REGION";
-const std::string Message::PROPERTY_UNIQ_CLIENT_MESSAGE_ID_KEYIDX = "UNIQ_KEY";
-const std::string Message::PROPERTY_MAX_RECONSUME_TIMES = "MAX_RECONSUME_TIMES";
-const std::string Message::PROPERTY_CONSUME_START_TIMESTAMP = "CONSUME_START_TIME";
-const std::string Message::KEY_SEPARATOR = " ";
-
-Message::Message()
-{
- Init("", "", "", 0, NULL, 0, true);
-}
-
-Message::Message(const std::string& topic, const char* body, int len)
-{
- Init(topic, "", "", 0, body, len, true);
-}
-
-Message::Message(const std::string& topic, const std::string& tags, const char* body, int len)
-{
- Init(topic, tags, "", 0, body, len, true);
-}
-
-Message::Message(const std::string& topic, const std::string& tags, const std::string& keys, const char* body, int len)
-{
- Init(topic, tags, keys, 0, body, len, true);
-}
-
-Message::Message(const std::string& topic,
- const std::string& tags,
- const std::string& keys,
- const int flag,
- const char* body,
- int len,
- bool waitStoreMsgOK)
-{
- Init(topic, tags, keys, flag, body, len, waitStoreMsgOK);
-}
-
-Message::~Message()
-{
- if (m_body)
- {
- free(m_body);
- m_body = NULL;
- m_bodyLen = 0;
- }
-
- if (m_compressBody)
- {
- free(m_compressBody);
- m_compressBody = NULL;
- m_compressBodyLen = 0;
- }
-}
-
-Message::Message(const Message& other)
-{
- m_body = (char*)malloc(other.m_bodyLen);
- m_bodyLen = other.m_bodyLen;
- memcpy(m_body, other.m_body, other.m_bodyLen);
-
- m_compressBody = NULL;
- m_compressBodyLen = 0;
-
- m_topic = other.m_topic;
- m_flag = other.m_flag;
- m_properties = other.m_properties;
-}
-
-Message& Message::operator=(const Message& other)
-{
- if (this != &other)
- {
- if (m_body)
- {
- free(m_body);
- m_body = NULL;
- m_bodyLen = 0;
- }
-
- if (m_compressBody)
- {
- free(m_compressBody);
- m_compressBody = NULL;
- m_compressBodyLen = 0;
- }
-
- m_body = (char*)malloc(other.m_bodyLen);;
- m_bodyLen = other.m_bodyLen;
- memcpy(m_body, other.m_body, other.m_bodyLen);
-
- m_topic = other.m_topic;
- m_flag = other.m_flag;
- m_properties = other.m_properties;
- }
-
- return *this;
-}
-
-void Message::clearProperty(const std::string& name)
-{
- m_properties.erase(name);
-}
-
-void Message::putProperty(const std::string& name, const std::string& value)
-{
- m_properties[name] = value;
-}
-
-std::string Message::getProperty(const std::string& name)
-{
- std::map<std::string, std::string>::const_iterator it = m_properties.find(name);
- return (it == m_properties.end()) ? "" : it->second;
-}
-
-std::string Message::getTopic()const
-{
- return m_topic;
-}
-
-void Message::setTopic(const std::string& topic)
-{
- m_topic = topic;
-}
-
-std::string Message::getTags()
-{
- return getProperty(PROPERTY_TAGS);
-}
-
-void Message::setTags(const std::string& tags)
-{
- putProperty(PROPERTY_TAGS, tags);
-}
-
-std::string Message::getKeys()
-{
- return getProperty(PROPERTY_KEYS);
-}
-
-void Message::setKeys(const std::string& keys)
-{
- putProperty(PROPERTY_KEYS, keys);
-}
-
-void Message::setKeys(const std::list<std::string> keys)
-{
- if (keys.empty())
- {
- return;
- }
-
- std::list<std::string>::const_iterator it = keys.begin();
- std::string str;
- str += *it;
- it++;
-
- for (; it != keys.end(); it++)
- {
- str += KEY_SEPARATOR;
- str += *it;
- }
-
- setKeys(str);
-}
-
-int Message::getDelayTimeLevel()
-{
- std::string tmp = getProperty(PROPERTY_DELAY_TIME_LEVEL);
- if (!tmp.empty())
- {
- return atoi(tmp.c_str());
- }
-
- return 0;
-}
-
-void Message::setDelayTimeLevel(int level)
-{
- char tmp[16];
- snprintf(tmp, sizeof(tmp), "%d", level);
-
- putProperty(PROPERTY_DELAY_TIME_LEVEL, tmp);
-}
-
-bool Message::isWaitStoreMsgOK()
-{
- std::string tmp = getProperty(PROPERTY_WAIT_STORE_MSG_OK);
- if (tmp.empty())
- {
- return true;
- }
- else
- {
- return (tmp == "true") ? true : false;
- }
-}
-
-void Message::setWaitStoreMsgOK(bool waitStoreMsgOK)
-{
- if (waitStoreMsgOK)
- {
- putProperty(PROPERTY_WAIT_STORE_MSG_OK, "true");
- }
- else
- {
- putProperty(PROPERTY_WAIT_STORE_MSG_OK, "false");
- }
-}
-
-int Message::getFlag()
-{
- return m_flag;
-}
-
-void Message::setFlag(int flag)
-{
- m_flag = flag;
-}
-
-const char* Message::getBody()const
-{
- return m_body;
-}
-
-int Message::getBodyLen()const
-{
- return m_bodyLen;
-}
-
-void Message::setBody(const char* body, int len)
-{
- if (len > 0)
- {
- if (m_body)
- {
- free(m_body);
- m_body = NULL;
- m_bodyLen = 0;
- }
-
- m_body = (char*)malloc(len);
- m_bodyLen = len;
- memcpy(m_body, body, len);
- }
-}
-
-bool Message::tryToCompress(int compressLevel)
-{
- if (m_body != NULL)
- {
- if (m_compressBody)
- {
- free(m_compressBody);
- m_compressBody = NULL;
- m_compressBodyLen = 0;
- }
-
- unsigned char* pOut;
- int outLen = 0;
- if (UtilAll::compress(m_body, m_bodyLen, &pOut, &outLen, compressLevel))
- {
- m_compressBody = (char*)pOut;
- m_compressBodyLen = outLen;
- return true;
- }
- }
-
- return false;
-}
-
-
-const char* Message::getCompressBody() const
-{
- return m_compressBody;
-}
-
-int Message::getCompressBodyLen() const
-{
- return m_compressBodyLen;
-}
-
-
-
-std::map<std::string, std::string>& Message::getProperties()
-{
- return m_properties;
-}
-
-void Message::setProperties(const std::map<std::string, std::string>& properties)
-{
- m_properties = properties;
-}
-
-void Message::Init(const std::string& topic, const std::string& tags, const std::string& keys, const int flag, const char* body, int len, bool waitStoreMsgOK)
-{
- m_topic = topic;
- m_flag = flag;
-
- m_body = NULL;
- m_bodyLen = len;
-
- m_compressBody = NULL;
- m_compressBodyLen = 0;
-
- if (len > 0)
- {
- m_body = (char*)malloc(len);
- memcpy(m_body, body, len);
- }
-
- if (tags.length() > 0)
- {
- setTags(tags);
- }
-
- if (keys.length() > 0)
- {
- setKeys(keys);
- }
-
- setWaitStoreMsgOK(waitStoreMsgOK);
-}
-
-std::string Message::toString() const
-{
- std::stringstream ss;
- ss << "{m_topic=" << m_topic
- << ",m_flag=" << m_flag
- << ",properties=" << UtilAll::toString(m_properties)
- << ",m_bodyLen=" << m_bodyLen
- << "}";
- return ss.str();
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/message/MessageDecoder.cpp b/rocketmq-client4cpp/src/message/MessageDecoder.cpp
deleted file mode 100755
index 338121ef..00000000
--- a/rocketmq-client4cpp/src/message/MessageDecoder.cpp
+++ /dev/null
@@ -1,366 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "MessageDecoder.h"
-
-#include <string.h>
-#include <stdio.h>
-#include <stdlib.h>
-#include <sstream>
-#include "MessageExt.h"
-#include "MessageSysFlag.h"
-#include "UtilAll.h"
-
-namespace rmq
-{
-
-const char MessageDecoder::NAME_VALUE_SEPARATOR = 1;
-const char MessageDecoder::PROPERTY_SEPARATOR = 2;
-const int MessageDecoder::MSG_ID_LENGTH = 8 + 8;
-
-int MessageDecoder::MessageMagicCodePostion = 4;
-int MessageDecoder::MessageFlagPostion = 16;
-int MessageDecoder::MessagePhysicOffsetPostion = 28;
-int MessageDecoder::MessageStoreTimestampPostion = 56;
-
-std::string MessageDecoder::createMessageId(sockaddr& addr, long long offset)
-{
- struct sockaddr_in sa;
- memcpy(&sa, &addr, sizeof(sockaddr));
- sa.sin_family = AF_INET;
-
- int port = ntohs(sa.sin_port);
- port = htonl(port);
- int ip = sa.sin_addr.s_addr;
-
- unsigned char* buf = new unsigned char[MSG_ID_LENGTH];
- offset = h2nll(offset);
- memcpy(buf, &ip, 4);
- memcpy(buf + 4, &port, 4);
- memcpy(buf + 8, &offset, 8);
-
- char* str = new char[2 * MSG_ID_LENGTH + 1];
- memset(str, 0, 2 * MSG_ID_LENGTH + 1);
-
- for (int i = 0; i < MSG_ID_LENGTH; i++)
- {
- char tmp[3];
- tmp[2] = 0;
-
- snprintf(tmp, sizeof(tmp), "%02X", buf[i]);
- strncat(str, tmp, sizeof(tmp));
- }
-
- std::string ret = str;
-
- delete[] buf;
- delete[] str;
-
- return ret;
-}
-
-MessageId MessageDecoder::decodeMessageId(const std::string& msgId)
-{
- std::string ipstr = msgId.substr(0, 8);
- std::string portstr = msgId.substr(8, 8);
- std::string offsetstr = msgId.substr(16);
-
- char* end;
- int ipint = strtoul(ipstr.c_str(), &end, 16);
- int portint = strtoul(portstr.c_str(), &end, 16);
-
- long long offset = UtilAll::hexstr2ull(offsetstr.c_str());
-
- offset = n2hll(offset);
-
- portint = ntohl(portint);
- short port = portint;
-
- struct sockaddr_in sa;
- sa.sin_family = AF_INET;
- sa.sin_port = htons(port);
- sa.sin_addr.s_addr = ipint;
-
- sockaddr addr;
- memcpy(&addr, &sa, sizeof(sockaddr));
-
- MessageId id(addr, offset);
-
- return id;
-}
-
-MessageExt* MessageDecoder::decode(const char* pData, int len, int& offset)
-{
- return decode(pData, len, offset, true);
-}
-
-MessageExt* MessageDecoder::decode(const char* pData, int len, int& offset, bool readBody)
-{
- MessageExt* msgExt = NULL;
-
- try
- {
- msgExt = new MessageExt();
-
- // 1 TOTALSIZE
- int storeSize;
- memcpy(&storeSize, pData, 4);
- storeSize = ntohl(storeSize);
-
- msgExt->setStoreSize(storeSize);
-
- // 2 MAGICCODE sizeof(int)
-
- // 3 BODYCRC
- int bodyCRC;
- memcpy(&bodyCRC, pData + 2 * sizeof(int), 4);
- bodyCRC = ntohl(bodyCRC);
- msgExt->setBodyCRC(bodyCRC);
-
- // 4 QUEUEID
- int queueId;
- memcpy(&queueId, pData + 3 * sizeof(int), 4);
- queueId = ntohl(queueId);
- msgExt->setQueueId(queueId);
-
- // 5 FLAG
- int flag ;
-
- memcpy(&flag, pData + 4 * sizeof(int), 4);
- flag = ntohl(flag);
-
- msgExt->setFlag(flag);
-
- // 6 QUEUEOFFSET
- long long queueOffset;
- memcpy(&queueOffset, pData + 5 * sizeof(int), 8);
- queueOffset = n2hll(queueOffset);
- msgExt->setQueueOffset(queueOffset);
-
- // 7 PHYSICALOFFSET
- long long physicOffset;
-
- memcpy(&physicOffset, pData + 7 * sizeof(int), 8);
- physicOffset = n2hll(physicOffset);
- msgExt->setCommitLogOffset(physicOffset);
-
- // 8 SYSFLAG
- int sysFlag;
-
- memcpy(&sysFlag, pData + 9 * sizeof(int), 4);
- sysFlag = ntohl(sysFlag);
- msgExt->setSysFlag(sysFlag);
-
- // 9 BORNTIMESTAMP
- long long bornTimeStamp;
- memcpy(&bornTimeStamp, pData + 10 * sizeof(int), 8);
- bornTimeStamp = n2hll(bornTimeStamp);
-
- msgExt->setBornTimestamp(bornTimeStamp);
-
- // 10 BORNHOST
- int bornHost;//c0 a8 00 68 192.168.0.104 c0 a8 00 68 00 00 c4 04
- memcpy(&bornHost, pData + 12 * sizeof(int), 4);
-
- int port;
- memcpy(&port, pData + 13 * sizeof(int), 4);
- port = ntohl(port);
-
- struct sockaddr_in sa;
- sa.sin_family = AF_INET;
- sa.sin_port = htons(port);
- sa.sin_addr.s_addr = bornHost;
-
- sockaddr bornAddr;
- memcpy(&bornAddr, &sa, sizeof(sockaddr));
- msgExt->setBornHost(bornAddr);
-
- // 11 STORETIMESTAMP
- long long storeTimestamp;
- memcpy(&storeTimestamp, pData + 14 * sizeof(int), 8);
- storeTimestamp = n2hll(storeTimestamp);
- msgExt->setStoreTimestamp(storeTimestamp);
-
- // 12 STOREHOST
- int storeHost;
- memcpy(&storeHost, pData + 16 * sizeof(int), 4);
- memcpy(&port, pData + 17 * sizeof(int), 4);
- port = ntohl(port);
-
- sa.sin_family = AF_INET;
- sa.sin_port = htons(port);
- sa.sin_addr.s_addr = storeHost;
-
- sockaddr storeAddr;
- memcpy(&storeAddr, &sa, sizeof(sockaddr));
-
- msgExt->setStoreHost(storeAddr);
-
- // 13 RECONSUMETIMES
- int reconsumeTimes;
- memcpy(&reconsumeTimes, pData + 18 * sizeof(int), 4);
- reconsumeTimes = ntohl(reconsumeTimes);
- msgExt->setReconsumeTimes(reconsumeTimes);
-
- // 14 Prepared Transaction Offset
- long long preparedTransactionOffset;
- memcpy(&preparedTransactionOffset, pData + 19 * sizeof(int), 8);
- preparedTransactionOffset = n2hll(preparedTransactionOffset);
- msgExt->setPreparedTransactionOffset(preparedTransactionOffset);
-
- // 15 BODY
- int bodyLen = 0;
- memcpy(&bodyLen, pData + 21 * sizeof(int), 4);
- bodyLen = ntohl(bodyLen);
-
- if (bodyLen > 0)
- {
- if (readBody)
- {
- const char* body = pData + 22 * sizeof(int);
- int newBodyLen = bodyLen;
-
- // uncompress body
- if ((sysFlag & MessageSysFlag::CompressedFlag) == MessageSysFlag::CompressedFlag)
- {
- unsigned char* pOut;
- int outLen;
-
- if (UtilAll::decompress(body, bodyLen, &pOut, &outLen))
- {
- msgExt->setBody((char*)pOut, outLen);
- free(pOut);
- }
- else
- {
- msgExt->setBody(body, newBodyLen);
- }
- }
- else
- {
- msgExt->setBody(body, newBodyLen);
- }
- }
- else
- {
-
- }
- }
-
- // 16 TOPIC
- int topicLen = *(pData + 22 * sizeof(int) + bodyLen);
-
- char* tmp = new char[topicLen + 1];
-
- memcpy(tmp, pData + 22 * sizeof(int) + bodyLen + 1, topicLen);
- tmp[topicLen] = 0;
- std::string topic = tmp;
-
- delete[] tmp;
-
- msgExt->setTopic(topic);
-
- // 17 properties
- short propertiesLength;
- memcpy(&propertiesLength, pData + 22 * sizeof(int) + bodyLen + 1 + topicLen, 2);
- propertiesLength = ntohs(propertiesLength);
-
- if (propertiesLength > 0)
- {
- char* properties = new char[propertiesLength + 1];
- memcpy(properties, pData + 22 * sizeof(int) + bodyLen + 1 + topicLen + 2, propertiesLength);
- properties[propertiesLength] = 0;
- std::string propertiesString = properties;
- std::map<std::string, std::string> map;
- string2messageProperties(map, propertiesString);
- msgExt->setProperties(map);
- delete[] properties;
- }
-
- offset = 22 * sizeof(int) + bodyLen + 1 + topicLen + 2 + propertiesLength;
-
- // ��ϢID
- std::string msgId = createMessageId(storeAddr, physicOffset);
- msgExt->setMsgId(msgId);
-
- return msgExt;
- }
- catch (...)
- {
- RMQ_ERROR("decode exception");
- if (msgExt)
- {
- delete msgExt;
- msgExt = NULL;
- }
- }
-
- return NULL;
-}
-
-std::list<MessageExt*> MessageDecoder::decodes(const char* pData, int len)
-{
- return decodes(pData, len, true);
-}
-
-std::list<MessageExt*> MessageDecoder::decodes(const char* pData, int len, bool readBody)
-{
- std::list<MessageExt*> list;
-
- int offset = 0;
- while (offset < len)
- {
- int tmp;
- MessageExt* msg = decode(pData + offset, len, tmp);
- list.push_back(msg);
- offset += tmp;
- }
-
- return list;
-}
-
-std::string MessageDecoder::messageProperties2String(const std::map<std::string, std::string>& properties)
-{
- std::stringstream ss;
-
- std::map<std::string, std::string>::const_iterator it = properties.begin();
-
- for (; it != properties.end(); it++)
- {
- ss << it->first << NAME_VALUE_SEPARATOR << it->second << PROPERTY_SEPARATOR;
- }
-
- return ss.str();
-}
-
-void MessageDecoder::string2messageProperties(std::map<std::string, std::string>& properties,
- std::string& propertiesString)
-{
- std::vector<std::string> out;
- UtilAll::Split(out, propertiesString, PROPERTY_SEPARATOR);
-
- for (size_t i = 0; i < out.size(); i++)
- {
- std::vector<std::string> outValue;
- UtilAll::Split(outValue, out[i], NAME_VALUE_SEPARATOR);
-
- if (outValue.size() == 2)
- {
- properties[outValue[0]] = outValue[1];
- }
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/message/MessageDecoder.h b/rocketmq-client4cpp/src/message/MessageDecoder.h
deleted file mode 100755
index a5f24ed5..00000000
--- a/rocketmq-client4cpp/src/message/MessageDecoder.h
+++ /dev/null
@@ -1,64 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __MESSAGEDECODER_H__
-#define __MESSAGEDECODER_H__
-
-#include <string>
-#include <list>
-#include <map>
-
-#include "SocketUtil.h"
-#include "MessageId.h"
-
-namespace rmq
-{
- class MessageExt;
- class UnknownHostException;
-
- /**
- * Message decoder
- *
- */
- class MessageDecoder
- {
- public:
- static std::string createMessageId(sockaddr& addr, long long offset);
- static MessageId decodeMessageId(const std::string& msgId);
-
- static MessageExt* decode(const char* pData, int len, int& offset);
- static MessageExt* decode(const char* pData, int len, int& offset, bool readBody);
-
- static std::list<MessageExt*> decodes(const char* pData, int len);
- static std::list<MessageExt*> decodes(const char* pData, int len, bool readBody);
-
- static std::string messageProperties2String(const std::map<std::string, std::string>& properties);
- static void string2messageProperties(std::map<std::string, std::string>& properties,
- std::string& propertiesString);
-
- public:
- static const char NAME_VALUE_SEPARATOR;
- static const char PROPERTY_SEPARATOR;
-
- static const int MSG_ID_LENGTH;
-
- static int MessageMagicCodePostion;
- static int MessageFlagPostion;
- static int MessagePhysicOffsetPostion;
- static int MessageStoreTimestampPostion;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/message/MessageExt.cpp b/rocketmq-client4cpp/src/message/MessageExt.cpp
deleted file mode 100755
index 35479cea..00000000
--- a/rocketmq-client4cpp/src/message/MessageExt.cpp
+++ /dev/null
@@ -1,244 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "MessageExt.h"
-
-#include <sstream>
-#include "MessageSysFlag.h"
-#include "SocketUtil.h"
-
-namespace rmq
-{
-
-MessageExt::MessageExt()
- : m_queueOffset(0),
- m_commitLogOffset(0),
- m_bornTimestamp(0),
- m_storeTimestamp(0),
- m_preparedTransactionOffset(0),
- m_queueId(0),
- m_storeSize(0),
- m_sysFlag(0),
- m_bodyCRC(0),
- m_reconsumeTimes(3),
- m_msgId("")
-{
-}
-
-MessageExt::MessageExt(int queueId,
- long long bornTimestamp,
- sockaddr bornHost,
- long long storeTimestamp,
- sockaddr storeHost,
- std::string msgId)
- : m_queueOffset(0),
- m_commitLogOffset(0),
- m_bornTimestamp(bornTimestamp),
- m_storeTimestamp(storeTimestamp),
- m_preparedTransactionOffset(0),
- m_queueId(queueId),
- m_storeSize(0),
- m_sysFlag(0),
- m_bodyCRC(0),
- m_reconsumeTimes(3),
- m_bornHost(bornHost),
- m_storeHost(storeHost),
- m_msgId(msgId)
-{
-
-}
-
-MessageExt::~MessageExt()
-{
-
-}
-
-int MessageExt::getQueueId()
-{
- return m_queueId;
-}
-
-void MessageExt::setQueueId(int queueId)
-{
- m_queueId = queueId;
-}
-
-long long MessageExt::getBornTimestamp()
-{
- return m_bornTimestamp;
-}
-
-void MessageExt::setBornTimestamp(long long bornTimestamp)
-{
- m_bornTimestamp = bornTimestamp;
-}
-
-sockaddr MessageExt::getBornHost()
-{
- return m_bornHost;
-}
-
-std::string MessageExt::getBornHostString()
-{
- return socketAddress2String(m_bornHost);
-}
-
-std::string MessageExt::getBornHostNameString()
-{
- return getHostName(m_bornHost);
-}
-
-void MessageExt::setBornHost(const sockaddr& bornHost)
-{
- m_bornHost = bornHost;
-}
-
-long long MessageExt::getStoreTimestamp()
-{
- return m_storeTimestamp;
-}
-
-void MessageExt::setStoreTimestamp(long long storeTimestamp)
-{
- m_storeTimestamp = storeTimestamp;
-}
-
-sockaddr MessageExt::getStoreHost()
-{
- return m_storeHost;
-}
-
-std::string MessageExt::getStoreHostString()
-{
- return socketAddress2String(m_storeHost);
-}
-
-void MessageExt::setStoreHost(const sockaddr& storeHost)
-{
- m_storeHost = storeHost;
-}
-
-std::string MessageExt::getMsgId()
-{
- return m_msgId;
-}
-
-void MessageExt::setMsgId(const std::string& msgId)
-{
- m_msgId = msgId;
-}
-
-int MessageExt::getSysFlag()
-{
- return m_sysFlag;
-}
-
-void MessageExt::setSysFlag(int sysFlag)
-{
- m_sysFlag = sysFlag;
-}
-
-int MessageExt::getBodyCRC()
-{
- return m_bodyCRC;
-}
-
-void MessageExt::setBodyCRC(int bodyCRC)
-{
- m_bodyCRC = bodyCRC;
-}
-
-long long MessageExt::getQueueOffset()
-{
- return m_queueOffset;
-}
-
-void MessageExt::setQueueOffset(long long queueOffset)
-{
- m_queueOffset = queueOffset;
-}
-
-long long MessageExt::getCommitLogOffset()
-{
- return m_commitLogOffset;
-}
-
-void MessageExt::setCommitLogOffset(long long physicOffset)
-{
- m_commitLogOffset = physicOffset;
-}
-
-int MessageExt::getStoreSize()
-{
- return m_storeSize;
-}
-
-void MessageExt::setStoreSize(int storeSize)
-{
- m_storeSize = storeSize;
-}
-
-TopicFilterType MessageExt::parseTopicFilterType(int sysFlag)
-{
- if ((sysFlag & MessageSysFlag::MultiTagsFlag) == MessageSysFlag::MultiTagsFlag)
- {
- return MULTI_TAG;
- }
-
- return SINGLE_TAG;
-}
-
-int MessageExt::getReconsumeTimes()
-{
- return m_reconsumeTimes;
-}
-
-void MessageExt::setReconsumeTimes(int reconsumeTimes)
-{
- m_reconsumeTimes = reconsumeTimes;
-}
-
-long long MessageExt::getPreparedTransactionOffset()
-{
- return m_preparedTransactionOffset;
-}
-
-void MessageExt::setPreparedTransactionOffset(long long preparedTransactionOffset)
-{
- m_preparedTransactionOffset = preparedTransactionOffset;
-}
-
-std::string MessageExt::toString() const
-{
- std::stringstream ss;
- ss << "{msgId=" << m_msgId
- << ",queueId=" << m_queueId
- << ",storeSize=" << m_storeSize
- << ",sysFlag=" << m_sysFlag
- << ",queueOffset=" << m_queueOffset
- << ",commitLogOffset=" << m_commitLogOffset
- << ",preparedTransactionOffset=" << m_preparedTransactionOffset
- << ",bornTimestamp=" << m_bornTimestamp
- << ",bornHost=" << socketAddress2String(m_bornHost)
- << ",storeHost=" << socketAddress2String(m_storeHost)
- << ",storeTimestamp=" << m_storeTimestamp
- << ",reconsumeTimes=" << m_reconsumeTimes
- << ",bodyCRC=" << m_bodyCRC
- << ",Message=" << Message::toString()
- << "}";
- return ss.str();
-}
-
-}
diff --git a/rocketmq-client4cpp/src/message/MessageId.h b/rocketmq-client4cpp/src/message/MessageId.h
deleted file mode 100644
index 5237f8d5..00000000
--- a/rocketmq-client4cpp/src/message/MessageId.h
+++ /dev/null
@@ -1,59 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MESSAGEID_H__
-#define __MESSAGEID_H__
-
-#include "SocketUtil.h"
-
-namespace rmq
-{
- class MessageId
- {
- public:
- MessageId(sockaddr address, long long offset)
- : m_address(address), m_offset(offset)
- {
-
- }
-
- sockaddr getAddress()
- {
- return m_address;
- }
-
- void setAddress(sockaddr address)
- {
- m_address = address;
- }
-
- long long getOffset()
- {
- return m_offset;
- }
-
- void setOffset(long long offset)
- {
- m_offset = offset;
- }
-
- private:
- sockaddr m_address;
- long long m_offset;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/message/MessageQueue.cpp b/rocketmq-client4cpp/src/message/MessageQueue.cpp
deleted file mode 100755
index d632550e..00000000
--- a/rocketmq-client4cpp/src/message/MessageQueue.cpp
+++ /dev/null
@@ -1,153 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "MessageQueue.h"
-
-#include <string>
-#include <sstream>
-#include <UtilAll.h>
-
-namespace rmq
-{
-
-MessageQueue::MessageQueue()
- : m_queueId(0)
-{
-}
-
-MessageQueue::MessageQueue(const std::string& topic, const std::string& brokerName, int queueId)
- : m_topic(topic), m_brokerName(brokerName), m_queueId(queueId)
-{
-
-}
-
-std::string MessageQueue::getTopic()const
-{
- return m_topic;
-}
-
-void MessageQueue::setTopic(const std::string& topic)
-{
- m_topic = topic;
-}
-
-std::string MessageQueue::getBrokerName()const
-{
- return m_brokerName;
-}
-
-void MessageQueue::setBrokerName(const std::string& brokerName)
-{
- m_brokerName = brokerName;
-}
-
-int MessageQueue::getQueueId()const
-{
- return m_queueId;
-}
-
-void MessageQueue::setQueueId(int queueId)
-{
- m_queueId = queueId;
-}
-
-int MessageQueue::hashCode()
-{
- /*
- final int prime = 31;
- int result = 1;
- result = prime * result + ((brokerName == null) ? 0 : brokerName.hashCode());
- result = prime * result + queueId;
- result = prime * result + ((topic == null) ? 0 : topic.hashCode());
- return result;
- */
- std::stringstream ss;
- ss << m_topic << m_brokerName << m_queueId;
- return UtilAll::hashCode(ss.str());
-}
-
-std::string MessageQueue::toString() const
-{
- std::stringstream ss;
- ss << "{topic=" << m_topic
- << ",brokerName=" << m_brokerName
- << ",queueId=" << m_queueId << "}";
- return ss.str();
-}
-
-
-std::string MessageQueue::toJsonString() const
-{
- std::stringstream ss;
- ss << "{\"topic\":\"" << m_topic
- << "\",\"brokerName\":\"" << m_brokerName
- << "\",\"queueId\":" << m_queueId << "}";
- return ss.str();
-}
-
-
-bool MessageQueue::operator==(const MessageQueue& mq)const
-{
- if (this == &mq)
- {
- return true;
- }
-
- if (m_brokerName != mq.m_brokerName)
- {
- return false;
- }
-
- if (m_queueId != mq.m_queueId)
- {
- return false;
- }
-
- if (m_topic != mq.m_topic)
- {
- return false;
- }
-
- return true;
-}
-
-int MessageQueue::compareTo(const MessageQueue& mq)const
-{
- {
- int result = strcmp(m_topic.c_str(), mq.m_topic.c_str());
- if (result != 0)
- {
- return result;
- }
- }
-
- {
- int result = strcmp(m_brokerName.c_str(), mq.m_brokerName.c_str());
- if (result != 0)
- {
- return result;
- }
- }
-
- return m_queueId - mq.m_queueId;
-}
-
-bool MessageQueue::operator<(const MessageQueue& mq)const
-{
- return compareTo(mq) < 0;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/producer/DefaultMQProducer.cpp b/rocketmq-client4cpp/src/producer/DefaultMQProducer.cpp
deleted file mode 100755
index dcad6549..00000000
--- a/rocketmq-client4cpp/src/producer/DefaultMQProducer.cpp
+++ /dev/null
@@ -1,277 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License")
-{
-}
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "DefaultMQProducer.h"
-
-#include <assert.h>
-#include "MessageExt.h"
-#include "QueryResult.h"
-#include "DefaultMQProducerImpl.h"
-#include "MixAll.h"
-#include "MQClientException.h"
-
-namespace rmq
-{
-
-DefaultMQProducer::DefaultMQProducer()
- : m_producerGroup(MixAll::DEFAULT_PRODUCER_GROUP),
- m_createTopicKey(MixAll::DEFAULT_TOPIC),
- m_defaultTopicQueueNums(4),
- m_sendMsgTimeout(3000),
- m_compressMsgBodyOverHowmuch(1024 * 4),
- m_retryTimesWhenSendFailed(2),
- m_retryAnotherBrokerWhenNotStoreOK(false),
- m_maxMessageSize(1024 * 128),
- m_compressLevel(5)
-{
- m_pDefaultMQProducerImpl = new DefaultMQProducerImpl(this);
-}
-
-DefaultMQProducer::DefaultMQProducer(const std::string& producerGroup)
- : m_producerGroup(producerGroup),
- m_createTopicKey(MixAll::DEFAULT_TOPIC),
- m_defaultTopicQueueNums(4),
- m_sendMsgTimeout(3000),
- m_compressMsgBodyOverHowmuch(1024 * 4),
- m_retryTimesWhenSendFailed(2),
- m_retryAnotherBrokerWhenNotStoreOK(false),
- m_maxMessageSize(1024 * 128),
- m_compressLevel(5)
-{
- m_pDefaultMQProducerImpl = new DefaultMQProducerImpl(this);
-}
-
-DefaultMQProducer::~DefaultMQProducer()
-{
- // memleak: maybe core
- delete m_pDefaultMQProducerImpl;
-}
-
-
-void DefaultMQProducer::start()
-{
- m_pDefaultMQProducerImpl->start();
-}
-
-void DefaultMQProducer::shutdown()
-{
- m_pDefaultMQProducerImpl->shutdown();
-}
-
-std::vector<MessageQueue>* DefaultMQProducer::fetchPublishMessageQueues(const std::string& topic)
-{
- return m_pDefaultMQProducerImpl->fetchPublishMessageQueues(topic);
-}
-
-SendResult DefaultMQProducer::send(Message& msg)
-{
- return m_pDefaultMQProducerImpl->send(msg);
-}
-
-void DefaultMQProducer::send(Message& msg, SendCallback* pSendCallback)
-{
- m_pDefaultMQProducerImpl->send(msg, pSendCallback);
-}
-
-void DefaultMQProducer::sendOneway(Message& msg)
-{
- m_pDefaultMQProducerImpl->sendOneway(msg);
-}
-
-SendResult DefaultMQProducer::send(Message& msg, MessageQueue& mq)
-{
- return m_pDefaultMQProducerImpl->send(msg, mq);
-}
-
-void DefaultMQProducer::send(Message& msg, MessageQueue& mq, SendCallback* pSendCallback)
-{
- m_pDefaultMQProducerImpl->send(msg, mq, pSendCallback);
-}
-
-void DefaultMQProducer::sendOneway(Message& msg, MessageQueue& mq)
-{
- m_pDefaultMQProducerImpl->sendOneway(msg, mq);
-}
-
-SendResult DefaultMQProducer::send(Message& msg, MessageQueueSelector* pSelector, void* arg)
-{
- return m_pDefaultMQProducerImpl->send(msg, pSelector, arg);
-}
-
-void DefaultMQProducer::send(Message& msg,
- MessageQueueSelector* pSelector,
- void* arg,
- SendCallback* pSendCallback)
-{
- m_pDefaultMQProducerImpl->send(msg, pSelector, arg, pSendCallback);
-}
-
-void DefaultMQProducer::sendOneway(Message& msg, MessageQueueSelector* pSelector, void* arg)
-{
- m_pDefaultMQProducerImpl->sendOneway(msg, pSelector, arg);
-}
-
-TransactionSendResult DefaultMQProducer::sendMessageInTransaction(Message& msg,
- LocalTransactionExecuter* tranExecuter, void* arg)
-{
- THROW_MQEXCEPTION(MQClientException,
- "sendMessageInTransaction not implement, please use TransactionMQProducer class", -1);
- TransactionSendResult result;
-
- return result;
-}
-
-void DefaultMQProducer::createTopic(const std::string& key, const std::string& newTopic, int queueNum)
-{
- m_pDefaultMQProducerImpl->createTopic(key, newTopic, queueNum);
-}
-
-long long DefaultMQProducer::searchOffset(const MessageQueue& mq, long long timestamp)
-{
- return m_pDefaultMQProducerImpl->searchOffset(mq, timestamp);
-}
-
-long long DefaultMQProducer::maxOffset(const MessageQueue& mq)
-{
- return m_pDefaultMQProducerImpl->maxOffset(mq);
-}
-
-long long DefaultMQProducer::minOffset(const MessageQueue& mq)
-{
- return m_pDefaultMQProducerImpl->minOffset(mq);
-}
-
-long long DefaultMQProducer::earliestMsgStoreTime(const MessageQueue& mq)
-{
- return m_pDefaultMQProducerImpl->earliestMsgStoreTime(mq);
-}
-
-MessageExt* DefaultMQProducer::viewMessage(const std::string& msgId)
-{
- return m_pDefaultMQProducerImpl->viewMessage(msgId);
-}
-
-QueryResult DefaultMQProducer::queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end)
-{
-
- return m_pDefaultMQProducerImpl->queryMessage(topic, key, maxNum, begin, end);
-}
-
-std::string DefaultMQProducer::getProducerGroup()
-{
- return m_producerGroup;
-}
-
-void DefaultMQProducer::setProducerGroup(const std::string& producerGroup)
-{
- m_producerGroup = producerGroup;
-}
-
-std::string DefaultMQProducer::getCreateTopicKey()
-{
- return m_createTopicKey;
-}
-
-void DefaultMQProducer::setCreateTopicKey(const std::string& createTopicKey)
-{
- m_createTopicKey = createTopicKey;
-}
-
-int DefaultMQProducer::getSendMsgTimeout()
-{
- return m_sendMsgTimeout;
-}
-
-void DefaultMQProducer::setSendMsgTimeout(int sendMsgTimeout)
-{
- m_sendMsgTimeout = sendMsgTimeout;
-}
-
-int DefaultMQProducer::getCompressMsgBodyOverHowmuch()
-{
- return m_compressMsgBodyOverHowmuch;
-}
-
-void DefaultMQProducer::setCompressMsgBodyOverHowmuch(int compressMsgBodyOverHowmuch)
-{
- m_compressMsgBodyOverHowmuch = compressMsgBodyOverHowmuch;
-}
-
-DefaultMQProducerImpl* DefaultMQProducer::getDefaultMQProducerImpl()
-{
- return m_pDefaultMQProducerImpl;
-}
-
-bool DefaultMQProducer::isRetryAnotherBrokerWhenNotStoreOK()
-{
- return m_retryAnotherBrokerWhenNotStoreOK;
-}
-
-void DefaultMQProducer::setRetryAnotherBrokerWhenNotStoreOK(bool retryAnotherBrokerWhenNotStoreOK)
-{
- m_retryAnotherBrokerWhenNotStoreOK = retryAnotherBrokerWhenNotStoreOK;
-}
-
-int DefaultMQProducer::getMaxMessageSize()
-{
- return m_maxMessageSize;
-}
-
-void DefaultMQProducer::setMaxMessageSize(int maxMessageSize)
-{
- m_maxMessageSize = maxMessageSize;
-}
-
-int DefaultMQProducer::getDefaultTopicQueueNums()
-{
- return m_defaultTopicQueueNums;
-}
-
-void DefaultMQProducer::setDefaultTopicQueueNums(int defaultTopicQueueNums)
-{
- m_defaultTopicQueueNums = defaultTopicQueueNums;
-}
-
-int DefaultMQProducer::getRetryTimesWhenSendFailed()
-{
- return m_retryTimesWhenSendFailed;
-}
-
-void DefaultMQProducer::setRetryTimesWhenSendFailed(int retryTimesWhenSendFailed)
-{
- m_retryTimesWhenSendFailed = retryTimesWhenSendFailed;
-}
-
-int DefaultMQProducer::getCompressLevel()
-{
- return m_compressLevel;
-}
-
-void DefaultMQProducer::setCompressLevel(int compressLevel)
-{
- assert(compressLevel >= 0 && compressLevel <= 9 || compressLevel == -1);
-
- m_compressLevel = compressLevel;
-}
-
-
-}
-
diff --git a/rocketmq-client4cpp/src/producer/DefaultMQProducerImpl.cpp b/rocketmq-client4cpp/src/producer/DefaultMQProducerImpl.cpp
deleted file mode 100755
index 26b3f0b9..00000000
--- a/rocketmq-client4cpp/src/producer/DefaultMQProducerImpl.cpp
+++ /dev/null
@@ -1,932 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License")
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "DefaultMQProducerImpl.h"
-#include "DefaultMQProducer.h"
-#include "MessageExt.h"
-#include "QueryResult.h"
-#include "TopicPublishInfo.h"
-#include "MQClientException.h"
-#include "LocalTransactionExecuter.h"
-#include "SendMessageHook.h"
-#include "MQClientManager.h"
-#include "MQClientFactory.h"
-#include "Validators.h"
-#include "MQAdminImpl.h"
-#include "MQClientAPIImpl.h"
-#include "MessageSysFlag.h"
-#include "CommandCustomHeader.h"
-#include "KPRUtil.h"
-#include "MessageDecoder.h"
-#include "MessageQueueSelector.h"
-#include "MQProtos.h"
-#include "RemotingCommand.h"
-#include "UtilAll.h"
-
-
-
-namespace rmq
-{
-
-DefaultMQProducerImpl::DefaultMQProducerImpl(DefaultMQProducer
- *pDefaultMQProducer)
- : m_pDefaultMQProducer(pDefaultMQProducer),
- m_serviceState(CREATE_JUST),
- m_pMQClientFactory(NULL)
-{
-}
-
-DefaultMQProducerImpl::~DefaultMQProducerImpl()
-{
- //delete m_pMQClientFactory;
-}
-
-
-void DefaultMQProducerImpl::start()
-{
- start(true);
-}
-
-void DefaultMQProducerImpl::start(bool startFactory)
-{
- RMQ_DEBUG("DefaultMQProducerImpl::start()");
-
- switch (m_serviceState)
- {
- case CREATE_JUST:
- {
- RMQ_INFO("the producer [{%s}] start beginning.",
- m_pDefaultMQProducer->getProducerGroup().c_str());
-
- m_serviceState = START_FAILED;
- checkConfig();
-
- if (m_pDefaultMQProducer->getProducerGroup() !=
- MixAll::CLIENT_INNER_PRODUCER_GROUP)
- {
- m_pDefaultMQProducer->changeInstanceNameToPID();
- }
-
- m_pMQClientFactory =
- MQClientManager::getInstance()->getAndCreateMQClientFactory(
- *m_pDefaultMQProducer);
- bool registerOK = m_pMQClientFactory->registerProducer(
- m_pDefaultMQProducer->getProducerGroup(), this);
-
- if (!registerOK)
- {
- m_serviceState = CREATE_JUST;
- THROW_MQEXCEPTION(MQClientException,
- "The producer group[" + m_pDefaultMQProducer->getProducerGroup()
- + "] has been created before, specify another name please.", -1);
- }
-
- m_topicPublishInfoTable[m_pDefaultMQProducer->getCreateTopicKey()] =
- TopicPublishInfo();
-
- if (startFactory)
- {
- m_pMQClientFactory->start();
- }
-
- RMQ_INFO("the producer [%s] start OK", m_pDefaultMQProducer->getProducerGroup().c_str());
- m_serviceState = RUNNING;
- }
- break;
-
- case RUNNING:
- RMQ_ERROR("This client is already running.");
-
- case START_FAILED:
- RMQ_ERROR("This client failed to start previously.");
-
- case SHUTDOWN_ALREADY:
- RMQ_ERROR("This client has been shutted down.");
- THROW_MQEXCEPTION(MQClientException,
- "The producer service state not OK, maybe started once, ", -1);
-
- default:
- break;
- }
-
- m_pMQClientFactory->sendHeartbeatToAllBrokerWithLock();
-}
-
-void DefaultMQProducerImpl::shutdown()
-{
- shutdown(true);
-}
-
-void DefaultMQProducerImpl::shutdown(bool shutdownFactory)
-{
- RMQ_DEBUG("DefaultMQProducerImpl::shutdown()");
-
- switch (m_serviceState)
- {
- case CREATE_JUST:
- break;
-
- case RUNNING:
- m_pMQClientFactory->unregisterProducer(
- m_pDefaultMQProducer->getProducerGroup());
-
- if (shutdownFactory)
- {
- m_pMQClientFactory->shutdown();
- }
-
- RMQ_INFO("the producer [%s] shutdown OK", m_pDefaultMQProducer->getProducerGroup().c_str());
- m_serviceState = SHUTDOWN_ALREADY;
- break;
-
- case SHUTDOWN_ALREADY:
- break;
-
- default:
- break;
- }
-}
-
-
-void DefaultMQProducerImpl::initTransactionEnv()
-{
- //TODO
-}
-
-void DefaultMQProducerImpl::destroyTransactionEnv()
-{
- //TODO
-}
-
-bool DefaultMQProducerImpl::hasHook()
-{
- return !m_hookList.empty();
-}
-
-void DefaultMQProducerImpl::registerHook(SendMessageHook* pHook)
-{
- m_hookList.push_back(pHook);
-}
-
-void DefaultMQProducerImpl::executeHookBefore(const SendMessageContext& context)
-{
- std::list<SendMessageHook*>::iterator it = m_hookList.begin();
-
- for (; it != m_hookList.end(); it++)
- {
- try
- {
- (*it)->sendMessageBefore(context);
- }
- catch (...)
- {
- RMQ_WARN("sendMessageBefore exception");
- }
- }
-}
-
-void DefaultMQProducerImpl::executeHookAfter(const SendMessageContext& context)
-{
- std::list<SendMessageHook*>::iterator it = m_hookList.begin();
-
- for (; it != m_hookList.end(); it++)
- {
- try
- {
- (*it)->sendMessageAfter(context);
- }
- catch (...)
- {
- RMQ_WARN("sendMessageAfter exception");
- }
- }
-}
-
-
-std::set<std::string> DefaultMQProducerImpl::getPublishTopicList()
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_topicPublishInfoTableLock);
- std::set<std::string> toplist;
- std::map<std::string, TopicPublishInfo>::iterator it =
- m_topicPublishInfoTable.begin();
- for (; it != m_topicPublishInfoTable.end(); it++)
- {
- toplist.insert(it->first);
- }
-
- return toplist;
-}
-
-bool DefaultMQProducerImpl::isPublishTopicNeedUpdate(const std::string& topic)
-{
- kpr::ScopedRLock<kpr::RWMutex> lock(m_topicPublishInfoTableLock);
- std::map<std::string, TopicPublishInfo>::iterator it =
- m_topicPublishInfoTable.find(topic);
- if (it != m_topicPublishInfoTable.end())
- {
- return !it->second.ok();
- }
-
- return true;
-}
-
-void DefaultMQProducerImpl::checkTransactionState(const std::string& addr, //
- const MessageExt& msg, //
- const CheckTransactionStateRequestHeader& checkRequestHeader)
-{
- //TODO
-}
-
-void DefaultMQProducerImpl::updateTopicPublishInfo(const std::string& topic,
- TopicPublishInfo& info)
-{
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_topicPublishInfoTableLock);
- std::map<std::string, TopicPublishInfo>::iterator it =
- m_topicPublishInfoTable.find(topic);
- if (it != m_topicPublishInfoTable.end())
- {
- info.getSendWhichQueue() = it->second.getSendWhichQueue();
- RMQ_INFO("updateTopicPublishInfo prev is not null, %s", it->second.toString().c_str());
- }
- m_topicPublishInfoTable[topic] = info;
- }
-}
-
-void DefaultMQProducerImpl::createTopic(const std::string& key,
- const std::string& newTopic, int queueNum)
-{
- makeSureStateOK();
- Validators::checkTopic(newTopic);
-
- m_pMQClientFactory->getMQAdminImpl()->createTopic(key, newTopic, queueNum);
-}
-
-std::vector<MessageQueue>* DefaultMQProducerImpl::fetchPublishMessageQueues(
- const std::string& topic)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->fetchPublishMessageQueues(topic);
-}
-
-long long DefaultMQProducerImpl::searchOffset(const MessageQueue& mq,
- long long timestamp)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->searchOffset(mq, timestamp);
-}
-
-long long DefaultMQProducerImpl::maxOffset(const MessageQueue& mq)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->maxOffset(mq);
-}
-
-long long DefaultMQProducerImpl::minOffset(const MessageQueue& mq)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->minOffset(mq);
-}
-
-long long DefaultMQProducerImpl::earliestMsgStoreTime(const MessageQueue& mq)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->earliestMsgStoreTime(mq);
-}
-
-MessageExt* DefaultMQProducerImpl::viewMessage(const std::string& msgId)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->viewMessage(msgId);
-}
-
-QueryResult DefaultMQProducerImpl::queryMessage(const std::string& topic,
- const std::string& key, int maxNum, long long begin, long long end)
-{
- makeSureStateOK();
- return m_pMQClientFactory->getMQAdminImpl()->queryMessage(topic, key, maxNum,
- begin, end);
-}
-
-
-/**
- * DEFAULT ASYNC -------------------------------------------------------
- */
-void DefaultMQProducerImpl::send(Message& msg, SendCallback* pSendCallback)
-{
- send(msg, pSendCallback, m_pDefaultMQProducer->getSendMsgTimeout());
-}
-void DefaultMQProducerImpl::send(Message& msg, SendCallback* pSendCallback, int timeout)
-{
- try
- {
- sendDefaultImpl(msg, ASYNC, pSendCallback, timeout);
- }
- catch (MQBrokerException& e)
- {
- THROW_MQEXCEPTION(MQClientException, std::string("unknow exception: ") + e.what(), -1);
- }
-}
-
-
-/**
- * DEFAULT ONEWAY -------------------------------------------------------
- */
-void DefaultMQProducerImpl::sendOneway(Message& msg)
-{
- try
- {
- sendDefaultImpl(msg, ONEWAY, NULL, m_pDefaultMQProducer->getSendMsgTimeout());
- }
- catch (MQBrokerException& e)
- {
- THROW_MQEXCEPTION(MQClientException, std::string("unknow exception: ") + e.what(), -1);
- }
-}
-
-
-/**
- * KERNEL SYNC -------------------------------------------------------
- */
-SendResult DefaultMQProducerImpl::send(Message& msg, MessageQueue& mq)
-{
- return send(msg, mq, m_pDefaultMQProducer->getSendMsgTimeout());
-}
-SendResult DefaultMQProducerImpl::send(Message& msg, MessageQueue& mq, int timeout)
-{
- makeSureStateOK();
- Validators::checkMessage(msg, m_pDefaultMQProducer);
-
- if (msg.getTopic() != mq.getTopic())
- {
- THROW_MQEXCEPTION(MQClientException, "message's topic not equal mq's topic", -1);
- }
-
- return sendKernelImpl(msg, mq, SYNC, NULL, timeout);
-}
-
-
-/**
- * KERNEL ASYNC -------------------------------------------------------
- */
-void DefaultMQProducerImpl::send(Message& msg, MessageQueue& mq,
- SendCallback* pSendCallback)
-{
- return send(msg, mq, pSendCallback, m_pDefaultMQProducer->getSendMsgTimeout());
-}
-void DefaultMQProducerImpl::send(Message& msg, MessageQueue& mq,
- SendCallback* pSendCallback, int timeout)
-{
- makeSureStateOK();
- Validators::checkMessage(msg, m_pDefaultMQProducer);
-
- if (msg.getTopic() != mq.getTopic())
- {
- THROW_MQEXCEPTION(MQClientException, "message's topic not equal mq's topic", -1);
- }
-
- try
- {
- sendKernelImpl(msg, mq, ASYNC, pSendCallback, timeout);
- }
- catch (MQBrokerException& e)
- {
- THROW_MQEXCEPTION(MQClientException, std::string("unknow exception: ") + e.what(), -1);
- }
-}
-
-/**
- * KERNEL ONEWAY -------------------------------------------------------
- */
-void DefaultMQProducerImpl::sendOneway(Message& msg, MessageQueue& mq)
-{
- makeSureStateOK();
- Validators::checkMessage(msg, m_pDefaultMQProducer);
-
- if (msg.getTopic() != mq.getTopic())
- {
- THROW_MQEXCEPTION(MQClientException, "message's topic not equal mq's topic", -1);
- }
-
- try
- {
- sendKernelImpl(msg, mq, ONEWAY, NULL, m_pDefaultMQProducer->getSendMsgTimeout());
- }
- catch (MQBrokerException& e)
- {
- THROW_MQEXCEPTION(MQClientException, std::string("unknow exception: ") + e.what(), -1);
- }
-}
-
-
-/**
- * SELECT SYNC -------------------------------------------------------
- */
-SendResult DefaultMQProducerImpl::send(Message& msg,
- MessageQueueSelector* pSelector, void* arg)
-{
- return send(msg, pSelector, arg, m_pDefaultMQProducer->getSendMsgTimeout());
-}
-SendResult DefaultMQProducerImpl::send(Message& msg,
- MessageQueueSelector* pSelector, void* arg, int timeout)
-{
- return sendSelectImpl(msg, pSelector, arg, SYNC, NULL, timeout);
-}
-
-
-/**
- * SELECT ASYNC -------------------------------------------------------
- */
-void DefaultMQProducerImpl::send(Message& msg,
- MessageQueueSelector* pSelector,
- void* arg,
- SendCallback* pSendCallback)
-{
- return send(msg, pSelector, arg, pSendCallback, m_pDefaultMQProducer->getSendMsgTimeout());
-}
-void DefaultMQProducerImpl::send(Message& msg,
- MessageQueueSelector* pSelector,
- void* arg,
- SendCallback* pSendCallback,
- int timeout)
-{
- try
- {
- sendSelectImpl(msg, pSelector, arg, ASYNC, pSendCallback, timeout);
- }
- catch (MQBrokerException& e)
- {
- THROW_MQEXCEPTION(MQClientException, std::string("unknow exception: ") + e.what(), -1);
- }
-}
-
-
-/**
- * SELECT ONEWAY -------------------------------------------------------
- */
-void DefaultMQProducerImpl::sendOneway(Message& msg,
- MessageQueueSelector* pSelector, void* arg)
-{
- try
- {
- sendSelectImpl(msg, pSelector, arg, ONEWAY, NULL,
- m_pDefaultMQProducer->getSendMsgTimeout());
- }
- catch (MQBrokerException& e)
- {
- THROW_MQEXCEPTION(MQClientException, std::string("unknow exception: ") + e.what(), -1);
- }
-}
-
-
-/*
- * Send with Transaction
- */
-TransactionSendResult DefaultMQProducerImpl::sendMessageInTransaction(
- Message& msg,
- LocalTransactionExecuter* tranExecuter, void* arg)
-{
- //TODO
- TransactionSendResult result;
- return result;
-}
-
-void DefaultMQProducerImpl::endTransaction(//
- SendResult sendResult, //
- LocalTransactionState localTransactionState, //
- MQClientException localException)
-{
- //TODO
-}
-
-/**
- * DEFAULT SYNC -------------------------------------------------------
- */
-SendResult DefaultMQProducerImpl::send(Message& msg)
-{
- return send(msg, m_pDefaultMQProducer->getSendMsgTimeout());
-}
-SendResult DefaultMQProducerImpl::send(Message& msg, int timeout)
-{
- return sendDefaultImpl(msg, SYNC, NULL, timeout);
-}
-
-
-std::map<std::string, TopicPublishInfo> DefaultMQProducerImpl::getTopicPublishInfoTable()
-{
- return m_topicPublishInfoTable;
-}
-
-MQClientFactory* DefaultMQProducerImpl::getMQClientFactory()
-{
- return m_pMQClientFactory;
-}
-
-int DefaultMQProducerImpl::getZipCompressLevel()
-{
- return m_zipCompressLevel;
-}
-
-void DefaultMQProducerImpl::setZipCompressLevel(int zipCompressLevel)
-{
- m_zipCompressLevel = zipCompressLevel;
-}
-
-ServiceState DefaultMQProducerImpl::getServiceState() {
- return m_serviceState;
-}
-
-
-void DefaultMQProducerImpl::setServiceState(ServiceState serviceState) {
- m_serviceState = serviceState;
-}
-
-
-SendResult DefaultMQProducerImpl::sendDefaultImpl(Message& msg,
- CommunicationMode communicationMode,
- SendCallback* pSendCallback,
- int timeout)
-{
- makeSureStateOK();
- Validators::checkMessage(msg, m_pDefaultMQProducer);
-
- long long maxTimeout = m_pDefaultMQProducer->getSendMsgTimeout() + 1000;
- long long beginTimestamp = KPRUtil::GetCurrentTimeMillis();
- long long endTimestamp = beginTimestamp;
- TopicPublishInfo& topicPublishInfo = tryToFindTopicPublishInfo(msg.getTopic());
- SendResult sendResult;
-
- if (topicPublishInfo.ok())
- {
- MessageQueue* mq = NULL;
-
- int times = 0;
- int timesTotal = 1 + m_pDefaultMQProducer->getRetryTimesWhenSendFailed();
- std::vector<std::string> brokersSent;
- for (; times < timesTotal && int(endTimestamp - beginTimestamp) < maxTimeout; times++)
- {
- std::string lastBrokerName = (NULL == mq) ? "" : mq->getBrokerName();
- MessageQueue* tmpmq = topicPublishInfo.selectOneMessageQueue(lastBrokerName);
-
- if (tmpmq != NULL)
- {
- mq = tmpmq;
- brokersSent.push_back(mq->getBrokerName());
-
- try
- {
- sendResult = sendKernelImpl(msg, *mq, communicationMode, pSendCallback, timeout);
- endTimestamp = KPRUtil::GetCurrentTimeMillis();
-
- switch (communicationMode)
- {
- case ASYNC:
- return sendResult;
-
- case ONEWAY:
- return sendResult;
-
- case SYNC:
- if (sendResult.getSendStatus() != SEND_OK)
- {
- if (m_pDefaultMQProducer->isRetryAnotherBrokerWhenNotStoreOK())
- {
- continue;
- }
- }
-
- return sendResult;
-
- default:
- break;
- }
- }
- catch (RemotingException& e)
- {
- endTimestamp = KPRUtil::GetCurrentTimeMillis();
- continue;
- }
- catch (MQClientException& e)
- {
- endTimestamp = KPRUtil::GetCurrentTimeMillis();
- continue;
- }
- catch (MQBrokerException& e)
- {
- endTimestamp = KPRUtil::GetCurrentTimeMillis();
-
- switch (e.GetError())
- {
- case TOPIC_NOT_EXIST_VALUE:
- case SERVICE_NOT_AVAILABLE_VALUE:
- case SYSTEM_ERROR_VALUE:
- case NO_PERMISSION_VALUE:
- case NO_BUYER_ID_VALUE:
- case NOT_IN_CURRENT_UNIT_VALUE:
- continue;
- default:
- if (sendResult.hasResult())
- {
- return sendResult;
- }
- throw;
- }
- }
- catch (InterruptedException& e)
- {
- endTimestamp = KPRUtil::GetCurrentTimeMillis();
- throw;
- }
- }
- else
- {
- break;
- }
- } // end of for
-
- std::string info = RocketMQUtil::str2fmt("Send [%d] times, still failed, cost [%d]ms, Topic: %s, BrokersSent: %s",
- times, int(endTimestamp - beginTimestamp), msg.getTopic().c_str(), UtilAll::toString(brokersSent).c_str());
- RMQ_WARN("%s", info.c_str());
- THROW_MQEXCEPTION(MQClientException, info, -1);
- return sendResult;
- }
-
- std::vector<std::string> nsList =
- getMQClientFactory()->getMQClientAPIImpl()->getNameServerAddressList();
- if (nsList.empty())
- {
- THROW_MQEXCEPTION(MQClientException, "No name server address, please set it", -1);
- }
-
- THROW_MQEXCEPTION(MQClientException, std::string("No route info of this topic, ") + msg.getTopic(), -1);
-}
-
-SendResult DefaultMQProducerImpl::sendKernelImpl(Message& msg,
- const MessageQueue& mq,
- CommunicationMode communicationMode,
- SendCallback* sendCallback,
- int timeout)
-{
- std::string brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- if (brokerAddr.empty())
- {
- tryToFindTopicPublishInfo(mq.getTopic());
- brokerAddr = m_pMQClientFactory->findBrokerAddressInPublish(mq.getBrokerName());
- }
-
- SendMessageContext context;
- if (!brokerAddr.empty())
- {
- try
- {
- int sysFlag = 0;
-
- if (tryToCompressMessage(msg))
- {
- sysFlag |= MessageSysFlag::CompressedFlag;
- }
-
- std::string tranMsg = msg.getProperty(Message::PROPERTY_TRANSACTION_PREPARED);
- if (!tranMsg.empty() && tranMsg == "true")
- {
- sysFlag |= MessageSysFlag::TransactionPreparedType;
- }
-
- // ִ��hook
- if (hasHook())
- {
- context.producerGroup = (m_pDefaultMQProducer->getProducerGroup());
- context.communicationMode = (communicationMode);
- context.brokerAddr = (brokerAddr);
- context.msg = (msg);
- context.mq = (mq);
- executeHookBefore(context);
- }
-
- SendMessageRequestHeader* requestHeader = new SendMessageRequestHeader();
- requestHeader->producerGroup = (m_pDefaultMQProducer->getProducerGroup());
- requestHeader->topic = (msg.getTopic());
- requestHeader->defaultTopic = (m_pDefaultMQProducer->getCreateTopicKey());
- requestHeader->defaultTopicQueueNums = (m_pDefaultMQProducer->getDefaultTopicQueueNums());
- requestHeader->queueId = (mq.getQueueId());
- requestHeader->sysFlag = (sysFlag);
- requestHeader->bornTimestamp = (KPRUtil::GetCurrentTimeMillis());
- requestHeader->flag = (msg.getFlag());
- requestHeader->properties = (MessageDecoder::messageProperties2String(msg.getProperties()));
- requestHeader->reconsumeTimes = 0;
-
- if (requestHeader->topic.find(MixAll::RETRY_GROUP_TOPIC_PREFIX) == 0)
- {
- std::string reconsumeTimes = msg.getProperty(Message::PROPERTY_RECONSUME_TIME);
- if (!reconsumeTimes.empty())
- {
- requestHeader->reconsumeTimes = int(UtilAll::str2ll(reconsumeTimes.c_str()));
- msg.clearProperty(Message::PROPERTY_RECONSUME_TIME);
- }
-
- /*
- 3.5.8 new features
- std::string maxReconsumeTimes = msg.getProperty(Message::PROPERTY_MAX_RECONSUME_TIMES);
- if (!maxReconsumeTimes.empty())
- {
- requestHeader->maxReconsumeTimes = int(UtilAll::str2ll(maxReconsumeTimes.c_str()));
- msg.clearProperty(Message::PROPERTY_MAX_RECONSUME_TIMES);
- }
- */
- }
-
- SendResult sendResult = m_pMQClientFactory->getMQClientAPIImpl()->sendMessage(
- brokerAddr,
- mq.getBrokerName(),
- msg,
- requestHeader,
- timeout,
- communicationMode,
- sendCallback
- );
-
- if (hasHook())
- {
- context.sendResult = (sendResult);
- executeHookAfter(context);
- }
-
- return sendResult;
- }
- catch (RemotingException& e)
- {
- if (hasHook())
- {
- context.pException = (&e);
- executeHookAfter(context);
- }
- RMQ_WARN("sendKernelImpl exception: %s, msg: %s", e.what(), msg.toString().c_str());
- throw;
- }
- catch (MQBrokerException& e)
- {
- if (hasHook())
- {
- context.pException = (&e);
- executeHookAfter(context);
- }
- RMQ_WARN("sendKernelImpl exception: %s, msg: %s", e.what(), msg.toString().c_str());
- throw;
- }
- catch (InterruptedException& e)
- {
- if (hasHook())
- {
- context.pException = (&e);
- executeHookAfter(context);
- }
- RMQ_WARN("sendKernelImpl exception: %s, msg: %s", e.what(), msg.toString().c_str());
- throw;
- }
- }
-
- THROW_MQEXCEPTION(MQClientException, std::string("The broker[") + mq.getBrokerName() + "] not exist", -1);
-}
-
-SendResult DefaultMQProducerImpl::sendSelectImpl(Message& msg,
- MessageQueueSelector* selector,
- void* pArg,
- CommunicationMode communicationMode,
- SendCallback* sendCallback,
- int timeout)
-{
- makeSureStateOK();
- Validators::checkMessage(msg, m_pDefaultMQProducer);
-
- SendResult result;
- TopicPublishInfo& topicPublishInfo = tryToFindTopicPublishInfo(msg.getTopic());
- SendResult sendResult;
-
- if (topicPublishInfo.ok())
- {
- MessageQueue* mq = NULL;
-
- try
- {
- mq = selector->select(topicPublishInfo.getMessageQueueList(), msg, pArg);
- }
- catch (std::exception& e)
- {
- THROW_MQEXCEPTION(MQClientException,
- std::string("select message queue throwed exception, ") + e.what(), -1);
- }
- catch (...)
- {
- THROW_MQEXCEPTION(MQClientException, "select message queue throwed exception, ", -1);
- }
-
- if (mq != NULL)
- {
- return sendKernelImpl(msg, *mq, communicationMode, sendCallback, timeout);
- }
- else
- {
- THROW_MQEXCEPTION(MQClientException, "select message queue return null", -1);
- }
- }
-
- THROW_MQEXCEPTION(MQClientException, std::string("No route info of this topic, ") + msg.getTopic(), -1);
-}
-
-void DefaultMQProducerImpl::makeSureStateOK()
-{
- if (m_serviceState != RUNNING)
- {
- THROW_MQEXCEPTION(MQClientException, "The producer service state not OK, ", -1);
- }
-}
-
-void DefaultMQProducerImpl::checkConfig()
-{
- Validators::checkGroup(m_pDefaultMQProducer->getProducerGroup());
-
- if (m_pDefaultMQProducer->getProducerGroup().empty())
- {
- THROW_MQEXCEPTION(MQClientException, "producerGroup is null", -1);
- }
-
- if (m_pDefaultMQProducer->getProducerGroup() == MixAll::DEFAULT_PRODUCER_GROUP)
- {
- THROW_MQEXCEPTION(MQClientException,
- std::string("producerGroup can not equal [") + MixAll::DEFAULT_PRODUCER_GROUP + "], please specify another one",
- -1);
- }
-}
-
-TopicPublishInfo& DefaultMQProducerImpl::tryToFindTopicPublishInfo(
- const std::string& topic)
-{
- std::map<std::string, TopicPublishInfo>::iterator it;
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_topicPublishInfoTableLock);
- it = m_topicPublishInfoTable.find(topic);
- }
-
- if (it == m_topicPublishInfoTable.end() || !it->second.ok())
- {
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_topicPublishInfoTableLock);
- m_topicPublishInfoTable[topic] = TopicPublishInfo();
- }
-
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(topic);
-
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_topicPublishInfoTableLock);
- it = m_topicPublishInfoTable.find(topic);
- }
- }
-
- if (it != m_topicPublishInfoTable.end()
- && (it->second.ok() || it->second.isHaveTopicRouterInfo()))
- {
- return (it->second);
- }
- else
- {
- m_pMQClientFactory->updateTopicRouteInfoFromNameServer(topic, true,
- m_pDefaultMQProducer);
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_topicPublishInfoTableLock);
- it = m_topicPublishInfoTable.find(topic);
- }
- return (it->second);
- }
-}
-
-bool DefaultMQProducerImpl::tryToCompressMessage(Message& msg)
-{
- if (msg.getBodyLen() >= m_pDefaultMQProducer->getCompressMsgBodyOverHowmuch())
- {
- if (msg.tryToCompress(m_pDefaultMQProducer->getCompressLevel()))
- {
- return true;
- }
- }
-
- return false;
-}
-
-TransactionCheckListener* DefaultMQProducerImpl::checkListener()
-{
- return NULL;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/producer/DefaultMQProducerImpl.h b/rocketmq-client4cpp/src/producer/DefaultMQProducerImpl.h
deleted file mode 100755
index 3df914c0..00000000
--- a/rocketmq-client4cpp/src/producer/DefaultMQProducerImpl.h
+++ /dev/null
@@ -1,205 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __DEFAULTMQPRODUCERIMPL_H__
-#define __DEFAULTMQPRODUCERIMPL_H__
-
-#include <list>
-#include <vector>
-#include "MQProducerInner.h"
-#include "QueryResult.h"
-#include "ServiceState.h"
-#include "CommunicationMode.h"
-#include "SendResult.h"
-#include "MQClientException.h"
-#include "Mutex.h"
-#include "ScopedLock.h"
-
-
-namespace rmq
-{
- class DefaultMQProducer;
- class SendMessageHook;
- class SendMessageContext;
- class MessageQueue;
- class MessageExt;
- class SendCallback;
- class MessageQueueSelector;
- class MQClientFactory;
- class MQClientException;
- class RemotingException;
- class MQBrokerException;
- class InterruptedException;
- class LocalTransactionExecuter;
-
-
- class DefaultMQProducerImpl : public MQProducerInner
- {
- public:
- DefaultMQProducerImpl(DefaultMQProducer* pDefaultMQProducer);
- ~DefaultMQProducerImpl();
- void initTransactionEnv();
- void destroyTransactionEnv();
-
- bool hasHook();
- void registerHook(SendMessageHook* pHook);
- void executeHookBefore(const SendMessageContext& context);
- void executeHookAfter(const SendMessageContext& context);
-
- void start();
- void start(bool startFactory);
- void shutdown();
- void shutdown(bool shutdownFactory);
-
- std::set<std::string> getPublishTopicList();
- bool isPublishTopicNeedUpdate(const std::string& topic);
-
- void checkTransactionState(const std::string& addr,
- const MessageExt& msg,
- const CheckTransactionStateRequestHeader& checkRequestHeader);
-
- void updateTopicPublishInfo(const std::string& topic, TopicPublishInfo& info);
- virtual TransactionCheckListener* checkListener();
-
- void createTopic(const std::string& key, const std::string& newTopic, int queueNum);
- std::vector<MessageQueue>* fetchPublishMessageQueues(const std::string& topic);
-
- long long searchOffset(const MessageQueue& mq, long long timestamp);
- long long maxOffset(const MessageQueue& mq);
- long long minOffset(const MessageQueue& mq);
-
- long long earliestMsgStoreTime(const MessageQueue& mq);
-
- MessageExt* viewMessage(const std::string& msgId);
- QueryResult queryMessage(const std::string& topic,
- const std::string& key,
- int maxNum,
- long long begin,
- long long end);
-
- /**
- * DEFAULT ASYNC -------------------------------------------------------
- */
- void send(Message& msg, SendCallback* sendCallback);
- void send(Message& msg, SendCallback* sendCallback, int timeout);
-
- /**
- * DEFAULT ONEWAY -------------------------------------------------------
- */
- void sendOneway(Message& msg);
-
- /**
- * KERNEL SYNC -------------------------------------------------------
- */
- SendResult send(Message& msg, MessageQueue& mq);
- SendResult send(Message& msg, MessageQueue& mq, int timeout);
-
- /**
- * KERNEL ASYNC -------------------------------------------------------
- */
- void send(Message& msg, MessageQueue& mq, SendCallback* sendCallback);
- void send(Message& msg, MessageQueue& mq, SendCallback* sendCallback, int timeout);
-
- /**
- * KERNEL ONEWAY -------------------------------------------------------
- */
- void sendOneway(Message& msg, MessageQueue& mq);
-
- /**
- * SELECT SYNC -------------------------------------------------------
- */
- SendResult send(Message& msg, MessageQueueSelector* selector, void* arg);
- SendResult send(Message& msg, MessageQueueSelector* selector, void* arg, int timeout);
-
- /**
- * SELECT ASYNC -------------------------------------------------------
- */
- void send(Message& msg, MessageQueueSelector* selector, void* arg, SendCallback* sendCallback);
- void send(Message& msg, MessageQueueSelector* selector, void* arg, SendCallback* sendCallback, int timeout);
-
- /**
- * SELECT ONEWAY -------------------------------------------------------
- */
- void sendOneway(Message& msg, MessageQueueSelector* selector, void* arg);
-
- /**
- * SEND with Transaction
- */
- TransactionSendResult sendMessageInTransaction(Message& msg, LocalTransactionExecuter* tranExecuter, void* arg);
-
- /**
- * DEFAULT SYNC -------------------------------------------------------
- */
- SendResult send(Message& msg);
- SendResult send(Message& msg, int timeout);
-
- std::map<std::string, TopicPublishInfo> getTopicPublishInfoTable();
-
- MQClientFactory* getMQClientFactory();
-
- int getZipCompressLevel();
- void setZipCompressLevel(int zipCompressLevel);
-
- ServiceState getServiceState();
- void setServiceState(ServiceState serviceState);
-
- private:
- SendResult sendSelectImpl(Message& msg,
- MessageQueueSelector* selector,
- void* pArg,
- CommunicationMode communicationMode,
- SendCallback* sendCallback,
- int timeout);
-
- SendResult sendDefaultImpl(Message& msg,
- CommunicationMode communicationMode,
- SendCallback* pSendCallback,
- int timeout);
-
- SendResult sendKernelImpl(Message& msg,
- const MessageQueue& mq,
- CommunicationMode communicationMode,
- SendCallback* pSendCallback,
- int timeout);
-
- void endTransaction(SendResult sendResult,
- LocalTransactionState localTransactionState,
- MQClientException localException);
-
- void makeSureStateOK();
- void checkConfig();
-
- TopicPublishInfo& tryToFindTopicPublishInfo(const std::string& topic) ;
- bool tryToCompressMessage(Message& msg);
-
- protected:
- //TODO transaction imp
-
- private:
- int m_zipCompressLevel;// message compress level, default is 5
-
- DefaultMQProducer* m_pDefaultMQProducer;
-
- std::map<std::string, TopicPublishInfo> m_topicPublishInfoTable;
- kpr::RWMutex m_topicPublishInfoTableLock;
-
- ServiceState m_serviceState;
- MQClientFactory* m_pMQClientFactory;
- std::list<SendMessageHook*> m_hookList;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/producer/LocalTransactionExecuter.h b/rocketmq-client4cpp/src/producer/LocalTransactionExecuter.h
deleted file mode 100755
index a124884e..00000000
--- a/rocketmq-client4cpp/src/producer/LocalTransactionExecuter.h
+++ /dev/null
@@ -1,31 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __LOCALTRANSACTIONEXECUTER_H__
-#define __LOCALTRANSACTIONEXECUTER_H__
-
-#include "SendResult.h"
-
-namespace rmq
-{
- class LocalTransactionExecuter
- {
- public:
- virtual~LocalTransactionExecuter() {}
- virtual LocalTransactionState executeLocalTransactionBranch(Message& msg, void* arg) = 0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/producer/MQProducerInner.h b/rocketmq-client4cpp/src/producer/MQProducerInner.h
deleted file mode 100755
index 56194dce..00000000
--- a/rocketmq-client4cpp/src/producer/MQProducerInner.h
+++ /dev/null
@@ -1,44 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MQPRODUCERINNER_H__
-#define __MQPRODUCERINNER_H__
-
-#include <string>
-#include <set>
-
-namespace rmq
-{
- class TransactionCheckListener;
- class MessageExt;
- class CheckTransactionStateRequestHeader;
- class TopicPublishInfo;
-
- class MQProducerInner
- {
- public:
- virtual ~MQProducerInner() {}
- virtual std::set<std::string> getPublishTopicList() = 0;
- virtual bool isPublishTopicNeedUpdate(const std::string& topic) = 0;
- virtual TransactionCheckListener* checkListener() = 0;
- virtual void checkTransactionState(const std::string& addr, //
- const MessageExt& msg, //
- const CheckTransactionStateRequestHeader& checkRequestHeader) = 0;
- virtual void updateTopicPublishInfo(const std::string& topic, TopicPublishInfo& info) = 0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/producer/MessageQueueSelector.h b/rocketmq-client4cpp/src/producer/MessageQueueSelector.h
deleted file mode 100755
index 6d5ac482..00000000
--- a/rocketmq-client4cpp/src/producer/MessageQueueSelector.h
+++ /dev/null
@@ -1,96 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __MESSAGEQUEUESELECTOR_H__
-#define __MESSAGEQUEUESELECTOR_H__
-
-#include <stdlib.h>
-#include <stdio.h>
-#include <time.h>
-#include <math.h>
-#include <set>
-#include <string>
-#include <vector>
-
-#include "MessageQueue.h"
-#include "UtilAll.h"
-
-namespace rmq
-{
- class Message;
-
- class MessageQueueSelector
- {
- public:
- virtual ~MessageQueueSelector() {}
- virtual MessageQueue* select(std::vector<MessageQueue>& mqs, const Message& msg, void* arg) = 0;
- };
-
- class SelectMessageQueueByRandoom : public MessageQueueSelector
- {
- public:
- MessageQueue* select(std::vector<MessageQueue>& mqs, const Message& msg, void* arg)
- {
- srand((unsigned)time(NULL));
- int value = rand();
- value = value % mqs.size();
- return &(mqs.at(value));
- }
- };
-
- class SelectMessageQueueByHash : public MessageQueueSelector
- {
- public:
- MessageQueue* select(std::vector<MessageQueue>& mqs, const Message& msg, void* arg)
- {
- std::string* sArg = (std::string*)arg;
- int value = UtilAll::hashCode(sArg->c_str(), sArg->size());
- if (value < 0)
- {
- value = abs(value);
- }
-
- value = value % mqs.size();
- return &(mqs.at(value));
- }
- };
-
-
- class SelectMessageQueueByMachineRoom : public MessageQueueSelector
- {
- public:
- MessageQueue* select(std::vector<MessageQueue>& mqs, const Message& msg, void* arg)
- {
- // TODO Auto-generated method stub
- return NULL;
- }
-
- std::set<std::string> getConsumeridcs()
- {
- return m_consumeridcs;
- }
-
- void setConsumeridcs(const std::set<std::string>& consumeridcs)
- {
- m_consumeridcs = consumeridcs;
- }
-
- private:
- std::set<std::string> m_consumeridcs;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/producer/ProducerInvokeCallback.cpp b/rocketmq-client4cpp/src/producer/ProducerInvokeCallback.cpp
deleted file mode 100755
index 573db95c..00000000
--- a/rocketmq-client4cpp/src/producer/ProducerInvokeCallback.cpp
+++ /dev/null
@@ -1,101 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "ProducerInvokeCallback.h"
-#include "ResponseFuture.h"
-#include "SendResult.h"
-#include "MQClientAPIImpl.h"
-#include "SendCallback.h"
-#include "MQClientException.h"
-#include "RemotingCommand.h"
-
-namespace rmq
-{
-
-ProducerInvokeCallback::ProducerInvokeCallback(SendCallback* pSendCallBack,
- MQClientAPIImpl* pMQClientAPIImpl,
- const std::string& topic,
- const std::string& brokerName)
- : m_pSendCallBack(pSendCallBack),
- m_pMQClientAPIImpl(pMQClientAPIImpl),
- m_topic(topic),
- m_brokerName(brokerName)
-{
-}
-
-ProducerInvokeCallback::~ProducerInvokeCallback()
-{
- if (m_pSendCallBack)
- {
- delete m_pSendCallBack;
- m_pSendCallBack = NULL;
- }
-}
-
-void ProducerInvokeCallback::operationComplete(ResponseFuturePtr pResponseFuture)
-{
- if (m_pSendCallBack == NULL)
- {
- delete this;
- return;
- }
-
- RemotingCommand* response = pResponseFuture->getResponseCommand();
- if (response != NULL)
- {
- try
- {
- SendResult* sendResult =
- m_pMQClientAPIImpl->processSendResponse(m_brokerName, m_topic, response);
-
- assert(sendResult != NULL);
- m_pSendCallBack->onSuccess(*sendResult);
-
- delete sendResult;
- }
- catch (MQException& e)
- {
- m_pSendCallBack->onException(e);
- }
-
- delete response;
- }
- else
- {
- if (!pResponseFuture->isSendRequestOK())
- {
- std::string msg = "send request failed";
- MQClientException e(msg, -1, __FILE__, __LINE__);
- m_pSendCallBack->onException(e);
- }
- else if (pResponseFuture->isTimeout())
- {
- std::string msg = RocketMQUtil::str2fmt("wait response timeout %lld ms",
- pResponseFuture->getTimeoutMillis());
- MQClientException e(msg, -1, __FILE__, __LINE__);
- m_pSendCallBack->onException(e);
- }
- else
- {
- std::string msg = "unknow reseaon";
- MQClientException e(msg, -1, __FILE__, __LINE__);
- m_pSendCallBack->onException(e);
- }
- }
-
- delete this;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/producer/ProducerInvokeCallback.h b/rocketmq-client4cpp/src/producer/ProducerInvokeCallback.h
deleted file mode 100755
index d2c98254..00000000
--- a/rocketmq-client4cpp/src/producer/ProducerInvokeCallback.h
+++ /dev/null
@@ -1,46 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __PRODUCERINVOKECALLBACK_H__
-#define __PRODUCERINVOKECALLBACK_H__
-
-#include <string>
-#include "InvokeCallback.h"
-
-namespace rmq
-{
- class MQClientAPIImpl;
- class SendCallback;
-
- class ProducerInvokeCallback : public InvokeCallback
- {
- public:
- ProducerInvokeCallback(SendCallback* pSendCallBack,
- MQClientAPIImpl* pMQClientAPIImpl,
- const std::string& topic,
- const std::string& brokerName);
- virtual ~ProducerInvokeCallback();
- virtual void operationComplete(ResponseFuturePtr pResponseFuture);
-
- private:
- SendCallback* m_pSendCallBack;
- MQClientAPIImpl* m_pMQClientAPIImpl;
- std::string m_topic;
- std::string m_brokerName;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/producer/TopicPublishInfo.h b/rocketmq-client4cpp/src/producer/TopicPublishInfo.h
deleted file mode 100755
index 0d85b5fd..00000000
--- a/rocketmq-client4cpp/src/producer/TopicPublishInfo.h
+++ /dev/null
@@ -1,141 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __TOPICPUBLISHINFO_H__
-#define __TOPICPUBLISHINFO_H__
-
-#include <list>
-#include <vector>
-#include <string>
-#include <sstream>
-#include <math.h>
-#include <stdlib.h>
-
-#include "RocketMQClient.h"
-#include "RefHandle.h"
-#include "MessageQueue.h"
-#include "AtomicValue.h"
-#include "UtilAll.h"
-
-
-namespace rmq
-{
- class TopicPublishInfo : public kpr::RefCount
- {
- public:
- TopicPublishInfo()
- {
- m_orderTopic = false;
- m_haveTopicRouterInfo = false;
- }
-
- ~TopicPublishInfo()
- {
- m_messageQueueList.clear();
- }
-
- bool isOrderTopic()
- {
- return m_orderTopic;
- }
-
- bool ok()
- {
- return !m_messageQueueList.empty();
- }
-
- void setOrderTopic(bool orderTopic)
- {
- m_orderTopic = orderTopic;
- }
-
- std::vector<MessageQueue>& getMessageQueueList()
- {
- return m_messageQueueList;
- }
-
- void setMessageQueueList(const std::vector<MessageQueue>& messageQueueList)
- {
- m_messageQueueList = messageQueueList;
- }
-
- kpr::AtomicInteger& getSendWhichQueue()
- {
- return m_sendWhichQueue;
- }
-
- void setSendWhichQueue(kpr::AtomicInteger& sendWhichQueue)
- {
- m_sendWhichQueue = sendWhichQueue;
- }
-
- bool isHaveTopicRouterInfo()
- {
- return m_haveTopicRouterInfo;
- }
-
-
- void setHaveTopicRouterInfo(bool haveTopicRouterInfo)
- {
- m_haveTopicRouterInfo = haveTopicRouterInfo;
- }
-
- MessageQueue* selectOneMessageQueue(const std::string lastBrokerName)
- {
- if (!lastBrokerName.empty())
- {
- int index = m_sendWhichQueue++;
- for (size_t i = 0; i < m_messageQueueList.size(); i++)
- {
- int pos = abs(index++) % m_messageQueueList.size();
- MessageQueue& mq = m_messageQueueList.at(pos);
- if (mq.getBrokerName() != lastBrokerName)
- {
- return &mq;
- }
- }
-
- return NULL;
- }
- else
- {
- int index = m_sendWhichQueue++;
- int pos = abs(index) % m_messageQueueList.size();
- return &(m_messageQueueList.at(pos));
- }
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{orderTopic=" << m_orderTopic
- << ",messageQueueList=" << UtilAll::toString(m_messageQueueList)
- << ",sendWhichQueue=" << m_sendWhichQueue
- << ",haveTopicRouterInfo=" << m_haveTopicRouterInfo
- << "}";
- return ss.str();
- }
-
- private:
- bool m_orderTopic;
- std::vector<MessageQueue> m_messageQueueList;
- kpr::AtomicInteger m_sendWhichQueue;
- bool m_haveTopicRouterInfo;
- };
- typedef kpr::RefHandleT<TopicPublishInfo> TopicPublishInfoPtr;
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/producer/TransactionCheckListener.h b/rocketmq-client4cpp/src/producer/TransactionCheckListener.h
deleted file mode 100755
index 89557426..00000000
--- a/rocketmq-client4cpp/src/producer/TransactionCheckListener.h
+++ /dev/null
@@ -1,31 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __TRANSACTIONCHECKLISTENER_H__
-#define __TRANSACTIONCHECKLISTENER_H__
-
-#include "SendResult.h"
-
-namespace rmq
-{
- class TransactionCheckListener
- {
- public:
- virtual ~TransactionCheckListener() {}
- virtual LocalTransactionState checkLocalTransactionState(MessageExt* pMsg) = 0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/producer/TransactionMQProducer.h b/rocketmq-client4cpp/src/producer/TransactionMQProducer.h
deleted file mode 100755
index bee11a53..00000000
--- a/rocketmq-client4cpp/src/producer/TransactionMQProducer.h
+++ /dev/null
@@ -1,118 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __TRANSACTIONMQPRODUCER_H__
-#define __TRANSACTIONMQPRODUCER_H__
-
-#include "DefaultMQProducer.h"
-#include "DefaultMQProducerImpl.h"
-#include "MQClientException.h"
-
-namespace rmq
-{
- class TransactionMQProducer : public DefaultMQProducer
- {
- public:
- TransactionMQProducer()
- : m_pTransactionCheckListener(NULL),
- m_checkThreadPoolMinSize(1),
- m_checkThreadPoolMaxSize(1),
- m_checkRequestHoldMax(2000)
- {
-
- }
-
- TransactionMQProducer(const std::string& producerGroup)
- : DefaultMQProducer(producerGroup),
- m_pTransactionCheckListener(NULL),
- m_checkThreadPoolMinSize(1),
- m_checkThreadPoolMaxSize(1),
- m_checkRequestHoldMax(2000)
- {
-
- }
-
- void start()
- {
- m_pDefaultMQProducerImpl->initTransactionEnv();
- DefaultMQProducer::start();
- }
-
- void shutdown()
- {
- DefaultMQProducer::shutdown();
- m_pDefaultMQProducerImpl->destroyTransactionEnv();
- }
-
- TransactionSendResult sendMessageInTransaction(const Message& msg,
- LocalTransactionExecuter* tranExecuter, void* arg)
- {
- if (NULL == m_pTransactionCheckListener)
- {
- THROW_MQEXCEPTION("localTransactionBranchCheckListener is null", -1);
- }
-
- return m_pDefaultMQProducerImpl.sendMessageInTransaction(msg, tranExecuter, arg);
- }
-
- TransactionCheckListener* getTransactionCheckListener()
- {
- return m_pTransactionCheckListener;
- }
-
- void setTransactionCheckListener(TransactionCheckListener* pTransactionCheckListener)
- {
- m_pTransactionCheckListener = pTransactionCheckListener;
- }
-
- int getCheckThreadPoolMinSize()
- {
- return m_checkThreadPoolMinSize;
- }
-
- void setCheckThreadPoolMinSize(int checkThreadPoolMinSize)
- {
- m_checkThreadPoolMinSize = checkThreadPoolMinSize;
- }
-
- int getCheckThreadPoolMaxSize()
- {
- return m_checkThreadPoolMaxSize;
- }
-
- void setCheckThreadPoolMaxSize(int checkThreadPoolMaxSize)
- {
- m_checkThreadPoolMaxSize = checkThreadPoolMaxSize;
- }
-
- int getCheckRequestHoldMax()
- {
- return m_checkRequestHoldMax;
- }
-
- void setCheckRequestHoldMax(int checkRequestHoldMax)
- {
- m_checkRequestHoldMax = checkRequestHoldMax;
- }
-
- private:
- TransactionCheckListener* m_pTransactionCheckListener;
- int m_checkThreadPoolMinSize;
- int m_checkThreadPoolMaxSize;
- int m_checkRequestHoldMax;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/CommandCustomHeader.cpp b/rocketmq-client4cpp/src/protocol/CommandCustomHeader.cpp
deleted file mode 100755
index fb2d2a64..00000000
--- a/rocketmq-client4cpp/src/protocol/CommandCustomHeader.cpp
+++ /dev/null
@@ -1,672 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "CommandCustomHeader.h"
-
-#include <stdlib.h>
-#include <unistd.h>
-#include <arpa/inet.h>
-#include <sstream>
-#include <string>
-#include <cstdlib>
-#include "RemotingCommand.h"
-#include "MQProtos.h"
-#include "KPRUtil.h"
-#include "UtilAll.h"
-
-#include "json/json.h"
-
-namespace rmq
-{
-
-
-CommandCustomHeader* CommandCustomHeader::decode(int code, Json::Value& data, bool isResponseType)
-{
- CommandCustomHeader* pCustomHeader = NULL;
-
- try
- {
- if (isResponseType)
- {
- switch (code)
- {
- case SEND_MESSAGE_VALUE:
- case SEND_MESSAGE_V2_VALUE:
- pCustomHeader = SendMessageResponseHeader::decode(data);
- break;
- case PULL_MESSAGE_VALUE:
- pCustomHeader = PullMessageResponseHeader::decode(data);
- break;
- case QUERY_CONSUMER_OFFSET_VALUE:
- pCustomHeader = QueryConsumerOffsetResponseHeader::decode(data);
- break;
- case SEARCH_OFFSET_BY_TIMESTAMP_VALUE:
- pCustomHeader = SearchOffsetResponseHeader::decode(data);
- break;
- case GET_MAX_OFFSET_VALUE:
- pCustomHeader = GetMaxOffsetResponseHeader::decode(data);
- break;
- case GET_MIN_OFFSET_VALUE:
- pCustomHeader = GetMinOffsetResponseHeader::decode(data);
- break;
- case GET_EARLIEST_MSG_STORETIME_VALUE:
- pCustomHeader = GetEarliestMsgStoretimeResponseHeader::decode(data);
- break;
- case QUERY_MESSAGE_VALUE:
- pCustomHeader = QueryMessageResponseHeader::decode(data);
- break;
- case GET_KV_CONFIG_VALUE:
- pCustomHeader = GetKVConfigResponseHeader::decode(data);
- break;
-
- default:
- break;
- }
- }
- else
- {
- switch (code)
- {
- case NOTIFY_CONSUMER_IDS_CHANGED_VALUE:
- pCustomHeader = NotifyConsumerIdsChangedRequestHeader::decode(data);
- break;
- case GET_CONSUMER_RUNNING_INFO_VALUE:
- pCustomHeader = GetConsumerRunningInfoRequestHeader::decode(data);
- break;
- default:
- break;
- }
- }
- }
- catch(std::exception& e)
- {
- if (pCustomHeader != NULL)
- {
- delete pCustomHeader;
- pCustomHeader = NULL;
- }
- RMQ_ERROR("CommandCustomHeader decode exception, %d, %d, %s, %s",
- code, isResponseType, UtilAll::toString(data).c_str(), e.what());
- }
- catch(...)
- {
- if (pCustomHeader != NULL)
- {
- delete pCustomHeader;
- pCustomHeader = NULL;
- }
- RMQ_ERROR("CommandCustomHeader decode exception, %d, %d, %s",
- code, isResponseType, UtilAll::toString(data).c_str());
- }
-
- return pCustomHeader;
-}
-
-
-////////////////////////////////////////////////////////////////////////////////
-//GET_ROUTEINTO_BY_TOPIC_VALUE
-////////////////////////////////////////////////////////////////////////////////
-void GetRouteInfoRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"topic\":\"" << topic << "\""
- << "}";
-
- outData = ss.str();
-}
-
-
-////////////////////////////////////////////////////////////////////////////////
-// UPDATE_AND_CREATE_TOPIC_VALUE
-////////////////////////////////////////////////////////////////////////////////
-void CreateTopicRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
-
- ss << "{"
- << "\"topic\":\"" << topic << "\","
- << "\"defaultTopic\":\"" << defaultTopic << "\","
- << "\"readQueueNums\":\"" << readQueueNums << "\","
- << "\"writeQueueNums\":\"" << writeQueueNums << "\","
- << "\"perm\":\"" << perm << "\","
- << "\"topicFilterType\":\"" << topicFilterType << "\","
- << "\"topicSysFlag\":\"" << topicFilterType << "\","
- << "\"order\":\"" << topicFilterType << "\""
- << "}";
-
- outData = ss.str();
-}
-
-
-////////////////////////////////////////////////////////////////////////////////
-// SEND_MESSAGE_VALUE/SEND_MESSAGE_V2_VALUE
-////////////////////////////////////////////////////////////////////////////////
-void SendMessageRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
-
- ss << "{"
- << "\"producerGroup\":\"" << producerGroup << "\","
- << "\"topic\":\"" << topic << "\","
- << "\"defaultTopic\":\"" << defaultTopic << "\","
- << "\"defaultTopicQueueNums\":" << defaultTopicQueueNums << ","
- << "\"queueId\":" << queueId << ","
- << "\"sysFlag\":" << sysFlag << ","
- << "\"bornTimestamp\":" << bornTimestamp << ","
- << "\"flag\":" << flag << ","
- << "\"properties\":\"" << properties << "\","
- << "\"reconsumeTimes\":" << reconsumeTimes
- << "}";
-
- outData = ss.str();
-}
-
-void SendMessageRequestHeaderV2::encode(std::string& outData)
-{
- std::stringstream ss;
-
- ss << "{"
- << "\"a\":\"" << a << "\","
- << "\"b\":\"" << b << "\","
- << "\"c\":\"" << c << "\","
- << "\"d\":\"" << d << "\","
- << "\"e\":\"" << e << "\","
- << "\"f\":\"" << f << "\","
- << "\"g\":\"" << g << "\","
- << "\"h\":\"" << h << "\","
- << "\"i\":\"" << i << "\","
- << "\"j\":\"" << j << "\""
- << "}";
-
- outData = ss.str();
-}
-
-SendMessageRequestHeader* SendMessageRequestHeaderV2::createSendMessageRequestHeaderV1(
- const SendMessageRequestHeaderV2* v2)
-{
- SendMessageRequestHeader* v1 = new SendMessageRequestHeader();
- v1->producerGroup = v2->a;
- v1->topic = v2->b;
- v1->defaultTopic = v2->c;
- v1->defaultTopicQueueNums = v2->d;
- v1->queueId = v2->e;
- v1->sysFlag = v2->f;
- v1->bornTimestamp = v2->g;
- v1->flag = v2->h;
- v1->properties = v2->i;
- v1->reconsumeTimes = v2->j;
-
- return v1;
-}
-
-SendMessageRequestHeaderV2* SendMessageRequestHeaderV2::createSendMessageRequestHeaderV2(
- const SendMessageRequestHeader* v1)
-{
- SendMessageRequestHeaderV2* v2 = new SendMessageRequestHeaderV2();
- v2->a = v1->producerGroup;
- v2->b = v1->topic;
- v2->c = v1->defaultTopic;
- v2->d = v1->defaultTopicQueueNums;
- v2->e = v1->queueId;
- v2->f = v1->sysFlag;
- v2->g = v1->bornTimestamp;
- v2->h = v1->flag;
- v2->i = v1->properties;
- v2->j = v1->reconsumeTimes;
-
- return v2;
-}
-
-void SendMessageResponseHeader::encode(std::string& outData)
-{
-}
-
-CommandCustomHeader* SendMessageResponseHeader::decode(Json::Value& data)
-{
- std::string msgId = data["msgId"].asString();
- int queueId = atoi(data["queueId"].asCString());
- long long queueOffset = KPRUtil::str2ll(data["queueOffset"].asCString());
-
- SendMessageResponseHeader* h = new SendMessageResponseHeader();
-
- h->msgId = msgId;
- h->queueId = queueId;
- h->queueOffset = queueOffset;
-
- return h;
-}
-
-
-////////////////////////////////////////////////////////////////////////////////
-// PULL_MESSAGE_VALUE
-////////////////////////////////////////////////////////////////////////////////
-void PullMessageRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
-
- ss << "{"
- << "\"consumerGroup\":\"" << consumerGroup << "\","
- << "\"topic\":\"" << topic << "\","
- << "\"queueId\":\"" << queueId << "\","
- << "\"queueOffset\":\"" << queueOffset << "\","
- << "\"maxMsgNums\":\"" << maxMsgNums << "\","
- << "\"sysFlag\":\"" << sysFlag << "\","
- << "\"commitOffset\":\"" << commitOffset << "\","
- << "\"suspendTimeoutMillis\":\"" << suspendTimeoutMillis << "\","
- << "\"subscription\":\"" << subscription << "\","
- << "\"subVersion\":\"" << subVersion << "\""
- << "}";
-
- outData = ss.str();
-}
-
-void PullMessageResponseHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"suggestWhichBrokerId\":\"" << suggestWhichBrokerId << "\","
- << "\"nextBeginOffset\":\"" << nextBeginOffset << "\","
- << "\"minOffset\":\"" << minOffset << "\","
- << "\"maxOffset\":\"" << maxOffset << "\""
- << "}";
- outData = ss.str();
-}
-
-CommandCustomHeader* PullMessageResponseHeader::decode(Json::Value& data)
-{
- long long suggestWhichBrokerId = KPRUtil::str2ll(data["suggestWhichBrokerId"].asCString());
- long long nextBeginOffset = KPRUtil::str2ll(data["nextBeginOffset"].asCString());
- long long minOffset = KPRUtil::str2ll(data["minOffset"].asCString());
- long long maxOffset = KPRUtil::str2ll(data["maxOffset"].asCString());
-
- PullMessageResponseHeader* h = new PullMessageResponseHeader();
- h->suggestWhichBrokerId = suggestWhichBrokerId;
- h->nextBeginOffset = nextBeginOffset;
- h->minOffset = minOffset;
- h->maxOffset = maxOffset;
-
- return h;
-}
-
-
-
-////////////////////////////////////////////////////////////////////////////////
-// GET_CONSUMER_LIST_BY_GROUP_VALUE
-////////////////////////////////////////////////////////////////////////////////
-void GetConsumerListByGroupRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
-
- ss << "{"
- << "\"consumerGroup\":\"" << consumerGroup << "\""
- << "}";
-
- outData = ss.str();
-}
-
-
-////////////////////////////////////////////////////////////////////////////////
-// CONSUMER_SEND_MSG_BACK_VALUE
-////////////////////////////////////////////////////////////////////////////////
-void ConsumerSendMsgBackRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
-
- ss << "{"
- << "\"offset\":\"" << offset << "\","
- << "\"group\":\"" << group << "\","
- << "\"delayLevel\":\"" << delayLevel << "\""
- << "}";
-
- outData = ss.str();
-}
-
-
-////////////////////////////////////////////////////////////////////////////////
-// QUERY_CONSUMER_OFFSET_VALUE
-////////////////////////////////////////////////////////////////////////////////
-void QueryConsumerOffsetRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"consumerGroup\":\"" << consumerGroup << "\","
- << "\"topic\":\"" << topic << "\","
- << "\"queueId\":\"" << queueId << "\""
- << "}";
- outData = ss.str();
-}
-
-void QueryConsumerOffsetResponseHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"offset\":\"" << offset << "\""
- << "}";
- outData = ss.str();
-}
-
-CommandCustomHeader* QueryConsumerOffsetResponseHeader::decode(Json::Value& data)
-{
- long long offset = -1;
-
- if (data.isMember("offset"))
- {
- offset = KPRUtil::str2ll(data["offset"].asCString());
- }
-
- QueryConsumerOffsetResponseHeader* h = new QueryConsumerOffsetResponseHeader();
- h->offset = offset;
-
- return h;
-}
-
-
-////////////////////////////////////////////////////////////////////////////////
-// UPDATE_CONSUMER_OFFSET_VALUE
-////////////////////////////////////////////////////////////////////////////////
-void UpdateConsumerOffsetRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"consumerGroup\":\"" << consumerGroup << "\","
- << "\"topic\":\"" << topic << "\","
- << "\"queueId\":\"" << queueId << "\","
- << "\"commitOffset\":\"" << commitOffset << "\""
- << "}";
- outData = ss.str();
-}
-
-
-////////////////////////////////////////////////////////////////////////////////
-// UNREGISTER_CLIENT_VALUE
-////////////////////////////////////////////////////////////////////////////////
-void UnregisterClientRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"producerGroup\":\"" << producerGroup << "\","
- << "\"consumerGroup\":\"" << consumerGroup << "\","
- << "\"clientID\":\"" << clientID << "\""
- << "}";
- outData = ss.str();
-}
-
-
-///////////////////////////////////////////////////////////////////////
-// VIEW_MESSAGE_BY_ID_VALUE
-///////////////////////////////////////////////////////////////////////
-void ViewMessageRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"offset\":" << offset
- << "}";
- outData = ss.str();
-}
-
-
-///////////////////////////////////////////////////////////////////////
-// SEARCH_OFFSET_BY_TIMESTAMP_VALUE
-///////////////////////////////////////////////////////////////////////
-void SearchOffsetRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"topic\":\"" << topic << "\","
- << "\"queueId\":\"" << queueId << "\","
- << "\"timestamp\":\"" << timestamp << "\""
- << "}";
- outData = ss.str();
-}
-
-void SearchOffsetResponseHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"offset\":\"" << offset << "\""
- << "}";
- outData = ss.str();
-}
-
-CommandCustomHeader* SearchOffsetResponseHeader::decode(Json::Value& data)
-{
- long long offset = KPRUtil::str2ll(data["offset"].asCString());
-
- SearchOffsetResponseHeader* h = new SearchOffsetResponseHeader();
- h->offset = offset;
-
- return h;
-}
-
-
-///////////////////////////////////////////////////////////////////////
-// GET_MAX_OFFSET_VALUE
-///////////////////////////////////////////////////////////////////////
-void GetMaxOffsetRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"topic\":\"" << topic << "\","
- << "\"queueId\":\"" << queueId << "\""
- << "}";
- outData = ss.str();
-}
-
-void GetMaxOffsetResponseHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"offset\":\"" << offset << "\""
- << "}";
- outData = ss.str();
-}
-
-CommandCustomHeader* GetMaxOffsetResponseHeader::decode(Json::Value& data)
-{
- long long offset = KPRUtil::str2ll(data["offset"].asCString());
-
- GetMaxOffsetResponseHeader* h = new GetMaxOffsetResponseHeader();
- h->offset = offset;
-
- return h;
-}
-
-
-///////////////////////////////////////////////////////////////////////
-// GET_MIN_OFFSET_VALUE
-///////////////////////////////////////////////////////////////////////
-void GetMinOffsetRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"topic\":\"" << topic << "\","
- << "\"queueId\":\"" << queueId << "\""
- << "}";
- outData = ss.str();
-}
-
-void GetMinOffsetResponseHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"offset\":\"" << offset << "\""
- << "}";
- outData = ss.str();
-}
-
-CommandCustomHeader* GetMinOffsetResponseHeader::decode(Json::Value& data)
-{
- long long offset = KPRUtil::str2ll(data["offset"].asCString());
-
- GetMinOffsetResponseHeader* h = new GetMinOffsetResponseHeader();
- h->offset = offset;
-
- return h;
-}
-
-
-
-///////////////////////////////////////////////////////////////////////
-// GET_EARLIEST_MSG_STORETIME_VALUE
-///////////////////////////////////////////////////////////////////////
-void GetEarliestMsgStoretimeRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"topic\":\"" << topic << "\","
- << "\"queueId\":\"" << queueId << "\""
- << "}";
- outData = ss.str();
-}
-
-void GetEarliestMsgStoretimeResponseHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"timestamp\":\"" << timestamp << "\""
- << "}";
- outData = ss.str();
-}
-
-
-CommandCustomHeader* GetEarliestMsgStoretimeResponseHeader::decode(Json::Value& data)
-{
- long long timestamp = KPRUtil::str2ll(data["timestamp"].asCString());
-
- GetEarliestMsgStoretimeResponseHeader* h = new GetEarliestMsgStoretimeResponseHeader();
- h->timestamp = timestamp;
-
- return h;
-}
-
-
-///////////////////////////////////////////////////////////////////////
-// QUERY_MESSAGE_VALUE
-///////////////////////////////////////////////////////////////////////
-void QueryMessageRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"topic\":\"" << topic << "\","
- << "\"key\":\"" << key << "\","
- << "\"maxNum\":\"" << maxNum << "\","
- << "\"beginTimestamp\":\"" << beginTimestamp << "\","
- << "\"endTimestamp\":\"" << endTimestamp << "\""
- << "}";
- outData = ss.str();
-}
-
-void QueryMessageResponseHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"indexLastUpdateTimestamp\":\"" << indexLastUpdateTimestamp << "\","
- << "\"indexLastUpdatePhyoffset\":\"" << indexLastUpdatePhyoffset << "\""
- << "}";
- outData = ss.str();
-}
-
-CommandCustomHeader* QueryMessageResponseHeader::decode(Json::Value& data)
-{
- long long indexLastUpdateTimestamp = KPRUtil::str2ll(data["indexLastUpdateTimestamp"].asCString());
- long long indexLastUpdatePhyoffset = KPRUtil::str2ll(data["indexLastUpdatePhyoffset"].asCString());
-
- QueryMessageResponseHeader* h = new QueryMessageResponseHeader();
- h->indexLastUpdateTimestamp = indexLastUpdateTimestamp;
- h->indexLastUpdatePhyoffset = indexLastUpdatePhyoffset;
-
- return h;
-}
-
-
-///////////////////////////////////////////////////////////////////////
-// GET_KV_CONFIG_VALUE
-///////////////////////////////////////////////////////////////////////
-void GetKVConfigRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"namespace\":\"" << namespace_ << "\","
- << "\"key\":\"" << key << "\""
- << "}";
- outData = ss.str();
-}
-
-void GetKVConfigResponseHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"value\":\"" << value << "\""
- << "}";
- outData = ss.str();
-}
-
-CommandCustomHeader* GetKVConfigResponseHeader::decode(Json::Value& data)
-{
- GetKVConfigResponseHeader* h = new GetKVConfigResponseHeader();
- h->value = data["value"].asString();
-
- return h;
-}
-
-
-///////////////////////////////////////////////////////////////////////
-// NOTIFY_CONSUMER_IDS_CHANGED_VALUE
-///////////////////////////////////////////////////////////////////////
-void NotifyConsumerIdsChangedRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"consumerGroup\":\"" << consumerGroup << "\""
- << "}";
- outData = ss.str();
-}
-
-CommandCustomHeader* NotifyConsumerIdsChangedRequestHeader::decode(Json::Value& data)
-{
- NotifyConsumerIdsChangedRequestHeader* h = new NotifyConsumerIdsChangedRequestHeader();
- h->consumerGroup = data["consumerGroup"].asString();
-
- return h;
-}
-
-
-///////////////////////////////////////////////////////////////////////
-// GET_CONSUMER_RUNNING_INFO_VALUE
-///////////////////////////////////////////////////////////////////////
-void GetConsumerRunningInfoRequestHeader::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "\"consumerGroup\":\"" << consumerGroup << "\","
- << "\"clientId\":\"" << clientId << "\","
- << "\"jstackEnable\":\"" << jstackEnable << "\","
- << "}";
- outData = ss.str();
-}
-
-CommandCustomHeader* GetConsumerRunningInfoRequestHeader::decode(Json::Value& data)
-{
- GetConsumerRunningInfoRequestHeader* h = new GetConsumerRunningInfoRequestHeader();
- h->consumerGroup = data["consumerGroup"].asString();
- h->clientId = data["clientId"].asString();
- h->jstackEnable = false;//not support
-
- return h;
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/protocol/CommandCustomHeader.h b/rocketmq-client4cpp/src/protocol/CommandCustomHeader.h
deleted file mode 100755
index 93f811a8..00000000
--- a/rocketmq-client4cpp/src/protocol/CommandCustomHeader.h
+++ /dev/null
@@ -1,604 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __COMMANDCUSTOMHEADER_H__
-#define __COMMANDCUSTOMHEADER_H__
-
-#include <string>
-#include <json/json.h>
-
-namespace rmq
-{
- /**
- * RemotingCommand custom header
- *
- */
- class CommandCustomHeader
- {
- public :
- virtual ~CommandCustomHeader() {}
- virtual void encode(std::string& outData) = 0;
- static CommandCustomHeader* decode(int code, Json::Value& data, bool isResponseType);
- };
-
- ///////////////////////////////////////////////////////////////////////
- // GET_ROUTEINTO_BY_TOPIC_VALUE
- ///////////////////////////////////////////////////////////////////////
- class GetRouteInfoRequestHeader : public CommandCustomHeader
- {
- public:
- GetRouteInfoRequestHeader()
- {
- };
- ~GetRouteInfoRequestHeader() {};
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string topic;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // UPDATE_AND_CREATE_TOPIC_VALUE
- ///////////////////////////////////////////////////////////////////////
- class CreateTopicRequestHeader : public CommandCustomHeader
- {
- public:
- CreateTopicRequestHeader()
- {
- readQueueNums = 0;
- writeQueueNums = 0;
- perm = 0;
- topicSysFlag = 0;
- order = false;
- };
- ~CreateTopicRequestHeader() {};
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string topic;
- std::string defaultTopic;
- int readQueueNums;
- int writeQueueNums;
- int perm;
- std::string topicFilterType;
- int topicSysFlag;
- bool order;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // SEND_MESSAGE_VALUE/SEND_MESSAGE_V2_VALUE
- ///////////////////////////////////////////////////////////////////////
- class SendMessageRequestHeader: public CommandCustomHeader
- {
- public:
- SendMessageRequestHeader()
- : defaultTopicQueueNums(0),queueId(0),sysFlag(0),
- bornTimestamp(0),flag(0),reconsumeTimes(0)
- {
- };
- ~SendMessageRequestHeader() {};
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string producerGroup;
- std::string topic;
- std::string defaultTopic;
- int defaultTopicQueueNums;
- int queueId;
- int sysFlag;
- long long bornTimestamp;
- int flag;
- std::string properties;
- int reconsumeTimes;
- };
-
- class SendMessageRequestHeaderV2: public CommandCustomHeader
- {
- public:
- SendMessageRequestHeaderV2()
- : d(0),e(0),f(0),
- g(0),h(0),j(0)
- {
- };
- ~SendMessageRequestHeaderV2() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
- static SendMessageRequestHeader* createSendMessageRequestHeaderV1(const SendMessageRequestHeaderV2* v2);
- static SendMessageRequestHeaderV2* createSendMessageRequestHeaderV2(const SendMessageRequestHeader* v1);
- public:
- std::string a; //producerGroup
- std::string b; //topic
- std::string c; //defaultTopic
- int d; //defaultTopicQueueNums
- int e; //queueId
- int f; //sysFlag
- long long g; //bornTimestamp
- int h; //flag
- std::string i; //properties
- int j; //reconsumeTimes
- };
-
- class SendMessageResponseHeader: public CommandCustomHeader
- {
- public:
- SendMessageResponseHeader()
- {
- queueId = 0;
- queueOffset = 0;
- };
- ~SendMessageResponseHeader() {};
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string msgId;
- int queueId;
- long long queueOffset;
- };
-
-
- ///////////////////////////////////////////////////////////////////////
- // PULL_MESSAGE_VALUE
- ///////////////////////////////////////////////////////////////////////
- class PullMessageRequestHeader: public CommandCustomHeader
- {
- public:
- PullMessageRequestHeader()
- {
- queueId = 0;
- queueOffset = 0;
- maxMsgNums = 0;
- sysFlag = 0;
- commitOffset = 0;
- suspendTimeoutMillis = 0;
- subVersion = 0;
- };
- ~PullMessageRequestHeader() {};
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string consumerGroup;
- std::string topic;
- int queueId;
- long long queueOffset;
- int maxMsgNums;
- int sysFlag;
- long long commitOffset;
- long long suspendTimeoutMillis;
- std::string subscription;
- long long subVersion;
- };
-
- class PullMessageResponseHeader: public CommandCustomHeader
- {
- public:
- PullMessageResponseHeader()
- {
- suggestWhichBrokerId = 0;
- nextBeginOffset = 0;
- minOffset = 0;
- maxOffset = 0;
- };
- ~PullMessageResponseHeader() {};
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- long long suggestWhichBrokerId;
- long long nextBeginOffset;
- long long minOffset;
- long long maxOffset;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // GET_CONSUMER_LIST_BY_GROUP_VALUE
- ///////////////////////////////////////////////////////////////////////
- class GetConsumerListByGroupRequestHeader : public CommandCustomHeader
- {
- public:
- GetConsumerListByGroupRequestHeader() {};
- ~GetConsumerListByGroupRequestHeader() {};
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string consumerGroup;
- };
-
-
- ///////////////////////////////////////////////////////////////////////
- // CONSUMER_SEND_MSG_BACK_VALUE
- ///////////////////////////////////////////////////////////////////////
- class ConsumerSendMsgBackRequestHeader : public CommandCustomHeader
- {
- public:
- ConsumerSendMsgBackRequestHeader()
- {
- offset = 0;
- delayLevel = 0;
- };
- ~ConsumerSendMsgBackRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- long long offset;
- std::string group;
- int delayLevel;
- };
-
-
- ///////////////////////////////////////////////////////////////////////
- // QUERY_CONSUMER_OFFSET_VALUE
- ///////////////////////////////////////////////////////////////////////
- class QueryConsumerOffsetRequestHeader : public CommandCustomHeader
- {
- public:
- QueryConsumerOffsetRequestHeader()
- {
- queueId = 0;
- };
- ~QueryConsumerOffsetRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string consumerGroup;
- std::string topic;
- int queueId;
- };
-
- class QueryConsumerOffsetResponseHeader : public CommandCustomHeader
- {
- public:
- QueryConsumerOffsetResponseHeader()
- {
- offset = 0;
- };
- ~QueryConsumerOffsetResponseHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- long long offset;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // UPDATE_CONSUMER_OFFSET_VALUE
- ///////////////////////////////////////////////////////////////////////
- class UpdateConsumerOffsetRequestHeader : public CommandCustomHeader
- {
- public:
- UpdateConsumerOffsetRequestHeader()
- {
- queueId = 0;
- commitOffset = 0;
- };
- ~UpdateConsumerOffsetRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string consumerGroup;
- std::string topic;
- int queueId;
- long long commitOffset;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // UNREGISTER_CLIENT_VALUE
- ///////////////////////////////////////////////////////////////////////
- class UnregisterClientRequestHeader : public CommandCustomHeader
- {
- public:
- UnregisterClientRequestHeader() {};
- ~UnregisterClientRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string clientID;
- std::string producerGroup;
- std::string consumerGroup;
- };
-
-
- ///////////////////////////////////////////////////////////////////////
- // VIEW_MESSAGE_BY_ID_VALUE
- ///////////////////////////////////////////////////////////////////////
- class ViewMessageRequestHeader : public CommandCustomHeader
- {
- public:
- ViewMessageRequestHeader()
- {
- offset = 0;
- };
- ~ViewMessageRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- long long offset;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // SEARCH_OFFSET_BY_TIMESTAMP_VALUE
- ///////////////////////////////////////////////////////////////////////
- class SearchOffsetRequestHeader : public CommandCustomHeader
- {
- public:
- SearchOffsetRequestHeader()
- {
- queueId = 0;
- timestamp = 0;
- };
- ~SearchOffsetRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string topic;
- int queueId;
- long long timestamp;
- };
-
- class SearchOffsetResponseHeader : public CommandCustomHeader
- {
- public:
- SearchOffsetResponseHeader()
- {
- offset = 0;
- };
- ~SearchOffsetResponseHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- long long offset;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // GET_MAX_OFFSET_VALUE
- ///////////////////////////////////////////////////////////////////////
- class GetMaxOffsetRequestHeader : public CommandCustomHeader
- {
- public:
- GetMaxOffsetRequestHeader()
- {
- queueId = 0;
- };
- ~GetMaxOffsetRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string topic;
- int queueId;
- };
-
- class GetMaxOffsetResponseHeader : public CommandCustomHeader
- {
- public:
- GetMaxOffsetResponseHeader()
- {
- offset = 0;
- };
- ~GetMaxOffsetResponseHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- long long offset;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // GET_MIN_OFFSET_VALUE
- ///////////////////////////////////////////////////////////////////////
- class GetMinOffsetRequestHeader : public CommandCustomHeader
- {
- public:
- GetMinOffsetRequestHeader()
- {
- queueId = 0;
- };
- ~GetMinOffsetRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string topic;
- int queueId;
- };
-
- class GetMinOffsetResponseHeader : public CommandCustomHeader
- {
- public:
- GetMinOffsetResponseHeader()
- {
- offset = 0;
- };
- ~GetMinOffsetResponseHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- long long offset;
- };
-
-
- ///////////////////////////////////////////////////////////////////////
- // GET_EARLIEST_MSG_STORETIME_VALUE
- ///////////////////////////////////////////////////////////////////////
- class GetEarliestMsgStoretimeRequestHeader : public CommandCustomHeader
- {
- public:
- GetEarliestMsgStoretimeRequestHeader()
- {
- queueId = 0;
- };
- ~GetEarliestMsgStoretimeRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string topic;
- int queueId;
- };
-
- class GetEarliestMsgStoretimeResponseHeader : public CommandCustomHeader
- {
- public:
- GetEarliestMsgStoretimeResponseHeader()
- {
- timestamp = 0;
- };
- ~GetEarliestMsgStoretimeResponseHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- long long timestamp;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // QUERY_MESSAGE_VALUE
- ///////////////////////////////////////////////////////////////////////
- class QueryMessageRequestHeader : public CommandCustomHeader
- {
- public:
- QueryMessageRequestHeader()
- {
- maxNum = 0;
- beginTimestamp = 0;
- endTimestamp = 0;
- };
- ~QueryMessageRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string topic;
- std::string key;
- int maxNum;
- long long beginTimestamp;
- long long endTimestamp;
- };
-
- class QueryMessageResponseHeader : public CommandCustomHeader
- {
- public:
- QueryMessageResponseHeader()
- {
- indexLastUpdateTimestamp = 0;
- indexLastUpdatePhyoffset = 0;
- };
- ~QueryMessageResponseHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- long long indexLastUpdateTimestamp;
- long long indexLastUpdatePhyoffset;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // GET_KV_CONFIG_VALUE
- ///////////////////////////////////////////////////////////////////////
- class GetKVConfigRequestHeader : public CommandCustomHeader
- {
- public:
- GetKVConfigRequestHeader() {};
- ~GetKVConfigRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string namespace_;
- std::string key;
- };
-
- class GetKVConfigResponseHeader : public CommandCustomHeader
- {
- public:
- GetKVConfigResponseHeader() {};
- ~GetKVConfigResponseHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string value;
- };
-
- ///////////////////////////////////////////////////////////////////////
- // NOTIFY_CONSUMER_IDS_CHANGED_VALUE
- ///////////////////////////////////////////////////////////////////////
- class NotifyConsumerIdsChangedRequestHeader : public CommandCustomHeader
- {
- public:
- NotifyConsumerIdsChangedRequestHeader() {};
- ~NotifyConsumerIdsChangedRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string consumerGroup;
- };
-
-
- ///////////////////////////////////////////////////////////////////////
- // GET_CONSUMER_RUNNING_INFO_VALUE
- ///////////////////////////////////////////////////////////////////////
- class GetConsumerRunningInfoRequestHeader : public CommandCustomHeader
- {
- public:
- GetConsumerRunningInfoRequestHeader() {};
- ~GetConsumerRunningInfoRequestHeader() {};
-
- virtual void encode(std::string& outData);
- static CommandCustomHeader* decode(Json::Value& data);
-
- public:
- std::string consumerGroup;
- std::string clientId;
- bool jstackEnable;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/ConsumerRunningInfo.cpp b/rocketmq-client4cpp/src/protocol/ConsumerRunningInfo.cpp
deleted file mode 100755
index 58cecdeb..00000000
--- a/rocketmq-client4cpp/src/protocol/ConsumerRunningInfo.cpp
+++ /dev/null
@@ -1,168 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "ConsumerRunningInfo.h"
-
-namespace rmq
-{
-
-const std::string ConsumerRunningInfo::PROP_NAMESERVER_ADDR = "PROP_NAMESERVER_ADDR";
-const std::string ConsumerRunningInfo::PROP_THREADPOOL_CORE_SIZE = "PROP_THREADPOOL_CORE_SIZE";
-const std::string ConsumerRunningInfo::PROP_CONSUME_ORDERLY = "PROP_CONSUMEORDERLY";
-const std::string ConsumerRunningInfo::PROP_CONSUME_TYPE = "PROP_CONSUME_TYPE";
-const std::string ConsumerRunningInfo::PROP_CLIENT_VERSION = "PROP_CLIENT_VERSION";
-const std::string ConsumerRunningInfo::PROP_CONSUMER_START_TIMESTAMP = "PROP_CONSUMER_START_TIMESTAMP";
-
-
-ConsumerRunningInfo::ConsumerRunningInfo()
-{
-}
-
-ConsumerRunningInfo::~ConsumerRunningInfo()
-{
-}
-
-void ConsumerRunningInfo::encode(std::string& outData)
-{
- std::stringstream ss;
- ss << "{"
- << "}";
- outData = ss.str();
-}
-
-
-std::string ConsumerRunningInfo::formatString()
-{
- std::string sb = "rocketmq-client4cpp not suppport this feature";
-
- /*
- // 1
- {
- sb.append("#Consumer Properties#\n");
- Iterator<Entry<Object, Object>> it = m_properties.entrySet().iterator();
- while (it.hasNext()) {
- Entry<Object, Object> next = it.next();
- String item =
- String.format("%-40s: %s\n", next.getKey().toString(), next.getValue().toString());
- sb.append(item);
- }
- }
-
- // 2
- {
- sb.append("\n\n#Consumer Subscription#\n");
-
- Iterator<SubscriptionData> it = m_subscriptionSet.iterator();
- int i = 0;
- while (it.hasNext()) {
- SubscriptionData next = it.next();
- String item = String.format("%03d Topic: %-40s ClassFilter: %-8s SubExpression: %s\n", //
- ++i,//
- next.getTopic(),//
- next.isClassFilterMode(),//
- next.getSubString());
-
- sb.append(item);
- }
- }
-
- // 3
- {
- sb.append("\n\n#Consumer Offset#\n");
- sb.append(String.format("%-32s %-32s %-4s %-20s\n",//
- "#Topic",//
- "#Broker Name",//
- "#QID",//
- "#Consumer Offset"//
- ));
-
- Iterator<Entry<MessageQueue, ProcessQueueInfo>> it = m_mqTable.entrySet().iterator();
- while (it.hasNext()) {
- Entry<MessageQueue, ProcessQueueInfo> next = it.next();
- String item = String.format("%-32s %-32s %-4d %-20d\n",//
- next.getKey().getTopic(),//
- next.getKey().getBrokerName(),//
- next.getKey().getQueueId(),//
- next.getValue().getCommitOffset());
-
- sb.append(item);
- }
- }
-
- // 4
- {
- sb.append("\n\n#Consumer MQ Detail#\n");
- sb.append(String.format("%-32s %-32s %-4s %-20s\n",//
- "#Topic",//
- "#Broker Name",//
- "#QID",//
- "#ProcessQueueInfo"//
- ));
-
- Iterator<Entry<MessageQueue, ProcessQueueInfo>> it = m_mqTable.entrySet().iterator();
- while (it.hasNext()) {
- Entry<MessageQueue, ProcessQueueInfo> next = it.next();
- String item = String.format("%-32s %-32s %-4d %s\n",//
- next.getKey().getTopic(),//
- next.getKey().getBrokerName(),//
- next.getKey().getQueueId(),//
- next.getValue().toString());
-
- sb.append(item);
- }
- }
-
- // 5
- {
- sb.append("\n\n#Consumer RT&TPS#\n");
- sb.append(String.format("%-32s %14s %14s %14s %14s %18s %25s\n",//
- "#Topic",//
- "#Pull RT",//
- "#Pull TPS",//
- "#Consume RT",//
- "#ConsumeOK TPS",//
- "#ConsumeFailed TPS",//
- "#ConsumeFailedMsgsInHour"//
- ));
-
- Iterator<Entry<String, ConsumeStatus>> it = m_statusTable.entrySet().iterator();
- while (it.hasNext()) {
- Entry<String, ConsumeStatus> next = it.next();
- String item = String.format("%-32s %14.2f %14.2f %14.2f %14.2f %18.2f %25d\n",//
- next.getKey(),//
- next.getValue().getPullRT(),//
- next.getValue().getPullTPS(),//
- next.getValue().getConsumeRT(),//
- next.getValue().getConsumeOKTPS(),//
- next.getValue().getConsumeFailedTPS(),//
- next.getValue().getConsumeFailedMsgs()//
- );
-
- sb.append(item);
- }
- }
-
- // 6
- if (m_jstack != null) {
- sb.append("\n\n#Consumer jstack#\n");
- sb.append(m_jstack);
- }
- */
-
- return sb;
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/protocol/ConsumerRunningInfo.h b/rocketmq-client4cpp/src/protocol/ConsumerRunningInfo.h
deleted file mode 100755
index 588bf073..00000000
--- a/rocketmq-client4cpp/src/protocol/ConsumerRunningInfo.h
+++ /dev/null
@@ -1,97 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __ConsumerRunningInfo_H__
-#define __ConsumerRunningInfo_H__
-
-#include <string>
-#include <set>
-#include <map>
-
-#include "RemotingSerializable.h"
-#include "MessageQueue.h"
-#include "SubscriptionData.h"
-#include "ConsumerStatManage.h"
-
-namespace rmq
-{
- class ConsumerRunningInfo : public RemotingSerializable
- {
- public:
- ConsumerRunningInfo();
- ~ConsumerRunningInfo();
-
- /*
- std::map<std::string, std::string>& getProperties()
- {
- return m_properties;
- }
- void setProperties(const std::map<std::string, std::string>& properties)
- {
- m_properties = properties;
- }
-
- std::map<MessageQueue, ProcessQueueInfo>& getMqTable()
- {
- return m_mqTable;
- }
- void setMqTable(const std::map<MessageQueue, ProcessQueueInfo>& mqTable)
- {
- m_mqTable = mqTable;
- }
-
- std::map<std::string, ConsumeStatus>& getStatusTable()
- {
- return m_statusTable;
- }
- void setStatusTable(const std::map<std::string, ConsumeStatus>& statusTable)
- {
- m_statusTable = statusTable;
- }
-
- std::set<SubscriptionData>& getSubscriptionSet()
- {
- return m_subscriptionSet;
- }
- void setSubscriptionSet(const std::set<SubscriptionData>& subscriptionSet)
- {
- m_subscriptionSet = subscriptionSet;
- }
- */
-
- void encode(std::string& outData);
- std::string formatString();
-
- public:
- static const std::string PROP_NAMESERVER_ADDR;
- static const std::string PROP_THREADPOOL_CORE_SIZE;
- static const std::string PROP_CONSUME_ORDERLY;
- static const std::string PROP_CONSUME_TYPE;
- static const std::string PROP_CLIENT_VERSION;
- static const std::string PROP_CONSUMER_START_TIMESTAMP;
-
- private:
- /*
- std::map<std::string, std::string> m_properties;
- std::set<SubscriptionData> m_subscriptionSet;
- std::map<MessageQueue, ProcessQueueInfo> m_mqTable;
- std::map<string, ConsumerStat> m_statusTable;
- std::string m_jstack;
- */
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/GetConsumerListByGroupResponseBody.h b/rocketmq-client4cpp/src/protocol/GetConsumerListByGroupResponseBody.h
deleted file mode 100755
index 0ea19dad..00000000
--- a/rocketmq-client4cpp/src/protocol/GetConsumerListByGroupResponseBody.h
+++ /dev/null
@@ -1,97 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __GETCONSUMERLISTBYGROUPRESPONSEBODY_H__
-#define __GETCONSUMERLISTBYGROUPRESPONSEBODY_H__
-
-#include <string>
-#include <sstream>
-#include <list>
-#include "UtilAll.h"
-#include "RemotingSerializable.h"
-
-namespace rmq
-{
- class GetConsumerListByGroupResponseBody : public RemotingSerializable
- {
- public:
- GetConsumerListByGroupResponseBody()
- {
-
- }
-
- ~GetConsumerListByGroupResponseBody()
- {
-
- }
-
- void encode(std::string& outData)
- {
-
- }
-
- static GetConsumerListByGroupResponseBody* decode(const char* pData, int len)
- {
- /*
- {"consumerIdList":["10.12.22.213@DEFAULT", "10.12.22.213@xxx"]}
- */
- //RMQ_DEBUG("GET_CONSUMER_LIST_BY_GROUP_VALUE:%s", pData);
-
- Json::Reader reader;
- Json::Value object;
- if (!reader.parse(pData, pData + len, object))
- {
- RMQ_ERROR("parse fail: %s", reader.getFormattedErrorMessages().c_str());
- return NULL;
- }
-
- GetConsumerListByGroupResponseBody* rsp = new GetConsumerListByGroupResponseBody();
- Json::Value cidList = object["consumerIdList"];
- for (size_t i = 0; i < cidList.size(); i++)
- {
- Json::Value cid = cidList[i];
- if (cid != Json::Value::null)
- {
- rsp->m_consumerIdList.push_back(cid.asString());
- }
- }
-
- return rsp;
- }
-
- std::list<std::string>& getConsumerIdList()
- {
- return m_consumerIdList;
- }
-
- void setConsumerIdList(const std::list<std::string>& consumerIdList)
- {
- m_consumerIdList = consumerIdList;
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{consumerIdList=" << UtilAll::toString(m_consumerIdList) << "}";
- return ss.str();
- }
-
- private:
- std::list<std::string> m_consumerIdList;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/HeartbeatData.cpp b/rocketmq-client4cpp/src/protocol/HeartbeatData.cpp
deleted file mode 100755
index 73f197aa..00000000
--- a/rocketmq-client4cpp/src/protocol/HeartbeatData.cpp
+++ /dev/null
@@ -1,52 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "HeartbeatData.h"
-
-namespace rmq
-{
-
-void HeartbeatData::encode(std::string& outData)
-{
- //{"clientID":"10.6.223.90@16164","consumerDataSet":[{"consumeFromWhere":"CONSUME_FROM_LAST_OFFSET","consumeType":"CONSUME_ACTIVELY","groupName":"please_rename_unique_group_name_5","messageModel":"CLUSTERING","subscriptionDataSet":[],"unitMode":false}],"producerDataSet":[{"groupName":"CLIENT_INNER_PRODUCER"}]}
- Json::Value obj;
- obj["clientID"] = m_clientID;
-
- Json::Value consumerDataSet(Json::arrayValue);
- for (typeof(m_consumerDataSet.begin()) it = m_consumerDataSet.begin(); it != m_consumerDataSet.end(); it++)
- {
- Json::Value o;
- (*it).toJson(o);
- consumerDataSet.append(o);
- }
- obj["consumerDataSet"] = consumerDataSet;
-
- Json::Value producerDataSet(Json::arrayValue);
- for (typeof(m_producerDataSet.begin()) it = m_producerDataSet.begin(); it != m_producerDataSet.end(); it++)
- {
- Json::Value o;
- it->toJson(o);
- producerDataSet.append(o);
- }
- obj["producerDataSet"] = producerDataSet;
-
- Json::FastWriter outer;
- outData = outer.write(obj);
-}
-
-
-
-
-}
diff --git a/rocketmq-client4cpp/src/protocol/HeartbeatData.h b/rocketmq-client4cpp/src/protocol/HeartbeatData.h
deleted file mode 100755
index cb0f720c..00000000
--- a/rocketmq-client4cpp/src/protocol/HeartbeatData.h
+++ /dev/null
@@ -1,157 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __HEARTBEATDATA_H__
-#define __HEARTBEATDATA_H__
-
-#include <string>
-#include <set>
-#include <sstream>
-
-#include "RocketMQClient.h"
-#include "ConsumeType.h"
-#include "SubscriptionData.h"
-#include "RemotingSerializable.h"
-#include "UtilAll.h"
-
-namespace rmq
-{
- struct ConsumerData
- {
- std::string groupName;
- ConsumeType consumeType;
- MessageModel messageModel;
- ConsumeFromWhere consumeFromWhere;
- std::set<SubscriptionData> subscriptionDataSet;
- bool operator < (const ConsumerData& cd)const
- {
- return groupName < cd.groupName;
- }
-
- void toJson(Json::Value& obj) const
- {
- //{"consumeFromWhere":"CONSUME_FROM_LAST_OFFSET","consumeType":"CONSUME_ACTIVELY","groupName":"please_rename_unique_group_name_5","messageModel":"CLUSTERING","subscriptionDataSet":[],"unitMode":false}
- obj["groupName"] = groupName;
- obj["messageModel"] = getMessageModelString(messageModel);
- obj["consumeFromWhere"] = getConsumeFromWhereString(consumeFromWhere);
- obj["consumeType"] = getConsumeTypeString(consumeType);
- obj["unitMode"] = false;
-
- Json::Value objSub(Json::arrayValue);
- RMQ_FOR_EACH(subscriptionDataSet, it)
- {
- Json::Value o;
- (*it).toJson(o);
- objSub.append(o);
- }
- obj["subscriptionDataSet"] = objSub;
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{groupName=" << groupName
- << ",messageModel=" << getMessageModelString(messageModel)
- << ",consumeFromWhere=" << getConsumeFromWhereString(consumeFromWhere)
- << ",consumeType=" << getConsumeTypeString(consumeType)
- << ",subscriptionDataSet=" << UtilAll::toString(subscriptionDataSet)
- << "}";
- return ss.str();
- }
- };
- inline std::ostream& operator<<(std::ostream& os, const ConsumerData& obj)
- {
- os << obj.toString();
- return os;
- }
-
- struct ProducerData
- {
- std::string groupName;
- bool operator < (const ProducerData& pd)const
- {
- return groupName < pd.groupName;
- }
- void toJson(Json::Value& obj) const
- {
- obj["groupName"] = groupName;
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{groupName=" << groupName << "}";
- return ss.str();
- }
- };
- inline std::ostream& operator<<(std::ostream& os, const ProducerData& obj)
- {
- os << obj.toString();
- return os;
- }
-
-
- class HeartbeatData : public RemotingSerializable
- {
- public:
- void encode(std::string& outData);
-
- std::string getClientID()
- {
- return m_clientID;
- }
-
- void setClientID(const std::string& clientID)
- {
- m_clientID = clientID;
- }
-
- std::set<ProducerData>& getProducerDataSet()
- {
- return m_producerDataSet;
- }
-
- void setProducerDataSet(const std::set<ProducerData>& producerDataSet)
- {
- m_producerDataSet = producerDataSet;
- }
-
- std::set<ConsumerData>& getConsumerDataSet()
- {
- return m_consumerDataSet;
- }
-
- void setConsumerDataSet(const std::set<ConsumerData>& consumerDataSet)
- {
- m_consumerDataSet = consumerDataSet;
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{clientID=" << m_clientID
- << ",producerDataSet=" << UtilAll::toString(m_producerDataSet)
- << ",consumerDataSet=" << UtilAll::toString(m_consumerDataSet) << "}";
- return ss.str();
- }
-
- private:
- std::string m_clientID;
- std::set<ProducerData> m_producerDataSet;
- std::set<ConsumerData> m_consumerDataSet;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/KVTable.h b/rocketmq-client4cpp/src/protocol/KVTable.h
deleted file mode 100755
index 726b872b..00000000
--- a/rocketmq-client4cpp/src/protocol/KVTable.h
+++ /dev/null
@@ -1,58 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __KVTABLE_H__
-#define __KVTABLE_H__
-
-#include <map>
-#include <string>
-#include "RemotingSerializable.h"
-#include "UtilAll.h"
-
-namespace rmq
-{
- class KVTable : public RemotingSerializable
- {
- public:
- void encode(std::string& outData)
- {
-
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{table=" << UtilAll::toString(m_table)
- << "}";
- return ss.str();
- }
-
- const std::map<std::string, std::string>& getTable()
- {
- return m_table;
- }
-
- void setTable(const std::map<std::string, std::string>& table)
- {
- m_table = table;
- }
-
- private:
- std::map<std::string, std::string> m_table ;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/LockBatchBody.cpp b/rocketmq-client4cpp/src/protocol/LockBatchBody.cpp
deleted file mode 100755
index 947abe29..00000000
--- a/rocketmq-client4cpp/src/protocol/LockBatchBody.cpp
+++ /dev/null
@@ -1,112 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "LockBatchBody.h"
-#include "UtilAll.h"
-
-namespace rmq
-{
-
-LockBatchRequestBody::LockBatchRequestBody()
-{
-}
-
-LockBatchRequestBody::~LockBatchRequestBody()
-{
-}
-
-void LockBatchRequestBody::encode(std::string& outData)
-{
-
-}
-
-std::string LockBatchRequestBody::toString() const
-{
- std::stringstream ss;
- ss << "{consumerGroup=" << m_consumerGroup
- << ",clientId=" << m_clientId
- << ",mqSet=" << UtilAll::toString(m_mqSet)
- << "}";
- return ss.str();
-}
-
-
-std::string LockBatchRequestBody::getConsumerGroup()
-{
- return m_consumerGroup;
-}
-
-void LockBatchRequestBody::setConsumerGroup(const std::string& consumerGroup)
-{
- m_consumerGroup = consumerGroup;
-}
-
-std::string LockBatchRequestBody::getClientId()
-{
- return m_clientId;
-}
-
-void LockBatchRequestBody::setClientId(const std::string& clientId)
-{
- m_clientId = clientId;
-}
-
-std::set<MessageQueue>& LockBatchRequestBody::getMqSet()
-{
- return m_mqSet;
-}
-
-void LockBatchRequestBody::setMqSet(const std::set<MessageQueue>& mqSet)
-{
- m_mqSet = mqSet;
-}
-
-LockBatchResponseBody::LockBatchResponseBody()
-{
-}
-
-LockBatchResponseBody::~LockBatchResponseBody()
-{
-}
-
-void LockBatchResponseBody::encode(std::string& outData)
-{
-}
-
-std::string LockBatchResponseBody::toString() const
-{
- std::stringstream ss;
- ss << "{consumerGroup=" << UtilAll::toString(m_lockOKMQSet)
- << "}";
- return ss.str();
-}
-
-
-LockBatchResponseBody* LockBatchResponseBody::decode(const char* pData, int len)
-{
- return new LockBatchResponseBody();
-}
-
-std::set<MessageQueue> LockBatchResponseBody::getLockOKMQSet()
-{
- return m_lockOKMQSet;
-}
-
-void LockBatchResponseBody::setLockOKMQSet(const std::set<MessageQueue>& lockOKMQSet)
-{
- m_lockOKMQSet = lockOKMQSet;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/protocol/LockBatchBody.h b/rocketmq-client4cpp/src/protocol/LockBatchBody.h
deleted file mode 100755
index ab9ee02b..00000000
--- a/rocketmq-client4cpp/src/protocol/LockBatchBody.h
+++ /dev/null
@@ -1,73 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __LOCKBATCHBODY_H__
-#define __LOCKBATCHBODY_H__
-
-#include <string>
-#include <set>
-
-#include "RemotingSerializable.h"
-#include "MessageQueue.h"
-
-namespace rmq
-{
- class LockBatchRequestBody : public RemotingSerializable
- {
- public:
- LockBatchRequestBody();
- ~LockBatchRequestBody();
-
- void encode(std::string& outData);
- std::string toString() const;
-
- std::string getConsumerGroup();
- void setConsumerGroup(const std::string& consumerGroup);
-
- std::string getClientId();
- void setClientId(const std::string& clientId);
-
- std::set<MessageQueue>& getMqSet();
- void setMqSet(const std::set<MessageQueue>& mqSet);
-
- private:
- std::string m_consumerGroup;
- std::string m_clientId;
- std::set<MessageQueue> m_mqSet;
- };
-
- class LockBatchResponseBody : public RemotingSerializable
- {
- public:
- LockBatchResponseBody();
- ~LockBatchResponseBody();
-
- void encode(std::string& outData);
- std::string toString() const;
-
- static LockBatchResponseBody* decode(const char* pData, int len);
-
- std::set<MessageQueue> getLockOKMQSet();
- void setLockOKMQSet(const std::set<MessageQueue>& lockOKMQSet);
-
- private:
- std::set<MessageQueue> m_lockOKMQSet;
- };
-
- typedef LockBatchRequestBody UnlockBatchRequestBody;
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/MQProtos.cpp b/rocketmq-client4cpp/src/protocol/MQProtos.cpp
deleted file mode 100755
index 052c104c..00000000
--- a/rocketmq-client4cpp/src/protocol/MQProtos.cpp
+++ /dev/null
@@ -1,248 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#include "MQProtos.h"
-
-namespace rmq
-{
-
-const char* getMQRequestCodeString(int code)
-{
- switch (code)
- {
- case SEND_MESSAGE_VALUE:
- return "SEND_MESSAGE_VALUE";
- case PULL_MESSAGE_VALUE:
- return "PULL_MESSAGE_VALUE";
- case QUERY_MESSAGE_VALUE:
- return "QUERY_MESSAGE_VALUE";
- case QUERY_BROKER_OFFSET_VALUE:
- return "QUERY_BROKER_OFFSET_VALUE";
- case QUERY_CONSUMER_OFFSET_VALUE:
- return "QUERY_CONSUMER_OFFSET_VALUE";
- case UPDATE_CONSUMER_OFFSET_VALUE:
- return "UPDATE_CONSUMER_OFFSET_VALUE";
- case UPDATE_AND_CREATE_TOPIC_VALUE:
- return "UPDATE_AND_CREATE_TOPIC_VALUE";
- case GET_ALL_TOPIC_CONFIG_VALUE:
- return "GET_ALL_TOPIC_CONFIG_VALUE";
- case GET_TOPIC_CONFIG_LIST_VALUE:
- return "GET_TOPIC_CONFIG_LIST_VALUE";
- case GET_TOPIC_NAME_LIST_VALUE:
- return "GET_TOPIC_NAME_LIST_VALUE";
- case UPDATE_BROKER_CONFIG_VALUE:
- return "UPDATE_BROKER_CONFIG_VALUE";
- case GET_BROKER_CONFIG_VALUE:
- return "GET_BROKER_CONFIG_VALUE";
- case TRIGGER_DELETE_FILES_VALUE:
- return "TRIGGER_DELETE_FILES_VALUE";
- case GET_BROKER_RUNTIME_INFO_VALUE:
- return "GET_BROKER_RUNTIME_INFO_VALUE";
- case SEARCH_OFFSET_BY_TIMESTAMP_VALUE:
- return "SEARCH_OFFSET_BY_TIMESTAMP_VALUE";
- case GET_MAX_OFFSET_VALUE:
- return "GET_MAX_OFFSET_VALUE";
- case GET_MIN_OFFSET_VALUE:
- return "GET_MIN_OFFSET_VALUE";
- case GET_EARLIEST_MSG_STORETIME_VALUE:
- return "GET_EARLIEST_MSG_STORETIME_VALUE";
- case VIEW_MESSAGE_BY_ID_VALUE:
- return "VIEW_MESSAGE_BY_ID_VALUE";
- case HEART_BEAT_VALUE:
- return "HEART_BEAT_VALUE";
- case UNREGISTER_CLIENT_VALUE:
- return "UNREGISTER_CLIENT_VALUE";
- case CONSUMER_SEND_MSG_BACK_VALUE:
- return "CONSUMER_SEND_MSG_BACK_VALUE";
- case END_TRANSACTION_VALUE:
- return "END_TRANSACTION_VALUE";
- case GET_CONSUMER_LIST_BY_GROUP_VALUE:
- return "GET_CONSUMER_LIST_BY_GROUP_VALUE";
- case CHECK_TRANSACTION_STATE_VALUE:
- return "CHECK_TRANSACTION_STATE_VALUE";
- case NOTIFY_CONSUMER_IDS_CHANGED_VALUE:
- return "NOTIFY_CONSUMER_IDS_CHANGED_VALUE";
- case LOCK_BATCH_MQ_VALUE:
- return "LOCK_BATCH_MQ_VALUE";
- case UNLOCK_BATCH_MQ_VALUE:
- return "UNLOCK_BATCH_MQ_VALUE";
- case GET_ALL_CONSUMER_OFFSET_VALUE:
- return "GET_ALL_CONSUMER_OFFSET_VALUE";
- case GET_ALL_DELAY_OFFSET_VALUE:
- return "GET_ALL_DELAY_OFFSET_VALUE";
- case PUT_KV_CONFIG_VALUE:
- return "PUT_KV_CONFIG_VALUE";
- case GET_KV_CONFIG_VALUE:
- return "GET_KV_CONFIG_VALUE";
- case DELETE_KV_CONFIG_VALUE:
- return "DELETE_KV_CONFIG_VALUE";
- case REGISTER_BROKER_VALUE:
- return "REGISTER_BROKER_VALUE";
- case UNREGISTER_BROKER_VALUE:
- return "UNREGISTER_BROKER_VALUE";
- case GET_ROUTEINTO_BY_TOPIC_VALUE:
- return "GET_ROUTEINTO_BY_TOPIC_VALUE";
- case GET_BROKER_CLUSTER_INFO_VALUE:
- return "GET_BROKER_CLUSTER_INFO_VALUE";
- case UPDATE_AND_CREATE_SUBSCRIPTIONGROUP_VALUE:
- return "UPDATE_AND_CREATE_SUBSCRIPTIONGROUP_VALUE";
- case GET_ALL_SUBSCRIPTIONGROUP_CONFIG_VALUE:
- return "GET_ALL_SUBSCRIPTIONGROUP_CONFIG_VALUE";
- case GET_TOPIC_STATS_INFO_VALUE:
- return "GET_TOPIC_STATS_INFO_VALUE";
- case GET_CONSUMER_CONNECTION_LIST_VALUE:
- return "GET_CONSUMER_CONNECTION_LIST_VALUE";
- case GET_PRODUCER_CONNECTION_LIST_VALUE:
- return "GET_PRODUCER_CONNECTION_LIST_VALUE";
- case WIPE_WRITE_PERM_OF_BROKER_VALUE:
- return "WIPE_WRITE_PERM_OF_BROKER_VALUE";
- case GET_ALL_TOPIC_LIST_FROM_NAMESERVER_VALUE:
- return "GET_ALL_TOPIC_LIST_FROM_NAMESERVER_VALUE";
- case DELETE_SUBSCRIPTIONGROUP_VALUE:
- return "DELETE_SUBSCRIPTIONGROUP_VALUE";
- case GET_CONSUME_STATS_VALUE:
- return "GET_CONSUME_STATS_VALUE";
- case SUSPEND_CONSUMER_VALUE:
- return "SUSPEND_CONSUMER_VALUE";
- case RESUME_CONSUMER_VALUE:
- return "RESUME_CONSUMER_VALUE";
- case RESET_CONSUMER_OFFSET_IN_CONSUMER_VALUE:
- return "RESET_CONSUMER_OFFSET_IN_CONSUMER_VALUE";
- case RESET_CONSUMER_OFFSET_IN_BROKER_VALUE:
- return "RESET_CONSUMER_OFFSET_IN_BROKER_VALUE";
- case ADJUST_CONSUMER_THREAD_POOL_VALUE:
- return "ADJUST_CONSUMER_THREAD_POOL_VALUE";
- case WHO_CONSUME_THE_MESSAGE_VALUE:
- return "WHO_CONSUME_THE_MESSAGE_VALUE";
- case DELETE_TOPIC_IN_BROKER_VALUE:
- return "DELETE_TOPIC_IN_BROKER_VALUE";
- case DELETE_TOPIC_IN_NAMESRV_VALUE:
- return "DELETE_TOPIC_IN_NAMESRV_VALUE";
- case GET_KV_CONFIG_BY_VALUE_VALUE:
- return "GET_KV_CONFIG_BY_VALUE_VALUE";
- case DELETE_KV_CONFIG_BY_VALUE_VALUE:
- return "DELETE_KV_CONFIG_BY_VALUE_VALUE";
- case GET_KVLIST_BY_NAMESPACE_VALUE:
- return "GET_KVLIST_BY_NAMESPACE_VALUE";
- case RESET_CONSUMER_CLIENT_OFFSET_VALUE:
- return "RESET_CONSUMER_CLIENT_OFFSET_VALUE";
- case GET_CONSUMER_STATUS_FROM_CLIENT_VALUE:
- return "GET_CONSUMER_STATUS_FROM_CLIENT_VALUE";
- case INVOKE_BROKER_TO_RESET_OFFSET_VALUE:
- return "INVOKE_BROKER_TO_RESET_OFFSET_VALUE";
- case INVOKE_BROKER_TO_GET_CONSUMER_STATUS_VALUE:
- return "INVOKE_BROKER_TO_GET_CONSUMER_STATUS_VALUE";
- case QUERY_TOPIC_CONSUME_BY_WHO_VALUE:
- return "QUERY_TOPIC_CONSUME_BY_WHO_VALUE";
- case GET_TOPICS_BY_CLUSTER_VALUE:
- return "GET_TOPICS_BY_CLUSTER_VALUE";
- case REGISTER_FILTER_SERVER_VALUE:
- return "REGISTER_FILTER_SERVER_VALUE";
- case REGISTER_MESSAGE_FILTER_CLASS_VALUE:
- return "REGISTER_MESSAGE_FILTER_CLASS_VALUE";
- case QUERY_CONSUME_TIME_SPAN_VALUE:
- return "QUERY_CONSUME_TIME_SPAN_VALUE";
- case GET_SYSTEM_TOPIC_LIST_FROM_NS_VALUE:
- return "GET_SYSTEM_TOPIC_LIST_FROM_NS_VALUE";
- case GET_SYSTEM_TOPIC_LIST_FROM_BROKER_VALUE:
- return "GET_SYSTEM_TOPIC_LIST_FROM_BROKER_VALUE";
- case CLEAN_EXPIRED_CONSUMEQUEUE_VALUE:
- return "CLEAN_EXPIRED_CONSUMEQUEUE_VALUE";
- case GET_CONSUMER_RUNNING_INFO_VALUE:
- return "GET_CONSUMER_RUNNING_INFO_VALUE";
- case QUERY_CORRECTION_OFFSET_VALUE:
- return "QUERY_CORRECTION_OFFSET_VALUE";
- case CONSUME_MESSAGE_DIRECTLY_VALUE:
- return "CONSUME_MESSAGE_DIRECTLY_VALUE";
- case SEND_MESSAGE_V2_VALUE:
- return "SEND_MESSAGE_V2_VALUE";
- case GET_UNIT_TOPIC_LIST_VALUE:
- return "GET_UNIT_TOPIC_LIST_VALUE";
- case GET_HAS_UNIT_SUB_TOPIC_LIST_VALUE:
- return "GET_HAS_UNIT_SUB_TOPIC_LIST_VALUE";
- case GET_HAS_UNIT_SUB_UNUNIT_TOPIC_LIST_VALUE:
- return "GET_HAS_UNIT_SUB_UNUNIT_TOPIC_LIST_VALUE";
- case CLONE_GROUP_OFFSET_VALUE:
- return "CLONE_GROUP_OFFSET_VALUE";
- case VIEW_BROKER_STATS_DATA_VALUE:
- return "VIEW_BROKER_STATS_DATA_VALUE";
- }
-
- return "UnknowMQRequestCode";
-}
-
-const char* getMQResponseCodeString(int code)
-{
- switch (code)
- {
- case 0:
- return "OK";
- case FLUSH_DISK_TIMEOUT_VALUE:
- return "FLUSH_DISK_TIMEOUT_VALUE";
- case SLAVE_NOT_AVAILABLE_VALUE:
- return "SLAVE_NOT_AVAILABLE_VALUE";
- case FLUSH_SLAVE_TIMEOUT_VALUE:
- return "FLUSH_SLAVE_TIMEOUT_VALUE";
- case MESSAGE_ILLEGAL_VALUE:
- return "MESSAGE_ILLEGAL_VALUE";
- case SERVICE_NOT_AVAILABLE_VALUE:
- return "SERVICE_NOT_AVAILABLE_VALUE";
- case VERSION_NOT_SUPPORTED_VALUE:
- return "VERSION_NOT_SUPPORTED_VALUE";
- case NO_PERMISSION_VALUE:
- return "NO_PERMISSION_VALUE";
- case TOPIC_NOT_EXIST_VALUE:
- return "TOPIC_NOT_EXIST_VALUE";
- case TOPIC_EXIST_ALREADY_VALUE:
- return "TOPIC_EXIST_ALREADY_VALUE";
- case PULL_NOT_FOUND_VALUE:
- return "PULL_NOT_FOUND_VALUE";
- case PULL_RETRY_IMMEDIATELY_VALUE:
- return "PULL_RETRY_IMMEDIATELY_VALUE";
- case PULL_OFFSET_MOVED_VALUE:
- return "PULL_OFFSET_MOVED_VALUE";
- case QUERY_NOT_FOUND_VALUE:
- return "QUERY_NOT_FOUND_VALUE";
- case SUBSCRIPTION_PARSE_FAILED_VALUE:
- return "SUBSCRIPTION_PARSE_FAILED_VALUE";
- case SUBSCRIPTION_NOT_EXIST_VALUE:
- return "SUBSCRIPTION_NOT_EXIST_VALUE";
- case SUBSCRIPTION_NOT_LATEST_VALUE:
- return "SUBSCRIPTION_NOT_LATEST_VALUE";
- case SUBSCRIPTION_GROUP_NOT_EXIST_VALUE:
- return "SUBSCRIPTION_GROUP_NOT_EXIST_VALUE";
- case TRANSACTION_SHOULD_COMMIT_VALUE:
- return "TRANSACTION_SHOULD_COMMIT_VALUE";
- case TRANSACTION_SHOULD_ROLLBACK_VALUE:
- return "TRANSACTION_SHOULD_ROLLBACK_VALUE";
- case TRANSACTION_STATE_UNKNOW_VALUE:
- return "TRANSACTION_STATE_UNKNOW_VALUE";
- case TRANSACTION_STATE_GROUP_WRONG_VALUE:
- return "TRANSACTION_STATE_GROUP_WRONG_VALUE";
- case NO_BUYER_ID_VALUE:
- return "NO_BUYER_ID_VALUE";
- case NOT_IN_CURRENT_UNIT_VALUE:
- return "NOT_IN_CURRENT_UNIT_VALUE";
- case CONSUMER_NOT_ONLINE_VALUE:
- return "CONSUMER_NOT_ONLINE_VALUE";
- case CONSUME_MSG_TIMEOUT_VALUE:
- return "CONSUME_MSG_TIMEOUT_VALUE";
- }
-
- return "UnknowMQResponseCode";
-}
-
-}
diff --git a/rocketmq-client4cpp/src/protocol/MQProtos.h b/rocketmq-client4cpp/src/protocol/MQProtos.h
deleted file mode 100755
index 94167ea1..00000000
--- a/rocketmq-client4cpp/src/protocol/MQProtos.h
+++ /dev/null
@@ -1,150 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __MQPROTOS_H__
-#define __MQPROTOS_H__
-
-namespace rmq
-{
- enum MQRequestCode
- {
- // broker
- SEND_MESSAGE_VALUE = 10,
- PULL_MESSAGE_VALUE = 11,
- QUERY_MESSAGE_VALUE = 12,
- QUERY_BROKER_OFFSET_VALUE = 13,
- QUERY_CONSUMER_OFFSET_VALUE = 14,
- UPDATE_CONSUMER_OFFSET_VALUE = 15,
- UPDATE_AND_CREATE_TOPIC_VALUE = 17,
-
- GET_ALL_TOPIC_CONFIG_VALUE = 21,
- GET_TOPIC_CONFIG_LIST_VALUE = 22,
- GET_TOPIC_NAME_LIST_VALUE = 23,
- UPDATE_BROKER_CONFIG_VALUE = 25,
- GET_BROKER_CONFIG_VALUE = 26,
- TRIGGER_DELETE_FILES_VALUE = 27,
- GET_BROKER_RUNTIME_INFO_VALUE = 28,
- SEARCH_OFFSET_BY_TIMESTAMP_VALUE = 29,
-
- GET_MAX_OFFSET_VALUE = 30,
- GET_MIN_OFFSET_VALUE = 31,
- GET_EARLIEST_MSG_STORETIME_VALUE = 32,
- VIEW_MESSAGE_BY_ID_VALUE = 33,
- HEART_BEAT_VALUE = 34,
- UNREGISTER_CLIENT_VALUE = 35,
- CONSUMER_SEND_MSG_BACK_VALUE = 36,
- END_TRANSACTION_VALUE = 37,
- GET_CONSUMER_LIST_BY_GROUP_VALUE = 38,
- CHECK_TRANSACTION_STATE_VALUE = 39,
-
- NOTIFY_CONSUMER_IDS_CHANGED_VALUE = 40,
- LOCK_BATCH_MQ_VALUE = 41,
- UNLOCK_BATCH_MQ_VALUE = 42,
- GET_ALL_CONSUMER_OFFSET_VALUE = 43,
- GET_ALL_DELAY_OFFSET_VALUE = 45,
-
- // Namesrv
- PUT_KV_CONFIG_VALUE = 100,
- GET_KV_CONFIG_VALUE = 101,
- DELETE_KV_CONFIG_VALUE = 102,
- REGISTER_BROKER_VALUE = 103,
- UNREGISTER_BROKER_VALUE = 104,
- GET_ROUTEINTO_BY_TOPIC_VALUE = 105,
- GET_BROKER_CLUSTER_INFO_VALUE = 106,
-
- // broker && namesrv
- UPDATE_AND_CREATE_SUBSCRIPTIONGROUP_VALUE = 200,
- GET_ALL_SUBSCRIPTIONGROUP_CONFIG_VALUE = 201,
- GET_TOPIC_STATS_INFO_VALUE = 202,
- GET_CONSUMER_CONNECTION_LIST_VALUE = 203,
- GET_PRODUCER_CONNECTION_LIST_VALUE = 204,
- WIPE_WRITE_PERM_OF_BROKER_VALUE = 205,
- GET_ALL_TOPIC_LIST_FROM_NAMESERVER_VALUE = 206,
- DELETE_SUBSCRIPTIONGROUP_VALUE = 207,
- GET_CONSUME_STATS_VALUE = 208,
- SUSPEND_CONSUMER_VALUE = 209,
-
- RESUME_CONSUMER_VALUE = 210,
- RESET_CONSUMER_OFFSET_IN_CONSUMER_VALUE = 211,
- RESET_CONSUMER_OFFSET_IN_BROKER_VALUE = 212,
- ADJUST_CONSUMER_THREAD_POOL_VALUE = 213,
- WHO_CONSUME_THE_MESSAGE_VALUE = 214,
- DELETE_TOPIC_IN_BROKER_VALUE = 215,
- DELETE_TOPIC_IN_NAMESRV_VALUE = 216,
- GET_KV_CONFIG_BY_VALUE_VALUE = 217,
- DELETE_KV_CONFIG_BY_VALUE_VALUE = 218,
- GET_KVLIST_BY_NAMESPACE_VALUE = 219,
-
- RESET_CONSUMER_CLIENT_OFFSET_VALUE = 220,
- GET_CONSUMER_STATUS_FROM_CLIENT_VALUE = 221,
- INVOKE_BROKER_TO_RESET_OFFSET_VALUE = 222,
- INVOKE_BROKER_TO_GET_CONSUMER_STATUS_VALUE = 223,
- GET_TOPICS_BY_CLUSTER_VALUE = 224,
-
- QUERY_TOPIC_CONSUME_BY_WHO_VALUE = 300,
- REGISTER_FILTER_SERVER_VALUE = 301,
- REGISTER_MESSAGE_FILTER_CLASS_VALUE = 302,
- QUERY_CONSUME_TIME_SPAN_VALUE = 303,
- GET_SYSTEM_TOPIC_LIST_FROM_NS_VALUE = 304,
- GET_SYSTEM_TOPIC_LIST_FROM_BROKER_VALUE = 305,
- CLEAN_EXPIRED_CONSUMEQUEUE_VALUE = 306,
- GET_CONSUMER_RUNNING_INFO_VALUE = 307,
- QUERY_CORRECTION_OFFSET_VALUE = 308,
- CONSUME_MESSAGE_DIRECTLY_VALUE = 309,
-
- SEND_MESSAGE_V2_VALUE = 310,
- GET_UNIT_TOPIC_LIST_VALUE = 311,
- GET_HAS_UNIT_SUB_TOPIC_LIST_VALUE = 312,
- GET_HAS_UNIT_SUB_UNUNIT_TOPIC_LIST_VALUE = 313,
- CLONE_GROUP_OFFSET_VALUE = 314,
- VIEW_BROKER_STATS_DATA_VALUE = 315,
- };
-
- enum MQResponseCode
- {
- FLUSH_DISK_TIMEOUT_VALUE = 10,
- SLAVE_NOT_AVAILABLE_VALUE = 11,
- FLUSH_SLAVE_TIMEOUT_VALUE = 12,
- MESSAGE_ILLEGAL_VALUE = 13,
- SERVICE_NOT_AVAILABLE_VALUE = 14,
- VERSION_NOT_SUPPORTED_VALUE = 15,
- NO_PERMISSION_VALUE = 16,
- TOPIC_NOT_EXIST_VALUE = 17,
- TOPIC_EXIST_ALREADY_VALUE = 18,
- PULL_NOT_FOUND_VALUE = 19,
-
- PULL_RETRY_IMMEDIATELY_VALUE = 20,
- PULL_OFFSET_MOVED_VALUE = 21,
- QUERY_NOT_FOUND_VALUE = 22,
- SUBSCRIPTION_PARSE_FAILED_VALUE = 23,
- SUBSCRIPTION_NOT_EXIST_VALUE = 24,
- SUBSCRIPTION_NOT_LATEST_VALUE = 25,
- SUBSCRIPTION_GROUP_NOT_EXIST_VALUE = 26,
-
- TRANSACTION_SHOULD_COMMIT_VALUE = 200,
- TRANSACTION_SHOULD_ROLLBACK_VALUE = 201,
- TRANSACTION_STATE_UNKNOW_VALUE = 202,
- TRANSACTION_STATE_GROUP_WRONG_VALUE = 203,
- NO_BUYER_ID_VALUE = 204,
- NOT_IN_CURRENT_UNIT_VALUE = 205,
- CONSUMER_NOT_ONLINE_VALUE = 206,
- CONSUME_MSG_TIMEOUT_VALUE = 207,
- };
-
- const char* getMQRequestCodeString(int code);
- const char* getMQResponseCodeString(int code);
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/OffsetSerializeWrapper.h b/rocketmq-client4cpp/src/protocol/OffsetSerializeWrapper.h
deleted file mode 100755
index 56ee4e4a..00000000
--- a/rocketmq-client4cpp/src/protocol/OffsetSerializeWrapper.h
+++ /dev/null
@@ -1,135 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __OFFSETSERIALIZEWRAPPER_H__
-#define __OFFSETSERIALIZEWRAPPER_H__
-
-#include <map>
-#include <string>
-#include "RemotingSerializable.h"
-#include "MessageQueue.h"
-#include "AtomicValue.h"
-#include "UtilAll.h"
-#include "json/json.h"
-
-
-namespace rmq
-{
- class OffsetSerializeWrapper : public RemotingSerializable
- {
- public:
- void encode(std::string& outData)
- {
- Json::Value offsetTable;
- RMQ_FOR_EACH(m_offsetTable, it)
- {
- MessageQueue mq = it->first;
- kpr::AtomicLong& offset = it->second;
-
- std::string mqStr = mq.toJsonString();
- offsetTable[mqStr] = offset.get();
- }
-
- Json::Value obj;
- obj["offsetTable"] = offsetTable;
-
- Json::FastWriter writer;
- outData = writer.write(obj);
- }
- static OffsetSerializeWrapper* decode(const char* pData, int len)
- {
- /*
- {
- "offsetTable":{
- '{"brokerName":"broker-a","queueId":3,"topic":"TopicTest"}':0,
- '{"brokerName":"broker-a","queueId":2,"topic":"TopicTest"}':0
- }
-
- }
- */
-
- RMQ_DEBUG("decode, data:%s", pData);
-
- Json::Reader reader;
- Json::Value obj;
- if (!reader.parse(pData, pData + len, obj))
- {
- return NULL;
- }
-
- RMQ_DEBUG("decode ok");
-
- if (obj.isObject())
- {
- Json::Value objOffsetTable = obj["offsetTable"];
- if (objOffsetTable.isObject())
- {
- std::map<MessageQueue, kpr::AtomicLong> offsetTable;
- OffsetSerializeWrapper* offsetWrapper = new OffsetSerializeWrapper();
-
- Json::Value::Members members = objOffsetTable.getMemberNames();
- for (typeof(members.begin()) it = members.begin(); it != members.end(); it++)
- {
- std::string key = *it;
- Json::Value objMq;
- RMQ_DEBUG("decode, key:%s", key.c_str());
- if (!reader.parse(key, objMq))
- {
- continue;
- }
- RMQ_DEBUG("decode, key ok");
-
- MessageQueue mq(objMq["topic"].asString(), objMq["brokerName"].asString(),
- objMq["queueId"].asInt());
- long long offset = objOffsetTable[key].asInt64();
-
- offsetTable[mq] = kpr::AtomicLong(offset);
- }
- offsetWrapper->setOffsetTable(offsetTable);
-
- return offsetWrapper;
- }
- }
-
- return NULL;
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{offsetTable=" << UtilAll::toString(m_offsetTable)
- << "}";
- return ss.str();
- }
-
- std::map<MessageQueue, kpr::AtomicLong>& getOffsetTable()
- {
- return m_offsetTable;
- }
-
- void setOffsetTable(const std::map<MessageQueue, kpr::AtomicLong>& table)
- {
- m_offsetTable = table;
- }
-
- private:
- std::map<MessageQueue, kpr::AtomicLong> m_offsetTable;
- };
-
- typedef kpr::RefHandleT<OffsetSerializeWrapper> OffsetSerializeWrapperPtr;
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/RemotingCommand.cpp b/rocketmq-client4cpp/src/protocol/RemotingCommand.cpp
deleted file mode 100755
index 2f58d20c..00000000
--- a/rocketmq-client4cpp/src/protocol/RemotingCommand.cpp
+++ /dev/null
@@ -1,421 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "RemotingCommand.h"
-
-#include <sstream>
-#include <string>
-#include <stdlib.h>
-#include <string.h>
-#include <json/json.h>
-#include "SocketUtil.h"
-#include "CommandCustomHeader.h"
-#include "MQVersion.h"
-
-namespace rmq
-{
-
-kpr::AtomicInteger RemotingCommand::s_seqNumber = 0;
-volatile int RemotingCommand::s_configVersion = MQVersion::s_CurrentVersion;
-
-RemotingCommand::RemotingCommand(int code)
- : m_code(code), m_language("CPP"), m_version(0), m_opaque(s_seqNumber++),
- m_flag(0), m_remark(""), m_pCustomHeader(NULL),
- m_dataLen(0), m_pData(NULL), m_bodyLen(0), m_pBody(NULL), m_releaseBody(false)
-{
-}
-
-RemotingCommand::RemotingCommand(int code,
- const std::string& language,
- int version,
- int opaque,
- int flag,
- const std::string& remark,
- CommandCustomHeader* pCustomHeader)
- : m_code(code), m_language(language), m_version(version), m_opaque(opaque),
- m_flag(flag), m_remark(remark), m_pCustomHeader(pCustomHeader),
- m_dataLen(0), m_pData(NULL), m_bodyLen(0), m_pBody(NULL), m_releaseBody(false)
-{
-
-}
-
-RemotingCommand::~RemotingCommand()
-{
- if (m_pData)
- {
- delete[] m_pData;
- }
-
- if (m_releaseBody)
- {
- delete[] m_pBody;
- m_bodyLen = 0;
- m_pBody = NULL;
- }
-
- // TODO: maybe memleak
- if (m_pCustomHeader)
- {
- delete m_pCustomHeader;
- m_pCustomHeader = NULL;
- }
-}
-
-void RemotingCommand::encode()
-{
- std::string extHeader = "{}";
- if (m_pCustomHeader)
- {
- m_pCustomHeader->encode(extHeader);
- }
-
- std::stringstream ss;
- ss << "{"
- << CODE_STRING << m_code << ","
- << language_STRING << "\"CPP\","
- << version_STRING << m_version << ","
- << opaque_STRING << m_opaque << ","
- << flag_STRING << m_flag << ","
- << remark_STRING << "\"" << m_remark << "\","
- << extFields_STRING << extHeader
- << "}";
-
- /* protocol:
- * | 4 | 4 | headerlen | bodylen |
- * | 1-length | 2-headerlen | 3-headerdata | 4-bodydata |
- */
- int headLen = ss.str().size();
- m_dataLen = 8 + headLen + m_bodyLen;
- m_pData = new char[m_dataLen];
-
- //length = len(2 + 3 + 4)
- int tmp = htonl(4 + headLen + m_bodyLen);
- memcpy(m_pData, &tmp, 4);
-
- //headerlength = len(3)
- tmp = htonl(headLen);
- memcpy(m_pData + 4, &tmp, 4);
-
- //headerdata
- memcpy(m_pData + 8, ss.str().c_str(), headLen);
-
- //bodydata
- if (m_pBody)
- {
- memcpy(m_pData + 8 + headLen, m_pBody, m_bodyLen);
- }
-
- //RMQ_DEBUG("encode|%s%s", ss.str().c_str(), m_pBody ? std::string(m_pBody, m_bodyLen).c_str() : "");
-}
-
-std::string RemotingCommand::toString() const
-{
- std::string extHeader;
- if (m_pCustomHeader)
- {
- m_pCustomHeader->encode(extHeader);
- }
-
- std::stringstream ss;
- ss << "{"
- << CODE_STRING << m_code << ","
- << language_STRING << "\"CPP\","
- << version_STRING << m_version << ","
- << opaque_STRING << m_opaque << ","
- << flag_STRING << m_flag << ","
- << remark_STRING << "\"" << m_remark << "\"";
- if (!extHeader.empty())
- {
- ss << "," << extFields_STRING << extHeader;
- }
- ss << "}";
-
- if (m_pBody)
- {
- ss << "|" << m_bodyLen << "|" << std::string(m_pBody, m_bodyLen);
- }
-
- return ss.str();
-}
-
-
-const char* RemotingCommand::getData()
-{
- return m_pData;
-}
-
-int RemotingCommand::getDataLen()
-{
- return m_dataLen;
-}
-
-const char* RemotingCommand::getBody()
-{
- return m_pBody;
-}
-
-int RemotingCommand::getBodyLen()
-{
- return m_bodyLen;
-}
-
-void RemotingCommand::setBody(char* pData, int len, bool copy)
-{
- m_releaseBody = copy;
-
- if (copy)
- {
- m_pBody = new char[len];
- m_bodyLen = len;
- memcpy(m_pBody, pData, len);
- }
- else
- {
- m_pBody = pData;
- m_bodyLen = len;
- }
-}
-
-RemotingCommand* RemotingCommand::decode(const char* pData, int len)
-{
- Json::Reader reader;
- Json::Value object;
-
- int headLen;
- memcpy(&headLen, pData + 4, 4);
- headLen = ntohl(headLen);
-
- //RMQ_DEBUG("decode[%d,%d,%d]|%s%s", len, headLen, len - 8 - headLen, std::string(pData + 8, headLen).c_str(),
- // std::string(pData + 8 + headLen, len - 8 - headLen).c_str());
-
- if (!reader.parse(pData + 8, pData + 8 + headLen, object))
- {
- RMQ_ERROR("parse header fail, %s", std::string(pData + 8, headLen).c_str());
- return NULL;
- }
-
- int code = object["code"].asInt();
- std::string language = object["language"].asString();
- int version = object["version"].asInt();
- int opaque = object["opaque"].asInt();
- int flag = object["flag"].asInt();
-
- Json::Value v = object["remark"];
- std::string remark = "";
- if (!v.isNull())
- {
- remark = object["remark"].asString();
- }
-
- RemotingCommand* cmd = new RemotingCommand(code,
- language,
- version,
- opaque,
- flag,
- remark,
- NULL);
-
- int bodyLen = len - 8 - headLen;
- if (bodyLen > 0)
- {
- cmd->setBody((char*)(pData + 8 + headLen), bodyLen, true);
- }
-
- return cmd;
-}
-
-CommandCustomHeader* RemotingCommand::makeCustomHeader(int code, const char* pData, int len)
-{
- Json::Reader reader;
- Json::Value object;
-
- int headLen;
- memcpy(&headLen, pData + 4, 4);
- headLen = ntohl(headLen);
-
- if (!reader.parse(pData + 8, pData + 8 + headLen, object))
- {
- RMQ_ERROR("parse header fail, %s", std::string(pData + 8, headLen).c_str());
- return NULL;
- }
-
- if (object.isMember("extFields") && object["extFields"].isObject() && object["extFields"].size() > 0)
- {
- CommandCustomHeader* pCustomHeader = CommandCustomHeader::decode(
- code, object["extFields"], isResponseType());
- if (pCustomHeader == NULL)
- {
- RMQ_WARN("invalid extFields, %d, %s", code, std::string(pData + 8, headLen).c_str());
- }
-
- setCommandCustomHeader(pCustomHeader);
- return pCustomHeader;
- }
-
- return NULL;
-}
-
-
-RemotingCommand* RemotingCommand::createRequestCommand(int code, CommandCustomHeader* pCustomHeader)
-{
- RemotingCommand* cmd = new RemotingCommand(code);
- cmd->setCommandCustomHeader(pCustomHeader);
- setCmdVersion(cmd);
-
- return cmd;
-}
-
-RemotingCommand* RemotingCommand::createResponseCommand(int code, const std::string& remark)
-{
- return createResponseCommand(code, remark, NULL);
-}
-
-
-RemotingCommand* RemotingCommand::createResponseCommand(int code, const std::string& remark,
- CommandCustomHeader* pCustomHeader)
-{
- RemotingCommand* cmd = new RemotingCommand(code);
- cmd->markResponseType();
- cmd->setRemark(remark);
- setCmdVersion(cmd);
-
- if (pCustomHeader)
- {
- cmd->setCommandCustomHeader(pCustomHeader);
- }
-
- return cmd;
-}
-
-
-void RemotingCommand::markResponseType()
-{
- int bits = 1 << RPC_TYPE;
- m_flag |= bits;
-}
-
-bool RemotingCommand::isResponseType()
-{
- int bits = 1 << RPC_TYPE;
- return (m_flag & bits) == bits;
-}
-
-void RemotingCommand::markOnewayRPC()
-{
- int bits = 1 << RPC_ONEWAY;
- m_flag |= bits;
-}
-
-bool RemotingCommand::isOnewayRPC()
-{
- int bits = 1 << RPC_ONEWAY;
- return (m_flag & bits) == bits;
-}
-
-void RemotingCommand::setCmdVersion(RemotingCommand* pCmd)
-{
- if (s_configVersion >= 0)
- {
- pCmd->setVersion(s_configVersion);
- }
- else
- {
- int value = MQVersion::s_CurrentVersion;
- pCmd->setVersion(value);
- s_configVersion = value;
- }
-}
-
-int RemotingCommand::getCode()
-{
- return m_code;
-}
-
-void RemotingCommand::setCode(int code)
-{
- m_code = code;
-}
-
-std::string RemotingCommand::getLanguage()
-{
- return m_language;
-}
-
-void RemotingCommand::setLanguage(const std::string& language)
-{
- m_language = language;
-}
-
-int RemotingCommand::getVersion()
-{
- return m_version;
-}
-
-void RemotingCommand::setVersion(int version)
-{
- m_version = version;
-}
-
-int RemotingCommand::getOpaque()
-{
- return m_opaque;
-}
-
-void RemotingCommand::setOpaque(int opaque)
-{
- m_opaque = opaque;
-}
-
-int RemotingCommand::getFlag()
-{
- return m_flag;
-}
-
-void RemotingCommand::setFlag(int flag)
-{
- m_flag = flag;
-}
-
-std::string RemotingCommand::getRemark()
-{
- return m_remark;
-}
-
-void RemotingCommand::setRemark(const std::string& remark)
-{
- m_remark = remark;
-}
-
-void RemotingCommand::setCommandCustomHeader(CommandCustomHeader* pCommandCustomHeader)
-{
- m_pCustomHeader = pCommandCustomHeader;
-}
-
-CommandCustomHeader* RemotingCommand::getCommandCustomHeader()
-{
- return m_pCustomHeader;
-}
-
-RemotingCommandType RemotingCommand::getType()
-{
- if (isResponseType())
- {
- return RESPONSE_COMMAND;
- }
-
- return REQUEST_COMMAND;
-}
-
-}
diff --git a/rocketmq-client4cpp/src/protocol/RemotingCommand.h b/rocketmq-client4cpp/src/protocol/RemotingCommand.h
deleted file mode 100755
index c51fcfd8..00000000
--- a/rocketmq-client4cpp/src/protocol/RemotingCommand.h
+++ /dev/null
@@ -1,153 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __REMOTINGCOMMAND_H__
-#define __REMOTINGCOMMAND_H__
-
-#include <sstream>
-#include <string>
-
-#include "RocketMQClient.h"
-#include "AtomicValue.h"
-#include "RefHandle.h"
-
-namespace rmq
-{
- const std::string CODE_STRING = "\"code\":";
- const std::string language_STRING = "\"language\":";
- const std::string version_STRING = "\"version\":";
- const std::string opaque_STRING = "\"opaque\":";
- const std::string flag_STRING = "\"flag\":";
- const std::string remark_STRING = "\"remark\":";
- const std::string extFields_STRING = "\"extFields\":";
-
- const std::string RemotingVersionKey = "rocketmq.remoting.version";
-
- class CommandCustomHeader;
-
- typedef enum
- {
- REQUEST_COMMAND,
- RESPONSE_COMMAND
- } RemotingCommandType;
-
- typedef enum
- {
- SUCCESS_VALUE = 0,
- SYSTEM_ERROR_VALUE,
- SYSTEM_BUSY_VALUE,
- REQUEST_CODE_NOT_SUPPORTED_VALUE,
- } ResponseCode;
-
- typedef enum
- {
- JAVA,
- CPP,
- DOTNET,
- PYTHON,
- DELPHI,
- ERLANG,
- RUBY,
- OTHER,
- } LanguageCode;
-
- const int RPC_TYPE = 0; // 0, REQUEST_COMMAND // 1, RESPONSE_COMMAND
- const int RPC_ONEWAY = 1; // 0, RPC // 1, Oneway
-
- class RemotingCommand : public kpr::RefCount
- {
- public:
- RemotingCommand(int code);
- RemotingCommand(int code,
- const std::string& language,
- int version,
- int opaque,
- int flag,
- const std::string& remark,
- CommandCustomHeader* pCustomHeader);
- ~RemotingCommand();
-
- void encode();
- std::string toString() const;
-
- const char* getData();
- int getDataLen();
-
- const char* getBody();
- int getBodyLen();
- void setBody(char* pData, int len, bool copy);
- CommandCustomHeader* makeCustomHeader(int code, const char* pData, int len);
-
- int getCode();
- void setCode(int code);
-
- std::string getLanguage();
- void setLanguage(const std::string& language);
-
- int getVersion();
- void setVersion(int version);
-
- int getOpaque();
- void setOpaque(int opaque);
-
- int getFlag();
- void setFlag(int flag);
-
- std::string getRemark();
- void setRemark(const std::string& remark);
-
- void setCommandCustomHeader(CommandCustomHeader* pCommandCustomHeader);
- CommandCustomHeader* getCommandCustomHeader();
-
- RemotingCommandType getType();
- void markResponseType();
- bool isResponseType() ;
- void markOnewayRPC();
- bool isOnewayRPC();
-
- static void setCmdVersion(RemotingCommand* pCmd);
- static RemotingCommand* decode(const char* pData, int len);
- static RemotingCommand* createRequestCommand(int code, CommandCustomHeader* pCustomHeader);
- static RemotingCommand* createResponseCommand(int code, const std::string& remark);
- static RemotingCommand* createResponseCommand(int code, const std::string& remark, CommandCustomHeader* pCustomHeader);
-
-
- private:
- static volatile int s_configVersion;
-
- private:
- int m_code;
- std::string m_language;
- int m_version;
- int m_opaque;
- int m_flag;
- std::string m_remark;
- CommandCustomHeader* m_pCustomHeader;
-
- int m_dataLen;
- char* m_pData;
-
- int m_bodyLen;
- char* m_pBody;
-
- bool m_releaseBody;
-
- static kpr::AtomicInteger s_seqNumber;
- };
- typedef kpr::RefHandleT<RemotingCommand> RemotingCommandPtr;
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/RemotingSerializable.h b/rocketmq-client4cpp/src/protocol/RemotingSerializable.h
deleted file mode 100755
index 8e50ab0a..00000000
--- a/rocketmq-client4cpp/src/protocol/RemotingSerializable.h
+++ /dev/null
@@ -1,33 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __REMOTINGSERIALIZABLE_H__
-#define __REMOTINGSERIALIZABLE_H__
-
-#include "RocketMQClient.h"
-#include "RefHandle.h"
-
-namespace rmq
-{
- class RemotingSerializable : public kpr::RefCount
- {
- public:
- virtual ~RemotingSerializable() {};
- virtual void encode(std::string& outData) = 0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/TopicList.h b/rocketmq-client4cpp/src/protocol/TopicList.h
deleted file mode 100755
index e8275406..00000000
--- a/rocketmq-client4cpp/src/protocol/TopicList.h
+++ /dev/null
@@ -1,60 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __TOPICLIST_H__
-#define __TOPICLIST_H__
-
-#include <set>
-#include <string>
-#include <UtilAll.h>
-
-namespace rmq
-{
- class TopicList : public RemotingSerializable
- {
- public:
- static TopicList* decode(const char* pData, int len)
- {
- return new TopicList();
- }
-
- void encode(std::string& outData)
- {
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{topicList=" << UtilAll::toString(m_topicList)
- << "}";
- return ss.str();
- }
-
- const std::set<std::string>& getTopicList()
- {
- return m_topicList;
- }
-
- void setTopicList(const std::set<std::string>& topicList)
- {
- m_topicList = topicList;
- }
-
- private:
- std::set<std::string> m_topicList;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/protocol/TopicRouteData.h b/rocketmq-client4cpp/src/protocol/TopicRouteData.h
deleted file mode 100755
index a40ef7d3..00000000
--- a/rocketmq-client4cpp/src/protocol/TopicRouteData.h
+++ /dev/null
@@ -1,279 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __TOPICROUTEDATA_H__
-#define __TOPICROUTEDATA_H__
-
-#include <stdio.h>
-#include <stdlib.h>
-#include <iostream>
-#include <list>
-#include <map>
-#include <string>
-#include <sstream>
-#include "RocketMQClient.h"
-#include "RemotingSerializable.h"
-#include "UtilAll.h"
-#include "MixAll.h"
-#include "json/json.h"
-
-namespace rmq
-{
- struct QueueData
- {
- std::string brokerName;
- int readQueueNums;
- int writeQueueNums;
- int perm;
-
- bool operator < (const QueueData& other)
- {
- return brokerName < other.brokerName;
- }
-
- bool operator==(const QueueData& other)const
- {
- if (brokerName == other.brokerName
- && readQueueNums == other.readQueueNums
- && writeQueueNums == other.writeQueueNums
- && perm == other.perm)
- {
- return true;
- }
-
- return false;
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{brokerName=" << brokerName
- << ",readQueueNums=" << readQueueNums
- << ",writeQueueNums=" << writeQueueNums
- << ",perm=" << perm
- << "}";
- return ss.str();
- }
- };
- inline std::ostream& operator<<(std::ostream& os, const QueueData& obj)
- {
- os << obj.toString();
- return os;
- }
-
-
- struct BrokerData
- {
- std::string brokerName;
- std::map<int, std::string> brokerAddrs;
-
- bool operator < (const BrokerData& other)
- {
- return brokerName < other.brokerName;
- }
-
- bool operator == (const BrokerData& other)const
- {
- if (brokerName == other.brokerName
- && brokerAddrs == other.brokerAddrs)
- {
- return true;
- }
-
- return false;
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{brokerName=" << brokerName
- << ",brokerAddrs=" << UtilAll::toString(brokerAddrs)
- << "}";
- return ss.str();
- }
- };
-
-
- inline std::ostream& operator<<(std::ostream& os, const BrokerData& obj)
- {
- os << obj.toString();
- return os;
- }
-
-
- class TopicRouteData : public RemotingSerializable
- {
- public:
- void encode(std::string& outData)
- {
-
- }
-
- static TopicRouteData* encode(const char* pData, int len)
- {
- /*
- {
- "orderTopicConf":"",
- "brokerDatas":[
- {"brokerAddrs":{0:"10.134.143.77:10911"},"brokerName":"broker-a"}
- ],
- "filterServerTable":{},
- "queueDatas":[
- {"brokerName":"broker-a","perm":6,"readQueueNums":4,"topicSynFlag":0,"writeQueueNums":4}
- ]
- }
- */
- Json::Reader reader;
- Json::Value object;
-
- if (!reader.parse(pData, pData + len, object))
- {
- RMQ_ERROR("parse fail:%s", reader.getFormattedErrorMessages().c_str());
- return NULL;
- }
-
- TopicRouteData* trd = new TopicRouteData();
- trd->setOrderTopicConf(object["orderTopicConf"].asString());
-
- Json::Value qds = object["queueDatas"];
- for (size_t i = 0; i < qds.size(); i++)
- {
- QueueData d;
- Json::Value qd = qds[i];
- d.brokerName = qd["brokerName"].asString();
- d.readQueueNums = qd["readQueueNums"].asInt();
- d.writeQueueNums = qd["writeQueueNums"].asInt();
- d.perm = qd["perm"].asInt();
-
- trd->getQueueDatas().push_back(d);
- }
-
- Json::Value bds = object["brokerDatas"];
- for (size_t i = 0; i < bds.size(); i++)
- {
- BrokerData d;
- Json::Value bd = bds[i];
- d.brokerName = bd["brokerName"].asString();
-
- Json::Value bas = bd["brokerAddrs"];
- Json::Value::Members mbs = bas.getMemberNames();
- for (size_t i = 0; i < mbs.size(); i++)
- {
- std::string key = mbs.at(i);
- d.brokerAddrs[atoi(key.c_str())] = bas[key].asString();
- }
-
- trd->getBrokerDatas().push_back(d);
- }
-
- return trd;
- }
-
- static std::string selectBrokerAddr(BrokerData& data)
- {
- std::map<int, std::string>::iterator it = data.brokerAddrs.find(MixAll::MASTER_ID);
- std::string value = "";
- if (it == data.brokerAddrs.end())
- {
- it = data.brokerAddrs.begin();
- if (it != data.brokerAddrs.end())
- {
- value = it->second;
- }
- }
- else
- {
- value = it->second;
- }
-
- return value;
- }
-
- std::list<QueueData>& getQueueDatas()
- {
- return m_queueDatas;
- }
-
- void setQueueDatas(const std::list<QueueData>& queueDatas)
- {
- m_queueDatas = queueDatas;
- }
-
- std::list<BrokerData>& getBrokerDatas()
- {
- return m_brokerDatas;
- }
-
- void setBrokerDatas(const std::list<BrokerData>& brokerDatas)
- {
- m_brokerDatas = brokerDatas;
- }
-
- const std::string& getOrderTopicConf()
- {
- return m_orderTopicConf;
- }
-
- void setOrderTopicConf(const std::string& orderTopicConf)
- {
- m_orderTopicConf = orderTopicConf;
- }
-
- bool operator ==(const TopicRouteData& other)
- {
- if (m_brokerDatas != other.m_brokerDatas)
- {
- return false;
- }
-
- if (m_orderTopicConf != other.m_orderTopicConf)
- {
- return false;
- }
-
- if (m_queueDatas != other.m_queueDatas)
- {
- return false;
- }
-
- return true;
- }
-
- std::string toString() const
- {
- std::stringstream ss;
- ss << "{orderTopicConf=" << m_orderTopicConf
- << ",queueDatas=" << UtilAll::toString(m_queueDatas)
- << ",brokerDatas=" << UtilAll::toString(m_brokerDatas)
- << "}";
- return ss.str();
- }
-
- private:
- std::string m_orderTopicConf;
- std::list<QueueData> m_queueDatas;
- std::list<BrokerData> m_brokerDatas;
- };
- typedef kpr::RefHandleT<TopicRouteData> TopicRouteDataPtr;
-
- inline std::ostream& operator<<(std::ostream& os, const TopicRouteData& obj)
- {
- os << obj.toString();
- return os;
- }
-
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/transport/InvokeCallback.h b/rocketmq-client4cpp/src/transport/InvokeCallback.h
deleted file mode 100755
index 4b5b3c76..00000000
--- a/rocketmq-client4cpp/src/transport/InvokeCallback.h
+++ /dev/null
@@ -1,32 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __INVOKECALLBACK_H__
-#define __INVOKECALLBACK_H__
-
-#include "ResponseFuture.h"
-
-namespace rmq
-{
- class InvokeCallback
- {
- public:
- virtual ~InvokeCallback() {}
- virtual void operationComplete(ResponseFuturePtr pResponseFuture) = 0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/transport/RemoteClientConfig.h b/rocketmq-client4cpp/src/transport/RemoteClientConfig.h
deleted file mode 100755
index 930fc783..00000000
--- a/rocketmq-client4cpp/src/transport/RemoteClientConfig.h
+++ /dev/null
@@ -1,67 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-#ifndef __REMOTECLIENTCONFIG_H__
-#define __REMOTECLIENTCONFIG_H__
-
-#include <unistd.h>
-#include <sys/sysinfo.h>
-
-namespace rmq
-{
- /**
- * remote client config
- *
- */
- class RemoteClientConfig
- {
- public:
- RemoteClientConfig()
- {
- clientWorkerThreads = 4;
- clientCallbackExecutorThreads = get_nprocs();
- clientSelectorThreads = 1;
- clientOnewaySemaphoreValue = 2048;
- clientAsyncSemaphoreValue = 2048;
- connectTimeoutMillis = 3000;
- channelNotActiveInterval = 1000 * 60;
- clientChannelMaxIdleTimeSeconds = 120;
- clientSocketSndBufSize = 65535;
- clientSocketRcvBufSize = 65535;
-
- nsL5ModId = 0;
- nsL5CmdId = 0;
- }
-
- // Server Response/Request
- int clientWorkerThreads;
- int clientCallbackExecutorThreads;
- int clientSelectorThreads;
- int clientOnewaySemaphoreValue;
- int clientAsyncSemaphoreValue;
- int connectTimeoutMillis;
-
- int channelNotActiveInterval;
- int clientChannelMaxIdleTimeSeconds;
- int clientSocketSndBufSize;
- int clientSocketRcvBufSize;
-
- int nsL5ModId;
- int nsL5CmdId;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/transport/ResponseFuture.cpp b/rocketmq-client4cpp/src/transport/ResponseFuture.cpp
deleted file mode 100755
index c80fb84b..00000000
--- a/rocketmq-client4cpp/src/transport/ResponseFuture.cpp
+++ /dev/null
@@ -1,183 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "ResponseFuture.h"
-
-#include "RocketMQClient.h"
-#include "KPRUtil.h"
-#include "InvokeCallback.h"
-#include "Monitor.h"
-#include "Semaphore.h"
-#include "ScopedLock.h"
-
-namespace rmq
-{
-
-ResponseFuture::ResponseFuture(int requestCode, int opaque, int timeoutMillis,
- InvokeCallback* pInvokeCallback, bool block, kpr::Semaphore* pSem)
-{
- m_requestCode = requestCode;
- m_opaque = opaque;
- m_timeoutMillis = timeoutMillis;
- m_pInvokeCallback = pInvokeCallback;
- m_beginTimestamp = KPRUtil::GetCurrentTimeMillis();
- m_pResponseCommand = NULL;
- m_notifyFlag = false;
- m_pMonitor = NULL;
- m_sendRequestOK = false;
- m_exec = 0;
-
- m_pSemaphore = pSem;
- m_released = 0;
-
- if (block)
- {
- m_pMonitor = new kpr::Monitor();
- }
-}
-
-ResponseFuture::~ResponseFuture()
-{
- if (m_pMonitor)
- {
- delete m_pMonitor;
- }
-}
-
-void ResponseFuture::executeInvokeCallback()
-{
- if (m_pInvokeCallback != NULL)
- {
- if (m_exec.compareAndSet(0, 1))
- {
- try
- {
- m_pInvokeCallback->operationComplete(this);
- }
- catch(std::exception& e)
- {
- RMQ_ERROR("executeInvokeCallback exception: %s", e.what());
- }
- catch(...)
- {
- RMQ_ERROR("executeInvokeCallback exception");
- }
- }
- }
-}
-
-void ResponseFuture::release()
-{
- if (m_pSemaphore != NULL)
- {
- if (m_released.compareAndSet(0, 1))
- {
- m_pSemaphore->Release();
- }
- }
-}
-
-bool ResponseFuture::isTimeout()
-{
- long long diff = KPRUtil::GetCurrentTimeMillis() - m_beginTimestamp;
- return diff > m_timeoutMillis;
-}
-
-RemotingCommand* ResponseFuture::waitResponse(int timeoutMillis)
-{
- if (m_pMonitor)
- {
- kpr::ScopedLock<kpr::Monitor> lock(*m_pMonitor);
- if (!m_notifyFlag)
- {
- m_pMonitor->Wait(timeoutMillis);
- }
- }
-
- return m_pResponseCommand;
-}
-
-void ResponseFuture::putResponse(RemotingCommand* pResponseCommand)
-{
- m_pResponseCommand = pResponseCommand;
- if (m_pMonitor)
- {
- kpr::ScopedLock<kpr::Monitor> lock(*m_pMonitor);
- m_notifyFlag = true;
- m_pMonitor->Notify();
- }
-}
-
-long long ResponseFuture::getBeginTimestamp()
-{
- return m_beginTimestamp;
-}
-
-bool ResponseFuture::isSendRequestOK()
-{
- return m_sendRequestOK;
-}
-
-void ResponseFuture::setSendRequestOK(bool sendRequestOK)
-{
- m_sendRequestOK = sendRequestOK;
-}
-
-long long ResponseFuture::getTimeoutMillis()
-{
- return m_timeoutMillis;
-}
-
-InvokeCallback* ResponseFuture::getInvokeCallback()
-{
- return m_pInvokeCallback;
-}
-
-RemotingCommand* ResponseFuture::getResponseCommand()
-{
- return m_pResponseCommand;
-}
-
-void ResponseFuture::setResponseCommand(RemotingCommand* pResponseCommand)
-{
- m_pResponseCommand = pResponseCommand;
-}
-
-int ResponseFuture::getOpaque()
-{
- return m_opaque;
-}
-
-int ResponseFuture::getRequestCode()
-{
- return m_requestCode;
-}
-
-void ResponseFuture::setRequestCode(int requestCode)
-{
- m_requestCode = requestCode;
-}
-
-std::string ResponseFuture::toString() const
-{
- std::stringstream oss;
- oss << "{responseCommand=" << m_pResponseCommand << ",sendRequestOK=" << m_sendRequestOK
- << ",opaque=" << m_opaque << ",timeoutMillis=" << m_timeoutMillis
- << ",invokeCallback=" << m_pInvokeCallback << ",beginTimestamp=" << m_beginTimestamp
- << "}";
- return oss.str();
-}
-
-}
diff --git a/rocketmq-client4cpp/src/transport/ResponseFuture.h b/rocketmq-client4cpp/src/transport/ResponseFuture.h
deleted file mode 100755
index f1dfc01f..00000000
--- a/rocketmq-client4cpp/src/transport/ResponseFuture.h
+++ /dev/null
@@ -1,77 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __RESPONSEFUTURE_H__
-#define __RESPONSEFUTURE_H__
-
-#include <string>
-#include "AtomicValue.h"
-#include "RefHandle.h"
-
-namespace kpr
-{
-class Monitor;
-class Semaphore;
-}
-
-namespace rmq
-{
- class InvokeCallback;
- class RemotingCommand;
-
- class ResponseFuture : public kpr::RefCount
- {
- public:
- ResponseFuture(int requestCode, int opaque, int timeoutMillis, InvokeCallback* pInvokeCallback,
- bool block, kpr::Semaphore* pSem);
- ~ResponseFuture();
- void executeInvokeCallback();
- void release();
- bool isTimeout();
- RemotingCommand* waitResponse(int timeoutMillis);
- void putResponse(RemotingCommand* pResponseCommand);
- long long getBeginTimestamp();
- bool isSendRequestOK();
- void setSendRequestOK(bool sendRequestOK);
- int getRequestCode();
- void setRequestCode(int requestCode);
- long long getTimeoutMillis();
- InvokeCallback* getInvokeCallback();
- RemotingCommand* getResponseCommand();
- void setResponseCommand(RemotingCommand* pResponseCommand);
- int getOpaque();
- std::string toString() const;
-
- private:
- RemotingCommand* m_pResponseCommand;
- volatile bool m_sendRequestOK;
- int m_requestCode;
- int m_opaque;
- long long m_timeoutMillis;
- InvokeCallback* m_pInvokeCallback;
- long long m_beginTimestamp;
- kpr::Monitor* m_pMonitor;
- bool m_notifyFlag;
-
- kpr::AtomicInteger m_exec;
-
- kpr::Semaphore* m_pSemaphore;
- kpr::AtomicInteger m_released;
- };
- typedef kpr::RefHandleT<ResponseFuture> ResponseFuturePtr;
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/transport/SocketUtil.cpp b/rocketmq-client4cpp/src/transport/SocketUtil.cpp
deleted file mode 100755
index a1e0d57e..00000000
--- a/rocketmq-client4cpp/src/transport/SocketUtil.cpp
+++ /dev/null
@@ -1,250 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "SocketUtil.h"
-#include "MixAll.h"
-#include "MQClientException.h"
-
-
-namespace rmq
-{
-
-int SocketInit()
-{
- signal(SIGPIPE, SIG_IGN);
-
- return 0;
-}
-
-int MakeSocketNonblocking(SOCKET fd)
-{
- int flags = fcntl(fd, F_GETFL, 0);
- assert(flags != -1);
- flags = (flags | O_NONBLOCK);
- return fcntl(fd, F_SETFL, flags);
-}
-
-int SetTcpNoDelay(SOCKET fd)
-{
- int flag = 1;
- return setsockopt(fd, IPPROTO_TCP, TCP_NODELAY, (const char*)&flag, sizeof(flag));
-}
-
-bool SplitURL(const std::string& serverURL, std::string& addr, short& nPort)
-{
- size_t pos = serverURL.find(':');
- if (pos == std::string::npos)
- {
- return false;
- }
-
- addr = serverURL.substr(0, pos);
- if (0 == addr.compare("localhost"))
- {
- addr = "127.0.0.1";
- }
- pos++;
-
- std::string port = serverURL.substr(pos, serverURL.length() - pos);
- nPort = atoi(port.c_str());
- return true;
-}
-
-sockaddr string2SocketAddress(const std::string& addrString)
-{
- std::string strAddr;
- short port;
- SplitURL(addrString, strAddr, port);
-
- struct sockaddr_in sa;
- sa.sin_family = AF_INET;
- sa.sin_port = htons(port);
-
- sa.sin_addr.s_addr = inet_addr(strAddr.c_str());
-
- sockaddr addr;
- memcpy(&addr, &sa, sizeof(sockaddr));
-
- return addr;
-}
-
-std::string socketAddress2String(sockaddr addr)
-{
- sockaddr_in in;
- memcpy(&in, &addr, sizeof(sockaddr));
-
- std::stringstream ss;
- ss << inet_ntoa(in.sin_addr) << ":" << in.sin_port;
-
- return ss.str();
-}
-
-void GetLocalAddrs(std::vector<unsigned int>& addrs)
-{
- addrs.clear();
-
- struct ifconf ifc;
- ifc.ifc_buf = NULL;
- ifc.ifc_len = 0;
-
- int sfd = socket(AF_INET, SOCK_DGRAM, 0);
- if (sfd != INVALID_SOCKET)
- {
- int ret = ioctl(sfd, SIOCGIFCONF, (char*)&ifc);
-
- if (ret != -1)
- {
- ifc.ifc_req = (struct ifreq*)malloc(ifc.ifc_len);
- ret = ioctl(sfd, SIOCGIFCONF, (char*)&ifc);
- if (ret != -1)
- {
- for (size_t i = 0; i < ifc.ifc_len / sizeof(struct ifreq); i++)
- {
- struct sockaddr* sa = (struct sockaddr*) & (ifc.ifc_req[i].ifr_addr);
- if (AF_INET == sa->sa_family)
- {
- unsigned int addr = ((struct sockaddr_in*)sa)->sin_addr.s_addr;
- addrs.push_back(htonl(addr));
- }
- }
- }
-
- free(ifc.ifc_req);
- ifc.ifc_req = NULL;
- }
-
- close(sfd);
- }
-
- if (addrs.empty())
- {
- char hostname[1024];
-
- int ret = gethostname(hostname, sizeof(hostname));
- if (ret == 0)
- {
- struct addrinfo* result = NULL;
- struct addrinfo* ptr = NULL;
- struct addrinfo hints;
-
- memset(&hints, 0, sizeof(hints));
- hints.ai_family = AF_INET;
- hints.ai_socktype = SOCK_STREAM;
- hints.ai_protocol = IPPROTO_TCP;
-
- ret = getaddrinfo(hostname, NULL, &hints, &result);
- if (ret == 0)
- {
- for (ptr = result; ptr != NULL ; ptr = ptr->ai_next)
- {
-
- struct sockaddr_in* sockaddr_ipv4 = (struct sockaddr_in*) ptr->ai_addr;
- addrs.push_back(ntohl(sockaddr_ipv4->sin_addr.s_addr));
- }
- }
-
- freeaddrinfo(result);
- }
- }
-
- std::vector<unsigned int>::iterator it = addrs.begin();
- for (; it != addrs.end();)
- {
- if (*it >= 0x7F000000U && *it < 0x80000000U)
- {
- it = addrs.erase(it);
- }
- else
- {
- it++;
- }
- }
-
- if (addrs.empty())
- {
- addrs.push_back(INADDR_LOOPBACK);
- }
-}
-
-std::string getLocalAddress()
-{
- std::vector<unsigned int> addrs;
- GetLocalAddrs(addrs);
- struct in_addr addr;
- addr.s_addr = htonl(addrs[0]);
-
- return inet_ntoa(addr);
-}
-
-std::string getHostName(sockaddr addr)
-{
- sockaddr_in in;
- memcpy(&in, &addr, sizeof(sockaddr));
-
- struct hostent* remoteHost = gethostbyaddr((char*) & (in.sin_addr), 4, AF_INET);
- char** alias = remoteHost->h_aliases;
- if (*alias != 0)
- {
- return *alias;
- }
- else
- {
- return inet_ntoa(in.sin_addr);
- }
-}
-
-
-unsigned long long swapll(unsigned long long v)
-{
-#ifdef ENDIANMODE_BIG
- return v;
-#else
- unsigned long long ret = ((v << 56)
- | ((v & 0xff00) << 40)
- | ((v & 0xff0000) << 24)
- | ((v & 0xff000000) << 8)
- | ((v >> 8) & 0xff000000)
- | ((v >> 24) & 0xff0000)
- | ((v >> 40) & 0xff00)
- | (v >> 56));
-
- return ret;
-#endif
-}
-
-unsigned long long h2nll(unsigned long long v)
-{
- return swapll(v);
-}
-
-unsigned long long n2hll(unsigned long long v)
-{
- return swapll(v);
-}
-
-std::string socketAddress2IPPort(sockaddr addr)
-{
- sockaddr_in in;
- memcpy(&in, &addr, sizeof(sockaddr));
-
- char tmp[32];
- snprintf(tmp, sizeof(tmp), "%s:%d", inet_ntoa(in.sin_addr), ntohs(in.sin_port));
-
- std::string ipport = tmp;
- return ipport;
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/transport/SocketUtil.h b/rocketmq-client4cpp/src/transport/SocketUtil.h
deleted file mode 100755
index bfd86d83..00000000
--- a/rocketmq-client4cpp/src/transport/SocketUtil.h
+++ /dev/null
@@ -1,75 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __SOCKETUTIL_H__
-#define __SOCKETUTIL_H__
-
-#include <unistd.h>
-#include <sys/time.h>
-#include <sys/types.h>
-#include <sys/socket.h>
-#include <sys/select.h>
-#include <sys/ioctl.h>
-#include <netdb.h>
-#include <netinet/in.h>
-#include <net/if.h>
-#include <netinet/tcp.h>
-#include <arpa/inet.h>
-#include <fcntl.h>
-#include <errno.h>
-#include <signal.h>
-#include <string>
-#include <stdlib.h>
-#include <assert.h>
-#include <string.h>
-#include <sstream>
-#include <vector>
-#include <iostream>
-
-#include "RocketMQClient.h"
-
-
-#define NET_ERROR errno
-#define SOCKET_ERROR -1
-#define INVALID_SOCKET -1
-#define WSAECONNRESET ECONNRESET
-#define WSAEWOULDBLOCK EWOULDBLOCK
-#define WSAEINPROGRESS EINPROGRESS
-#define WSAEBADF EBADF
-#define closesocket close
-#define SD_SEND SHUT_WR
-#define SD_RECEIVE SHUT_RD
-#define SD_BOTH SHUT_RDWR
-typedef int SOCKET;
-#define SocketUninit()
-
-namespace rmq
-{
- int SocketInit();
- int MakeSocketNonblocking(SOCKET fd);
- int SetTcpNoDelay(SOCKET fd);
-
- bool SplitURL(const std::string& serverURL, std::string& addr, short& nPort);
- sockaddr string2SocketAddress(const std::string& addr);
- std::string socketAddress2String(sockaddr addr);
- std::string socketAddress2IPPort(sockaddr addr);
- std::string getHostName(sockaddr addr);
- std::string getLocalAddress();
-
- unsigned long long h2nll(unsigned long long v);
- unsigned long long n2hll(unsigned long long v);
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/transport/TcpRemotingClient.cpp b/rocketmq-client4cpp/src/transport/TcpRemotingClient.cpp
deleted file mode 100755
index 03b8ca7b..00000000
--- a/rocketmq-client4cpp/src/transport/TcpRemotingClient.cpp
+++ /dev/null
@@ -1,841 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "TcpRemotingClient.h"
-#include "MQClientException.h"
-#include "TcpRequestProcessor.h"
-#include "MQProtos.h"
-#include "ThreadPoolWork.h"
-
-namespace rmq
-{
-
-
-ProcessDataWork::ProcessDataWork(TcpRemotingClient* pClient, TcpTransport* pTts, std::string* pData)
- : m_pClient(pClient), m_pTts(pTts), m_pData(pData)
-{
-}
-
-ProcessDataWork::~ProcessDataWork()
-{
- delete m_pData;
-}
-
-void ProcessDataWork::Do()
-{
- try
- {
- m_pClient->processData(m_pTts, m_pData);
- }
- catch (std::exception& e)
- {
- RMQ_ERROR("processDataWork catch Exception: %s", e.what());
- }
- catch (...)
- {
- RMQ_ERROR("processDataWork catch Exception");
- }
-}
-
-TcpRemotingClient::TcpRemotingClient(const RemoteClientConfig& config)
- : m_stop(false), m_epoller(false), m_config(config),
- m_semaphoreOneway(s_ClientOnewaySemaphoreValue), m_semaphoreAsync(s_ClientAsyncSemaphoreValue)
-{
- m_pNetThreadPool = new kpr::ThreadPool("NetClientThreadPool", 5, 5, 20);
- m_pEventThread = new EventThread(*this);
- SocketInit();
- m_epoller.create(10240);
-}
-
-TcpRemotingClient::~TcpRemotingClient()
-{
- SocketUninit();
-}
-
-void TcpRemotingClient::start()
-{
- RMQ_DEBUG("TcpRemotingClient::start()");
- m_pEventThread->Start();
-}
-
-void TcpRemotingClient::shutdown()
-{
- RMQ_DEBUG("TcpRemotingClient::shutdown()");
- m_stop = true;
- m_pNetThreadPool->Destroy();
- m_pEventThread->Join();
-}
-
-/*
-void printMsg(const std::string& prefix, const char* pData, int len)
-{
- int headLen;
- memcpy(&headLen, pData + 4, 4);
- headLen = ntohl(headLen);
-
- RMQ_DEBUG("%s|decode[%d,%d,%d]|%s%s", prefix.c_str(), len, headLen, len - 8 - headLen, std::string(pData + 8, headLen).c_str(),
- std::string(pData + 8 + headLen, len - 8 - headLen).c_str());
-}
-*/
-
-void TcpRemotingClient::run()
-{
- RMQ_INFO("EventThread run begin: %lld", KPRUtil::GetCurrentTimeMillis());
- do
- {
- try
- {
- int nfds = m_epoller.wait(500);
- if (nfds > 0)
- {
- int ret = 0;
- std::vector<TcpTransport*> errTts;
- for (int i = 0; i < nfds && !m_stop; ++i)
- {
- const epoll_event& ev = m_epoller.get(i);
- std::map<std::string , TcpTransport*>::iterator it;
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_transportTableLock);
- it = m_transportTable.find((char*)ev.data.ptr);
- if (it == m_transportTable.end())
- {
- continue;
- }
- }
-
- TcpTransport* pTts = it->second;
- if (ev.events & EPOLLERR || ev.events & EPOLLHUP)
- {
- RMQ_ERROR("recvData fail, err=%d(%s), pts=%p", errno, strerror(errno), pTts);
- errTts.push_back(pTts);
- }
-
- if (ev.events & EPOLLIN)
- {
- std::list<std::string*> dataList;
- ret = pTts->recvData(dataList);
- if (ret < 0)
- {
- RMQ_ERROR("recvData fail, ret=%d, errno=%d, pts=%p", ret, NET_ERROR, pTts);
- errTts.push_back(pTts);
- }
-
- if (dataList.size() > 0)
- {
- for (typeof(dataList.begin()) it = dataList.begin();
- it != dataList.end(); it++)
- {
- //printMsg("run", (*it)->c_str(), (*it)->size());
- kpr::ThreadPoolWorkPtr work = new ProcessDataWork(this, pTts, *it);
- m_pNetThreadPool->AddWork(work);
- }
- }
- }
- }
-
- std::vector<TcpTransport*>::iterator itErr = errTts.begin();
- for (; itErr != errTts.end(); itErr++)
- {
- removeTTS(*itErr, true);
- }
- }
-
- handleTimerEvent();
- }
- catch (...)
- {
- RMQ_ERROR("TcpRemotingClient.run catch exception");
- }
- }
- while (!m_stop);
- handleTimerEvent();
-
- RMQ_INFO("EventThread run end: %lld", KPRUtil::GetCurrentTimeMillis());
-}
-
-
-void TcpRemotingClient::updateNameServerAddressList(const std::vector<std::string>& addrs)
-{
- m_namesrvAddrList = addrs;
- m_namesrvIndex = 0;
-}
-
-std::vector<std::string> TcpRemotingClient::getNameServerAddressList()
-{
- return m_namesrvAddrList;
-}
-
-void TcpRemotingClient::registerProcessor(int requestCode, TcpRequestProcessor* pProcessor)
-{
- m_processorTable[requestCode] = pProcessor;
-}
-
-
-RemotingCommand* TcpRemotingClient::invokeSync(const std::string& addr,
- RemotingCommand* pRequest,
- int timeoutMillis)
-{
- TcpTransport* pTts = getAndCreateTransport(addr, timeoutMillis);
- if (pTts != NULL && pTts->isConnected())
- {
- RemotingCommand* pResponse = NULL;
- try
- {
- pResponse = invokeSyncImpl(pTts, pRequest, timeoutMillis);
- }
- catch(const RemotingSendRequestException& e)
- {
- RMQ_WARN("invokeSync: send pRequest exception, so close the channel[{%s}]",
- pTts->getServerAddr().c_str());
- removeTTS(pTts, false);
- throw e;
- }
- catch(const RemotingTimeoutException& e)
- {
- RMQ_WARN("invokeSync: wait response timeout exception, the channel[{%s}], timeout=%d",
- pTts->getServerAddr().c_str(), timeoutMillis);
- throw e;
- }
-
- return pResponse;
- }
- else
- {
- removeTTS(pTts, false);
- THROW_MQEXCEPTION(RemotingConnectException, "connect fail", -1);
- //return NULL;
- }
-}
-
-void TcpRemotingClient::invokeAsync(const std::string& addr,
- RemotingCommand* pRequest,
- int timeoutMillis,
- InvokeCallback* pInvokeCallback)
-{
- TcpTransport* pTts = getAndCreateTransport(addr, timeoutMillis);
- if (pTts != NULL && pTts->isConnected())
- {
- try
- {
- this->invokeAsyncImpl(pTts, pRequest, timeoutMillis, pInvokeCallback);
- }
- catch (const RemotingSendRequestException& e)
- {
- RMQ_WARN("invokeAsync: send pRequest exception, so close the channel[{%s}]", addr.c_str());
- removeTTS(pTts, false);
- throw e;
- }
-
- return;
- }
- else
- {
- removeTTS(pTts, false);
- std::string msg;msg.append("connect to <").append(addr).append("> failed");
- THROW_MQEXCEPTION(RemotingConnectException, msg, -1);
- }
-}
-
-int TcpRemotingClient::invokeOneway(const std::string& addr,
- RemotingCommand* pRequest,
- int timeoutMillis)
-{
- TcpTransport* pTts = getAndCreateTransport(addr, timeoutMillis);
- if (pTts != NULL && pTts->isConnected())
- {
- return invokeOnewayImpl(pTts, pRequest, timeoutMillis);
- }
- else
- {
- removeTTS(pTts, false);
- return -1;
- }
-}
-
-
-TcpTransport* TcpRemotingClient::getAndCreateTransport(const std::string& addr, int timeoutMillis)
-{
- if (addr.empty())
- {
- return getAndCreateNameserverTransport(timeoutMillis);
- }
-
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_transportTableLock);
- std::map<std::string , TcpTransport*>::iterator it = m_transportTable.find(addr);
- if (it != m_transportTable.end())
- {
- return it->second;
- }
- }
-
- return this->createTransport(addr, timeoutMillis);
-}
-
-
-TcpTransport* TcpRemotingClient::createTransport(const std::string& addr, int timeoutMillis)
-{
- TcpTransport* pTts = NULL;
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_transportTableLock);
- std::map<std::string , TcpTransport*>::iterator it = m_transportTable.find(addr);
- if (it != m_transportTable.end())
- {
- return it->second;
- }
- }
-
- if (m_transportTableLock.TryWriteLock(s_LockTimeoutMillis))
- {
- std::map<std::string , TcpTransport*>::iterator it = m_transportTable.find(addr);
- if (it != m_transportTable.end())
- {
- return it->second;
- }
-
- std::map<std::string , std::string> config;
- pTts = new TcpTransport(config);
- if (pTts->connect(addr, timeoutMillis) != CLIENT_ERROR_SUCCESS)
- {
- delete pTts;
- pTts = NULL;
-
- RMQ_INFO("[NETWORK]: CONNECT {%s} failed", addr.c_str());
- }
- else
- {
- m_transportTable[addr] = pTts;
- m_epoller.add(pTts->getSocket(), (long long)((pTts->getServerAddr()).c_str()), EPOLLIN);
-
- RMQ_INFO("[NETWORK]: CONNECT => {%s} success", addr.c_str());
- }
- m_transportTableLock.Unlock();
- }
- else
- {
- RMQ_WARN("createTransport: try to lock m_transportTable, but timeout, {%d}ms", timeoutMillis);
- }
-
- return pTts;
-}
-
-
-TcpTransport* TcpRemotingClient::getAndCreateNameserverTransport(int timeoutMillis)
-{
- TcpTransport* pTts = NULL;
-
- if (m_namesrvAddrChoosed.get() != NULL)
- {
- std::string addr = *m_namesrvAddrChoosed;
- if (!addr.empty())
- {
- pTts = getAndCreateTransport(addr, timeoutMillis);
- if (pTts != NULL)
- {
- return pTts;
- }
- }
- }
-
- if (m_namesrvAddrChoosedLock.TryLock(s_LockTimeoutMillis))
- {
- if (m_namesrvAddrChoosed.get() != NULL)
- {
- std::string addr = *m_namesrvAddrChoosed;
- if (!addr.empty())
- {
- pTts = getAndCreateTransport(addr, timeoutMillis);
- if (pTts != NULL)
- {
- m_namesrvAddrChoosedLock.Unlock();
- return pTts;
- }
- }
- }
-
- if (!m_namesrvAddrList.empty())
- {
- for (size_t i = 0; i < m_namesrvAddrList.size(); i++)
- {
- int index = abs(++m_namesrvIndex) % m_namesrvAddrList.size();
- std::string& newAddr = m_namesrvAddrList.at(index);
- m_namesrvAddrChoosed.set(&newAddr);
- TcpTransport* pTts = getAndCreateTransport(newAddr, timeoutMillis);
- if (pTts != NULL)
- {
- m_namesrvAddrChoosedLock.Unlock();
- return pTts;
- }
- }
- }
-
- m_namesrvAddrChoosedLock.Unlock();
- }
-
- return NULL;
-}
-
-
-void TcpRemotingClient::handleTimerEvent()
-{
- // every 1000ms
- static unsigned long long lastTime = 0;
- if (!m_stop && (int)(KPRUtil::GetCurrentTimeMillis() - lastTime) < s_CheckIntervalMillis)
- {
- return;
- }
-
- try
- {
- lastTime = KPRUtil::GetCurrentTimeMillis();
-
- this->scanResponseTable();
-
- this->scanCloseTransportTable();
- }
- catch(...)
- {
- RMQ_ERROR("scanResponseTable exception");
- }
-}
-
-
-void TcpRemotingClient::scanCloseTransportTable()
-{
- if (m_closeTransportTable.empty())
- {
- return;
- }
-
- if (m_closeTransportTableLock.TryLock())
- {
- std::list<TcpTransport*>::iterator it;
- for( it = m_closeTransportTable.begin(); it != m_closeTransportTable.end(); )
- {
- TcpTransport* pTts = *it;
- long long diffTime = KPRUtil::GetCurrentTimeMillis() - pTts->getLastSendRecvTime();
- if (m_stop || (diffTime > 5000))
- {
- RMQ_WARN("remove close connection, %lld, {%s}", diffTime, pTts->getServerAddr().c_str());
- it = m_closeTransportTable.erase(it);
- delete pTts;
- }
- else
- {
- it++;
- }
- }
- m_closeTransportTableLock.Unlock();
- }
- else
- {
- RMQ_WARN("m_closeTransportTableLock TryLock fail");
- }
-}
-
-
-void TcpRemotingClient::scanResponseTable()
-{
- kpr::ScopedWLock<kpr::RWMutex> lock(m_responseTableLock);
- for(typeof(m_responseTable.begin()) it = m_responseTable.begin();it != m_responseTable.end();)
- {
- long long diffTime = KPRUtil::GetCurrentTimeMillis() - it->second->getBeginTimestamp();
- if (m_stop || (diffTime > it->second->getTimeoutMillis() + 2000))
- {
- RMQ_WARN("remove timeout request, %lld, %s", diffTime, it->second->toString().c_str());
- try
- {
- it->second->executeInvokeCallback();
- }
- catch(...)
- {
- RMQ_WARN("scanResponseTable, operationComplete Exception");
- }
- it->second->release();
- m_responseTable.erase(it++);
- }
- else
- {
- it++;
- }
- }
-}
-
-void TcpRemotingClient::processData(TcpTransport* pTts, std::string* pData)
-{
- //printMsg("processData", pData->c_str(), pData->size());
- RemotingCommand* pCmd = RemotingCommand::decode(pData->data(), (int)pData->size());
- if (pCmd == NULL)
- {
- RMQ_ERROR("invalid data format, len:%d, data: %s", (int)pData->size(), pData->c_str());
- return;
- }
-
- int code = 0;
- if (pCmd->isResponseType())
- {
- kpr::ScopedRLock<kpr::RWMutex> lock(m_responseTableLock);
- std::map<int, ResponseFuturePtr>::iterator it = m_responseTable.find(pCmd->getOpaque());
- if (it != m_responseTable.end())
- {
- code = it->second->getRequestCode();
- }
- else
- {
- RMQ_WARN("receive response, but not matched any request, maybe timeout or oneway, pCmd: %s", pCmd->toString().c_str());
- delete pCmd;
- return;
- }
- }
- else
- {
- code = pCmd->getCode();
- }
-
- pCmd->makeCustomHeader(code, pData->data(), (int)pData->size());
- if (pCmd->isResponseType())
- {
- RMQ_DEBUG("[NETWORK]: RECV => {%s}, {opaque=%d, requst.code=%s(%d), response.code=%s(%d)}, %s",
- pTts->getServerAddr().c_str(), pCmd->getOpaque(), getMQRequestCodeString(code), code,
- getMQResponseCodeString(pCmd->getCode()), pCmd->getCode(), pCmd->toString().c_str());
- }
- else
- {
- RMQ_DEBUG("[NETWORK]: RECV => {%s}, {opaque=%d, requst.code=%s(%d)}, %s",
- pTts->getServerAddr().c_str(), pCmd->getOpaque(),
- getMQRequestCodeString(code), code, pCmd->toString().c_str());
- }
-
- processMessageReceived(pTts, pCmd);
-}
-
-RemotingCommand* TcpRemotingClient::invokeSyncImpl(TcpTransport* pTts,
- RemotingCommand* pRequest,
- int timeoutMillis)
-{
- ResponseFuturePtr pResponseFuture = new ResponseFuture(
- pRequest->getCode(), pRequest->getOpaque(), timeoutMillis,
- NULL, true, NULL);
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_responseTableLock);
- m_responseTable.insert(std::pair<int, ResponseFuturePtr>(pRequest->getOpaque(), pResponseFuture));
- }
-
- int ret = sendCmd(pTts, pRequest, timeoutMillis);
- if (ret == 0)
- {
- pResponseFuture->setSendRequestOK(true);
- }
- else
- {
- pResponseFuture->setSendRequestOK(false);
- pResponseFuture->putResponse(NULL);
- RMQ_WARN("send a pRequest command to channel <%s> failed.", pTts->getServerAddr().c_str());
- }
-
- RemotingCommand* pResponse = pResponseFuture->waitResponse(timeoutMillis);
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_responseTableLock);
- std::map<int, ResponseFuturePtr>::iterator it = m_responseTable.find(pRequest->getOpaque());
- if (it != m_responseTable.end())
- {
- m_responseTable.erase(it);
- }
- }
-
- if (pResponse == NULL)
- {
- if (ret == 0)
- {
- std::stringstream oss;
- oss << "wait response on the channel <" << pTts->getServerAddr() << "> timeout," << timeoutMillis << "ms";
- THROW_MQEXCEPTION(RemotingTimeoutException, oss.str(), -1);
- }
- else
- {
- std::stringstream oss;
- oss << "send request to <" << pTts->getServerAddr() << "> failed";
- THROW_MQEXCEPTION(RemotingSendRequestException, oss.str(), -1);
- }
- }
-
- return pResponse;
-}
-
-void TcpRemotingClient::invokeAsyncImpl(TcpTransport* pTts,
- RemotingCommand* pRequest,
- int timeoutMillis,
- InvokeCallback* pInvokeCallback)
-{
- bool acquired = m_semaphoreAsync.Wait(timeoutMillis);
- if (acquired)
- {
- ResponseFuturePtr pResponseFuture = new ResponseFuture(
- pRequest->getCode(), pRequest->getOpaque(), timeoutMillis,
- pInvokeCallback, false, &m_semaphoreAsync);
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_responseTableLock);
- m_responseTable.insert(std::pair<int, ResponseFuturePtr>(pRequest->getOpaque(), pResponseFuture));
- }
-
- int ret = sendCmd(pTts, pRequest, timeoutMillis);
- if (ret == 0)
- {
- pResponseFuture->setSendRequestOK(true);
- }
- else
- {
- pResponseFuture->setSendRequestOK(false);
- pResponseFuture->putResponse(NULL);
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_responseTableLock);
- std::map<int, ResponseFuturePtr>::iterator it = m_responseTable.find(pRequest->getOpaque());
- if (it != m_responseTable.end())
- {
- m_responseTable.erase(it);
- }
- }
-
- try
- {
- pResponseFuture->executeInvokeCallback();
- }
- catch (...)
- {
- RMQ_WARN("executeInvokeCallback exception");
- }
- pResponseFuture->release();
-
- RMQ_WARN("send a pRequest command to channel <%s> failed, requet: %s",
- pTts->getServerAddr().c_str(), pRequest->toString().c_str());
- }
- }
- else
- {
- if (timeoutMillis <= 0)
- {
- THROW_MQEXCEPTION(RemotingTooMuchRequestException, "invokeAsyncImpl invoke too fast", -1);
- }
- else
- {
- std::string info = RocketMQUtil::str2fmt(
- "invokeAsyncImpl wait semaphore timeout, %dms, semaphoreAsyncValue: %d, request: %s",
- timeoutMillis,
- m_semaphoreAsync.GetValue(),
- pRequest->toString().c_str()
- );
- RMQ_WARN("%s", info.c_str());
- THROW_MQEXCEPTION(RemotingTimeoutException, info, -1);
- }
- }
-
- return;
-}
-
-int TcpRemotingClient::invokeOnewayImpl(TcpTransport* pTts,
- RemotingCommand* pRequest,
- int timeoutMillis)
-{
- pRequest->markOnewayRPC();
-
- bool acquired = m_semaphoreOneway.Wait(timeoutMillis);
- if (acquired)
- {
- int ret = sendCmd(pTts, pRequest, timeoutMillis);
- m_semaphoreOneway.Release();
- if (ret != 0)
- {
- RMQ_WARN("send a pRequest command to channel <%s> failed, requet: %s",
- pTts->getServerAddr().c_str(), pRequest->toString().c_str());
- THROW_MQEXCEPTION(RemotingSendRequestException, std::string("send request to <") + pTts->getServerAddr() + "> fail", -1);
- }
- }
- else
- {
- if (timeoutMillis <= 0)
- {
- THROW_MQEXCEPTION(RemotingTooMuchRequestException, "invokeOnewayImpl invoke too fast", -1);
- }
- else
- {
- std::string info = RocketMQUtil::str2fmt(
- "invokeOnewayImpl wait semaphore timeout, %dms, semaphoreAsyncValue: %d, request: %s",
- timeoutMillis,
- m_semaphoreAsync.GetValue(),
- pRequest->toString().c_str()
- );
- RMQ_WARN("%s", info.c_str());
- THROW_MQEXCEPTION(RemotingTimeoutException, info, -1);
- }
- }
-
- return 0;
-}
-
-void TcpRemotingClient::processMessageReceived(TcpTransport* pTts, RemotingCommand* pCmd)
-{
- try
- {
- switch (pCmd->getType())
- {
- case REQUEST_COMMAND:
- processRequestCommand(pTts, pCmd);
- break;
- case RESPONSE_COMMAND:
- processResponseCommand(pTts, pCmd);
- break;
- default:
- break;
- }
- }
- catch (std::exception& e)
- {
- RMQ_ERROR("processMessageReceived catch Exception: %s", e.what());
- }
- catch (...)
- {
- RMQ_ERROR("processMessageReceived catch Exception");
- }
-}
-
-void TcpRemotingClient::processRequestCommand(TcpTransport* pTts, RemotingCommand* pCmd)
-{
- RMQ_DEBUG("receive request from server, cmd: %s", pCmd->toString().c_str());
- RemotingCommandPtr pResponse = NULL;
- std::map<int, TcpRequestProcessor*>::iterator it = m_processorTable.find(pCmd->getCode());
- if (it != m_processorTable.end())
- {
- try
- {
- pResponse = it->second->processRequest(pTts, pCmd);
- if (!pCmd->isOnewayRPC())
- {
- if (pResponse.ptr() != NULL)
- {
- pResponse->setOpaque(pCmd->getOpaque());
- pResponse->markResponseType();
- int ret = this->sendCmd(pTts, pResponse, 3000);
- if (ret != 0)
- {
- RMQ_ERROR("process request over, but response failed");
- }
- }
- else
- {
- // ignore
- }
- }
- }
- catch (const std::exception& e)
- {
- RMQ_ERROR("process request exception:%s", e.what());
- if (!pCmd->isOnewayRPC())
- {
- pResponse = RemotingCommand::createResponseCommand(
- SYSTEM_ERROR_VALUE, e.what(), NULL);
- pResponse->setOpaque(pCmd->getOpaque());
- int ret = this->sendCmd(pTts, pResponse, 3000);
- if (ret != 0)
- {
- RMQ_ERROR("process request over, but response failed");
- }
- }
- }
- }
- else
- {
- pResponse = RemotingCommand::createResponseCommand(
- REQUEST_CODE_NOT_SUPPORTED_VALUE, "request type not supported", NULL);
- pResponse->setOpaque(pCmd->getOpaque());
- int ret = this->sendCmd(pTts, pResponse, 3000);
- if (ret != 0)
- {
- RMQ_ERROR("process request over, but pResponse failed");
- }
- }
- delete pCmd;
-}
-
-void TcpRemotingClient::processResponseCommand(TcpTransport* pTts, RemotingCommand* pCmd)
-{
- ResponseFuturePtr res = NULL;
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_responseTableLock);
- std::map<int, ResponseFuturePtr>::iterator it = m_responseTable.find(pCmd->getOpaque());
- if (it != m_responseTable.end())
- {
- res = it->second;
- res->release();
- m_responseTable.erase(it);
- }
- }
-
- if (res)
- {
- res->putResponse(pCmd);
- res->executeInvokeCallback();
- }
- else
- {
- RMQ_WARN("receive response, but not matched any request, cmd: %s", pCmd->toString().c_str());
- delete pCmd;
- }
-}
-
-int TcpRemotingClient::sendCmd(TcpTransport* pTts, RemotingCommand* pRequest, int timeoutMillis)
-{
- pRequest->encode();
- int ret = pTts->sendData(pRequest->getData(), pRequest->getDataLen(), timeoutMillis);
-
- RMQ_DEBUG("[NETWORK]: SEND => {%s}, {opaque=%d, request.code=%s(%d), ret=%d, timeout=%d}, %s",
- pTts->getServerAddr().c_str(), pRequest->getOpaque(),
- getMQRequestCodeString(pRequest->getCode()), pRequest->getCode(),
- ret, timeoutMillis, pRequest->toString().c_str());
-
- return ret;
-}
-
-void TcpRemotingClient::removeTTS(TcpTransport* pTts, bool isDisConnected)
-{
- if (pTts)
- {
- RMQ_INFO("[NETWORK]: %s => {%s}", isDisConnected ? "DISCONNECT" : "CLOSE",
- pTts->getServerAddr().c_str());
-
- bool bNeedClear = false;
- m_epoller.del(pTts->getSocket(), (long long)(pTts->getServerAddr().c_str()), 0);
- {
- kpr::ScopedWLock<kpr::RWMutex> lock(m_transportTableLock);
- std::map<std::string , TcpTransport*>::iterator it = m_transportTable.find(pTts->getServerAddr());
- if (it != m_transportTable.end())
- {
- if (it->second == pTts)
- {
- m_transportTable.erase(it);
- bNeedClear = true;
- }
- }
- }
-
- if (bNeedClear)
- {
- kpr::ScopedLock<kpr::Mutex> lock(m_closeTransportTableLock);
- m_closeTransportTable.push_back(pTts);
- }
- }
-}
-
-}
diff --git a/rocketmq-client4cpp/src/transport/TcpRemotingClient.h b/rocketmq-client4cpp/src/transport/TcpRemotingClient.h
deleted file mode 100755
index d8bbf962..00000000
--- a/rocketmq-client4cpp/src/transport/TcpRemotingClient.h
+++ /dev/null
@@ -1,152 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-
-#ifndef __TCPREMOTINGCLIENT_H__
-#define __TCPREMOTINGCLIENT_H__
-
-#include <map>
-#include <string>
-#include <list>
-
-#include "RocketMQClient.h"
-#include "SocketUtil.h"
-#include "Epoller.h"
-#include "RemotingCommand.h"
-#include "Thread.h"
-#include "ThreadPool.h"
-#include "ThreadPoolWork.h"
-#include "RemoteClientConfig.h"
-#include "TcpTransport.h"
-#include "ScopedLock.h"
-#include "KPRUtil.h"
-#include "Semaphore.h"
-#include "ResponseFuture.h"
-
-namespace rmq
-{
- class TcpTransport;
- class InvokeCallback;
- class TcpRemotingClient;
- class ResponseFuture;
- class TcpRequestProcessor;
-
- class ProcessDataWork : public kpr::ThreadPoolWork
- {
- public:
- ProcessDataWork(TcpRemotingClient* pClient, TcpTransport* pTts, std::string* pData);
- virtual ~ProcessDataWork();
- virtual void Do();
-
- private:
- TcpRemotingClient* m_pClient;
- TcpTransport* m_pTts;
- std::string* m_pData;
- };
- typedef kpr::RefHandleT<ProcessDataWork> ProcessDataWorkPtr;
-
- class TcpRemotingClient
- {
- class EventThread : public kpr::Thread
- {
- public:
- EventThread(TcpRemotingClient& client)
- : Thread("NetThread"), m_client(client)
- {
- }
-
- void Run()
- {
- m_client.run();
- }
-
- private :
- TcpRemotingClient& m_client;
- };
- friend class EventThread;
- friend class ProcessDataWork;
-
- public:
- static const int s_LockTimeoutMillis = 3000;
- static const int s_CheckIntervalMillis = 1000;
- static const int s_ClientOnewaySemaphoreValue = 2048;
- static const int s_ClientAsyncSemaphoreValue = 2048;
-
- public:
- TcpRemotingClient(const RemoteClientConfig& config);
- virtual ~TcpRemotingClient();
- virtual void start();
- virtual void shutdown();
-
- void updateNameServerAddressList(const std::vector<std::string>& addrs);
- std::vector<std::string> getNameServerAddressList();
- void registerProcessor(int requestCode, TcpRequestProcessor* pProcessor);
-
- RemotingCommand* invokeSync(const std::string& addr, RemotingCommand* pRequest, int timeoutMillis) ;
- void invokeAsync(const std::string& addr, RemotingCommand* pRequest, int timeoutMillis, InvokeCallback* invokeCallback);
- int invokeOneway(const std::string& addr, RemotingCommand* pRequest, int timeoutMillis);
-
- private:
- void run();
- int sendCmd(TcpTransport* pTts, RemotingCommand* pRequest, int timeoutMillis);
- void removeTTS(TcpTransport* pTts, bool isDisConnected = false);
- void processData(TcpTransport* pTts, std::string* data);
- void handleTimerEvent();
- void scanResponseTable();
- void scanCloseTransportTable();
-
- void processMessageReceived(TcpTransport* pTts, RemotingCommand* pCmd);
- void processRequestCommand(TcpTransport* pTts, RemotingCommand* pCmd);
- void processResponseCommand(TcpTransport* pTts, RemotingCommand* pCmd);
-
- TcpTransport* getAndCreateTransport(const std::string& addr, int timeoutMillis);
- TcpTransport* getAndCreateNameserverTransport(int timeoutMillis);
- TcpTransport* createTransport(const std::string& addr, int timeoutMillis);
-
- RemotingCommand* invokeSyncImpl(TcpTransport* pTts, RemotingCommand* pRequest, int timeoutMillis) ;
- void invokeAsyncImpl(TcpTransport* pTts, RemotingCommand* pRequest, int timeoutMillis, InvokeCallback* pInvokeCallback);
- int invokeOnewayImpl(TcpTransport* pTts, RemotingCommand* pRequest, int timeoutMillis);
-
- private:
- bool m_stop;
- kpr::Epoller m_epoller;
- RemoteClientConfig m_config;
-
- kpr::Semaphore m_semaphoreOneway;
- kpr::Semaphore m_semaphoreAsync;
-
- std::map<std::string , TcpTransport*> m_transportTable;
- kpr::RWMutex m_transportTableLock;
-
- std::list<TcpTransport*> m_closeTransportTable;
- kpr::Mutex m_closeTransportTableLock;
-
- std::map<int, ResponseFuturePtr> m_responseTable;
- kpr::RWMutex m_responseTableLock;
-
- std::vector<std::string> m_namesrvAddrList;
- kpr::AtomicInteger m_namesrvIndex;
- kpr::AtomicReference<std::string> m_namesrvAddrChoosed;
- kpr::Mutex m_namesrvAddrChoosedLock;
-
- kpr::ThreadPoolPtr m_pNetThreadPool;
- kpr::ThreadPtr m_pEventThread;
-
- TcpRequestProcessor* m_pDefaultRequestProcessor;
- std::map<int, TcpRequestProcessor*> m_processorTable;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/transport/TcpRequestProcessor.h b/rocketmq-client4cpp/src/transport/TcpRequestProcessor.h
deleted file mode 100755
index 6ac02d15..00000000
--- a/rocketmq-client4cpp/src/transport/TcpRequestProcessor.h
+++ /dev/null
@@ -1,32 +0,0 @@
-/**
- * Copyright (C) 2013 kangliqiang ,kangliq@163.com
- *
- * Licensed under the Apache License, Version 2.0 (the "License");
- * you may not use this file except in compliance with the License.
- * You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-#ifndef __TCPREQUESTPROCESSOR_H__
-#define __TCPREQUESTPROCESSOR_H__
-
-namespace rmq
-{
- class RemotingCommand;
- class TcpTransport;
-
- class TcpRequestProcessor
- {
- public:
- virtual ~TcpRequestProcessor() {}
- virtual RemotingCommand* processRequest(TcpTransport* pTts, RemotingCommand* pRequest) = 0;
- };
-}
-
-#endif
diff --git a/rocketmq-client4cpp/src/transport/TcpTransport.cpp b/rocketmq-client4cpp/src/transport/TcpTransport.cpp
deleted file mode 100755
index 858adf35..00000000
--- a/rocketmq-client4cpp/src/transport/TcpTransport.cpp
+++ /dev/null
@@ -1,387 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#include "TcpTransport.h"
-
-#include <stdio.h>
-#include <stdlib.h>
-#include <memory.h>
-#include <errno.h>
-#include <assert.h>
-#include "KPRUtil.h"
-#include "SocketUtil.h"
-#include "Epoller.h"
-#include "ScopedLock.h"
-
-namespace rmq
-{
-
-const int DEFAULT_SHRINK_COUNT = 32;
-const int DEFAULT_RECV_BUFFER_SIZE = 1024 * 16;
-
-TcpTransport::TcpTransport(std::map<std::string, std::string>& config)
- : m_sfd(-1),
- m_state(CLIENT_STATE_UNINIT),
- m_pRecvBuf(NULL),
- m_recvBufSize(DEFAULT_RECV_BUFFER_SIZE),
- m_recvBufUsed(0),
- m_shrinkMax(DEFAULT_RECV_BUFFER_SIZE),
- m_shrinkCheckCnt(DEFAULT_SHRINK_COUNT)
-{
- std::map<std::string, std::string>::iterator it = config.find("tcp.transport.recvBufferSize");
- if (it != config.end())
- {
- m_recvBufSize = atoi(it->second.c_str());
- }
-
- it = config.find("tcp.transport.shrinkCheckMax");
- if (it != config.end())
- {
- m_shrinkCheckCnt = atoi(it->second.c_str());
- }
-
- if (SocketInit() != 0)
- {
- m_state = CLIENT_STATE_UNINIT;
- }
-
- m_pRecvBuf = (char*)malloc(m_recvBufSize);
- m_state = (NULL == m_pRecvBuf) ? CLIENT_STATE_UNINIT : CLIENT_STATE_INITED;
- m_lastSendRecvTime = KPRUtil::GetCurrentTimeMillis();
-}
-
-TcpTransport::~TcpTransport()
-{
- close();
-
- if (m_sfd != INVALID_SOCKET)
- {
- ::shutdown(m_sfd, SD_BOTH);
- ::closesocket(m_sfd);
- m_sfd = INVALID_SOCKET;
- }
-
- if (m_pRecvBuf)
- {
- free(m_pRecvBuf);
- }
-
- SocketUninit();
-}
-
-
-int TcpTransport::connect(const std::string& serverAddr, int timeoutMillis)
-{
- long long endTime = KPRUtil::GetCurrentTimeMillis() + timeoutMillis;
- if (m_state == CLIENT_STATE_UNINIT)
- {
- return CLIENT_ERROR_INIT;
- }
-
- if (isConnected())
- {
- if (serverAddr.compare(m_serverAddr) == 0)
- {
- return CLIENT_ERROR_SUCCESS;
- }
- else
- {
- close();
- }
- }
-
- short port;
- std::string strAddr;
-
- if (!SplitURL(serverAddr, strAddr, port))
- {
- return CLIENT_ERROR_INVALID_URL;
- }
-
- struct sockaddr_in sa;
- sa.sin_family = AF_INET;
- sa.sin_port = htons(port);
-
- sa.sin_addr.s_addr = inet_addr(strAddr.c_str());
- m_sfd = (int)socket(AF_INET, SOCK_STREAM, 0);
-
- if (MakeSocketNonblocking(m_sfd) == -1)
- {
- ::closesocket(m_sfd);
- return CLIENT_ERROR_CONNECT;
- }
-
- if (SetTcpNoDelay(m_sfd) == -1)
- {
- ::closesocket(m_sfd);
- return CLIENT_ERROR_CONNECT;
- }
-
- if (::connect(m_sfd, (struct sockaddr*)&sa, sizeof(sockaddr)) == -1)
- {
- int err = NET_ERROR;
- if (err == WSAEWOULDBLOCK || err == WSAEINPROGRESS)
- {
- kpr::Epoller epoller(false);
- epoller.create(1);
- epoller.add(m_sfd, 0, EPOLLOUT);
- int iRetCode = epoller.wait(endTime - KPRUtil::GetCurrentTimeMillis());
- if (iRetCode <= 0)
- {
- ::closesocket(m_sfd);
- return CLIENT_ERROR_CONNECT;
- }
- else if (iRetCode == 0)
- {
- ::closesocket(m_sfd);
- return CLIENT_ERROR_CONNECT;
- }
-
- const epoll_event& ev = epoller.get(0);
- if (ev.events & EPOLLERR || ev.events & EPOLLHUP)
- {
- ::closesocket(m_sfd);
- return CLIENT_ERROR_CONNECT;
- }
-
- int opterr = 0;
- socklen_t errlen = sizeof(opterr);
- if (getsockopt(m_sfd, SOL_SOCKET, SO_ERROR, &opterr, &errlen) == -1 || opterr)
- {
- ::closesocket(m_sfd);
- return CLIENT_ERROR_CONNECT;
- }
- }
- else
- {
- ::closesocket(m_sfd);
- return CLIENT_ERROR_CONNECT;
- }
- }
-
- m_serverAddr = serverAddr;
- m_state = CLIENT_STATE_CONNECTED;
- m_recvBufUsed = 0;
- m_lastSendRecvTime = KPRUtil::GetCurrentTimeMillis();
-
- return CLIENT_ERROR_SUCCESS;
-}
-
-
-bool TcpTransport::isConnected()
-{
- return m_state == CLIENT_STATE_CONNECTED;
-}
-
-void TcpTransport::close()
-{
- if (m_state == CLIENT_STATE_CONNECTED)
- {
- m_state = CLIENT_STATE_DISCONNECT;
- }
-}
-
-int TcpTransport::sendData(const char* pBuffer, int len, int timeOut)
-{
- kpr::ScopedLock<kpr::Mutex> lock(m_sendLock);
- return sendOneMsg(pBuffer, len, timeOut > 0 ? timeOut : 0);
-}
-
-int TcpTransport::sendOneMsg(const char* pBuffer, int len, int nTimeOut)
-{
- int pos = 0;
- long long endTime = KPRUtil::GetCurrentTimeMillis() + nTimeOut;
-
- while (len > 0 && m_state == CLIENT_STATE_CONNECTED)
- {
- int ret = send(m_sfd, pBuffer + pos, len, 0);
- if (ret > 0)
- {
- len -= ret;
- pos += ret;
- }
- else if (ret == 0)
- {
- close();
- break;
- }
- else
- {
- int err = NET_ERROR;
- if (err == WSAEWOULDBLOCK || err == EAGAIN)
- {
- kpr::Epoller epoller(false);
- epoller.create(1);
- epoller.add(m_sfd, 0, EPOLLOUT);
- int iRetCode = epoller.wait(endTime - KPRUtil::GetCurrentTimeMillis());
- if (iRetCode <= 0)
- {
- close();
- break;
- }
- else if (iRetCode == 0)
- {
- close();
- break;
- }
-
- const epoll_event& ev = epoller.get(0);
- if (ev.events & EPOLLERR || ev.events & EPOLLHUP)
- {
- close();
- break;
- }
- }
- else
- {
- close();
- break;
- }
- }
- }
- m_lastSendRecvTime = KPRUtil::GetCurrentTimeMillis();
-
- return (len == 0) ? 0 : -1;
-}
-
-
-int TcpTransport::recvMsg()
-{
- int ret = recv(m_sfd, m_pRecvBuf + m_recvBufUsed, m_recvBufSize - m_recvBufUsed, 0);
-
- if (ret > 0)
- {
- m_recvBufUsed += ret;
- }
- else if (ret == 0)
- {
- close();
- ret = -1;
- }
- else if (ret < 0)
- {
- int err = NET_ERROR;
- if (err == WSAEWOULDBLOCK || err == EAGAIN || err == EINTR)
- {
- ret = 0;
- }
- else
- {
- close();
- }
- }
- m_lastSendRecvTime = KPRUtil::GetCurrentTimeMillis();
-
- return ret;
-}
-
-bool TcpTransport::resizeBuf(int nNewSize)
-{
- char* newbuf = (char*)realloc(m_pRecvBuf, nNewSize);
- if (!newbuf)
- {
- return false;
- }
-
- m_pRecvBuf = newbuf;
- m_recvBufSize = nNewSize;
-
- return true;
-}
-
-void TcpTransport::tryShrink(int MsgLen)
-{
- m_shrinkMax = MsgLen > m_shrinkMax ? MsgLen : m_shrinkMax;
- if (m_shrinkCheckCnt == 0)
- {
- m_shrinkCheckCnt = DEFAULT_SHRINK_COUNT;
- if (m_recvBufSize > m_shrinkMax)
- {
- resizeBuf(m_shrinkMax);
- }
- }
- else
- {
- m_shrinkCheckCnt--;
- }
-}
-
-int TcpTransport::getMsgSize(const char* pBuf)
-{
- int len = 0;
- memcpy(&len, pBuf, sizeof(int));
-
- return ntohl(len) + 4;
-}
-
-int TcpTransport::recvData(std::list<std::string*>& dataList)
-{
- int ret = recvMsg();
- processData(dataList);
- return ret;
-}
-
-void TcpTransport::processData(std::list<std::string*>& dataList)
-{
- while (m_recvBufUsed > int(sizeof(int)))
- {
- int msgLen = 0;
- msgLen = getMsgSize(m_pRecvBuf);
- if (msgLen > m_recvBufSize)
- {
- if (resizeBuf(msgLen))
- {
- m_shrinkCheckCnt = DEFAULT_SHRINK_COUNT;
- }
- break;
- }
- else
- {
- tryShrink(msgLen);
- }
-
- if (m_recvBufUsed >= msgLen)
- {
- std::string* data = new std::string;
- data->assign(m_pRecvBuf, msgLen);
- dataList.push_back(data);
- m_recvBufUsed -= msgLen;
-
- memmove(m_pRecvBuf, m_pRecvBuf + msgLen, m_recvBufUsed);
- }
- else
- {
- break;
- }
- }
-}
-
-SOCKET TcpTransport::getSocket()
-{
- return m_sfd;
-}
-
-std::string& TcpTransport::getServerAddr()
-{
- return m_serverAddr;
-}
-
-unsigned long long TcpTransport::getLastSendRecvTime()
-{
- return m_lastSendRecvTime;
-}
-
-
-}
diff --git a/rocketmq-client4cpp/src/transport/TcpTransport.h b/rocketmq-client4cpp/src/transport/TcpTransport.h
deleted file mode 100755
index 69f1e53f..00000000
--- a/rocketmq-client4cpp/src/transport/TcpTransport.h
+++ /dev/null
@@ -1,78 +0,0 @@
-/**
-* Copyright (C) 2013 kangliqiang ,kangliq@163.com
-*
-* Licensed under the Apache License, Version 2.0 (the "License");
-* you may not use this file except in compliance with the License.
-* You may obtain a copy of the License at
-*
-* http://www.apache.org/licenses/LICENSE-2.0
-*
-* Unless required by applicable law or agreed to in writing, software
-* distributed under the License is distributed on an "AS IS" BASIS,
-* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-* See the License for the specific language governing permissions and
-* limitations under the License.
-*/
-#ifndef __TCPTRANSPORT_H__
-#define __TCPTRANSPORT_H__
-
-#include <map>
-#include <string>
-#include <list>
-#include "Mutex.h"
-#include "SocketUtil.h"
-
-namespace rmq
-{
- const int CLIENT_STATE_UNINIT = 0;
- const int CLIENT_STATE_INITED = 1;
- const int CLIENT_STATE_DISCONNECT = 2;
- const int CLIENT_STATE_CONNECTED = 3;
-
- const int CLIENT_ERROR_SUCCESS = 0;
- const int CLIENT_ERROR_INIT = 1;
- const int CLIENT_ERROR_INVALID_URL = 2;
- const int CLIENT_ERROR_CONNECT = 3;
- const int CLIENT_ERROR_OOM = 4;
-
- class TcpTransport
- {
- public:
- TcpTransport(std::map<std::string, std::string>& config);
- ~TcpTransport();
-
- int connect(const std::string& serverAddr, int timeoutMillis);
- bool isConnected();
- void close();
-
- int sendData(const char* pBuffer, int len, int nTimeOut = -1);
- int recvData(std::list<std::string*>& dataList);
-
- SOCKET getSocket();
- std::string& getServerAddr();
- unsigned long long getLastSendRecvTime();
-
- private:
- int sendOneMsg(const char* pBuffer, int len, int nTimeout);
- int recvMsg();
- void processData(std::list<std::string*>& dataList);
- bool resizeBuf(int nNewSize);
- void tryShrink(int nMsgLen);
- static int getMsgSize(const char* pBuf);
-
- private:
- int m_sfd;
- int m_state;
- char* m_pRecvBuf;
- int m_recvBufSize;
- int m_recvBufUsed;
- int m_shrinkMax;
- int m_shrinkCheckCnt;
- kpr::Mutex m_sendLock;
- kpr::Mutex m_recvLock;
- std::string m_serverAddr;
- long long m_lastSendRecvTime;
- };
-}
-
-#endif
diff --git a/rocketmq-cpp/.gitignore b/rocketmq-cpp/.gitignore
new file mode 100644
index 00000000..23d1d0a6
--- /dev/null
+++ b/rocketmq-cpp/.gitignore
@@ -0,0 +1,40 @@
+# Compiled source #
+###################
+*.com
+*.class
+*.dll
+*.exe
+*.o
+*.lo
+*.so
+*.a
+/build
+# Packages #
+############
+# it's better to unpack these files and commit the raw source
+# git has its own built in compression methods
+*.7z
+*.dmg
+*.gz
+*.iso
+*.jar
+*.rar
+*.tar
+*.zip
+rpm/.dep_create/*
+# Logs and databases #
+######################
+*.log
+*.sql
+*.sqlite
+
+# OS generated files #
+######################
+.DS_Store
+.DS_Store?
+._*
+.Spotlight-V100
+.Trashes
+Icon?
+ehthumbs.db
+Thumbs.db
diff --git a/rocketmq-cpp/CMakeLists.txt b/rocketmq-cpp/CMakeLists.txt
new file mode 100755
index 00000000..2d368562
--- /dev/null
+++ b/rocketmq-cpp/CMakeLists.txt
@@ -0,0 +1,161 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+cmake_minimum_required(VERSION 2.8)
+
+
+# CMake complains if we don't have this.
+if (COMMAND cmake_policy)
+ cmake_policy(SET CMP0003 NEW)
+endif()
+
+# We're escaping quotes in the Windows version number, because
+# for some reason CMake won't do it at config version 2.4.7
+# It seems that this restores the newer behaviour where define
+# args are not auto-escaped.
+if (COMMAND cmake_policy)
+ cmake_policy(SET CMP0005 NEW)
+endif()
+
+# First, declare project (important for prerequisite checks).
+project(all)
+set(CMAKE_MODULE_PATH ${PROJECT_SOURCE_DIR}/cmake)
+set(CMAKE_ALLOW_LOOSE_LOOP_CONSTRUCTS ON)
+set(CMAKE_VERBOSE_MAKEFILE 1)
+
+#Find dependency
+#set(BOOST_INCLUDEDIR xxx)
+find_package(Boost 1.56.0)
+if(Boost_FOUND)
+ include_directories(${Boost_INCLUDE_DIRS})
+endif()
+
+#set(LIBEVENT_INCLUDE_DIR xxx)
+find_package(Libevent 2.0.22)
+if(LIBEVENT_FOUND)
+ include_directories(${LIBEVENT_INCLUDE_DIRS})
+endif()
+
+#set(JSONCPP_INCLUDE_DIR xxx)
+find_package(Jsoncpp 0.10.6)
+if(JSONCPP_FOUND)
+ include_directories(${JSONCPP_INCLUDE_DIR})
+endif()
+
+# put binaries in a different dir to make them easier to find.
+set(EXECUTABLE_OUTPUT_PATH ${PROJECT_SOURCE_DIR}/bin)
+set(LIBRARY_OUTPUT_PATH ${PROJECT_SOURCE_DIR}/bin)
+
+# for unix, put debug files in a separate bin "debug" dir.
+# release bin files should stay in the root of the bin dir.
+# if (CMAKE_GENERATOR STREQUAL "Unix Makefiles")
+# if (CMAKE_BUILD_TYPE STREQUAL Debug)
+# set(EXECUTABLE_OUTPUT_PATH ${PROJECT_SOURCE_DIR}/bin/debug)
+# set(LIBRARY_OUTPUT_PATH ${PROJECT_SOURCE_DIR}/bin/debug)
+# endif()
+# endif()
+
+if(NOT CMAKE_BUILD_TYPE)
+ set(CMAKE_BUILD_TYPE "Release")
+endif()
+
+set(C_FLAGS
+ -g
+ -Wall
+ -Wno-deprecated
+ -fPIC
+ -fno-strict-aliasing
+)
+set(CXX_FLAGS
+ -g
+ -Wall
+ -Wno-deprecated
+ -fPIC
+ -fno-strict-aliasing
+ -std=c++0x
+ # -finline-limit=1000
+ # -Wextra
+ # -pedantic
+ # -pedantic-errors
+ # -D_FILE_OFFSET_BITS=64
+ # -DVALGRIND
+ # -DCHECK_PTHREAD_RETURN_VALUE
+ # -Werror
+ # -Wconversion
+ # -Wno-unused-parameter
+ # -Wunused-but-set-variable
+ # -Wold-style-cast
+ # -Woverloaded-virtual
+ # -Wpointer-arith
+ # -Wshadow
+ # -Wwrite-strings
+ # -Wdeprecated-declarations
+ # -march=native
+ # -MMD
+ # -std=c++0x
+ # -rdynamic
+ )
+
+if(CMAKE_BUILD_BITS EQUAL 32)
+ list(APPEND CXX_FLAGS "-m32")
+else() #not-condition
+ list(APPEND CXX_FLAGS "-m64")
+endif()
+
+string(REPLACE ";" " " CMAKE_CXX_FLAGS "${CXX_FLAGS}")
+string(REPLACE ";" " " CMAKE_C_FLAGS "${C_FLAGS}")
+set(CMAKE_CXX_FLAGS_DEBUG "-O0 -DDEBUG")
+set(CMAKE_CXX_FLAGS_RELEASE "-O3 -DNDEBUG")
+
+# Declare deplibs, so we can use list in linker later. There's probably
+# a more elegant way of doing this; with SCons, when you check for the
+# lib, it is automatically passed to the linker.
+set(deplibs)
+
+# For some reason, the check_function_exists macro doesn't detect
+# the inet_aton on some pure Unix platforms (e.g. sunos5). So we
+# need to do a more detailed check and also include some extra deplibs.
+list(APPEND deplibs dl)
+list(APPEND deplibs pthread)
+list(APPEND deplibs rt)
+list(APPEND deplibs z)
+
+# add include dir for bsd (posix uses /usr/include/)
+set(CMAKE_INCLUDE_PATH "${CMAKE_INCLUDE_PATH}:/usr/local/include")
+
+# For config.h, set some static values; it may be a good idea to make
+# these values dynamic for non-standard UNIX compilers.
+set(ACCEPT_TYPE_ARG3 socklen_t)
+set(HAVE_CXX_BOOL 1)
+set(HAVE_CXX_CASTS 1)
+set(HAVE_CXX_EXCEPTIONS 1)
+set(HAVE_CXX_MUTABLE 1)
+set(HAVE_CXX_STDLIB 1)
+set(HAVE_PTHREAD_SIGNAL 1)
+set(SELECT_TYPE_ARG1 int)
+set(SELECT_TYPE_ARG234 "(fd_set *)")
+set(SELECT_TYPE_ARG5 "(struct timeval *)")
+set(STDC_HEADERS 1)
+set(TIME_WITH_SYS_TIME 1)
+set(HAVE_SOCKLEN_T 1)
+
+# For config.h, save the results based on a template (config.h.in).
+# configure_file(res/config.h.in ${root_dir}/config.h)
+
+# add_definitions(-DSYSAPI_UNIX=1 -DHAVE_CONFIG_H)
+
+add_subdirectory(libs)
+add_subdirectory(project)
+add_subdirectory(example)
diff --git a/rocketmq-cpp/README.md b/rocketmq-cpp/README.md
index e69de29b..bb6febba 100644
--- a/rocketmq-cpp/README.md
+++ b/rocketmq-cpp/README.md
@@ -0,0 +1,94 @@
+## How to build
+### Windows platform will be supported later
+### Linux platform
+#### 1. Dependency Installation
+* Install libevent 2.0.22 dependency
+ - Download [libevent 2.0.22](https://github.com/libevent/libevent/releases/download/release-2.0.22-stable/libevent-2.0.22-stable.tar.gz)
+ - Build and install libevent
+ - ./configure
+ - make
+ - make install
+* Install JsonCPP 0.7.0 dependency
+ - Download [jsoncpp 0.7.0](https://github.com/open-source-parsers/jsoncpp/archive/0.10.6.zip)
+ - Build and install jsoncpp
+ - cmake .
+ - make
+ - make install
+* Install boost 1.56.0 dependency
+ - Download [boost 1.56.0](http://www.boost.org/users/history/version_1_56_0.html)
+ - Build and install boost
+ - cd path/to/boost_1_56_0
+ - config boost：./bootstrap.sh
+ - build boost:
+ - build static boost lib: ./b2 link=static runtime-link=static
+ - build dynamic boost lib: ./b2 link=shared runtime-link=shared
+ - install boost: ./b2 install
+
+#### 2. Make and Install
+* Default install path:
+ - header files: /usr/local/include
+ - lib: /usr/local/lib
+* Make and install using cmake
+ - cmake will auto find_package, if failes, change BOOST_INCLUDEDIR/LIBEVENT_INCLUDE_DIR/JSONCPP_INCLUDE_DIR in CMakeList.txt, according to its real install path
+ - make
+ - make install
+
+#### 3. Check verion
+- strings librocketmq.so |grep VERSION
+
+- log path:$HOME/logs/rocketmq-4cpp
+
+- Before Run:
+ - export LD_LIBRARY_PATH=/xxx/rocketmq-cpp/bin/:$LD_LIBRARY_PATH;LD_LIBRARY_PATH=/A/lib:$LD_LIBRARY_PATH
+
+## Description for Important Parameters
+- -n : nameserver addr, if not set -n and -i ,no nameSrv will be got
+- -i : nameserver domain name, if not set -n and -i ,no nameSrv will be got
+- Notice: oper should only set one option from -n and -i,
+- -g : groupName, contains producer groupName and consumer groupName
+- -t : msg topic
+- -m : message count(default value:1)
+- -c : msg content(default value: only test)
+- -b : consume model(default value: CLUSTER)
+- -a : set sync push(default value: async)
+- -r : setup retry times(default value:5 times)
+- -u : select active broker to send msg(default value: false)
+- -d : use AutoDeleteSendcallback by cpp client(defalut value: false)
+- -T : thread count of send msg or consume msg(defalut value: system cpu core number)
+- -v : print more details information
+
+- Example:
+ - sync producer: ./SyncProducer -g producerGroup -t topic -c msgContent -m msgCount -n nameServerAddr
+ - async producer: ./AsyncProducer -g producerGroup -t topic -c msgContent -m msgCount -n nameServerAddr
+ - send delay msg: ./SendDelayMsg -g producerGroup -t topic -c msgContent -n nameServerAddr
+ - sync pushConsumer: ./PushConsumer -g producerGroup -t topic -c msgContent -m msgCount -n nameServerAddr -s sync
+ - async pushConsumer: ./AsyncPushConsumer -g producerGroup -t topic -c msgContent -m msgCount -n nameServerAddr
+ - orderly sync pushConsumer: ./OrderlyPushConsumer -g producerGroup -t topic -c msgContent -m msgCount -n nameServerAddr -s sync
+ - orderly async pushConsumer: ./OrderlyPushConsumer -g producerGroup -t topic -c msgContent -m msgCount -n nameServerAddr
+ - sync pullConsumer:./PullConsumer -g producerGroup -t topic -c msgContent -m msgCount -n nameServerAddr
+
+## Best practice
+- producer must invoke following interface:
+ - DefaultMQProducer g_producer("please_rename_unique_group_name");
+ - g_producer.start();
+ - g_producer.send(...);
+ - g_producer.shutdown();
+
+- pullconsumer must invoke following interface:
+ - DefaultMQPullConsumer g_consumer("please_rename_unique_group_name");
+ - g_consumer.start();
+ - g_consumer.fetchSubscribeMessageQueues(..., ...);
+ - g_consumer.pull(...)
+ - g_consumer.shutdown();
+
+- pushconsumer must invoke following interface:
+ - DefaultMQPushConsumer g_consumer("please_rename_unique_group_name_1");
+ - g_consumer.subscribe("test_topic", "*");
+ - g_consumer.registerMessageListener(listener);
+ - g_consumer.start();
+ - g_consumer.shutdown();
+
+## Acknowledgment - Alibaba Group.
+
+
+
diff --git a/rocketmq-cpp/bin/.gitkeep b/rocketmq-cpp/bin/.gitkeep
new file mode 100644
index 00000000..533bd5f6
--- /dev/null
+++ b/rocketmq-cpp/bin/.gitkeep
@@ -0,0 +1 @@
+#keep
diff --git a/rocketmq-cpp/cmake/FindJsoncpp.cmake b/rocketmq-cpp/cmake/FindJsoncpp.cmake
new file mode 100755
index 00000000..456d97fb
--- /dev/null
+++ b/rocketmq-cpp/cmake/FindJsoncpp.cmake
@@ -0,0 +1,90 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# Find jsoncpp
+#
+# Find the jsoncpp includes and library
+#
+# if you nee to add a custom library search path, do it via via CMAKE_PREFIX_PATH
+#
+# This module defines
+# JSONCPP_INCLUDE_DIR, where to find header, etc.
+# JSONCPP_LIBRARY, the libraries needed to use jsoncpp.
+# JSONCPP_FOUND, If false, do not try to use jsoncpp.
+# JSONCPP_INCLUDE_PREFIX, include prefix for jsoncpp.
+# jsoncpp_lib_static imported library.
+
+# only look in default directories
+find_path(
+ JSONCPP_INCLUDE_DIR
+ NAMES json/json.h jsoncpp/json/json.h
+ PATHS /usr/include/jsoncp /usr/local/include/jsoncpp
+ DOC "jsoncpp include dir"
+)
+
+find_library(
+ JSONCPP_LIBRARY
+ NAMES jsoncpp
+ PATHS /usr/lib /usr/local/lib
+ DOC "jsoncpp library"
+)
+
+add_library(jsoncpp_lib_static UNKNOWN IMPORTED)
+set_target_properties(
+ jsoncpp_lib_static
+ PROPERTIES
+ IMPORTED_LOCATION "${JSONCPP_LIBRARY}"
+ INTERFACE_INCLUDE_DIRECTORIES "${JSONCPP_INCLUDE_DIR}"
+)
+
+# debug library on windows
+# same naming convention as in qt (appending debug library with d)
+# boost is using the same "hack" as us with "optimized" and "debug"
+if ("${CMAKE_CXX_COMPILER_ID}" STREQUAL "MSVC")
+ find_library(
+ JSONCPP_LIBRARY_DEBUG
+ NAMES jsoncppd
+ DOC "jsoncpp debug library"
+ )
+
+ set_target_properties(
+ jsoncpp_lib_static
+ PROPERTIES
+ IMPORTED_LOCATION_DEBUG "${JSONCPP_LIBRARY_DEBUG}"
+ )
+ set(JSONCPP_LIBRARY optimized ${JSONCPP_LIBRARY} debug ${JSONCPP_LIBRARY_DEBUG})
+
+endif()
+
+# find JSONCPP_INCLUDE_PREFIX
+find_path(
+ JSONCPP_INCLUDE_PREFIX
+ NAMES json.h
+ PATH_SUFFIXES jsoncpp/json json
+)
+
+if (${JSONCPP_INCLUDE_PREFIX} MATCHES "jsoncpp")
+ set(JSONCPP_INCLUDE_PREFIX "jsoncpp/json")
+else()
+ set(JSONCPP_INCLUDE_PREFIX "json")
+endif()
+
+
+
+# handle the QUIETLY and REQUIRED arguments and set JSONCPP_FOUND to TRUE
+# if all listed variables are TRUE, hide their existence from configuration view
+include(FindPackageHandleStandardArgs)
+find_package_handle_standard_args(jsoncpp DEFAULT_MSG JSONCPP_INCLUDE_DIR JSONCPP_LIBRARY)
+mark_as_advanced (JSONCPP_INCLUDE_DIR JSONCPP_LIBRARY)
diff --git a/rocketmq-cpp/cmake/FindLibevent.cmake b/rocketmq-cpp/cmake/FindLibevent.cmake
new file mode 100755
index 00000000..dc09fb37
--- /dev/null
+++ b/rocketmq-cpp/cmake/FindLibevent.cmake
@@ -0,0 +1,111 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# - Try to find libevent
+#.rst
+# FindLibevent
+# ------------
+#
+# Find Libevent include directories and libraries. Invoke as::
+#
+# find_package(Libevent
+# [version] [EXACT] # Minimum or exact version
+# [REQUIRED] # Fail if Libevent is not found
+# [COMPONENT <C>...]) # Libraries to look for
+#
+# Valid components are one or more of:: libevent core extra pthreads openssl.
+# Note that 'libevent' contains both core and extra. You must specify one of
+# them for the other components.
+#
+# This module will define the following variables::
+#
+# LIBEVENT_FOUND - True if headers and requested libraries were found
+# LIBEVENT_INCLUDE_DIRS - Libevent include directories
+# LIBEVENT_LIBRARIES - Libevent libraries to be linked
+# LIBEVENT_<C>_FOUND - Component <C> was found (<C> is uppercase)
+# LIBEVENT_<C>_LIBRARY - Library to be linked for Libevent component <C>.
+
+find_package(PkgConfig QUIET)
+pkg_check_modules(PC_LIBEVENT QUIET libevent)
+
+# Look for the Libevent 2.0 or 1.4 headers
+find_path(LIBEVENT_INCLUDE_DIR
+ NAMES
+ event2/event-config.h
+ event-config.h
+ PATHS /usr/include /usr/local/include
+ HINTS
+ ${PC_LIBEVENT_INCLUDE_DIRS}
+)
+
+if(LIBEVENT_INCLUDE_DIR)
+ set(_version_regex "^#define[ \t]+_EVENT_VERSION[ \t]+\"([^\"]+)\".*")
+ if(EXISTS "${LIBEVENT_INCLUDE_DIR}/event2/event-config.h")
+ # Libevent 2.0
+ file(STRINGS "${LIBEVENT_INCLUDE_DIR}/event2/event-config.h"
+ LIBEVENT_VERSION REGEX "${_version_regex}")
+ else()
+ # Libevent 1.4
+ file(STRINGS "${LIBEVENT_INCLUDE_DIR}/event-config.h"
+ LIBEVENT_VERSION REGEX "${_version_regex}")
+ endif()
+ string(REGEX REPLACE "${_version_regex}" "\\1"
+ LIBEVENT_VERSION "${LIBEVENT_VERSION}")
+ unset(_version_regex)
+endif()
+
+set(_LIBEVENT_REQUIRED_VARS)
+foreach(COMPONENT ${Libevent_FIND_COMPONENTS})
+ set(_LIBEVENT_LIBNAME libevent)
+ # Note: compare two variables to avoid a CMP0054 policy warning
+ if(COMPONENT STREQUAL _LIBEVENT_LIBNAME)
+ set(_LIBEVENT_LIBNAME event)
+ else()
+ set(_LIBEVENT_LIBNAME "event_${COMPONENT}")
+ endif()
+ string(TOUPPER "${COMPONENT}" COMPONENT_UPPER)
+ find_library(LIBEVENT_${COMPONENT_UPPER}_LIBRARY
+ NAMES ${_LIBEVENT_LIBNAME}
+ PATHS /usr/lib /usr/local/lib
+ HINTS ${PC_LIBEVENT_LIBRARY_DIRS}
+ )
+ if(LIBEVENT_${COMPONENT_UPPER}_LIBRARY)
+ set(Libevent_${COMPONENT}_FOUND 1)
+ endif()
+ list(APPEND _LIBEVENT_REQUIRED_VARS LIBEVENT_${COMPONENT_UPPER}_LIBRARY)
+endforeach()
+unset(_LIBEVENT_LIBNAME)
+
+include(FindPackageHandleStandardArgs)
+# handle the QUIETLY and REQUIRED arguments and set LIBEVENT_FOUND to TRUE
+# if all listed variables are TRUE and the requested version matches.
+find_package_handle_standard_args(Libevent REQUIRED_VARS
+ ${_LIBEVENT_REQUIRED_VARS}
+ LIBEVENT_INCLUDE_DIR
+ VERSION_VAR LIBEVENT_VERSION
+ HANDLE_COMPONENTS)
+
+if(LIBEVENT_FOUND)
+ set(LIBEVENT_INCLUDE_DIRS ${LIBEVENT_INCLUDE_DIR})
+ set(LIBEVENT_LIBRARIES)
+ foreach(COMPONENT ${Libevent_FIND_COMPONENTS})
+ string(TOUPPER "${COMPONENT}" COMPONENT_UPPER)
+ list(APPEND LIBEVENT_LIBRARIES ${LIBEVENT_${COMPONENT_UPPER}_LIBRARY})
+ set(LIBEVENT_${COMPONENT_UPPER}_FOUND ${Libevent_${COMPONENT}_FOUND})
+ endforeach()
+endif()
+
+mark_as_advanced(LIBEVENT_INCLUDE_DIR ${_LIBEVENT_REQUIRED_VARS})
+unset(_LIBEVENT_REQUIRED_VARS)
diff --git a/rocketmq-cpp/deploy.sh b/rocketmq-cpp/deploy.sh
new file mode 100755
index 00000000..c29cb0c7
--- /dev/null
+++ b/rocketmq-cpp/deploy.sh
@@ -0,0 +1,26 @@
+#!/bin/sh
+
+VERSION="rocketmq-client4cpp"
+CWD_DIR=$(cd "$(dirname "$0")"; pwd)
+DEPLOY_BUILD_HOME=${CWD_DIR}/${VERSION}
+
+# ##====================================================================
+make
+# ##====================================================================
+# # deploy
+rm -rf ${DEPLOY_BUILD_HOME}
+mkdir -p ${DEPLOY_BUILD_HOME}/lib
+mkdir -p ${DEPLOY_BUILD_HOME}/logs
+rm -rf ${CWD_DIR}/bin/*.log
+cp -rf ${CWD_DIR}/bin/*.a ${DEPLOY_BUILD_HOME}/lib/
+cp -rf ${CWD_DIR}/bin/*.so ${DEPLOY_BUILD_HOME}/lib/
+cp -rf ${CWD_DIR}/include ${DEPLOY_BUILD_HOME}/
+cp -rf ${CWD_DIR}/example ${DEPLOY_BUILD_HOME}/
+cp -rf ${CWD_DIR}/doc ${DEPLOY_BUILD_HOME}/
+cp -rf ${CWD_DIR}/readme ${DEPLOY_BUILD_HOME}/
+
+
+cd ${CWD_DIR} && tar -cvzf ./${VERSION}.tar.gz ./${VERSION} >/dev/null 2>&1
+rm -rf ${DEPLOY_BUILD_HOME}
+# # ##====================================================================
+make clean
diff --git a/rocketmq-cpp/example/AsyncProducer.cpp b/rocketmq-cpp/example/AsyncProducer.cpp
new file mode 100755
index 00000000..1ee9e417
--- /dev/null
+++ b/rocketmq-cpp/example/AsyncProducer.cpp
@@ -0,0 +1,125 @@
+#include <stdio.h>
+#include <stdlib.h>
+#include <string.h>
+#include <unistd.h>
+
+#include <chrono>
+#include <condition_variable>
+#include <iomanip>
+#include <iostream>
+#include <mutex>
+#include <thread>
+
+#include "common.h"
+
+using namespace rocketmq;
+
+boost::atomic<bool> g_quit;
+std::mutex g_mtx;
+std::condition_variable g_finished;
+SendCallback* g_callback = NULL;
+TpsReportService g_tps;
+
+class MySendCallback : public SendCallback {
+ virtual void onSuccess(SendResult& sendResult) {
+ g_msgCount--;
+ g_tps.Increment();
+ if (g_msgCount.load() <= 0) {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.notify_one();
+ }
+ }
+ virtual void onException(MQException& e) { cout << "send Exception\n"; }
+};
+
+class MyAutoDeleteSendCallback : public AutoDeleteSendCallBack {
+ public:
+ virtual ~MyAutoDeleteSendCallback() {}
+ virtual void onSuccess(SendResult& sendResult) {
+ g_msgCount--;
+ if (g_msgCount.load() <= 0) {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.notify_one();
+ }
+ }
+ virtual void onException(MQException& e) {
+ std::cout << "send Exception" << e << "\n";
+ }
+};
+
+void AsyncProducerWorker(RocketmqSendAndConsumerArgs* info,
+ DefaultMQProducer* producer) {
+ while (!g_quit.load()) {
+ if (g_msgCount.load() <= 0) {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.notify_one();
+ }
+ MQMessage msg(info->topic, // topic
+ "*", // tag
+ info->body); // body
+
+ if (info->IsAutoDeleteSendCallback) {
+ g_callback = new MyAutoDeleteSendCallback(); // auto delete
+ }
+
+ try {
+ producer->send(msg, g_callback);
+ } catch (MQException& e) {
+ std::cout << e << endl; // if catch excepiton , need re-send this msg by
+ // service
+ }
+ }
+}
+
+int main(int argc, char* argv[]) {
+ RocketmqSendAndConsumerArgs info;
+ if (!ParseArgs(argc, argv, &info)) {
+ exit(-1);
+ }
+
+ DefaultMQProducer producer("please_rename_unique_group_name");
+ if (!info.IsAutoDeleteSendCallback) {
+ g_callback = new MySendCallback();
+ }
+
+ PrintRocketmqSendAndConsumerArgs(info);
+
+ if (!info.namesrv.empty()) producer.setNamesrvAddr(info.namesrv);
+
+ producer.setGroupName(info.groupname);
+ producer.setInstanceName(info.groupname);
+ producer.setNamesrvDomain(info.namesrv_domain);
+ producer.start();
+ g_tps.start();
+ std::vector<std::shared_ptr<std::thread>> work_pool;
+ auto start = std::chrono::system_clock::now();
+ int msgcount = g_msgCount.load();
+ for (int j = 0; j < info.thread_count; j++) {
+ std::shared_ptr<std::thread> th =
+ std::make_shared<std::thread>(AsyncProducerWorker, &info, &producer);
+ work_pool.push_back(th);
+ }
+
+ {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.wait(lck);
+ g_quit.store(true);
+ }
+
+ auto end = std::chrono::system_clock::now();
+ auto duration =
+ std::chrono::duration_cast<std::chrono::milliseconds>(end - start);
+
+ std::cout
+ << "per msg time: " << duration.count() / (double)msgcount << "ms \n"
+ << "========================finished==============================\n";
+
+ producer.shutdown();
+ for (size_t th = 0; th != work_pool.size(); ++th) {
+ work_pool[th]->join();
+ }
+ if (!info.IsAutoDeleteSendCallback) {
+ delete g_callback;
+ }
+ return 0;
+}
diff --git a/rocketmq-cpp/example/AsyncPushConsumer.cpp b/rocketmq-cpp/example/AsyncPushConsumer.cpp
new file mode 100755
index 00000000..36a17f79
--- /dev/null
+++ b/rocketmq-cpp/example/AsyncPushConsumer.cpp
@@ -0,0 +1,94 @@
+#include <stdlib.h>
+#include <string.h>
+
+#include <condition_variable>
+#include <iomanip>
+#include <iostream>
+#include <map>
+#include <mutex>
+#include <string>
+#include <vector>
+
+#include "common.h"
+
+std::mutex g_mtx;
+std::condition_variable g_finished;
+
+using namespace rocketmq;
+
+class MyMsgListener : public MessageListenerConcurrently {
+ public:
+ MyMsgListener() {}
+ virtual ~MyMsgListener() {}
+
+ virtual ConsumeStatus consumeMessage(const std::vector<MQMessageExt> &msgs) {
+ g_msgCount.store(g_msgCount.load() - msgs.size());
+ for (size_t i = 0; i < msgs.size(); ++i) {
+ // std::cout << i << ": " << msgs[i].toString() << std::endl;
+ }
+
+ if (g_msgCount.load() <= 0) {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.notify_one();
+ }
+ return CONSUME_SUCCESS;
+ }
+};
+
+int main(int argc, char *argv[]) {
+ RocketmqSendAndConsumerArgs info;
+ if (!ParseArgs(argc, argv, &info)) {
+ exit(-1);
+ }
+ PrintRocketmqSendAndConsumerArgs(info);
+ DefaultMQPushConsumer consumer("please_rename_unique_group_name");
+ DefaultMQProducer producer("please_rename_unique_group_name");
+
+ producer.setNamesrvAddr(info.namesrv);
+ producer.setGroupName("msg-persist-group_producer_sandbox");
+ producer.setNamesrvDomain(info.namesrv_domain);
+ producer.start();
+
+ consumer.setNamesrvAddr(info.namesrv);
+ consumer.setGroupName(info.groupname);
+ consumer.setNamesrvDomain(info.namesrv_domain);
+ consumer.setConsumeFromWhere(CONSUME_FROM_LAST_OFFSET);
+
+ consumer.setInstanceName(info.groupname);
+
+ consumer.subscribe(info.topic, "*");
+ consumer.setConsumeThreadCount(15);
+ consumer.setTcpTransportTryLockTimeout(1000);
+ consumer.setTcpTransportConnectTimeout(400);
+
+ MyMsgListener msglistener;
+ consumer.registerMessageListener(&msglistener);
+
+ try {
+ consumer.start();
+ } catch (MQClientException &e) {
+ cout << e << endl;
+ }
+
+ int msgcount = g_msgCount.load();
+ for (int i = 0; i < msgcount; ++i) {
+ MQMessage msg(info.topic, // topic
+ "*", // tag
+ info.body); // body
+
+ try {
+ producer.send(msg);
+ } catch (MQException &e) {
+ std::cout << e << endl; // if catch excepiton , need re-send this msg by
+ // service
+ }
+ }
+
+ {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.wait(lck);
+ }
+ producer.shutdown();
+ consumer.shutdown();
+ return 0;
+}
diff --git a/rocketmq-cpp/example/CMakeLists.txt b/rocketmq-cpp/example/CMakeLists.txt
new file mode 100755
index 00000000..8141f21d
--- /dev/null
+++ b/rocketmq-cpp/example/CMakeLists.txt
@@ -0,0 +1,49 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+project(example)
+
+set(EXECUTABLE_OUTPUT_PATH ${CMAKE_SOURCE_DIR}/bin)
+
+include_directories(${CMAKE_SOURCE_DIR}/include)
+include_directories(${Boost_INCLUDE_DIRS})
+
+link_directories(${Boost_LIBRARY_DIRS})
+link_directories(${LIBEVENT_LIBRARY})
+link_directories(${JSONCPP_LIBRARY})
+
+set(SYS_LIBS ${SYS_LIBS} libboost_thread.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_system.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_iostreams.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_locale.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_date_time.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_chrono.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_serialization.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_log.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_log_setup.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_regex.a)
+set(SYS_LIBS ${SYS_LIBS} libboost_filesystem.a)
+set(SYS_LIBS ${SYS_LIBS} libevent.a)
+set(SYS_LIBS ${SYS_LIBS} libevent_core.a)
+set(SYS_LIBS ${SYS_LIBS} libevent_pthreads.a)
+set(SYS_LIBS ${SYS_LIBS} libevent_openssl.a)
+set(SYS_LIBS ${SYS_LIBS} libevent_extra.a)
+set(SYS_LIBS ${SYS_LIBS} libjsoncpp.a)
+file(GLOB files "*.cpp")
+foreach(file ${files})
+ get_filename_component(basename ${file} NAME_WE)
+ add_executable(${basename} ${file})
+ target_link_libraries (${basename} rocketmq_static ${deplibs} ${SYS_LIBS})
+endforeach()
diff --git a/rocketmq-cpp/example/OrderProducer.cpp b/rocketmq-cpp/example/OrderProducer.cpp
new file mode 100755
index 00000000..808d0ea9
--- /dev/null
+++ b/rocketmq-cpp/example/OrderProducer.cpp
@@ -0,0 +1,99 @@
+#include <stdio.h>
+#include <stdlib.h>
+#include <string.h>
+#include <unistd.h>
+
+#include <condition_variable>
+#include <iomanip>
+#include <iostream>
+#include <mutex>
+#include <thread>
+
+#include "common.h"
+
+using namespace rocketmq;
+
+std::condition_variable g_finished;
+std::mutex g_mtx;
+boost::atomic<bool> g_quit(false);
+
+class SelectMessageQueueByHash : public MessageQueueSelector {
+ public:
+ MQMessageQueue select(const std::vector<MQMessageQueue> &mqs,
+ const MQMessage &msg, void *arg) {
+ int orderId = *static_cast<int *>(arg);
+ int index = orderId % mqs.size();
+ return mqs[index];
+ }
+};
+
+SelectMessageQueueByHash g_mySelector;
+
+void ProducerWorker(RocketmqSendAndConsumerArgs *info,
+ DefaultMQProducer *producer) {
+ while (!g_quit.load()) {
+ if (g_msgCount.load() <= 0) {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.notify_one();
+ }
+ MQMessage msg(info->topic, // topic
+ "*", // tag
+ info->body); // body
+
+ int orderId = 1;
+ SendResult sendResult =
+ producer->send(msg, &g_mySelector, static_cast<void *>(&orderId),
+ info->retrytimes, info->SelectUnactiveBroker);
+ --g_msgCount;
+ }
+}
+
+int main(int argc, char *argv[]) {
+ RocketmqSendAndConsumerArgs info;
+ if (!ParseArgs(argc, argv, &info)) {
+ exit(-1);
+ }
+
+ DefaultMQProducer producer("please_rename_unique_group_name");
+ PrintRocketmqSendAndConsumerArgs(info);
+
+ producer.setNamesrvAddr(info.namesrv);
+ producer.setNamesrvDomain(info.namesrv_domain);
+ producer.setGroupName(info.groupname);
+ producer.setInstanceName(info.groupname);
+
+ producer.start();
+
+ int msgcount = g_msgCount.load();
+ std::vector<std::shared_ptr<std::thread>> work_pool;
+
+ int threadCount = info.thread_count;
+ for (int j = 0; j < threadCount; j++) {
+ std::shared_ptr<std::thread> th =
+ std::make_shared<std::thread>(ProducerWorker, &info, &producer);
+ work_pool.push_back(th);
+ }
+
+ auto start = std::chrono::system_clock::now();
+ {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.wait(lck);
+ g_quit.store(true);
+ }
+
+ auto end = std::chrono::system_clock::now();
+ auto duration =
+ std::chrono::duration_cast<std::chrono::milliseconds>(end - start);
+
+ std::cout
+ << "per msg time: " << duration.count() / (double)msgcount << "ms \n"
+ << "========================finished==============================\n";
+
+ for (size_t th = 0; th != work_pool.size(); ++th) {
+ work_pool[th]->join();
+ }
+
+ producer.shutdown();
+
+ return 0;
+}
diff --git a/rocketmq-cpp/example/OrderlyPushConsumer.cpp b/rocketmq-cpp/example/OrderlyPushConsumer.cpp
new file mode 100755
index 00000000..cc1aded9
--- /dev/null
+++ b/rocketmq-cpp/example/OrderlyPushConsumer.cpp
@@ -0,0 +1,95 @@
+#include <stdlib.h>
+#include <string.h>
+
+#include <condition_variable>
+#include <iomanip>
+#include <iostream>
+#include <map>
+#include <mutex>
+#include <thread>
+#include <vector>
+
+#include "common.h"
+
+using namespace rocketmq;
+
+std::condition_variable g_finished;
+std::mutex g_mtx;
+boost::atomic<int> g_consumedCount(0);
+boost::atomic<bool> g_quit(false);
+TpsReportService g_tps;
+
+class MyMsgListener : public MessageListenerOrderly {
+ public:
+ MyMsgListener() {}
+ virtual ~MyMsgListener() {}
+
+ virtual ConsumeStatus consumeMessage(const vector<MQMessageExt> &msgs) {
+ if (g_consumedCount.load() >= g_msgCount) {
+ std::unique_lock<std::mutex> lK(g_mtx);
+ g_quit.store(true);
+ g_finished.notify_one();
+ }
+ for (size_t i = 0; i < msgs.size(); i++) {
+ ++g_consumedCount;
+ g_tps.Increment();
+ }
+ return CONSUME_SUCCESS;
+ }
+};
+
+int main(int argc, char *argv[]) {
+ RocketmqSendAndConsumerArgs info;
+ if (!ParseArgs(argc, argv, &info)) {
+ exit(-1);
+ }
+ PrintRocketmqSendAndConsumerArgs(info);
+ DefaultMQPushConsumer consumer("please_rename_unique_group_name");
+ DefaultMQProducer producer("please_rename_unique_group_name");
+
+ producer.setNamesrvAddr(info.namesrv);
+ producer.setGroupName("msg-persist-group_producer_sandbox");
+ producer.start();
+
+ consumer.setNamesrvAddr(info.namesrv);
+ consumer.setNamesrvDomain(info.namesrv_domain);
+ consumer.setGroupName(info.groupname);
+ consumer.setConsumeFromWhere(CONSUME_FROM_LAST_OFFSET);
+ consumer.subscribe(info.topic, "*");
+ consumer.setConsumeThreadCount(info.thread_count);
+ consumer.setConsumeMessageBatchMaxSize(31);
+ if (info.syncpush) consumer.setAsyncPull(false);
+
+ MyMsgListener msglistener;
+ consumer.registerMessageListener(&msglistener);
+ g_tps.start();
+
+ try {
+ consumer.start();
+ } catch (MQClientException &e) {
+ std::cout << e << std::endl;
+ }
+
+ int msgcount = g_msgCount.load();
+ for (int i = 0; i < msgcount; ++i) {
+ MQMessage msg(info.topic, // topic
+ "*", // tag
+ info.body); // body
+
+ try {
+ producer.send(msg);
+ } catch (MQException &e) {
+ std::cout << e << endl; // if catch excepiton , need re-send this msg by
+ // service
+ }
+ }
+
+ while (!g_quit.load()) {
+ std::unique_lock<std::mutex> lk(g_mtx);
+ g_finished.wait(lk);
+ }
+
+ producer.shutdown();
+ consumer.shutdown();
+ return 0;
+}
diff --git a/rocketmq-cpp/example/PullConsumer.cpp b/rocketmq-cpp/example/PullConsumer.cpp
new file mode 100755
index 00000000..1709b26c
--- /dev/null
+++ b/rocketmq-cpp/example/PullConsumer.cpp
@@ -0,0 +1,108 @@
+#include <stdlib.h>
+#include <string.h>
+
+#include <chrono>
+#include <iomanip>
+#include <iostream>
+#include <map>
+#include <vector>
+
+#include "common.h"
+
+using namespace rocketmq;
+
+std::map<MQMessageQueue, uint64_t> g_offseTable;
+
+void putMessageQueueOffset(MQMessageQueue mq, uint64_t offset) {
+ g_offseTable[mq] = offset;
+}
+
+uint64_t getMessageQueueOffset(MQMessageQueue mq) {
+ map<MQMessageQueue, uint64_t>::iterator it = g_offseTable.find(mq);
+ if (it != g_offseTable.end()) {
+ return it->second;
+ }
+ return 0;
+}
+
+int main(int argc, char *argv[]) {
+ RocketmqSendAndConsumerArgs info;
+ if (!ParseArgs(argc, argv, &info)) {
+ exit(-1);
+ }
+ PrintRocketmqSendAndConsumerArgs(info);
+ DefaultMQPullConsumer consumer("please_rename_unique_group_name");
+ consumer.setNamesrvAddr(info.namesrv);
+ consumer.setNamesrvDomain(info.namesrv_domain);
+ consumer.setGroupName(info.groupname);
+ consumer.setInstanceName(info.groupname);
+ consumer.registerMessageQueueListener(info.topic, NULL);
+ consumer.start();
+ std::vector<MQMessageQueue> mqs;
+
+ try {
+ consumer.fetchSubscribeMessageQueues(info.topic, mqs);
+ auto iter = mqs.begin();
+ for (; iter != mqs.end(); ++iter) {
+ std::cout << "mq:" << (*iter).toString() << endl;
+ }
+ } catch (MQException &e) {
+ std::cout << e << endl;
+ }
+
+ auto start = std::chrono::system_clock::now();
+ auto iter = mqs.begin();
+ for (; iter != mqs.end(); ++iter) {
+ MQMessageQueue mq = (*iter);
+ // if cluster model
+ // putMessageQueueOffset(mq, g_consumer.fetchConsumeOffset(mq,true));
+ // if broadcast model
+ // putMessageQueueOffset(mq, your last consume offset);
+
+ bool noNewMsg = false;
+ do {
+ try {
+ PullResult result =
+ consumer.pull(mq, "*", getMessageQueueOffset(mq), 32);
+ g_msgCount += result.msgFoundList.size();
+ std::cout << result.msgFoundList.size() << std::endl;
+ // if pull request timeout or received NULL response, pullStatus will be
+ // setted to BROKER_TIMEOUT,
+ // And nextBeginOffset/minOffset/MaxOffset will be setted to 0
+ if (result.pullStatus != BROKER_TIMEOUT) {
+ putMessageQueueOffset(mq, result.nextBeginOffset);
+ PrintPullResult(&result);
+ } else {
+ cout << "broker timeout occur" << endl;
+ }
+ switch (result.pullStatus) {
+ case FOUND:
+ case NO_MATCHED_MSG:
+ case OFFSET_ILLEGAL:
+ case BROKER_TIMEOUT:
+ break;
+ case NO_NEW_MSG:
+ noNewMsg = true;
+ break;
+ default:
+ break;
+ }
+ } catch (MQClientException &e) {
+ std::cout << e << std::endl;
+ }
+ } while (!noNewMsg);
+ }
+
+ auto end = std::chrono::system_clock::now();
+ auto duration =
+ std::chrono::duration_cast<std::chrono::milliseconds>(end - start);
+
+ std::cout << "msg count: " << g_msgCount.load() << "\n";
+ std::cout
+ << "per msg time: " << duration.count() / (double)g_msgCount.load()
+ << "ms \n"
+ << "========================finished==============================\n";
+
+ consumer.shutdown();
+ return 0;
+}
diff --git a/rocketmq-cpp/example/PushConsumer.cpp b/rocketmq-cpp/example/PushConsumer.cpp
new file mode 100755
index 00000000..7c85b643
--- /dev/null
+++ b/rocketmq-cpp/example/PushConsumer.cpp
@@ -0,0 +1,110 @@
+#include <stdlib.h>
+#include <string.h>
+
+#include <chrono>
+#include <condition_variable>
+#include <iomanip>
+#include <iostream>
+#include <map>
+#include <mutex>
+#include <string>
+#include <vector>
+
+#include "common.h"
+
+std::mutex g_mtx;
+std::condition_variable g_finished;
+TpsReportService g_tps;
+
+using namespace rocketmq;
+
+class MyMsgListener : public MessageListenerConcurrently {
+ public:
+ MyMsgListener() {}
+ virtual ~MyMsgListener() {}
+
+ virtual ConsumeStatus consumeMessage(const std::vector<MQMessageExt> &msgs) {
+ g_msgCount.store(g_msgCount.load() - msgs.size());
+ for (size_t i = 0; i < msgs.size(); ++i) {
+ g_tps.Increment();
+ // cout << "msg body: "<< msgs[i].getBody() << endl;
+ }
+
+ if (g_msgCount.load() <= 0) {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.notify_one();
+ }
+ return CONSUME_SUCCESS;
+ }
+};
+
+int main(int argc, char *argv[]) {
+ RocketmqSendAndConsumerArgs info;
+ if (!ParseArgs(argc, argv, &info)) {
+ exit(-1);
+ }
+ PrintRocketmqSendAndConsumerArgs(info);
+ DefaultMQPushConsumer consumer("please_rename_unique_group_name");
+ DefaultMQProducer producer("please_rename_unique_group_name");
+ producer.setSessionCredentials("mEbjOEonoo5TREFS",
+ "xZRP6rejrDjxLxGFHbDfppfJt1S0VJ", "ALIYUN");
+ producer.setTcpTransportTryLockTimeout(1000);
+ producer.setTcpTransportConnectTimeout(400);
+ producer.setNamesrvDomain(info.namesrv_domain);
+ producer.setNamesrvAddr(info.namesrv);
+ producer.setGroupName("msg-persist-group_producer_sandbox");
+ producer.start();
+
+ consumer.setNamesrvAddr(info.namesrv);
+ consumer.setGroupName(info.groupname);
+ consumer.setSessionCredentials("mEbjOEonoo5TREFS",
+ "xZRP6rejrDjxLxGFHbDfppfJt1S0VJ", "ALIYUN");
+ consumer.setConsumeThreadCount(info.thread_count);
+ consumer.setNamesrvDomain(info.namesrv_domain);
+ consumer.setConsumeFromWhere(CONSUME_FROM_LAST_OFFSET);
+
+ if (info.syncpush) consumer.setAsyncPull(false); // set sync pull
+ if (info.broadcasting) {
+ consumer.setMessageModel(BROADCASTING);
+ }
+
+ consumer.setInstanceName(info.groupname);
+
+ consumer.subscribe(info.topic, "*");
+ consumer.setConsumeThreadCount(15);
+ consumer.setTcpTransportTryLockTimeout(1000);
+ consumer.setTcpTransportConnectTimeout(400);
+
+ MyMsgListener msglistener;
+ consumer.registerMessageListener(&msglistener);
+
+ try {
+ consumer.start();
+ } catch (MQClientException &e) {
+ cout << e << endl;
+ }
+ g_tps.start();
+
+ int msgcount = g_msgCount.load();
+ for (int i = 0; i < msgcount; ++i) {
+ MQMessage msg(info.topic, // topic
+ "*", // tag
+ info.body); // body
+
+ // std::this_thread::sleep_for(std::chrono::seconds(100000));
+ try {
+ producer.send(msg);
+ } catch (MQException &e) {
+ std::cout << e << endl; // if catch excepiton , need re-send this msg by
+ // service
+ }
+ }
+
+ {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.wait(lck);
+ }
+ producer.shutdown();
+ consumer.shutdown();
+ return 0;
+}
diff --git a/rocketmq-cpp/example/README.md b/rocketmq-cpp/example/README.md
new file mode 100644
index 00000000..91965d01
--- /dev/null
+++ b/rocketmq-cpp/example/README.md
@@ -0,0 +1,4 @@
+1. AsyncProducer
+2. OrderlyProducer
+3. SyncProducer
+
diff --git a/rocketmq-cpp/example/SendDelayMsg.cpp b/rocketmq-cpp/example/SendDelayMsg.cpp
new file mode 100755
index 00000000..a078c803
--- /dev/null
+++ b/rocketmq-cpp/example/SendDelayMsg.cpp
@@ -0,0 +1,51 @@
+#include <stdio.h>
+#include <stdlib.h>
+#include <string.h>
+#include <unistd.h>
+
+#include <condition_variable>
+#include <iomanip>
+#include <iomanip>
+#include <iostream>
+#include <iostream>
+#include <mutex>
+#include <thread>
+
+#include "common.h"
+
+using namespace rocketmq;
+
+int main(int argc, char* argv[]) {
+ RocketmqSendAndConsumerArgs info;
+ if (!ParseArgs(argc, argv, &info)) {
+ exit(-1);
+ }
+ PrintRocketmqSendAndConsumerArgs(info);
+ DefaultMQProducer producer("please_rename_unique_group_name");
+ producer.setNamesrvAddr(info.namesrv);
+ producer.setNamesrvDomain(info.namesrv_domain);
+ producer.setGroupName(info.groupname);
+ producer.setInstanceName(info.groupname);
+
+ producer.setSendMsgTimeout(500);
+ producer.setTcpTransportTryLockTimeout(1000);
+ producer.setTcpTransportConnectTimeout(400);
+
+ producer.start();
+
+ MQMessage msg(info.topic, // topic
+ "*", // tag
+ info.body); // body
+
+ // messageDelayLevel=1s 5s 10s 30s 1m 2m 3m 4m 5m 6m 7m 8m 9m 10m 20m 30m 1h
+ // 2h
+ msg.setDelayTimeLevel(5); // 1m
+ try {
+ SendResult sendResult = producer.send(msg, info.SelectUnactiveBroker);
+ } catch (const MQException& e) {
+ std::cout << "send failed: " << std::endl;
+ }
+
+ producer.shutdown();
+ return 0;
+}
diff --git a/rocketmq-cpp/example/SyncProducer.cpp b/rocketmq-cpp/example/SyncProducer.cpp
new file mode 100755
index 00000000..f4f6e419
--- /dev/null
+++ b/rocketmq-cpp/example/SyncProducer.cpp
@@ -0,0 +1,101 @@
+#include <stdio.h>
+#include <stdlib.h>
+#include <string.h>
+#include <unistd.h>
+
+#include <condition_variable>
+#include <iomanip>
+#include <iomanip>
+#include <iostream>
+#include <iostream>
+#include <mutex>
+#include <thread>
+
+#include "common.h"
+
+using namespace rocketmq;
+
+boost::atomic<bool> g_quit;
+std::mutex g_mtx;
+std::condition_variable g_finished;
+TpsReportService g_tps;
+
+void SyncProducerWorker(RocketmqSendAndConsumerArgs* info,
+ DefaultMQProducer* producer) {
+ while (!g_quit.load()) {
+ if (g_msgCount.load() <= 0) {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.notify_one();
+ }
+ MQMessage msg(info->topic, // topic
+ "*", // tag
+ info->body); // body
+ try {
+ auto start = std::chrono::system_clock::now();
+ SendResult sendResult = producer->send(msg, info->SelectUnactiveBroker);
+ g_tps.Increment();
+ --g_msgCount;
+ auto end = std::chrono::system_clock::now();
+ auto duration =
+ std::chrono::duration_cast<std::chrono::milliseconds>(end - start);
+ if (duration.count() >= 500) {
+ std::cout << "send RT more than: " << duration.count()
+ << " ms with msgid: " << sendResult.getMsgId() << endl;
+ }
+ } catch (const MQException& e) {
+ std::cout << "send failed: " << std::endl;
+ }
+ }
+}
+
+int main(int argc, char* argv[]) {
+ RocketmqSendAndConsumerArgs info;
+ if (!ParseArgs(argc, argv, &info)) {
+ exit(-1);
+ }
+ PrintRocketmqSendAndConsumerArgs(info);
+ DefaultMQProducer producer("please_rename_unique_group_name");
+ producer.setNamesrvAddr(info.namesrv);
+ producer.setNamesrvDomain(info.namesrv_domain);
+ producer.setGroupName(info.groupname);
+ producer.setInstanceName(info.groupname);
+ producer.setSessionCredentials("mq acesskey", "mq secretkey", "ALIYUN");
+ producer.setSendMsgTimeout(500);
+ producer.setTcpTransportTryLockTimeout(1000);
+ producer.setTcpTransportConnectTimeout(400);
+
+ producer.start();
+ std::vector<std::shared_ptr<std::thread>> work_pool;
+ auto start = std::chrono::system_clock::now();
+ int msgcount = g_msgCount.load();
+ g_tps.start();
+
+ int threadCount = info.thread_count;
+ for (int j = 0; j < threadCount; j++) {
+ std::shared_ptr<std::thread> th =
+ std::make_shared<std::thread>(SyncProducerWorker, &info, &producer);
+ work_pool.push_back(th);
+ }
+
+ {
+ std::unique_lock<std::mutex> lck(g_mtx);
+ g_finished.wait(lck);
+ g_quit.store(true);
+ }
+
+ auto end = std::chrono::system_clock::now();
+ auto duration =
+ std::chrono::duration_cast<std::chrono::milliseconds>(end - start);
+
+ std::cout
+ << "per msg time: " << duration.count() / (double)msgcount << "ms \n"
+ << "========================finished==============================\n";
+
+ for (size_t th = 0; th != work_pool.size(); ++th) {
+ work_pool[th]->join();
+ }
+
+ producer.shutdown();
+
+ return 0;
+}
diff --git a/rocketmq-cpp/example/common.h b/rocketmq-cpp/example/common.h
new file mode 100755
index 00000000..d96af6d8
--- /dev/null
+++ b/rocketmq-cpp/example/common.h
@@ -0,0 +1,183 @@
+#ifndef ROCKETMQ_CLIENT4CPP_EXAMPLE_COMMON_H_
+#define ROCKETMQ_CLIENT4CPP_EXAMPLE_COMMON_H_
+
+#include <boost/atomic.hpp>
+#include <boost/chrono.hpp>
+#include <boost/shared_ptr.hpp>
+#include <boost/thread.hpp>
+#include <iostream>
+#include <string>
+#include <thread>
+#include <vector>
+
+#include "DefaultMQProducer.h"
+#include "DefaultMQPullConsumer.h"
+#include "DefaultMQPushConsumer.h"
+using namespace std;
+
+boost::atomic<int> g_msgCount(1);
+
+class RocketmqSendAndConsumerArgs {
+ public:
+ RocketmqSendAndConsumerArgs()
+ : body("msgbody for test"),
+ thread_count(boost::thread::hardware_concurrency()),
+ broadcasting(false),
+ syncpush(false),
+ SelectUnactiveBroker(false),
+ IsAutoDeleteSendCallback(false),
+ retrytimes(5),
+ PrintMoreInfo(false) {}
+
+ public:
+ std::string namesrv;
+ std::string namesrv_domain;
+ std::string groupname;
+ std::string topic;
+ std::string body;
+ int thread_count;
+ bool broadcasting;
+ bool syncpush;
+ bool SelectUnactiveBroker; // default select active broker
+ bool IsAutoDeleteSendCallback;
+ int retrytimes; // default retry 5 times;
+ bool PrintMoreInfo;
+};
+
+class TpsReportService {
+ public:
+ TpsReportService() : tps_interval_(1), quit_flag_(false), tps_count_(0) {}
+ void start() {
+ tps_thread_.reset(
+ new boost::thread(boost::bind(&TpsReportService::TpsReport, this)));
+ }
+
+ ~TpsReportService() {
+ quit_flag_.store(true);
+ if (tps_thread_->joinable()) tps_thread_->join();
+ }
+
+ void Increment() { ++tps_count_; }
+
+ void TpsReport() {
+ while (!quit_flag_.load()) {
+ boost::this_thread::sleep_for(tps_interval_);
+ std::cout << "tps: " << tps_count_.load() << std::endl;
+ tps_count_.store(0);
+ }
+ }
+
+ private:
+ boost::chrono::seconds tps_interval_;
+ boost::shared_ptr<boost::thread> tps_thread_;
+ boost::atomic<bool> quit_flag_;
+ boost::atomic<long> tps_count_;
+};
+
+static void PrintResult(rocketmq::SendResult* result) {
+ std::cout << "sendresult = " << result->getSendStatus()
+ << ", msgid = " << result->getMsgId()
+ << ", queueOffset = " << result->getQueueOffset() << ","
+ << result->getMessageQueue().toString() << endl;
+}
+
+void PrintPullResult(rocketmq::PullResult* result) {
+ std::cout << result->toString() << std::endl;
+ if (result->pullStatus == rocketmq::FOUND) {
+ std::cout << result->toString() << endl;
+ std::vector<rocketmq::MQMessageExt>::iterator it =
+ result->msgFoundList.begin();
+ for (; it != result->msgFoundList.end(); ++it) {
+ cout << "=======================================================" << endl
+ << (*it).toString() << endl;
+ }
+ }
+}
+
+static void PrintRocketmqSendAndConsumerArgs(
+ const RocketmqSendAndConsumerArgs& info) {
+ std::cout << "nameserver: " << info.namesrv << endl
+ << "topic: " << info.topic << endl
+ << "groupname: " << info.groupname << endl
+ << "produce content: " << info.body << endl
+ << "msg count: " << g_msgCount.load() << endl;
+}
+
+static void help() {
+ std::cout
+ << "need option,like follow: \n"
+ << "-n nameserver addr, if not set -n and -i ,no nameSrv will be got \n"
+ "-i nameserver domain name, if not set -n and -i ,no nameSrv will be "
+ "got \n"
+ "-g groupname \n"
+ "-t msg topic \n"
+ "-m messagecout(default value: 1) \n"
+ "-c content(default value: only test ) \n"
+ "-b (BROADCASTING model, default value: CLUSTER) \n"
+ "-s sync push(default is async push)\n"
+ "-r setup retry times(default value: 5 times)\n"
+ "-u select active broker to send msg(default value: false)\n"
+ "-d use AutoDeleteSendcallback by cpp client(defalut value: false) \n"
+ "-T thread count of send msg or consume msg(defalut value: system cpu "
+ "core number) \n"
+ "-v print more details information \n";
+}
+
+static bool ParseArgs(int argc, char* argv[],
+ RocketmqSendAndConsumerArgs* info) {
+ int ch;
+ while ((ch = getopt(argc, argv, "n:i:g:t:m:c:b:s:h:r:T:bu")) != -1) {
+ switch (ch) {
+ case 'n':
+ info->namesrv.insert(0, optarg);
+ break;
+ case 'i':
+ info->namesrv_domain.insert(0, optarg);
+ break;
+ case 'g':
+ info->groupname.insert(0, optarg);
+ break;
+ case 't':
+ info->topic.insert(0, optarg);
+ break;
+ case 'm':
+ g_msgCount.store(atoi(optarg));
+ break;
+ case 'c':
+ info->body.insert(0, optarg);
+ break;
+ case 'b':
+ info->broadcasting = true;
+ break;
+ case 's':
+ info->syncpush = true;
+ break;
+ case 'r':
+ info->retrytimes = atoi(optarg);
+ break;
+ case 'u':
+ info->SelectUnactiveBroker = true;
+ break;
+ case 'T':
+ info->thread_count = atoi(optarg);
+ break;
+ case 'v':
+ info->PrintMoreInfo = true;
+ break;
+ case 'h':
+ help();
+ return false;
+ default:
+ help();
+ return false;
+ }
+ }
+ if (info->groupname.empty() || info->topic.empty() ||
+ (info->namesrv_domain.empty() && info->namesrv.empty())) {
+ std::cout << "please use -g to setup groupname and -t setup topic \n";
+ help();
+ return false;
+ }
+ return true;
+}
+#endif // ROCKETMQ_CLIENT4CPP_EXAMPLE_COMMON_H_
diff --git a/rocketmq-cpp/format.sh b/rocketmq-cpp/format.sh
new file mode 100755
index 00000000..20dbe71a
--- /dev/null
+++ b/rocketmq-cpp/format.sh
@@ -0,0 +1,62 @@
+#!/bin/bash
+
+
+TMPFILE=".clang_format_file.tmp"
+FORMAT="{BasedOnStyle: Google,IndentWidth: 2,ColumnLimit: 80}"
+
+function Usage
+{
+ echo "Usage: $0 want-format-file|want-format-dir ..."
+ #echo "Currently only format a file or dir at a time"
+}
+
+#Setp1 check clang-format support
+if ! which clang-format &>/dev/null; then
+ echo -e "\033[32m !!!!!!please install clang-format \033[0m"
+ exit 1
+fi
+
+
+#Setp2 check weather incoming format file
+if [ ! $# -ge 1 ];then
+ Usage
+ exit 1
+fi
+
+for dest in "$@"
+do
+ if [ ! -e $dest ]; then
+ echo -e "\033[32m $dest not exists,please check this file weather exists \033[0m"
+ fi
+done
+
+
+#Setp3 get filelist
+for dest in $*
+do
+ if [ -f $dest ];then
+ files="$files $dest"
+ elif [ -d $dest ];then
+ files="$files `ls $dest/*.cpp $dest/*.h $dest/*.cc 2>/dev/null`"
+ else
+ echo -e "\033[32m $dest sorry current $0 only support regular file or dir \033[0m"
+ fi
+done
+
+#Setp4 use clang-format format dest file
+for file in $files
+do
+ echo $file
+ clang-format -style="$FORMAT" $file > $TMPFILE
+
+ if [ -e $TMPFILE ];then
+ filesize=`wc -c $TMPFILE |cut -d " " -f1`
+ if [ $filesize -eq 0 ];then
+ echo -e "\033[32m formt file error,May be because of the size of the source file is 0, or format program error \033[0m"
+ exit 1
+ fi
+ fi
+
+ #Setp4 replace source file
+ mv -f $TMPFILE $file
+done
diff --git a/rocketmq-cpp/include/Arg_helper.h b/rocketmq-cpp/include/Arg_helper.h
new file mode 100755
index 00000000..f243fc16
--- /dev/null
+++ b/rocketmq-cpp/include/Arg_helper.h
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef _ARG_HELPER_H_
+#define _ARG_HELPER_H_
+
+#include <string>
+#include <vector>
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class ROCKETMQCLIENT_API Arg_helper {
+ public:
+ Arg_helper(int argc, char* argv[]);
+ Arg_helper(std::string arg_str_);
+ std::string get_option(int idx_) const;
+ bool is_enable_option(std::string opt_) const;
+ std::string get_option_value(std::string opt_) const;
+
+ private:
+ std::vector<std::string> m_args;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+
+#endif //<!_ARG_HELPER_H_;
diff --git a/rocketmq-cpp/include/AsyncCallback.h b/rocketmq-cpp/include/AsyncCallback.h
new file mode 100755
index 00000000..698575c9
--- /dev/null
+++ b/rocketmq-cpp/include/AsyncCallback.h
@@ -0,0 +1,66 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __SENDCALLBACK_H__
+#define __SENDCALLBACK_H__
+
+#include "MQClientException.h"
+#include "PullResult.h"
+#include "RocketMQClient.h"
+#include "SendResult.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+struct AsyncCallback {};
+//<!***************************************************************************
+typedef enum sendCallbackType {
+ noAutoDeleteSendCallback = 0,
+ autoDeleteSendCallback = 1
+} sendCallbackType;
+
+class ROCKETMQCLIENT_API SendCallback : public AsyncCallback {
+ public:
+ virtual ~SendCallback() {}
+ virtual void onSuccess(SendResult& sendResult) = 0;
+ virtual void onException(MQException& e) = 0;
+ virtual sendCallbackType getSendCallbackType() {
+ return noAutoDeleteSendCallback;
+ }
+};
+
+//async SendCallback will be deleted automatically by metaq cpp after invoke callback interface
+class ROCKETMQCLIENT_API AutoDeleteSendCallBack : public SendCallback {
+ public:
+ virtual ~AutoDeleteSendCallBack() {}
+ virtual void onSuccess(SendResult& sendResult) = 0;
+ virtual void onException(MQException& e) = 0;
+ virtual sendCallbackType getSendCallbackType() {
+ return autoDeleteSendCallback;
+ }
+};
+
+//<!************************************************************************
+class ROCKETMQCLIENT_API PullCallback : public AsyncCallback {
+ public:
+ virtual ~PullCallback() {}
+ virtual void onSuccess(MQMessageQueue& mq, PullResult& result,
+ bool bProducePullRequest) = 0;
+ virtual void onException(MQException& e) = 0;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/ConsumeType.h b/rocketmq-cpp/include/ConsumeType.h
new file mode 100755
index 00000000..f8046552
--- /dev/null
+++ b/rocketmq-cpp/include/ConsumeType.h
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __CONSUMETYPE_H__
+#define __CONSUMETYPE_H__
+
+namespace rocketmq {
+//<!***************************************************************************
+enum ConsumeType {
+ CONSUME_ACTIVELY,
+ CONSUME_PASSIVELY,
+};
+
+//<!***************************************************************************
+enum ConsumeFromWhere {
+ /**
+ *new consumer will consume from end offset of queue,
+ * and then consume from last consumed offset of queue follow-up
+ */
+ CONSUME_FROM_LAST_OFFSET,
+
+ // @Deprecated
+ CONSUME_FROM_LAST_OFFSET_AND_FROM_MIN_WHEN_BOOT_FIRST,
+ // @Deprecated
+ CONSUME_FROM_MIN_OFFSET,
+ // @Deprecated
+ CONSUME_FROM_MAX_OFFSET,
+ /**
+ *new consumer will consume from first offset of queue,
+ * and then consume from last consumed offset of queue follow-up
+ */
+ CONSUME_FROM_FIRST_OFFSET,
+ /**
+ *new consumer will consume from the queue offset specified by timestamp,
+ * and then consume from last consumed offset of queue follow-up
+ */
+ CONSUME_FROM_TIMESTAMP,
+};
+
+//<!***************************************************************************
+enum MessageModel {
+ BROADCASTING,
+ CLUSTERING,
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/DefaultMQProducer.h b/rocketmq-cpp/include/DefaultMQProducer.h
new file mode 100755
index 00000000..fafd1a47
--- /dev/null
+++ b/rocketmq-cpp/include/DefaultMQProducer.h
@@ -0,0 +1,106 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __DEFAULTMQPRODUCER_H__
+#define __DEFAULTMQPRODUCER_H__
+
+#include "MQMessageQueue.h"
+#include "MQProducer.h"
+#include "RocketMQClient.h"
+#include "SendResult.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class ROCKETMQCLIENT_API DefaultMQProducer : public MQProducer {
+ public:
+ DefaultMQProducer(const std::string& groupname);
+ virtual ~DefaultMQProducer();
+
+ //<!begin mqadmin;
+ virtual void start();
+ virtual void shutdown();
+ //<!end mqadmin;
+
+ //<! begin MQProducer;
+ virtual SendResult send(MQMessage& msg, bool bSelectActiveBroker = false);
+ virtual SendResult send(MQMessage& msg, const MQMessageQueue& mq);
+ virtual SendResult send(MQMessage& msg, MessageQueueSelector* selector,
+ void* arg);
+ virtual SendResult send(MQMessage& msg, MessageQueueSelector* selector,
+ void* arg, int autoRetryTimes,
+ bool bActiveBroker = false);
+ virtual void send(MQMessage& msg, SendCallback* pSendCallback,
+ bool bSelectActiveBroker = false);
+ virtual void send(MQMessage& msg, const MQMessageQueue& mq,
+ SendCallback* pSendCallback);
+ virtual void send(MQMessage& msg, MessageQueueSelector* selector, void* arg,
+ SendCallback* pSendCallback);
+ virtual void sendOneway(MQMessage& msg, bool bSelectActiveBroker = false);
+ virtual void sendOneway(MQMessage& msg, const MQMessageQueue& mq);
+ virtual void sendOneway(MQMessage& msg, MessageQueueSelector* selector,
+ void* arg);
+ //<! end MQProducer;
+
+ //set and get timeout of per msg
+ int getSendMsgTimeout() const;
+ void setSendMsgTimeout(int sendMsgTimeout);
+
+ /*
+ * if msgBody size is large than m_compressMsgBodyOverHowmuch
+ metaq cpp will compress msgBody according to compressLevel
+ */
+ int getCompressMsgBodyOverHowmuch() const;
+ void setCompressMsgBodyOverHowmuch(int compressMsgBodyOverHowmuch);
+ int getCompressLevel() const;
+ void setCompressLevel(int compressLevel);
+
+ //if msgbody size larger than maxMsgBodySize, exception will be throwed
+ int getMaxMessageSize() const;
+ void setMaxMessageSize(int maxMessageSize);
+
+ //set msg max retry times, default retry times is 5
+ int getRetryTimes() const;
+ void setRetryTimes(int times);
+
+ protected:
+ SendResult sendAutoRetrySelectImpl(MQMessage& msg,
+ MessageQueueSelector* pSelector,
+ void* pArg, int communicationMode,
+ SendCallback* pSendCallback,
+ int retryTimes,
+ bool bActiveBroker = false);
+ SendResult sendSelectImpl(MQMessage& msg, MessageQueueSelector* pSelector,
+ void* pArg, int communicationMode,
+ SendCallback* sendCallback);
+ SendResult sendDefaultImpl(MQMessage& msg, int communicationMode,
+ SendCallback* pSendCallback,
+ bool bActiveBroker = false);
+ SendResult sendKernelImpl(MQMessage& msg, const MQMessageQueue& mq,
+ int communicationMode, SendCallback* pSendCallback);
+ bool tryToCompressMessage(MQMessage& msg);
+
+ private:
+ int m_sendMsgTimeout;
+ int m_compressMsgBodyOverHowmuch;
+ int m_maxMessageSize; //<! default:128K;
+ bool m_retryAnotherBrokerWhenNotStoreOK;
+ int m_compressLevel;
+ int m_retryTimes;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/DefaultMQPullConsumer.h b/rocketmq-cpp/include/DefaultMQPullConsumer.h
new file mode 100755
index 00000000..30599a2e
--- /dev/null
+++ b/rocketmq-cpp/include/DefaultMQPullConsumer.h
@@ -0,0 +1,155 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __DEFAULTMQPULLCONSUMER_H__
+#define __DEFAULTMQPULLCONSUMER_H__
+
+#include <set>
+#include <string>
+#include "MQConsumer.h"
+#include "MQMessageQueue.h"
+#include "MQueueListener.h"
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+class Rebalance;
+class SubscriptionData;
+class OffsetStore;
+class PullAPIWrapper;
+class ConsumerRunningInfo;
+//<!***************************************************************************
+class ROCKETMQCLIENT_API DefaultMQPullConsumer : public MQConsumer {
+ public:
+ DefaultMQPullConsumer(const std::string& groupname);
+ virtual ~DefaultMQPullConsumer();
+
+ //<!begin mqadmin;
+ virtual void start();
+ virtual void shutdown();
+ //<!end mqadmin;
+
+ //<!begin MQConsumer
+ virtual void sendMessageBack(MQMessageExt& msg, int delayLevel);
+ virtual void fetchSubscribeMessageQueues(const std::string& topic,
+ std::vector<MQMessageQueue>& mqs);
+ virtual void doRebalance();
+ virtual void persistConsumerOffset();
+ virtual void persistConsumerOffsetByResetOffset();
+ virtual void updateTopicSubscribeInfo(const std::string& topic,
+ std::vector<MQMessageQueue>& info);
+ virtual ConsumeType getConsumeType();
+ virtual ConsumeFromWhere getConsumeFromWhere();
+ virtual void getSubscriptions(std::vector<SubscriptionData>&);
+ virtual void updateConsumeOffset(const MQMessageQueue& mq, int64 offset);
+ virtual void removeConsumeOffset(const MQMessageQueue& mq);
+ virtual void producePullMsgTask(PullRequest*);
+ virtual Rebalance* getRebalance() const;
+ //<!end MQConsumer;
+
+ void registerMessageQueueListener(const std::string& topic,
+ MQueueListener* pListener);
+ /**
+ * pull msg from specified queue, if no msg in queue, return directly
+ *
+ * @param mq
+ * specify the pulled queue
+ * @param subExpression
+ * set filter expression for pulled msg, broker will filter msg actively
+ * Now only OR operation is supported, eg: "tag1 || tag2 || tag3"
+ * if subExpression is setted to "null" or "*"��all msg will be subscribed
+ * @param offset
+ * specify the started pull offset
+ * @param maxNums
+ * specify max msg num by per pull
+ * @return
+ * accroding to PullResult
+ */
+ virtual PullResult pull(const MQMessageQueue& mq, const std::string& subExpression,
+ int64 offset, int maxNums);
+ virtual void pull(const MQMessageQueue& mq, const std::string& subExpression,
+ int64 offset, int maxNums, PullCallback* pPullCallback);
+
+ /**
+ * pull msg from specified queue, if no msg, broker will suspend the pull request 20s
+ *
+ * @param mq
+ * specify the pulled queue
+ * @param subExpression
+ * set filter expression for pulled msg, broker will filter msg actively
+ * Now only OR operation is supported, eg: "tag1 || tag2 || tag3"
+ * if subExpression is setted to "null" or "*"��all msg will be subscribed
+ * @param offset
+ * specify the started pull offset
+ * @param maxNums
+ * specify max msg num by per pull
+ * @return
+ * accroding to PullResult
+ */
+ PullResult pullBlockIfNotFound(const MQMessageQueue& mq,
+ const std::string& subExpression, int64 offset,
+ int maxNums);
+ void pullBlockIfNotFound(const MQMessageQueue& mq,
+ const std::string& subExpression, int64 offset,
+ int maxNums, PullCallback* pPullCallback);
+
+ virtual ConsumerRunningInfo* getConsumerRunningInfo() { return NULL; }
+ /**
+ * ��ȡ���ѽ��ȣ�����-1��ʾ����
+ *
+ * @param mq
+ * @param fromStore
+ * @return
+ */
+ int64 fetchConsumeOffset(const MQMessageQueue& mq, bool fromStore);
+ /**
+ * ����topic��ȡMessageQueue���Ծ��ⷽʽ�����ڶ����Ա֮�����
+ *
+ * @param topic
+ * ��ϢTopic
+ * @return ���ض��м���
+ */
+ void fetchMessageQueuesInBalance(const std::string& topic,
+ std::vector<MQMessageQueue> mqs);
+
+ // temp persist consumer offset interface, only valid with
+ // RemoteBrokerOffsetStore, updateConsumeOffset should be called before.
+ void persistConsumerOffset4PullConsumer(const MQMessageQueue& mq);
+
+ private:
+ void checkConfig();
+ void copySubscription();
+
+ PullResult pullSyncImpl(const MQMessageQueue& mq, const std::string& subExpression,
+ int64 offset, int maxNums, bool block);
+
+ void pullAsyncImpl(const MQMessageQueue& mq, const std::string& subExpression,
+ int64 offset, int maxNums, bool block,
+ PullCallback* pPullCallback);
+
+ void subscriptionAutomatically(const std::string& topic);
+
+ private:
+ std::set<std::string> m_registerTopics;
+
+ MQueueListener* m_pMessageQueueListener;
+ OffsetStore* m_pOffsetStore;
+ Rebalance* m_pRebalance;
+ PullAPIWrapper* m_pPullAPIWrapper;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/DefaultMQPushConsumer.h b/rocketmq-cpp/include/DefaultMQPushConsumer.h
new file mode 100755
index 00000000..9a394845
--- /dev/null
+++ b/rocketmq-cpp/include/DefaultMQPushConsumer.h
@@ -0,0 +1,160 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __DEFAULTMQPUSHCONSUMER_H__
+#define __DEFAULTMQPUSHCONSUMER_H__
+
+#include <boost/asio.hpp>
+#include <boost/asio/io_service.hpp>
+#include <boost/bind.hpp>
+#include <boost/date_time/posix_time/posix_time.hpp>
+#include <boost/scoped_ptr.hpp>
+#include <boost/thread/thread.hpp>
+#include <string>
+#include "AsyncCallback.h"
+#include "MQConsumer.h"
+#include "MQMessageListener.h"
+#include "MQMessageQueue.h"
+
+namespace rocketmq {
+
+class Rebalance;
+class SubscriptionData;
+class OffsetStore;
+class PullAPIWrapper;
+class PullRequest;
+class ConsumeMsgService;
+class TaskQueue;
+class TaskThread;
+class AsyncPullCallback;
+class ConsumerRunningInfo;
+//<!***************************************************************************
+class ROCKETMQCLIENT_API DefaultMQPushConsumer : public MQConsumer {
+ public:
+ DefaultMQPushConsumer(const std::string& groupname);
+ void boost_asio_work();
+ virtual ~DefaultMQPushConsumer();
+
+ //<!begin mqadmin;
+ virtual void start();
+ virtual void shutdown();
+ //<!end mqadmin;
+
+ //<!begin MQConsumer
+ virtual void sendMessageBack(MQMessageExt& msg, int delayLevel);
+ virtual void fetchSubscribeMessageQueues(const std::string& topic,
+ std::vector<MQMessageQueue>& mqs);
+ virtual void doRebalance();
+ virtual void persistConsumerOffset();
+ virtual void persistConsumerOffsetByResetOffset();
+ virtual void updateTopicSubscribeInfo(const std::string& topic,
+ std::vector<MQMessageQueue>& info);
+ virtual ConsumeType getConsumeType();
+ virtual ConsumeFromWhere getConsumeFromWhere();
+ void setConsumeFromWhere(ConsumeFromWhere consumeFromWhere);
+ virtual void getSubscriptions(std::vector<SubscriptionData>&);
+ virtual void updateConsumeOffset(const MQMessageQueue& mq, int64 offset);
+ virtual void removeConsumeOffset(const MQMessageQueue& mq);
+ virtual PullResult pull(const MQMessageQueue& mq, const std::string& subExpression,
+ int64 offset, int maxNums) {
+ return PullResult();
+ }
+ virtual void pull(const MQMessageQueue& mq, const std::string& subExpression,
+ int64 offset, int maxNums,
+ PullCallback* pPullCallback) {}
+ virtual ConsumerRunningInfo* getConsumerRunningInfo();
+ //<!end MQConsumer;
+
+ void registerMessageListener(MQMessageListener* pMessageListener);
+ MessageListenerType getMessageListenerType();
+ void subscribe(const std::string& topic, const std::string& subExpression);
+
+ OffsetStore* getOffsetStore() const;
+ virtual Rebalance* getRebalance() const;
+ ConsumeMsgService* getConsumerMsgService() const;
+
+ virtual void producePullMsgTask(PullRequest*);
+ void triggerNextPullRequest(boost::asio::deadline_timer* t,
+ PullRequest* request);
+ void runPullMsgQueue(TaskQueue* pTaskQueue);
+ void pullMessage(PullRequest* pullrequest); // sync pullMsg
+ void pullMessageAsync(PullRequest* pullrequest); // async pullMsg
+ void setAsyncPull(bool asyncFlag);
+ AsyncPullCallback* getAsyncPullCallBack(PullRequest* request,
+ MQMessageQueue msgQueue);
+ void shutdownAsyncPullCallBack();
+
+ /*
+ for orderly consume, set the pull num of message size by each pullMsg,
+ default value is 1;
+ */
+ void setConsumeMessageBatchMaxSize(int consumeMessageBatchMaxSize);
+ int getConsumeMessageBatchMaxSize() const;
+
+ /*
+ set consuming thread count, default value is cpu cores
+ */
+ void setConsumeThreadCount(int threadCount);
+ int getConsumeThreadCount() const;
+
+ /*
+ set pullMsg thread count, default value is cpu cores
+ */
+ void setPullMsgThreadPoolCount(int threadCount);
+ int getPullMsgThreadPoolCount() const;
+
+ /*
+ set max cache msg size perQueue in memory if consumer could not consume msgs
+ immediately
+ default maxCacheMsgSize perQueue is 1000, set range is:1~65535
+ */
+ void setMaxCacheMsgSizePerQueue(int maxCacheSize);
+ int getMaxCacheMsgSizePerQueue() const;
+
+ private:
+ void checkConfig();
+ void copySubscription();
+ void updateTopicSubscribeInfoWhenSubscriptionChanged();
+
+ private:
+ uint64_t m_startTime;
+ ConsumeFromWhere m_consumeFromWhere;
+ std::map<std::string, std::string> m_subTopics;
+ int m_consumeThreadCount;
+ OffsetStore* m_pOffsetStore;
+ Rebalance* m_pRebalance;
+ PullAPIWrapper* m_pPullAPIWrapper;
+ ConsumeMsgService* m_consumerServeice;
+ MQMessageListener* m_pMessageListener;
+ int m_consumeMessageBatchMaxSize;
+ int m_maxMsgCacheSize;
+ boost::asio::io_service m_async_ioService;
+ boost::scoped_ptr<boost::thread> m_async_service_thread;
+
+ typedef std::map<MQMessageQueue, AsyncPullCallback*> PullMAP;
+ PullMAP m_PullCallback;
+ bool m_asyncPull;
+ int m_asyncPullTimeout;
+ int m_pullMsgThreadPoolNum;
+
+ private:
+ TaskQueue* m_pullmsgQueue;
+ std::unique_ptr<boost::thread> m_pullmsgThread;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/MQClient.h b/rocketmq-cpp/include/MQClient.h
new file mode 100755
index 00000000..b3a1ba8b
--- /dev/null
+++ b/rocketmq-cpp/include/MQClient.h
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __MQADMIN_H__
+#define __MQADMIN_H__
+#include <boost/asio.hpp>
+#include <boost/asio/io_service.hpp>
+#include <boost/bind.hpp>
+#include <boost/date_time/posix_time/posix_time.hpp>
+#include <boost/thread/mutex.hpp>
+#include <boost/thread/thread.hpp>
+#include "MQMessageExt.h"
+#include "MQMessageQueue.h"
+#include "QueryResult.h"
+#include "RocketMQClient.h"
+#include "SessionCredentials.h"
+
+namespace rocketmq {
+class MQClientFactory;
+//<!***************************************************************************
+
+enum elogLevel {
+ eLOG_LEVEL_DISABLE = 0,
+ eLOG_LEVEL_FATAL = 1,
+ eLOG_LEVEL_ERROR = 2,
+ eLOG_LEVEL_WARN = 3,
+ eLOG_LEVEL_INFO = 4,
+ eLOG_LEVEL_DEBUG = 5,
+ eLOG_LEVEL_TRACE = 6,
+ eLOG_LEVEL_LEVEL_NUM = 7
+};
+
+class ROCKETMQCLIENT_API MQClient {
+ public:
+ MQClient();
+ virtual ~MQClient();
+
+ public:
+ // clientid=processId-ipAddr@instanceName;
+ std::string getMQClientId() const;
+ const std::string& getNamesrvAddr() const;
+ void setNamesrvAddr(const std::string& namesrvAddr);
+ const std::string& getNamesrvDomain() const;
+ void setNamesrvDomain(const std::string& namesrvDomain);
+ const std::string& getInstanceName() const;
+ void setInstanceName(const std::string& instanceName);
+ //<!groupName;
+ const std::string& getGroupName() const;
+ void setGroupName(const std::string& groupname);
+
+ /**
+ * no realization
+ */
+ void createTopic(const std::string& key, const std::string& newTopic, int queueNum);
+ /**
+ * search earliest msg store time for specified queue
+ *
+ * @param mq
+ * message queue
+ * @return earliest store time, ms
+ */
+ int64 earliestMsgStoreTime(const MQMessageQueue& mq);
+ /**
+ * search maxOffset of queue
+ *
+ * @param mq
+ * message queue
+ * @return minOffset of queue
+ */
+ int64 minOffset(const MQMessageQueue& mq);
+ /**
+ * search maxOffset of queue
+ * Note: maxOffset-1 is max offset that could get msg
+ * @param mq
+ * message queue
+ * @return maxOffset of queue
+ */
+ int64 maxOffset(const MQMessageQueue& mq);
+ /**
+ * get queue offset by timestamp
+ *
+ * @param mq
+ * mq queue
+ * @param timestamp
+ * timestamp with ms unit
+ * @return queue offset according to timestamp
+ */
+ int64 searchOffset(const MQMessageQueue& mq, uint64_t timestamp);
+ /**
+ * get whole msg info from broker by msgId
+ *
+ * @param msgId
+ * @return MQMessageExt
+ */
+ MQMessageExt* viewMessage(const std::string& msgId);
+ /**
+ * query message by topic and key
+ *
+ * @param topic
+ * topic name
+ * @param key
+ * topic key
+ * @param maxNum
+ * query num
+ * @param begin
+ * begin timestamp
+ * @param end
+ * end timestamp
+ * @return
+ * according to QueryResult
+ */
+ QueryResult queryMessage(const std::string& topic, const std::string& key, int maxNum,
+ int64 begin, int64 end);
+
+ std::vector<MQMessageQueue> getTopicMessageQueueInfo(const std::string& topic);
+
+ // log configuration interface, default LOG_LEVEL is LOG_LEVEL_INFO, default
+ // log file num is 3, each log size is 100M
+ void setMetaqLogLevel(elogLevel inputLevel);
+ void setMetaqLogFileSizeAndNum(int fileNum,
+ long perFileSize); // perFileSize is MB unit
+
+ /** set TcpTransport pull thread num, which dermine the num of threads to
+ distribute network data,
+ 1. its default value is CPU num, it must be setted before producer/consumer
+ start, minimum value is CPU num;
+ 2. this pullThread num must be tested on your environment to find the best
+ value for RT of sendMsg or delay time of consume msg before you change it;
+ 3. producer and consumer need different pullThread num, if set this num,
+ producer and consumer must set different instanceName.
+ 4. configuration suggestion:
+ 1>. minimum RT of sendMsg:
+ pullThreadNum = brokerNum*2
+ **/
+ void setTcpTransportPullThreadNum(int num);
+ const int getTcpTransportPullThreadNum() const;
+
+ /** timeout of tcp connect, it is same meaning for both producer and consumer;
+ 1. default value is 3000ms
+ 2. input parameter could only be milliSecond, suggestion value is
+ 1000-3000ms;
+ **/
+ void setTcpTransportConnectTimeout(uint64_t timeout); // ms
+ const uint64_t getTcpTransportConnectTimeout() const;
+
+ /** timeout of tryLock tcpTransport before sendMsg/pullMsg, if timeout,
+ returns NULL
+ 1. paremeter unit is ms, default value is 3000ms, the minimun value is
+ 1000ms
+ suggestion value is 3000ms;
+ 2. if configured with value smaller than 1000ms, the tryLockTimeout value
+ will be setted to 1000ms
+ **/
+ void setTcpTransportTryLockTimeout(uint64_t timeout); // ms
+ const uint64_t getTcpTransportTryLockTimeout() const;
+
+ void setUnitName(std::string unitName);
+ const std::string& getUnitName();
+
+ void setSessionCredentials(const std::string& input_accessKey,
+ const std::string& input_secretKey,
+ const std::string& input_onsChannel);
+ const SessionCredentials& getSessionCredentials() const;
+
+ protected:
+ virtual void start();
+ virtual void shutdown();
+ MQClientFactory* getFactory() const;
+ virtual bool isServiceStateOk();
+
+ protected:
+ std::string m_namesrvAddr;
+ std::string m_namesrvDomain;
+ std::string m_instanceName;
+ //<! the name is globle only
+ std::string m_GroupName;
+ //<!factory;
+ MQClientFactory* m_clientFactory;
+ int m_serviceState;
+ int m_pullThreadNum;
+ uint64_t m_tcpConnectTimeout; // ms
+ uint64_t m_tcpTransportTryLockTimeout; // s
+
+ std::string m_unitName;
+ SessionCredentials m_SessionCredentials;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/MQClientException.h b/rocketmq-cpp/include/MQClientException.h
new file mode 100755
index 00000000..9b641978
--- /dev/null
+++ b/rocketmq-cpp/include/MQClientException.h
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MQCLIENTEXCEPTION_H__
+#define __MQCLIENTEXCEPTION_H__
+
+#include <exception>
+#include <ostream>
+#include <sstream>
+#include <string>
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class ROCKETMQCLIENT_API MQException : public std::exception {
+ public:
+ MQException(const std::string& msg, int error, const char* file,
+ int line) throw()
+ : m_error(error), m_line(line), m_file(file) {
+ try {
+ std::stringstream ss;
+ ss << "msg: " << msg << ",error:" << error << ",in file <" << file
+ << "> line:" << line;
+ m_msg = ss.str();
+ } catch (...) {
+ }
+ }
+
+ MQException(const std::string& msg, int error, const char* file,
+ const char* type, int line) throw()
+ : m_error(error), m_line(line), m_file(file), m_type(type) {
+ try {
+ std::stringstream ss;
+ ss << "msg: " << msg << ",error:" << error << ",in file <" << file
+ << "> line:" << line;
+ m_msg = ss.str();
+ } catch (...) {
+ }
+ }
+
+ virtual ~MQException() throw() {}
+
+ const char* what() const throw() { return m_msg.c_str(); }
+
+ int GetError() const throw() { return m_error; }
+
+ virtual const char* GetType() const throw() { return m_type.c_str(); }
+
+ protected:
+ int m_error;
+ int m_line;
+ std::string m_msg;
+ std::string m_file;
+ std::string m_type;
+};
+
+inline std::ostream& operator<<(std::ostream& os, const MQException& e) {
+ os << "Type: " << e.GetType() << " , " << e.what();
+ return os;
+}
+
+#define DEFINE_MQCLIENTEXCEPTION(name) \
+ class ROCKETMQCLIENT_API name : public MQException { \
+ public: \
+ name(const std::string& msg, int error, const char* file, \
+ int line) throw() \
+ : MQException(msg, error, file, #name, line) {} \
+ virtual const char* GetType() const throw() { return m_type.c_str(); } \
+ };
+
+DEFINE_MQCLIENTEXCEPTION(MQClientException)
+DEFINE_MQCLIENTEXCEPTION(MQBrokerException)
+DEFINE_MQCLIENTEXCEPTION(InterruptedException)
+DEFINE_MQCLIENTEXCEPTION(RemotingException)
+DEFINE_MQCLIENTEXCEPTION(UnknownHostException)
+
+#define THROW_MQEXCEPTION(e, msg, err) throw e(msg, err, __FILE__, __LINE__)
+#define NEW_MQEXCEPTION(e, msg, err) e(msg, err, __FILE__, __LINE__)
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/MQConsumer.h b/rocketmq-cpp/include/MQConsumer.h
new file mode 100755
index 00000000..89763a85
--- /dev/null
+++ b/rocketmq-cpp/include/MQConsumer.h
@@ -0,0 +1,70 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MQCONSUMER_H__
+#define __MQCONSUMER_H__
+
+#include <string>
+#include "AsyncCallback.h"
+#include "ConsumeType.h"
+#include "MQClient.h"
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+class SubscriptionData;
+class PullRequest;
+class Rebalance;
+class ConsumerRunningInfo;
+//<!************************************************************************
+class ROCKETMQCLIENT_API MQConsumer : public MQClient {
+ public:
+ virtual ~MQConsumer() {}
+ virtual void sendMessageBack(MQMessageExt& msg, int delayLevel) = 0;
+ virtual void fetchSubscribeMessageQueues(const std::string& topic,
+ std::vector<MQMessageQueue>& mqs) = 0;
+ virtual void doRebalance() = 0;
+ virtual void persistConsumerOffset() = 0;
+ virtual void persistConsumerOffsetByResetOffset() = 0;
+ virtual void updateTopicSubscribeInfo(const std::string& topic,
+ std::vector<MQMessageQueue>& info) = 0;
+ virtual void updateConsumeOffset(const MQMessageQueue& mq,
+ int64 offset) = 0;
+ virtual void removeConsumeOffset(const MQMessageQueue& mq) = 0;
+ virtual ConsumeType getConsumeType() = 0;
+ virtual ConsumeFromWhere getConsumeFromWhere() = 0;
+ virtual void getSubscriptions(std::vector<SubscriptionData>&) = 0;
+ virtual void producePullMsgTask(PullRequest*) = 0;
+ virtual Rebalance* getRebalance() const = 0;
+ virtual PullResult pull(const MQMessageQueue& mq, const std::string& subExpression,
+ int64 offset, int maxNums) = 0;
+ virtual void pull(const MQMessageQueue& mq, const std::string& subExpression,
+ int64 offset, int maxNums,
+ PullCallback* pPullCallback) = 0;
+ virtual ConsumerRunningInfo* getConsumerRunningInfo() = 0;
+
+ public:
+ MessageModel getMessageModel() const { return m_messageModel; }
+ void setMessageModel(MessageModel messageModel) {
+ m_messageModel = messageModel;
+ }
+
+ protected:
+ MessageModel m_messageModel;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/MQMessage.h b/rocketmq-cpp/include/MQMessage.h
new file mode 100755
index 00000000..fc18ac97
--- /dev/null
+++ b/rocketmq-cpp/include/MQMessage.h
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MESSAGE_H__
+#define __MESSAGE_H__
+
+#include <map>
+#include <sstream>
+#include <string>
+#include <vector>
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class ROCKETMQCLIENT_API MQMessage {
+ public:
+ MQMessage();
+ MQMessage(const std::string& topic, const std::string& body);
+ MQMessage(const std::string& topic, const std::string& tags, const std::string& body);
+ MQMessage(const std::string& topic, const std::string& tags, const std::string& keys,
+ const std::string& body);
+ MQMessage(const std::string& topic, const std::string& tags, const std::string& keys,
+ const int flag, const std::string& body, bool waitStoreMsgOK);
+
+ virtual ~MQMessage();
+ MQMessage(const MQMessage& other);
+ MQMessage& operator=(const MQMessage& other);
+
+ void setProperty(const std::string& name, const std::string& value);
+ std::string getProperty(const std::string& name) const;
+
+ std::string getTopic() const;
+ void setTopic(const std::string& topic);
+ void setTopic(const char* body, int len);
+
+ std::string getTags() const;
+ void setTags(const std::string& tags);
+
+ std::string getKeys() const;
+ void setKeys(const std::string& keys);
+ void setKeys(const std::vector<std::string>& keys);
+
+ int getDelayTimeLevel() const;
+ void setDelayTimeLevel(int level);
+
+ bool isWaitStoreMsgOK();
+ void setWaitStoreMsgOK(bool waitStoreMsgOK);
+
+ int getFlag() const;
+ void setFlag(int flag);
+
+ std::string getBody() const;
+ void setBody(const char* body, int len);
+ void setBody(const std::string& body);
+
+ std::map<std::string, std::string> getProperties() const;
+ void setProperties(std::map<std::string, std::string>& properties);
+
+ const std::string toString() const {
+ std::stringstream ss;
+ ss << "Message [topic=" << m_topic << ", flag=" << m_flag
+ << ", tag=" << getTags() << "]";
+ return ss.str();
+ }
+
+ protected:
+ void Init(const std::string& topic, const std::string& tags, const std::string& keys,
+ const int flag, const std::string& body, bool waitStoreMsgOK);
+
+ public:
+ static const std::string PROPERTY_KEYS;
+ static const std::string PROPERTY_TAGS;
+ static const std::string PROPERTY_WAIT_STORE_MSG_OK;
+ static const std::string PROPERTY_DELAY_TIME_LEVEL;
+ static const std::string PROPERTY_RETRY_TOPIC;
+ static const std::string PROPERTY_REAL_TOPIC;
+ static const std::string PROPERTY_REAL_QUEUE_ID;
+ static const std::string PROPERTY_TRANSACTION_PREPARED;
+ static const std::string PROPERTY_PRODUCER_GROUP;
+ static const std::string PROPERTY_MIN_OFFSET;
+ static const std::string PROPERTY_MAX_OFFSET;
+ static const std::string KEY_SEPARATOR;
+
+ private:
+ std::string m_topic;
+ int m_flag;
+ std::string m_body;
+ std::map<std::string, std::string> m_properties;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/MQMessageExt.h b/rocketmq-cpp/include/MQMessageExt.h
new file mode 100755
index 00000000..cf911e3c
--- /dev/null
+++ b/rocketmq-cpp/include/MQMessageExt.h
@@ -0,0 +1,117 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MESSAGEEXT_H__
+#define __MESSAGEEXT_H__
+
+#ifdef WIN32
+#include <Windows.h>
+#include <Winsock2.h>
+#else
+#include <sys/socket.h>
+#endif
+
+#include "MQMessage.h"
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!message extend class, which was generated on broker;
+//<!***************************************************************************
+class ROCKETMQCLIENT_API MQMessageExt : public MQMessage {
+ public:
+ MQMessageExt();
+ MQMessageExt(int queueId, int64 bornTimestamp, sockaddr bornHost,
+ int64 storeTimestamp, sockaddr storeHost, std::string msgId);
+
+ virtual ~MQMessageExt();
+
+ static int parseTopicFilterType(int sysFlag);
+
+ int getQueueId() const;
+ void setQueueId(int queueId);
+
+ int64 getBornTimestamp() const;
+ void setBornTimestamp(int64 bornTimestamp);
+
+ sockaddr getBornHost() const;
+ std::string getBornHostString() const;
+ std::string getBornHostNameString() const;
+ void setBornHost(const sockaddr& bornHost);
+
+ int64 getStoreTimestamp() const;
+ void setStoreTimestamp(int64 storeTimestamp);
+
+ sockaddr getStoreHost() const;
+ std::string getStoreHostString() const;
+ void setStoreHost(const sockaddr& storeHost);
+
+ const std::string& getMsgId() const;
+ void setMsgId(const std::string& msgId);
+
+ int getSysFlag() const;
+ void setSysFlag(int sysFlag);
+
+ int getBodyCRC() const;
+ void setBodyCRC(int bodyCRC);
+
+ int64 getQueueOffset() const;
+ void setQueueOffset(int64 queueOffset);
+
+ int64 getCommitLogOffset() const;
+ void setCommitLogOffset(int64 physicOffset);
+
+ int getStoreSize() const;
+ void setStoreSize(int storeSize);
+
+ int getReconsumeTimes() const;
+ void setReconsumeTimes(int reconsumeTimes);
+
+ int64 getPreparedTransactionOffset() const;
+ void setPreparedTransactionOffset(int64 preparedTransactionOffset);
+
+ std::string toString() const {
+ std::stringstream ss;
+ ss << "MessageExt [queueId=" << m_queueId << ", storeSize=" << m_storeSize
+ << ", queueOffset=" << m_queueOffset << ", sysFlag=" << m_sysFlag
+ << ", bornTimestamp=" << m_bornTimestamp
+ << ", bornHost=" << getBornHostString()
+ << ", storeTimestamp=" << m_storeTimestamp
+ << ", storeHost=" << getStoreHostString() << ", msgId=" << m_msgId
+ << ", commitLogOffset=" << m_commitLogOffset << ", bodyCRC=" << m_bodyCRC
+ << ", reconsumeTimes=" << m_reconsumeTimes
+ << ", preparedTransactionOffset=" << m_preparedTransactionOffset << ", "
+ << MQMessage::toString() << "]";
+ return ss.str();
+ }
+
+ private:
+ int64 m_queueOffset;
+ int64 m_commitLogOffset;
+ int64 m_bornTimestamp;
+ int64 m_storeTimestamp;
+ int64 m_preparedTransactionOffset;
+ int m_queueId;
+ int m_storeSize;
+ int m_sysFlag;
+ int m_bodyCRC;
+ int m_reconsumeTimes;
+ sockaddr m_bornHost;
+ sockaddr m_storeHost;
+ std::string m_msgId;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/MQMessageListener.h b/rocketmq-cpp/include/MQMessageListener.h
new file mode 100755
index 00000000..63bd74d6
--- /dev/null
+++ b/rocketmq-cpp/include/MQMessageListener.h
@@ -0,0 +1,90 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MESSAGELISTENER_H__
+#define __MESSAGELISTENER_H__
+
+#include <limits.h>
+#include "MQMessageExt.h"
+#include "MQMessageQueue.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+enum ConsumeStatus {
+ //consume success, msg will be cleard from memory
+ CONSUME_SUCCESS,
+ //consume fail, but will be re-consume by call messageLisenter again
+ RECONSUME_LATER
+};
+
+/*enum ConsumeOrderlyStatus
+{*/
+/**
+ * Success consumption
+ */
+// SUCCESS,
+/**
+ * Rollback consumption(only for binlog consumption)
+ */
+// ROLLBACK,
+/**
+ * Commit offset(only for binlog consumption)
+ */
+// COMMIT,
+/**
+ * Suspend current queue a moment
+ */
+// SUSPEND_CURRENT_QUEUE_A_MOMENT
+/*};*/
+
+enum MessageListenerType {
+ messageListenerDefaultly = 0,
+ messageListenerOrderly = 1,
+ messageListenerConcurrently = 2
+};
+
+//<!***************************************************************************
+class ROCKETMQCLIENT_API MQMessageListener {
+ public:
+ virtual ~MQMessageListener() {}
+ virtual ConsumeStatus consumeMessage(const std::vector<MQMessageExt>& msgs) = 0;
+ virtual MessageListenerType getMessageListenerType() {
+ return messageListenerDefaultly;
+ }
+};
+
+class ROCKETMQCLIENT_API MessageListenerOrderly : public MQMessageListener {
+ public:
+ virtual ~MessageListenerOrderly() {}
+ virtual ConsumeStatus consumeMessage(const std::vector<MQMessageExt>& msgs) = 0;
+ virtual MessageListenerType getMessageListenerType() {
+ return messageListenerOrderly;
+ }
+};
+
+class ROCKETMQCLIENT_API MessageListenerConcurrently
+ : public MQMessageListener {
+ public:
+ virtual ~MessageListenerConcurrently() {}
+ virtual ConsumeStatus consumeMessage(const std::vector<MQMessageExt>& msgs) = 0;
+ virtual MessageListenerType getMessageListenerType() {
+ return messageListenerConcurrently;
+ }
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/MQMessageQueue.h b/rocketmq-cpp/include/MQMessageQueue.h
new file mode 100755
index 00000000..bb1c4aee
--- /dev/null
+++ b/rocketmq-cpp/include/MQMessageQueue.h
@@ -0,0 +1,64 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MQMESSAGEQUEUE_H__
+#define __MQMESSAGEQUEUE_H__
+
+#include <iomanip>
+#include <sstream>
+#include <string>
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!************************************************************************/
+//<!* MQ(T,B,ID);
+//<!************************************************************************/
+class ROCKETMQCLIENT_API MQMessageQueue {
+ public:
+ MQMessageQueue();
+ MQMessageQueue(const std::string& topic, const std::string& brokerName, int queueId);
+ MQMessageQueue(const MQMessageQueue& other);
+ MQMessageQueue& operator=(const MQMessageQueue& other);
+
+ std::string getTopic() const;
+ void setTopic(const std::string& topic);
+
+ std::string getBrokerName() const;
+ void setBrokerName(const std::string& brokerName);
+
+ int getQueueId() const;
+ void setQueueId(int queueId);
+
+ bool operator==(const MQMessageQueue& mq) const;
+ bool operator<(const MQMessageQueue& mq) const;
+ int compareTo(const MQMessageQueue& mq) const;
+
+ const std::string toString() const {
+ std::stringstream ss;
+ ss << "MessageQueue [topic=" << m_topic << ", brokerName=" << m_brokerName
+ << ", queueId=" << m_queueId << "]";
+
+ return ss.str();
+ }
+
+ private:
+ std::string m_topic;
+ std::string m_brokerName;
+ int m_queueId;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/MQProducer.h b/rocketmq-cpp/include/MQProducer.h
new file mode 100755
index 00000000..e5df9eec
--- /dev/null
+++ b/rocketmq-cpp/include/MQProducer.h
@@ -0,0 +1,62 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MQPRODUCER_H__
+#define __MQPRODUCER_H__
+
+#include "AsyncCallback.h"
+#include "MQClient.h"
+#include "MQMessageQueue.h"
+#include "MQSelector.h"
+#include "RocketMQClient.h"
+#include "SendResult.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class ROCKETMQCLIENT_API MQProducer : public MQClient {
+ public:
+ MQProducer() {}
+ virtual ~MQProducer() {}
+ // if setted bActiveBroker, will search brokers with best service state
+ // firstly, then search brokers that had been sent failed by last time;
+ virtual SendResult send(MQMessage& msg, bool bSelectActiveBroker = false) = 0;
+ virtual SendResult send(MQMessage& msg, const MQMessageQueue& mq) = 0;
+ // strict order msg, if send failed on seleted MessageQueue, throw exception
+ // to up layer
+ virtual SendResult send(MQMessage& msg, MessageQueueSelector* selector,
+ void* arg) = 0;
+ // non-strict order msg, if send failed on seleted MessageQueue, will auto
+ // retry others Broker queues with autoRetryTimes;
+ // if setted bActiveBroker, if send failed on seleted MessageQueue, , and then
+ // search brokers with best service state, lastly will search brokers that had
+ // been sent failed by last time;
+ virtual SendResult send(MQMessage& msg, MessageQueueSelector* selector,
+ void* arg, int autoRetryTimes,
+ bool bActiveBroker = false) = 0;
+ virtual void send(MQMessage& msg, SendCallback* sendCallback,
+ bool bSelectActiveBroker = false) = 0;
+ virtual void send(MQMessage& msg, const MQMessageQueue& mq,
+ SendCallback* sendCallback) = 0;
+ virtual void send(MQMessage& msg, MessageQueueSelector* selector, void* arg,
+ SendCallback* sendCallback) = 0;
+ virtual void sendOneway(MQMessage& msg, bool bSelectActiveBroker = false) = 0;
+ virtual void sendOneway(MQMessage& msg, const MQMessageQueue& mq) = 0;
+ virtual void sendOneway(MQMessage& msg, MessageQueueSelector* selector,
+ void* arg) = 0;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/MQSelector.h b/rocketmq-cpp/include/MQSelector.h
new file mode 100755
index 00000000..77309b85
--- /dev/null
+++ b/rocketmq-cpp/include/MQSelector.h
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef _MQSELECTOR_H_
+#define _MQSELECTOR_H_
+#include "MQMessage.h"
+#include "MQMessageQueue.h"
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class ROCKETMQCLIENT_API MessageQueueSelector {
+ public:
+ virtual ~MessageQueueSelector() {}
+ virtual MQMessageQueue select(const std::vector<MQMessageQueue>& mqs,
+ const MQMessage& msg, void* arg) = 0;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif //<! _MQSELECTOR_H_
diff --git a/rocketmq-cpp/include/MQueueListener.h b/rocketmq-cpp/include/MQueueListener.h
new file mode 100755
index 00000000..5938ebfb
--- /dev/null
+++ b/rocketmq-cpp/include/MQueueListener.h
@@ -0,0 +1,34 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MESSAGEQUEUELISTENER_H__
+#define __MESSAGEQUEUELISTENER_H__
+
+#include <vector>
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class ROCKETMQCLIENT_API MQueueListener {
+ public:
+ virtual ~MQueueListener() {}
+ virtual void messageQueueChanged(const std::string& topic,
+ std::vector<MQMessageQueue>& mqAll,
+ std::vector<MQMessageQueue>& mqDivided) = 0;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/PullResult.h b/rocketmq-cpp/include/PullResult.h
new file mode 100755
index 00000000..69a6aef1
--- /dev/null
+++ b/rocketmq-cpp/include/PullResult.h
@@ -0,0 +1,69 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __PULLRESULT_H__
+#define __PULLRESULT_H__
+
+#include <sstream>
+#include "MQMessageExt.h"
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+enum PullStatus {
+ FOUND,
+ NO_NEW_MSG,
+ NO_MATCHED_MSG,
+ OFFSET_ILLEGAL,
+ BROKER_TIMEOUT // indicate pull request timeout or received NULL response
+};
+
+static const char* EnumStrings[] = {"FOUND", "NO_NEW_MSG", "NO_MATCHED_MSG",
+ "OFFSET_ILLEGAL", "BROKER_TIMEOUT"};
+
+//<!***************************************************************************
+class ROCKETMQCLIENT_API PullResult {
+ public:
+ PullResult();
+ PullResult(PullStatus status);
+ PullResult(PullStatus pullStatus, int64 nextBeginOffset,
+ int64 minOffset, int64 maxOffset);
+
+ PullResult(PullStatus pullStatus, int64 nextBeginOffset,
+ int64 minOffset, int64 maxOffset,
+ const std::vector<MQMessageExt>& src);
+
+ virtual ~PullResult();
+
+ std::string toString() {
+ std::stringstream ss;
+ ss << "PullResult [ pullStatus=" << EnumStrings[pullStatus]
+ << ", nextBeginOffset=" << nextBeginOffset << ", minOffset=" << minOffset
+ << ", maxOffset=" << maxOffset
+ << ", msgFoundList=" << msgFoundList.size() << " ]";
+ return ss.str();
+ }
+
+ public:
+ PullStatus pullStatus;
+ int64 nextBeginOffset;
+ int64 minOffset;
+ int64 maxOffset;
+ std::vector<MQMessageExt> msgFoundList;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/QueryResult.h b/rocketmq-cpp/include/QueryResult.h
new file mode 100755
index 00000000..c9861a0a
--- /dev/null
+++ b/rocketmq-cpp/include/QueryResult.h
@@ -0,0 +1,43 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __QUERYRESULT_H__
+#define __QUERYRESULT_H__
+
+#include "MQMessageExt.h"
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!************************************************************************
+class ROCKETMQCLIENT_API QueryResult {
+ public:
+ QueryResult(uint64 indexLastUpdateTimestamp,
+ const std::vector<MQMessageExt*>& messageList) {
+ m_indexLastUpdateTimestamp = indexLastUpdateTimestamp;
+ m_messageList = messageList;
+ }
+
+ uint64 getIndexLastUpdateTimestamp() { return m_indexLastUpdateTimestamp; }
+
+ std::vector<MQMessageExt*>& getMessageList() { return m_messageList; }
+
+ private:
+ uint64 m_indexLastUpdateTimestamp;
+ std::vector<MQMessageExt*> m_messageList;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/RocketMQClient.h b/rocketmq-cpp/include/RocketMQClient.h
new file mode 100755
index 00000000..93be2d60
--- /dev/null
+++ b/rocketmq-cpp/include/RocketMQClient.h
@@ -0,0 +1,47 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __ROCKETMQCLIENT_H__
+#define __ROCKETMQCLIENT_H__
+
+#ifdef WIN32
+#ifdef ROCKETMQCLIENT_EXPORTS
+#define ROCKETMQCLIENT_API __declspec(dllexport)
+#else
+#define ROCKETMQCLIENT_API __declspec(dllimport)
+#endif
+#else
+#define ROCKETMQCLIENT_API
+#endif
+
+/** A platform-independent 8-bit signed integer type. */
+typedef signed char int8;
+/** A platform-independent 8-bit unsigned integer type. */
+typedef unsigned char uint8;
+/** A platform-independent 16-bit signed integer type. */
+typedef signed short int16;
+/** A platform-independent 16-bit unsigned integer type. */
+typedef unsigned short uint16;
+/** A platform-independent 32-bit signed integer type. */
+typedef signed int int32;
+/** A platform-independent 32-bit unsigned integer type. */
+typedef unsigned int uint32;
+/** A platform-independent 64-bit integer type. */
+typedef long long int64;
+/** A platform-independent 64-bit unsigned integer type. */
+typedef unsigned long long uint64;
+
+#endif
diff --git a/rocketmq-cpp/include/SendMessageHook.h b/rocketmq-cpp/include/SendMessageHook.h
new file mode 100755
index 00000000..f5a48359
--- /dev/null
+++ b/rocketmq-cpp/include/SendMessageHook.h
@@ -0,0 +1,47 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __SENDMESSAGEHOOK_H__
+#define __SENDMESSAGEHOOK_H__
+
+#include "MQClientException.h"
+#include "MQMessage.h"
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class ROCKETMQCLIENT_API SendMessageContext {
+ public:
+ string producerGroup;
+ MQMessage msg;
+ MQMessageQueue mq;
+ string brokerAddr;
+ int communicationMode;
+ SendResult sendResult;
+ MQException* pException;
+ void* pArg;
+};
+
+class ROCKETMQCLIENT_API SendMessageHook {
+ public:
+ virtual ~SendMessageHook() {}
+ virtual string hookName() = 0;
+ virtual void sendMessageBefore(const SendMessageContext& context) = 0;
+ virtual void sendMessageAfter(const SendMessageContext& context) = 0;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/SendResult.h b/rocketmq-cpp/include/SendResult.h
new file mode 100755
index 00000000..0f518540
--- /dev/null
+++ b/rocketmq-cpp/include/SendResult.h
@@ -0,0 +1,58 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __SENDRESULT_H__
+#define __SENDRESULT_H__
+
+#include "MQMessageQueue.h"
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+//<!all to Master;
+enum SendStatus {
+ SEND_OK,
+ SEND_FLUSH_DISK_TIMEOUT,
+ SEND_FLUSH_SLAVE_TIMEOUT,
+ SEND_SLAVE_NOT_AVAILABLE
+};
+
+//<!***************************************************************************
+class ROCKETMQCLIENT_API SendResult {
+ public:
+ SendResult();
+ SendResult(const SendStatus& sendStatus, const std::string& msgId,
+ const MQMessageQueue& messageQueue, int64 queueOffset);
+
+ virtual ~SendResult();
+ SendResult(const SendResult& other);
+ SendResult& operator=(const SendResult& other);
+
+ const std::string& getMsgId() const;
+ SendStatus getSendStatus() const;
+ MQMessageQueue getMessageQueue() const;
+ int64 getQueueOffset() const;
+
+ private:
+ SendStatus m_sendStatus;
+ std::string m_msgId;
+ MQMessageQueue m_messageQueue;
+ int64 m_queueOffset;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/include/SessionCredentials.h b/rocketmq-cpp/include/SessionCredentials.h
new file mode 100755
index 00000000..d4a4de90
--- /dev/null
+++ b/rocketmq-cpp/include/SessionCredentials.h
@@ -0,0 +1,62 @@
+
+#ifndef __SESSIONCREDENTIALS_H__
+#define __SESSIONCREDENTIALS_H__
+
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+
+class SessionCredentials {
+ public:
+ static const std::string AccessKey;
+ static const std::string SecretKey;
+ static const std::string Signature;
+ static const std::string SignatureMethod;
+ static const std::string ONSChannelKey;
+
+ SessionCredentials(std::string input_accessKey, std::string input_secretKey,
+ const std::string& input_authChannel)
+ : accessKey(input_accessKey),
+ secretKey(input_secretKey),
+ authChannel(input_authChannel) {}
+ SessionCredentials() : authChannel("ALIYUN") {}
+ ~SessionCredentials() {}
+
+ std::string getAccessKey() const { return accessKey; }
+
+ void setAccessKey(std::string input_accessKey) { accessKey = input_accessKey; }
+
+ std::string getSecretKey() const { return secretKey; }
+
+ void setSecretKey(std::string input_secretKey) { secretKey = input_secretKey; }
+
+ std::string getSignature() const { return signature; }
+
+ void setSignature(std::string input_signature) { signature = input_signature; }
+
+ std::string getSignatureMethod() const { return signatureMethod; }
+
+ void setSignatureMethod(std::string input_signatureMethod) {
+ signatureMethod = input_signatureMethod;
+ }
+
+ std::string getAuthChannel() const { return authChannel; }
+
+ void setAuthChannel(std::string input_channel) { authChannel = input_channel; }
+
+ bool isValid() const {
+ if (accessKey.empty() || secretKey.empty() || authChannel.empty())
+ return false;
+
+ return true;
+ }
+
+ private:
+ std::string accessKey;
+ std::string secretKey;
+ std::string signature;
+ std::string signatureMethod;
+ std::string authChannel;
+};
+}
+#endif
diff --git a/rocketmq-cpp/libs/CMakeLists.txt b/rocketmq-cpp/libs/CMakeLists.txt
new file mode 100755
index 00000000..015951dc
--- /dev/null
+++ b/rocketmq-cpp/libs/CMakeLists.txt
@@ -0,0 +1,16 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+add_subdirectory(signature)
diff --git a/rocketmq-cpp/libs/signature/CMakeLists.txt b/rocketmq-cpp/libs/signature/CMakeLists.txt
new file mode 100755
index 00000000..84ca0c5f
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/CMakeLists.txt
@@ -0,0 +1,25 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+project(signature)
+
+include_directories(${CMAKE_CURRENT_SOURCE_DIR}/include)
+set(LIBRARY_OUTPUT_PATH ${CMAKE_CURRENT_SOURCE_DIR}/lib)
+
+aux_source_directory(src/ DIR_LIB_SRCS)
+
+add_library(Signature STATIC ${DIR_LIB_SRCS})
+target_link_libraries(Signature ${deplibs})
+set_target_properties(Signature PROPERTIES OUTPUT_NAME "Signature")
diff --git a/rocketmq-cpp/libs/signature/Makefile b/rocketmq-cpp/libs/signature/Makefile
new file mode 100644
index 00000000..f3368cb0
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/Makefile
@@ -0,0 +1,63 @@
+##====================================================================
+# make release=0 debug版。
+# make release=1 release版。
+CXXFLAGS = -g -fPIC -Wno-deprecated -O3
+
+ifeq ($(shell uname -m),x86_64)
+ CXXFLAGS += -m64
+ BITS:= 64
+else
+ CXXFLAGS += -m32
+ BITS := 32
+endif
+
+ifeq ($(release),0)
+ CXXFLAGS += -DDEBUG
+ OUTCONFIG := debug
+else
+ CXXFLAGS += -DNDEBUG
+ OUTCONFIG := release
+endif
+
+##====================================================================
+TOPDIR := .
+TARGET := $(TOPDIR)/lib/libSignature.a
+
+CPP_SRCDIR := $(TOPDIR)/src
+CPP_SRC := $(foreach dir,$(CPP_SRCDIR), $(wildcard $(dir)/*.c))
+CPP_OBJS := $(patsubst %.c, %.o, $(CPP_SRC))
+VPATH := $(CPP_SRCDIR)
+
+LDLIBS :=
+LIBPATH :=
+CPPFLAGS := -I$(TOPDIR)/include $(addprefix -I,$(CPP_SRCDIR))
+
+CXX := g++
+AR := ar
+ARFLAGS := rcs
+##====================================================================
+all: build
+
+build:$(TARGET)
+
+
+$(TARGET):$(CPP_OBJS)
+ $(AR) $(ARFLAGS) $@ $^ $(LIBPATH) $(LDLIBS)
+
+%.o: %.c
+ $(CXX) -c $(CXXFLAGS) $(CPPFLAGS) -o $@ $<
+
+
+rebuild:clean build
+
+test:
+ @echo $(CPP_SRC)
+ @echo $(CPP_OBJS)
+
+clean:
+ $(RM) -rf $(CPP_OBJS)
+ $(RM) -rf $(TARGET)
+ $(RM) -rf tmp
+
+
+
diff --git a/rocketmq-cpp/libs/signature/include/base64.h b/rocketmq-cpp/libs/signature/include/base64.h
new file mode 100755
index 00000000..7b2b3b71
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/include/base64.h
@@ -0,0 +1,54 @@
+/* base64.h -- Encode binary data using printable characters.
+ Copyright (C) 2004, 2005, 2006 Free Software Foundation, Inc.
+ Written by Simon Josefsson.
+
+ This program is free software; you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation; either version 2, or (at your option)
+ any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program; if not, write to the Free Software Foundation,
+ Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. */
+
+#ifndef BASE64_H
+# define BASE64_H
+
+/* Get size_t. */
+# include <stddef.h>
+
+/* Get bool. */
+# include <stdbool.h>
+
+
+#ifdef __cplusplus
+namespace metaqSignature{
+#endif
+
+ /* This uses that the expression (n+(k-1))/k means the smallest
+ integer >= n/k, i.e., the ceiling of n/k. */
+# define BASE64_LENGTH(inlen) ((((inlen) + 2) / 3) * 4)
+
+extern bool isbase64(char ch);
+
+extern void base64_encode(const char *in, size_t inlen,
+ char *out, size_t outlen);
+
+extern size_t base64_encode_alloc(const char *in, size_t inlen, char **out);
+
+extern bool base64_decode(const char *in, size_t inlen,
+ char *out, size_t *outlen);
+
+extern bool base64_decode_alloc(const char *in, size_t inlen,
+ char **out, size_t *outlen);
+
+#ifdef __cplusplus
+}
+#endif
+
+#endif /* BASE64_H */
diff --git a/rocketmq-cpp/libs/signature/include/hmac.h b/rocketmq-cpp/libs/signature/include/hmac.h
new file mode 100755
index 00000000..9ddd6213
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/include/hmac.h
@@ -0,0 +1,55 @@
+
+#ifndef _HMAC_HMAC_H
+#define _HMAC_HMAC_H
+
+#ifdef __cplusplus
+extern "C" {
+#endif
+
+#include <sys/types.h>
+
+#ifndef SHA1_DIGEST_LEN
+#define SHA1_DIGEST_LEN 20
+#endif
+
+#ifndef SHA256_DIGEST_LEN
+#define SHA256_DIGEST_LEN 32
+#endif
+
+#ifndef SHA512_DIGEST_LEN
+#define SHA512_DIGEST_LEN 64
+#endif
+
+/*
+ * hmac_sha1:
+ * hmac_sha256:
+ * hmac_sha512:
+ * Calculate Hashed Message Authentication Code with sha1/256/512 algorithm
+ * Caution: ret_buf should provide enough space for HMAC result.
+ *
+ * @key [in]: the secure-key string
+ * @key_len [in]: the length of secure-key
+ * @data [in]: data string could be calculated.
+ * @data_len [in]: the length of data. length is needed because strlen could not take effect.
+ * @ret_buf [out]: HMAC result stored in ret_buf.
+ */
+
+#ifdef __cplusplus
+namespace metaqSignature{
+
+#endif
+
+extern int hmac_sha1(const void *key, size_t key_len, const void *data, size_t data_len, void *ret_buf);
+extern int hmac_sha256(const void *key, size_t key_len, const void *data, size_t data_len, void *ret_buf);
+extern int hmac_sha512(const void *key, size_t key_len, const void *data, size_t data_len, void *ret_buf);
+
+#ifdef __cplusplus
+}
+#endif
+
+#ifdef __cplusplus
+}
+#endif
+
+#endif
+
diff --git a/rocketmq-cpp/libs/signature/include/param_list.h b/rocketmq-cpp/libs/signature/include/param_list.h
new file mode 100755
index 00000000..0fd4e3d9
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/include/param_list.h
@@ -0,0 +1,39 @@
+#ifndef PARAM_LIST_H
+#define PARAM_LIST_H
+
+#ifdef __cplusplus
+extern "C" {
+#endif
+
+#ifdef __cplusplus
+namespace metaqSignature{
+#endif
+
+
+typedef struct _spas_param_node {
+ char *name;
+ char *value;
+ struct _spas_param_node *pnext;
+} SPAS_PARAM_NODE;
+
+typedef struct _spas_param_list {
+ SPAS_PARAM_NODE *phead;
+ unsigned int length; /* count of nodes */
+ unsigned int size; /* total size of string presentation */
+} SPAS_PARAM_LIST;
+
+extern SPAS_PARAM_LIST * create_param_list(void);
+extern int add_param_to_list(SPAS_PARAM_LIST *list, const char *name, const char *value);
+extern void free_param_list(SPAS_PARAM_LIST *list);
+extern char * param_list_to_str(const SPAS_PARAM_LIST *list);
+
+#ifdef __cplusplus
+}
+#endif
+
+#ifdef __cplusplus
+}
+#endif
+
+#endif
+
diff --git a/rocketmq-cpp/libs/signature/include/sha1.h b/rocketmq-cpp/libs/signature/include/sha1.h
new file mode 100755
index 00000000..cfb718a3
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/include/sha1.h
@@ -0,0 +1,93 @@
+/* Declarations of functions and data types used for SHA1 sum
+ library functions.
+ Copyright (C) 2000, 2001, 2003, 2005, 2006, 2008
+ Free Software Foundation, Inc.
+
+ This program is free software; you can redistribute it and/or modify it
+ under the terms of the GNU General Public License as published by the
+ Free Software Foundation; either version 2, or (at your option) any
+ later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program; if not, write to the Free Software Foundation,
+ Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. */
+
+#ifndef SHA1_H
+# define SHA1_H 1
+
+# include <stdio.h>
+# include <stdint.h>
+
+#ifdef __cplusplus
+namespace metaqSignature {
+#endif
+
+#define SHA1_DIGEST_SIZE 20
+
+/* Structure to save state of computation between the single steps. */
+struct sha1_ctx
+{
+ uint32_t A;
+ uint32_t B;
+ uint32_t C;
+ uint32_t D;
+ uint32_t E;
+
+ uint32_t total[2];
+ uint32_t buflen;
+ uint32_t buffer[32];
+};
+
+
+/* Initialize structure containing state of computation. */
+extern void sha1_init_ctx (struct sha1_ctx *ctx);
+
+/* Starting with the result of former calls of this function (or the
+ initialization function update the context for the next LEN bytes
+ starting at BUFFER.
+ It is necessary that LEN is a multiple of 64!!! */
+extern void sha1_process_block (const void *buffer, size_t len,
+ struct sha1_ctx *ctx);
+
+/* Starting with the result of former calls of this function (or the
+ initialization function update the context for the next LEN bytes
+ starting at BUFFER.
+ It is NOT required that LEN is a multiple of 64. */
+extern void sha1_process_bytes (const void *buffer, size_t len,
+ struct sha1_ctx *ctx);
+
+/* Process the remaining bytes in the buffer and put result from CTX
+ in first 20 bytes following RESBUF. The result is always in little
+ endian byte order, so that a byte-wise output yields to the wanted
+ ASCII representation of the message digest. */
+extern void *sha1_finish_ctx (struct sha1_ctx *ctx, void *resbuf);
+
+
+/* Put result from CTX in first 20 bytes following RESBUF. The result is
+ always in little endian byte order, so that a byte-wise output yields
+ to the wanted ASCII representation of the message digest. */
+extern void *sha1_read_ctx (const struct sha1_ctx *ctx, void *resbuf);
+
+
+/* Compute SHA1 message digest for bytes read from STREAM. The
+ resulting message digest number will be written into the 20 bytes
+ beginning at RESBLOCK. */
+extern int sha1_stream (FILE *stream, void *resblock);
+
+
+/* Compute SHA1 message digest for LEN bytes beginning at BUFFER. The
+ result is always in little endian byte order, so that a byte-wise
+ output yields to the wanted ASCII representation of the message
+ digest. */
+extern void *sha1_buffer (const char *buffer, size_t len, void *resblock);
+
+#ifdef __cplusplus
+}
+#endif
+
+#endif
diff --git a/rocketmq-cpp/libs/signature/include/sha256.h b/rocketmq-cpp/libs/signature/include/sha256.h
new file mode 100755
index 00000000..1756e84e
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/include/sha256.h
@@ -0,0 +1,91 @@
+/* Declarations of functions and data types used for SHA256 and SHA224 sum
+ library functions.
+ Copyright (C) 2005, 2006, 2008 Free Software Foundation, Inc.
+
+ This program is free software: you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation, either version 3 of the License, or
+ (at your option) any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program. If not, see <http://www.gnu.org/licenses/>. */
+
+#ifndef SHA256_H
+# define SHA256_H 1
+
+# include <stdio.h>
+# include <stdint.h>
+
+#ifdef __cplusplus
+namespace metaqSignature{
+#endif
+
+/* Structure to save state of computation between the single steps. */
+struct sha256_ctx
+{
+ uint32_t state[8];
+
+ uint32_t total[2];
+ size_t buflen;
+ uint32_t buffer[32];
+};
+
+enum { SHA224_DIGEST_SIZE = 28 };
+enum { SHA256_DIGEST_SIZE = 32 };
+
+/* Initialize structure containing state of computation. */
+extern void sha256_init_ctx (struct sha256_ctx *ctx);
+extern void sha224_init_ctx (struct sha256_ctx *ctx);
+
+/* Starting with the result of former calls of this function (or the
+ initialization function update the context for the next LEN bytes
+ starting at BUFFER.
+ It is necessary that LEN is a multiple of 64!!! */
+extern void sha256_process_block (const void *buffer, size_t len,
+ struct sha256_ctx *ctx);
+
+/* Starting with the result of former calls of this function (or the
+ initialization function update the context for the next LEN bytes
+ starting at BUFFER.
+ It is NOT required that LEN is a multiple of 64. */
+extern void sha256_process_bytes (const void *buffer, size_t len,
+ struct sha256_ctx *ctx);
+
+/* Process the remaining bytes in the buffer and put result from CTX
+ in first 32 (28) bytes following RESBUF. The result is always in little
+ endian byte order, so that a byte-wise output yields to the wanted
+ ASCII representation of the message digest. */
+extern void *sha256_finish_ctx (struct sha256_ctx *ctx, void *resbuf);
+extern void *sha224_finish_ctx (struct sha256_ctx *ctx, void *resbuf);
+
+
+/* Put result from CTX in first 32 (28) bytes following RESBUF. The result is
+ always in little endian byte order, so that a byte-wise output yields
+ to the wanted ASCII representation of the message digest. */
+extern void *sha256_read_ctx (const struct sha256_ctx *ctx, void *resbuf);
+extern void *sha224_read_ctx (const struct sha256_ctx *ctx, void *resbuf);
+
+
+/* Compute SHA256 (SHA224) message digest for bytes read from STREAM. The
+ resulting message digest number will be written into the 32 (28) bytes
+ beginning at RESBLOCK. */
+extern int sha256_stream (FILE *stream, void *resblock);
+extern int sha224_stream (FILE *stream, void *resblock);
+
+/* Compute SHA256 (SHA224) message digest for LEN bytes beginning at BUFFER. The
+ result is always in little endian byte order, so that a byte-wise
+ output yields to the wanted ASCII representation of the message
+ digest. */
+extern void *sha256_buffer (const char *buffer, size_t len, void *resblock);
+extern void *sha224_buffer (const char *buffer, size_t len, void *resblock);
+
+#ifdef __cplusplus
+}
+#endif
+
+#endif
diff --git a/rocketmq-cpp/libs/signature/include/sha512.h b/rocketmq-cpp/libs/signature/include/sha512.h
new file mode 100755
index 00000000..0b3b5e72
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/include/sha512.h
@@ -0,0 +1,95 @@
+/* Declarations of functions and data types used for SHA512 and SHA384 sum
+ library functions.
+ Copyright (C) 2005, 2006, 2008 Free Software Foundation, Inc.
+
+ This program is free software: you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation, either version 3 of the License, or
+ (at your option) any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program. If not, see <http://www.gnu.org/licenses/>. */
+
+#ifndef SHA512_H
+# define SHA512_H 1
+
+# include <stdio.h>
+
+# include "u64.h"
+
+#ifdef __cplusplus
+namespace metaqSignature{
+#endif
+
+/* Structure to save state of computation between the single steps. */
+struct sha512_ctx
+{
+ u64 state[8];
+
+ u64 total[2];
+ size_t buflen;
+ u64 buffer[32];
+};
+
+enum { SHA384_DIGEST_SIZE = 48 };
+enum { SHA512_DIGEST_SIZE = 64 };
+
+/* Initialize structure containing state of computation. */
+extern void sha512_init_ctx (struct sha512_ctx *ctx);
+extern void sha384_init_ctx (struct sha512_ctx *ctx);
+
+/* Starting with the result of former calls of this function (or the
+ initialization function update the context for the next LEN bytes
+ starting at BUFFER.
+ It is necessary that LEN is a multiple of 128!!! */
+extern void sha512_process_block (const void *buffer, size_t len,
+ struct sha512_ctx *ctx);
+
+/* Starting with the result of former calls of this function (or the
+ initialization function update the context for the next LEN bytes
+ starting at BUFFER.
+ It is NOT required that LEN is a multiple of 128. */
+extern void sha512_process_bytes (const void *buffer, size_t len,
+ struct sha512_ctx *ctx);
+
+/* Process the remaining bytes in the buffer and put result from CTX
+ in first 64 (48) bytes following RESBUF. The result is always in little
+ endian byte order, so that a byte-wise output yields to the wanted
+ ASCII representation of the message digest. */
+extern void *sha512_finish_ctx (struct sha512_ctx *ctx, void *resbuf);
+extern void *sha384_finish_ctx (struct sha512_ctx *ctx, void *resbuf);
+
+
+/* Put result from CTX in first 64 (48) bytes following RESBUF. The result is
+ always in little endian byte order, so that a byte-wise output yields
+ to the wanted ASCII representation of the message digest.
+
+ IMPORTANT: On some systems it is required that RESBUF is correctly
+ aligned for a 32 bits value. */
+extern void *sha512_read_ctx (const struct sha512_ctx *ctx, void *resbuf);
+extern void *sha384_read_ctx (const struct sha512_ctx *ctx, void *resbuf);
+
+
+/* Compute SHA512 (SHA384) message digest for bytes read from STREAM. The
+ resulting message digest number will be written into the 64 (48) bytes
+ beginning at RESBLOCK. */
+extern int sha512_stream (FILE *stream, void *resblock);
+extern int sha384_stream (FILE *stream, void *resblock);
+
+/* Compute SHA512 (SHA384) message digest for LEN bytes beginning at BUFFER. The
+ result is always in little endian byte order, so that a byte-wise
+ output yields to the wanted ASCII representation of the message
+ digest. */
+extern void *sha512_buffer (const char *buffer, size_t len, void *resblock);
+extern void *sha384_buffer (const char *buffer, size_t len, void *resblock);
+
+#ifdef __cplusplus
+}
+#endif
+
+#endif
diff --git a/rocketmq-cpp/libs/signature/include/spas_client.h b/rocketmq-cpp/libs/signature/include/spas_client.h
new file mode 100755
index 00000000..b8fa02cd
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/include/spas_client.h
@@ -0,0 +1,85 @@
+#ifndef SPAS_CLIENT_H
+#define SPAS_CLIENT_H
+
+#include "param_list.h"
+
+#ifdef __cplusplus
+extern "C" {
+#endif
+
+#ifdef __cplusplus
+ namespace metaqSignature {
+#endif
+
+#define SPAS_MAX_KEY_LEN 128 /* max access_key/secret_key length */
+#define SPAS_MAX_PATH 256 /* max credential file path length */
+#define SPAS_ACCESS_KEY_TAG "accessKey" /* access_key tag in credential file */
+#define SPAS_SECRET_KEY_TAG "secretKey" /* secret_key tag in credential file */
+#define SPAS_CREDENTIAL_ENV "SPAS_CREDENTIAL" /* credential file environment variable */
+
+
+ typedef enum {
+ SIGN_HMACSHA1 = 0, /* HmacSHA1 */
+ SIGN_HMACSHA256 = 1, /* HmacSHA256 */
+ } SPAS_SIGN_ALGORITHM;
+
+ typedef enum {
+ NO_UPDATE = 0, /* do not update credential */
+ UPDATE_BY_ALARM = 1, /* update credential by SIGALRM */
+#ifdef SPAS_MT
+ UPDATE_BY_THREAD = 2, /* update credential by standalone thread */
+#endif
+ } CREDENTIAL_UPDATE_MODE;
+
+ typedef enum {
+ NO_ERROR = 0, /* success */
+ ERROR_INVALID_PARAM = -1, /* invalid parameter */
+ ERROR_NO_CREDENTIAL = -2, /* credential file not specified */
+ ERROR_FILE_OPEN = -3, /* file open failed */
+ ERROR_MEM_ALLOC = -4, /* memory allocation failed */
+ ERROR_MISSING_KEY = -5, /* missing access_key/secret_key */
+ ERROR_KEY_LENGTH = -6, /* key length exceed limit */
+ ERROR_UPDATE_CREDENTIAL = -7, /* update credential file failed */
+
+ } SPAS_ERROR_CODE;
+
+ typedef struct _spas_credential {
+ char access_key[SPAS_MAX_KEY_LEN];
+ char secret_key[SPAS_MAX_KEY_LEN];
+ } SPAS_CREDENTIAL;
+
+
+ extern int spas_load_credential(char *path, CREDENTIAL_UPDATE_MODE mode);
+ extern int spas_set_access_key(char *key);
+ extern int spas_set_secret_key(char *key);
+ extern char * spas_get_access_key(void);
+ extern char * spas_get_secret_key(void);
+ extern SPAS_CREDENTIAL * spas_get_credential(void);
+
+#ifdef SPAS_MT
+
+ extern int spas_load_thread_credential(char *path);
+ extern int spas_set_thread_access_key(char *key);
+ extern int spas_set_thread_secret_key(char *key);
+ extern char * spas_get_thread_access_key(void);
+ extern char * spas_get_thread_secret_key(void);
+
+#endif
+
+ extern char * spas_get_signature(const SPAS_PARAM_LIST *list, const char *key);
+ extern char * spas_get_signature2(const SPAS_PARAM_LIST *list, const char *key, SPAS_SIGN_ALGORITHM algorithm);
+ extern char * spas_sign(const char *data, size_t size, const char *key);
+ extern char * spas_sign2(const char *data, size_t size, const char *key, SPAS_SIGN_ALGORITHM algorithm);
+ extern void spas_mem_free(char *pSignature);
+ extern char * spas_get_version(void);
+
+#ifdef __cplusplus
+ }
+#endif
+
+#ifdef __cplusplus
+}
+#endif
+
+#endif
+
diff --git a/rocketmq-cpp/libs/signature/include/u64.h b/rocketmq-cpp/libs/signature/include/u64.h
new file mode 100644
index 00000000..34fd32be
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/include/u64.h
@@ -0,0 +1,159 @@
+/* uint64_t-like operations that work even on hosts lacking uint64_t
+
+ Copyright (C) 2006 Free Software Foundation, Inc.
+
+ This program is free software: you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation, either version 3 of the License, or
+ (at your option) any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program. If not, see <http://www.gnu.org/licenses/>. */
+
+/* Written by Paul Eggert. */
+
+#include <stddef.h>
+#include <stdint.h>
+
+/* Return X rotated left by N bits, where 0 < N < 64. */
+#define u64rol(x, n) u64or (u64shl (x, n), u64shr (x, 64 - n))
+
+#ifdef UINT64_MAX
+
+/* Native implementations are trivial. See below for comments on what
+ these operations do. */
+typedef uint64_t u64;
+# define u64hilo(hi, lo) ((u64) (((u64) (hi) << 32) + (lo)))
+# define u64init(hi, lo) u64hilo (hi, lo)
+# define u64lo(x) ((u64) (x))
+# define u64lt(x, y) ((x) < (y))
+# define u64and(x, y) ((x) & (y))
+# define u64or(x, y) ((x) | (y))
+# define u64xor(x, y) ((x) ^ (y))
+# define u64plus(x, y) ((x) + (y))
+# define u64shl(x, n) ((x) << (n))
+# define u64shr(x, n) ((x) >> (n))
+
+#else
+
+/* u64 is a 64-bit unsigned integer value.
+ u64init (HI, LO), is like u64hilo (HI, LO), but for use in
+ initializer contexts. */
+# ifdef WORDS_BIGENDIAN
+typedef struct { uint32_t hi, lo; } u64;
+# define u64init(hi, lo) { hi, lo }
+# else
+typedef struct { uint32_t lo, hi; } u64;
+# define u64init(hi, lo) { lo, hi }
+# endif
+
+/* Given the high and low-order 32-bit quantities HI and LO, return a u64
+ value representing (HI << 32) + LO. */
+static inline u64
+u64hilo (uint32_t hi, uint32_t lo)
+{
+ u64 r;
+ r.hi = hi;
+ r.lo = lo;
+ return r;
+}
+
+/* Return a u64 value representing LO. */
+static inline u64
+u64lo (uint32_t lo)
+{
+ u64 r;
+ r.hi = 0;
+ r.lo = lo;
+ return r;
+}
+
+/* Return X < Y. */
+static inline int
+u64lt (u64 x, u64 y)
+{
+ return x.hi < y.hi || (x.hi == y.hi && x.lo < y.lo);
+}
+
+/* Return X & Y. */
+static inline u64
+u64and (u64 x, u64 y)
+{
+ u64 r;
+ r.hi = x.hi & y.hi;
+ r.lo = x.lo & y.lo;
+ return r;
+}
+
+/* Return X | Y. */
+static inline u64
+u64or (u64 x, u64 y)
+{
+ u64 r;
+ r.hi = x.hi | y.hi;
+ r.lo = x.lo | y.lo;
+ return r;
+}
+
+/* Return X ^ Y. */
+static inline u64
+u64xor (u64 x, u64 y)
+{
+ u64 r;
+ r.hi = x.hi ^ y.hi;
+ r.lo = x.lo ^ y.lo;
+ return r;
+}
+
+/* Return X + Y. */
+static inline u64
+u64plus (u64 x, u64 y)
+{
+ u64 r;
+ r.lo = x.lo + y.lo;
+ r.hi = x.hi + y.hi + (r.lo < x.lo);
+ return r;
+}
+
+/* Return X << N. */
+static inline u64
+u64shl (u64 x, int n)
+{
+ u64 r;
+ if (n < 32)
+ {
+ r.hi = (x.hi << n) | (x.lo >> (32 - n));
+ r.lo = x.lo << n;
+ }
+ else
+ {
+ r.hi = x.lo << (n - 32);
+ r.lo = 0;
+ }
+ return r;
+}
+
+/* Return X >> N. */
+static inline u64
+u64shr (u64 x, int n)
+{
+ u64 r;
+ if (n < 32)
+ {
+ r.hi = x.hi >> n;
+ r.lo = (x.hi << (32 - n)) | (x.lo >> n);
+ }
+ else
+ {
+ r.hi = 0;
+ r.lo = x.hi >> (n - 32);
+ }
+ return r;
+}
+
+#endif
diff --git a/rocketmq-cpp/libs/signature/lib/.gitkeep b/rocketmq-cpp/libs/signature/lib/.gitkeep
new file mode 100644
index 00000000..533bd5f6
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/lib/.gitkeep
@@ -0,0 +1 @@
+#keep
diff --git a/rocketmq-cpp/libs/signature/msvc13/Metaqsignature.sln b/rocketmq-cpp/libs/signature/msvc13/Metaqsignature.sln
new file mode 100755
index 00000000..ea15e8e3
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/msvc13/Metaqsignature.sln
@@ -0,0 +1,22 @@
+
+Microsoft Visual Studio Solution File, Format Version 12.00
+# Visual Studio 2013
+VisualStudioVersion = 12.0.21005.1
+MinimumVisualStudioVersion = 10.0.40219.1
+Project("{8BC9CEB8-8B4A-11D0-8D11-00A0C91BC942}") = "Metaqsignature", "Metaqsignature.vcxproj", "{F93E745C-232C-46A0-8D4B-91D3A53EE699}"
+EndProject
+Global
+ GlobalSection(SolutionConfigurationPlatforms) = preSolution
+ Debug|Win32 = Debug|Win32
+ Release|Win32 = Release|Win32
+ EndGlobalSection
+ GlobalSection(ProjectConfigurationPlatforms) = postSolution
+ {F93E745C-232C-46A0-8D4B-91D3A53EE699}.Debug|Win32.ActiveCfg = Debug|Win32
+ {F93E745C-232C-46A0-8D4B-91D3A53EE699}.Debug|Win32.Build.0 = Debug|Win32
+ {F93E745C-232C-46A0-8D4B-91D3A53EE699}.Release|Win32.ActiveCfg = Release|Win32
+ {F93E745C-232C-46A0-8D4B-91D3A53EE699}.Release|Win32.Build.0 = Release|Win32
+ EndGlobalSection
+ GlobalSection(SolutionProperties) = preSolution
+ HideSolutionNode = FALSE
+ EndGlobalSection
+EndGlobal
diff --git a/rocketmq-cpp/libs/signature/msvc13/Metaqsignature.vcxproj b/rocketmq-cpp/libs/signature/msvc13/Metaqsignature.vcxproj
new file mode 100755
index 00000000..4cba9346
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/msvc13/Metaqsignature.vcxproj
@@ -0,0 +1,168 @@
+<?xml version="1.0" encoding="utf-8"?>
+<Project DefaultTargets="Build" ToolsVersion="14.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
+ <ItemGroup Label="ProjectConfigurations">
+ <ProjectConfiguration Include="Debug|Win32">
+ <Configuration>Debug</Configuration>
+ <Platform>Win32</Platform>
+ </ProjectConfiguration>
+ <ProjectConfiguration Include="Debug|x64">
+ <Configuration>Debug</Configuration>
+ <Platform>x64</Platform>
+ </ProjectConfiguration>
+ <ProjectConfiguration Include="Release|Win32">
+ <Configuration>Release</Configuration>
+ <Platform>Win32</Platform>
+ </ProjectConfiguration>
+ <ProjectConfiguration Include="Release|x64">
+ <Configuration>Release</Configuration>
+ <Platform>x64</Platform>
+ </ProjectConfiguration>
+ </ItemGroup>
+ <PropertyGroup Label="Globals">
+ <ProjectGuid>{F93E745C-232C-46A0-8D4B-91D3A53EE699}</ProjectGuid>
+ <Keyword>Win32Proj</Keyword>
+ <ProjectName>Metaqsignature</ProjectName>
+ </PropertyGroup>
+ <Import Project="$(VCTargetsPath)\Microsoft.Cpp.Default.props" />
+ <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Debug|Win32'" Label="Configuration">
+ <ConfigurationType>StaticLibrary</ConfigurationType>
+ <UseDebugLibraries>true</UseDebugLibraries>
+ <PlatformToolset>v140</PlatformToolset>
+ </PropertyGroup>
+ <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Debug|x64'" Label="Configuration">
+ <ConfigurationType>StaticLibrary</ConfigurationType>
+ <UseDebugLibraries>true</UseDebugLibraries>
+ <PlatformToolset>v140</PlatformToolset>
+ </PropertyGroup>
+ <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Release|Win32'" Label="Configuration">
+ <ConfigurationType>StaticLibrary</ConfigurationType>
+ <UseDebugLibraries>false</UseDebugLibraries>
+ <PlatformToolset>v140_xp</PlatformToolset>
+ </PropertyGroup>
+ <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Release|x64'" Label="Configuration">
+ <ConfigurationType>StaticLibrary</ConfigurationType>
+ <UseDebugLibraries>false</UseDebugLibraries>
+ <PlatformToolset>v140_xp</PlatformToolset>
+ </PropertyGroup>
+ <Import Project="$(VCTargetsPath)\Microsoft.Cpp.props" />
+ <ImportGroup Label="ExtensionSettings">
+ </ImportGroup>
+ <ImportGroup Label="PropertySheets" Condition="'$(Configuration)|$(Platform)'=='Debug|Win32'">
+ <Import Project="$(UserRootDir)\Microsoft.Cpp.$(Platform).user.props" Condition="exists('$(UserRootDir)\Microsoft.Cpp.$(Platform).user.props')" Label="LocalAppDataPlatform" />
+ </ImportGroup>
+ <ImportGroup Condition="'$(Configuration)|$(Platform)'=='Debug|x64'" Label="PropertySheets">
+ <Import Project="$(UserRootDir)\Microsoft.Cpp.$(Platform).user.props" Condition="exists('$(UserRootDir)\Microsoft.Cpp.$(Platform).user.props')" Label="LocalAppDataPlatform" />
+ </ImportGroup>
+ <ImportGroup Label="PropertySheets" Condition="'$(Configuration)|$(Platform)'=='Release|Win32'">
+ <Import Project="$(UserRootDir)\Microsoft.Cpp.$(Platform).user.props" Condition="exists('$(UserRootDir)\Microsoft.Cpp.$(Platform).user.props')" Label="LocalAppDataPlatform" />
+ </ImportGroup>
+ <ImportGroup Condition="'$(Configuration)|$(Platform)'=='Release|x64'" Label="PropertySheets">
+ <Import Project="$(UserRootDir)\Microsoft.Cpp.$(Platform).user.props" Condition="exists('$(UserRootDir)\Microsoft.Cpp.$(Platform).user.props')" Label="LocalAppDataPlatform" />
+ </ImportGroup>
+ <PropertyGroup Label="UserMacros" />
+ <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Debug|Win32'">
+ <LinkIncremental>true</LinkIncremental>
+ <OutDir>..\lib</OutDir>
+ <IntDir>..\tmp</IntDir>
+ <TargetName>$(ProjectName)_d</TargetName>
+ <IncludePath>Z:\win\rocketmq-client4cpp\libs\signature\include;$(IncludePath)</IncludePath>
+ </PropertyGroup>
+ <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Debug|x64'">
+ <TargetName>$(ProjectName)_d</TargetName>
+ <IncludePath>Z:\win\rocketmq-client4cpp\libs\signature\include;$(IncludePath)</IncludePath>
+ <LinkIncremental>true</LinkIncremental>
+ <OutDir>..\lib</OutDir>
+ </PropertyGroup>
+ <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Release|Win32'">
+ <LinkIncremental>true</LinkIncremental>
+ <OutDir>..\lib\</OutDir>
+ <IntDir>..\tmp</IntDir>
+ <TargetName>$(ProjectName)_d</TargetName>
+ </PropertyGroup>
+ <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Release|x64'">
+ <TargetName>$(ProjectName)_d</TargetName>
+ <LinkIncremental>true</LinkIncremental>
+ <OutDir>..\lib</OutDir>
+ <LibraryPath>C:\Program Files (x86)\Windows Kits\10\Lib\10.0.10150.0\ucrt\;$(LibraryPath)</LibraryPath>
+ </PropertyGroup>
+ <ItemDefinitionGroup Condition="'$(Configuration)|$(Platform)'=='Debug|Win32'">
+ <ClCompile>
+ <PreprocessorDefinitions>WIN32;_DEBUG;_LIB;%(PreprocessorDefinitions)</PreprocessorDefinitions>
+ <RuntimeLibrary>MultiThreadedDebugDLL</RuntimeLibrary>
+ <WarningLevel>Level3</WarningLevel>
+ <DebugInformationFormat>ProgramDatabase</DebugInformationFormat>
+ <Optimization>Disabled</Optimization>
+ </ClCompile>
+ <Link>
+ <TargetMachine>MachineX86</TargetMachine>
+ <GenerateDebugInformation>true</GenerateDebugInformation>
+ <SubSystem>Windows</SubSystem>
+ </Link>
+ </ItemDefinitionGroup>
+ <ItemDefinitionGroup Condition="'$(Configuration)|$(Platform)'=='Debug|x64'">
+ <ClCompile>
+ <PreprocessorDefinitions>WIN32;_DEBUG;_LIB;%(PreprocessorDefinitions)</PreprocessorDefinitions>
+ <RuntimeLibrary>MultiThreadedDebugDLL</RuntimeLibrary>
+ <WarningLevel>Level3</WarningLevel>
+ <DebugInformationFormat>ProgramDatabase</DebugInformationFormat>
+ <Optimization>Disabled</Optimization>
+ </ClCompile>
+ <Link>
+ <GenerateDebugInformation>true</GenerateDebugInformation>
+ <SubSystem>Windows</SubSystem>
+ </Link>
+ </ItemDefinitionGroup>
+ <ItemDefinitionGroup Condition="'$(Configuration)|$(Platform)'=='Release|Win32'">
+ <ClCompile>
+ <PreprocessorDefinitions>WIN32;NDEBUG;_LIB;%(PreprocessorDefinitions)</PreprocessorDefinitions>
+ <RuntimeLibrary>MultiThreadedDLL</RuntimeLibrary>
+ <WarningLevel>Level3</WarningLevel>
+ <DebugInformationFormat>ProgramDatabase</DebugInformationFormat>
+ <AdditionalIncludeDirectories>..\include;%(AdditionalIncludeDirectories)</AdditionalIncludeDirectories>
+ </ClCompile>
+ <Link>
+ <TargetMachine>MachineX86</TargetMachine>
+ <GenerateDebugInformation>true</GenerateDebugInformation>
+ <SubSystem>Windows</SubSystem>
+ <EnableCOMDATFolding>true</EnableCOMDATFolding>
+ <OptimizeReferences>true</OptimizeReferences>
+ </Link>
+ </ItemDefinitionGroup>
+ <ItemDefinitionGroup Condition="'$(Configuration)|$(Platform)'=='Release|x64'">
+ <ClCompile>
+ <PreprocessorDefinitions>WIN32;NDEBUG;_LIB;%(PreprocessorDefinitions)</PreprocessorDefinitions>
+ <RuntimeLibrary>MultiThreadedDLL</RuntimeLibrary>
+ <WarningLevel>Level3</WarningLevel>
+ <DebugInformationFormat>ProgramDatabase</DebugInformationFormat>
+ <AdditionalIncludeDirectories>..\include;C:\Program Files (x86)\Windows Kits\10\Include\10.0.10150.0\ucrt;%(AdditionalIncludeDirectories)</AdditionalIncludeDirectories>
+ </ClCompile>
+ <Link>
+ <GenerateDebugInformation>true</GenerateDebugInformation>
+ <SubSystem>Windows</SubSystem>
+ <EnableCOMDATFolding>true</EnableCOMDATFolding>
+ <OptimizeReferences>true</OptimizeReferences>
+ </Link>
+ </ItemDefinitionGroup>
+ <ItemGroup>
+ <ClCompile Include="..\src\base64.c" />
+ <ClCompile Include="..\src\hmac.c" />
+ <ClCompile Include="..\src\param_list.c" />
+ <ClCompile Include="..\src\sha1.c" />
+ <ClCompile Include="..\src\sha256.c" />
+ <ClCompile Include="..\src\sha512.c" />
+ <ClCompile Include="..\src\spas_client.c" />
+ </ItemGroup>
+ <ItemGroup>
+ <ClInclude Include="..\include\base64.h" />
+ <ClInclude Include="..\include\hmac.h" />
+ <ClInclude Include="..\include\param_list.h" />
+ <ClInclude Include="..\include\sha1.h" />
+ <ClInclude Include="..\include\sha256.h" />
+ <ClInclude Include="..\include\sha512.h" />
+ <ClInclude Include="..\include\spas_client.h" />
+ <ClInclude Include="..\include\u64.h" />
+ </ItemGroup>
+ <Import Project="$(VCTargetsPath)\Microsoft.Cpp.targets" />
+ <ImportGroup Label="ExtensionTargets">
+ </ImportGroup>
+</Project>
\ No newline at end of file
diff --git a/rocketmq-cpp/libs/signature/msvc13/Metaqsignature.vcxproj.filters b/rocketmq-cpp/libs/signature/msvc13/Metaqsignature.vcxproj.filters
new file mode 100755
index 00000000..92c3147b
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/msvc13/Metaqsignature.vcxproj.filters
@@ -0,0 +1,66 @@
+<?xml version="1.0" encoding="utf-8"?>
+<Project ToolsVersion="4.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
+ <ItemGroup>
+ <Filter Include="Source Files">
+ <UniqueIdentifier>{4FC737F1-C7A5-4376-A066-2A32D752A2FF}</UniqueIdentifier>
+ <Extensions>cpp;c;cc;cxx;def;odl;idl;hpj;bat;asm;asmx</Extensions>
+ </Filter>
+ <Filter Include="Header Files">
+ <UniqueIdentifier>{93995380-89BD-4b04-88EB-625FBE52EBFB}</UniqueIdentifier>
+ <Extensions>h;hh;hpp;hxx;hm;inl;inc;xsd</Extensions>
+ </Filter>
+ <Filter Include="Resource Files">
+ <UniqueIdentifier>{67DA6AB6-F800-4c08-8B7A-83BB121AAD01}</UniqueIdentifier>
+ <Extensions>rc;ico;cur;bmp;dlg;rc2;rct;bin;rgs;gif;jpg;jpeg;jpe;resx;tiff;tif;png;wav</Extensions>
+ </Filter>
+ </ItemGroup>
+ <ItemGroup>
+ <ClCompile Include="..\src\sha256.c">
+ <Filter>Source Files</Filter>
+ </ClCompile>
+ <ClCompile Include="..\src\param_list.c">
+ <Filter>Source Files</Filter>
+ </ClCompile>
+ <ClCompile Include="..\src\base64.c">
+ <Filter>Source Files</Filter>
+ </ClCompile>
+ <ClCompile Include="..\src\spas_client.c">
+ <Filter>Source Files</Filter>
+ </ClCompile>
+ <ClCompile Include="..\src\sha512.c">
+ <Filter>Source Files</Filter>
+ </ClCompile>
+ <ClCompile Include="..\src\sha1.c">
+ <Filter>Source Files</Filter>
+ </ClCompile>
+ <ClCompile Include="..\src\hmac.c">
+ <Filter>Source Files</Filter>
+ </ClCompile>
+ </ItemGroup>
+ <ItemGroup>
+ <ClInclude Include="..\include\sha256.h">
+ <Filter>Header Files</Filter>
+ </ClInclude>
+ <ClInclude Include="..\include\sha512.h">
+ <Filter>Header Files</Filter>
+ </ClInclude>
+ <ClInclude Include="..\include\u64.h">
+ <Filter>Header Files</Filter>
+ </ClInclude>
+ <ClInclude Include="..\include\hmac.h">
+ <Filter>Header Files</Filter>
+ </ClInclude>
+ <ClInclude Include="..\include\param_list.h">
+ <Filter>Header Files</Filter>
+ </ClInclude>
+ <ClInclude Include="..\include\sha1.h">
+ <Filter>Header Files</Filter>
+ </ClInclude>
+ <ClInclude Include="..\include\base64.h">
+ <Filter>Header Files</Filter>
+ </ClInclude>
+ <ClInclude Include="..\include\spas_client.h">
+ <Filter>Header Files</Filter>
+ </ClInclude>
+ </ItemGroup>
+</Project>
\ No newline at end of file
diff --git a/rocketmq-cpp/libs/signature/src/base64.c b/rocketmq-cpp/libs/signature/src/base64.c
new file mode 100755
index 00000000..df18c81c
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/src/base64.c
@@ -0,0 +1,437 @@
+/* -*- buffer-read-only: t -*- vi: set ro: */
+/* DO NOT EDIT! GENERATED AUTOMATICALLY! */
+/* base64.c -- Encode binary data using printable characters.
+ Copyright (C) 1999, 2000, 2001, 2004, 2005, 2006 Free Software
+ Foundation, Inc.
+
+ This program is free software; you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation; either version 2, or (at your option)
+ any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program; if not, write to the Free Software Foundation,
+ Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. */
+
+/* Written by Simon Josefsson. Partially adapted from GNU MailUtils
+ * (mailbox/filter_trans.c, as of 2004-11-28). Improved by review
+ * from Paul Eggert, Bruno Haible, and Stepan Kasal.
+ *
+ * See also RFC 3548 <http://www.ietf.org/rfc/rfc3548.txt>.
+ *
+ * Be careful with error checking. Here is how you would typically
+ * use these functions:
+ *
+ * bool ok = base64_decode_alloc (in, inlen, &out, &outlen);
+ * if (!ok)
+ * FAIL: input was not valid base64
+ * if (out == NULL)
+ * FAIL: memory allocation error
+ * OK: data in OUT/OUTLEN
+ *
+ * size_t outlen = base64_encode_alloc (in, inlen, &out);
+ * if (out == NULL && outlen == 0 && inlen != 0)
+ * FAIL: input too long
+ * if (out == NULL)
+ * FAIL: memory allocation error
+ * OK: data in OUT/OUTLEN.
+ *
+ */
+
+/* Get prototype. */
+#include "base64.h"
+
+/* Get malloc. */
+#include <stdlib.h>
+
+/* Get UCHAR_MAX. */
+#include <limits.h>
+
+#ifdef __cplusplus
+namespace metaqSignature{
+#endif
+
+/* C89 compliant way to cast 'char' to 'unsigned char'. */
+#ifdef WIN32
+static _inline unsigned char
+#else
+static inline unsigned char
+#endif
+to_uchar (char ch)
+{
+ return ch;
+}
+
+/* Base64 encode IN array of size INLEN into OUT array of size OUTLEN.
+ If OUTLEN is less than BASE64_LENGTH(INLEN), write as many bytes as
+ possible. If OUTLEN is larger than BASE64_LENGTH(INLEN), also zero
+ terminate the output buffer. */
+void
+base64_encode (const char *in, size_t inlen,
+ char *out, size_t outlen)
+{
+ static const char b64str[65] =
+ "ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789+/";
+
+ while (inlen && outlen)
+ {
+ *out++ = b64str[(to_uchar (in[0]) >> 2) & 0x3f];
+ if (!--outlen)
+ break;
+ *out++ = b64str[((to_uchar (in[0]) << 4)
+ + (--inlen ? to_uchar (in[1]) >> 4 : 0))
+ & 0x3f];
+ if (!--outlen)
+ break;
+ *out++ =
+ (inlen
+ ? b64str[((to_uchar (in[1]) << 2)
+ + (--inlen ? to_uchar (in[2]) >> 6 : 0))
+ & 0x3f]
+ : '=');
+ if (!--outlen)
+ break;
+ *out++ = inlen ? b64str[to_uchar (in[2]) & 0x3f] : '=';
+ if (!--outlen)
+ break;
+ if (inlen)
+ inlen--;
+ if (inlen)
+ in += 3;
+ }
+
+ if (outlen)
+ *out = '\0';
+}
+
+/* Allocate a buffer and store zero terminated base64 encoded data
+ from array IN of size INLEN, returning BASE64_LENGTH(INLEN), i.e.,
+ the length of the encoded data, excluding the terminating zero. On
+ return, the OUT variable will hold a pointer to newly allocated
+ memory that must be deallocated by the caller. If output string
+ length would overflow, 0 is returned and OUT is set to NULL. If
+ memory allocation failed, OUT is set to NULL, and the return value
+ indicates length of the requested memory block, i.e.,
+ BASE64_LENGTH(inlen) + 1. */
+size_t
+base64_encode_alloc (const char *in, size_t inlen, char **out)
+{
+ size_t outlen = 1 + BASE64_LENGTH (inlen);
+
+ /* Check for overflow in outlen computation.
+ *
+ * If there is no overflow, outlen >= inlen.
+ *
+ * If the operation (inlen + 2) overflows then it yields at most +1, so
+ * outlen is 0.
+ *
+ * If the multiplication overflows, we lose at least half of the
+ * correct value, so the result is < ((inlen + 2) / 3) * 2, which is
+ * less than (inlen + 2) * 0.66667, which is less than inlen as soon as
+ * (inlen > 4).
+ */
+ if (inlen > outlen)
+ {
+ *out = NULL;
+ return 0;
+ }
+
+ *out = (char *)malloc (outlen);
+ if (!*out)
+ return outlen;
+
+ base64_encode (in, inlen, *out, outlen);
+
+ return outlen - 1;
+}
+
+/* With this approach this file works independent of the charset used
+ (think EBCDIC). However, it does assume that the characters in the
+ Base64 alphabet (A-Za-z0-9+/) are encoded in 0..255. POSIX
+ 1003.1-2001 require that char and unsigned char are 8-bit
+ quantities, though, taking care of that problem. But this may be a
+ potential problem on non-POSIX C99 platforms.
+
+ IBM C V6 for AIX mishandles "#define B64(x) ...'x'...", so use "_"
+ as the formal parameter rather than "x". */
+#define B64(_) \
+ ((_) == 'A' ? 0 \
+ : (_) == 'B' ? 1 \
+ : (_) == 'C' ? 2 \
+ : (_) == 'D' ? 3 \
+ : (_) == 'E' ? 4 \
+ : (_) == 'F' ? 5 \
+ : (_) == 'G' ? 6 \
+ : (_) == 'H' ? 7 \
+ : (_) == 'I' ? 8 \
+ : (_) == 'J' ? 9 \
+ : (_) == 'K' ? 10 \
+ : (_) == 'L' ? 11 \
+ : (_) == 'M' ? 12 \
+ : (_) == 'N' ? 13 \
+ : (_) == 'O' ? 14 \
+ : (_) == 'P' ? 15 \
+ : (_) == 'Q' ? 16 \
+ : (_) == 'R' ? 17 \
+ : (_) == 'S' ? 18 \
+ : (_) == 'T' ? 19 \
+ : (_) == 'U' ? 20 \
+ : (_) == 'V' ? 21 \
+ : (_) == 'W' ? 22 \
+ : (_) == 'X' ? 23 \
+ : (_) == 'Y' ? 24 \
+ : (_) == 'Z' ? 25 \
+ : (_) == 'a' ? 26 \
+ : (_) == 'b' ? 27 \
+ : (_) == 'c' ? 28 \
+ : (_) == 'd' ? 29 \
+ : (_) == 'e' ? 30 \
+ : (_) == 'f' ? 31 \
+ : (_) == 'g' ? 32 \
+ : (_) == 'h' ? 33 \
+ : (_) == 'i' ? 34 \
+ : (_) == 'j' ? 35 \
+ : (_) == 'k' ? 36 \
+ : (_) == 'l' ? 37 \
+ : (_) == 'm' ? 38 \
+ : (_) == 'n' ? 39 \
+ : (_) == 'o' ? 40 \
+ : (_) == 'p' ? 41 \
+ : (_) == 'q' ? 42 \
+ : (_) == 'r' ? 43 \
+ : (_) == 's' ? 44 \
+ : (_) == 't' ? 45 \
+ : (_) == 'u' ? 46 \
+ : (_) == 'v' ? 47 \
+ : (_) == 'w' ? 48 \
+ : (_) == 'x' ? 49 \
+ : (_) == 'y' ? 50 \
+ : (_) == 'z' ? 51 \
+ : (_) == '0' ? 52 \
+ : (_) == '1' ? 53 \
+ : (_) == '2' ? 54 \
+ : (_) == '3' ? 55 \
+ : (_) == '4' ? 56 \
+ : (_) == '5' ? 57 \
+ : (_) == '6' ? 58 \
+ : (_) == '7' ? 59 \
+ : (_) == '8' ? 60 \
+ : (_) == '9' ? 61 \
+ : (_) == '+' ? 62 \
+ : (_) == '/' ? 63 \
+ : -1)
+
+static const signed char b64[0x100] = {
+ B64 (0), B64 (1), B64 (2), B64 (3),
+ B64 (4), B64 (5), B64 (6), B64 (7),
+ B64 (8), B64 (9), B64 (10), B64 (11),
+ B64 (12), B64 (13), B64 (14), B64 (15),
+ B64 (16), B64 (17), B64 (18), B64 (19),
+ B64 (20), B64 (21), B64 (22), B64 (23),
+ B64 (24), B64 (25), B64 (26), B64 (27),
+ B64 (28), B64 (29), B64 (30), B64 (31),
+ B64 (32), B64 (33), B64 (34), B64 (35),
+ B64 (36), B64 (37), B64 (38), B64 (39),
+ B64 (40), B64 (41), B64 (42), B64 (43),
+ B64 (44), B64 (45), B64 (46), B64 (47),
+ B64 (48), B64 (49), B64 (50), B64 (51),
+ B64 (52), B64 (53), B64 (54), B64 (55),
+ B64 (56), B64 (57), B64 (58), B64 (59),
+ B64 (60), B64 (61), B64 (62), B64 (63),
+ B64 (64), B64 (65), B64 (66), B64 (67),
+ B64 (68), B64 (69), B64 (70), B64 (71),
+ B64 (72), B64 (73), B64 (74), B64 (75),
+ B64 (76), B64 (77), B64 (78), B64 (79),
+ B64 (80), B64 (81), B64 (82), B64 (83),
+ B64 (84), B64 (85), B64 (86), B64 (87),
+ B64 (88), B64 (89), B64 (90), B64 (91),
+ B64 (92), B64 (93), B64 (94), B64 (95),
+ B64 (96), B64 (97), B64 (98), B64 (99),
+ B64 (100), B64 (101), B64 (102), B64 (103),
+ B64 (104), B64 (105), B64 (106), B64 (107),
+ B64 (108), B64 (109), B64 (110), B64 (111),
+ B64 (112), B64 (113), B64 (114), B64 (115),
+ B64 (116), B64 (117), B64 (118), B64 (119),
+ B64 (120), B64 (121), B64 (122), B64 (123),
+ B64 (124), B64 (125), B64 (126), B64 (127),
+ B64 (128), B64 (129), B64 (130), B64 (131),
+ B64 (132), B64 (133), B64 (134), B64 (135),
+ B64 (136), B64 (137), B64 (138), B64 (139),
+ B64 (140), B64 (141), B64 (142), B64 (143),
+ B64 (144), B64 (145), B64 (146), B64 (147),
+ B64 (148), B64 (149), B64 (150), B64 (151),
+ B64 (152), B64 (153), B64 (154), B64 (155),
+ B64 (156), B64 (157), B64 (158), B64 (159),
+ B64 (160), B64 (161), B64 (162), B64 (163),
+ B64 (164), B64 (165), B64 (166), B64 (167),
+ B64 (168), B64 (169), B64 (170), B64 (171),
+ B64 (172), B64 (173), B64 (174), B64 (175),
+ B64 (176), B64 (177), B64 (178), B64 (179),
+ B64 (180), B64 (181), B64 (182), B64 (183),
+ B64 (184), B64 (185), B64 (186), B64 (187),
+ B64 (188), B64 (189), B64 (190), B64 (191),
+ B64 (192), B64 (193), B64 (194), B64 (195),
+ B64 (196), B64 (197), B64 (198), B64 (199),
+ B64 (200), B64 (201), B64 (202), B64 (203),
+ B64 (204), B64 (205), B64 (206), B64 (207),
+ B64 (208), B64 (209), B64 (210), B64 (211),
+ B64 (212), B64 (213), B64 (214), B64 (215),
+ B64 (216), B64 (217), B64 (218), B64 (219),
+ B64 (220), B64 (221), B64 (222), B64 (223),
+ B64 (224), B64 (225), B64 (226), B64 (227),
+ B64 (228), B64 (229), B64 (230), B64 (231),
+ B64 (232), B64 (233), B64 (234), B64 (235),
+ B64 (236), B64 (237), B64 (238), B64 (239),
+ B64 (240), B64 (241), B64 (242), B64 (243),
+ B64 (244), B64 (245), B64 (246), B64 (247),
+ B64 (248), B64 (249), B64 (250), B64 (251),
+ B64 (252), B64 (253), B64 (254), B64 (255)
+};
+
+#if UCHAR_MAX == 255
+# define uchar_in_range(c) true
+#else
+# define uchar_in_range(c) ((c) <= 255)
+#endif
+
+/* Return true if CH is a character from the Base64 alphabet, and
+ false otherwise. Note that '=' is padding and not considered to be
+ part of the alphabet. */
+bool
+isbase64 (char ch)
+{
+ return uchar_in_range (to_uchar (ch)) && 0 <= b64[to_uchar (ch)];
+}
+
+/* Decode base64 encoded input array IN of length INLEN to output
+ array OUT that can hold *OUTLEN bytes. Return true if decoding was
+ successful, i.e. if the input was valid base64 data, false
+ otherwise. If *OUTLEN is too small, as many bytes as possible will
+ be written to OUT. On return, *OUTLEN holds the length of decoded
+ bytes in OUT. Note that as soon as any non-alphabet characters are
+ encountered, decoding is stopped and false is returned. This means
+ that, when applicable, you must remove any line terminators that is
+ part of the data stream before calling this function. */
+bool
+base64_decode (const char *in, size_t inlen,
+ char *out, size_t *outlen)
+{
+ size_t outleft = *outlen;
+
+ while (inlen >= 2)
+ {
+ if (!isbase64 (in[0]) || !isbase64 (in[1]))
+ break;
+
+ if (outleft)
+ {
+ *out++ = ((b64[to_uchar (in[0])] << 2)
+ | (b64[to_uchar (in[1])] >> 4));
+ outleft--;
+ }
+
+ if (inlen == 2)
+ break;
+
+ if (in[2] == '=')
+ {
+ if (inlen != 4)
+ break;
+
+ if (in[3] != '=')
+ break;
+
+ }
+ else
+ {
+ if (!isbase64 (in[2]))
+ break;
+
+ if (outleft)
+ {
+ *out++ = (((b64[to_uchar (in[1])] << 4) & 0xf0)
+ | (b64[to_uchar (in[2])] >> 2));
+ outleft--;
+ }
+
+ if (inlen == 3)
+ break;
+
+ if (in[3] == '=')
+ {
+ if (inlen != 4)
+ break;
+ }
+ else
+ {
+ if (!isbase64 (in[3]))
+ break;
+
+ if (outleft)
+ {
+ *out++ = (((b64[to_uchar (in[2])] << 6) & 0xc0)
+ | b64[to_uchar (in[3])]);
+ outleft--;
+ }
+ }
+ }
+
+ in += 4;
+ inlen -= 4;
+ }
+
+ *outlen -= outleft;
+
+ if (inlen != 0)
+ return false;
+
+ return true;
+}
+
+/* Allocate an output buffer in *OUT, and decode the base64 encoded
+ data stored in IN of size INLEN to the *OUT buffer. On return, the
+ size of the decoded data is stored in *OUTLEN. OUTLEN may be NULL,
+ if the caller is not interested in the decoded length. *OUT may be
+ NULL to indicate an out of memory error, in which case *OUTLEN
+ contains the size of the memory block needed. The function returns
+ true on successful decoding and memory allocation errors. (Use the
+ *OUT and *OUTLEN parameters to differentiate between successful
+ decoding and memory error.) The function returns false if the
+ input was invalid, in which case *OUT is NULL and *OUTLEN is
+ undefined. */
+bool
+base64_decode_alloc (const char *in, size_t inlen, char **out,
+ size_t *outlen)
+{
+ /* This may allocate a few bytes too much, depending on input,
+ but it's not worth the extra CPU time to compute the exact amount.
+ The exact amount is 3 * inlen / 4, minus 1 if the input ends
+ with "=" and minus another 1 if the input ends with "==".
+ Dividing before multiplying avoids the possibility of overflow. */
+ size_t needlen = 3 * (inlen / 4) + 2;
+
+ *out = (char *)malloc (needlen);
+ if (!*out)
+ return true;
+
+ if (!base64_decode (in, inlen, *out, &needlen))
+ {
+ free (*out);
+ *out = NULL;
+ return false;
+ }
+
+ if (outlen)
+ *outlen = needlen;
+
+ return true;
+#ifdef __cplusplus
+}
+#endif
+
+}
diff --git a/rocketmq-cpp/libs/signature/src/hmac.c b/rocketmq-cpp/libs/signature/src/hmac.c
new file mode 100755
index 00000000..9cac58d8
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/src/hmac.c
@@ -0,0 +1,165 @@
+
+#include <string.h>
+#include <stdint.h>
+
+#include "hmac.h"
+#include "sha1.h"
+#include "sha256.h"
+#include "sha512.h"
+
+#ifdef __cplusplus
+namespace metaqSignature{
+#endif
+
+#define IPAD 0x36
+#define OPAD 0x5c
+
+int hmac_sha1(const void *key, size_t key_len, const void *data, size_t data_len, void *ret_buf)
+{
+ uint32_t i;
+ struct sha1_ctx inner;
+ struct sha1_ctx outer;
+ struct sha1_ctx key_hash;
+ char ipad[64] = {0};
+ char opad[64] = {0};
+ char key_buf[SHA1_DIGEST_SIZE] = {0};
+ char inner_buf[SHA1_DIGEST_SIZE] = {0};
+
+ if (key == NULL || data == NULL || ret_buf == NULL) return -1;
+
+ if (key_len > 64) {
+ sha1_init_ctx(&key_hash);
+ sha1_process_bytes(key, key_len, &key_hash);
+ sha1_finish_ctx(&key_hash, key_buf);
+
+ key = key_buf;
+ key_len = SHA1_DIGEST_SIZE;
+ }
+
+ sha1_init_ctx (&inner);
+
+ for (i = 0; i < 64; i++) {
+ if (i < key_len) {
+ ipad[i] = ((const char *)key)[i] ^ IPAD;
+ opad[i] = ((const char *)key)[i] ^ OPAD;
+ } else {
+ ipad[i] = IPAD;
+ opad[i] = OPAD;
+ }
+ }
+
+ sha1_process_block (ipad, 64, &inner);
+ sha1_process_bytes (data, data_len, &inner);
+
+ sha1_finish_ctx (&inner, inner_buf);
+
+ sha1_init_ctx (&outer);
+
+ sha1_process_block (opad, 64, &outer);
+ sha1_process_bytes (inner_buf, SHA1_DIGEST_SIZE, &outer);
+
+ sha1_finish_ctx (&outer, ret_buf);
+
+ return 0;
+}
+
+int hmac_sha256(const void *key, size_t key_len, const void *data, size_t data_len, void *ret_buf)
+{
+ uint32_t i;
+ struct sha256_ctx inner;
+ struct sha256_ctx outer;
+ struct sha256_ctx key_hash;
+ char ipad[64] = {0};
+ char opad[64] = {0};
+ char key_buf[SHA256_DIGEST_SIZE] = {0};
+ char inner_buf[SHA256_DIGEST_SIZE] = {0};
+
+ if (key == NULL || data == NULL || ret_buf == NULL) return -1;
+
+ if (key_len > 64) {
+ sha256_init_ctx(&key_hash);
+ sha256_process_bytes(key, key_len, &key_hash);
+ sha256_finish_ctx(&key_hash, key_buf);
+
+ key = key_buf;
+ key_len = SHA256_DIGEST_SIZE;
+ }
+
+ sha256_init_ctx (&inner);
+
+ for (i = 0; i < 64; i++) {
+ if (i < key_len) {
+ ipad[i] = ((const char *)key)[i] ^ IPAD;
+ opad[i] = ((const char *)key)[i] ^ OPAD;
+ } else {
+ ipad[i] = IPAD;
+ opad[i] = OPAD;
+ }
+ }
+
+ sha256_process_block (ipad, 64, &inner);
+ sha256_process_bytes (data, data_len, &inner);
+
+ sha256_finish_ctx (&inner, inner_buf);
+
+ sha256_init_ctx (&outer);
+
+ sha256_process_block (opad, 64, &outer);
+ sha256_process_bytes (inner_buf, SHA256_DIGEST_SIZE, &outer);
+
+ sha256_finish_ctx (&outer, ret_buf);
+
+ return 0;
+}
+
+int hmac_sha512(const void *key, size_t key_len, const void *data, size_t data_len, void *ret_buf)
+{
+ uint32_t i;
+ struct sha512_ctx inner;
+ struct sha512_ctx outer;
+ struct sha512_ctx key_hash;
+ char ipad[128] = {0};
+ char opad[128] = {0};
+ char key_buf[SHA512_DIGEST_SIZE] = {0};
+ char inner_buf[SHA512_DIGEST_SIZE] = {0};
+
+ if (key == NULL || data == NULL || ret_buf == NULL) return -1;
+
+ if (key_len > 128) {
+ sha512_init_ctx(&key_hash);
+ sha512_process_bytes(key, key_len, &key_hash);
+ sha512_finish_ctx(&key_hash, key_buf);
+
+ key = key_buf;
+ key_len = SHA512_DIGEST_SIZE;
+ }
+
+ sha512_init_ctx (&inner);
+
+ for (i = 0; i < 128; i++) {
+ if (i < key_len) {
+ ipad[i] = ((const char *)key)[i] ^ IPAD;
+ opad[i] = ((const char *)key)[i] ^ OPAD;
+ } else {
+ ipad[i] = IPAD;
+ opad[i] = OPAD;
+ }
+ }
+
+ sha512_process_block (ipad, 128, &inner);
+ sha512_process_bytes (data, data_len, &inner);
+
+ sha512_finish_ctx (&inner, inner_buf);
+
+ sha512_init_ctx (&outer);
+
+ sha512_process_block (opad, 128, &outer);
+ sha512_process_bytes (inner_buf, SHA512_DIGEST_SIZE, &outer);
+
+ sha512_finish_ctx (&outer, ret_buf);
+
+ return 0;
+}
+#ifdef __cplusplus
+}
+#endif
\ No newline at end of file
diff --git a/rocketmq-cpp/libs/signature/src/param_list.c b/rocketmq-cpp/libs/signature/src/param_list.c
new file mode 100755
index 00000000..7476169b
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/src/param_list.c
@@ -0,0 +1,130 @@
+#include <stdio.h>
+#include <string.h>
+#include "param_list.h"
+#include "spas_client.h"
+
+#ifdef __cplusplus
+namespace metaqSignature{
+#endif
+
+extern void * _mem_alloc(unsigned int size);
+extern void _mem_free(void *ptr);
+
+static int _nodecmp(SPAS_PARAM_NODE *n1, SPAS_PARAM_NODE *n2) {
+ int ret = strcmp(n1->name, n2->name);
+ if (ret == 0) {
+ ret = strcmp(n1->value, n2->value);
+ }
+ return ret;
+}
+
+SPAS_PARAM_LIST * create_param_list() {
+ return (SPAS_PARAM_LIST *)_mem_alloc(sizeof(SPAS_PARAM_LIST));
+}
+
+void free_param_list(SPAS_PARAM_LIST *list) {
+ SPAS_PARAM_NODE *pnode = NULL;
+ SPAS_PARAM_NODE *pnext = NULL;
+ if (list == NULL) {
+ return;
+ }
+ pnode = list->phead;
+ while (pnode != NULL) {
+ pnext = pnode->pnext;
+ _mem_free(pnode->name);
+ _mem_free(pnode->value);
+ _mem_free(pnode);
+ pnode = pnext;
+ }
+ _mem_free(list);
+}
+
+
+int add_param_to_list(SPAS_PARAM_LIST *list, const char *name, const char *value) {
+ SPAS_PARAM_NODE *pnode = NULL;
+ SPAS_PARAM_NODE *plast = NULL;
+ int nlen = 0;
+ int vlen = 0;
+ if (list == NULL || name == NULL || value == NULL) {
+ return ERROR_INVALID_PARAM;
+ }
+ nlen = strlen(name);
+ vlen = strlen(value);
+ pnode = (SPAS_PARAM_NODE *)_mem_alloc(sizeof(SPAS_PARAM_NODE));
+ if (pnode == NULL) {
+ return ERROR_MEM_ALLOC;
+ }
+ pnode->name = (char *)_mem_alloc(nlen + 1);
+ if (pnode->name == NULL) {
+ _mem_free(pnode);
+ return ERROR_MEM_ALLOC;
+ }
+ pnode->value = (char *)_mem_alloc(vlen + 1);
+ if (pnode->value == NULL) {
+ _mem_free(pnode->name);
+ _mem_free(pnode);
+ return ERROR_MEM_ALLOC;
+ }
+ memcpy(pnode->name, name, nlen);
+ memcpy(pnode->value, value, vlen);
+ if (list->phead == NULL) {
+ list->phead = pnode;
+ }
+ else if (_nodecmp(pnode, list->phead) <= 0) {
+ pnode->pnext = list->phead;
+ list->phead = pnode;
+ }
+ else {
+ plast = list->phead;
+ while (plast->pnext!= NULL) {
+ if (_nodecmp(pnode, plast->pnext) <= 0) {
+ pnode->pnext = plast->pnext;
+ plast->pnext= pnode;
+ break;
+ }
+ else {
+ plast = plast->pnext;
+ }
+ }
+ if (plast->pnext == NULL) {
+ plast->pnext = pnode;
+ }
+ }
+ list->length++;
+ list->size += nlen + vlen + 1; /* 1 overhead for '=' */
+ return NO_ERROR;
+}
+
+
+char * param_list_to_str(const SPAS_PARAM_LIST *list) {
+ int size = 0;
+ int pos = 0;
+ char *buf = NULL;
+ SPAS_PARAM_NODE *pnode = NULL;
+ if (list == NULL) {
+ return NULL;
+ }
+ if (list->length == 0) {
+ return (char *)_mem_alloc(1);
+ }
+ size = list->size + list->length - 1; /* overhead for '&' */
+ buf = (char *)_mem_alloc(size);
+ if (buf == NULL) {
+ return NULL;
+ }
+ pnode = list->phead;
+ if (pnode != NULL) {
+ sprintf(buf, "%s=%s", pnode->name, pnode->value);
+ pos += strlen(pnode->name) + strlen(pnode->value) + 1;
+ pnode = pnode->pnext;
+ }
+ while (pnode != NULL) {
+ sprintf(buf + pos, "&%s=%s", pnode->name, pnode->value);
+ pos += strlen(pnode->name) + strlen(pnode->value) + 2;
+ pnode = pnode->pnext;
+ }
+ return buf;
+}
+#ifdef __cplusplus
+}
+#endif
\ No newline at end of file
diff --git a/rocketmq-cpp/libs/signature/src/sha1.c b/rocketmq-cpp/libs/signature/src/sha1.c
new file mode 100755
index 00000000..53162048
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/src/sha1.c
@@ -0,0 +1,516 @@
+/* sha1.c - Functions to compute SHA1 message digest of files or
+ memory blocks according to the NIST specification FIPS-180-1.
+
+ Copyright (C) 2000, 2001, 2003, 2004, 2005, 2006, 2008 Free Software
+ Foundation, Inc.
+
+ This program is free software; you can redistribute it and/or modify it
+ under the terms of the GNU General Public License as published by the
+ Free Software Foundation; either version 2, or (at your option) any
+ later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program; if not, write to the Free Software Foundation,
+ Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. */
+
+/* Written by Scott G. Miller
+ Credits:
+ Robert Klep <ro...@ilse.nl> -- Expansion function fix
+*/
+
+
+#include "sha1.h"
+
+#include <stddef.h>
+#include <string.h>
+
+#if USE_UNLOCKED_IO
+# include "unlocked-io.h"
+#endif
+
+#ifdef __cplusplus
+namespace metaqSignature {
+#endif
+
+#ifdef WORDS_BIGENDIAN
+# define SWAP(n) (n)
+#else
+# define SWAP(n) \
+ (((n) << 24) | (((n) & 0xff00) << 8) | (((n) >> 8) & 0xff00) | ((n) >> 24))
+#endif
+
+#define BLOCKSIZE 4096
+#if BLOCKSIZE % 64 != 0
+# error "invalid BLOCKSIZE"
+#endif
+
+/* This array contains the bytes used to pad the buffer to the next
+ 64-byte boundary. (RFC 1321, 3.1: Step 1) */
+static const unsigned char fillbuf[64] = { 0x80, 0 /* , 0, 0, ... */ };
+
+/*!
+ * @fn void sha1_init_ctx (struct sha1_ctx *ctx)
+ *
+ * @brief initialize a context with start constants
+ *
+ * @details Take a pointer to a 160 bit block of data (five 32 bit ints) and
+ * initialize it to the start constants of the SHA1 algorithm. This
+ * must be called before using hash in the call to sha1_hash.
+ *
+ * @param[out] ctx pointer to a context to be initialized
+ */
+void
+sha1_init_ctx (struct sha1_ctx *ctx)
+{
+ ctx->A = 0x67452301;
+ ctx->B = 0xefcdab89;
+ ctx->C = 0x98badcfe;
+ ctx->D = 0x10325476;
+ ctx->E = 0xc3d2e1f0;
+
+ ctx->total[0] = ctx->total[1] = 0;
+ ctx->buflen = 0;
+}
+
+/*!
+ * @fn static __inline__ void set_uint32 (char *cp, uint32_t v)
+ *
+ * @brief Copy the 4 byte value from v into the memory location pointed to
+ by *cp
+ *
+ * @details Copy the 4 byte value from v into the memory location pointed to by
+ * *cp, If your architecture allows unaligned access this is equivalent
+ * to * (uint32_t *) cp = v
+ *
+ * @param[out] cp memory location to copy v into
+ * @param[in] v 4 byte value to be copied
+ */
+#ifdef WIN32
+static _inline void
+#else
+static __inline__ void
+#endif
+set_uint32 (char *cp, uint32_t v)
+{
+ memcpy (cp, &v, sizeof v);
+}
+
+/*!
+ * @fn void *sha1_read_ctx (const struct sha1_ctx *ctx, void *resbuf)
+ *
+ * @brief Put result from CTX in first 20 bytes following RESBUF
+ *
+ * @details Put result from CTX in first 20 bytes following RESBUF. The result
+ * must be in little endian byte order.
+ *
+ * @param[in] ctx context whose results will be copied
+ * @param[out] resbuf result of copies saved in little endian byte order
+ * @return resbuf
+ */
+void *
+sha1_read_ctx (const struct sha1_ctx *ctx, void *resbuf)
+{
+ char *r = (char*)resbuf;
+ set_uint32 (r + 0 * sizeof ctx->A, SWAP (ctx->A));
+ set_uint32 (r + 1 * sizeof ctx->B, SWAP (ctx->B));
+ set_uint32 (r + 2 * sizeof ctx->C, SWAP (ctx->C));
+ set_uint32 (r + 3 * sizeof ctx->D, SWAP (ctx->D));
+ set_uint32 (r + 4 * sizeof ctx->E, SWAP (ctx->E));
+
+ return resbuf;
+}
+
+/*!
+ * @fn void *sha1_finish_ctx (struct sha1_ctx *ctx, void *resbuf)
+ *
+ * @brief Process the remaining bytes in the internal buffer and write
+ the result to RESBUF.
+ *
+ * @details Process the remaining bytes in the internal buffer and the usual
+ * prolog according to the standard and write the result to RESBUF.
+ *
+ * @param[in] ctx context to be used
+ * @param[out] resbuf resultant SHA1 hash
+ * @return resultant SHA1 hash
+ */
+void *
+sha1_finish_ctx (struct sha1_ctx *ctx, void *resbuf)
+{
+ /* Take yet unprocessed bytes into account. */
+ uint32_t bytes = ctx->buflen;
+ size_t size = (bytes < 56) ? 64 / 4 : 64 * 2 / 4;
+
+ /* Now count remaining bytes. */
+ ctx->total[0] += bytes;
+ if (ctx->total[0] < bytes)
+ ++ctx->total[1];
+
+ /* Put the 64-bit file length in *bits* at the end of the buffer. */
+ ctx->buffer[size - 2] = SWAP ((ctx->total[1] << 3) | (ctx->total[0] >> 29));
+ ctx->buffer[size - 1] = SWAP (ctx->total[0] << 3);
+
+ memcpy (&((char *) ctx->buffer)[bytes], fillbuf, (size - 2) * 4 - bytes);
+
+ /* Process last bytes. */
+ sha1_process_block (ctx->buffer, size * 4, ctx);
+
+ return sha1_read_ctx (ctx, resbuf);
+}
+
+
+/*
+ * @fn void *sha1_stream (FILE *stream, void *resblock)
+ *
+ * @brief Compute SHA1 message digest for A Stream.
+ *
+ * @details Compute SHA1 message digest for Stream. The
+ * result is always in little endian byte order, so that a byte-wise
+ * output yields to the wanted ASCII representation of the message
+ * digest.
+ *
+ * @param[in] stream message stream to be hashed
+ * @param[out] resblock resultant hash in little endian byte order
+ * @return resultant hash in little endian byte order
+ */
+int
+sha1_stream (FILE *stream, void *resblock)
+{
+ struct sha1_ctx ctx;
+ char buffer[BLOCKSIZE + 72];
+ size_t sum;
+
+ /* Initialize the computation context. */
+ sha1_init_ctx (&ctx);
+
+ /* Iterate over full file contents. */
+ while (1)
+ {
+ /* We read the file in blocks of BLOCKSIZE bytes. One call of the
+ computation function processes the whole buffer so that with the
+ next round of the loop another block can be read. */
+ size_t n;
+ sum = 0;
+
+ /* Read block. Take care for partial reads. */
+ while (1)
+ {
+ n = fread (buffer + sum, 1, BLOCKSIZE - sum, stream);
+
+ sum += n;
+
+ if (sum == BLOCKSIZE)
+ break;
+
+ if (n == 0)
+ {
+ /* Check for the error flag IFF N == 0, so that we don't
+ exit the loop after a partial read due to e.g., EAGAIN
+ or EWOULDBLOCK. */
+ if (ferror (stream))
+ return 1;
+ goto process_partial_block;
+ }
+
+ /* We've read at least one byte, so ignore errors. But always
+ check for EOF, since feof may be true even though N > 0.
+ Otherwise, we could end up calling fread after EOF. */
+ if (feof (stream))
+ goto process_partial_block;
+ }
+
+ /* Process buffer with BLOCKSIZE bytes. Note that
+ BLOCKSIZE % 64 == 0
+ */
+ sha1_process_block (buffer, BLOCKSIZE, &ctx);
+ }
+
+ process_partial_block:;
+
+ /* Process any remaining bytes. */
+ if (sum > 0)
+ sha1_process_bytes (buffer, sum, &ctx);
+
+ /* Construct result in desired memory. */
+ sha1_finish_ctx (&ctx, resblock);
+ return 0;
+}
+
+
+/*
+ * @fn void *sha1_buffer (const char *buffer, size_t len, void *resblock)
+ *
+ * @brief Compute SHA1 message digest for LEN bytes beginning at BUFFER.
+ *
+ * @details Compute SHA1 message digest for LEN bytes beginning at BUFFER. The
+ * result is always in little endian byte order, so that a byte-wise
+ * output yields to the wanted ASCII representation of the message
+ * digest.
+ *
+ * @param[in] buffer message to be hashed
+ * @param[in] len length of buffer
+ * @param[out] resblock resultant hash in little endian byte order
+ * @return resultant hash in little endian byte order
+ */
+void *
+sha1_buffer (const char *buffer, size_t len, void *resblock)
+{
+ struct sha1_ctx ctx;
+
+ /* Initialize the computation context. */
+ sha1_init_ctx (&ctx);
+
+ /* Process whole buffer but last len % 64 bytes. */
+ sha1_process_bytes (buffer, len, &ctx);
+
+ /* Put result in desired memory area. */
+ return sha1_finish_ctx (&ctx, resblock);
+}
+
+/*!
+ * @fn void sha1_process_bytes (const void *buffer, size_t len, struct sha1_ctx *ctx)
+ *
+ * @brief update the context for the next LEN bytes starting at BUFFER.
+ *
+ * @details Starting with the result of former calls of this function (or the
+ * initialization function) update the context for the next LEN bytes
+ * starting at BUFFER.
+ * It is NOT required that LEN is a multiple of 64.
+ *
+ * @param[in] buffer buffer used to update context values
+ * @param[in] len length of buffer
+ * @param[out] ctx context to be updated
+ */
+void
+sha1_process_bytes (const void *buffer, size_t len, struct sha1_ctx *ctx)
+{
+ /* When we already have some bits in our internal buffer concatenate
+ both inputs first. */
+ if (ctx->buflen != 0)
+ {
+ size_t left_over = ctx->buflen;
+ size_t add = 128 - left_over > len ? len : 128 - left_over;
+
+ memcpy (&((char *) ctx->buffer)[left_over], buffer, add);
+ ctx->buflen += add;
+
+ if (ctx->buflen > 64)
+ {
+ sha1_process_block (ctx->buffer, ctx->buflen & ~63, ctx);
+
+ ctx->buflen &= 63;
+ /* The regions in the following copy operation cannot overlap. */
+ memcpy (ctx->buffer,
+ &((char *) ctx->buffer)[(left_over + add) & ~63],
+ ctx->buflen);
+ }
+
+ buffer = (const char *) buffer + add;
+ len -= add;
+ }
+
+ /* Process available complete blocks. */
+ if (len >= 64)
+ {
+#if !_STRING_ARCH_unaligned
+# define alignof(type) offsetof (struct { char c; type x; }, x)
+# define UNALIGNED_P(p) (((size_t) p) % alignof (uint32_t) != 0)
+ if (UNALIGNED_P (buffer))
+ while (len > 64)
+ {
+ sha1_process_block (memcpy (ctx->buffer, buffer, 64), 64, ctx);
+ buffer = (const char *) buffer + 64;
+ len -= 64;
+ }
+ else
+#endif
+ {
+ sha1_process_block (buffer, len & ~63, ctx);
+ buffer = (const char *) buffer + (len & ~63);
+ len &= 63;
+ }
+ }
+
+ /* Move remaining bytes in internal buffer. */
+ if (len > 0)
+ {
+ size_t left_over = ctx->buflen;
+
+ memcpy (&((char *) ctx->buffer)[left_over], buffer, len);
+ left_over += len;
+ if (left_over >= 64)
+ {
+ sha1_process_block (ctx->buffer, 64, ctx);
+ left_over -= 64;
+ memcpy (ctx->buffer, &ctx->buffer[16], left_over);
+ }
+ ctx->buflen = left_over;
+ }
+}
+
+/* --- Code below is the primary difference between md5.c and sha1.c --- */
+
+/* SHA1 round constants */
+#define K1 0x5a827999
+#define K2 0x6ed9eba1
+#define K3 0x8f1bbcdc
+#define K4 0xca62c1d6
+
+/* Round functions. Note that F2 is the same as F4. */
+#define F1(B,C,D) ( D ^ ( B & ( C ^ D ) ) )
+#define F2(B,C,D) (B ^ C ^ D)
+#define F3(B,C,D) ( ( B & C ) | ( D & ( B | C ) ) )
+#define F4(B,C,D) (B ^ C ^ D)
+
+/*!
+ * @fn void sha1_process_block (const void *buffer, size_t len, struct sha1_ctx *ctx)
+ *
+ * @brief Process LEN bytes of BUFFER, accumulating context into CTX.
+ *
+ * @details Process LEN bytes of BUFFER, accumulating context into CTX.
+ * It is assumed that LEN % 64 == 0.
+ * Most of this code comes from GnuPG's cipher/sha1.c.
+ *
+ * @param[in] buffer buffer to be processed
+ * @param[in] len length of buffer
+ * @param[out] ctx context used to accumulate results
+ */
+
+void
+sha1_process_block (const void *buffer, size_t len, struct sha1_ctx *ctx)
+{
+ const uint32_t *words = (const uint32_t*)buffer;
+ size_t nwords = len / sizeof (uint32_t);
+ const uint32_t *endp = words + nwords;
+ uint32_t x[16];
+ uint32_t a = ctx->A;
+ uint32_t b = ctx->B;
+ uint32_t c = ctx->C;
+ uint32_t d = ctx->D;
+ uint32_t e = ctx->E;
+
+ /* First increment the byte count. RFC 1321 specifies the possible
+ length of the file up to 2^64 bits. Here we only compute the
+ number of bytes. Do a double word increment. */
+ ctx->total[0] += len;
+ if (ctx->total[0] < len)
+ ++ctx->total[1];
+
+#define rol(x, n) (((x) << (n)) | ((uint32_t) (x) >> (32 - (n))))
+
+#define M(I) ( tm = x[I&0x0f] ^ x[(I-14)&0x0f] \
+ ^ x[(I-8)&0x0f] ^ x[(I-3)&0x0f] \
+ , (x[I&0x0f] = rol(tm, 1)) )
+
+#define R(A,B,C,D,E,F,K,M) do { E += rol( A, 5 ) \
+ + F( B, C, D ) \
+ + K \
+ + M; \
+ B = rol( B, 30 ); \
+ } while(0)
+
+ while (words < endp)
+ {
+ uint32_t tm;
+ int t;
+ for (t = 0; t < 16; t++)
+ {
+ x[t] = SWAP (*words);
+ words++;
+ }
+
+ R( a, b, c, d, e, F1, K1, x[ 0] );
+ R( e, a, b, c, d, F1, K1, x[ 1] );
+ R( d, e, a, b, c, F1, K1, x[ 2] );
+ R( c, d, e, a, b, F1, K1, x[ 3] );
+ R( b, c, d, e, a, F1, K1, x[ 4] );
+ R( a, b, c, d, e, F1, K1, x[ 5] );
+ R( e, a, b, c, d, F1, K1, x[ 6] );
+ R( d, e, a, b, c, F1, K1, x[ 7] );
+ R( c, d, e, a, b, F1, K1, x[ 8] );
+ R( b, c, d, e, a, F1, K1, x[ 9] );
+ R( a, b, c, d, e, F1, K1, x[10] );
+ R( e, a, b, c, d, F1, K1, x[11] );
+ R( d, e, a, b, c, F1, K1, x[12] );
+ R( c, d, e, a, b, F1, K1, x[13] );
+ R( b, c, d, e, a, F1, K1, x[14] );
+ R( a, b, c, d, e, F1, K1, x[15] );
+ R( e, a, b, c, d, F1, K1, M(16) );
+ R( d, e, a, b, c, F1, K1, M(17) );
+ R( c, d, e, a, b, F1, K1, M(18) );
+ R( b, c, d, e, a, F1, K1, M(19) );
+ R( a, b, c, d, e, F2, K2, M(20) );
+ R( e, a, b, c, d, F2, K2, M(21) );
+ R( d, e, a, b, c, F2, K2, M(22) );
+ R( c, d, e, a, b, F2, K2, M(23) );
+ R( b, c, d, e, a, F2, K2, M(24) );
+ R( a, b, c, d, e, F2, K2, M(25) );
+ R( e, a, b, c, d, F2, K2, M(26) );
+ R( d, e, a, b, c, F2, K2, M(27) );
+ R( c, d, e, a, b, F2, K2, M(28) );
+ R( b, c, d, e, a, F2, K2, M(29) );
+ R( a, b, c, d, e, F2, K2, M(30) );
+ R( e, a, b, c, d, F2, K2, M(31) );
+ R( d, e, a, b, c, F2, K2, M(32) );
+ R( c, d, e, a, b, F2, K2, M(33) );
+ R( b, c, d, e, a, F2, K2, M(34) );
+ R( a, b, c, d, e, F2, K2, M(35) );
+ R( e, a, b, c, d, F2, K2, M(36) );
+ R( d, e, a, b, c, F2, K2, M(37) );
+ R( c, d, e, a, b, F2, K2, M(38) );
+ R( b, c, d, e, a, F2, K2, M(39) );
+ R( a, b, c, d, e, F3, K3, M(40) );
+ R( e, a, b, c, d, F3, K3, M(41) );
+ R( d, e, a, b, c, F3, K3, M(42) );
+ R( c, d, e, a, b, F3, K3, M(43) );
+ R( b, c, d, e, a, F3, K3, M(44) );
+ R( a, b, c, d, e, F3, K3, M(45) );
+ R( e, a, b, c, d, F3, K3, M(46) );
+ R( d, e, a, b, c, F3, K3, M(47) );
+ R( c, d, e, a, b, F3, K3, M(48) );
+ R( b, c, d, e, a, F3, K3, M(49) );
+ R( a, b, c, d, e, F3, K3, M(50) );
+ R( e, a, b, c, d, F3, K3, M(51) );
+ R( d, e, a, b, c, F3, K3, M(52) );
+ R( c, d, e, a, b, F3, K3, M(53) );
+ R( b, c, d, e, a, F3, K3, M(54) );
+ R( a, b, c, d, e, F3, K3, M(55) );
+ R( e, a, b, c, d, F3, K3, M(56) );
+ R( d, e, a, b, c, F3, K3, M(57) );
+ R( c, d, e, a, b, F3, K3, M(58) );
+ R( b, c, d, e, a, F3, K3, M(59) );
+ R( a, b, c, d, e, F4, K4, M(60) );
+ R( e, a, b, c, d, F4, K4, M(61) );
+ R( d, e, a, b, c, F4, K4, M(62) );
+ R( c, d, e, a, b, F4, K4, M(63) );
+ R( b, c, d, e, a, F4, K4, M(64) );
+ R( a, b, c, d, e, F4, K4, M(65) );
+ R( e, a, b, c, d, F4, K4, M(66) );
+ R( d, e, a, b, c, F4, K4, M(67) );
+ R( c, d, e, a, b, F4, K4, M(68) );
+ R( b, c, d, e, a, F4, K4, M(69) );
+ R( a, b, c, d, e, F4, K4, M(70) );
+ R( e, a, b, c, d, F4, K4, M(71) );
+ R( d, e, a, b, c, F4, K4, M(72) );
+ R( c, d, e, a, b, F4, K4, M(73) );
+ R( b, c, d, e, a, F4, K4, M(74) );
+ R( a, b, c, d, e, F4, K4, M(75) );
+ R( e, a, b, c, d, F4, K4, M(76) );
+ R( d, e, a, b, c, F4, K4, M(77) );
+ R( c, d, e, a, b, F4, K4, M(78) );
+ R( b, c, d, e, a, F4, K4, M(79) );
+
+ a = ctx->A += a;
+ b = ctx->B += b;
+ c = ctx->C += c;
+ d = ctx->D += d;
+ e = ctx->E += e;
+ }
+}
+#ifdef __cplusplus
+}
+#endif
diff --git a/rocketmq-cpp/libs/signature/src/sha256.c b/rocketmq-cpp/libs/signature/src/sha256.c
new file mode 100755
index 00000000..ffa65fa5
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/src/sha256.c
@@ -0,0 +1,566 @@
+/* sha256.c - Functions to compute SHA256 and SHA224 message digest of files or
+ memory blocks according to the NIST specification FIPS-180-2.
+
+ Copyright (C) 2005, 2006, 2008 Free Software Foundation, Inc.
+
+ This program is free software: you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation, either version 3 of the License, or
+ (at your option) any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program. If not, see <http://www.gnu.org/licenses/>. */
+
+/* Written by David Madore, considerably copypasting from
+ Scott G. Miller's sha1.c
+*/
+
+/* #include <config.h> */
+
+#include "sha256.h"
+
+#include <stddef.h>
+#include <string.h>
+
+#if USE_UNLOCKED_IO
+# include "unlocked-io.h"
+#endif
+
+#ifdef __cplusplus
+namespace metaqSignature {
+#endif
+
+#ifdef WORDS_BIGENDIAN
+# define SWAP(n) (n)
+#else
+# define SWAP(n) \
+ (((n) << 24) | (((n) & 0xff00) << 8) | (((n) >> 8) & 0xff00) | ((n) >> 24))
+#endif
+
+#define BLOCKSIZE 4096
+#if BLOCKSIZE % 64 != 0
+# error "invalid BLOCKSIZE"
+#endif
+
+/* This array contains the bytes used to pad the buffer to the next
+ 64-byte boundary. */
+static const unsigned char fillbuf[64] = { 0x80, 0 /* , 0, 0, ... */ };
+
+
+/*
+ Takes a pointer to a 256 bit block of data (eight 32 bit ints) and
+ intializes it to the start constants of the SHA256 algorithm. This
+ must be called before using hash in the call to sha256_hash
+*/
+void
+sha256_init_ctx (struct sha256_ctx *ctx)
+{
+ ctx->state[0] = 0x6a09e667UL;
+ ctx->state[1] = 0xbb67ae85UL;
+ ctx->state[2] = 0x3c6ef372UL;
+ ctx->state[3] = 0xa54ff53aUL;
+ ctx->state[4] = 0x510e527fUL;
+ ctx->state[5] = 0x9b05688cUL;
+ ctx->state[6] = 0x1f83d9abUL;
+ ctx->state[7] = 0x5be0cd19UL;
+
+ ctx->total[0] = ctx->total[1] = 0;
+ ctx->buflen = 0;
+}
+
+void
+sha224_init_ctx (struct sha256_ctx *ctx)
+{
+ ctx->state[0] = 0xc1059ed8UL;
+ ctx->state[1] = 0x367cd507UL;
+ ctx->state[2] = 0x3070dd17UL;
+ ctx->state[3] = 0xf70e5939UL;
+ ctx->state[4] = 0xffc00b31UL;
+ ctx->state[5] = 0x68581511UL;
+ ctx->state[6] = 0x64f98fa7UL;
+ ctx->state[7] = 0xbefa4fa4UL;
+
+ ctx->total[0] = ctx->total[1] = 0;
+ ctx->buflen = 0;
+}
+
+/* Copy the value from v into the memory location pointed to by *cp,
+ If your architecture allows unaligned access this is equivalent to
+ * (uint32_t *) cp = v */
+#ifdef WIN32
+static _inline void
+#else
+static __inline__ void
+#endif
+set_uint32 (char *cp, uint32_t v)
+{
+ memcpy (cp, &v, sizeof v);
+}
+
+/* Put result from CTX in first 32 bytes following RESBUF. The result
+ must be in little endian byte order. */
+void *
+sha256_read_ctx (const struct sha256_ctx *ctx, void *resbuf)
+{
+ int i;
+ char *r = (char*)resbuf;
+
+ for (i = 0; i < 8; i++)
+ set_uint32 (r + i * sizeof ctx->state[0], SWAP (ctx->state[i]));
+
+ return resbuf;
+}
+
+void *
+sha224_read_ctx (const struct sha256_ctx *ctx, void *resbuf)
+{
+ int i;
+ char *r = (char*)resbuf;
+
+ for (i = 0; i < 7; i++)
+ set_uint32 (r + i * sizeof ctx->state[0], SWAP (ctx->state[i]));
+
+ return resbuf;
+}
+
+/* Process the remaining bytes in the internal buffer and the usual
+ prolog according to the standard and write the result to RESBUF. */
+static void
+sha256_conclude_ctx (struct sha256_ctx *ctx)
+{
+ /* Take yet unprocessed bytes into account. */
+ size_t bytes = ctx->buflen;
+ size_t size = (bytes < 56) ? 64 / 4 : 64 * 2 / 4;
+
+ /* Now count remaining bytes. */
+ ctx->total[0] += bytes;
+ if (ctx->total[0] < bytes)
+ ++ctx->total[1];
+
+ /* Put the 64-bit file length in *bits* at the end of the buffer.
+ Use set_uint32 rather than a simple assignment, to avoid risk of
+ unaligned access. */
+ set_uint32 ((char *) &ctx->buffer[size - 2],
+ SWAP ((ctx->total[1] << 3) | (ctx->total[0] >> 29)));
+ set_uint32 ((char *) &ctx->buffer[size - 1],
+ SWAP (ctx->total[0] << 3));
+
+ memcpy (&((char *) ctx->buffer)[bytes], fillbuf, (size - 2) * 4 - bytes);
+
+ /* Process last bytes. */
+ sha256_process_block (ctx->buffer, size * 4, ctx);
+}
+
+void *
+sha256_finish_ctx (struct sha256_ctx *ctx, void *resbuf)
+{
+ sha256_conclude_ctx (ctx);
+ return sha256_read_ctx (ctx, resbuf);
+}
+
+void *
+sha224_finish_ctx (struct sha256_ctx *ctx, void *resbuf)
+{
+ sha256_conclude_ctx (ctx);
+ return sha224_read_ctx (ctx, resbuf);
+}
+
+/* Compute SHA256 message digest for bytes read from STREAM. The
+ resulting message digest number will be written into the 32 bytes
+ beginning at RESBLOCK. */
+int
+sha256_stream (FILE *stream, void *resblock)
+{
+ struct sha256_ctx ctx;
+ char buffer[BLOCKSIZE + 72];
+ size_t sum;
+
+ /* Initialize the computation context. */
+ sha256_init_ctx (&ctx);
+
+ /* Iterate over full file contents. */
+ while (1)
+ {
+ /* We read the file in blocks of BLOCKSIZE bytes. One call of the
+ computation function processes the whole buffer so that with the
+ next round of the loop another block can be read. */
+ size_t n;
+ sum = 0;
+
+ /* Read block. Take care for partial reads. */
+ while (1)
+ {
+ n = fread (buffer + sum, 1, BLOCKSIZE - sum, stream);
+
+ sum += n;
+
+ if (sum == BLOCKSIZE)
+ break;
+
+ if (n == 0)
+ {
+ /* Check for the error flag IFF N == 0, so that we don't
+ exit the loop after a partial read due to e.g., EAGAIN
+ or EWOULDBLOCK. */
+ if (ferror (stream))
+ return 1;
+ goto process_partial_block;
+ }
+
+ /* We've read at least one byte, so ignore errors. But always
+ check for EOF, since feof may be true even though N > 0.
+ Otherwise, we could end up calling fread after EOF. */
+ if (feof (stream))
+ goto process_partial_block;
+ }
+
+ /* Process buffer with BLOCKSIZE bytes. Note that
+ BLOCKSIZE % 64 == 0
+ */
+ sha256_process_block (buffer, BLOCKSIZE, &ctx);
+ }
+
+ process_partial_block:;
+
+ /* Process any remaining bytes. */
+ if (sum > 0)
+ sha256_process_bytes (buffer, sum, &ctx);
+
+ /* Construct result in desired memory. */
+ sha256_finish_ctx (&ctx, resblock);
+ return 0;
+}
+
+/* FIXME: Avoid code duplication */
+int
+sha224_stream (FILE *stream, void *resblock)
+{
+ struct sha256_ctx ctx;
+ char buffer[BLOCKSIZE + 72];
+ size_t sum;
+
+ /* Initialize the computation context. */
+ sha224_init_ctx (&ctx);
+
+ /* Iterate over full file contents. */
+ while (1)
+ {
+ /* We read the file in blocks of BLOCKSIZE bytes. One call of the
+ computation function processes the whole buffer so that with the
+ next round of the loop another block can be read. */
+ size_t n;
+ sum = 0;
+
+ /* Read block. Take care for partial reads. */
+ while (1)
+ {
+ n = fread (buffer + sum, 1, BLOCKSIZE - sum, stream);
+
+ sum += n;
+
+ if (sum == BLOCKSIZE)
+ break;
+
+ if (n == 0)
+ {
+ /* Check for the error flag IFF N == 0, so that we don't
+ exit the loop after a partial read due to e.g., EAGAIN
+ or EWOULDBLOCK. */
+ if (ferror (stream))
+ return 1;
+ goto process_partial_block;
+ }
+
+ /* We've read at least one byte, so ignore errors. But always
+ check for EOF, since feof may be true even though N > 0.
+ Otherwise, we could end up calling fread after EOF. */
+ if (feof (stream))
+ goto process_partial_block;
+ }
+
+ /* Process buffer with BLOCKSIZE bytes. Note that
+ BLOCKSIZE % 64 == 0
+ */
+ sha256_process_block (buffer, BLOCKSIZE, &ctx);
+ }
+
+ process_partial_block:;
+
+ /* Process any remaining bytes. */
+ if (sum > 0)
+ sha256_process_bytes (buffer, sum, &ctx);
+
+ /* Construct result in desired memory. */
+ sha224_finish_ctx (&ctx, resblock);
+ return 0;
+}
+
+/* Compute SHA512 message digest for LEN bytes beginning at BUFFER. The
+ result is always in little endian byte order, so that a byte-wise
+ output yields to the wanted ASCII representation of the message
+ digest. */
+void *
+sha256_buffer (const char *buffer, size_t len, void *resblock)
+{
+ struct sha256_ctx ctx;
+
+ /* Initialize the computation context. */
+ sha256_init_ctx (&ctx);
+
+ /* Process whole buffer but last len % 64 bytes. */
+ sha256_process_bytes (buffer, len, &ctx);
+
+ /* Put result in desired memory area. */
+ return sha256_finish_ctx (&ctx, resblock);
+}
+
+void *
+sha224_buffer (const char *buffer, size_t len, void *resblock)
+{
+ struct sha256_ctx ctx;
+
+ /* Initialize the computation context. */
+ sha224_init_ctx (&ctx);
+
+ /* Process whole buffer but last len % 64 bytes. */
+ sha256_process_bytes (buffer, len, &ctx);
+
+ /* Put result in desired memory area. */
+ return sha224_finish_ctx (&ctx, resblock);
+}
+
+void
+sha256_process_bytes (const void *buffer, size_t len, struct sha256_ctx *ctx)
+{
+ /* When we already have some bits in our internal buffer concatenate
+ both inputs first. */
+ if (ctx->buflen != 0)
+ {
+ size_t left_over = ctx->buflen;
+ size_t add = 128 - left_over > len ? len : 128 - left_over;
+
+ memcpy (&((char *) ctx->buffer)[left_over], buffer, add);
+ ctx->buflen += add;
+
+ if (ctx->buflen > 64)
+ {
+ sha256_process_block (ctx->buffer, ctx->buflen & ~63, ctx);
+
+ ctx->buflen &= 63;
+ /* The regions in the following copy operation cannot overlap. */
+ memcpy (ctx->buffer,
+ &((char *) ctx->buffer)[(left_over + add) & ~63],
+ ctx->buflen);
+ }
+
+ buffer = (const char *) buffer + add;
+ len -= add;
+ }
+
+ /* Process available complete blocks. */
+ if (len >= 64)
+ {
+#if !_STRING_ARCH_unaligned
+# define alignof(type) offsetof (struct { char c; type x; }, x)
+# define UNALIGNED_P(p) (((size_t) p) % alignof (uint32_t) != 0)
+ if (UNALIGNED_P (buffer))
+ while (len > 64)
+ {
+ sha256_process_block (memcpy (ctx->buffer, buffer, 64), 64, ctx);
+ buffer = (const char *) buffer + 64;
+ len -= 64;
+ }
+ else
+#endif
+ {
+ sha256_process_block (buffer, len & ~63, ctx);
+ buffer = (const char *) buffer + (len & ~63);
+ len &= 63;
+ }
+ }
+
+ /* Move remaining bytes in internal buffer. */
+ if (len > 0)
+ {
+ size_t left_over = ctx->buflen;
+
+ memcpy (&((char *) ctx->buffer)[left_over], buffer, len);
+ left_over += len;
+ if (left_over >= 64)
+ {
+ sha256_process_block (ctx->buffer, 64, ctx);
+ left_over -= 64;
+ memcpy (ctx->buffer, &ctx->buffer[16], left_over);
+ }
+ ctx->buflen = left_over;
+ }
+}
+
+/* --- Code below is the primary difference between sha1.c and sha256.c --- */
+
+/* SHA256 round constants */
+#define K(I) sha256_round_constants[I]
+static const uint32_t sha256_round_constants[64] = {
+ 0x428a2f98UL, 0x71374491UL, 0xb5c0fbcfUL, 0xe9b5dba5UL,
+ 0x3956c25bUL, 0x59f111f1UL, 0x923f82a4UL, 0xab1c5ed5UL,
+ 0xd807aa98UL, 0x12835b01UL, 0x243185beUL, 0x550c7dc3UL,
+ 0x72be5d74UL, 0x80deb1feUL, 0x9bdc06a7UL, 0xc19bf174UL,
+ 0xe49b69c1UL, 0xefbe4786UL, 0x0fc19dc6UL, 0x240ca1ccUL,
+ 0x2de92c6fUL, 0x4a7484aaUL, 0x5cb0a9dcUL, 0x76f988daUL,
+ 0x983e5152UL, 0xa831c66dUL, 0xb00327c8UL, 0xbf597fc7UL,
+ 0xc6e00bf3UL, 0xd5a79147UL, 0x06ca6351UL, 0x14292967UL,
+ 0x27b70a85UL, 0x2e1b2138UL, 0x4d2c6dfcUL, 0x53380d13UL,
+ 0x650a7354UL, 0x766a0abbUL, 0x81c2c92eUL, 0x92722c85UL,
+ 0xa2bfe8a1UL, 0xa81a664bUL, 0xc24b8b70UL, 0xc76c51a3UL,
+ 0xd192e819UL, 0xd6990624UL, 0xf40e3585UL, 0x106aa070UL,
+ 0x19a4c116UL, 0x1e376c08UL, 0x2748774cUL, 0x34b0bcb5UL,
+ 0x391c0cb3UL, 0x4ed8aa4aUL, 0x5b9cca4fUL, 0x682e6ff3UL,
+ 0x748f82eeUL, 0x78a5636fUL, 0x84c87814UL, 0x8cc70208UL,
+ 0x90befffaUL, 0xa4506cebUL, 0xbef9a3f7UL, 0xc67178f2UL,
+};
+
+/* Round functions. */
+#define F2(A,B,C) ( ( A & B ) | ( C & ( A | B ) ) )
+#define F1(E,F,G) ( G ^ ( E & ( F ^ G ) ) )
+
+/* Process LEN bytes of BUFFER, accumulating context into CTX.
+ It is assumed that LEN % 64 == 0.
+ Most of this code comes from GnuPG's cipher/sha1.c. */
+
+void
+sha256_process_block (const void *buffer, size_t len, struct sha256_ctx *ctx)
+{
+ const uint32_t *words = (const uint32_t *)buffer;
+ size_t nwords = len / sizeof (uint32_t);
+ const uint32_t *endp = words + nwords;
+ uint32_t x[16];
+ uint32_t a = ctx->state[0];
+ uint32_t b = ctx->state[1];
+ uint32_t c = ctx->state[2];
+ uint32_t d = ctx->state[3];
+ uint32_t e = ctx->state[4];
+ uint32_t f = ctx->state[5];
+ uint32_t g = ctx->state[6];
+ uint32_t h = ctx->state[7];
+
+ /* First increment the byte count. FIPS PUB 180-2 specifies the possible
+ length of the file up to 2^64 bits. Here we only compute the
+ number of bytes. Do a double word increment. */
+ ctx->total[0] += len;
+ if (ctx->total[0] < len)
+ ++ctx->total[1];
+
+#define rol(x, n) (((x) << (n)) | ((x) >> (32 - (n))))
+#define S0(x) (rol(x,25)^rol(x,14)^(x>>3))
+#define S1(x) (rol(x,15)^rol(x,13)^(x>>10))
+#define SS0(x) (rol(x,30)^rol(x,19)^rol(x,10))
+#define SS1(x) (rol(x,26)^rol(x,21)^rol(x,7))
+
+#define M(I) ( tm = S1(x[(I-2)&0x0f]) + x[(I-7)&0x0f] \
+ + S0(x[(I-15)&0x0f]) + x[I&0x0f] \
+ , x[I&0x0f] = tm )
+
+#define R(A,B,C,D,E,F,G,H,K,M) do { t0 = SS0(A) + F2(A,B,C); \
+ t1 = H + SS1(E) \
+ + F1(E,F,G) \
+ + K \
+ + M; \
+ D += t1; H = t0 + t1; \
+ } while(0)
+
+ while (words < endp)
+ {
+ uint32_t tm;
+ uint32_t t0, t1;
+ int t;
+ /* FIXME: see sha1.c for a better implementation. */
+ for (t = 0; t < 16; t++)
+ {
+ x[t] = SWAP (*words);
+ words++;
+ }
+
+ R( a, b, c, d, e, f, g, h, K( 0), x[ 0] );
+ R( h, a, b, c, d, e, f, g, K( 1), x[ 1] );
+ R( g, h, a, b, c, d, e, f, K( 2), x[ 2] );
+ R( f, g, h, a, b, c, d, e, K( 3), x[ 3] );
+ R( e, f, g, h, a, b, c, d, K( 4), x[ 4] );
+ R( d, e, f, g, h, a, b, c, K( 5), x[ 5] );
+ R( c, d, e, f, g, h, a, b, K( 6), x[ 6] );
+ R( b, c, d, e, f, g, h, a, K( 7), x[ 7] );
+ R( a, b, c, d, e, f, g, h, K( 8), x[ 8] );
+ R( h, a, b, c, d, e, f, g, K( 9), x[ 9] );
+ R( g, h, a, b, c, d, e, f, K(10), x[10] );
+ R( f, g, h, a, b, c, d, e, K(11), x[11] );
+ R( e, f, g, h, a, b, c, d, K(12), x[12] );
+ R( d, e, f, g, h, a, b, c, K(13), x[13] );
+ R( c, d, e, f, g, h, a, b, K(14), x[14] );
+ R( b, c, d, e, f, g, h, a, K(15), x[15] );
+ R( a, b, c, d, e, f, g, h, K(16), M(16) );
+ R( h, a, b, c, d, e, f, g, K(17), M(17) );
+ R( g, h, a, b, c, d, e, f, K(18), M(18) );
+ R( f, g, h, a, b, c, d, e, K(19), M(19) );
+ R( e, f, g, h, a, b, c, d, K(20), M(20) );
+ R( d, e, f, g, h, a, b, c, K(21), M(21) );
+ R( c, d, e, f, g, h, a, b, K(22), M(22) );
+ R( b, c, d, e, f, g, h, a, K(23), M(23) );
+ R( a, b, c, d, e, f, g, h, K(24), M(24) );
+ R( h, a, b, c, d, e, f, g, K(25), M(25) );
+ R( g, h, a, b, c, d, e, f, K(26), M(26) );
+ R( f, g, h, a, b, c, d, e, K(27), M(27) );
+ R( e, f, g, h, a, b, c, d, K(28), M(28) );
+ R( d, e, f, g, h, a, b, c, K(29), M(29) );
+ R( c, d, e, f, g, h, a, b, K(30), M(30) );
+ R( b, c, d, e, f, g, h, a, K(31), M(31) );
+ R( a, b, c, d, e, f, g, h, K(32), M(32) );
+ R( h, a, b, c, d, e, f, g, K(33), M(33) );
+ R( g, h, a, b, c, d, e, f, K(34), M(34) );
+ R( f, g, h, a, b, c, d, e, K(35), M(35) );
+ R( e, f, g, h, a, b, c, d, K(36), M(36) );
+ R( d, e, f, g, h, a, b, c, K(37), M(37) );
+ R( c, d, e, f, g, h, a, b, K(38), M(38) );
+ R( b, c, d, e, f, g, h, a, K(39), M(39) );
+ R( a, b, c, d, e, f, g, h, K(40), M(40) );
+ R( h, a, b, c, d, e, f, g, K(41), M(41) );
+ R( g, h, a, b, c, d, e, f, K(42), M(42) );
+ R( f, g, h, a, b, c, d, e, K(43), M(43) );
+ R( e, f, g, h, a, b, c, d, K(44), M(44) );
+ R( d, e, f, g, h, a, b, c, K(45), M(45) );
+ R( c, d, e, f, g, h, a, b, K(46), M(46) );
+ R( b, c, d, e, f, g, h, a, K(47), M(47) );
+ R( a, b, c, d, e, f, g, h, K(48), M(48) );
+ R( h, a, b, c, d, e, f, g, K(49), M(49) );
+ R( g, h, a, b, c, d, e, f, K(50), M(50) );
+ R( f, g, h, a, b, c, d, e, K(51), M(51) );
+ R( e, f, g, h, a, b, c, d, K(52), M(52) );
+ R( d, e, f, g, h, a, b, c, K(53), M(53) );
+ R( c, d, e, f, g, h, a, b, K(54), M(54) );
+ R( b, c, d, e, f, g, h, a, K(55), M(55) );
+ R( a, b, c, d, e, f, g, h, K(56), M(56) );
+ R( h, a, b, c, d, e, f, g, K(57), M(57) );
+ R( g, h, a, b, c, d, e, f, K(58), M(58) );
+ R( f, g, h, a, b, c, d, e, K(59), M(59) );
+ R( e, f, g, h, a, b, c, d, K(60), M(60) );
+ R( d, e, f, g, h, a, b, c, K(61), M(61) );
+ R( c, d, e, f, g, h, a, b, K(62), M(62) );
+ R( b, c, d, e, f, g, h, a, K(63), M(63) );
+
+ a = ctx->state[0] += a;
+ b = ctx->state[1] += b;
+ c = ctx->state[2] += c;
+ d = ctx->state[3] += d;
+ e = ctx->state[4] += e;
+ f = ctx->state[5] += f;
+ g = ctx->state[6] += g;
+ h = ctx->state[7] += h;
+ }
+}
+#ifdef __cplusplus
+}
+#endif
+
diff --git a/rocketmq-cpp/libs/signature/src/sha512.c b/rocketmq-cpp/libs/signature/src/sha512.c
new file mode 100755
index 00000000..c64aec6a
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/src/sha512.c
@@ -0,0 +1,616 @@
+/* sha512.c - Functions to compute SHA512 and SHA384 message digest of files or
+ memory blocks according to the NIST specification FIPS-180-2.
+
+ Copyright (C) 2005, 2006, 2008 Free Software Foundation, Inc.
+
+ This program is free software: you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation, either version 3 of the License, or
+ (at your option) any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program. If not, see <http://www.gnu.org/licenses/>. */
+
+/* Written by David Madore, considerably copypasting from
+ Scott G. Miller's sha1.c
+*/
+
+/* #include <config.h> */
+
+#include "sha512.h"
+
+#include <stddef.h>
+#include <string.h>
+
+#if USE_UNLOCKED_IO
+# include "unlocked-io.h"
+#endif
+
+#ifdef __cplusplus
+namespace metaqSignature{
+#endif
+
+#ifdef WORDS_BIGENDIAN
+# define SWAP(n) (n)
+#else
+# define SWAP(n) \
+ u64or (u64or (u64or (u64shl (n, 56), \
+ u64shl (u64and (n, u64lo (0x0000ff00)), 40)), \
+ u64or (u64shl (u64and (n, u64lo (0x00ff0000)), 24), \
+ u64shl (u64and (n, u64lo (0xff000000)), 8))), \
+ u64or (u64or (u64and (u64shr (n, 8), u64lo (0xff000000)), \
+ u64and (u64shr (n, 24), u64lo (0x00ff0000))), \
+ u64or (u64and (u64shr (n, 40), u64lo (0x0000ff00)), \
+ u64shr (n, 56))))
+#endif
+
+#define BLOCKSIZE 4096
+#if BLOCKSIZE % 128 != 0
+# error "invalid BLOCKSIZE"
+#endif
+
+/* This array contains the bytes used to pad the buffer to the next
+ 128-byte boundary. */
+static const unsigned char fillbuf[128] = { 0x80, 0 /* , 0, 0, ... */ };
+
+
+/*
+ Takes a pointer to a 512 bit block of data (eight 64 bit ints) and
+ intializes it to the start constants of the SHA512 algorithm. This
+ must be called before using hash in the call to sha512_hash
+*/
+void
+sha512_init_ctx (struct sha512_ctx *ctx)
+{
+ ctx->state[0] = u64hilo (0x6a09e667, 0xf3bcc908);
+ ctx->state[1] = u64hilo (0xbb67ae85, 0x84caa73b);
+ ctx->state[2] = u64hilo (0x3c6ef372, 0xfe94f82b);
+ ctx->state[3] = u64hilo (0xa54ff53a, 0x5f1d36f1);
+ ctx->state[4] = u64hilo (0x510e527f, 0xade682d1);
+ ctx->state[5] = u64hilo (0x9b05688c, 0x2b3e6c1f);
+ ctx->state[6] = u64hilo (0x1f83d9ab, 0xfb41bd6b);
+ ctx->state[7] = u64hilo (0x5be0cd19, 0x137e2179);
+
+ ctx->total[0] = ctx->total[1] = u64lo (0);
+ ctx->buflen = 0;
+}
+
+void
+sha384_init_ctx (struct sha512_ctx *ctx)
+{
+ ctx->state[0] = u64hilo (0xcbbb9d5d, 0xc1059ed8);
+ ctx->state[1] = u64hilo (0x629a292a, 0x367cd507);
+ ctx->state[2] = u64hilo (0x9159015a, 0x3070dd17);
+ ctx->state[3] = u64hilo (0x152fecd8, 0xf70e5939);
+ ctx->state[4] = u64hilo (0x67332667, 0xffc00b31);
+ ctx->state[5] = u64hilo (0x8eb44a87, 0x68581511);
+ ctx->state[6] = u64hilo (0xdb0c2e0d, 0x64f98fa7);
+ ctx->state[7] = u64hilo (0x47b5481d, 0xbefa4fa4);
+
+ ctx->total[0] = ctx->total[1] = u64lo (0);
+ ctx->buflen = 0;
+}
+
+/* Copy the value from V into the memory location pointed to by *CP,
+ If your architecture allows unaligned access, this is equivalent to
+ * (__typeof__ (v) *) cp = v */
+#ifdef WIN32
+static _inline void
+#else
+static __inline__ void
+#endif
+set_uint64 (char *cp, u64 v)
+{
+ memcpy (cp, &v, sizeof v);
+}
+
+/* Put result from CTX in first 64 bytes following RESBUF.
+ The result must be in little endian byte order. */
+void *
+sha512_read_ctx (const struct sha512_ctx *ctx, void *resbuf)
+{
+ int i;
+ char *r = (char*)resbuf;
+
+ for (i = 0; i < 8; i++)
+ set_uint64 (r + i * sizeof ctx->state[0], SWAP (ctx->state[i]));
+
+ return resbuf;
+}
+
+void *
+sha384_read_ctx (const struct sha512_ctx *ctx, void *resbuf)
+{
+ int i;
+ char *r = (char*)resbuf;
+
+ for (i = 0; i < 6; i++)
+ set_uint64 (r + i * sizeof ctx->state[0], SWAP (ctx->state[i]));
+
+ return resbuf;
+}
+
+/* Process the remaining bytes in the internal buffer and the usual
+ prolog according to the standard and write the result to RESBUF. */
+static void
+sha512_conclude_ctx (struct sha512_ctx *ctx)
+{
+ /* Take yet unprocessed bytes into account. */
+ size_t bytes = ctx->buflen;
+ size_t size = (bytes < 112) ? 128 / 8 : 128 * 2 / 8;
+
+ /* Now count remaining bytes. */
+ ctx->total[0] = u64plus (ctx->total[0], u64lo (bytes));
+ if (u64lt (ctx->total[0], u64lo (bytes)))
+ ctx->total[1] = u64plus (ctx->total[1], u64lo (1));
+
+ /* Put the 128-bit file length in *bits* at the end of the buffer.
+ Use set_uint64 rather than a simple assignment, to avoid risk of
+ unaligned access. */
+ set_uint64 ((char *) &ctx->buffer[size - 2],
+ SWAP (u64or (u64shl (ctx->total[1], 3),
+ u64shr (ctx->total[0], 61))));
+ set_uint64 ((char *) &ctx->buffer[size - 1],
+ SWAP (u64shl (ctx->total[0], 3)));
+
+ memcpy (&((char *) ctx->buffer)[bytes], fillbuf, (size - 2) * 8 - bytes);
+
+ /* Process last bytes. */
+ sha512_process_block (ctx->buffer, size * 8, ctx);
+}
+
+void *
+sha512_finish_ctx (struct sha512_ctx *ctx, void *resbuf)
+{
+ sha512_conclude_ctx (ctx);
+ return sha512_read_ctx (ctx, resbuf);
+}
+
+void *
+sha384_finish_ctx (struct sha512_ctx *ctx, void *resbuf)
+{
+ sha512_conclude_ctx (ctx);
+ return sha384_read_ctx (ctx, resbuf);
+}
+
+/* Compute SHA512 message digest for bytes read from STREAM. The
+ resulting message digest number will be written into the 64 bytes
+ beginning at RESBLOCK. */
+int
+sha512_stream (FILE *stream, void *resblock)
+{
+ struct sha512_ctx ctx;
+ char buffer[BLOCKSIZE + 72];
+ size_t sum;
+
+ /* Initialize the computation context. */
+ sha512_init_ctx (&ctx);
+
+ /* Iterate over full file contents. */
+ while (1)
+ {
+ /* We read the file in blocks of BLOCKSIZE bytes. One call of the
+ computation function processes the whole buffer so that with the
+ next round of the loop another block can be read. */
+ size_t n;
+ sum = 0;
+
+ /* Read block. Take care for partial reads. */
+ while (1)
+ {
+ n = fread (buffer + sum, 1, BLOCKSIZE - sum, stream);
+
+ sum += n;
+
+ if (sum == BLOCKSIZE)
+ break;
+
+ if (n == 0)
+ {
+ /* Check for the error flag IFF N == 0, so that we don't
+ exit the loop after a partial read due to e.g., EAGAIN
+ or EWOULDBLOCK. */
+ if (ferror (stream))
+ return 1;
+ goto process_partial_block;
+ }
+
+ /* We've read at least one byte, so ignore errors. But always
+ check for EOF, since feof may be true even though N > 0.
+ Otherwise, we could end up calling fread after EOF. */
+ if (feof (stream))
+ goto process_partial_block;
+ }
+
+ /* Process buffer with BLOCKSIZE bytes. Note that
+ BLOCKSIZE % 128 == 0
+ */
+ sha512_process_block (buffer, BLOCKSIZE, &ctx);
+ }
+
+ process_partial_block:;
+
+ /* Process any remaining bytes. */
+ if (sum > 0)
+ sha512_process_bytes (buffer, sum, &ctx);
+
+ /* Construct result in desired memory. */
+ sha512_finish_ctx (&ctx, resblock);
+ return 0;
+}
+
+/* FIXME: Avoid code duplication */
+int
+sha384_stream (FILE *stream, void *resblock)
+{
+ struct sha512_ctx ctx;
+ char buffer[BLOCKSIZE + 72];
+ size_t sum;
+
+ /* Initialize the computation context. */
+ sha384_init_ctx (&ctx);
+
+ /* Iterate over full file contents. */
+ while (1)
+ {
+ /* We read the file in blocks of BLOCKSIZE bytes. One call of the
+ computation function processes the whole buffer so that with the
+ next round of the loop another block can be read. */
+ size_t n;
+ sum = 0;
+
+ /* Read block. Take care for partial reads. */
+ while (1)
+ {
+ n = fread (buffer + sum, 1, BLOCKSIZE - sum, stream);
+
+ sum += n;
+
+ if (sum == BLOCKSIZE)
+ break;
+
+ if (n == 0)
+ {
+ /* Check for the error flag IFF N == 0, so that we don't
+ exit the loop after a partial read due to e.g., EAGAIN
+ or EWOULDBLOCK. */
+ if (ferror (stream))
+ return 1;
+ goto process_partial_block;
+ }
+
+ /* We've read at least one byte, so ignore errors. But always
+ check for EOF, since feof may be true even though N > 0.
+ Otherwise, we could end up calling fread after EOF. */
+ if (feof (stream))
+ goto process_partial_block;
+ }
+
+ /* Process buffer with BLOCKSIZE bytes. Note that
+ BLOCKSIZE % 128 == 0
+ */
+ sha512_process_block (buffer, BLOCKSIZE, &ctx);
+ }
+
+ process_partial_block:;
+
+ /* Process any remaining bytes. */
+ if (sum > 0)
+ sha512_process_bytes (buffer, sum, &ctx);
+
+ /* Construct result in desired memory. */
+ sha384_finish_ctx (&ctx, resblock);
+ return 0;
+}
+
+/* Compute SHA512 message digest for LEN bytes beginning at BUFFER. The
+ result is always in little endian byte order, so that a byte-wise
+ output yields to the wanted ASCII representation of the message
+ digest. */
+void *
+sha512_buffer (const char *buffer, size_t len, void *resblock)
+{
+ struct sha512_ctx ctx;
+
+ /* Initialize the computation context. */
+ sha512_init_ctx (&ctx);
+
+ /* Process whole buffer but last len % 128 bytes. */
+ sha512_process_bytes (buffer, len, &ctx);
+
+ /* Put result in desired memory area. */
+ return sha512_finish_ctx (&ctx, resblock);
+}
+
+void *
+sha384_buffer (const char *buffer, size_t len, void *resblock)
+{
+ struct sha512_ctx ctx;
+
+ /* Initialize the computation context. */
+ sha384_init_ctx (&ctx);
+
+ /* Process whole buffer but last len % 128 bytes. */
+ sha512_process_bytes (buffer, len, &ctx);
+
+ /* Put result in desired memory area. */
+ return sha384_finish_ctx (&ctx, resblock);
+}
+
+void
+sha512_process_bytes (const void *buffer, size_t len, struct sha512_ctx *ctx)
+{
+ /* When we already have some bits in our internal buffer concatenate
+ both inputs first. */
+ if (ctx->buflen != 0)
+ {
+ size_t left_over = ctx->buflen;
+ size_t add = 256 - left_over > len ? len : 256 - left_over;
+
+ memcpy (&((char *) ctx->buffer)[left_over], buffer, add);
+ ctx->buflen += add;
+
+ if (ctx->buflen > 128)
+ {
+ sha512_process_block (ctx->buffer, ctx->buflen & ~127, ctx);
+
+ ctx->buflen &= 127;
+ /* The regions in the following copy operation cannot overlap. */
+ memcpy (ctx->buffer,
+ &((char *) ctx->buffer)[(left_over + add) & ~127],
+ ctx->buflen);
+ }
+
+ buffer = (const char *) buffer + add;
+ len -= add;
+ }
+
+ /* Process available complete blocks. */
+ if (len >= 128)
+ {
+#if !_STRING_ARCH_unaligned
+# define alignof(type) offsetof (struct { char c; type x; }, x)
+# define UNALIGNED_P(p) (((size_t) p) % alignof (u64) != 0)
+ if (UNALIGNED_P (buffer))
+ while (len > 128)
+ {
+ sha512_process_block (memcpy (ctx->buffer, buffer, 128), 128, ctx);
+ buffer = (const char *) buffer + 128;
+ len -= 128;
+ }
+ else
+#endif
+ {
+ sha512_process_block (buffer, len & ~127, ctx);
+ buffer = (const char *) buffer + (len & ~127);
+ len &= 127;
+ }
+ }
+
+ /* Move remaining bytes in internal buffer. */
+ if (len > 0)
+ {
+ size_t left_over = ctx->buflen;
+
+ memcpy (&((char *) ctx->buffer)[left_over], buffer, len);
+ left_over += len;
+ if (left_over >= 128)
+ {
+ sha512_process_block (ctx->buffer, 128, ctx);
+ left_over -= 128;
+ memcpy (ctx->buffer, &ctx->buffer[16], left_over);
+ }
+ ctx->buflen = left_over;
+ }
+}
+
+/* --- Code below is the primary difference between sha1.c and sha512.c --- */
+
+/* SHA512 round constants */
+#define K(I) sha512_round_constants[I]
+static u64 const sha512_round_constants[80] = {
+ u64init (0x428a2f98, 0xd728ae22), u64init (0x71374491, 0x23ef65cd),
+ u64init (0xb5c0fbcf, 0xec4d3b2f), u64init (0xe9b5dba5, 0x8189dbbc),
+ u64init (0x3956c25b, 0xf348b538), u64init (0x59f111f1, 0xb605d019),
+ u64init (0x923f82a4, 0xaf194f9b), u64init (0xab1c5ed5, 0xda6d8118),
+ u64init (0xd807aa98, 0xa3030242), u64init (0x12835b01, 0x45706fbe),
+ u64init (0x243185be, 0x4ee4b28c), u64init (0x550c7dc3, 0xd5ffb4e2),
+ u64init (0x72be5d74, 0xf27b896f), u64init (0x80deb1fe, 0x3b1696b1),
+ u64init (0x9bdc06a7, 0x25c71235), u64init (0xc19bf174, 0xcf692694),
+ u64init (0xe49b69c1, 0x9ef14ad2), u64init (0xefbe4786, 0x384f25e3),
+ u64init (0x0fc19dc6, 0x8b8cd5b5), u64init (0x240ca1cc, 0x77ac9c65),
+ u64init (0x2de92c6f, 0x592b0275), u64init (0x4a7484aa, 0x6ea6e483),
+ u64init (0x5cb0a9dc, 0xbd41fbd4), u64init (0x76f988da, 0x831153b5),
+ u64init (0x983e5152, 0xee66dfab), u64init (0xa831c66d, 0x2db43210),
+ u64init (0xb00327c8, 0x98fb213f), u64init (0xbf597fc7, 0xbeef0ee4),
+ u64init (0xc6e00bf3, 0x3da88fc2), u64init (0xd5a79147, 0x930aa725),
+ u64init (0x06ca6351, 0xe003826f), u64init (0x14292967, 0x0a0e6e70),
+ u64init (0x27b70a85, 0x46d22ffc), u64init (0x2e1b2138, 0x5c26c926),
+ u64init (0x4d2c6dfc, 0x5ac42aed), u64init (0x53380d13, 0x9d95b3df),
+ u64init (0x650a7354, 0x8baf63de), u64init (0x766a0abb, 0x3c77b2a8),
+ u64init (0x81c2c92e, 0x47edaee6), u64init (0x92722c85, 0x1482353b),
+ u64init (0xa2bfe8a1, 0x4cf10364), u64init (0xa81a664b, 0xbc423001),
+ u64init (0xc24b8b70, 0xd0f89791), u64init (0xc76c51a3, 0x0654be30),
+ u64init (0xd192e819, 0xd6ef5218), u64init (0xd6990624, 0x5565a910),
+ u64init (0xf40e3585, 0x5771202a), u64init (0x106aa070, 0x32bbd1b8),
+ u64init (0x19a4c116, 0xb8d2d0c8), u64init (0x1e376c08, 0x5141ab53),
+ u64init (0x2748774c, 0xdf8eeb99), u64init (0x34b0bcb5, 0xe19b48a8),
+ u64init (0x391c0cb3, 0xc5c95a63), u64init (0x4ed8aa4a, 0xe3418acb),
+ u64init (0x5b9cca4f, 0x7763e373), u64init (0x682e6ff3, 0xd6b2b8a3),
+ u64init (0x748f82ee, 0x5defb2fc), u64init (0x78a5636f, 0x43172f60),
+ u64init (0x84c87814, 0xa1f0ab72), u64init (0x8cc70208, 0x1a6439ec),
+ u64init (0x90befffa, 0x23631e28), u64init (0xa4506ceb, 0xde82bde9),
+ u64init (0xbef9a3f7, 0xb2c67915), u64init (0xc67178f2, 0xe372532b),
+ u64init (0xca273ece, 0xea26619c), u64init (0xd186b8c7, 0x21c0c207),
+ u64init (0xeada7dd6, 0xcde0eb1e), u64init (0xf57d4f7f, 0xee6ed178),
+ u64init (0x06f067aa, 0x72176fba), u64init (0x0a637dc5, 0xa2c898a6),
+ u64init (0x113f9804, 0xbef90dae), u64init (0x1b710b35, 0x131c471b),
+ u64init (0x28db77f5, 0x23047d84), u64init (0x32caab7b, 0x40c72493),
+ u64init (0x3c9ebe0a, 0x15c9bebc), u64init (0x431d67c4, 0x9c100d4c),
+ u64init (0x4cc5d4be, 0xcb3e42b6), u64init (0x597f299c, 0xfc657e2a),
+ u64init (0x5fcb6fab, 0x3ad6faec), u64init (0x6c44198c, 0x4a475817),
+};
+
+/* Round functions. */
+#define F2(A, B, C) u64or (u64and (A, B), u64and (C, u64or (A, B)))
+#define F1(E, F, G) u64xor (G, u64and (E, u64xor (F, G)))
+
+/* Process LEN bytes of BUFFER, accumulating context into CTX.
+ It is assumed that LEN % 128 == 0.
+ Most of this code comes from GnuPG's cipher/sha1.c. */
+
+void
+sha512_process_block (const void *buffer, size_t len, struct sha512_ctx *ctx)
+{
+ u64 const *words = (u64 const *)buffer;
+ u64 const *endp = words + len / sizeof (u64);
+ u64 x[16];
+ u64 a = ctx->state[0];
+ u64 b = ctx->state[1];
+ u64 c = ctx->state[2];
+ u64 d = ctx->state[3];
+ u64 e = ctx->state[4];
+ u64 f = ctx->state[5];
+ u64 g = ctx->state[6];
+ u64 h = ctx->state[7];
+
+ /* First increment the byte count. FIPS PUB 180-2 specifies the possible
+ length of the file up to 2^128 bits. Here we only compute the
+ number of bytes. Do a double word increment. */
+ ctx->total[0] = u64plus (ctx->total[0], u64lo (len));
+ if (u64lt (ctx->total[0], u64lo (len)))
+ ctx->total[1] = u64plus (ctx->total[1], u64lo (1));
+
+#define S0(x) u64xor (u64rol(x, 63), u64xor (u64rol (x, 56), u64shr (x, 7)))
+#define S1(x) u64xor (u64rol (x, 45), u64xor (u64rol (x, 3), u64shr (x, 6)))
+#define SS0(x) u64xor (u64rol (x, 36), u64xor (u64rol (x, 30), u64rol (x, 25)))
+#define SS1(x) u64xor (u64rol(x, 50), u64xor (u64rol (x, 46), u64rol (x, 23)))
+
+#define M(I) (x[(I) & 15] \
+ = u64plus (x[(I) & 15], \
+ u64plus (S1 (x[((I) - 2) & 15]), \
+ u64plus (x[((I) - 7) & 15], \
+ S0 (x[((I) - 15) & 15])))))
+
+#define R(A, B, C, D, E, F, G, H, K, M) \
+ do \
+ { \
+ u64 t0 = u64plus (SS0 (A), F2 (A, B, C)); \
+ u64 t1 = \
+ u64plus (H, u64plus (SS1 (E), \
+ u64plus (F1 (E, F, G), u64plus (K, M)))); \
+ D = u64plus (D, t1); \
+ H = u64plus (t0, t1); \
+ } \
+ while (0)
+
+ while (words < endp)
+ {
+ int t;
+ /* FIXME: see sha1.c for a better implementation. */
+ for (t = 0; t < 16; t++)
+ {
+ x[t] = SWAP (*words);
+ words++;
+ }
+
+ R( a, b, c, d, e, f, g, h, K( 0), x[ 0] );
+ R( h, a, b, c, d, e, f, g, K( 1), x[ 1] );
+ R( g, h, a, b, c, d, e, f, K( 2), x[ 2] );
+ R( f, g, h, a, b, c, d, e, K( 3), x[ 3] );
+ R( e, f, g, h, a, b, c, d, K( 4), x[ 4] );
+ R( d, e, f, g, h, a, b, c, K( 5), x[ 5] );
+ R( c, d, e, f, g, h, a, b, K( 6), x[ 6] );
+ R( b, c, d, e, f, g, h, a, K( 7), x[ 7] );
+ R( a, b, c, d, e, f, g, h, K( 8), x[ 8] );
+ R( h, a, b, c, d, e, f, g, K( 9), x[ 9] );
+ R( g, h, a, b, c, d, e, f, K(10), x[10] );
+ R( f, g, h, a, b, c, d, e, K(11), x[11] );
+ R( e, f, g, h, a, b, c, d, K(12), x[12] );
+ R( d, e, f, g, h, a, b, c, K(13), x[13] );
+ R( c, d, e, f, g, h, a, b, K(14), x[14] );
+ R( b, c, d, e, f, g, h, a, K(15), x[15] );
+ R( a, b, c, d, e, f, g, h, K(16), M(16) );
+ R( h, a, b, c, d, e, f, g, K(17), M(17) );
+ R( g, h, a, b, c, d, e, f, K(18), M(18) );
+ R( f, g, h, a, b, c, d, e, K(19), M(19) );
+ R( e, f, g, h, a, b, c, d, K(20), M(20) );
+ R( d, e, f, g, h, a, b, c, K(21), M(21) );
+ R( c, d, e, f, g, h, a, b, K(22), M(22) );
+ R( b, c, d, e, f, g, h, a, K(23), M(23) );
+ R( a, b, c, d, e, f, g, h, K(24), M(24) );
+ R( h, a, b, c, d, e, f, g, K(25), M(25) );
+ R( g, h, a, b, c, d, e, f, K(26), M(26) );
+ R( f, g, h, a, b, c, d, e, K(27), M(27) );
+ R( e, f, g, h, a, b, c, d, K(28), M(28) );
+ R( d, e, f, g, h, a, b, c, K(29), M(29) );
+ R( c, d, e, f, g, h, a, b, K(30), M(30) );
+ R( b, c, d, e, f, g, h, a, K(31), M(31) );
+ R( a, b, c, d, e, f, g, h, K(32), M(32) );
+ R( h, a, b, c, d, e, f, g, K(33), M(33) );
+ R( g, h, a, b, c, d, e, f, K(34), M(34) );
+ R( f, g, h, a, b, c, d, e, K(35), M(35) );
+ R( e, f, g, h, a, b, c, d, K(36), M(36) );
+ R( d, e, f, g, h, a, b, c, K(37), M(37) );
+ R( c, d, e, f, g, h, a, b, K(38), M(38) );
+ R( b, c, d, e, f, g, h, a, K(39), M(39) );
+ R( a, b, c, d, e, f, g, h, K(40), M(40) );
+ R( h, a, b, c, d, e, f, g, K(41), M(41) );
+ R( g, h, a, b, c, d, e, f, K(42), M(42) );
+ R( f, g, h, a, b, c, d, e, K(43), M(43) );
+ R( e, f, g, h, a, b, c, d, K(44), M(44) );
+ R( d, e, f, g, h, a, b, c, K(45), M(45) );
+ R( c, d, e, f, g, h, a, b, K(46), M(46) );
+ R( b, c, d, e, f, g, h, a, K(47), M(47) );
+ R( a, b, c, d, e, f, g, h, K(48), M(48) );
+ R( h, a, b, c, d, e, f, g, K(49), M(49) );
+ R( g, h, a, b, c, d, e, f, K(50), M(50) );
+ R( f, g, h, a, b, c, d, e, K(51), M(51) );
+ R( e, f, g, h, a, b, c, d, K(52), M(52) );
+ R( d, e, f, g, h, a, b, c, K(53), M(53) );
+ R( c, d, e, f, g, h, a, b, K(54), M(54) );
+ R( b, c, d, e, f, g, h, a, K(55), M(55) );
+ R( a, b, c, d, e, f, g, h, K(56), M(56) );
+ R( h, a, b, c, d, e, f, g, K(57), M(57) );
+ R( g, h, a, b, c, d, e, f, K(58), M(58) );
+ R( f, g, h, a, b, c, d, e, K(59), M(59) );
+ R( e, f, g, h, a, b, c, d, K(60), M(60) );
+ R( d, e, f, g, h, a, b, c, K(61), M(61) );
+ R( c, d, e, f, g, h, a, b, K(62), M(62) );
+ R( b, c, d, e, f, g, h, a, K(63), M(63) );
+ R( a, b, c, d, e, f, g, h, K(64), M(64) );
+ R( h, a, b, c, d, e, f, g, K(65), M(65) );
+ R( g, h, a, b, c, d, e, f, K(66), M(66) );
+ R( f, g, h, a, b, c, d, e, K(67), M(67) );
+ R( e, f, g, h, a, b, c, d, K(68), M(68) );
+ R( d, e, f, g, h, a, b, c, K(69), M(69) );
+ R( c, d, e, f, g, h, a, b, K(70), M(70) );
+ R( b, c, d, e, f, g, h, a, K(71), M(71) );
+ R( a, b, c, d, e, f, g, h, K(72), M(72) );
+ R( h, a, b, c, d, e, f, g, K(73), M(73) );
+ R( g, h, a, b, c, d, e, f, K(74), M(74) );
+ R( f, g, h, a, b, c, d, e, K(75), M(75) );
+ R( e, f, g, h, a, b, c, d, K(76), M(76) );
+ R( d, e, f, g, h, a, b, c, K(77), M(77) );
+ R( c, d, e, f, g, h, a, b, K(78), M(78) );
+ R( b, c, d, e, f, g, h, a, K(79), M(79) );
+
+ a = ctx->state[0] = u64plus (ctx->state[0], a);
+ b = ctx->state[1] = u64plus (ctx->state[1], b);
+ c = ctx->state[2] = u64plus (ctx->state[2], c);
+ d = ctx->state[3] = u64plus (ctx->state[3], d);
+ e = ctx->state[4] = u64plus (ctx->state[4], e);
+ f = ctx->state[5] = u64plus (ctx->state[5], f);
+ g = ctx->state[6] = u64plus (ctx->state[6], g);
+ h = ctx->state[7] = u64plus (ctx->state[7], h);
+ }
+}
+
+#ifdef __cplusplus
+}
+#endif
diff --git a/rocketmq-cpp/libs/signature/src/spas_client.c b/rocketmq-cpp/libs/signature/src/spas_client.c
new file mode 100755
index 00000000..08b5a2de
--- /dev/null
+++ b/rocketmq-cpp/libs/signature/src/spas_client.c
@@ -0,0 +1,508 @@
+#include <stdio.h>
+#include <stdlib.h>
+#include <string.h>
+#include <signal.h>
+#include <sys/types.h>
+#include <sys/stat.h>
+
+#include "spas_client.h"
+#include "sha1.h"
+#include "sha256.h"
+#include "hmac.h"
+#include "base64.h"
+
+#ifdef WIN32
+#include <io.h>
+#include <process.h>
+#else
+#include <unistd.h>
+#endif
+#ifdef SPAS_MT
+#include <pthread.h>
+#endif
+
+#ifdef __cplusplus
+namespace metaqSignature{
+#endif
+
+#define SPAS_VERSION "SPAS_V1_0"
+
+static SPAS_CREDENTIAL g_credential;
+static char g_path[SPAS_MAX_PATH];
+static int g_loaded = 0;
+static unsigned int refresh = 10;
+static time_t modified = 0;
+
+#ifdef SPAS_MT
+
+static pthread_mutex_t cred_mutex = PTHREAD_MUTEX_INITIALIZER;
+static pthread_once_t cred_once = PTHREAD_ONCE_INIT;
+static pthread_key_t cred_key;
+
+#endif
+
+extern void * _mem_alloc(unsigned int size);
+extern void * _mem_realloc(void *ptr, unsigned int old_size, unsigned int new_size);
+extern void _mem_free(void *ptr);
+extern void _trim(char *str);
+
+
+void * _mem_alloc(unsigned int size) {
+ void *p = malloc(size);
+ if (p != NULL) {
+ memset(p, 0, size);
+ }
+ return p;
+}
+
+void * _mem_realloc(void *ptr, unsigned int old_size, unsigned int new_size) {
+ void *p = realloc(ptr, new_size);
+ if (p != NULL && new_size > old_size) {
+ memset((unsigned int *)p + old_size, 0, new_size - old_size);
+ }
+ return p;
+}
+
+
+void _mem_free(void *ptr) {
+ free(ptr);
+}
+
+void _trim(char *str) {
+ int len = strlen(str);
+ int i;
+ int done = 0;
+ for (i = len - 1; i >= 0; i--) {
+ switch (str[i]) {
+ case ' ':
+ case '\t':
+ case '\r':
+ case '\n':
+ str[i] = '\0';
+ break;
+ default:
+ done = 1;
+ break;
+ }
+ if (done) {
+ break;
+ }
+ }
+}
+
+static int _load_credential(SPAS_CREDENTIAL *pcred, char *path) {
+ FILE *fp = NULL;
+ char buf[SPAS_MAX_KEY_LEN * 2];
+ if (pcred == NULL || path == NULL) {
+ return ERROR_INVALID_PARAM;
+ }
+ fp = fopen(path, "r");
+ if (fp == NULL) {
+ return ERROR_FILE_OPEN;
+ }
+ memset(pcred, 0, sizeof(SPAS_CREDENTIAL));
+ while (fgets(buf, sizeof(buf), fp)) {
+ _trim(buf);
+ int len = strlen(SPAS_ACCESS_KEY_TAG);
+ if (strncmp(buf, SPAS_ACCESS_KEY_TAG, len) == 0 && buf[len] == '=') {
+ strncpy(pcred->access_key, buf + len + 1, SPAS_MAX_KEY_LEN - 1);
+ }
+ else {
+ len = strlen(SPAS_SECRET_KEY_TAG);
+ if (strncmp(buf, SPAS_SECRET_KEY_TAG, len) == 0 && buf[len] == '=') {
+ strncpy(pcred->secret_key, buf + len + 1, SPAS_MAX_KEY_LEN - 1);
+ }
+ }
+ }
+ fclose(fp);
+ if (strlen(pcred->access_key) == 0 || strlen(pcred->secret_key) == 0) {
+ return ERROR_MISSING_KEY;
+ }
+ return NO_ERROR;
+}
+
+#ifndef WIN32
+static void _reload_credential(int sig) {
+ int ret;
+ SPAS_CREDENTIAL credential;
+ struct stat status;
+ struct sigaction act;
+
+ if (sig != SIGALRM) {
+ return;
+ }
+
+ memset(&act, 0, sizeof(act));
+ act.sa_handler = _reload_credential;
+ sigaction(SIGALRM, &act, NULL);
+ alarm(refresh);
+ if (g_path[0] != '\0') {
+ ret = stat(g_path, &status);
+ if (ret != 0) {
+ return;
+ }
+ if (status.st_mtime == modified) {
+ return;
+ }
+ ret = _load_credential(&credential, g_path);
+ if (ret != NO_ERROR) {
+ return;
+ }
+#ifdef SPAS_MT
+ pthread_mutex_lock(&cred_mutex);
+#endif
+ memcpy(&g_credential, &credential, sizeof(SPAS_CREDENTIAL));
+#ifdef SPAS_MT
+ pthread_mutex_unlock(&cred_mutex);
+#endif
+ modified = status.st_mtime;
+ }
+}
+
+static int _update_credential_by_alarm() {
+ struct sigaction act;
+
+ memset(&act, 0, sizeof(act));
+ act.sa_handler = _reload_credential;
+ sigaction(SIGALRM, &act, NULL);
+ alarm(refresh);
+ return NO_ERROR;
+}
+#endif
+
+#ifdef SPAS_MT
+
+static void * _update_credential_entry(void *arg) {
+ int ret;
+ SPAS_CREDENTIAL credential;
+ struct stat status;
+ struct timeval tv;
+ while (1) {
+ tv.tv_sec = refresh;
+ tv.tv_usec = 0;
+ select(0, NULL, NULL, NULL, &tv);
+ if (g_path[0] != '\0') {
+ ret = stat(g_path, &status);
+ if (ret != 0) {
+ continue;
+ }
+ if (status.st_mtime == modified) {
+ continue;
+ }
+ ret = _load_credential(&credential, g_path);
+ if (ret != NO_ERROR) {
+ continue;
+ }
+ pthread_mutex_lock(&cred_mutex);
+ memcpy(&g_credential, &credential, sizeof(SPAS_CREDENTIAL));
+ pthread_mutex_unlock(&cred_mutex);
+ modified = status.st_mtime;
+ }
+ }
+ return NULL;
+}
+
+static int _update_credential_by_thread() {
+ pthread_t tid;
+ int ret;
+
+ ret = pthread_create(&tid, NULL, _update_credential_entry, NULL);
+ if (ret != 0) {
+ return ERROR_UPDATE_CREDENTIAL;
+ }
+ pthread_detach(tid);
+ return NO_ERROR;
+}
+
+
+
+int spas_load_credential(char *path, CREDENTIAL_UPDATE_MODE mode) {
+ int ret = NO_ERROR;
+ SPAS_CREDENTIAL credential;
+
+ if (g_loaded) {
+ return NO_ERROR;
+ }
+ if (path == NULL) {
+ path = getenv(SPAS_CREDENTIAL_ENV);
+ if (path == NULL) {
+ return ERROR_NO_CREDENTIAL;
+ }
+ }
+ strncpy(g_path, path, SPAS_MAX_PATH - 1);
+ ret = _load_credential(&credential, path);
+ if (ret != NO_ERROR) {
+ return ret;
+ }
+#ifdef SPAS_MT
+ pthread_mutex_lock(&cred_mutex);
+#endif
+ if (!g_loaded) {
+ memcpy(&g_credential, &credential, sizeof(SPAS_CREDENTIAL));
+ g_loaded = 1;
+ }
+#ifdef SPAS_MT
+ pthread_mutex_unlock(&cred_mutex);
+#endif
+ switch (mode) {
+ case UPDATE_BY_ALARM:
+ ret = _update_credential_by_alarm();
+ break;
+#ifdef SPAS_MT
+ case UPDATE_BY_THREAD:
+ ret = _update_credential_by_thread();
+ break;
+#endif
+ case NO_UPDATE:
+ default:
+ ret = NO_ERROR;
+ break;
+ }
+ return ret;
+}
+
+#endif
+
+SPAS_CREDENTIAL * spas_get_credential(void) {
+ SPAS_CREDENTIAL *credential = (SPAS_CREDENTIAL *)_mem_alloc(sizeof(SPAS_CREDENTIAL));
+ if (credential != NULL) {
+#ifdef SPAS_MT
+ pthread_mutex_lock(&cred_mutex);
+#endif
+ memcpy(credential, &g_credential, sizeof(SPAS_CREDENTIAL));
+#ifdef SPAS_MT
+ pthread_mutex_unlock(&cred_mutex);
+#endif
+ }
+ return credential;
+}
+
+
+int spas_set_access_key(char *key) {
+ int len = 0;
+ if (key == NULL) {
+ return ERROR_INVALID_PARAM;
+ }
+ len = strlen(key);
+ if (len == 0 || len >= SPAS_MAX_KEY_LEN) {
+ return ERROR_KEY_LENGTH;
+ }
+#ifdef SPAS_MT
+ pthread_mutex_lock(&cred_mutex);
+#endif
+ memcpy(g_credential.access_key, key, len + 1);
+#ifdef SPAS_MT
+ pthread_mutex_unlock(&cred_mutex);
+#endif
+ return NO_ERROR;
+}
+
+int spas_set_secret_key(char *key) {
+ int len = 0;
+ if (key == NULL) {
+ return ERROR_INVALID_PARAM;
+ }
+ len = strlen(key);
+ if (len == 0 || len >= SPAS_MAX_KEY_LEN) {
+ return ERROR_KEY_LENGTH;
+ }
+#ifdef SPAS_MT
+ pthread_mutex_lock(&cred_mutex);
+#endif
+ memcpy(g_credential.secret_key, key, len + 1);
+#ifdef SPAS_MT
+ pthread_mutex_unlock(&cred_mutex);
+#endif
+ return NO_ERROR;
+}
+
+char * spas_get_access_key() {
+ return g_credential.access_key;
+}
+
+char * spas_get_secret_key() {
+ return g_credential.secret_key;
+}
+
+#ifdef SPAS_MT
+
+static void _free_thread_credential(void* credential)
+{
+ if (credential != NULL) {
+ _mem_free(credential);
+ }
+}
+
+static void _init_credential_key(void) {
+ pthread_key_create(&cred_key, _free_thread_credential);
+}
+
+static SPAS_CREDENTIAL * _get_thread_credential(void) {
+ int ret = 0;
+ SPAS_CREDENTIAL *credential = NULL;
+ ret = pthread_once(&cred_once, _init_credential_key);
+ if (ret != 0) {
+ return NULL;
+ }
+ credential = pthread_getspecific(cred_key);
+ if (credential == NULL) {
+ credential = _mem_alloc(sizeof(SPAS_CREDENTIAL));
+ if (credential == NULL) {
+ return NULL;
+ }
+ ret = pthread_setspecific(cred_key, credential);
+ if (ret != 0) {
+ _mem_free(credential);
+ return NULL;
+ }
+ }
+ return credential;
+}
+
+int spas_load_thread_credential(char *path) {
+ int ret = NO_ERROR;
+ SPAS_CREDENTIAL * credential = NULL;
+ credential = _get_thread_credential();
+ if (credential == NULL) {
+ return ERROR_MEM_ALLOC;
+ }
+ ret = _load_credential(credential, path);
+ if (ret != NO_ERROR) {
+ memset(credential, 0, sizeof(SPAS_CREDENTIAL));
+ return ret;
+ }
+ return NO_ERROR;
+}
+
+int spas_set_thread_access_key(char *key) {
+ int len = 0;
+ SPAS_CREDENTIAL * credential = NULL;
+ if (key == NULL) {
+ return ERROR_INVALID_PARAM;
+ }
+ len = strlen(key);
+ if (len == 0 || len >= SPAS_MAX_KEY_LEN) {
+ return ERROR_KEY_LENGTH;
+ }
+ credential = _get_thread_credential();
+ if (credential == NULL) {
+ return ERROR_MEM_ALLOC;
+ }
+ memcpy(credential->access_key, key, len + 1);
+ return NO_ERROR;
+}
+
+int spas_set_thread_secret_key(char *key) {
+ int len = 0;
+ SPAS_CREDENTIAL * credential = NULL;
+ if (key == NULL) {
+ return ERROR_INVALID_PARAM;
+ }
+ len = strlen(key);
+ if (len == 0 || len >= SPAS_MAX_KEY_LEN) {
+ return ERROR_KEY_LENGTH;
+ }
+ credential = _get_thread_credential();
+ if (credential == NULL) {
+ return ERROR_MEM_ALLOC;
+ }
+ memcpy(credential->secret_key, key, len + 1);
+ return NO_ERROR;
+
+}
+
+char * spas_get_thread_access_key(void) {
+ SPAS_CREDENTIAL * credential = _get_thread_credential();
+ if (credential == NULL) {
+ return NULL;
+ }
+ return credential->access_key;
+}
+
+char * spas_get_thread_secret_key(void) {
+ SPAS_CREDENTIAL * credential = _get_thread_credential();
+ if (credential == NULL) {
+ return NULL;
+ }
+ return credential->secret_key;
+}
+
+#endif
+
+
+char * spas_get_signature(const SPAS_PARAM_LIST *list, const char *key) {
+ return spas_get_signature2(list, key, SIGN_HMACSHA1);
+}
+
+char * spas_get_signature2(const SPAS_PARAM_LIST *list, const char *key, SPAS_SIGN_ALGORITHM algorithm) {
+ char *sign = NULL;
+ char *data = NULL;
+ if (list == NULL || key == NULL) {
+ return NULL;
+ }
+ data = param_list_to_str(list);
+ if (data == NULL) {
+ return NULL;
+ }
+ sign = spas_sign2(data, strlen(data),key, algorithm);
+ _mem_free(data);
+ return sign;
+}
+
+char * spas_sign(const char *data, size_t size, const char *key) {
+ return spas_sign2(data, size, key, SIGN_HMACSHA1);
+}
+
+char * spas_sign2(const char *data, size_t size, const char *key, SPAS_SIGN_ALGORITHM algorithm) {
+ int ret;
+ int dsize = 0;
+ char *sha_buf = NULL;
+ char *base64_ret = NULL;
+ if (data == NULL || key == NULL) {
+ return NULL;
+ }
+ if (algorithm == SIGN_HMACSHA1) {
+ dsize = SHA1_DIGEST_SIZE;
+ sha_buf = (char *)_mem_alloc(dsize + 1);
+ if (sha_buf == NULL) {
+ return NULL;
+ }
+ ret = hmac_sha1(key, strlen(key), data, size, sha_buf);
+ if (ret < 0) {
+ _mem_free(sha_buf);
+ return NULL;
+ }
+ }
+ else if (algorithm == SIGN_HMACSHA256) {
+ dsize = SHA256_DIGEST_SIZE;
+ sha_buf = (char *)_mem_alloc(dsize + 1);
+ if (sha_buf == NULL) {
+ return NULL;
+ }
+ ret = hmac_sha256(key, strlen(key), data, strlen(data), sha_buf);
+ if (ret < 0) {
+ _mem_free(sha_buf);
+ return NULL;
+ }
+ }
+ else {
+ return NULL;
+ }
+ ret = base64_encode_alloc(sha_buf, dsize, &base64_ret);
+ _mem_free(sha_buf);
+ return base64_ret;
+
+}
+
+void spas_mem_free(char *pSignature)
+{
+ _mem_free(pSignature);
+}
+
+char * spas_get_version(void) {
+ return SPAS_VERSION;
+}
+
+#ifdef __cplusplus
+}
+#endif
\ No newline at end of file
diff --git a/rocketmq-cpp/project/CMakeLists.txt b/rocketmq-cpp/project/CMakeLists.txt
new file mode 100755
index 00000000..02723afd
--- /dev/null
+++ b/rocketmq-cpp/project/CMakeLists.txt
@@ -0,0 +1,63 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# source files
+project(rocketmq4cpp)
+
+file(GLOB_RECURSE SRC_FILES ${CMAKE_SOURCE_DIR}/src/*)
+list(REMOVE_ITEM SRC_FILES ${CMAKE_SOURCE_DIR}/src/dllmain.cpp)
+
+# subdirs
+SET(SUB_DIRS)
+file(GLOB children ${CMAKE_SOURCE_DIR}/src/*)
+FOREACH(child ${children})
+ IF(IS_DIRECTORY ${child})
+ LIST(APPEND SUB_DIRS ${child})
+ ENDIF()
+ENDFOREACH()
+LIST(APPEND SUB_DIRS ${CMAKE_SOURCE_DIR}/src)
+
+include_directories(${CMAKE_SOURCE_DIR}/include)
+include_directories(${SUB_DIRS})
+
+# libs_directories
+file(GLOB LIB_DIRS ${CMAKE_SOURCE_DIR}/libs/*)
+foreach(dir ${LIB_DIRS})
+ if(IS_DIRECTORY ${dir})
+ set(CMAKE_PREFIX_PATH ${CMAKE_PREFIX_PATH};${dir})
+ include_directories(${dir}/include)
+ endif()
+endforeach()
+
+# static
+add_library(rocketmq_static STATIC ${SRC_FILES})
+set_target_properties(rocketmq_static PROPERTIES OUTPUT_NAME "rocketmq")
+add_dependencies(rocketmq_static Signature)
+target_link_libraries(rocketmq_static ${deplibs})
+target_link_libraries(rocketmq_static Signature)
+
+# shared
+set(CMAKE_SHARED_LINKER_FLAGS "-DBOOST_ALL_DYN_LINK -shared")
+add_library(rocketmq_shared SHARED ${SRC_FILES})
+set_target_properties(rocketmq_shared PROPERTIES OUTPUT_NAME "rocketmq")
+add_dependencies(rocketmq_shared Signature)
+target_link_libraries(rocketmq_shared ${deplibs})
+target_link_libraries(rocketmq_shared Signature)
+
+# install
+install (TARGETS rocketmq_static DESTINATION bin)
+install (DIRECTORY ${CMAKE_SOURCE_DIR}/include/ DESTINATION include)
+install (DIRECTORY ${CMAKE_SOURCE_DIR}/doc/ DESTINATION doc)
+
diff --git a/rocketmq-cpp/project/tool.mak b/rocketmq-cpp/project/tool.mak
new file mode 100644
index 00000000..e8f57fcb
--- /dev/null
+++ b/rocketmq-cpp/project/tool.mak
@@ -0,0 +1,21 @@
+define BUILD_LIBRARY
+$(if $(wildcard $@),@$(RM) $@)
+$(if $(wildcard ar.mac),@$(RM) ar.mac)
+$(if $(filter %.a, $^),
+@echo CREATE $@ > ar.mac
+@echo SAVE >> ar.mac
+@echo END >> ar.mac
+@$(AR) -M < ar.mac
+)
+$(if $(filter %.o,$^),@$(AR) -q $@ $(filter %.o, $^))
+$(if $(filter %.a, $^),
+@echo OPEN $@ > ar.mac
+$(foreach LIB, $(filter %.a, $^),
+@echo ADDLIB $(LIB) >> ar.mac
+)
+@echo SAVE >> ar.mac
+@echo END >> ar.mac
+@$(AR) -M < ar.mac
+@$(RM) ar.mac
+)
+endef
\ No newline at end of file
diff --git a/rocketmq-cpp/src/MQClientAPIImpl.cpp b/rocketmq-cpp/src/MQClientAPIImpl.cpp
new file mode 100755
index 00000000..2d9c39cf
--- /dev/null
+++ b/rocketmq-cpp/src/MQClientAPIImpl.cpp
@@ -0,0 +1,922 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "MQClientAPIImpl.h"
+#include <assert.h>
+#include <fstream>
+#include "CommunicationMode.h"
+#include "Logging.h"
+#include "MQDecoder.h"
+#include "PullResultExt.h"
+
+namespace rocketmq {
+//<!************************************************************************
+MQClientAPIImpl::MQClientAPIImpl(
+ const string& mqClientId, ClientRemotingProcessor* clientRemotingProcessor, int pullThreadNum,
+ uint64_t tcpConnectTimeout, uint64_t tcpTransportTryLockTimeout,
+ string unitName)
+ : m_firstFetchNameSrv(true), m_mqClientId(mqClientId) {
+ m_pRemotingClient.reset(new TcpRemotingClient(
+ pullThreadNum, tcpConnectTimeout, tcpTransportTryLockTimeout));
+ m_pRemotingClient->registerProcessor(CHECK_TRANSACTION_STATE,
+ clientRemotingProcessor);
+ m_pRemotingClient->registerProcessor(RESET_CONSUMER_CLIENT_OFFSET,
+ clientRemotingProcessor);
+ m_pRemotingClient->registerProcessor(GET_CONSUMER_STATUS_FROM_CLIENT,
+ clientRemotingProcessor);
+ m_pRemotingClient->registerProcessor(GET_CONSUMER_RUNNING_INFO,
+ clientRemotingProcessor);
+ m_pRemotingClient->registerProcessor(NOTIFY_CONSUMER_IDS_CHANGED,
+ clientRemotingProcessor);
+ m_pRemotingClient->registerProcessor(CONSUME_MESSAGE_DIRECTLY,
+ clientRemotingProcessor);
+
+ m_topAddressing.reset(new TopAddressing(unitName));
+}
+
+MQClientAPIImpl::~MQClientAPIImpl() {
+ m_pRemotingClient = NULL;
+ m_topAddressing = NULL;
+}
+
+void MQClientAPIImpl::stopAllTcpTransportThread() {
+ m_pRemotingClient->stopAllTcpTransportThread();
+}
+
+bool MQClientAPIImpl::writeDataToFile(string filename, string data,
+ bool isSync) {
+ if (data.size() == 0) return false;
+
+ int fd = open(filename.c_str(), O_RDWR | O_CREAT, 0755);
+ if (fd < 0) {
+ LOG_ERROR("open file failed, file:%s, msg:%s", filename.c_str(),
+ strerror(errno));
+ return false;
+ }
+
+ int byte_write = 0;
+ int byte_left = data.size();
+ const char* pData = data.c_str();
+ while (byte_left > 0) {
+ byte_write = write(fd, pData, byte_left);
+ if (byte_write == -1) {
+ LOG_ERROR("write data fail, data len:%zu, file:%s, msg:%s", data.size(),
+ filename.c_str(), strerror(errno));
+ close(fd);
+ return false;
+ }
+ byte_left -= byte_write;
+ pData += byte_write;
+ }
+ pData = NULL;
+
+ if (isSync) {
+ LOG_INFO("fsync with filename:%s", filename.c_str());
+ fsync(fd);
+ }
+ close(fd);
+
+ return true;
+}
+
+string MQClientAPIImpl::fetchNameServerAddr(const string& NSDomain) {
+ try {
+ string homeDir(UtilAll::getHomeDirectory());
+ string storePath = homeDir + "/logs/metaq-client4cpp/snapshot";
+
+ if (access(storePath.c_str(), F_OK) != 0) {
+ if (mkdir(storePath.c_str(), S_IRWXU | S_IRWXG | S_IRWXO) != 0) {
+ LOG_ERROR("create data dir:%s error", storePath.c_str());
+ }
+ }
+ string file(storePath);
+ string fileBak(storePath);
+ vector<string> ret_;
+ int retSize = UtilAll::Split(ret_, m_mqClientId, "@");
+ if(retSize==2){
+ file.append("/nameserver_addr-").append(ret_[retSize-1]);
+ }else{
+ LOG_ERROR("split mqClientId:%s fail", m_mqClientId.c_str());
+ file.append("/nameserver_addr-DEFAULT");
+ }
+ fileBak.append("/nameserver_addr.bak");
+ const string addrs = m_topAddressing->fetchNSAddr(NSDomain);
+ if (addrs.empty()) {
+ if (m_nameSrvAddr.empty()) {
+ LOG_INFO("Load the name server snapshot local file:%s", file.c_str());
+ if (access(file.c_str(), F_OK) == 0) {
+ ifstream snapshot_file(file, ios::binary);
+ istreambuf_iterator<char> beg(snapshot_file), end;
+ string filecontent(beg, end);
+ updateNameServerAddr(filecontent);
+ m_nameSrvAddr = filecontent;
+ } else {
+ LOG_WARN("The name server snapshot local file not exists");
+ }
+ }
+ } else {
+ if (m_firstFetchNameSrv == true) {
+ // it is the first time, so need to create the name server snapshot
+ // local file
+ m_firstFetchNameSrv = false;
+ }
+ if (addrs.compare(m_nameSrvAddr) != 0) {
+ LOG_INFO("name server address changed, old: %s, new: %s",
+ m_nameSrvAddr.c_str(), addrs.c_str());
+ updateNameServerAddr(addrs);
+ m_nameSrvAddr = addrs;
+ } else {
+ if (!m_firstFetchNameSrv) return m_nameSrvAddr;
+ }
+ // update the snapshot local file if nameSrv changes or
+ // m_firstFetchNameSrv==true
+ if (writeDataToFile(fileBak, addrs, true)) {
+ if (rename(fileBak.c_str(), file.c_str()) == -1)
+ LOG_ERROR("could not rename bak file:%s", strerror(errno));
+ }
+ }
+
+ if (access(file.c_str(), F_OK) != 0) {
+ // the name server snapshot local file maybe deleted by force, create it
+ if (writeDataToFile(fileBak, m_nameSrvAddr, true)) {
+ if (rename(fileBak.c_str(), file.c_str()) == -1)
+ LOG_ERROR("could not rename bak file:%s", strerror(errno));
+ }
+ }
+ } catch (...) {
+ }
+ return m_nameSrvAddr;
+}
+
+void MQClientAPIImpl::updateNameServerAddr(const string& addrs) {
+ if (m_pRemotingClient != NULL)
+ m_pRemotingClient->updateNameServerAddressList(addrs);
+}
+
+void MQClientAPIImpl::callSignatureBeforeRequest(
+ const string& addr, RemotingCommand& request,
+ const SessionCredentials& session_credentials) {
+ ClientRPCHook rpcHook(session_credentials);
+ rpcHook.doBeforeRequest(addr, request);
+}
+
+// Note: all request rules: throw exception if got broker error response,
+// exclude getTopicRouteInfoFromNameServer and unregisterClient
+void MQClientAPIImpl::createTopic(
+ const string& addr, const string& defaultTopic, TopicConfig topicConfig,
+ const SessionCredentials& sessionCredentials) {
+ string topicWithProjectGroup = topicConfig.getTopicName();
+ CreateTopicRequestHeader* requestHeader = new CreateTopicRequestHeader();
+ requestHeader->topic = (topicWithProjectGroup);
+ requestHeader->defaultTopic = (defaultTopic);
+ requestHeader->readQueueNums = (topicConfig.getReadQueueNums());
+ requestHeader->writeQueueNums = (topicConfig.getWriteQueueNums());
+ requestHeader->perm = (topicConfig.getPerm());
+ requestHeader->topicFilterType = (topicConfig.getTopicFilterType());
+
+ RemotingCommand request(UPDATE_AND_CREATE_TOPIC, requestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE:
+ return;
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, response->getRemark(),
+ response->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+SendResult MQClientAPIImpl::sendMessage(
+ const string& addr, const string& brokerName, const MQMessage& msg,
+ SendMessageRequestHeader* pRequestHeader, int timeoutMillis,
+ int communicationMode, SendCallback* pSendCallback,
+ const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(SEND_MESSAGE, pRequestHeader);
+ string body = msg.getBody();
+ request.SetBody(body.c_str(), body.length());
+ request.setMsgBody(body);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ switch (communicationMode) {
+ case ComMode_ONEWAY:
+ m_pRemotingClient->invokeOneway(addr, request);
+ break;
+ case ComMode_ASYNC:
+ sendMessageAsync(addr, brokerName, msg, request, pSendCallback,
+ timeoutMillis);
+ break;
+ case ComMode_SYNC:
+ return sendMessageSync(addr, brokerName, msg, request, timeoutMillis);
+ default:
+ break;
+ }
+ return SendResult();
+}
+
+void MQClientAPIImpl::sendHearbeat(
+ const string& addr, HeartbeatData* pHeartbeatData,
+ const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(HEART_BEAT, NULL);
+
+ string body;
+ pHeartbeatData->Encode(body);
+ request.SetBody(body.data(), body.length());
+ request.setMsgBody(body);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ if (m_pRemotingClient->invokeHeartBeat(addr, request)) {
+ LOG_INFO("sendheartbeat to broker:%s success", addr.c_str());
+ }
+}
+
+void MQClientAPIImpl::unregisterClient(
+ const string& addr, const string& clientID, const string& producerGroup,
+ const string& consumerGroup, const SessionCredentials& sessionCredentials) {
+ LOG_INFO("unregisterClient to broker:%s", addr.c_str());
+ RemotingCommand request(UNREGISTER_CLIENT,
+ new UnregisterClientRequestHeader(
+ clientID, producerGroup, consumerGroup));
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE:
+ LOG_INFO("unregisterClient to:%s success", addr.c_str());
+ return;
+ default:
+ break;
+ }
+ LOG_WARN("unregisterClient fail:%s,%d", response->getRemark().c_str(),
+ response->getCode());
+ }
+}
+
+// return NULL if got no response or error response
+TopicRouteData* MQClientAPIImpl::getTopicRouteInfoFromNameServer(
+ const string& topic, int timeoutMillis,
+ const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(GET_ROUTEINTO_BY_TOPIC,
+ new GetRouteInfoRequestHeader(topic));
+ callSignatureBeforeRequest("", request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> pResponse(
+ m_pRemotingClient->invokeSync("", request, timeoutMillis));
+
+ if (pResponse != NULL) {
+ if (((*(pResponse->GetBody())).getSize() == 0) ||
+ ((*(pResponse->GetBody())).getData() != NULL)) {
+ switch (pResponse->getCode()) {
+ case SUCCESS_VALUE: {
+ const MemoryBlock* pbody = pResponse->GetBody();
+ if (pbody->getSize()) {
+ TopicRouteData* topicRoute = TopicRouteData::Decode(pbody);
+ return topicRoute;
+ }
+ }
+ case TOPIC_NOT_EXIST: {
+ return NULL;
+ }
+ default:
+ break;
+ }
+ LOG_WARN("%s,%d", pResponse->getRemark().c_str(), pResponse->getCode());
+ return NULL;
+ }
+ }
+ return NULL;
+}
+
+TopicList* MQClientAPIImpl::getTopicListFromNameServer(
+ const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(GET_ALL_TOPIC_LIST_FROM_NAMESERVER, NULL);
+ callSignatureBeforeRequest("", request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> pResponse(
+ m_pRemotingClient->invokeSync("", request));
+ if (pResponse != NULL) {
+ if (((*(pResponse->GetBody())).getSize() == 0) ||
+ ((*(pResponse->GetBody())).getData() != NULL)) {
+ switch (pResponse->getCode()) {
+ case SUCCESS_VALUE: {
+ const MemoryBlock* pbody = pResponse->GetBody();
+ if (pbody->getSize()) {
+ TopicList* topicList = TopicList::Decode(pbody);
+ return topicList;
+ }
+ }
+ default:
+ break;
+ }
+
+ THROW_MQEXCEPTION(MQClientException, pResponse->getRemark(),
+ pResponse->getCode());
+ }
+ }
+ return NULL;
+}
+
+int MQClientAPIImpl::wipeWritePermOfBroker(const string& namesrvAddr,
+ const string& brokerName,
+ int timeoutMillis) {
+ return 0;
+}
+
+void MQClientAPIImpl::deleteTopicInBroker(const string& addr,
+ const string& topic,
+ int timeoutMillis) {}
+
+void MQClientAPIImpl::deleteTopicInNameServer(const string& addr,
+ const string& topic,
+ int timeoutMillis) {}
+
+void MQClientAPIImpl::deleteSubscriptionGroup(const string& addr,
+ const string& groupName,
+ int timeoutMillis) {}
+
+string MQClientAPIImpl::getKVConfigByValue(const string& projectNamespace,
+ const string& projectGroup,
+ int timeoutMillis) {
+ return "";
+}
+
+KVTable MQClientAPIImpl::getKVListByNamespace(const string& projectNamespace,
+ int timeoutMillis) {
+ return KVTable();
+}
+
+void MQClientAPIImpl::deleteKVConfigByValue(const string& projectNamespace,
+ const string& projectGroup,
+ int timeoutMillis) {}
+
+SendResult MQClientAPIImpl::sendMessageSync(const string& addr,
+ const string& brokerName,
+ const MQMessage& msg,
+ RemotingCommand& request,
+ int timeoutMillis) {
+ //<!block util response;
+ unique_ptr<RemotingCommand> pResponse(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+ if (pResponse != NULL) {
+ try {
+ LOG_DEBUG("sendMessageSync success:%s to addr:%s,brokername:%s",
+ msg.toString().c_str(), addr.c_str(), brokerName.c_str());
+ SendResult result = processSendResponse(brokerName, msg, pResponse.get());
+ return result;
+ } catch (...) {
+ LOG_ERROR("send error");
+ }
+ }
+ THROW_MQEXCEPTION(MQClientException, "response is null", -1);
+}
+
+void MQClientAPIImpl::sendMessageAsync(const string& addr,
+ const string& brokerName,
+ const MQMessage& msg,
+ RemotingCommand& request,
+ SendCallback* pSendCallback,
+ int64 timeoutMilliseconds) {
+ //<!delete in future;
+ AsyncCallbackWrap* cbw =
+ new SendCallbackWrap(brokerName, msg, pSendCallback, this);
+ if (m_pRemotingClient->invokeAsync(addr, request, cbw, timeoutMilliseconds) ==
+ false) {
+ LOG_ERROR("sendMessageAsync failed to addr:%s", addr.c_str());
+ if (cbw) {
+ cbw->onException();
+ deleteAndZero(cbw);
+ } else {
+ THROW_MQEXCEPTION(MQClientException, "sendMessageAsync failed", -1);
+ }
+ }
+}
+
+PullResult* MQClientAPIImpl::pullMessage(
+ const string& addr, PullMessageRequestHeader* pRequestHeader,
+ int timeoutMillis, int communicationMode, PullCallback* pullCallback,
+ void* pArg, const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(PULL_MESSAGE, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ switch (communicationMode) {
+ case ComMode_ONEWAY:
+ break;
+ case ComMode_ASYNC:
+ pullMessageAsync(addr, request, timeoutMillis, pullCallback, pArg);
+ break;
+ case ComMode_SYNC:
+ return pullMessageSync(addr, request, timeoutMillis);
+ default:
+ break;
+ }
+
+ return NULL;
+}
+
+void MQClientAPIImpl::pullMessageAsync(const string& addr,
+ RemotingCommand& request,
+ int timeoutMillis,
+ PullCallback* pullCallback, void* pArg) {
+ //<!delete in future;
+ AsyncCallbackWrap* cbw = new PullCallbackWarp(pullCallback, this, pArg);
+ if (m_pRemotingClient->invokeAsync(addr, request, cbw, timeoutMillis) ==
+ false) {
+ LOG_ERROR("pullMessageAsync failed of addr:%s", addr.c_str());
+ deleteAndZero(cbw);
+ THROW_MQEXCEPTION(MQClientException, "pullMessageAsync failed", -1);
+ }
+}
+
+PullResult* MQClientAPIImpl::pullMessageSync(const string& addr,
+ RemotingCommand& request,
+ int timeoutMillis) {
+ unique_ptr<RemotingCommand> pResponse(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+ if (pResponse != NULL) {
+ if (((*(pResponse->GetBody())).getSize() == 0) ||
+ ((*(pResponse->GetBody())).getData() != NULL)) {
+ try {
+ PullResult* pullResult =
+ processPullResponse(pResponse.get()); // pullMessage will handle
+ // exception from
+ // processPullResponse
+ return pullResult;
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ return NULL;
+ }
+ }
+ }
+ return NULL;
+}
+
+SendResult MQClientAPIImpl::processSendResponse(const string& brokerName,
+ const MQMessage& msg,
+ RemotingCommand* pResponse) {
+ SendStatus sendStatus = SEND_OK;
+ int res = 0;
+ switch (pResponse->getCode()) {
+ case FLUSH_DISK_TIMEOUT:
+ sendStatus = SEND_FLUSH_DISK_TIMEOUT;
+ break;
+ case FLUSH_SLAVE_TIMEOUT:
+ sendStatus = SEND_FLUSH_SLAVE_TIMEOUT;
+ break;
+ case SLAVE_NOT_AVAILABLE:
+ sendStatus = SEND_SLAVE_NOT_AVAILABLE;
+ break;
+ case SUCCESS_VALUE:
+ sendStatus = SEND_OK;
+ break;
+ default:
+ res = -1;
+ break;
+ }
+ if (res == 0) {
+ SendMessageResponseHeader* responseHeader =
+ (SendMessageResponseHeader*)pResponse->getCommandHeader();
+ MQMessageQueue messageQueue(msg.getTopic(), brokerName,
+ responseHeader->queueId);
+ return SendResult(sendStatus, responseHeader->msgId, messageQueue,
+ responseHeader->queueOffset);
+ }
+ LOG_ERROR("processSendResponse error remark:%s, error code:%d",
+ (pResponse->getRemark()).c_str(), pResponse->getCode());
+ THROW_MQEXCEPTION(MQClientException, pResponse->getRemark(),
+ pResponse->getCode());
+}
+
+PullResult* MQClientAPIImpl::processPullResponse(RemotingCommand* pResponse) {
+ PullStatus pullStatus = NO_NEW_MSG;
+ switch (pResponse->getCode()) {
+ case SUCCESS_VALUE:
+ pullStatus = FOUND;
+ break;
+ case PULL_NOT_FOUND:
+ pullStatus = NO_NEW_MSG;
+ break;
+ case PULL_RETRY_IMMEDIATELY:
+ pullStatus = NO_MATCHED_MSG;
+ break;
+ case PULL_OFFSET_MOVED:
+ pullStatus = OFFSET_ILLEGAL;
+ break;
+ default:
+ THROW_MQEXCEPTION(MQBrokerException, pResponse->getRemark(),
+ pResponse->getCode());
+ break;
+ }
+
+ PullMessageResponseHeader* responseHeader =
+ static_cast<PullMessageResponseHeader*>(pResponse->getCommandHeader());
+
+ if (!responseHeader) {
+ LOG_ERROR("processPullResponse:responseHeader is NULL");
+ THROW_MQEXCEPTION(MQClientException,
+ "processPullResponse:responseHeader is NULL", -1);
+ }
+ //<!get body,delete outsite;
+ MemoryBlock bodyFromResponse =
+ *(pResponse->GetBody()); // response data judgement had been done outside
+ // of processPullResponse
+ if (bodyFromResponse.getSize() == 0) {
+ if (pullStatus != FOUND) {
+ return new PullResultExt(pullStatus, responseHeader->nextBeginOffset,
+ responseHeader->minOffset,
+ responseHeader->maxOffset,
+ (int)responseHeader->suggestWhichBrokerId);
+ } else {
+ THROW_MQEXCEPTION(MQClientException,
+ "memoryBody size is 0, but pullStatus equals found",
+ -1);
+ }
+ } else {
+ return new PullResultExt(
+ pullStatus, responseHeader->nextBeginOffset, responseHeader->minOffset,
+ responseHeader->maxOffset, (int)responseHeader->suggestWhichBrokerId,
+ bodyFromResponse);
+ }
+}
+
+//<!***************************************************************************
+int64 MQClientAPIImpl::getMinOffset(
+ const string& addr, const string& topic, int queueId, int timeoutMillis,
+ const SessionCredentials& sessionCredentials) {
+ GetMinOffsetRequestHeader* pRequestHeader = new GetMinOffsetRequestHeader();
+ pRequestHeader->topic = topic;
+ pRequestHeader->queueId = queueId;
+
+ RemotingCommand request(GET_MIN_OFFSET, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE: {
+ GetMinOffsetResponseHeader* responseHeader =
+ (GetMinOffsetResponseHeader*)response->getCommandHeader();
+
+ int64 offset = responseHeader->offset;
+ return offset;
+ }
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, response->getRemark(),
+ response->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+int64 MQClientAPIImpl::getMaxOffset(
+ const string& addr, const string& topic, int queueId, int timeoutMillis,
+ const SessionCredentials& sessionCredentials) {
+ GetMaxOffsetRequestHeader* pRequestHeader = new GetMaxOffsetRequestHeader();
+ pRequestHeader->topic = topic;
+ pRequestHeader->queueId = queueId;
+
+ RemotingCommand request(GET_MAX_OFFSET, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE: {
+ GetMaxOffsetResponseHeader* responseHeader =
+ (GetMaxOffsetResponseHeader*)response->getCommandHeader();
+
+ int64 offset = responseHeader->offset;
+ return offset;
+ }
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, response->getRemark(),
+ response->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+int64 MQClientAPIImpl::searchOffset(
+ const string& addr, const string& topic, int queueId, uint64_t timestamp,
+ int timeoutMillis, const SessionCredentials& sessionCredentials) {
+ SearchOffsetRequestHeader* pRequestHeader = new SearchOffsetRequestHeader();
+ pRequestHeader->topic = topic;
+ pRequestHeader->queueId = queueId;
+ pRequestHeader->timestamp = timestamp;
+
+ RemotingCommand request(SEARCH_OFFSET_BY_TIMESTAMP, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE: {
+ SearchOffsetResponseHeader* responseHeader =
+ (SearchOffsetResponseHeader*)response->getCommandHeader();
+
+ int64 offset = responseHeader->offset;
+ return offset;
+ }
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, response->getRemark(),
+ response->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+MQMessageExt* MQClientAPIImpl::viewMessage(
+ const string& addr, int64 phyoffset, int timeoutMillis,
+ const SessionCredentials& sessionCredentials) {
+ ViewMessageRequestHeader* pRequestHeader = new ViewMessageRequestHeader();
+ pRequestHeader->offset = phyoffset;
+
+ RemotingCommand request(VIEW_MESSAGE_BY_ID, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE: {
+ }
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, response->getRemark(),
+ response->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+int64 MQClientAPIImpl::getEarliestMsgStoretime(
+ const string& addr, const string& topic, int queueId, int timeoutMillis,
+ const SessionCredentials& sessionCredentials) {
+ GetEarliestMsgStoretimeRequestHeader* pRequestHeader =
+ new GetEarliestMsgStoretimeRequestHeader();
+ pRequestHeader->topic = topic;
+ pRequestHeader->queueId = queueId;
+
+ RemotingCommand request(GET_EARLIEST_MSG_STORETIME, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE: {
+ GetEarliestMsgStoretimeResponseHeader* responseHeader =
+ (GetEarliestMsgStoretimeResponseHeader*)
+ response->getCommandHeader();
+
+ int64 timestamp = responseHeader->timestamp;
+ return timestamp;
+ }
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, response->getRemark(),
+ response->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+void MQClientAPIImpl::getConsumerIdListByGroup(
+ const string& addr, const string& consumerGroup, vector<string>& cids,
+ int timeoutMillis, const SessionCredentials& sessionCredentials) {
+ GetConsumerListByGroupRequestHeader* pRequestHeader =
+ new GetConsumerListByGroupRequestHeader();
+ pRequestHeader->consumerGroup = consumerGroup;
+
+ RemotingCommand request(GET_CONSUMER_LIST_BY_GROUP, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> pResponse(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (pResponse != NULL) {
+ if ((pResponse->GetBody()->getSize() == 0) ||
+ (pResponse->GetBody()->getData() != NULL)) {
+ switch (pResponse->getCode()) {
+ case SUCCESS_VALUE: {
+ const MemoryBlock* pbody = pResponse->GetBody();
+ if (pbody->getSize()) {
+ GetConsumerListByGroupResponseBody::Decode(pbody, cids);
+ return;
+ }
+ }
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, pResponse->getRemark(),
+ pResponse->getCode());
+ }
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+int64 MQClientAPIImpl::queryConsumerOffset(
+ const string& addr, QueryConsumerOffsetRequestHeader* pRequestHeader,
+ int timeoutMillis, const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(QUERY_CONSUMER_OFFSET, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE: {
+ QueryConsumerOffsetResponseHeader* responseHeader =
+ (QueryConsumerOffsetResponseHeader*)response->getCommandHeader();
+ int64 consumerOffset = responseHeader->offset;
+ return consumerOffset;
+ }
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, response->getRemark(),
+ response->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+ return -1;
+}
+
+void MQClientAPIImpl::updateConsumerOffset(
+ const string& addr, UpdateConsumerOffsetRequestHeader* pRequestHeader,
+ int timeoutMillis, const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(UPDATE_CONSUMER_OFFSET, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE: {
+ return;
+ }
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, response->getRemark(),
+ response->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+void MQClientAPIImpl::updateConsumerOffsetOneway(
+ const string& addr, UpdateConsumerOffsetRequestHeader* pRequestHeader,
+ int timeoutMillis, const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(UPDATE_CONSUMER_OFFSET, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ m_pRemotingClient->invokeOneway(addr, request);
+}
+
+void MQClientAPIImpl::consumerSendMessageBack(
+ MQMessageExt& msg, const string& consumerGroup, int delayLevel,
+ int timeoutMillis, const SessionCredentials& sessionCredentials) {
+ ConsumerSendMsgBackRequestHeader* pRequestHeader =
+ new ConsumerSendMsgBackRequestHeader();
+ pRequestHeader->group = consumerGroup;
+ pRequestHeader->offset = msg.getCommitLogOffset();
+ pRequestHeader->delayLevel = delayLevel;
+
+ string addr = socketAddress2IPPort(msg.getStoreHost());
+ RemotingCommand request(CONSUMER_SEND_MSG_BACK, pRequestHeader);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> response(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (response) {
+ switch (response->getCode()) {
+ case SUCCESS_VALUE: {
+ return;
+ }
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, response->getRemark(),
+ response->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+void MQClientAPIImpl::lockBatchMQ(
+ const string& addr, LockBatchRequestBody* requestBody,
+ vector<MQMessageQueue>& mqs, int timeoutMillis,
+ const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(LOCK_BATCH_MQ, NULL);
+ string body;
+ requestBody->Encode(body);
+ request.SetBody(body.data(), body.length());
+ request.setMsgBody(body);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> pResponse(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (pResponse != NULL) {
+ if (((*(pResponse->GetBody())).getSize() == 0) ||
+ ((*(pResponse->GetBody())).getData() != NULL)) {
+ switch (pResponse->getCode()) {
+ case SUCCESS_VALUE: {
+ const MemoryBlock* pbody = pResponse->GetBody();
+ if (pbody->getSize()) {
+ LockBatchResponseBody::Decode(pbody, mqs);
+ }
+ return;
+ } break;
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, pResponse->getRemark(),
+ pResponse->getCode());
+ }
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+void MQClientAPIImpl::unlockBatchMQ(
+ const string& addr, UnlockBatchRequestBody* requestBody, int timeoutMillis,
+ const SessionCredentials& sessionCredentials) {
+ RemotingCommand request(UNLOCK_BATCH_MQ, NULL);
+ string body;
+ requestBody->Encode(body);
+ request.SetBody(body.data(), body.length());
+ request.setMsgBody(body);
+ callSignatureBeforeRequest(addr, request, sessionCredentials);
+ request.Encode();
+
+ unique_ptr<RemotingCommand> pResponse(
+ m_pRemotingClient->invokeSync(addr, request, timeoutMillis));
+
+ if (pResponse != NULL) {
+ switch (pResponse->getCode()) {
+ case SUCCESS_VALUE: {
+ return;
+ } break;
+ default:
+ break;
+ }
+ THROW_MQEXCEPTION(MQBrokerException, pResponse->getRemark(),
+ pResponse->getCode());
+ }
+ THROW_MQEXCEPTION(MQBrokerException, "response is null", -1);
+}
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/MQClientAPIImpl.h b/rocketmq-cpp/src/MQClientAPIImpl.h
new file mode 100644
index 00000000..31e61a0c
--- /dev/null
+++ b/rocketmq-cpp/src/MQClientAPIImpl.h
@@ -0,0 +1,189 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MQCLIENTAPIIMPL_H__
+#define __MQCLIENTAPIIMPL_H__
+#include "AsyncCallback.h"
+#include "ClientRPCHook.h"
+#include "ClientRemotingProcessor.h"
+#include "CommandHeader.h"
+#include "HeartbeatData.h"
+#include "KVTable.h"
+#include "LockBatchBody.h"
+#include "MQClientException.h"
+#include "MQMessageExt.h"
+#include "MQProtos.h"
+#include "SendResult.h"
+#include "SocketUtil.h"
+#include "TcpRemotingClient.h"
+#include "TopAddressing.h"
+#include "TopicConfig.h"
+#include "TopicList.h"
+#include "TopicRouteData.h"
+#include "UtilAll.h"
+#include "VirtualEnvUtil.h"
+
+namespace rocketmq {
+//<!wrap all API to net ;
+//<!************************************************************************
+class MQClientAPIImpl {
+ public:
+ MQClientAPIImpl(const string& mqClientId, ClientRemotingProcessor* clientRemotingProcessor,
+ int pullThreadNum, uint64_t tcpConnectTimeout,
+ uint64_t tcpTransportTryLockTimeout, string unitName);
+ virtual ~MQClientAPIImpl();
+ void stopAllTcpTransportThread();
+ bool writeDataToFile(string filename, string data, bool isSync);
+ string fetchNameServerAddr(const string& NSDomain);
+ void updateNameServerAddr(const string& addrs);
+
+ void callSignatureBeforeRequest(
+ const string& addr, RemotingCommand& request,
+ const SessionCredentials& session_credentials);
+ void createTopic(const string& addr, const string& defaultTopic,
+ TopicConfig topicConfig,
+ const SessionCredentials& sessionCredentials);
+
+ SendResult sendMessage(const string& addr, const string& brokerName,
+ const MQMessage& msg,
+ SendMessageRequestHeader* pRequestHeader,
+ int timeoutMillis, int communicationMode,
+ SendCallback* pSendCallback,
+ const SessionCredentials& sessionCredentials);
+
+ PullResult* pullMessage(const string& addr,
+ PullMessageRequestHeader* pRequestHeader,
+ int timeoutMillis, int communicationMode,
+ PullCallback* pullCallback, void* pArg,
+ const SessionCredentials& sessionCredentials);
+
+ void sendHearbeat(const string& addr, HeartbeatData* pHeartbeatData,
+ const SessionCredentials& sessionCredentials);
+
+ void unregisterClient(const string& addr, const string& clientID,
+ const string& producerGroup,
+ const string& consumerGroup,
+ const SessionCredentials& sessionCredentials);
+
+ TopicRouteData* getTopicRouteInfoFromNameServer(
+ const string& topic, int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ TopicList* getTopicListFromNameServer(
+ const SessionCredentials& sessionCredentials);
+
+ int wipeWritePermOfBroker(const string& namesrvAddr, const string& brokerName,
+ int timeoutMillis);
+
+ void deleteTopicInBroker(const string& addr, const string& topic,
+ int timeoutMillis);
+
+ void deleteTopicInNameServer(const string& addr, const string& topic,
+ int timeoutMillis);
+
+ void deleteSubscriptionGroup(const string& addr, const string& groupName,
+ int timeoutMillis);
+
+ string getKVConfigByValue(const string& projectNamespace,
+ const string& projectGroup, int timeoutMillis);
+
+ KVTable getKVListByNamespace(const string& projectNamespace,
+ int timeoutMillis);
+
+ void deleteKVConfigByValue(const string& projectNamespace,
+ const string& projectGroup, int timeoutMillis);
+
+ SendResult processSendResponse(const string& brokerName, const MQMessage& msg,
+ RemotingCommand* pResponse);
+
+ PullResult* processPullResponse(RemotingCommand* pResponse);
+
+ int64 getMinOffset(const string& addr, const string& topic, int queueId,
+ int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ int64 getMaxOffset(const string& addr, const string& topic, int queueId,
+ int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ int64 searchOffset(const string& addr, const string& topic, int queueId,
+ uint64_t timestamp, int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ MQMessageExt* viewMessage(const string& addr, int64 phyoffset,
+ int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ int64 getEarliestMsgStoretime(const string& addr, const string& topic,
+ int queueId, int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ void getConsumerIdListByGroup(const string& addr, const string& consumerGroup,
+ vector<string>& cids, int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ int64 queryConsumerOffset(const string& addr,
+ QueryConsumerOffsetRequestHeader* pRequestHeader,
+ int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ void updateConsumerOffset(const string& addr,
+ UpdateConsumerOffsetRequestHeader* pRequestHeader,
+ int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ void updateConsumerOffsetOneway(
+ const string& addr, UpdateConsumerOffsetRequestHeader* pRequestHeader,
+ int timeoutMillis, const SessionCredentials& sessionCredentials);
+
+ void consumerSendMessageBack(MQMessageExt& msg, const string& consumerGroup,
+ int delayLevel, int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ void lockBatchMQ(const string& addr, LockBatchRequestBody* requestBody,
+ vector<MQMessageQueue>& mqs, int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ void unlockBatchMQ(const string& addr, UnlockBatchRequestBody* requestBody,
+ int timeoutMillis,
+ const SessionCredentials& sessionCredentials);
+
+ private:
+ SendResult sendMessageSync(const string& addr, const string& brokerName,
+ const MQMessage& msg, RemotingCommand& request,
+ int timeoutMillis);
+
+ void sendMessageAsync(const string& addr, const string& brokerName,
+ const MQMessage& msg, RemotingCommand& request,
+ SendCallback* pSendCallback, int64 timeoutMilliseconds);
+
+ PullResult* pullMessageSync(const string& addr, RemotingCommand& request,
+ int timeoutMillis);
+
+ void pullMessageAsync(const string& addr, RemotingCommand& request,
+ int timeoutMillis, PullCallback* pullCallback,
+ void* pArg);
+
+ private:
+ unique_ptr<TcpRemotingClient> m_pRemotingClient;
+ unique_ptr<TopAddressing> m_topAddressing;
+ string m_nameSrvAddr;
+ bool m_firstFetchNameSrv;
+ string m_mqClientId;
+};
+} //<!end namespace;
+//<!***************************************************************************
+#endif
diff --git a/rocketmq-cpp/src/MQClientFactory.cpp b/rocketmq-cpp/src/MQClientFactory.cpp
new file mode 100644
index 00000000..ab578ee5
--- /dev/null
+++ b/rocketmq-cpp/src/MQClientFactory.cpp
@@ -0,0 +1,1142 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "MQClientFactory.h"
+#include "ConsumerRunningInfo.h"
+#include "Logging.h"
+#include "MQClientManager.h"
+#include "PullRequest.h"
+#include "Rebalance.h"
+#include "TopicPublishInfo.h"
+
+#define MAX_BUFF_SIZE 8192
+#define SAFE_BUFF_SIZE 7936 // 8192 - 256 = 7936
+#define PROCESS_NAME_BUF_SIZE 256
+
+namespace rocketmq {
+//<!***************************************************************************
+MQClientFactory::MQClientFactory(const string& clientID, int pullThreadNum,
+ uint64_t tcpConnectTimeout,
+ uint64_t tcpTransportTryLockTimeout,
+ string unitName)
+ : m_bFetchNSService(true) {
+ m_clientId = clientID;
+ // default Topic register;
+ boost::shared_ptr<TopicPublishInfo> pDefaultTopicInfo(new TopicPublishInfo());
+ m_topicPublishInfoTable[DEFAULT_TOPIC] = pDefaultTopicInfo;
+ m_pClientRemotingProcessor.reset(new ClientRemotingProcessor(this));
+ m_pClientAPIImpl.reset(new MQClientAPIImpl(
+ m_clientId, m_pClientRemotingProcessor.get(), pullThreadNum, tcpConnectTimeout,
+ tcpTransportTryLockTimeout, unitName));
+ m_serviceState = CREATE_JUST;
+ LOG_DEBUG("MQClientFactory construct");
+}
+
+MQClientFactory::~MQClientFactory() {
+ LOG_INFO("MQClientFactory:%s destruct", m_clientId.c_str());
+
+ for (TRDMAP::iterator itp = m_topicRouteTable.begin();
+ itp != m_topicRouteTable.end(); ++itp) {
+ delete itp->second;
+ }
+
+ m_producerTable.clear();
+ m_consumerTable.clear();
+ m_topicRouteTable.clear();
+ m_brokerAddrTable.clear();
+ m_topicPublishInfoTable.clear();
+
+ m_pClientAPIImpl = NULL;
+}
+
+void MQClientFactory::start() {
+ switch (m_serviceState) {
+ case CREATE_JUST:
+ LOG_INFO("MQClientFactory:%s start", m_clientId.c_str());
+ m_serviceState = START_FAILED;
+ //<!start time task;
+ m_async_service_thread.reset(new boost::thread(boost::bind(
+ &MQClientFactory::startScheduledTask, this, m_bFetchNSService)));
+ m_serviceState = RUNNING;
+ break;
+ case RUNNING:
+ case SHUTDOWN_ALREADY:
+ case START_FAILED:
+ LOG_INFO("The Factory object:%s start failed with fault state:%d",
+ m_clientId.c_str(), m_serviceState);
+ break;
+ default:
+ break;
+ }
+}
+
+void MQClientFactory::updateTopicRouteInfo(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t) {
+ if ((getConsumerTableSize() == 0) && (getProducerTableSize() == 0)) {
+ return;
+ }
+
+ set<string> topicList;
+ //<!Consumer;
+ getTopicListFromConsumerSubscription(topicList);
+
+ //<!Producer;
+ getTopicListFromTopicPublishInfo(topicList);
+
+ //<! update;
+ {
+ SessionCredentials session_credentials;
+ getSessionCredentialsFromOneOfProducerOrConsumer(session_credentials);
+ set<string>::iterator it = topicList.begin();
+ for (; it != topicList.end(); ++it) {
+ updateTopicRouteInfoFromNameServer(*it, session_credentials);
+ }
+ }
+
+ boost::system::error_code e;
+ t->expires_at(t->expires_at() + boost::posix_time::seconds(30), e);
+ t->async_wait(
+ boost::bind(&MQClientFactory::updateTopicRouteInfo, this, ec, t));
+}
+
+TopicRouteData* MQClientFactory::getTopicRouteData(const string& topic) {
+ boost::lock_guard<boost::mutex> lock(m_topicRouteTableMutex);
+ if (m_topicRouteTable.find(topic) != m_topicRouteTable.end()) {
+ return m_topicRouteTable[topic];
+ }
+ return NULL;
+}
+
+void MQClientFactory::addTopicRouteData(const string& topic,
+ TopicRouteData* pTopicRouteData) {
+ boost::lock_guard<boost::mutex> lock(m_topicRouteTableMutex);
+ if (m_topicRouteTable.find(topic) != m_topicRouteTable.end()) {
+ delete m_topicRouteTable[topic];
+ m_topicRouteTable.erase(topic);
+ }
+ m_topicRouteTable[topic] = pTopicRouteData;
+}
+
+boost::shared_ptr<TopicPublishInfo> MQClientFactory::tryToFindTopicPublishInfo(
+ const string& topic, const SessionCredentials& session_credentials) {
+ boost::lock_guard<boost::mutex> lock(
+ m_topicPublishInfoLock); // add topicPublishInfoLock to avoid con-current
+ // excuting updateTopicRouteInfoFromNameServer
+ // when producer send msg before topicRouteInfo
+ // was got;
+ if (!isTopicInfoValidInTable(topic)) {
+ updateTopicRouteInfoFromNameServer(topic, session_credentials);
+ }
+ //<!if not exsit ,update dafult topic;
+ if (!isTopicInfoValidInTable(topic)) {
+ LOG_INFO("updateTopicRouteInfoFromNameServer with default");
+ updateTopicRouteInfoFromNameServer(topic, session_credentials, true);
+ }
+
+ if (!isTopicInfoValidInTable(topic)) {
+ LOG_WARN("tryToFindTopicPublishInfo null:%s", topic.c_str());
+ boost::shared_ptr<TopicPublishInfo> pTopicPublishInfo;
+ return pTopicPublishInfo;
+ }
+
+ return getTopicPublishInfoFromTable(topic);
+}
+
+bool MQClientFactory::updateTopicRouteInfoFromNameServer(
+ const string& topic, const SessionCredentials& session_credentials,
+ bool isDefault /* = false */) {
+ boost::lock_guard<boost::mutex> lock(m_factoryLock);
+ unique_ptr<TopicRouteData> pTopicRouteData;
+ LOG_INFO("updateTopicRouteInfoFromNameServer start:%s", topic.c_str());
+
+ if (isDefault) {
+ pTopicRouteData.reset(m_pClientAPIImpl->getTopicRouteInfoFromNameServer(
+ DEFAULT_TOPIC, 1000 * 5, session_credentials));
+ if (pTopicRouteData != NULL) {
+ vector<QueueData>& queueDatas = pTopicRouteData->getQueueDatas();
+ vector<QueueData>::iterator it = queueDatas.begin();
+ for (; it != queueDatas.end(); ++it) {
+ // ¶Áд·ÖÇø¸öÊýÊÇÒ»Ö£¬¹ÊÖ»×öÒ»´ÎÅжÏ;
+ int queueNums = std::min(4, it->readQueueNums);
+ it->readQueueNums = queueNums;
+ it->writeQueueNums = queueNums;
+ }
+ }
+ } else {
+ pTopicRouteData.reset(m_pClientAPIImpl->getTopicRouteInfoFromNameServer(
+ topic, 1000 * 5, session_credentials));
+ }
+
+ if (pTopicRouteData != NULL) {
+ LOG_INFO("updateTopicRouteInfoFromNameServer has data");
+ TopicRouteData* pTemp = getTopicRouteData(topic);
+ bool changed = true;
+ if (pTemp != NULL) {
+ changed = !(*pTemp == *pTopicRouteData);
+ }
+
+ if (getConsumerTableSize() > 0) {
+ vector<MQMessageQueue> mqs;
+ topicRouteData2TopicSubscribeInfo(topic, pTopicRouteData.get(), mqs);
+ updateConsumerSubscribeTopicInfo(topic, mqs);
+ }
+
+ if (changed) {
+ //<!update Broker addr
+ LOG_INFO("updateTopicRouteInfoFromNameServer changed:%s", topic.c_str());
+ vector<BrokerData> brokerList = pTopicRouteData->getBrokerDatas();
+ vector<BrokerData>::iterator it = brokerList.begin();
+ for (; it != brokerList.end(); ++it) {
+ LOG_INFO(
+ "updateTopicRouteInfoFromNameServer changed with broker name:%s",
+ (*it).brokerName.c_str());
+ addBrokerToAddrMap((*it).brokerName, (*it).brokerAddrs);
+ }
+
+ //<! update publish info;
+ {
+ boost::shared_ptr<TopicPublishInfo> publishInfo(
+ topicRouteData2TopicPublishInfo(topic, pTopicRouteData.get()));
+ addTopicInfoToTable(topic, publishInfo); // erase first, then add
+ }
+
+ //<! update subscribe info
+ addTopicRouteData(topic, pTopicRouteData.release());
+ }
+ LOG_DEBUG("updateTopicRouteInfoFromNameServer end:%s", topic.c_str());
+ return true;
+ }
+ LOG_DEBUG("updateTopicRouteInfoFromNameServer end null:%s", topic.c_str());
+ return false;
+}
+
+boost::shared_ptr<TopicPublishInfo>
+MQClientFactory::topicRouteData2TopicPublishInfo(const string& topic,
+ TopicRouteData* pRoute) {
+ boost::shared_ptr<TopicPublishInfo> info(new TopicPublishInfo());
+ string OrderTopicConf = pRoute->getOrderTopicConf();
+ //<! order msg
+ if (!OrderTopicConf.empty()) {
+ // "broker-a:8";"broker-b:8"
+ vector<string> brokers;
+ UtilAll::Split(brokers, OrderTopicConf, ';');
+ for (size_t i = 0; i < brokers.size(); i++) {
+ vector<string> item;
+ UtilAll::Split(item, brokers[i], ':');
+ int nums = atoi(item[1].c_str());
+ for (int i = 0; i < nums; i++) {
+ MQMessageQueue mq(topic, item[0], i);
+ info->updateMessageQueueList(mq);
+ }
+ }
+ }
+ //<!no order msg
+ else {
+ vector<QueueData>& queueDatas = pRoute->getQueueDatas();
+ vector<QueueData>::iterator it = queueDatas.begin();
+ for (; it != queueDatas.end(); ++it) {
+ QueueData& qd = (*it);
+ if (PermName::isWriteable(qd.perm)) {
+ string addr = findBrokerAddressInPublish(qd.brokerName);
+ if (addr.empty()) {
+ continue;
+ }
+ for (int i = 0; i < qd.writeQueueNums; i++) {
+ MQMessageQueue mq(topic, qd.brokerName, i);
+ info->updateMessageQueueList(mq);
+ }
+ }
+ }
+ }
+ return info;
+}
+
+void MQClientFactory::topicRouteData2TopicSubscribeInfo(
+ const string& topic, TopicRouteData* pRoute, vector<MQMessageQueue>& mqs) {
+ mqs.clear();
+ vector<QueueData>& queueDatas = pRoute->getQueueDatas();
+ vector<QueueData>::iterator it = queueDatas.begin();
+ for (; it != queueDatas.end(); ++it) {
+ QueueData& qd = (*it);
+ if (PermName::isReadable(qd.perm)) {
+ for (int i = 0; i < qd.readQueueNums; i++) {
+ MQMessageQueue mq(topic, qd.brokerName, i);
+ mqs.push_back(mq);
+ }
+ }
+ }
+}
+
+void MQClientFactory::shutdown() {
+ if (getConsumerTableSize() != 0) return;
+
+ if (getProducerTableSize() != 0) return;
+
+ switch (m_serviceState) {
+ case RUNNING: {
+ //<! stop;
+ if (m_consumer_async_service_thread) {
+ m_consumer_async_ioService.stop();
+ m_consumer_async_service_thread->interrupt();
+ m_consumer_async_service_thread->join();
+ }
+ m_async_ioService.stop();
+ m_async_service_thread->interrupt();
+ m_async_service_thread->join();
+ m_pClientAPIImpl->stopAllTcpTransportThread(); // Note: stop all
+ // TcpTransport Threads
+ // and release all
+ // responseFuture
+ // conditions
+ m_serviceState = SHUTDOWN_ALREADY;
+ LOG_INFO("MQClientFactory:%s shutdown", m_clientId.c_str());
+ break;
+ }
+ case SHUTDOWN_ALREADY:
+ case CREATE_JUST:
+ break;
+ default:
+ break;
+ }
+
+ //<!ɾ³ý×Ô¼º;
+ MQClientManager::getInstance()->removeClientFactory(m_clientId);
+}
+
+bool MQClientFactory::registerProducer(MQProducer* pProducer) {
+ string groupName = pProducer->getGroupName();
+ string namesrvaddr = pProducer->getNamesrvAddr();
+ if (groupName.empty()) {
+ return false;
+ }
+
+ if (!addProducerToTable(groupName, pProducer)) {
+ return false;
+ }
+
+ LOG_DEBUG("registerProducer success:%s", groupName.c_str());
+ //<!set nameserver;
+ if (namesrvaddr.empty()) {
+ string nameSrvDomain(pProducer->getNamesrvDomain());
+ if (!nameSrvDomain.empty()) m_nameSrvDomain = nameSrvDomain;
+ pProducer->setNamesrvAddr(
+ m_pClientAPIImpl->fetchNameServerAddr(m_nameSrvDomain));
+ } else {
+ m_bFetchNSService = false;
+ m_pClientAPIImpl->updateNameServerAddr(namesrvaddr);
+ LOG_INFO("user specfied name server address: %s", namesrvaddr.c_str());
+ }
+ return true;
+}
+
+void MQClientFactory::unregisterProducer(MQProducer* pProducer) {
+ string groupName = pProducer->getGroupName();
+ unregisterClient(groupName, "", pProducer->getSessionCredentials());
+
+ eraseProducerFromTable(groupName);
+}
+
+bool MQClientFactory::registerConsumer(MQConsumer* pConsumer) {
+ string groupName = pConsumer->getGroupName();
+ string namesrvaddr = pConsumer->getNamesrvAddr();
+ if (groupName.empty()) {
+ return false;
+ }
+
+ if (!addConsumerToTable(groupName, pConsumer)) {
+ return false;
+ }
+ LOG_DEBUG("registerConsumer success:%s", groupName.c_str());
+ //<!set nameserver;
+ if (namesrvaddr.empty()) {
+ string nameSrvDomain(pConsumer->getNamesrvDomain());
+ if (!nameSrvDomain.empty()) m_nameSrvDomain = nameSrvDomain;
+ pConsumer->setNamesrvAddr(
+ m_pClientAPIImpl->fetchNameServerAddr(m_nameSrvDomain));
+ } else {
+ m_bFetchNSService = false;
+ m_pClientAPIImpl->updateNameServerAddr(namesrvaddr);
+ LOG_INFO("user specfied name server address: %s", namesrvaddr.c_str());
+ }
+
+ return true;
+}
+
+void MQClientFactory::unregisterConsumer(MQConsumer* pConsumer) {
+ string groupName = pConsumer->getGroupName();
+ unregisterClient("", groupName, pConsumer->getSessionCredentials());
+
+ eraseConsumerFromTable(groupName);
+}
+
+MQProducer* MQClientFactory::selectProducer(const string& producerName) {
+ boost::lock_guard<boost::mutex> lock(m_producerTableMutex);
+ if (m_producerTable.find(producerName) != m_producerTable.end()) {
+ return m_producerTable[producerName];
+ }
+ return NULL;
+}
+
+bool MQClientFactory::getSessionCredentialFromProducerTable(
+ SessionCredentials& sessionCredentials) {
+ boost::lock_guard<boost::mutex> lock(m_producerTableMutex);
+ for (MQPMAP::iterator it = m_producerTable.begin();
+ it != m_producerTable.end(); ++it) {
+ if (it->second) sessionCredentials = it->second->getSessionCredentials();
+ }
+
+ if (sessionCredentials.isValid()) return true;
+
+ return false;
+}
+
+bool MQClientFactory::addProducerToTable(const string& producerName,
+ MQProducer* pMQProducer) {
+ boost::lock_guard<boost::mutex> lock(m_producerTableMutex);
+ if (m_producerTable.find(producerName) != m_producerTable.end()) return false;
+ m_producerTable[producerName] = pMQProducer;
+ return true;
+}
+
+void MQClientFactory::eraseProducerFromTable(const string& producerName) {
+ boost::lock_guard<boost::mutex> lock(m_producerTableMutex);
+ if (m_producerTable.find(producerName) != m_producerTable.end())
+ m_producerTable.erase(producerName);
+}
+
+int MQClientFactory::getProducerTableSize() {
+ boost::lock_guard<boost::mutex> lock(m_producerTableMutex);
+ return m_producerTable.size();
+}
+
+void MQClientFactory::insertProducerInfoToHeartBeatData(
+ HeartbeatData* pHeartbeatData) {
+ boost::lock_guard<boost::mutex> lock(m_producerTableMutex);
+ for (MQPMAP::iterator it = m_producerTable.begin();
+ it != m_producerTable.end(); ++it) {
+ ProducerData producerData;
+ producerData.groupName = it->first;
+ pHeartbeatData->insertDataToProducerDataSet(producerData);
+ }
+}
+
+MQConsumer* MQClientFactory::selectConsumer(const string& group) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ if (m_consumerTable.find(group) != m_consumerTable.end()) {
+ return m_consumerTable[group];
+ }
+ return NULL;
+}
+
+bool MQClientFactory::getSessionCredentialFromConsumerTable(
+ SessionCredentials& sessionCredentials) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ for (MQCMAP::iterator it = m_consumerTable.begin();
+ it != m_consumerTable.end(); ++it) {
+ if (it->second) sessionCredentials = it->second->getSessionCredentials();
+ }
+
+ if (sessionCredentials.isValid()) return true;
+
+ return false;
+}
+
+bool MQClientFactory::getSessionCredentialFromConsumer(
+ const string& consumerGroup, SessionCredentials& sessionCredentials) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ if (m_consumerTable.find(consumerGroup) != m_consumerTable.end()) {
+ sessionCredentials =
+ m_consumerTable[consumerGroup]->getSessionCredentials();
+ }
+
+ if (sessionCredentials.isValid()) return true;
+
+ return false;
+}
+
+bool MQClientFactory::addConsumerToTable(const string& consumerName,
+ MQConsumer* pMQConsumer) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ if (m_consumerTable.find(consumerName) != m_consumerTable.end()) return false;
+ m_consumerTable[consumerName] = pMQConsumer;
+ return true;
+}
+
+void MQClientFactory::eraseConsumerFromTable(const string& consumerName) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ if (m_consumerTable.find(consumerName) != m_consumerTable.end())
+ m_consumerTable.erase(consumerName); // do not need freee pConsumer, as it
+ // was allocated by user
+ else
+ LOG_WARN("could not find consumer:%s from table", consumerName.c_str());
+}
+
+int MQClientFactory::getConsumerTableSize() {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ return m_consumerTable.size();
+}
+
+void MQClientFactory::getTopicListFromConsumerSubscription(
+ set<string>& topicList) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ for (MQCMAP::iterator it = m_consumerTable.begin();
+ it != m_consumerTable.end(); ++it) {
+ vector<SubscriptionData> result;
+ it->second->getSubscriptions(result);
+
+ vector<SubscriptionData>::iterator iter = result.begin();
+ for (; iter != result.end(); ++iter) {
+ topicList.insert((*iter).getTopic());
+ }
+ }
+}
+
+void MQClientFactory::updateConsumerSubscribeTopicInfo(
+ const string& topic, vector<MQMessageQueue> mqs) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ for (MQCMAP::iterator it = m_consumerTable.begin();
+ it != m_consumerTable.end(); ++it) {
+ it->second->updateTopicSubscribeInfo(topic, mqs);
+ }
+}
+
+void MQClientFactory::insertConsumerInfoToHeartBeatData(
+ HeartbeatData* pHeartbeatData) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ for (MQCMAP::iterator it = m_consumerTable.begin();
+ it != m_consumerTable.end(); ++it) {
+ MQConsumer* pConsumer = it->second;
+ ConsumerData consumerData;
+ consumerData.groupName = pConsumer->getGroupName();
+ consumerData.consumeType = pConsumer->getConsumeType();
+ consumerData.messageModel = pConsumer->getMessageModel();
+ consumerData.consumeFromWhere = pConsumer->getConsumeFromWhere();
+
+ //<!fill data;
+ vector<SubscriptionData> result;
+ pConsumer->getSubscriptions(result);
+ consumerData.subscriptionDataSet.swap(result);
+
+ pHeartbeatData->insertDataToConsumerDataSet(consumerData);
+ }
+}
+
+void MQClientFactory::addTopicInfoToTable(
+ const string& topic,
+ boost::shared_ptr<TopicPublishInfo> pTopicPublishInfo) {
+ boost::lock_guard<boost::mutex> lock(m_topicPublishInfoTableMutex);
+ if (m_topicPublishInfoTable.find(topic) != m_topicPublishInfoTable.end()) {
+ m_topicPublishInfoTable.erase(topic);
+ }
+ m_topicPublishInfoTable[topic] = pTopicPublishInfo;
+}
+
+void MQClientFactory::eraseTopicInfoFromTable(const string& topic) {
+ boost::lock_guard<boost::mutex> lock(m_topicPublishInfoTableMutex);
+ if (m_topicPublishInfoTable.find(topic) != m_topicPublishInfoTable.end()) {
+ m_topicPublishInfoTable.erase(topic);
+ }
+}
+
+bool MQClientFactory::isTopicInfoValidInTable(const string& topic) {
+ boost::lock_guard<boost::mutex> lock(m_topicPublishInfoTableMutex);
+ if (m_topicPublishInfoTable.find(topic) != m_topicPublishInfoTable.end()) {
+ if (m_topicPublishInfoTable[topic]->ok()) return true;
+ }
+ return false;
+}
+
+boost::shared_ptr<TopicPublishInfo>
+MQClientFactory::getTopicPublishInfoFromTable(const string& topic) {
+ boost::lock_guard<boost::mutex> lock(m_topicPublishInfoTableMutex);
+ if (m_topicPublishInfoTable.find(topic) != m_topicPublishInfoTable.end()) {
+ return m_topicPublishInfoTable[topic];
+ }
+ boost::shared_ptr<TopicPublishInfo> pTopicPublishInfo;
+ return pTopicPublishInfo;
+}
+
+void MQClientFactory::getTopicListFromTopicPublishInfo(set<string>& topicList) {
+ boost::lock_guard<boost::mutex> lock(m_topicPublishInfoTableMutex);
+ for (TPMap::iterator itp = m_topicPublishInfoTable.begin();
+ itp != m_topicPublishInfoTable.end(); ++itp) {
+ topicList.insert(itp->first);
+ }
+}
+
+void MQClientFactory::clearBrokerAddrMap() {
+ boost::lock_guard<boost::mutex> lock(m_brokerAddrlock);
+ m_brokerAddrTable.clear();
+}
+
+void MQClientFactory::addBrokerToAddrMap(const string& brokerName,
+ map<int, string>& brokerAddrs) {
+ boost::lock_guard<boost::mutex> lock(m_brokerAddrlock);
+ if (m_brokerAddrTable.find(brokerName) != m_brokerAddrTable.end()) {
+ m_brokerAddrTable.erase(brokerName);
+ }
+ m_brokerAddrTable[brokerName] = brokerAddrs;
+}
+
+MQClientFactory::BrokerAddrMAP MQClientFactory::getBrokerAddrMap() {
+ boost::lock_guard<boost::mutex> lock(m_brokerAddrlock);
+ return m_brokerAddrTable;
+}
+
+string MQClientFactory::findBrokerAddressInPublish(const string& brokerName) {
+ /*reslove the concurrent access m_brokerAddrTable by
+ findBrokerAddressInPublish(called by sendKernlImpl) And
+ sendHeartbeatToAllBroker, which leads hign RT of sendMsg
+ 1. change m_brokerAddrTable from hashMap to map;
+ 2. do not add m_factoryLock here, but copy m_brokerAddrTable,
+ this is used to avoid con-current access m_factoryLock by
+ findBrokerAddressInPublish(called by sendKernlImpl) And
+ updateTopicRouteInfoFromNameServer
+
+ Note: after copying m_brokerAddrTable, updateTopicRouteInfoFromNameServer
+ modify m_brokerAddrTable imediatly,
+ after 1st send fail, producer will get topicPushlibshInfo again
+ before next try, so 2nd try will get correct broker to send ms;
+ */
+ BrokerAddrMAP brokerTable(getBrokerAddrMap());
+ string brokerAddr;
+ bool found = false;
+
+ if (brokerTable.find(brokerName) != brokerTable.end()) {
+ map<int, string> brokerMap(brokerTable[brokerName]);
+ map<int, string>::iterator it1 = brokerMap.find(MASTER_ID);
+ if (it1 != brokerMap.end()) {
+ brokerAddr = it1->second;
+ found = true;
+ }
+ }
+
+ brokerTable.clear();
+ if (found) return brokerAddr;
+
+ return "";
+}
+
+FindBrokerResult* MQClientFactory::findBrokerAddressInSubscribe(
+ const string& brokerName, int brokerId, bool onlyThisBroker) {
+ string brokerAddr;
+ bool slave = false;
+ bool found = false;
+ BrokerAddrMAP brokerTable(getBrokerAddrMap());
+
+ if (brokerTable.find(brokerName) != brokerTable.end()) {
+ map<int, string> brokerMap(brokerTable[brokerName]);
+ map<int, string>::iterator it1 = brokerMap.find(brokerId);
+ if (it1 != brokerMap.end()) {
+ brokerAddr = it1->second;
+ slave = (brokerId != MASTER_ID);
+ found = true;
+ } else // from master
+ {
+ it1 = brokerMap.find(MASTER_ID);
+ if (it1 != brokerMap.end()) {
+ brokerAddr = it1->second;
+ slave = false;
+ found = true;
+ }
+ }
+ }
+
+ brokerTable.clear();
+ if (found) return new FindBrokerResult(brokerAddr, slave);
+
+ return NULL;
+}
+
+FindBrokerResult* MQClientFactory::findBrokerAddressInAdmin(
+ const string& brokerName) {
+ BrokerAddrMAP brokerTable(getBrokerAddrMap());
+ bool found = false;
+ bool slave = false;
+ string brokerAddr;
+
+ if (brokerTable.find(brokerName) != brokerTable.end()) {
+ map<int, string> brokerMap(brokerTable[brokerName]);
+ map<int, string>::iterator it1 = brokerMap.begin();
+ if (it1 != brokerMap.end()) {
+ slave = (it1->first != MASTER_ID);
+ found = true;
+ brokerAddr = it1->second;
+ }
+ }
+
+ brokerTable.clear();
+ if (found) return new FindBrokerResult(brokerAddr, slave);
+
+ return NULL;
+}
+
+MQClientAPIImpl* MQClientFactory::getMQClientAPIImpl() const {
+ return m_pClientAPIImpl.get();
+}
+
+void MQClientFactory::sendHeartbeatToAllBroker() {
+ BrokerAddrMAP brokerTable(getBrokerAddrMap());
+ if (brokerTable.size() == 0) {
+ LOG_WARN("sendheartbeat brokeradd is empty");
+ return;
+ }
+
+ unique_ptr<HeartbeatData> heartbeatData(prepareHeartbeatData());
+ bool producerEmpty = heartbeatData->isProducerDataSetEmpty();
+ bool consumerEmpty = heartbeatData->isConsumerDataSetEmpty();
+ if (producerEmpty && consumerEmpty) {
+ LOG_WARN("sendheartbeat heartbeatData empty");
+ brokerTable.clear();
+ return;
+ }
+
+ SessionCredentials session_credentials;
+ getSessionCredentialsFromOneOfProducerOrConsumer(session_credentials);
+ for (BrokerAddrMAP::iterator it = brokerTable.begin();
+ it != brokerTable.end(); ++it) {
+ map<int, string> brokerMap(it->second);
+ map<int, string>::iterator it1 = brokerMap.begin();
+ for (; it1 != brokerMap.end(); ++it1) {
+ string& addr = it1->second;
+ if (consumerEmpty && it1->first != MASTER_ID) continue;
+
+ try {
+ m_pClientAPIImpl->sendHearbeat(addr, heartbeatData.get(),
+ session_credentials);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+ }
+ }
+ brokerTable.clear();
+}
+
+void MQClientFactory::persistAllConsumerOffset(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t) {
+ {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ if (m_consumerTable.size() > 0) {
+ for (MQCMAP::iterator it = m_consumerTable.begin();
+ it != m_consumerTable.end(); ++it) {
+ LOG_DEBUG("Client factory start persistAllConsumerOffset");
+ it->second->persistConsumerOffset();
+ }
+ }
+ }
+
+ boost::system::error_code e;
+ t->expires_at(t->expires_at() + boost::posix_time::seconds(5), e);
+ t->async_wait(
+ boost::bind(&MQClientFactory::persistAllConsumerOffset, this, ec, t));
+}
+
+HeartbeatData* MQClientFactory::prepareHeartbeatData() {
+ HeartbeatData* pHeartbeatData = new HeartbeatData();
+ // clientID
+ pHeartbeatData->setClientID(m_clientId);
+
+ // Consumer
+ insertConsumerInfoToHeartBeatData(pHeartbeatData);
+
+ // Producer
+ insertProducerInfoToHeartBeatData(pHeartbeatData);
+
+ return pHeartbeatData;
+}
+
+void MQClientFactory::timerCB_sendHeartbeatToAllBroker(
+ boost::system::error_code& ec, boost::asio::deadline_timer* t) {
+ sendHeartbeatToAllBroker();
+
+ boost::system::error_code e;
+ t->expires_at(t->expires_at() + boost::posix_time::seconds(30), e);
+ t->async_wait(boost::bind(&MQClientFactory::timerCB_sendHeartbeatToAllBroker,
+ this, ec, t));
+}
+
+void MQClientFactory::fetchNameServerAddr(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t) {
+ m_pClientAPIImpl->fetchNameServerAddr(m_nameSrvDomain);
+
+ boost::system::error_code e;
+ t->expires_at(t->expires_at() + boost::posix_time::seconds(60 * 2), e);
+ t->async_wait(
+ boost::bind(&MQClientFactory::fetchNameServerAddr, this, ec, t));
+}
+
+void MQClientFactory::startScheduledTask(bool startFetchNSService) {
+ boost::asio::io_service::work work(m_async_ioService); // avoid async io
+ // service stops after
+ // first timer timeout
+ // callback
+
+ boost::system::error_code ec1;
+ boost::asio::deadline_timer t1(m_async_ioService,
+ boost::posix_time::seconds(3));
+ t1.async_wait(
+ boost::bind(&MQClientFactory::updateTopicRouteInfo, this, ec1, &t1));
+
+ boost::system::error_code ec2;
+ boost::asio::deadline_timer t2(m_async_ioService,
+ boost::posix_time::milliseconds(10));
+ t2.async_wait(boost::bind(&MQClientFactory::timerCB_sendHeartbeatToAllBroker,
+ this, ec2, &t2));
+
+ if (startFetchNSService) {
+ boost::system::error_code ec5;
+ boost::asio::deadline_timer* t5 = new boost::asio::deadline_timer(
+ m_async_ioService, boost::posix_time::seconds(60 * 2));
+ t5->async_wait(
+ boost::bind(&MQClientFactory::fetchNameServerAddr, this, ec5, t5));
+ }
+
+ LOG_INFO("start scheduled task:%s", m_clientId.c_str());
+ boost::system::error_code ec;
+ m_async_ioService.run(ec);
+}
+
+void MQClientFactory::rebalanceImmediately() {
+ // m_consumer_async_service_thread will be only started once for all consumer
+ if (m_consumer_async_service_thread == NULL) {
+ doRebalance();
+ m_consumer_async_service_thread.reset(new boost::thread(
+ boost::bind(&MQClientFactory::consumer_timerOperation, this)));
+ }
+}
+
+void MQClientFactory::consumer_timerOperation() {
+ LOG_INFO("clientFactory:%s start consumer_timerOperation",
+ m_clientId.c_str());
+ boost::asio::io_service::work work(
+ m_consumer_async_ioService); // avoid async io
+ // service stops after
+ // first timer timeout
+ // callback
+
+ boost::system::error_code ec1;
+ boost::asio::deadline_timer t(m_consumer_async_ioService,
+ boost::posix_time::seconds(10));
+ t.async_wait(
+ boost::bind(&MQClientFactory::timerCB_doRebalance, this, ec1, &t));
+
+ boost::system::error_code ec2;
+ boost::asio::deadline_timer t2(m_consumer_async_ioService,
+ boost::posix_time::seconds(5));
+ t2.async_wait(
+ boost::bind(&MQClientFactory::persistAllConsumerOffset, this, ec2, &t2));
+
+ boost::system::error_code ec;
+ m_consumer_async_ioService.run(ec);
+ LOG_INFO("clientFactory:%s stop consumer_timerOperation", m_clientId.c_str());
+}
+
+void MQClientFactory::timerCB_doRebalance(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t) {
+ doRebalance();
+
+ boost::system::error_code e;
+ t->expires_at(t->expires_at() + boost::posix_time::seconds(10), e);
+ t->async_wait(
+ boost::bind(&MQClientFactory::timerCB_doRebalance, this, ec, t));
+}
+
+void MQClientFactory::doRebalance() {
+ LOG_INFO("Client factory:%s start dorebalance", m_clientId.c_str());
+ if (getConsumerTableSize() > 0) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ for (MQCMAP::iterator it = m_consumerTable.begin();
+ it != m_consumerTable.end(); ++it) {
+ it->second->doRebalance();
+ }
+ }
+}
+
+void MQClientFactory::doRebalanceByConsumerGroup(const string& consumerGroup) {
+ boost::lock_guard<boost::mutex> lock(m_consumerTableMutex);
+ if (m_consumerTable.find(consumerGroup) != m_consumerTable.end()) {
+ LOG_INFO("Client factory:%s start dorebalance for consumer:%s",
+ m_clientId.c_str(), consumerGroup.c_str());
+ MQConsumer* pMQConsumer = m_consumerTable[consumerGroup];
+ pMQConsumer->doRebalance();
+ }
+}
+
+void MQClientFactory::unregisterClient(
+ const string& producerGroup, const string& consumerGroup,
+ const SessionCredentials& sessionCredentials) {
+ BrokerAddrMAP brokerTable(getBrokerAddrMap());
+ for (BrokerAddrMAP::iterator it = brokerTable.begin();
+ it != brokerTable.end(); ++it) {
+ map<int, string> brokerMap(it->second);
+ map<int, string>::iterator it1 = brokerMap.begin();
+ for (; it1 != brokerMap.end(); ++it1) {
+ string& addr = it1->second;
+ m_pClientAPIImpl->unregisterClient(addr, m_clientId, producerGroup,
+ consumerGroup, sessionCredentials);
+ }
+ }
+}
+
+//<!************************************************************************
+void MQClientFactory::fetchSubscribeMessageQueues(
+ const string& topic, vector<MQMessageQueue>& mqs,
+ const SessionCredentials& sessionCredentials) {
+ TopicRouteData* pTopicRouteData = getTopicRouteData(topic);
+ if (pTopicRouteData == NULL) {
+ updateTopicRouteInfoFromNameServer(topic, sessionCredentials);
+ pTopicRouteData = getTopicRouteData(topic);
+ }
+ if (pTopicRouteData != NULL) {
+ topicRouteData2TopicSubscribeInfo(topic, pTopicRouteData, mqs);
+ if (mqs.empty()) {
+ THROW_MQEXCEPTION(MQClientException, "Can not find Message Queue", -1);
+ }
+ return;
+ }
+ THROW_MQEXCEPTION(MQClientException, "Can not find Message Queue", -1);
+}
+
+//<!***************************************************************************
+void MQClientFactory::createTopic(
+ const string& key, const string& newTopic, int queueNum,
+ const SessionCredentials& sessionCredentials) {}
+
+int64 MQClientFactory::minOffset(const MQMessageQueue& mq,
+ const SessionCredentials& sessionCredentials) {
+ string brokerAddr = findBrokerAddressInPublish(mq.getBrokerName());
+ if (brokerAddr.empty()) {
+ updateTopicRouteInfoFromNameServer(mq.getTopic(), sessionCredentials);
+ brokerAddr = findBrokerAddressInPublish(mq.getBrokerName());
+ }
+
+ if (!brokerAddr.empty()) {
+ try {
+ return m_pClientAPIImpl->getMinOffset(brokerAddr, mq.getTopic(),
+ mq.getQueueId(), 1000 * 3,
+ sessionCredentials);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+ }
+ THROW_MQEXCEPTION(MQClientException, "The broker is not exist", -1);
+}
+
+int64 MQClientFactory::maxOffset(const MQMessageQueue& mq,
+ const SessionCredentials& sessionCredentials) {
+ string brokerAddr = findBrokerAddressInPublish(mq.getBrokerName());
+ if (brokerAddr.empty()) {
+ updateTopicRouteInfoFromNameServer(mq.getTopic(), sessionCredentials);
+ brokerAddr = findBrokerAddressInPublish(mq.getBrokerName());
+ }
+
+ if (!brokerAddr.empty()) {
+ try {
+ return m_pClientAPIImpl->getMaxOffset(brokerAddr, mq.getTopic(),
+ mq.getQueueId(), 1000 * 3,
+ sessionCredentials);
+ } catch (MQException& e) {
+ THROW_MQEXCEPTION(MQClientException, "Invoke Broker exception", -1);
+ }
+ }
+ THROW_MQEXCEPTION(MQClientException, "The broker is not exist", -1);
+}
+
+int64 MQClientFactory::searchOffset(
+ const MQMessageQueue& mq, int64 timestamp,
+ const SessionCredentials& sessionCredentials) {
+ string brokerAddr = findBrokerAddressInPublish(mq.getBrokerName());
+ if (brokerAddr.empty()) {
+ updateTopicRouteInfoFromNameServer(mq.getTopic(), sessionCredentials);
+ brokerAddr = findBrokerAddressInPublish(mq.getBrokerName());
+ }
+
+ if (!brokerAddr.empty()) {
+ try {
+ return m_pClientAPIImpl->searchOffset(brokerAddr, mq.getTopic(),
+ mq.getQueueId(), timestamp,
+ 1000 * 3, sessionCredentials);
+ } catch (MQException& e) {
+ THROW_MQEXCEPTION(MQClientException, "Invoke Broker exception", -1);
+ }
+ }
+ THROW_MQEXCEPTION(MQClientException, "The broker is not exist", -1);
+}
+
+MQMessageExt* MQClientFactory::viewMessage(
+ const string& msgId, const SessionCredentials& sessionCredentials) {
+ try {
+ return NULL;
+ } catch (MQException& e) {
+ THROW_MQEXCEPTION(MQClientException, "message id illegal", -1);
+ }
+}
+
+int64 MQClientFactory::earliestMsgStoreTime(
+ const MQMessageQueue& mq, const SessionCredentials& sessionCredentials) {
+ string brokerAddr = findBrokerAddressInPublish(mq.getBrokerName());
+ if (brokerAddr.empty()) {
+ updateTopicRouteInfoFromNameServer(mq.getTopic(), sessionCredentials);
+ brokerAddr = findBrokerAddressInPublish(mq.getBrokerName());
+ }
+
+ if (!brokerAddr.empty()) {
+ try {
+ return m_pClientAPIImpl->getEarliestMsgStoretime(
+ brokerAddr, mq.getTopic(), mq.getQueueId(), 1000 * 3,
+ sessionCredentials);
+ } catch (MQException& e) {
+ THROW_MQEXCEPTION(MQClientException, "Invoke Broker exception", -1);
+ }
+ }
+ THROW_MQEXCEPTION(MQClientException, "The broker is not exist", -1);
+}
+
+QueryResult MQClientFactory::queryMessage(
+ const string& topic, const string& key, int maxNum, int64 begin, int64 end,
+ const SessionCredentials& sessionCredentials) {
+ THROW_MQEXCEPTION(MQClientException, "queryMessage", -1);
+}
+
+void MQClientFactory::findConsumerIds(
+ const string& topic, const string& group, vector<string>& cids,
+ const SessionCredentials& sessionCredentials) {
+ string brokerAddr;
+ TopicRouteData* pTopicRouteData = getTopicRouteData(topic);
+ if (pTopicRouteData == NULL) {
+ updateTopicRouteInfoFromNameServer(topic, sessionCredentials);
+ pTopicRouteData = getTopicRouteData(topic);
+ }
+ if (pTopicRouteData != NULL) {
+ brokerAddr = pTopicRouteData->selectBrokerAddr();
+ }
+
+ if (!brokerAddr.empty()) {
+ try {
+ LOG_INFO("getConsumerIdList from broker:%s", brokerAddr.c_str());
+ return m_pClientAPIImpl->getConsumerIdListByGroup(
+ brokerAddr, group, cids, 5000, sessionCredentials);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+ }
+}
+
+void MQClientFactory::resetOffset(
+ const string& group, const string& topic,
+ const map<MQMessageQueue, int64>& offsetTable) {
+ MQConsumer* pConsumer = selectConsumer(group);
+ if (pConsumer) {
+ map<MQMessageQueue, int64>::const_iterator it = offsetTable.begin();
+
+ for (; it != offsetTable.end(); ++it) {
+ MQMessageQueue mq = it->first;
+ PullRequest* pullreq = pConsumer->getRebalance()->getPullRequest(mq);
+ if (pullreq) {
+ pullreq->setDroped(true);
+ pullreq->clearAllMsgs();
+ pullreq->updateQueueMaxOffset(it->second);
+ } else {
+ LOG_ERROR("no corresponding pullRequest found for topic:%s",
+ topic.c_str());
+ }
+ }
+
+ for (it = offsetTable.begin(); it != offsetTable.end(); ++it) {
+ MQMessageQueue mq = it->first;
+ if (topic == mq.getTopic()) {
+ LOG_INFO("offset sets to:%lld", it->second);
+ pConsumer->updateConsumeOffset(mq, it->second);
+ }
+ }
+ pConsumer->persistConsumerOffsetByResetOffset();
+
+ poll(0, 0, 10);
+
+ for (it = offsetTable.begin(); it != offsetTable.end(); ++it) {
+ MQMessageQueue mq = it->first;
+ if (topic == mq.getTopic()) {
+ LOG_DEBUG("resetOffset sets to:%lld", it->second);
+ pConsumer->updateConsumeOffset(mq, it->second);
+ }
+ }
+ pConsumer->persistConsumerOffsetByResetOffset();
+
+ for (it = offsetTable.begin(); it != offsetTable.end(); ++it) {
+ MQMessageQueue mq = it->first;
+ if (topic == mq.getTopic()) {
+ pConsumer->removeConsumeOffset(mq);
+ }
+ }
+
+ pConsumer->doRebalance();
+ } else {
+ LOG_ERROR("no corresponding consumer found for group:%s", group.c_str());
+ }
+}
+
+ConsumerRunningInfo* MQClientFactory::consumerRunningInfo(
+ const string& consumerGroup) {
+ MQConsumer* pConsumer = selectConsumer(consumerGroup);
+ if (pConsumer) {
+ ConsumerRunningInfo* runningInfo = pConsumer->getConsumerRunningInfo();
+ if (runningInfo) {
+ runningInfo->setProperty(ConsumerRunningInfo::PROP_NAMESERVER_ADDR,
+ pConsumer->getNamesrvAddr());
+ if (pConsumer->getConsumeType() == CONSUME_PASSIVELY) {
+ runningInfo->setProperty(ConsumerRunningInfo::PROP_CONSUME_TYPE,
+ "CONSUME_PASSIVELY");
+ } else {
+ runningInfo->setProperty(ConsumerRunningInfo::PROP_CONSUME_TYPE,
+ "CONSUME_ACTIVELY");
+ }
+ runningInfo->setProperty(ConsumerRunningInfo::PROP_CLIENT_VERSION,
+ "V3_1_8"); // MQVersion::s_CurrentVersion ));
+
+ return runningInfo;
+ }
+ }
+
+ LOG_ERROR("no corresponding consumer found for group:%s",
+ consumerGroup.c_str());
+ return NULL;
+}
+
+void MQClientFactory::getSessionCredentialsFromOneOfProducerOrConsumer(
+ SessionCredentials& session_credentials) {
+ // Note: on the same MQClientFactory, all producers and consumers used the
+ // same
+ // sessionCredentials,
+ // So only need get sessionCredentials from the first one producer or consumer
+ // now.
+ // this function was only used by updateTopicRouteInfo() and
+ // sendHeartbeatToAllBrokers() now.
+ // if this strategy was changed in future, need get sessionCredentials for
+ // each
+ // producer and consumer.
+ getSessionCredentialFromProducerTable(session_credentials);
+ if (!session_credentials.isValid())
+ getSessionCredentialFromConsumerTable(session_credentials);
+
+ if (!session_credentials.isValid()) {
+ LOG_ERROR(
+ "updateTopicRouteInfo: didn't get the session_credentials from any "
+ "producers and consumers, please re-intialize it");
+ }
+}
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/MQClientFactory.h b/rocketmq-cpp/src/MQClientFactory.h
new file mode 100644
index 00000000..34ac2a94
--- /dev/null
+++ b/rocketmq-cpp/src/MQClientFactory.h
@@ -0,0 +1,220 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MQCLIENTFACTORY_H__
+#define __MQCLIENTFACTORY_H__
+#include <boost/asio.hpp>
+#include <boost/asio/io_service.hpp>
+#include <boost/bind.hpp>
+#include <boost/date_time/posix_time/posix_time.hpp>
+#include <boost/thread/thread.hpp>
+#include "FindBrokerResult.h"
+#include "MQClientAPIImpl.h"
+#include "MQClientException.h"
+#include "MQConsumer.h"
+#include "MQDecoder.h"
+#include "MQMessageQueue.h"
+#include "MQProducer.h"
+#include "PermName.h"
+#include "QueryResult.h"
+#include "ServiceState.h"
+#include "SocketUtil.h"
+#include "TopicConfig.h"
+#include "TopicRouteData.h"
+
+namespace rocketmq {
+//<!************************************************************************
+class TopicPublishInfo;
+class MQClientFactory {
+ public:
+ MQClientFactory(const string& clientID, int pullThreadNum,
+ uint64_t tcpConnectTimeout,
+ uint64_t tcpTransportTryLockTimeout, string unitName);
+ virtual ~MQClientFactory();
+
+ void start();
+ void shutdown();
+ bool registerProducer(MQProducer* pProducer);
+ void unregisterProducer(MQProducer* pProducer);
+ bool registerConsumer(MQConsumer* pConsumer);
+ void unregisterConsumer(MQConsumer* pConsumer);
+
+ void createTopic(const string& key, const string& newTopic, int queueNum,
+ const SessionCredentials& session_credentials);
+ int64 minOffset(const MQMessageQueue& mq,
+ const SessionCredentials& session_credentials);
+ int64 maxOffset(const MQMessageQueue& mq,
+ const SessionCredentials& session_credentials);
+ int64 searchOffset(const MQMessageQueue& mq, int64 timestamp,
+ const SessionCredentials& session_credentials);
+ int64 earliestMsgStoreTime(const MQMessageQueue& mq,
+ const SessionCredentials& session_credentials);
+ MQMessageExt* viewMessage(const string& msgId,
+ const SessionCredentials& session_credentials);
+ QueryResult queryMessage(const string& topic, const string& key, int maxNum,
+ int64 begin, int64 end,
+ const SessionCredentials& session_credentials);
+
+ MQClientAPIImpl* getMQClientAPIImpl() const;
+ MQProducer* selectProducer(const string& group);
+ MQConsumer* selectConsumer(const string& group);
+
+ boost::shared_ptr<TopicPublishInfo> topicRouteData2TopicPublishInfo(
+ const string& topic, TopicRouteData* pRoute);
+
+ void topicRouteData2TopicSubscribeInfo(const string& topic,
+ TopicRouteData* pRoute,
+ vector<MQMessageQueue>& mqs);
+
+ FindBrokerResult* findBrokerAddressInSubscribe(const string& brokerName,
+ int brokerId,
+ bool onlyThisBroker);
+
+ FindBrokerResult* findBrokerAddressInAdmin(const string& brokerName);
+
+ string findBrokerAddressInPublish(const string& brokerName);
+
+ boost::shared_ptr<TopicPublishInfo> tryToFindTopicPublishInfo(
+ const string& topic, const SessionCredentials& session_credentials);
+
+ void fetchSubscribeMessageQueues(
+ const string& topic, vector<MQMessageQueue>& mqs,
+ const SessionCredentials& session_credentials);
+
+ bool updateTopicRouteInfoFromNameServer(
+ const string& topic, const SessionCredentials& session_credentials,
+ bool isDefault = false);
+ void rebalanceImmediately();
+ void doRebalanceByConsumerGroup(const string& consumerGroup);
+ void sendHeartbeatToAllBroker();
+
+ void findConsumerIds(const string& topic, const string& group,
+ vector<string>& cids,
+ const SessionCredentials& session_credentials);
+ void resetOffset(const string& group, const string& topic,
+ const map<MQMessageQueue, int64>& offsetTable);
+ ConsumerRunningInfo* consumerRunningInfo(const string& consumerGroup);
+ bool getSessionCredentialFromConsumer(const string& consumerGroup,
+ SessionCredentials& sessionCredentials);
+ void addBrokerToAddrMap(const string& brokerName,
+ map<int, string>& brokerAddrs);
+ map<string, map<int, string>> getBrokerAddrMap();
+ void clearBrokerAddrMap();
+
+ private:
+ void unregisterClient(const string& producerGroup,
+ const string& consumerGroup,
+ const SessionCredentials& session_credentials);
+ TopicRouteData* getTopicRouteData(const string& topic);
+ void addTopicRouteData(const string& topic, TopicRouteData* pTopicRouteData);
+ HeartbeatData* prepareHeartbeatData();
+
+ void startScheduledTask(bool startFetchNSService = true);
+ //<!timer async callback
+ void fetchNameServerAddr(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t);
+ void updateTopicRouteInfo(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t);
+ void timerCB_sendHeartbeatToAllBroker(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t);
+
+ // consumer related operation
+ void consumer_timerOperation();
+ void persistAllConsumerOffset(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t);
+ void doRebalance();
+ void timerCB_doRebalance(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t);
+ bool getSessionCredentialFromConsumerTable(
+ SessionCredentials& sessionCredentials);
+ bool addConsumerToTable(const string& consumerName, MQConsumer* pMQConsumer);
+ void eraseConsumerFromTable(const string& consumerName);
+ int getConsumerTableSize();
+ void getTopicListFromConsumerSubscription(set<string>& topicList);
+ void updateConsumerSubscribeTopicInfo(const string& topic,
+ vector<MQMessageQueue> mqs);
+ void insertConsumerInfoToHeartBeatData(HeartbeatData* pHeartbeatData);
+
+ // producer related operation
+ bool getSessionCredentialFromProducerTable(
+ SessionCredentials& sessionCredentials);
+ bool addProducerToTable(const string& producerName, MQProducer* pMQProducer);
+ void eraseProducerFromTable(const string& producerName);
+ int getProducerTableSize();
+ void insertProducerInfoToHeartBeatData(HeartbeatData* pHeartbeatData);
+
+ // topicPublishInfo related operation
+ void addTopicInfoToTable(
+ const string& topic,
+ boost::shared_ptr<TopicPublishInfo> pTopicPublishInfo);
+ void eraseTopicInfoFromTable(const string& topic);
+ bool isTopicInfoValidInTable(const string& topic);
+ boost::shared_ptr<TopicPublishInfo> getTopicPublishInfoFromTable(
+ const string& topic);
+ void getTopicListFromTopicPublishInfo(set<string>& topicList);
+
+ void getSessionCredentialsFromOneOfProducerOrConsumer(
+ SessionCredentials& session_credentials);
+
+ private:
+ string m_clientId;
+ string m_nameSrvDomain; // per clientId
+ ServiceState m_serviceState;
+ bool m_bFetchNSService;
+
+ //<! group --> MQProducer;
+ typedef map<string, MQProducer*> MQPMAP;
+ boost::mutex m_producerTableMutex;
+ MQPMAP m_producerTable;
+
+ //<! group --> MQConsumer;
+ typedef map<string, MQConsumer*> MQCMAP;
+ boost::mutex m_consumerTableMutex;
+ MQCMAP m_consumerTable;
+
+ //<! Topic---> TopicRouteData
+ typedef map<string, TopicRouteData*> TRDMAP;
+ boost::mutex m_topicRouteTableMutex;
+ TRDMAP m_topicRouteTable;
+
+ //<!-----brokerName
+ //<! ------brokerid;
+ //<! ------add;
+ boost::mutex m_brokerAddrlock;
+ typedef map<string, map<int, string>> BrokerAddrMAP;
+ BrokerAddrMAP m_brokerAddrTable;
+
+ //<!topic ---->TopicPublishInfo> ;
+ typedef map<string, boost::shared_ptr<TopicPublishInfo>> TPMap;
+ boost::mutex m_topicPublishInfoTableMutex;
+ TPMap m_topicPublishInfoTable;
+ boost::mutex m_factoryLock;
+ boost::mutex m_topicPublishInfoLock;
+
+ //<!clientapi;
+ unique_ptr<MQClientAPIImpl> m_pClientAPIImpl;
+ unique_ptr<ClientRemotingProcessor> m_pClientRemotingProcessor;
+
+ boost::asio::io_service m_async_ioService;
+ unique_ptr<boost::thread> m_async_service_thread;
+
+ boost::asio::io_service m_consumer_async_ioService;
+ unique_ptr<boost::thread> m_consumer_async_service_thread;
+};
+
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/MQClientManager.cpp b/rocketmq-cpp/src/MQClientManager.cpp
new file mode 100755
index 00000000..79ef77e3
--- /dev/null
+++ b/rocketmq-cpp/src/MQClientManager.cpp
@@ -0,0 +1,54 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "MQClientManager.h"
+#include "Logging.h"
+
+namespace rocketmq {
+//<!************************************************************************
+MQClientManager::MQClientManager() {}
+
+MQClientManager::~MQClientManager() { m_factoryTable.clear(); }
+
+MQClientManager* MQClientManager::getInstance() {
+ static MQClientManager instance;
+ return &instance;
+}
+
+MQClientFactory* MQClientManager::getMQClientFactory(
+ const string& clientId, int pullThreadNum, uint64_t tcpConnectTimeout,
+ uint64_t tcpTransportTryLockTimeout, string unitName) {
+ FTMAP::iterator it = m_factoryTable.find(clientId);
+ if (it != m_factoryTable.end()) {
+ return it->second;
+ } else {
+ MQClientFactory* factory =
+ new MQClientFactory(clientId, pullThreadNum, tcpConnectTimeout,
+ tcpTransportTryLockTimeout, unitName);
+ m_factoryTable[clientId] = factory;
+ return factory;
+ }
+}
+
+void MQClientManager::removeClientFactory(const string& clientId) {
+ FTMAP::iterator it = m_factoryTable.find(clientId);
+ if (it != m_factoryTable.end()) {
+ deleteAndZero(it->second);
+ m_factoryTable.erase(it);
+ }
+}
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/MQClientManager.h b/rocketmq-cpp/src/MQClientManager.h
new file mode 100755
index 00000000..7703c158
--- /dev/null
+++ b/rocketmq-cpp/src/MQClientManager.h
@@ -0,0 +1,49 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MQCLIENTMANAGER_H__
+#define __MQCLIENTMANAGER_H__
+
+#include <map>
+#include <string>
+#include "Logging.h"
+#include "MQClientFactory.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class MQClientManager {
+ public:
+ virtual ~MQClientManager();
+ MQClientFactory* getMQClientFactory(const string& clientId, int pullThreadNum,
+ uint64_t tcpConnectTimeout,
+ uint64_t tcpTransportTryLockTimeout,
+ string unitName);
+ void removeClientFactory(const string& clientId);
+
+ static MQClientManager* getInstance();
+
+ private:
+ MQClientManager();
+
+ private:
+ typedef map<string, MQClientFactory*> FTMAP;
+ FTMAP m_factoryTable;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/common/Arg_helper.cpp b/rocketmq-cpp/src/common/Arg_helper.cpp
new file mode 100755
index 00000000..61ac5493
--- /dev/null
+++ b/rocketmq-cpp/src/common/Arg_helper.cpp
@@ -0,0 +1,67 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "Arg_helper.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+Arg_helper::Arg_helper(int argc, char* argv[]) {
+ for (int i = 0; i < argc; i++) {
+ m_args.push_back(argv[i]);
+ }
+}
+
+Arg_helper::Arg_helper(string arg_str_) {
+ vector<string> v;
+ UtilAll::Split(v, arg_str_, " ");
+ m_args.insert(m_args.end(), v.begin(), v.end());
+}
+
+string Arg_helper::get_option(int idx_) const {
+ if ((size_t)idx_ >= m_args.size()) {
+ return "";
+ }
+ return m_args[idx_];
+}
+
+bool Arg_helper::is_enable_option(string opt_) const {
+ for (size_t i = 0; i < m_args.size(); ++i) {
+ if (opt_ == m_args[i]) {
+ return true;
+ }
+ }
+ return false;
+}
+
+string Arg_helper::get_option_value(string opt_) const {
+ string ret = "";
+ for (size_t i = 0; i < m_args.size(); ++i) {
+ if (opt_ == m_args[i]) {
+ size_t value_idx = ++i;
+ if (value_idx >= m_args.size()) {
+ return ret;
+ }
+ ret = m_args[value_idx];
+ return ret;
+ }
+ }
+ return ret;
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/AsyncArg.h b/rocketmq-cpp/src/common/AsyncArg.h
new file mode 100755
index 00000000..fc358cb0
--- /dev/null
+++ b/rocketmq-cpp/src/common/AsyncArg.h
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef _AsyncArg_H_
+#define _AsyncArg_H_
+
+#include "MQMessageQueue.h"
+#include "PullAPIWrapper.h"
+#include "SubscriptionData.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+
+struct AsyncArg {
+ MQMessageQueue mq;
+ SubscriptionData subData;
+ PullAPIWrapper* pPullWrapper;
+};
+
+//<!***************************************************************************
+}
+#endif //<! _AsyncArg_H_
diff --git a/rocketmq-cpp/src/common/AsyncCallbackWrap.cpp b/rocketmq-cpp/src/common/AsyncCallbackWrap.cpp
new file mode 100755
index 00000000..a61e0ee4
--- /dev/null
+++ b/rocketmq-cpp/src/common/AsyncCallbackWrap.cpp
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "AsyncCallbackWrap.h"
+#include "Logging.h"
+#include "MQClientAPIImpl.h"
+#include "MQDecoder.h"
+#include "MQMessageQueue.h"
+#include "MQProtos.h"
+#include "PullAPIWrapper.h"
+#include "PullResultExt.h"
+#include "ResponseFuture.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+AsyncCallbackWrap::AsyncCallbackWrap(AsyncCallback* pAsyncCallback,
+ MQClientAPIImpl* pclientAPI)
+ : m_pAsyncCallBack(pAsyncCallback), m_pClientAPI(pclientAPI) {}
+
+AsyncCallbackWrap::~AsyncCallbackWrap() {
+ m_pAsyncCallBack = NULL;
+ m_pClientAPI = NULL;
+}
+
+//<!************************************************************************
+SendCallbackWrap::SendCallbackWrap(const string& brokerName,
+ const MQMessage& msg,
+ AsyncCallback* pAsyncCallback,
+ MQClientAPIImpl* pclientAPI)
+ : AsyncCallbackWrap(pAsyncCallback, pclientAPI),
+ m_msg(msg),
+ m_brokerName(brokerName) {}
+
+void SendCallbackWrap::onException() {
+ if (m_pAsyncCallBack == NULL) return;
+
+ SendCallback* pCallback = static_cast<SendCallback*>(m_pAsyncCallBack);
+ if (pCallback) {
+ unique_ptr<MQException> exception(new MQException(
+ "send msg failed due to wait response timeout or network error", -1,
+ __FILE__, __LINE__));
+ pCallback->onException(*exception);
+ if (pCallback->getSendCallbackType() == autoDeleteSendCallback) {
+ deleteAndZero(pCallback);
+ }
+ }
+}
+
+void SendCallbackWrap::operationComplete(ResponseFuture* pResponseFuture,
+ bool bProducePullRequest) {
+ unique_ptr<RemotingCommand> pResponse(pResponseFuture->getCommand());
+
+ if (m_pAsyncCallBack == NULL) {
+ return;
+ }
+ SendCallback* pCallback = static_cast<SendCallback*>(m_pAsyncCallBack);
+
+ if (!pResponse) {
+ string err = "unknow reseaon";
+ if (!pResponseFuture->isSendRequestOK()) {
+ err = "send request failed";
+
+ } else if (pResponseFuture->isTimeOut()) {
+ // pResponseFuture->setAsyncResponseFlag();
+ err = "wait response timeout";
+ }
+ if (pCallback) {
+ MQException exception(err, -1, __FILE__, __LINE__);
+ pCallback->onException(exception);
+ }
+ LOG_ERROR("send failed of:%d", pResponseFuture->getOpaque());
+ } else {
+ try {
+ SendResult ret = m_pClientAPI->processSendResponse(m_brokerName, m_msg,
+ pResponse.get());
+ if (pCallback) pCallback->onSuccess(ret);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ if (pCallback) {
+ MQException exception("process send response error", -1, __FILE__,
+ __LINE__);
+ pCallback->onException(exception);
+ }
+ }
+ }
+ if (pCallback && pCallback->getSendCallbackType() == autoDeleteSendCallback) {
+ deleteAndZero(pCallback);
+ }
+}
+
+//<!************************************************************************
+PullCallbackWarp::PullCallbackWarp(AsyncCallback* pAsyncCallback,
+ MQClientAPIImpl* pclientAPI, void* pArg)
+ : AsyncCallbackWrap(pAsyncCallback, pclientAPI) {
+ m_pArg = *static_cast<AsyncArg*>(pArg);
+}
+
+PullCallbackWarp::~PullCallbackWarp() {}
+
+void PullCallbackWarp::onException() {
+ if (m_pAsyncCallBack == NULL) return;
+
+ PullCallback* pCallback = static_cast<PullCallback*>(m_pAsyncCallBack);
+ if (pCallback) {
+ MQException exception("wait response timeout", -1, __FILE__, __LINE__);
+ pCallback->onException(exception);
+ } else {
+ LOG_ERROR("PullCallback is NULL, AsyncPull could not continue");
+ }
+}
+
+void PullCallbackWarp::operationComplete(ResponseFuture* pResponseFuture,
+ bool bProducePullRequest) {
+ unique_ptr<RemotingCommand> pResponse(pResponseFuture->getCommand());
+ if (m_pAsyncCallBack == NULL) {
+ LOG_ERROR("m_pAsyncCallBack is NULL, AsyncPull could not continue");
+ return;
+ }
+ PullCallback* pCallback = static_cast<PullCallback*>(m_pAsyncCallBack);
+ if (!pResponse) {
+ string err = "unknow reseaon";
+ if (!pResponseFuture->isSendRequestOK()) {
+ err = "send request failed";
+
+ } else if (pResponseFuture->isTimeOut()) {
+ // pResponseFuture->setAsyncResponseFlag();
+ err = "wait response timeout";
+ }
+ MQException exception(err, -1, __FILE__, __LINE__);
+ LOG_ERROR("Async pull exception of opaque:%d",
+ pResponseFuture->getOpaque());
+ if (pCallback && bProducePullRequest) pCallback->onException(exception);
+ } else {
+ try {
+ if (m_pArg.pPullWrapper) {
+ unique_ptr<PullResult> pullResult(
+ m_pClientAPI->processPullResponse(pResponse.get()));
+ PullResult result = m_pArg.pPullWrapper->processPullResult(
+ m_pArg.mq, pullResult.get(), &m_pArg.subData);
+ if (pCallback)
+ pCallback->onSuccess(m_pArg.mq, result, bProducePullRequest);
+ } else {
+ LOG_ERROR("pPullWrapper had been destroyed with consumer");
+ }
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ MQException exception("pullResult error", -1, __FILE__, __LINE__);
+ if (pCallback && bProducePullRequest) pCallback->onException(exception);
+ }
+ }
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/AsyncCallbackWrap.h b/rocketmq-cpp/src/common/AsyncCallbackWrap.h
new file mode 100755
index 00000000..50968c9c
--- /dev/null
+++ b/rocketmq-cpp/src/common/AsyncCallbackWrap.h
@@ -0,0 +1,84 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __ASYNCCALLBACKWRAP_H__
+#define __ASYNCCALLBACKWRAP_H__
+
+#include "AsyncArg.h"
+#include "AsyncCallback.h"
+#include "MQMessage.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+
+class ResponseFuture;
+class MQClientAPIImpl;
+//<!***************************************************************************
+enum asyncCallBackType {
+ asyncCallbackWrap = 0,
+ sendCallbackWrap = 1,
+ pullCallbackWarp = 2
+};
+
+struct AsyncCallbackWrap {
+ public:
+ AsyncCallbackWrap(AsyncCallback* pAsyncCallback, MQClientAPIImpl* pclientAPI);
+ virtual ~AsyncCallbackWrap();
+ virtual void operationComplete(ResponseFuture* pResponseFuture,
+ bool bProducePullRequest) = 0;
+ virtual void onException() = 0;
+ virtual asyncCallBackType getCallbackType() = 0;
+
+ protected:
+ AsyncCallback* m_pAsyncCallBack;
+ MQClientAPIImpl* m_pClientAPI;
+};
+
+//<!************************************************************************
+class SendCallbackWrap : public AsyncCallbackWrap {
+ public:
+ SendCallbackWrap(const string& brokerName, const MQMessage& msg,
+ AsyncCallback* pAsyncCallback, MQClientAPIImpl* pclientAPI);
+
+ virtual ~SendCallbackWrap(){};
+ virtual void operationComplete(ResponseFuture* pResponseFuture,
+ bool bProducePullRequest);
+ virtual void onException();
+ virtual asyncCallBackType getCallbackType() { return sendCallbackWrap; }
+
+ private:
+ MQMessage m_msg;
+ string m_brokerName;
+};
+
+//<!***************************************************************************
+class PullCallbackWarp : public AsyncCallbackWrap {
+ public:
+ PullCallbackWarp(AsyncCallback* pAsyncCallback, MQClientAPIImpl* pclientAPI,
+ void* pArg);
+ virtual ~PullCallbackWarp();
+ virtual void operationComplete(ResponseFuture* pResponseFuture,
+ bool bProducePullRequest);
+ virtual void onException();
+ virtual asyncCallBackType getCallbackType() { return pullCallbackWarp; }
+
+ private:
+ AsyncArg m_pArg;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif //<! _AsyncCallbackWrap_H_
diff --git a/rocketmq-cpp/src/common/ByteOrder.h b/rocketmq-cpp/src/common/ByteOrder.h
new file mode 100644
index 00000000..351c5ae1
--- /dev/null
+++ b/rocketmq-cpp/src/common/ByteOrder.h
@@ -0,0 +1,179 @@
+
+#ifndef BYTEORDER_H_INCLUDED
+#define BYTEORDER_H_INCLUDED
+
+#include <stddef.h>
+#include <stdint.h>
+#include <algorithm>
+#include <boost/detail/endian.hpp>
+#include "RocketMQClient.h"
+#include "UtilAll.h"
+//==============================================================================
+/** Contains static methods for converting the byte order between different
+ endiannesses.
+*/
+namespace rocketmq {
+
+class ROCKETMQCLIENT_API ByteOrder {
+ public:
+ //==============================================================================
+ /** Swaps the upper and lower bytes of a 16-bit integer. */
+ static uint16 swap(uint16 value);
+
+ /** Reverses the order of the 4 bytes in a 32-bit integer. */
+ static uint32 swap(uint32 value);
+
+ /** Reverses the order of the 8 bytes in a 64-bit integer. */
+ static uint64 swap(uint64 value);
+
+ //==============================================================================
+ /** Swaps the byte order of a 16-bit int if the CPU is big-endian */
+ static uint16 swapIfBigEndian(uint16 value);
+
+ /** Swaps the byte order of a 32-bit int if the CPU is big-endian */
+ static uint32 swapIfBigEndian(uint32 value);
+
+ /** Swaps the byte order of a 64-bit int if the CPU is big-endian */
+ static uint64 swapIfBigEndian(uint64 value);
+
+ /** Swaps the byte order of a 16-bit int if the CPU is little-endian */
+ static uint16 swapIfLittleEndian(uint16 value);
+
+ /** Swaps the byte order of a 32-bit int if the CPU is little-endian */
+ static uint32 swapIfLittleEndian(uint32 value);
+
+ /** Swaps the byte order of a 64-bit int if the CPU is little-endian */
+ static uint64 swapIfLittleEndian(uint64 value);
+
+ //==============================================================================
+ /** Turns 4 bytes into a little-endian integer. */
+ static uint32 littleEndianInt(const void* bytes);
+
+ /** Turns 8 bytes into a little-endian integer. */
+ static uint64 littleEndianInt64(const void* bytes);
+
+ /** Turns 2 bytes into a little-endian integer. */
+ static uint16 littleEndianShort(const void* bytes);
+
+ /** Turns 4 bytes into a big-endian integer. */
+ static uint32 bigEndianInt(const void* bytes);
+
+ /** Turns 8 bytes into a big-endian integer. */
+ static uint64 bigEndianInt64(const void* bytes);
+
+ /** Turns 2 bytes into a big-endian integer. */
+ static uint16 bigEndianShort(const void* bytes);
+
+ //==============================================================================
+ /** Converts 3 little-endian bytes into a signed 24-bit value (which is
+ * sign-extended to 32 bits). */
+ static int littleEndian24Bit(const void* bytes);
+
+ /** Converts 3 big-endian bytes into a signed 24-bit value (which is
+ * sign-extended to 32 bits). */
+ static int bigEndian24Bit(const void* bytes);
+
+ /** Copies a 24-bit number to 3 little-endian bytes. */
+ static void littleEndian24BitToChars(int value, void* destBytes);
+
+ /** Copies a 24-bit number to 3 big-endian bytes. */
+ static void bigEndian24BitToChars(int value, void* destBytes);
+
+ //==============================================================================
+ /** Returns true if the current CPU is big-endian. */
+ static bool isBigEndian();
+};
+
+//==============================================================================
+
+inline uint16 ByteOrder::swap(uint16 n) {
+ return static_cast<uint16>((n << 8) | (n >> 8));
+}
+
+inline uint32 ByteOrder::swap(uint32 n) {
+ return (n << 24) | (n >> 24) | ((n & 0xff00) << 8) | ((n & 0xff0000) >> 8);
+}
+
+inline uint64 ByteOrder::swap(uint64 value) {
+ return (((uint64)swap((uint32)value)) << 32) | swap((uint32)(value >> 32));
+}
+
+#if __BYTE_ORDER__ == \
+ __ORDER_LITTLE_ENDIAN__ //__BYTE_ORDER__ is defined by GCC
+inline uint16 ByteOrder::swapIfBigEndian(const uint16 v) { return v; }
+inline uint32 ByteOrder::swapIfBigEndian(const uint32 v) { return v; }
+inline uint64 ByteOrder::swapIfBigEndian(const uint64 v) { return v; }
+inline uint16 ByteOrder::swapIfLittleEndian(const uint16 v) { return swap(v); }
+inline uint32 ByteOrder::swapIfLittleEndian(const uint32 v) { return swap(v); }
+inline uint64 ByteOrder::swapIfLittleEndian(const uint64 v) { return swap(v); }
+inline uint32 ByteOrder::littleEndianInt(const void* const bytes) {
+ return *static_cast<const uint32*>(bytes);
+}
+inline uint64 ByteOrder::littleEndianInt64(const void* const bytes) {
+ return *static_cast<const uint64*>(bytes);
+}
+inline uint16 ByteOrder::littleEndianShort(const void* const bytes) {
+ return *static_cast<const uint16*>(bytes);
+}
+inline uint32 ByteOrder::bigEndianInt(const void* const bytes) {
+ return swap(*static_cast<const uint32*>(bytes));
+}
+inline uint64 ByteOrder::bigEndianInt64(const void* const bytes) {
+ return swap(*static_cast<const uint64*>(bytes));
+}
+inline uint16 ByteOrder::bigEndianShort(const void* const bytes) {
+ return swap(*static_cast<const uint16*>(bytes));
+}
+inline bool ByteOrder::isBigEndian() { return false; }
+#else
+inline uint16 ByteOrder::swapIfBigEndian(const uint16 v) { return swap(v); }
+inline uint32 ByteOrder::swapIfBigEndian(const uint32 v) { return swap(v); }
+inline uint64 ByteOrder::swapIfBigEndian(const uint64 v) { return swap(v); }
+inline uint16 ByteOrder::swapIfLittleEndian(const uint16 v) { return v; }
+inline uint32 ByteOrder::swapIfLittleEndian(const uint32 v) { return v; }
+inline uint64 ByteOrder::swapIfLittleEndian(const uint64 v) { return v; }
+inline uint32 ByteOrder::littleEndianInt(const void* const bytes) {
+ return swap(*static_cast<const uint32*>(bytes));
+}
+inline uint64 ByteOrder::littleEndianInt64(const void* const bytes) {
+ return swap(*static_cast<const uint64*>(bytes));
+}
+inline uint16 ByteOrder::littleEndianShort(const void* const bytes) {
+ return swap(*static_cast<const uint16*>(bytes));
+}
+inline uint32 ByteOrder::bigEndianInt(const void* const bytes) {
+ return *static_cast<const uint32*>(bytes);
+}
+inline uint64 ByteOrder::bigEndianInt64(const void* const bytes) {
+ return *static_cast<const uint64*>(bytes);
+}
+inline uint16 ByteOrder::bigEndianShort(const void* const bytes) {
+ return *static_cast<const uint16*>(bytes);
+}
+inline bool ByteOrder::isBigEndian() { return true; }
+#endif
+
+inline int ByteOrder::littleEndian24Bit(const void* const bytes) {
+ return (((int)static_cast<const int8*>(bytes)[2]) << 16) |
+ (((int)static_cast<const uint8*>(bytes)[1]) << 8) |
+ ((int)static_cast<const uint8*>(bytes)[0]);
+}
+inline int ByteOrder::bigEndian24Bit(const void* const bytes) {
+ return (((int)static_cast<const int8*>(bytes)[0]) << 16) |
+ (((int)static_cast<const uint8*>(bytes)[1]) << 8) |
+ ((int)static_cast<const uint8*>(bytes)[2]);
+}
+inline void ByteOrder::littleEndian24BitToChars(const int value,
+ void* const destBytes) {
+ static_cast<uint8*>(destBytes)[0] = (uint8)value;
+ static_cast<uint8*>(destBytes)[1] = (uint8)(value >> 8);
+ static_cast<uint8*>(destBytes)[2] = (uint8)(value >> 16);
+}
+inline void ByteOrder::bigEndian24BitToChars(const int value,
+ void* const destBytes) {
+ static_cast<uint8*>(destBytes)[0] = (uint8)(value >> 16);
+ static_cast<uint8*>(destBytes)[1] = (uint8)(value >> 8);
+ static_cast<uint8*>(destBytes)[2] = (uint8)value;
+}
+}
+#endif // BYTEORDER_H_INCLUDED
diff --git a/rocketmq-cpp/src/common/ClientRPCHook.cpp b/rocketmq-cpp/src/common/ClientRPCHook.cpp
new file mode 100755
index 00000000..3fa3d78f
--- /dev/null
+++ b/rocketmq-cpp/src/common/ClientRPCHook.cpp
@@ -0,0 +1,80 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "ClientRPCHook.h"
+#include "CommandHeader.h"
+#include "Logging.h"
+#include "spas_client.h"
+#include "string"
+
+namespace rocketmq {
+
+const string SessionCredentials::AccessKey = "AccessKey";
+const string SessionCredentials::SecretKey = "SecretKey";
+const string SessionCredentials::Signature = "Signature";
+const string SessionCredentials::SignatureMethod = "SignatureMethod";
+const string SessionCredentials::ONSChannelKey = "OnsChannel";
+
+void ClientRPCHook::doBeforeRequest(const string& remoteAddr,
+ RemotingCommand& request) {
+ CommandHeader* header = request.getCommandHeader();
+
+ map<string, string> requestMap;
+ string totalMsg;
+
+ requestMap.insert(pair<string, string>(SessionCredentials::AccessKey,
+ sessionCredentials.getAccessKey()));
+ requestMap.insert(pair<string, string>(SessionCredentials::ONSChannelKey,
+ sessionCredentials.getAuthChannel()));
+
+ LOG_DEBUG("before insert declared filed,MAP SIZE is:%zu", requestMap.size());
+ if (header != NULL) {
+ header->SetDeclaredFieldOfCommandHeader(requestMap);
+ }
+ LOG_DEBUG("after insert declared filed, MAP SIZE is:%zu", requestMap.size());
+
+ map<string, string>::iterator it = requestMap.begin();
+ for (; it != requestMap.end(); ++it) {
+ totalMsg.append(it->second);
+ }
+ if (request.getMsgBody().length() > 0) {
+ LOG_DEBUG("msgBody is:%s, msgBody length is:%zu",
+ request.getMsgBody().c_str(), request.getMsgBody().length());
+
+ totalMsg.append(request.getMsgBody());
+ }
+ LOG_DEBUG("total msg info are:%s, size is:%zu", totalMsg.c_str(),
+ totalMsg.size());
+ char* pSignature =
+ metaqSignature::spas_sign(totalMsg.c_str(), totalMsg.size(),
+ sessionCredentials.getSecretKey().c_str());
+ // char *pSignature = spas_sign(totalMsg.c_str(),
+ // sessionCredentials.getSecretKey().c_str());
+
+ if (pSignature != NULL) {
+ string signature(static_cast<const char*>(pSignature));
+ request.addExtField(SessionCredentials::Signature, signature);
+ request.addExtField(SessionCredentials::AccessKey,
+ sessionCredentials.getAccessKey());
+ request.addExtField(SessionCredentials::ONSChannelKey,
+ sessionCredentials.getAuthChannel());
+ metaqSignature::spas_mem_free(pSignature);
+ } else {
+ LOG_ERROR("signature for request failed");
+ }
+}
+}
diff --git a/rocketmq-cpp/src/common/ClientRPCHook.h b/rocketmq-cpp/src/common/ClientRPCHook.h
new file mode 100755
index 00000000..8abab31c
--- /dev/null
+++ b/rocketmq-cpp/src/common/ClientRPCHook.h
@@ -0,0 +1,51 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __CLIENTRPCHOOK_H__
+#define __CLIENTRPCHOOK_H__
+
+#include "RemotingCommand.h"
+#include "RocketMQClient.h"
+#include "SessionCredentials.h"
+namespace rocketmq {
+class RPCHook {
+ public:
+ RPCHook() {}
+ virtual ~RPCHook() {}
+ virtual void doBeforeRequest(const string& remoteAddr,
+ RemotingCommand& request) = 0;
+ virtual void doAfterResponse(RemotingCommand& request,
+ RemotingCommand& response) = 0;
+};
+
+class ClientRPCHook : public RPCHook {
+ private:
+ SessionCredentials sessionCredentials;
+
+ public:
+ ClientRPCHook(const SessionCredentials& session_credentials)
+ : sessionCredentials(session_credentials) {}
+ virtual ~ClientRPCHook() {}
+
+ virtual void doBeforeRequest(const string& remoteAddr,
+ RemotingCommand& request);
+
+ virtual void doAfterResponse(RemotingCommand& request,
+ RemotingCommand& response) {}
+};
+}
+#endif
diff --git a/rocketmq-cpp/src/common/CommunicationMode.h b/rocketmq-cpp/src/common/CommunicationMode.h
new file mode 100755
index 00000000..9d9b283b
--- /dev/null
+++ b/rocketmq-cpp/src/common/CommunicationMode.h
@@ -0,0 +1,27 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __COMMUNICATIONMODE_H__
+#define __COMMUNICATIONMODE_H__
+
+namespace rocketmq {
+//<!***************************************************************************
+enum CommunicationMode { ComMode_SYNC, ComMode_ASYNC, ComMode_ONEWAY };
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/FastDelegate.h b/rocketmq-cpp/src/common/FastDelegate.h
new file mode 100644
index 00000000..b2f5035a
--- /dev/null
+++ b/rocketmq-cpp/src/common/FastDelegate.h
@@ -0,0 +1,2626 @@
+// FastDelegate.h
+// Efficient delegates in C++ that generate only two lines of asm code!
+// Documentation is found at http://www.codeproject.com/cpp/FastDelegate.asp
+//
+// - Don Clugston, Mar 2004.
+// Major contributions were made by Jody Hagins.
+// History:
+// 24-Apr-04 1.0 * Submitted to CodeProject.
+// 28-Apr-04 1.1 * Prevent most unsafe uses of evil static function hack.
+// * Improved syntax for horrible_cast (thanks Paul Bludov).
+// * Tested on Metrowerks MWCC and Intel ICL (IA32)
+// * Compiled, but not run, on Comeau C++ and Intel Itanium ICL.
+// 27-Jun-04 1.2 * Now works on Borland C++ Builder 5.5
+// * Now works on /clr "managed C++" code on VC7, VC7.1
+// * Comeau C++ now compiles without warnings.
+// * Prevent the virtual inheritance case from being used on
+// VC6 and earlier, which generate incorrect code.
+// * Improved warning and error messages. Non-standard hacks
+// now have compile-time checks to make them safer.
+// * implicit_cast used instead of static_cast in many cases.
+// * If calling a const member function, a const class pointer
+// can be used.
+// * MakeDelegate() global helper function added to simplify
+// pass-by-value.
+// * Added fastdelegate.clear()
+// 16-Jul-04 1.2.1* Workaround for gcc bug (const member function pointers in
+// templates)
+// 30-Oct-04 1.3 * Support for (non-void) return values.
+// * No more workarounds in client code!
+// MSVC and Intel now use a clever hack invented by John
+// Dlugosz:
+// - The FASTDELEGATEDECLARE workaround is no longer
+// necessary.
+// - No more warning messages for VC6
+// * Less use of macros. Error messages should be more
+// comprehensible.
+// * Added include guards
+// * Added FastDelegate::empty() to test if invocation is safe
+// (Thanks Neville Franks).
+// * Now tested on VS 2005 Express Beta, PGI C++
+// 24-Dec-04 1.4 * Added DelegateMemento, to allow collections of disparate
+// delegates.
+// * <,>,<=,>= comparison operators to allow storage in ordered
+// containers.
+// * Substantial reduction of code size, especially the 'Closure'
+// class.
+// * Standardised all the compiler-specific workarounds.
+// * MFP conversion now works for CodePlay (but not yet supported
+// in the full code).
+// * Now compiles without warnings on _any_ supported compiler,
+// including BCC 5.5.1
+// * New syntax: FastDelegate< int (char *, double) >.
+// 14-Feb-05 1.4.1* Now treats =0 as equivalent to .clear(), ==0 as equivalent
+// to .empty(). (Thanks elfric).
+// * Now tested on Intel ICL for AMD64, VS2005 Beta for AMD64 and
+// Itanium.
+// 30-Mar-05 1.5 * Safebool idiom: "if (dg)" is now equivalent to "if
+// (!dg.empty())"
+// * Fully supported by CodePlay VectorC
+// * Bugfix for Metrowerks: empty() was buggy because a valid MFP
+// can be 0 on MWCC!
+// * More optimal assignment,== and != operators for static
+// function pointers.
+
+#ifndef FASTDELEGATE_H
+#define FASTDELEGATE_H
+#if _MSC_VER > 1000
+#pragma once
+#endif // _MSC_VER > 1000
+
+#include <memory.h> // to allow <,> comparisons
+
+////////////////////////////////////////////////////////////////////////////////
+// Configuration options
+//
+////////////////////////////////////////////////////////////////////////////////
+
+// Uncomment the following #define for optimally-sized delegates.
+// In this case, the generated asm code is almost identical to the code you'd
+// get
+// if the compiler had native support for delegates.
+// It will not work on systems where sizeof(dataptr) < sizeof(codeptr).
+// Thus, it will not work for DOS compilers using the medium model.
+// It will also probably fail on some DSP systems.
+#define FASTDELEGATE_USESTATICFUNCTIONHACK
+
+// Uncomment the next line to allow function declarator syntax.
+// It is automatically enabled for those compilers where it is known to work.
+//#define FASTDELEGATE_ALLOW_FUNCTION_TYPE_SYNTAX
+
+////////////////////////////////////////////////////////////////////////////////
+// Compiler identification for workarounds
+//
+////////////////////////////////////////////////////////////////////////////////
+
+// Compiler identification. It's not easy to identify Visual C++ because
+// many vendors fraudulently define Microsoft's identifiers.
+#if defined(_MSC_VER) && !defined(__MWERKS__) && !defined(__VECTOR_C) && \
+ !defined(__ICL) && !defined(__BORLANDC__)
+#define FASTDLGT_ISMSVC
+
+#if (_MSC_VER < 1300) // Many workarounds are required for VC6.
+#define FASTDLGT_VC6
+#pragma warning(disable : 4786) // disable this ridiculous warning
+#endif
+
+#endif
+
+// Does the compiler uses Microsoft's member function pointer structure?
+// If so, it needs special treatment.
+// Metrowerks CodeWarrior, Intel, and CodePlay fraudulently define Microsoft's
+// identifier, _MSC_VER. We need to filter Metrowerks out.
+#if defined(_MSC_VER) && !defined(__MWERKS__)
+#define FASTDLGT_MICROSOFT_MFP
+
+#if !defined(__VECTOR_C)
+// CodePlay doesn't have the __single/multi/virtual_inheritance keywords
+#define FASTDLGT_HASINHERITANCE_KEYWORDS
+#endif
+#endif
+
+// Does it allow function declarator syntax? The following compilers are known
+// to work:
+#if defined(FASTDLGT_ISMSVC) && (_MSC_VER >= 1310) // VC 7.1
+#define FASTDELEGATE_ALLOW_FUNCTION_TYPE_SYNTAX
+#endif
+
+// Gcc(2.95+), and versions of Digital Mars, Intel and Comeau in common use.
+#if defined(__DMC__) || defined(__GNUC__) || defined(__ICL) || defined(__COMO__)
+#define FASTDELEGATE_ALLOW_FUNCTION_TYPE_SYNTAX
+#endif
+
+// It works on Metrowerks MWCC 3.2.2. From boost.Config it should work on
+// earlier ones too.
+#if defined(__MWERKS__)
+#define FASTDELEGATE_ALLOW_FUNCTION_TYPE_SYNTAX
+#endif
+
+#ifdef __GNUC__ // Workaround GCC bug #8271
+// At present, GCC doesn't recognize constness of MFPs in templates
+#define FASTDELEGATE_GCC_BUG_8271
+#endif
+
+////////////////////////////////////////////////////////////////////////////////
+// General tricks used in this code
+//
+// (a) Error messages are generated by typdefing an array of negative size to
+// generate compile-time errors.
+// (b) Warning messages on MSVC are generated by declaring unused variables, and
+// enabling the "variable XXX is never used" warning.
+// (c) Unions are used in a few compiler-specific cases to perform illegal
+// casts.
+// (d) For Microsoft and Intel, when adjusting the 'this' pointer, it's cast to
+// (char *) first to ensure that the correct number of *bytes* are added.
+//
+////////////////////////////////////////////////////////////////////////////////
+// Helper templates
+//
+////////////////////////////////////////////////////////////////////////////////
+
+namespace fastdelegate {
+namespace detail { // we'll hide the implementation details in a nested
+ // namespace.
+
+// implicit_cast< >
+// I believe this was originally going to be in the C++ standard but
+// was left out by accident. It's even milder than static_cast.
+// I use it instead of static_cast<> to emphasize that I'm not doing
+// anything nasty.
+// Usage is identical to static_cast<>
+template <class OutputClass, class InputClass>
+inline OutputClass implicit_cast(InputClass input) {
+ return input;
+}
+
+// horrible_cast< >
+// This is truly evil. It completely subverts C++'s type system, allowing you
+// to cast from any class to any other class. Technically, using a union
+// to perform the cast is undefined behaviour (even in C). But we can see if
+// it is OK by checking that the union is the same size as each of its members.
+// horrible_cast<> should only be used for compiler-specific workarounds.
+// Usage is identical to reinterpret_cast<>.
+
+// This union is declared outside the horrible_cast because BCC 5.5.1
+// can't inline a function with a nested class, and gives a warning.
+template <class OutputClass, class InputClass>
+union horrible_union {
+ OutputClass out;
+ InputClass in;
+};
+
+template <class OutputClass, class InputClass>
+inline OutputClass horrible_cast(const InputClass input) {
+ horrible_union<OutputClass, InputClass> u;
+ // Cause a compile-time error if in, out and u are not the same size.
+ // If the compile fails here, it means the compiler has peculiar
+ // unions which would prevent the cast from working.
+ // typedef int ERROR_CantUseHorrible_cast[sizeof(InputClass)==sizeof(u)
+ // && sizeof(InputClass)==sizeof(OutputClass) ? 1 : -1];
+ u.in = input;
+ return u.out;
+}
+
+////////////////////////////////////////////////////////////////////////////////
+// Workarounds
+//
+////////////////////////////////////////////////////////////////////////////////
+
+// Backwards compatibility: This macro used to be necessary in the virtual
+// inheritance
+// case for Intel and Microsoft. Now it just forward-declares the class.
+#define FASTDELEGATEDECLARE(CLASSNAME) class CLASSNAME;
+
+// Prevent use of the static function hack with the DOS medium model.
+#ifdef __MEDIUM__
+#undef FASTDELEGATE_USESTATICFUNCTIONHACK
+#endif
+
+// DefaultVoid - a workaround for 'void' templates in VC6.
+//
+// (1) VC6 and earlier do not allow 'void' as a default template argument.
+// (2) They also doesn't allow you to return 'void' from a function.
+//
+// Workaround for (1): Declare a dummy type 'DefaultVoid' which we use
+// when we'd like to use 'void'. We convert it into 'void' and back
+// using the templates DefaultVoidToVoid<> and VoidToDefaultVoid<>.
+// Workaround for (2): On VC6, the code for calling a void function is
+// identical to the code for calling a non-void function in which the
+// return value is never used, provided the return value is returned
+// in the EAX register, rather than on the stack.
+// This is true for most fundamental types such as int, enum, void *.
+// Const void * is the safest option since it doesn't participate
+// in any automatic conversions. But on a 16-bit compiler it might
+// cause extra code to be generated, so we disable it for all compilers
+// except for VC6 (and VC5).
+#ifdef FASTDLGT_VC6
+// VC6 workaround
+typedef const void* DefaultVoid;
+#else
+// On any other compiler, just use a normal void.
+typedef void DefaultVoid;
+#endif
+
+// Translate from 'DefaultVoid' to 'void'.
+// Everything else is unchanged
+template <class T>
+struct DefaultVoidToVoid {
+ typedef T type;
+};
+
+template <>
+struct DefaultVoidToVoid<DefaultVoid> {
+ typedef void type;
+};
+
+// Translate from 'void' into 'DefaultVoid'
+// Everything else is unchanged
+template <class T>
+struct VoidToDefaultVoid {
+ typedef T type;
+};
+
+template <>
+struct VoidToDefaultVoid<void> {
+ typedef DefaultVoid type;
+};
+
+////////////////////////////////////////////////////////////////////////////////
+// Fast Delegates, part 1:
+//
+// Conversion of member function pointer to a standard form
+//
+////////////////////////////////////////////////////////////////////////////////
+
+// GenericClass is a fake class, ONLY used to provide a type.
+// It is vitally important that it is never defined, so that the compiler
+// doesn't
+// think it can optimize the invocation. For example, Borland generates simpler
+// code if it knows the class only uses single inheritance.
+
+// Compilers using Microsoft's structure need to be treated as a special case.
+#ifdef FASTDLGT_MICROSOFT_MFP
+
+#ifdef FASTDLGT_HASINHERITANCE_KEYWORDS
+// For Microsoft and Intel, we want to ensure that it's the most efficient type
+// of MFP
+// (4 bytes), even when the /vmg option is used. Declaring an empty class
+// would give 16 byte pointers in this case....
+class __single_inheritance GenericClass;
+#endif
+// ...but for Codeplay, an empty class *always* gives 4 byte pointers.
+// If compiled with the /clr option ("managed C++"), the JIT compiler thinks
+// it needs to load GenericClass before it can call any of its functions,
+// (compiles OK but crashes at runtime!), so we need to declare an
+// empty class to make it happy.
+// Codeplay and VC4 can't cope with the unknown_inheritance case either.
+class GenericClass {};
+#else
+class GenericClass;
+#endif
+
+// The size of a single inheritance member function pointer.
+const int SINGLE_MEMFUNCPTR_SIZE = sizeof(void (GenericClass::*)());
+
+// SimplifyMemFunc< >::Convert()
+//
+// A template function that converts an arbitrary member function pointer into
+// the
+// simplest possible form of member function pointer, using a supplied 'this'
+// pointer.
+// According to the standard, this can be done legally with reinterpret_cast<>.
+// For (non-standard) compilers which use member function pointers which vary
+// in size
+// depending on the class, we need to use knowledge of the internal structure
+// of a
+// member function pointer, as used by the compiler. Template specialization is
+// used
+// to distinguish between the sizes. Because some compilers don't support
+// partial
+// template specialisation, I use full specialisation of a wrapper struct.
+
+// general case -- don't know how to convert it. Force a compile failure
+template <int N>
+struct SimplifyMemFunc {
+ template <class X, class XFuncType, class GenericMemFuncType>
+ inline static GenericClass* Convert(X* pthis, XFuncType function_to_bind,
+ GenericMemFuncType& bound_func) {
+ // Unsupported member function type -- force a compile failure.
+ // (it's illegal to have a array with negative size).
+ // typedef char ERROR_Unsupported_member_function_pointer_on_this_compiler[N
+ // - 100];
+ return 0;
+ }
+};
+
+// For compilers where all member func ptrs are the same size, everything goes
+// here.
+// For non-standard compilers, only single_inheritance classes go here.
+template <>
+struct SimplifyMemFunc<SINGLE_MEMFUNCPTR_SIZE> {
+ template <class X, class XFuncType, class GenericMemFuncType>
+ inline static GenericClass* Convert(X* pthis, XFuncType function_to_bind,
+ GenericMemFuncType& bound_func) {
+#if defined __DMC__
+ // Digital Mars doesn't allow you to cast between abitrary PMF's,
+ // even though the standard says you can. The 32-bit compiler lets you
+ // static_cast through an int, but the DOS compiler doesn't.
+ bound_func = horrible_cast<GenericMemFuncType>(function_to_bind);
+#else
+ bound_func = reinterpret_cast<GenericMemFuncType>(function_to_bind);
+#endif
+ return reinterpret_cast<GenericClass*>(pthis);
+ }
+};
+
+////////////////////////////////////////////////////////////////////////////////
+// Fast Delegates, part 1b:
+//
+// Workarounds for Microsoft and Intel
+//
+////////////////////////////////////////////////////////////////////////////////
+
+// Compilers with member function pointers which violate the standard (MSVC,
+// Intel, Codeplay),
+// need to be treated as a special case.
+#ifdef FASTDLGT_MICROSOFT_MFP
+
+// We use unions to perform horrible_casts. I would like to use #pragma
+// pack(push, 1)
+// at the start of each function for extra safety, but VC6 seems to ICE
+// intermittently if you do this inside a template.
+
+// __multiple_inheritance classes go here
+// Nasty hack for Microsoft and Intel (IA32 and Itanium)
+template <>
+struct SimplifyMemFunc<SINGLE_MEMFUNCPTR_SIZE + sizeof(int)> {
+ template <class X, class XFuncType, class GenericMemFuncType>
+ inline static GenericClass* Convert(X* pthis, XFuncType function_to_bind,
+ GenericMemFuncType& bound_func) {
+ // We need to use a horrible_cast to do this conversion.
+ // In MSVC, a multiple inheritance member pointer is internally defined as:
+ union {
+ XFuncType func;
+ struct {
+ GenericMemFuncType funcaddress; // points to the actual member function
+ int delta; // #BYTES to be added to the 'this' pointer
+ } s;
+ } u;
+ // Check that the horrible_cast will work
+ typedef int ERROR_CantUsehorrible_cast
+ [sizeof(function_to_bind) == sizeof(u.s) ? 1 : -1];
+ u.func = function_to_bind;
+ bound_func = u.s.funcaddress;
+ return reinterpret_cast<GenericClass*>(reinterpret_cast<char*>(pthis) +
+ u.s.delta);
+ }
+};
+
+// virtual inheritance is a real nuisance. It's inefficient and complicated.
+// On MSVC and Intel, there isn't enough information in the pointer itself to
+// enable conversion to a closure pointer. Earlier versions of this code didn't
+// work for all cases, and generated a compile-time error instead.
+// But a very clever hack invented by John M. Dlugosz solves this problem.
+// My code is somewhat different to his: I have no asm code, and I make no
+// assumptions about the calling convention that is used.
+
+// In VC++ and ICL, a virtual_inheritance member pointer
+// is internally defined as:
+struct MicrosoftVirtualMFP {
+ void (GenericClass::*codeptr)(); // points to the actual member function
+ int delta; // #bytes to be added to the 'this' pointer
+ int vtable_index; // or 0 if no virtual inheritance
+};
+// The CRUCIAL feature of Microsoft/Intel MFPs which we exploit is that the
+// m_codeptr member is *always* called, regardless of the values of the other
+// members. (This is *not* true for other compilers, eg GCC, which obtain the
+// function address from the vtable if a virtual function is being called).
+// Dlugosz's trick is to make the codeptr point to a probe function which
+// returns the 'this' pointer that was used.
+
+// Define a generic class that uses virtual inheritance.
+// It has a trival member function that returns the value of the 'this' pointer.
+struct GenericVirtualClass : virtual public GenericClass {
+ typedef GenericVirtualClass* (GenericVirtualClass::*ProbePtrType)();
+ GenericVirtualClass* GetThis() { return this; }
+};
+
+// __virtual_inheritance classes go here
+template <>
+struct SimplifyMemFunc<SINGLE_MEMFUNCPTR_SIZE + 2 * sizeof(int)> {
+ template <class X, class XFuncType, class GenericMemFuncType>
+ inline static GenericClass* Convert(X* pthis, XFuncType function_to_bind,
+ GenericMemFuncType& bound_func) {
+ union {
+ XFuncType func;
+ GenericClass* (X::*ProbeFunc)();
+ MicrosoftVirtualMFP s;
+ } u;
+ u.func = function_to_bind;
+ bound_func = reinterpret_cast<GenericMemFuncType>(u.s.codeptr);
+ union {
+ GenericVirtualClass::ProbePtrType virtfunc;
+ MicrosoftVirtualMFP s;
+ } u2;
+ // Check that the horrible_cast<>s will work
+ typedef int
+ ERROR_CantUsehorrible_cast[sizeof(function_to_bind) == sizeof(u.s) &&
+ sizeof(function_to_bind) ==
+ sizeof(u.ProbeFunc) &&
+ sizeof(u2.virtfunc) == sizeof(u2.s)
+ ? 1
+ : -1];
+ // Unfortunately, taking the address of a MF prevents it from being inlined,
+ // so
+ // this next line can't be completely optimised away by the compiler.
+ u2.virtfunc = &GenericVirtualClass::GetThis;
+ u.s.codeptr = u2.s.codeptr;
+ return (pthis->*u.ProbeFunc)();
+ }
+};
+
+#if (_MSC_VER < 1300)
+
+// Nasty hack for Microsoft Visual C++ 6.0
+// unknown_inheritance classes go here
+// There is a compiler bug in MSVC6 which generates incorrect code in this
+// case!!
+template <>
+struct SimplifyMemFunc<SINGLE_MEMFUNCPTR_SIZE + 3 * sizeof(int)> {
+ template <class X, class XFuncType, class GenericMemFuncType>
+ inline static GenericClass* Convert(X* pthis, XFuncType function_to_bind,
+ GenericMemFuncType& bound_func) {
+ // There is an apalling but obscure compiler bug in MSVC6 and earlier:
+ // vtable_index and 'vtordisp' are always set to 0 in the
+ // unknown_inheritance case!
+ // This means that an incorrect function could be called!!!
+ // Compiling with the /vmg option leads to potentially incorrect code.
+ // This is probably the reason that the IDE has a user interface for
+ // specifying
+ // the /vmg option, but it is disabled - you can only specify /vmg on
+ // the command line. In VC1.5 and earlier, the compiler would ICE if it ever
+ // encountered this situation.
+ // It is OK to use the /vmg option if /vmm or /vms is specified.
+
+ // Fortunately, the wrong function is only called in very obscure cases.
+ // It only occurs when a derived class overrides a virtual function declared
+ // in a virtual base class, and the member function
+ // points to the *Derived* version of that function. The problem can be
+ // completely averted in 100% of cases by using the *Base class* for the
+ // member fpointer. Ie, if you use the base class as an interface, you'll
+ // stay out of trouble.
+ // Occasionally, you might want to point directly to a derived class
+ // function
+ // that isn't an override of a base class. In this case, both vtable_index
+ // and 'vtordisp' are zero, but a virtual_inheritance pointer will be
+ // generated.
+ // We can generate correct code in this case. To prevent an incorrect call
+ // from
+ // ever being made, on MSVC6 we generate a warning, and call a function to
+ // make the program crash instantly.
+ typedef char ERROR_VC6CompilerBug[-100];
+ return 0;
+ }
+};
+
+#else
+
+// Nasty hack for Microsoft and Intel (IA32 and Itanium)
+// unknown_inheritance classes go here
+// This is probably the ugliest bit of code I've ever written. Look at the
+// casts!
+// There is a compiler bug in MSVC6 which prevents it from using this code.
+template <>
+struct SimplifyMemFunc<SINGLE_MEMFUNCPTR_SIZE + 3 * sizeof(int)> {
+ template <class X, class XFuncType, class GenericMemFuncType>
+ inline static GenericClass* Convert(X* pthis, XFuncType function_to_bind,
+ GenericMemFuncType& bound_func) {
+ // The member function pointer is 16 bytes long. We can't use a normal cast,
+ // but
+ // we can use a union to do the conversion.
+ union {
+ XFuncType func;
+ // In VC++ and ICL, an unknown_inheritance member pointer
+ // is internally defined as:
+ struct {
+ GenericMemFuncType
+ m_funcaddress; // points to the actual member function
+ int delta; // #bytes to be added to the 'this' pointer
+ int vtordisp; // #bytes to add to 'this' to find the vtable
+ int vtable_index; // or 0 if no virtual inheritance
+ } s;
+ } u;
+ // Check that the horrible_cast will work
+ typedef int
+ ERROR_CantUsehorrible_cast[sizeof(XFuncType) == sizeof(u.s) ? 1 : -1];
+ u.func = function_to_bind;
+ bound_func = u.s.funcaddress;
+ int virtual_delta = 0;
+ if (u.s.vtable_index) { // Virtual inheritance is used
+ // First, get to the vtable.
+ // It is 'vtordisp' bytes from the start of the class.
+ const int* vtable = *reinterpret_cast<const int* const*>(
+ reinterpret_cast<const char*>(pthis) + u.s.vtordisp);
+
+ // 'vtable_index' tells us where in the table we should be looking.
+ virtual_delta =
+ u.s.vtordisp +
+ *reinterpret_cast<const int*>(reinterpret_cast<const char*>(vtable) +
+ u.s.vtable_index);
+ }
+ // The int at 'virtual_delta' gives us the amount to add to 'this'.
+ // Finally we can add the three components together. Phew!
+ return reinterpret_cast<GenericClass*>(reinterpret_cast<char*>(pthis) +
+ u.s.delta + virtual_delta);
+ };
+};
+#endif // MSVC 7 and greater
+
+#endif // MS/Intel hacks
+
+} // namespace detail
+
+////////////////////////////////////////////////////////////////////////////////
+// Fast Delegates, part 2:
+//
+// Define the delegate storage, and cope with static functions
+//
+////////////////////////////////////////////////////////////////////////////////
+
+// DelegateMemento -- an opaque structure which can hold an arbitary delegate.
+// It knows nothing about the calling convention or number of arguments used by
+// the function pointed to.
+// It supplies comparison operators so that it can be stored in STL collections.
+// It cannot be set to anything other than null, nor invoked directly:
+// it must be converted to a specific delegate.
+
+// Implementation:
+// There are two possible implementations: the Safe method and the Evil method.
+// DelegateMemento - Safe version
+//
+// This implementation is standard-compliant, but a bit tricky.
+// A static function pointer is stored inside the class.
+// Here are the valid values:
+// +-- Static pointer --+--pThis --+-- pMemFunc-+-- Meaning------+
+// | 0 | 0 | 0 | Empty |
+// | !=0 |(dontcare)| Invoker | Static function|
+// | 0 | !=0 | !=0* | Method call |
+// +--------------------+----------+------------+----------------+
+// * For Metrowerks, this can be 0. (first virtual function in a
+// single_inheritance class).
+// When stored stored inside a specific delegate, the 'dontcare' entries are
+// replaced
+// with a reference to the delegate itself. This complicates the = and ==
+// operators
+// for the delegate class.
+
+// DelegateMemento - Evil version
+//
+// For compilers where data pointers are at least as big as code pointers, it is
+// possible to store the function pointer in the this pointer, using another
+// horrible_cast. In this case the DelegateMemento implementation is simple:
+// +--pThis --+-- pMemFunc-+-- Meaning---------------------+
+// | 0 | 0 | Empty |
+// | !=0 | !=0* | Static function or method call|
+// +----------+------------+-------------------------------+
+// * For Metrowerks, this can be 0. (first virtual function in a
+// single_inheritance class).
+// Note that the Sun C++ and MSVC documentation explicitly state that they
+// support static_cast between void * and function pointers.
+
+class DelegateMemento {
+ protected:
+ // the data is protected, not private, because many
+ // compilers have problems with template friends.
+ typedef void (detail::GenericClass::*GenericMemFuncType)(); // arbitrary MFP.
+ detail::GenericClass* m_pthis;
+ GenericMemFuncType m_pFunction;
+
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+ typedef void (*GenericFuncPtr)(); // arbitrary code pointer
+ GenericFuncPtr m_pStaticFunction;
+#endif
+
+ public:
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+ DelegateMemento() : m_pthis(0), m_pFunction(0), m_pStaticFunction(0){};
+ void clear() {
+ m_pthis = 0;
+ m_pFunction = 0;
+ m_pStaticFunction = 0;
+ }
+#else
+ DelegateMemento() : m_pthis(0), m_pFunction(0){};
+ void clear() {
+ m_pthis = 0;
+ m_pFunction = 0;
+ }
+#endif
+ public:
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+ inline bool IsEqual(const DelegateMemento& x) const {
+ // We have to cope with the static function pointers as a special case
+ if (m_pFunction != x.m_pFunction) return false;
+ // the static function ptrs must either both be equal, or both be 0.
+ if (m_pStaticFunction != x.m_pStaticFunction) return false;
+ if (m_pStaticFunction != 0)
+ return m_pthis == x.m_pthis;
+ else
+ return true;
+ }
+#else // Evil Method
+ inline bool IsEqual(const DelegateMemento& x) const {
+ return m_pthis == x.m_pthis && m_pFunction == x.m_pFunction;
+ }
+#endif
+ // Provide a strict weak ordering for DelegateMementos.
+ inline bool IsLess(const DelegateMemento& right) const {
+// deal with static function pointers first
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+ if (m_pStaticFunction != 0 || right.m_pStaticFunction != 0)
+ return m_pStaticFunction < right.m_pStaticFunction;
+#endif
+ if (m_pthis != right.m_pthis) return m_pthis < right.m_pthis;
+ // There are no ordering operators for member function pointers,
+ // but we can fake one by comparing each byte. The resulting ordering is
+ // arbitrary (and compiler-dependent), but it permits storage in ordered STL
+ // containers.
+ return memcmp(&m_pFunction, &right.m_pFunction, sizeof(m_pFunction)) < 0;
+ }
+ // BUGFIX (Mar 2005):
+ // We can't just compare m_pFunction because on Metrowerks,
+ // m_pFunction can be zero even if the delegate is not empty!
+ inline bool operator!() const { // Is it bound to anything?
+ return m_pthis == 0 && m_pFunction == 0;
+ }
+ inline bool empty() const { // Is it bound to anything?
+ return m_pthis == 0 && m_pFunction == 0;
+ }
+
+ public:
+ DelegateMemento& operator=(const DelegateMemento& right) {
+ SetMementoFrom(right);
+ return *this;
+ }
+ inline bool operator<(const DelegateMemento& right) { return IsLess(right); }
+ inline bool operator>(const DelegateMemento& right) {
+ return right.IsLess(*this);
+ }
+ DelegateMemento(const DelegateMemento& right)
+ : m_pthis(right.m_pthis),
+ m_pFunction(right.m_pFunction)
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+ ,
+ m_pStaticFunction(right.m_pStaticFunction)
+#endif
+ {
+ }
+
+ protected:
+ void SetMementoFrom(const DelegateMemento& right) {
+ m_pFunction = right.m_pFunction;
+ m_pthis = right.m_pthis;
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+ m_pStaticFunction = right.m_pStaticFunction;
+#endif
+ }
+};
+
+// ClosurePtr<>
+//
+// A private wrapper class that adds function signatures to DelegateMemento.
+// It's the class that does most of the actual work.
+// The signatures are specified by:
+// GenericMemFunc: must be a type of GenericClass member function pointer.
+// StaticFuncPtr: must be a type of function pointer with the same signature
+// as GenericMemFunc.
+// UnvoidStaticFuncPtr: is the same as StaticFuncPtr, except on VC6
+// where it never returns void (returns DefaultVoid instead).
+
+// An outer class, FastDelegateN<>, handles the invoking and creates the
+// necessary typedefs.
+// This class does everything else.
+
+namespace detail {
+
+template <class GenericMemFunc, class StaticFuncPtr, class UnvoidStaticFuncPtr>
+class ClosurePtr : public DelegateMemento {
+ public:
+ // These functions are for setting the delegate to a member function.
+
+ // Here's the clever bit: we convert an arbitrary member function into a
+ // standard form. XMemFunc should be a member function of class X, but I can't
+ // enforce that here. It needs to be enforced by the wrapper class.
+ template <class X, class XMemFunc>
+ inline void bindmemfunc(X* pthis, XMemFunc function_to_bind) {
+ m_pthis = SimplifyMemFunc<sizeof(function_to_bind)>::Convert(
+ pthis, function_to_bind, m_pFunction);
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+ m_pStaticFunction = 0;
+#endif
+ }
+ // For const member functions, we only need a const class pointer.
+ // Since we know that the member function is const, it's safe to
+ // remove the const qualifier from the 'this' pointer with a const_cast.
+ // VC6 has problems if we just overload 'bindmemfunc', so we give it a
+ // different name.
+ template <class X, class XMemFunc>
+ inline void bindconstmemfunc(const X* pthis, XMemFunc function_to_bind) {
+ m_pthis = SimplifyMemFunc<sizeof(function_to_bind)>::Convert(
+ const_cast<X*>(pthis), function_to_bind, m_pFunction);
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+ m_pStaticFunction = 0;
+#endif
+ }
+#ifdef FASTDELEGATE_GCC_BUG_8271 // At present, GCC doesn't recognize constness
+ // of MFPs in templates
+ template <class X, class XMemFunc>
+ inline void bindmemfunc(const X* pthis, XMemFunc function_to_bind) {
+ bindconstmemfunc(pthis, function_to_bind);
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+ m_pStaticFunction = 0;
+#endif
+ }
+#endif
+ // These functions are required for invoking the stored function
+ inline GenericClass* GetClosureThis() const { return m_pthis; }
+ inline GenericMemFunc GetClosureMemPtr() const {
+ return reinterpret_cast<GenericMemFunc>(m_pFunction);
+ }
+
+// There are a few ways of dealing with static function pointers.
+// There's a standard-compliant, but tricky method.
+// There's also a straightforward hack, that won't work on DOS compilers using
+// the
+// medium memory model. It's so evil that I can't recommend it, but I've
+// implemented it anyway because it produces very nice asm code.
+
+#if !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+
+ // ClosurePtr<> - Safe version
+ //
+ // This implementation is standard-compliant, but a bit tricky.
+ // I store the function pointer inside the class, and the delegate then
+ // points to itself. Whenever the delegate is copied, these self-references
+ // must be transformed, and this complicates the = and == operators.
+ public:
+ // The next two functions are for operator ==, =, and the copy constructor.
+ // We may need to convert the m_pthis pointers, so that
+ // they remain as self-references.
+ template <class DerivedClass>
+ inline void CopyFrom(DerivedClass* pParent, const DelegateMemento& x) {
+ SetMementoFrom(x);
+ if (m_pStaticFunction != 0) {
+ // transform self references...
+ m_pthis = reinterpret_cast<GenericClass*>(pParent);
+ }
+ }
+ // For static functions, the 'static_function_invoker' class in the parent
+ // will be called. The parent then needs to call GetStaticFunction() to find
+ // out
+ // the actual function to invoke.
+ template <class DerivedClass, class ParentInvokerSig>
+ inline void bindstaticfunc(DerivedClass* pParent,
+ ParentInvokerSig static_function_invoker,
+ StaticFuncPtr function_to_bind) {
+ if (function_to_bind == 0) { // cope with assignment to 0
+ m_pFunction = 0;
+ } else {
+ bindmemfunc(pParent, static_function_invoker);
+ }
+ m_pStaticFunction = reinterpret_cast<GenericFuncPtr>(function_to_bind);
+ }
+ inline UnvoidStaticFuncPtr GetStaticFunction() const {
+ return reinterpret_cast<UnvoidStaticFuncPtr>(m_pStaticFunction);
+ }
+#else
+
+ // ClosurePtr<> - Evil version
+ //
+ // For compilers where data pointers are at least as big as code pointers, it
+ // is
+ // possible to store the function pointer in the this pointer, using another
+ // horrible_cast. Invocation isn't any faster, but it saves 4 bytes, and
+ // speeds up comparison and assignment. If C++ provided direct language
+ // support
+ // for delegates, they would produce asm code that was almost identical to
+ // this.
+ // Note that the Sun C++ and MSVC documentation explicitly state that they
+ // support static_cast between void * and function pointers.
+
+ template <class DerivedClass>
+ inline void CopyFrom(DerivedClass* pParent, const DelegateMemento& right) {
+ SetMementoFrom(right);
+ }
+ // For static functions, the 'static_function_invoker' class in the parent
+ // will be called. The parent then needs to call GetStaticFunction() to find
+ // out
+ // the actual function to invoke.
+ // ******** EVIL, EVIL CODE! *******
+ template <class DerivedClass, class ParentInvokerSig>
+ inline void bindstaticfunc(DerivedClass* pParent,
+ ParentInvokerSig static_function_invoker,
+ StaticFuncPtr function_to_bind) {
+ if (function_to_bind == 0) { // cope with assignment to 0
+ m_pFunction = 0;
+ } else {
+ // We'll be ignoring the 'this' pointer, but we need to make sure we pass
+ // a valid value to bindmemfunc().
+ bindmemfunc(pParent, static_function_invoker);
+ }
+
+ // WARNING! Evil hack. We store the function in the 'this' pointer!
+ // Ensure that there's a compilation failure if function pointers
+ // and data pointers have different sizes.
+ // If you get this error, you need to #undef
+ // FASTDELEGATE_USESTATICFUNCTIONHACK.
+ // typedef int ERROR_CantUseEvilMethod[sizeof(GenericClass*) ==
+ // sizeof(function_to_bind) ? 1 : -1];
+ m_pthis = horrible_cast<GenericClass*>(function_to_bind);
+ // MSVC, SunC++ and DMC accept the following (non-standard) code:
+ // m_pthis = static_cast<GenericClass *>(static_cast<void
+ // *>(function_to_bind));
+ // BCC32, Comeau and DMC accept this method. MSVC7.1 needs __int64 instead
+ // of long
+ // m_pthis = reinterpret_cast<GenericClass
+ // *>(reinterpret_cast<long>(function_to_bind));
+ }
+ // ******** EVIL, EVIL CODE! *******
+ // This function will be called with an invalid 'this' pointer!!
+ // We're just returning the 'this' pointer, converted into
+ // a function pointer!
+ inline UnvoidStaticFuncPtr GetStaticFunction() const {
+ // Ensure that there's a compilation failure if function pointers
+ // and data pointers have different sizes.
+ // If you get this error, you need to #undef
+ // FASTDELEGATE_USESTATICFUNCTIONHACK.
+ // typedef int ERROR_CantUseEvilMethod[sizeof(UnvoidStaticFuncPtr) ==
+ // sizeof(this) ? 1 : -1];
+ return horrible_cast<UnvoidStaticFuncPtr>(this);
+ }
+#endif // !defined(FASTDELEGATE_USESTATICFUNCTIONHACK)
+
+ // Does the closure contain this static function?
+ inline bool IsEqualToStaticFuncPtr(StaticFuncPtr funcptr) {
+ if (funcptr == 0) return empty();
+ // For the Evil method, if it doesn't actually contain a static function,
+ // this will return an arbitrary
+ // value that is not equal to any valid function pointer.
+ else
+ return funcptr == reinterpret_cast<StaticFuncPtr>(GetStaticFunction());
+ }
+};
+
+} // namespace detail
+
+////////////////////////////////////////////////////////////////////////////////
+// Fast Delegates, part 3:
+//
+// Wrapper classes to ensure type safety
+//
+////////////////////////////////////////////////////////////////////////////////
+
+// Once we have the member function conversion templates, it's easy to make the
+// wrapper classes. So that they will work with as many compilers as possible,
+// the classes are of the form
+// FastDelegate3<int, char *, double>
+// They can cope with any combination of parameters. The max number of
+// parameters
+// allowed is 8, but it is trivial to increase this limit.
+// Note that we need to treat const member functions seperately.
+// All this class does is to enforce type safety, and invoke the delegate with
+// the correct list of parameters.
+
+// Because of the weird rule about the class of derived member function
+// pointers,
+// you sometimes need to apply a downcast to the 'this' pointer.
+// This is the reason for the use of "implicit_cast<X*>(pthis)" in the code
+// below.
+// If CDerivedClass is derived from CBaseClass, but doesn't override
+// SimpleVirtualFunction,
+// without this trick you'd need to write:
+// MyDelegate(static_cast<CBaseClass *>(&d),
+// &CDerivedClass::SimpleVirtualFunction);
+// but with the trick you can write
+// MyDelegate(&d, &CDerivedClass::SimpleVirtualFunction);
+
+// RetType is the type the compiler uses in compiling the template. For VC6,
+// it cannot be void. DesiredRetType is the real type which is returned from
+// all of the functions. It can be void.
+
+// Implicit conversion to "bool" is achieved using the safe_bool idiom,
+// using member data pointers (MDP). This allows "if (dg)..." syntax
+// Because some compilers (eg codeplay) don't have a unique value for a zero
+// MDP, an extra padding member is added to the SafeBool struct.
+// Some compilers (eg VC6) won't implicitly convert from 0 to an MDP, so
+// in that case the static function constructor is not made explicit; this
+// allows "if (dg==0) ..." to compile.
+
+// N=0
+template <class RetType = detail::DefaultVoid>
+class FastDelegate0 {
+ private:
+ typedef typename detail::DefaultVoidToVoid<RetType>::type DesiredRetType;
+ typedef DesiredRetType (*StaticFunctionPtr)();
+ typedef RetType (*UnvoidStaticFunctionPtr)();
+ typedef RetType (detail::GenericClass::*GenericMemFn)();
+ typedef detail::ClosurePtr<GenericMemFn, StaticFunctionPtr,
+ UnvoidStaticFunctionPtr>
+ ClosureType;
+ ClosureType m_Closure;
+
+ public:
+ // Typedefs to aid generic programming
+ typedef FastDelegate0 type;
+
+ // Construction and comparison functions
+ FastDelegate0() { clear(); }
+ FastDelegate0(const FastDelegate0& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ void operator=(const FastDelegate0& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ bool operator==(const FastDelegate0& x) const {
+ return m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator!=(const FastDelegate0& x) const {
+ return !m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator<(const FastDelegate0& x) const {
+ return m_Closure.IsLess(x.m_Closure);
+ }
+ bool operator>(const FastDelegate0& x) const {
+ return x.m_Closure.IsLess(m_Closure);
+ }
+ // Binding to non-const member functions
+ template <class X, class Y>
+ FastDelegate0(Y* pthis, DesiredRetType (X::*function_to_bind)()) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(Y* pthis, DesiredRetType (X::*function_to_bind)()) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ // Binding to const member functions.
+ template <class X, class Y>
+ FastDelegate0(const Y* pthis, DesiredRetType (X::*function_to_bind)() const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)() const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ // Static functions. We convert them into a member function call.
+ // This constructor also provides implicit conversion
+ FastDelegate0(DesiredRetType (*function_to_bind)()) {
+ bind(function_to_bind);
+ }
+ // for efficiency, prevent creation of a temporary
+ void operator=(DesiredRetType (*function_to_bind)()) {
+ bind(function_to_bind);
+ }
+ inline void bind(DesiredRetType (*function_to_bind)()) {
+ m_Closure.bindstaticfunc(this, &FastDelegate0::InvokeStaticFunction,
+ function_to_bind);
+ }
+ // Invoke the delegate
+ RetType operator()() const {
+ return (m_Closure.GetClosureThis()->*(m_Closure.GetClosureMemPtr()))();
+ }
+ // Implicit conversion to "bool" using the safe_bool idiom
+ private:
+ typedef struct SafeBoolStruct {
+ int a_data_pointer_to_this_is_0_on_buggy_compilers;
+ StaticFunctionPtr m_nonzero;
+ } UselessTypedef;
+ typedef StaticFunctionPtr SafeBoolStruct::*unspecified_bool_type;
+
+ public:
+ operator unspecified_bool_type() const {
+ return empty() ? 0 : &SafeBoolStruct::m_nonzero;
+ }
+ // necessary to allow ==0 to work despite the safe_bool idiom
+ inline bool operator==(StaticFunctionPtr funcptr) {
+ return m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!=(StaticFunctionPtr funcptr) {
+ return !m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!() const { // Is it bound to anything?
+ return !m_Closure;
+ }
+ inline bool empty() const { return !m_Closure; }
+ void clear() { m_Closure.clear(); }
+ // Conversion to and from the DelegateMemento storage class
+ const DelegateMemento& GetMemento() { return m_Closure; }
+ void SetMemento(const DelegateMemento& any) { m_Closure.CopyFrom(this, any); }
+
+ private: // Invoker for static functions
+ RetType InvokeStaticFunction() const {
+ return (*(m_Closure.GetStaticFunction()))();
+ }
+};
+
+// N=1
+template <class Param1, class RetType = detail::DefaultVoid>
+class FastDelegate1 {
+ private:
+ typedef typename detail::DefaultVoidToVoid<RetType>::type DesiredRetType;
+ typedef DesiredRetType (*StaticFunctionPtr)(Param1 p1);
+ typedef RetType (*UnvoidStaticFunctionPtr)(Param1 p1);
+ typedef RetType (detail::GenericClass::*GenericMemFn)(Param1 p1);
+ typedef detail::ClosurePtr<GenericMemFn, StaticFunctionPtr,
+ UnvoidStaticFunctionPtr>
+ ClosureType;
+ ClosureType m_Closure;
+
+ public:
+ // Typedefs to aid generic programming
+ typedef FastDelegate1 type;
+
+ // Construction and comparison functions
+ FastDelegate1() { clear(); }
+ FastDelegate1(const FastDelegate1& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ void operator=(const FastDelegate1& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ bool operator==(const FastDelegate1& x) const {
+ return m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator!=(const FastDelegate1& x) const {
+ return !m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator<(const FastDelegate1& x) const {
+ return m_Closure.IsLess(x.m_Closure);
+ }
+ bool operator>(const FastDelegate1& x) const {
+ return x.m_Closure.IsLess(m_Closure);
+ }
+ // Binding to non-const member functions
+ template <class X, class Y>
+ FastDelegate1(Y* pthis, DesiredRetType (X::*function_to_bind)(Param1 p1)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(Y* pthis, DesiredRetType (X::*function_to_bind)(Param1 p1)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ // Binding to const member functions.
+ template <class X, class Y>
+ FastDelegate1(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1) const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1) const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ // Static functions. We convert them into a member function call.
+ // This constructor also provides implicit conversion
+ FastDelegate1(DesiredRetType (*function_to_bind)(Param1 p1)) {
+ bind(function_to_bind);
+ }
+ // for efficiency, prevent creation of a temporary
+ void operator=(DesiredRetType (*function_to_bind)(Param1 p1)) {
+ bind(function_to_bind);
+ }
+ inline void bind(DesiredRetType (*function_to_bind)(Param1 p1)) {
+ m_Closure.bindstaticfunc(this, &FastDelegate1::InvokeStaticFunction,
+ function_to_bind);
+ }
+ // Invoke the delegate
+ RetType operator()(Param1 p1) const {
+ return (m_Closure.GetClosureThis()->*(m_Closure.GetClosureMemPtr()))(p1);
+ }
+ // Implicit conversion to "bool" using the safe_bool idiom
+ private:
+ typedef struct SafeBoolStruct {
+ int a_data_pointer_to_this_is_0_on_buggy_compilers;
+ StaticFunctionPtr m_nonzero;
+ } UselessTypedef;
+ typedef StaticFunctionPtr SafeBoolStruct::*unspecified_bool_type;
+
+ public:
+ operator unspecified_bool_type() const {
+ return empty() ? 0 : &SafeBoolStruct::m_nonzero;
+ }
+ // necessary to allow ==0 to work despite the safe_bool idiom
+ inline bool operator==(StaticFunctionPtr funcptr) {
+ return m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!=(StaticFunctionPtr funcptr) {
+ return !m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!() const { // Is it bound to anything?
+ return !m_Closure;
+ }
+ inline bool empty() const { return !m_Closure; }
+ void clear() { m_Closure.clear(); }
+ // Conversion to and from the DelegateMemento storage class
+ const DelegateMemento& GetMemento() { return m_Closure; }
+ void SetMemento(const DelegateMemento& any) { m_Closure.CopyFrom(this, any); }
+
+ private: // Invoker for static functions
+ RetType InvokeStaticFunction(Param1 p1) const {
+ return (*(m_Closure.GetStaticFunction()))(p1);
+ }
+};
+
+// N=2
+template <class Param1, class Param2, class RetType = detail::DefaultVoid>
+class FastDelegate2 {
+ private:
+ typedef typename detail::DefaultVoidToVoid<RetType>::type DesiredRetType;
+ typedef DesiredRetType (*StaticFunctionPtr)(Param1 p1, Param2 p2);
+ typedef RetType (*UnvoidStaticFunctionPtr)(Param1 p1, Param2 p2);
+ typedef RetType (detail::GenericClass::*GenericMemFn)(Param1 p1, Param2 p2);
+ typedef detail::ClosurePtr<GenericMemFn, StaticFunctionPtr,
+ UnvoidStaticFunctionPtr>
+ ClosureType;
+ ClosureType m_Closure;
+
+ public:
+ // Typedefs to aid generic programming
+ typedef FastDelegate2 type;
+
+ // Construction and comparison functions
+ FastDelegate2() { clear(); }
+ FastDelegate2(const FastDelegate2& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ void operator=(const FastDelegate2& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ bool operator==(const FastDelegate2& x) const {
+ return m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator!=(const FastDelegate2& x) const {
+ return !m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator<(const FastDelegate2& x) const {
+ return m_Closure.IsLess(x.m_Closure);
+ }
+ bool operator>(const FastDelegate2& x) const {
+ return x.m_Closure.IsLess(m_Closure);
+ }
+ // Binding to non-const member functions
+ template <class X, class Y>
+ FastDelegate2(Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(Y* pthis, DesiredRetType (X::*function_to_bind)(Param1 p1,
+ Param2 p2)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ // Binding to const member functions.
+ template <class X, class Y>
+ FastDelegate2(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2)
+ const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2)
+ const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ // Static functions. We convert them into a member function call.
+ // This constructor also provides implicit conversion
+ FastDelegate2(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2)) {
+ bind(function_to_bind);
+ }
+ // for efficiency, prevent creation of a temporary
+ void operator=(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2)) {
+ bind(function_to_bind);
+ }
+ inline void bind(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2)) {
+ m_Closure.bindstaticfunc(this, &FastDelegate2::InvokeStaticFunction,
+ function_to_bind);
+ }
+ // Invoke the delegate
+ RetType operator()(Param1 p1, Param2 p2) const {
+ return (m_Closure.GetClosureThis()->*(m_Closure.GetClosureMemPtr()))(p1,
+ p2);
+ }
+ // Implicit conversion to "bool" using the safe_bool idiom
+ private:
+ typedef struct SafeBoolStruct {
+ int a_data_pointer_to_this_is_0_on_buggy_compilers;
+ StaticFunctionPtr m_nonzero;
+ } UselessTypedef;
+ typedef StaticFunctionPtr SafeBoolStruct::*unspecified_bool_type;
+
+ public:
+ operator unspecified_bool_type() const {
+ return empty() ? 0 : &SafeBoolStruct::m_nonzero;
+ }
+ // necessary to allow ==0 to work despite the safe_bool idiom
+ inline bool operator==(StaticFunctionPtr funcptr) {
+ return m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!=(StaticFunctionPtr funcptr) {
+ return !m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!() const { // Is it bound to anything?
+ return !m_Closure;
+ }
+ inline bool empty() const { return !m_Closure; }
+ void clear() { m_Closure.clear(); }
+ // Conversion to and from the DelegateMemento storage class
+ const DelegateMemento& GetMemento() { return m_Closure; }
+ void SetMemento(const DelegateMemento& any) { m_Closure.CopyFrom(this, any); }
+
+ private: // Invoker for static functions
+ RetType InvokeStaticFunction(Param1 p1, Param2 p2) const {
+ return (*(m_Closure.GetStaticFunction()))(p1, p2);
+ }
+};
+
+// N=3
+template <class Param1, class Param2, class Param3,
+ class RetType = detail::DefaultVoid>
+class FastDelegate3 {
+ private:
+ typedef typename detail::DefaultVoidToVoid<RetType>::type DesiredRetType;
+ typedef DesiredRetType (*StaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3);
+ typedef RetType (*UnvoidStaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3);
+ typedef RetType (detail::GenericClass::*GenericMemFn)(Param1 p1, Param2 p2,
+ Param3 p3);
+ typedef detail::ClosurePtr<GenericMemFn, StaticFunctionPtr,
+ UnvoidStaticFunctionPtr>
+ ClosureType;
+ ClosureType m_Closure;
+
+ public:
+ // Typedefs to aid generic programming
+ typedef FastDelegate3 type;
+
+ // Construction and comparison functions
+ FastDelegate3() { clear(); }
+ FastDelegate3(const FastDelegate3& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ void operator=(const FastDelegate3& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ bool operator==(const FastDelegate3& x) const {
+ return m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator!=(const FastDelegate3& x) const {
+ return !m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator<(const FastDelegate3& x) const {
+ return m_Closure.IsLess(x.m_Closure);
+ }
+ bool operator>(const FastDelegate3& x) const {
+ return x.m_Closure.IsLess(m_Closure);
+ }
+ // Binding to non-const member functions
+ template <class X, class Y>
+ FastDelegate3(Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ // Binding to const member functions.
+ template <class X, class Y>
+ FastDelegate3(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3) const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3) const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ // Static functions. We convert them into a member function call.
+ // This constructor also provides implicit conversion
+ FastDelegate3(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3)) {
+ bind(function_to_bind);
+ }
+ // for efficiency, prevent creation of a temporary
+ void operator=(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3)) {
+ bind(function_to_bind);
+ }
+ inline void bind(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3)) {
+ m_Closure.bindstaticfunc(this, &FastDelegate3::InvokeStaticFunction,
+ function_to_bind);
+ }
+ // Invoke the delegate
+ RetType operator()(Param1 p1, Param2 p2, Param3 p3) const {
+ return (m_Closure.GetClosureThis()->*(m_Closure.GetClosureMemPtr()))(p1, p2,
+ p3);
+ }
+ // Implicit conversion to "bool" using the safe_bool idiom
+ private:
+ typedef struct SafeBoolStruct {
+ int a_data_pointer_to_this_is_0_on_buggy_compilers;
+ StaticFunctionPtr m_nonzero;
+ } UselessTypedef;
+ typedef StaticFunctionPtr SafeBoolStruct::*unspecified_bool_type;
+
+ public:
+ operator unspecified_bool_type() const {
+ return empty() ? 0 : &SafeBoolStruct::m_nonzero;
+ }
+ // necessary to allow ==0 to work despite the safe_bool idiom
+ inline bool operator==(StaticFunctionPtr funcptr) {
+ return m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!=(StaticFunctionPtr funcptr) {
+ return !m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!() const { // Is it bound to anything?
+ return !m_Closure;
+ }
+ inline bool empty() const { return !m_Closure; }
+ void clear() { m_Closure.clear(); }
+ // Conversion to and from the DelegateMemento storage class
+ const DelegateMemento& GetMemento() { return m_Closure; }
+ void SetMemento(const DelegateMemento& any) { m_Closure.CopyFrom(this, any); }
+
+ private: // Invoker for static functions
+ RetType InvokeStaticFunction(Param1 p1, Param2 p2, Param3 p3) const {
+ return (*(m_Closure.GetStaticFunction()))(p1, p2, p3);
+ }
+};
+
+// N=4
+template <class Param1, class Param2, class Param3, class Param4,
+ class RetType = detail::DefaultVoid>
+class FastDelegate4 {
+ private:
+ typedef typename detail::DefaultVoidToVoid<RetType>::type DesiredRetType;
+ typedef DesiredRetType (*StaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4);
+ typedef RetType (*UnvoidStaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4);
+ typedef RetType (detail::GenericClass::*GenericMemFn)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4);
+ typedef detail::ClosurePtr<GenericMemFn, StaticFunctionPtr,
+ UnvoidStaticFunctionPtr>
+ ClosureType;
+ ClosureType m_Closure;
+
+ public:
+ // Typedefs to aid generic programming
+ typedef FastDelegate4 type;
+
+ // Construction and comparison functions
+ FastDelegate4() { clear(); }
+ FastDelegate4(const FastDelegate4& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ void operator=(const FastDelegate4& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ bool operator==(const FastDelegate4& x) const {
+ return m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator!=(const FastDelegate4& x) const {
+ return !m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator<(const FastDelegate4& x) const {
+ return m_Closure.IsLess(x.m_Closure);
+ }
+ bool operator>(const FastDelegate4& x) const {
+ return x.m_Closure.IsLess(m_Closure);
+ }
+ // Binding to non-const member functions
+ template <class X, class Y>
+ FastDelegate4(Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(Y* pthis, DesiredRetType (X::*function_to_bind)(
+ Param1 p1, Param2 p2, Param3 p3, Param4 p4)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ // Binding to const member functions.
+ template <class X, class Y>
+ FastDelegate4(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4)
+ const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4)
+ const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ // Static functions. We convert them into a member function call.
+ // This constructor also provides implicit conversion
+ FastDelegate4(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4)) {
+ bind(function_to_bind);
+ }
+ // for efficiency, prevent creation of a temporary
+ void operator=(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4)) {
+ bind(function_to_bind);
+ }
+ inline void bind(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4)) {
+ m_Closure.bindstaticfunc(this, &FastDelegate4::InvokeStaticFunction,
+ function_to_bind);
+ }
+ // Invoke the delegate
+ RetType operator()(Param1 p1, Param2 p2, Param3 p3, Param4 p4) const {
+ return (m_Closure.GetClosureThis()->*(m_Closure.GetClosureMemPtr()))(
+ p1, p2, p3, p4);
+ }
+ // Implicit conversion to "bool" using the safe_bool idiom
+ private:
+ typedef struct SafeBoolStruct {
+ int a_data_pointer_to_this_is_0_on_buggy_compilers;
+ StaticFunctionPtr m_nonzero;
+ } UselessTypedef;
+ typedef StaticFunctionPtr SafeBoolStruct::*unspecified_bool_type;
+
+ public:
+ operator unspecified_bool_type() const {
+ return empty() ? 0 : &SafeBoolStruct::m_nonzero;
+ }
+ // necessary to allow ==0 to work despite the safe_bool idiom
+ inline bool operator==(StaticFunctionPtr funcptr) {
+ return m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!=(StaticFunctionPtr funcptr) {
+ return !m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!() const { // Is it bound to anything?
+ return !m_Closure;
+ }
+ inline bool empty() const { return !m_Closure; }
+ void clear() { m_Closure.clear(); }
+ // Conversion to and from the DelegateMemento storage class
+ const DelegateMemento& GetMemento() { return m_Closure; }
+ void SetMemento(const DelegateMemento& any) { m_Closure.CopyFrom(this, any); }
+
+ private: // Invoker for static functions
+ RetType InvokeStaticFunction(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4) const {
+ return (*(m_Closure.GetStaticFunction()))(p1, p2, p3, p4);
+ }
+};
+
+// N=5
+template <class Param1, class Param2, class Param3, class Param4, class Param5,
+ class RetType = detail::DefaultVoid>
+class FastDelegate5 {
+ private:
+ typedef typename detail::DefaultVoidToVoid<RetType>::type DesiredRetType;
+ typedef DesiredRetType (*StaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5);
+ typedef RetType (*UnvoidStaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5);
+ typedef RetType (detail::GenericClass::*GenericMemFn)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5);
+ typedef detail::ClosurePtr<GenericMemFn, StaticFunctionPtr,
+ UnvoidStaticFunctionPtr>
+ ClosureType;
+ ClosureType m_Closure;
+
+ public:
+ // Typedefs to aid generic programming
+ typedef FastDelegate5 type;
+
+ // Construction and comparison functions
+ FastDelegate5() { clear(); }
+ FastDelegate5(const FastDelegate5& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ void operator=(const FastDelegate5& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ bool operator==(const FastDelegate5& x) const {
+ return m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator!=(const FastDelegate5& x) const {
+ return !m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator<(const FastDelegate5& x) const {
+ return m_Closure.IsLess(x.m_Closure);
+ }
+ bool operator>(const FastDelegate5& x) const {
+ return x.m_Closure.IsLess(m_Closure);
+ }
+ // Binding to non-const member functions
+ template <class X, class Y>
+ FastDelegate5(Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ // Binding to const member functions.
+ template <class X, class Y>
+ FastDelegate5(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5) const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5) const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ // Static functions. We convert them into a member function call.
+ // This constructor also provides implicit conversion
+ FastDelegate5(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5)) {
+ bind(function_to_bind);
+ }
+ // for efficiency, prevent creation of a temporary
+ void operator=(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5)) {
+ bind(function_to_bind);
+ }
+ inline void bind(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5)) {
+ m_Closure.bindstaticfunc(this, &FastDelegate5::InvokeStaticFunction,
+ function_to_bind);
+ }
+ // Invoke the delegate
+ RetType operator()(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5) const {
+ return (m_Closure.GetClosureThis()->*(m_Closure.GetClosureMemPtr()))(
+ p1, p2, p3, p4, p5);
+ }
+ // Implicit conversion to "bool" using the safe_bool idiom
+ private:
+ typedef struct SafeBoolStruct {
+ int a_data_pointer_to_this_is_0_on_buggy_compilers;
+ StaticFunctionPtr m_nonzero;
+ } UselessTypedef;
+ typedef StaticFunctionPtr SafeBoolStruct::*unspecified_bool_type;
+
+ public:
+ operator unspecified_bool_type() const {
+ return empty() ? 0 : &SafeBoolStruct::m_nonzero;
+ }
+ // necessary to allow ==0 to work despite the safe_bool idiom
+ inline bool operator==(StaticFunctionPtr funcptr) {
+ return m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!=(StaticFunctionPtr funcptr) {
+ return !m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!() const { // Is it bound to anything?
+ return !m_Closure;
+ }
+ inline bool empty() const { return !m_Closure; }
+ void clear() { m_Closure.clear(); }
+ // Conversion to and from the DelegateMemento storage class
+ const DelegateMemento& GetMemento() { return m_Closure; }
+ void SetMemento(const DelegateMemento& any) { m_Closure.CopyFrom(this, any); }
+
+ private: // Invoker for static functions
+ RetType InvokeStaticFunction(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5) const {
+ return (*(m_Closure.GetStaticFunction()))(p1, p2, p3, p4, p5);
+ }
+};
+
+// N=6
+template <class Param1, class Param2, class Param3, class Param4, class Param5,
+ class Param6, class RetType = detail::DefaultVoid>
+class FastDelegate6 {
+ private:
+ typedef typename detail::DefaultVoidToVoid<RetType>::type DesiredRetType;
+ typedef DesiredRetType (*StaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6);
+ typedef RetType (*UnvoidStaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6);
+ typedef RetType (detail::GenericClass::*GenericMemFn)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6);
+ typedef detail::ClosurePtr<GenericMemFn, StaticFunctionPtr,
+ UnvoidStaticFunctionPtr>
+ ClosureType;
+ ClosureType m_Closure;
+
+ public:
+ // Typedefs to aid generic programming
+ typedef FastDelegate6 type;
+
+ // Construction and comparison functions
+ FastDelegate6() { clear(); }
+ FastDelegate6(const FastDelegate6& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ void operator=(const FastDelegate6& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ bool operator==(const FastDelegate6& x) const {
+ return m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator!=(const FastDelegate6& x) const {
+ return !m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator<(const FastDelegate6& x) const {
+ return m_Closure.IsLess(x.m_Closure);
+ }
+ bool operator>(const FastDelegate6& x) const {
+ return x.m_Closure.IsLess(m_Closure);
+ }
+ // Binding to non-const member functions
+ template <class X, class Y>
+ FastDelegate6(Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(Y* pthis, DesiredRetType (X::*function_to_bind)(
+ Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ // Binding to const member functions.
+ template <class X, class Y>
+ FastDelegate6(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6)
+ const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6)
+ const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ // Static functions. We convert them into a member function call.
+ // This constructor also provides implicit conversion
+ FastDelegate6(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6)) {
+ bind(function_to_bind);
+ }
+ // for efficiency, prevent creation of a temporary
+ void operator=(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6)) {
+ bind(function_to_bind);
+ }
+ inline void bind(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6)) {
+ m_Closure.bindstaticfunc(this, &FastDelegate6::InvokeStaticFunction,
+ function_to_bind);
+ }
+ // Invoke the delegate
+ RetType operator()(Param1 p1, Param2 p2, Param3 p3, Param4 p4, Param5 p5,
+ Param6 p6) const {
+ return (m_Closure.GetClosureThis()->*(m_Closure.GetClosureMemPtr()))(
+ p1, p2, p3, p4, p5, p6);
+ }
+ // Implicit conversion to "bool" using the safe_bool idiom
+ private:
+ typedef struct SafeBoolStruct {
+ int a_data_pointer_to_this_is_0_on_buggy_compilers;
+ StaticFunctionPtr m_nonzero;
+ } UselessTypedef;
+ typedef StaticFunctionPtr SafeBoolStruct::*unspecified_bool_type;
+
+ public:
+ operator unspecified_bool_type() const {
+ return empty() ? 0 : &SafeBoolStruct::m_nonzero;
+ }
+ // necessary to allow ==0 to work despite the safe_bool idiom
+ inline bool operator==(StaticFunctionPtr funcptr) {
+ return m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!=(StaticFunctionPtr funcptr) {
+ return !m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!() const { // Is it bound to anything?
+ return !m_Closure;
+ }
+ inline bool empty() const { return !m_Closure; }
+ void clear() { m_Closure.clear(); }
+ // Conversion to and from the DelegateMemento storage class
+ const DelegateMemento& GetMemento() { return m_Closure; }
+ void SetMemento(const DelegateMemento& any) { m_Closure.CopyFrom(this, any); }
+
+ private: // Invoker for static functions
+ RetType InvokeStaticFunction(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6) const {
+ return (*(m_Closure.GetStaticFunction()))(p1, p2, p3, p4, p5, p6);
+ }
+};
+
+// N=7
+template <class Param1, class Param2, class Param3, class Param4, class Param5,
+ class Param6, class Param7, class RetType = detail::DefaultVoid>
+class FastDelegate7 {
+ private:
+ typedef typename detail::DefaultVoidToVoid<RetType>::type DesiredRetType;
+ typedef DesiredRetType (*StaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6,
+ Param7 p7);
+ typedef RetType (*UnvoidStaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6,
+ Param7 p7);
+ typedef RetType (detail::GenericClass::*GenericMemFn)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7);
+ typedef detail::ClosurePtr<GenericMemFn, StaticFunctionPtr,
+ UnvoidStaticFunctionPtr>
+ ClosureType;
+ ClosureType m_Closure;
+
+ public:
+ // Typedefs to aid generic programming
+ typedef FastDelegate7 type;
+
+ // Construction and comparison functions
+ FastDelegate7() { clear(); }
+ FastDelegate7(const FastDelegate7& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ void operator=(const FastDelegate7& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ bool operator==(const FastDelegate7& x) const {
+ return m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator!=(const FastDelegate7& x) const {
+ return !m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator<(const FastDelegate7& x) const {
+ return m_Closure.IsLess(x.m_Closure);
+ }
+ bool operator>(const FastDelegate7& x) const {
+ return x.m_Closure.IsLess(m_Closure);
+ }
+ // Binding to non-const member functions
+ template <class X, class Y>
+ FastDelegate7(Y* pthis, DesiredRetType (X::*function_to_bind)(
+ Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(Y* pthis, DesiredRetType (X::*function_to_bind)(
+ Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ // Binding to const member functions.
+ template <class X, class Y>
+ FastDelegate7(const Y* pthis, DesiredRetType (X::*function_to_bind)(
+ Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7) const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7) const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ // Static functions. We convert them into a member function call.
+ // This constructor also provides implicit conversion
+ FastDelegate7(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7)) {
+ bind(function_to_bind);
+ }
+ // for efficiency, prevent creation of a temporary
+ void operator=(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7)) {
+ bind(function_to_bind);
+ }
+ inline void bind(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7)) {
+ m_Closure.bindstaticfunc(this, &FastDelegate7::InvokeStaticFunction,
+ function_to_bind);
+ }
+ // Invoke the delegate
+ RetType operator()(Param1 p1, Param2 p2, Param3 p3, Param4 p4, Param5 p5,
+ Param6 p6, Param7 p7) const {
+ return (m_Closure.GetClosureThis()->*(m_Closure.GetClosureMemPtr()))(
+ p1, p2, p3, p4, p5, p6, p7);
+ }
+ // Implicit conversion to "bool" using the safe_bool idiom
+ private:
+ typedef struct SafeBoolStruct {
+ int a_data_pointer_to_this_is_0_on_buggy_compilers;
+ StaticFunctionPtr m_nonzero;
+ } UselessTypedef;
+ typedef StaticFunctionPtr SafeBoolStruct::*unspecified_bool_type;
+
+ public:
+ operator unspecified_bool_type() const {
+ return empty() ? 0 : &SafeBoolStruct::m_nonzero;
+ }
+ // necessary to allow ==0 to work despite the safe_bool idiom
+ inline bool operator==(StaticFunctionPtr funcptr) {
+ return m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!=(StaticFunctionPtr funcptr) {
+ return !m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!() const { // Is it bound to anything?
+ return !m_Closure;
+ }
+ inline bool empty() const { return !m_Closure; }
+ void clear() { m_Closure.clear(); }
+ // Conversion to and from the DelegateMemento storage class
+ const DelegateMemento& GetMemento() { return m_Closure; }
+ void SetMemento(const DelegateMemento& any) { m_Closure.CopyFrom(this, any); }
+
+ private: // Invoker for static functions
+ RetType InvokeStaticFunction(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7) const {
+ return (*(m_Closure.GetStaticFunction()))(p1, p2, p3, p4, p5, p6, p7);
+ }
+};
+
+// N=8
+template <class Param1, class Param2, class Param3, class Param4, class Param5,
+ class Param6, class Param7, class Param8,
+ class RetType = detail::DefaultVoid>
+class FastDelegate8 {
+ private:
+ typedef typename detail::DefaultVoidToVoid<RetType>::type DesiredRetType;
+ typedef DesiredRetType (*StaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8);
+ typedef RetType (*UnvoidStaticFunctionPtr)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8);
+ typedef RetType (detail::GenericClass::*GenericMemFn)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8);
+ typedef detail::ClosurePtr<GenericMemFn, StaticFunctionPtr,
+ UnvoidStaticFunctionPtr>
+ ClosureType;
+ ClosureType m_Closure;
+
+ public:
+ // Typedefs to aid generic programming
+ typedef FastDelegate8 type;
+
+ // Construction and comparison functions
+ FastDelegate8() { clear(); }
+ FastDelegate8(const FastDelegate8& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ void operator=(const FastDelegate8& x) {
+ m_Closure.CopyFrom(this, x.m_Closure);
+ }
+ bool operator==(const FastDelegate8& x) const {
+ return m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator!=(const FastDelegate8& x) const {
+ return !m_Closure.IsEqual(x.m_Closure);
+ }
+ bool operator<(const FastDelegate8& x) const {
+ return m_Closure.IsLess(x.m_Closure);
+ }
+ bool operator>(const FastDelegate8& x) const {
+ return x.m_Closure.IsLess(m_Closure);
+ }
+ // Binding to non-const member functions
+ template <class X, class Y>
+ FastDelegate8(Y* pthis, DesiredRetType (X::*function_to_bind)(
+ Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7, Param8 p8)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(Y* pthis, DesiredRetType (X::*function_to_bind)(
+ Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7, Param8 p8)) {
+ m_Closure.bindmemfunc(detail::implicit_cast<X*>(pthis), function_to_bind);
+ }
+ // Binding to const member functions.
+ template <class X, class Y>
+ FastDelegate8(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8)
+ const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ template <class X, class Y>
+ inline void bind(const Y* pthis,
+ DesiredRetType (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8)
+ const) {
+ m_Closure.bindconstmemfunc(detail::implicit_cast<const X*>(pthis),
+ function_to_bind);
+ }
+ // Static functions. We convert them into a member function call.
+ // This constructor also provides implicit conversion
+ FastDelegate8(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8)) {
+ bind(function_to_bind);
+ }
+ // for efficiency, prevent creation of a temporary
+ void operator=(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8)) {
+ bind(function_to_bind);
+ }
+ inline void bind(DesiredRetType (*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8)) {
+ m_Closure.bindstaticfunc(this, &FastDelegate8::InvokeStaticFunction,
+ function_to_bind);
+ }
+ // Invoke the delegate
+ RetType operator()(Param1 p1, Param2 p2, Param3 p3, Param4 p4, Param5 p5,
+ Param6 p6, Param7 p7, Param8 p8) const {
+ return (m_Closure.GetClosureThis()->*(m_Closure.GetClosureMemPtr()))(
+ p1, p2, p3, p4, p5, p6, p7, p8);
+ }
+ // Implicit conversion to "bool" using the safe_bool idiom
+ private:
+ typedef struct SafeBoolStruct {
+ int a_data_pointer_to_this_is_0_on_buggy_compilers;
+ StaticFunctionPtr m_nonzero;
+ } UselessTypedef;
+ typedef StaticFunctionPtr SafeBoolStruct::*unspecified_bool_type;
+
+ public:
+ operator unspecified_bool_type() const {
+ return empty() ? 0 : &SafeBoolStruct::m_nonzero;
+ }
+ // necessary to allow ==0 to work despite the safe_bool idiom
+ inline bool operator==(StaticFunctionPtr funcptr) {
+ return m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!=(StaticFunctionPtr funcptr) {
+ return !m_Closure.IsEqualToStaticFuncPtr(funcptr);
+ }
+ inline bool operator!() const { // Is it bound to anything?
+ return !m_Closure;
+ }
+ inline bool empty() const { return !m_Closure; }
+ void clear() { m_Closure.clear(); }
+ // Conversion to and from the DelegateMemento storage class
+ const DelegateMemento& GetMemento() { return m_Closure; }
+ void SetMemento(const DelegateMemento& any) { m_Closure.CopyFrom(this, any); }
+
+ private: // Invoker for static functions
+ RetType InvokeStaticFunction(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7,
+ Param8 p8) const {
+ return (*(m_Closure.GetStaticFunction()))(p1, p2, p3, p4, p5, p6, p7, p8);
+ }
+};
+
+////////////////////////////////////////////////////////////////////////////////
+// Fast Delegates, part 4:
+//
+// FastDelegate<> class (Original author: Jody Hagins)
+// Allows boost::function style syntax like:
+// FastDelegate< double (int, long) >
+// instead of:
+// FastDelegate2< int, long, double >
+//
+////////////////////////////////////////////////////////////////////////////////
+
+#ifdef FASTDELEGATE_ALLOW_FUNCTION_TYPE_SYNTAX
+
+// Declare FastDelegate as a class template. It will be specialized
+// later for all number of arguments.
+template <typename Signature>
+class FastDelegate;
+
+// N=0
+// Specialization to allow use of
+// FastDelegate< R ( ) >
+// instead of
+// FastDelegate0 < R >
+template <typename R>
+class FastDelegate<R()>
+ // Inherit from FastDelegate0 so that it can be treated just like a
+ // FastDelegate0
+ : public FastDelegate0<R> {
+ public:
+ // Make using the base type a bit easier via typedef.
+ typedef FastDelegate0<R> BaseType;
+
+ // Allow users access to the specific type of this delegate.
+ typedef FastDelegate SelfType;
+
+ // Mimic the base class constructors.
+ FastDelegate() : BaseType() {}
+
+ template <class X, class Y>
+ FastDelegate(Y* pthis, R (X::*function_to_bind)())
+ : BaseType(pthis, function_to_bind) {}
+
+ template <class X, class Y>
+ FastDelegate(const Y* pthis, R (X::*function_to_bind)() const)
+ : BaseType(pthis, function_to_bind) {}
+
+ FastDelegate(R (*function_to_bind)()) : BaseType(function_to_bind) {}
+ void operator=(const BaseType& x) { *static_cast<BaseType*>(this) = x; }
+};
+
+// N=1
+// Specialization to allow use of
+// FastDelegate< R ( Param1 ) >
+// instead of
+// FastDelegate1 < Param1, R >
+template <typename R, class Param1>
+class FastDelegate<R(Param1)>
+ // Inherit from FastDelegate1 so that it can be treated just like a
+ // FastDelegate1
+ : public FastDelegate1<Param1, R> {
+ public:
+ // Make using the base type a bit easier via typedef.
+ typedef FastDelegate1<Param1, R> BaseType;
+
+ // Allow users access to the specific type of this delegate.
+ typedef FastDelegate SelfType;
+
+ // Mimic the base class constructors.
+ FastDelegate() : BaseType() {}
+
+ template <class X, class Y>
+ FastDelegate(Y* pthis, R (X::*function_to_bind)(Param1 p1))
+ : BaseType(pthis, function_to_bind) {}
+
+ template <class X, class Y>
+ FastDelegate(const Y* pthis, R (X::*function_to_bind)(Param1 p1) const)
+ : BaseType(pthis, function_to_bind) {}
+
+ FastDelegate(R (*function_to_bind)(Param1 p1)) : BaseType(function_to_bind) {}
+ void operator=(const BaseType& x) { *static_cast<BaseType*>(this) = x; }
+};
+
+// N=2
+// Specialization to allow use of
+// FastDelegate< R ( Param1, Param2 ) >
+// instead of
+// FastDelegate2 < Param1, Param2, R >
+template <typename R, class Param1, class Param2>
+class FastDelegate<R(Param1, Param2)>
+ // Inherit from FastDelegate2 so that it can be treated just like a
+ // FastDelegate2
+ : public FastDelegate2<Param1, Param2, R> {
+ public:
+ // Make using the base type a bit easier via typedef.
+ typedef FastDelegate2<Param1, Param2, R> BaseType;
+
+ // Allow users access to the specific type of this delegate.
+ typedef FastDelegate SelfType;
+
+ // Mimic the base class constructors.
+ FastDelegate() : BaseType() {}
+
+ template <class X, class Y>
+ FastDelegate(Y* pthis, R (X::*function_to_bind)(Param1 p1, Param2 p2))
+ : BaseType(pthis, function_to_bind) {}
+
+ template <class X, class Y>
+ FastDelegate(const Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2) const)
+ : BaseType(pthis, function_to_bind) {}
+
+ FastDelegate(R (*function_to_bind)(Param1 p1, Param2 p2))
+ : BaseType(function_to_bind) {}
+ void operator=(const BaseType& x) { *static_cast<BaseType*>(this) = x; }
+};
+
+// N=3
+// Specialization to allow use of
+// FastDelegate< R ( Param1, Param2, Param3 ) >
+// instead of
+// FastDelegate3 < Param1, Param2, Param3, R >
+template <typename R, class Param1, class Param2, class Param3>
+class FastDelegate<R(Param1, Param2, Param3)>
+ // Inherit from FastDelegate3 so that it can be treated just like a
+ // FastDelegate3
+ : public FastDelegate3<Param1, Param2, Param3, R> {
+ public:
+ // Make using the base type a bit easier via typedef.
+ typedef FastDelegate3<Param1, Param2, Param3, R> BaseType;
+
+ // Allow users access to the specific type of this delegate.
+ typedef FastDelegate SelfType;
+
+ // Mimic the base class constructors.
+ FastDelegate() : BaseType() {}
+
+ template <class X, class Y>
+ FastDelegate(Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3))
+ : BaseType(pthis, function_to_bind) {}
+
+ template <class X, class Y>
+ FastDelegate(const Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3) const)
+ : BaseType(pthis, function_to_bind) {}
+
+ FastDelegate(R (*function_to_bind)(Param1 p1, Param2 p2, Param3 p3))
+ : BaseType(function_to_bind) {}
+ void operator=(const BaseType& x) { *static_cast<BaseType*>(this) = x; }
+};
+
+// N=4
+// Specialization to allow use of
+// FastDelegate< R ( Param1, Param2, Param3, Param4 ) >
+// instead of
+// FastDelegate4 < Param1, Param2, Param3, Param4, R >
+template <typename R, class Param1, class Param2, class Param3, class Param4>
+class FastDelegate<R(Param1, Param2, Param3, Param4)>
+ // Inherit from FastDelegate4 so that it can be treated just like a
+ // FastDelegate4
+ : public FastDelegate4<Param1, Param2, Param3, Param4, R> {
+ public:
+ // Make using the base type a bit easier via typedef.
+ typedef FastDelegate4<Param1, Param2, Param3, Param4, R> BaseType;
+
+ // Allow users access to the specific type of this delegate.
+ typedef FastDelegate SelfType;
+
+ // Mimic the base class constructors.
+ FastDelegate() : BaseType() {}
+
+ template <class X, class Y>
+ FastDelegate(Y* pthis, R (X::*function_to_bind)(Param1 p1, Param2 p2,
+ Param3 p3, Param4 p4))
+ : BaseType(pthis, function_to_bind) {}
+
+ template <class X, class Y>
+ FastDelegate(const Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4) const)
+ : BaseType(pthis, function_to_bind) {}
+
+ FastDelegate(R (*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4))
+ : BaseType(function_to_bind) {}
+ void operator=(const BaseType& x) { *static_cast<BaseType*>(this) = x; }
+};
+
+// N=5
+// Specialization to allow use of
+// FastDelegate< R ( Param1, Param2, Param3, Param4, Param5 ) >
+// instead of
+// FastDelegate5 < Param1, Param2, Param3, Param4, Param5, R >
+template <typename R, class Param1, class Param2, class Param3, class Param4,
+ class Param5>
+class FastDelegate<R(Param1, Param2, Param3, Param4, Param5)>
+ // Inherit from FastDelegate5 so that it can be treated just like a
+ // FastDelegate5
+ : public FastDelegate5<Param1, Param2, Param3, Param4, Param5, R> {
+ public:
+ // Make using the base type a bit easier via typedef.
+ typedef FastDelegate5<Param1, Param2, Param3, Param4, Param5, R> BaseType;
+
+ // Allow users access to the specific type of this delegate.
+ typedef FastDelegate SelfType;
+
+ // Mimic the base class constructors.
+ FastDelegate() : BaseType() {}
+
+ template <class X, class Y>
+ FastDelegate(Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5))
+ : BaseType(pthis, function_to_bind) {}
+
+ template <class X, class Y>
+ FastDelegate(const Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5) const)
+ : BaseType(pthis, function_to_bind) {}
+
+ FastDelegate(R (*function_to_bind)(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5))
+ : BaseType(function_to_bind) {}
+ void operator=(const BaseType& x) { *static_cast<BaseType*>(this) = x; }
+};
+
+// N=6
+// Specialization to allow use of
+// FastDelegate< R ( Param1, Param2, Param3, Param4, Param5, Param6 ) >
+// instead of
+// FastDelegate6 < Param1, Param2, Param3, Param4, Param5, Param6, R >
+template <typename R, class Param1, class Param2, class Param3, class Param4,
+ class Param5, class Param6>
+class FastDelegate<R(Param1, Param2, Param3, Param4, Param5, Param6)>
+ // Inherit from FastDelegate6 so that it can be treated just like a
+ // FastDelegate6
+ : public FastDelegate6<Param1, Param2, Param3, Param4, Param5, Param6, R> {
+ public:
+ // Make using the base type a bit easier via typedef.
+ typedef FastDelegate6<Param1, Param2, Param3, Param4, Param5, Param6, R>
+ BaseType;
+
+ // Allow users access to the specific type of this delegate.
+ typedef FastDelegate SelfType;
+
+ // Mimic the base class constructors.
+ FastDelegate() : BaseType() {}
+
+ template <class X, class Y>
+ FastDelegate(Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6))
+ : BaseType(pthis, function_to_bind) {}
+
+ template <class X, class Y>
+ FastDelegate(const Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6) const)
+ : BaseType(pthis, function_to_bind) {}
+
+ FastDelegate(R (*function_to_bind)(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6))
+ : BaseType(function_to_bind) {}
+ void operator=(const BaseType& x) { *static_cast<BaseType*>(this) = x; }
+};
+
+// N=7
+// Specialization to allow use of
+// FastDelegate< R ( Param1, Param2, Param3, Param4, Param5, Param6, Param7 ) >
+// instead of
+// FastDelegate7 < Param1, Param2, Param3, Param4, Param5, Param6, Param7, R >
+template <typename R, class Param1, class Param2, class Param3, class Param4,
+ class Param5, class Param6, class Param7>
+class FastDelegate<R(Param1, Param2, Param3, Param4, Param5, Param6, Param7)>
+ // Inherit from FastDelegate7 so that it can be treated just like a
+ // FastDelegate7
+ : public FastDelegate7<Param1, Param2, Param3, Param4, Param5, Param6,
+ Param7, R> {
+ public:
+ // Make using the base type a bit easier via typedef.
+ typedef FastDelegate7<Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+ R>
+ BaseType;
+
+ // Allow users access to the specific type of this delegate.
+ typedef FastDelegate SelfType;
+
+ // Mimic the base class constructors.
+ FastDelegate() : BaseType() {}
+
+ template <class X, class Y>
+ FastDelegate(Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6,
+ Param7 p7))
+ : BaseType(pthis, function_to_bind) {}
+
+ template <class X, class Y>
+ FastDelegate(const Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6,
+ Param7 p7) const)
+ : BaseType(pthis, function_to_bind) {}
+
+ FastDelegate(R (*function_to_bind)(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7))
+ : BaseType(function_to_bind) {}
+ void operator=(const BaseType& x) { *static_cast<BaseType*>(this) = x; }
+};
+
+// N=8
+// Specialization to allow use of
+// FastDelegate< R ( Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+// Param8 ) >
+// instead of
+// FastDelegate8 < Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+// Param8, R >
+template <typename R, class Param1, class Param2, class Param3, class Param4,
+ class Param5, class Param6, class Param7, class Param8>
+class FastDelegate<R(Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+ Param8)>
+ // Inherit from FastDelegate8 so that it can be treated just like a
+ // FastDelegate8
+ : public FastDelegate8<Param1, Param2, Param3, Param4, Param5, Param6,
+ Param7, Param8, R> {
+ public:
+ // Make using the base type a bit easier via typedef.
+ typedef FastDelegate8<Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+ Param8, R>
+ BaseType;
+
+ // Allow users access to the specific type of this delegate.
+ typedef FastDelegate SelfType;
+
+ // Mimic the base class constructors.
+ FastDelegate() : BaseType() {}
+
+ template <class X, class Y>
+ FastDelegate(Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8))
+ : BaseType(pthis, function_to_bind) {}
+
+ template <class X, class Y>
+ FastDelegate(const Y* pthis,
+ R (X::*function_to_bind)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8) const)
+ : BaseType(pthis, function_to_bind) {}
+
+ FastDelegate(R (*function_to_bind)(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7,
+ Param8 p8))
+ : BaseType(function_to_bind) {}
+ void operator=(const BaseType& x) { *static_cast<BaseType*>(this) = x; }
+};
+
+#endif // FASTDELEGATE_ALLOW_FUNCTION_TYPE_SYNTAX
+
+////////////////////////////////////////////////////////////////////////////////
+// Fast Delegates, part 5:
+//
+// MakeDelegate() helper function
+//
+// MakeDelegate(&x, &X::func) returns a fastdelegate of the type
+// necessary for calling x.func() with the correct number of arguments.
+// This makes it possible to eliminate many typedefs from user code.
+//
+////////////////////////////////////////////////////////////////////////////////
+
+// Also declare overloads of a MakeDelegate() global function to
+// reduce the need for typedefs.
+// We need seperate overloads for const and non-const member functions.
+// Also, because of the weird rule about the class of derived member function
+// pointers,
+// implicit downcasts may need to be applied later to the 'this' pointer.
+// That's why two classes (X and Y) appear in the definitions. Y must be
+// implicitly
+// castable to X.
+
+// Workaround for VC6. VC6 needs void return types converted into DefaultVoid.
+// GCC 3.2 and later won't compile this unless it's preceded by 'typename',
+// but VC6 doesn't allow 'typename' in this context.
+// So, I have to use a macro.
+
+#ifdef FASTDLGT_VC6
+#define FASTDLGT_RETTYPE detail::VoidToDefaultVoid<RetType>::type
+#else
+#define FASTDLGT_RETTYPE RetType
+#endif
+
+// N=0
+template <class X, class Y, class RetType>
+FastDelegate0<FASTDLGT_RETTYPE> MakeDelegate(Y* x, RetType (X::*func)()) {
+ return FastDelegate0<FASTDLGT_RETTYPE>(x, func);
+}
+
+template <class X, class Y, class RetType>
+FastDelegate0<FASTDLGT_RETTYPE> MakeDelegate(Y* x, RetType (X::*func)() const) {
+ return FastDelegate0<FASTDLGT_RETTYPE>(x, func);
+}
+
+// N=1
+template <class X, class Y, class Param1, class RetType>
+FastDelegate1<Param1, FASTDLGT_RETTYPE> MakeDelegate(
+ Y* x, RetType (X::*func)(Param1 p1)) {
+ return FastDelegate1<Param1, FASTDLGT_RETTYPE>(x, func);
+}
+
+template <class X, class Y, class Param1, class RetType>
+FastDelegate1<Param1, FASTDLGT_RETTYPE> MakeDelegate(
+ Y* x, RetType (X::*func)(Param1 p1) const) {
+ return FastDelegate1<Param1, FASTDLGT_RETTYPE>(x, func);
+}
+
+// N=2
+template <class X, class Y, class Param1, class Param2, class RetType>
+FastDelegate2<Param1, Param2, FASTDLGT_RETTYPE> MakeDelegate(
+ Y* x, RetType (X::*func)(Param1 p1, Param2 p2)) {
+ return FastDelegate2<Param1, Param2, FASTDLGT_RETTYPE>(x, func);
+}
+
+template <class X, class Y, class Param1, class Param2, class RetType>
+FastDelegate2<Param1, Param2, FASTDLGT_RETTYPE> MakeDelegate(
+ Y* x, RetType (X::*func)(Param1 p1, Param2 p2) const) {
+ return FastDelegate2<Param1, Param2, FASTDLGT_RETTYPE>(x, func);
+}
+
+// N=3
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class RetType>
+FastDelegate3<Param1, Param2, Param3, FASTDLGT_RETTYPE> MakeDelegate(
+ Y* x, RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3)) {
+ return FastDelegate3<Param1, Param2, Param3, FASTDLGT_RETTYPE>(x, func);
+}
+
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class RetType>
+FastDelegate3<Param1, Param2, Param3, FASTDLGT_RETTYPE> MakeDelegate(
+ Y* x, RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3) const) {
+ return FastDelegate3<Param1, Param2, Param3, FASTDLGT_RETTYPE>(x, func);
+}
+
+// N=4
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class RetType>
+FastDelegate4<Param1, Param2, Param3, Param4, FASTDLGT_RETTYPE> MakeDelegate(
+ Y* x, RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3, Param4 p4)) {
+ return FastDelegate4<Param1, Param2, Param3, Param4, FASTDLGT_RETTYPE>(x,
+ func);
+}
+
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class RetType>
+FastDelegate4<Param1, Param2, Param3, Param4, FASTDLGT_RETTYPE> MakeDelegate(
+ Y* x,
+ RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3, Param4 p4) const) {
+ return FastDelegate4<Param1, Param2, Param3, Param4, FASTDLGT_RETTYPE>(x,
+ func);
+}
+
+// N=5
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class Param5, class RetType>
+FastDelegate5<Param1, Param2, Param3, Param4, Param5, FASTDLGT_RETTYPE>
+MakeDelegate(Y* x, RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5)) {
+ return FastDelegate5<Param1, Param2, Param3, Param4, Param5,
+ FASTDLGT_RETTYPE>(x, func);
+}
+
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class Param5, class RetType>
+FastDelegate5<Param1, Param2, Param3, Param4, Param5, FASTDLGT_RETTYPE>
+MakeDelegate(Y* x, RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5) const) {
+ return FastDelegate5<Param1, Param2, Param3, Param4, Param5,
+ FASTDLGT_RETTYPE>(x, func);
+}
+
+// N=6
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class Param5, class Param6, class RetType>
+FastDelegate6<Param1, Param2, Param3, Param4, Param5, Param6, FASTDLGT_RETTYPE>
+MakeDelegate(Y* x, RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6)) {
+ return FastDelegate6<Param1, Param2, Param3, Param4, Param5, Param6,
+ FASTDLGT_RETTYPE>(x, func);
+}
+
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class Param5, class Param6, class RetType>
+FastDelegate6<Param1, Param2, Param3, Param4, Param5, Param6, FASTDLGT_RETTYPE>
+MakeDelegate(Y* x, RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6) const) {
+ return FastDelegate6<Param1, Param2, Param3, Param4, Param5, Param6,
+ FASTDLGT_RETTYPE>(x, func);
+}
+
+// N=7
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class Param5, class Param6, class Param7, class RetType>
+FastDelegate7<Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+ FASTDLGT_RETTYPE>
+MakeDelegate(Y* x,
+ RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7)) {
+ return FastDelegate7<Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+ FASTDLGT_RETTYPE>(x, func);
+}
+
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class Param5, class Param6, class Param7, class RetType>
+FastDelegate7<Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+ FASTDLGT_RETTYPE>
+MakeDelegate(Y* x,
+ RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7) const) {
+ return FastDelegate7<Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+ FASTDLGT_RETTYPE>(x, func);
+}
+
+// N=8
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class Param5, class Param6, class Param7, class Param8,
+ class RetType>
+FastDelegate8<Param1, Param2, Param3, Param4, Param5, Param6, Param7, Param8,
+ FASTDLGT_RETTYPE>
+MakeDelegate(Y* x,
+ RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3, Param4 p4,
+ Param5 p5, Param6 p6, Param7 p7, Param8 p8)) {
+ return FastDelegate8<Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+ Param8, FASTDLGT_RETTYPE>(x, func);
+}
+
+template <class X, class Y, class Param1, class Param2, class Param3,
+ class Param4, class Param5, class Param6, class Param7, class Param8,
+ class RetType>
+FastDelegate8<Param1, Param2, Param3, Param4, Param5, Param6, Param7, Param8,
+ FASTDLGT_RETTYPE>
+MakeDelegate(Y* x, RetType (X::*func)(Param1 p1, Param2 p2, Param3 p3,
+ Param4 p4, Param5 p5, Param6 p6,
+ Param7 p7, Param8 p8) const) {
+ return FastDelegate8<Param1, Param2, Param3, Param4, Param5, Param6, Param7,
+ Param8, FASTDLGT_RETTYPE>(x, func);
+}
+
+// clean up after ourselves...
+#undef FASTDLGT_RETTYPE
+
+} // namespace fastdelegate
+
+#endif // !defined(FASTDELEGATE_H)
diff --git a/rocketmq-cpp/src/common/FilterAPI.h b/rocketmq-cpp/src/common/FilterAPI.h
new file mode 100755
index 00000000..c95f17e4
--- /dev/null
+++ b/rocketmq-cpp/src/common/FilterAPI.h
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __FILTERAPI_H__
+#define __FILTERAPI_H__
+
+#include <string>
+#include "MQClientException.h"
+#include "SubscriptionData.h"
+#include "UtilAll.h"
+namespace rocketmq {
+//<!***************************************************************************
+class FilterAPI {
+ public:
+ static SubscriptionData* buildSubscriptionData(const string topic,
+ const string& subString) {
+ //<!delete in balance;
+ SubscriptionData* subscriptionData = new SubscriptionData(topic, subString);
+
+ if (subString.empty() || !subString.compare(SUB_ALL)) {
+ subscriptionData->setSubString(SUB_ALL);
+ } else {
+ vector<string> out;
+ UtilAll::Split(out, subString, "||");
+
+ if (out.empty()) {
+ THROW_MQEXCEPTION(MQClientException, "FilterAPI subString split error",
+ -1);
+ }
+
+ for (size_t i = 0; i < out.size(); i++) {
+ string tag = out[i];
+ if (!tag.empty()) {
+ UtilAll::Trim(tag);
+ if (!tag.empty()) {
+ subscriptionData->putTagsSet(tag);
+ subscriptionData->putCodeSet(tag);
+ }
+ }
+ }
+ }
+
+ return subscriptionData;
+ }
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/InputStream.cpp b/rocketmq-cpp/src/common/InputStream.cpp
new file mode 100644
index 00000000..4eb55879
--- /dev/null
+++ b/rocketmq-cpp/src/common/InputStream.cpp
@@ -0,0 +1,149 @@
+#include "InputStream.h"
+#include <algorithm>
+#include "MemoryOutputStream.h"
+
+namespace rocketmq {
+int64 InputStream::getNumBytesRemaining() {
+ int64 len = getTotalLength();
+
+ if (len >= 0) len -= getPosition();
+
+ return len;
+}
+
+char InputStream::readByte() {
+ char temp = 0;
+ read(&temp, 1);
+ return temp;
+}
+
+bool InputStream::readBool() { return readByte() != 0; }
+
+short InputStream::readShort() {
+ char temp[2];
+
+ if (read(temp, 2) == 2) return (short)ByteOrder::littleEndianShort(temp);
+
+ return 0;
+}
+
+short InputStream::readShortBigEndian() {
+ char temp[2];
+
+ if (read(temp, 2) == 2) return (short)ByteOrder::bigEndianShort(temp);
+
+ return 0;
+}
+
+int InputStream::readInt() {
+ char temp[4];
+
+ if (read(temp, 4) == 4) return (int)ByteOrder::littleEndianInt(temp);
+
+ return 0;
+}
+
+int InputStream::readIntBigEndian() {
+ char temp[4];
+
+ if (read(temp, 4) == 4) return (int)ByteOrder::bigEndianInt(temp);
+
+ return 0;
+}
+
+int InputStream::readCompressedInt() {
+ const uint8 sizeByte = (uint8)readByte();
+ if (sizeByte == 0) return 0;
+
+ const int numBytes = (sizeByte & 0x7f);
+ if (numBytes > 4) {
+ return 0;
+ }
+
+ char bytes[4] = {0, 0, 0, 0};
+ if (read(bytes, numBytes) != numBytes) return 0;
+
+ const int num = (int)ByteOrder::littleEndianInt(bytes);
+ return (sizeByte >> 7) ? -num : num;
+}
+
+int64 InputStream::readInt64() {
+ union {
+ uint8 asBytes[8];
+ uint64 asInt64;
+ } n;
+
+ if (read(n.asBytes, 8) == 8)
+ return (int64)ByteOrder::swapIfBigEndian(n.asInt64);
+
+ return 0;
+}
+
+int64 InputStream::readInt64BigEndian() {
+ union {
+ uint8 asBytes[8];
+ uint64 asInt64;
+ } n;
+
+ if (read(n.asBytes, 8) == 8)
+ return (int64)ByteOrder::swapIfLittleEndian(n.asInt64);
+
+ return 0;
+}
+
+float InputStream::readFloat() {
+ // the union below relies on these types being the same size...
+ union {
+ int32 asInt;
+ float asFloat;
+ } n;
+ n.asInt = (int32)readInt();
+ return n.asFloat;
+}
+
+float InputStream::readFloatBigEndian() {
+ union {
+ int32 asInt;
+ float asFloat;
+ } n;
+ n.asInt = (int32)readIntBigEndian();
+ return n.asFloat;
+}
+
+double InputStream::readDouble() {
+ union {
+ int64 asInt;
+ double asDouble;
+ } n;
+ n.asInt = readInt64();
+ return n.asDouble;
+}
+
+double InputStream::readDoubleBigEndian() {
+ union {
+ int64 asInt;
+ double asDouble;
+ } n;
+ n.asInt = readInt64BigEndian();
+ return n.asDouble;
+}
+
+size_t InputStream::readIntoMemoryBlock(MemoryBlock& block, ssize_t numBytes) {
+ MemoryOutputStream mo(block, true);
+ return (size_t)mo.writeFromInputStream(*this, numBytes);
+}
+
+//==============================================================================
+void InputStream::skipNextBytes(int64 numBytesToSkip) {
+ if (numBytesToSkip > 0) {
+ const int skipBufferSize = (int)std::min(numBytesToSkip, (int64)16384);
+ char* temp = static_cast<char*>(std::malloc(skipBufferSize * sizeof(char)));
+
+ while (numBytesToSkip > 0 && !isExhausted())
+ numBytesToSkip -=
+ read(temp, (int)std::min(numBytesToSkip, (int64)skipBufferSize));
+
+ std::free(temp);
+ }
+}
+}
diff --git a/rocketmq-cpp/src/common/InputStream.h b/rocketmq-cpp/src/common/InputStream.h
new file mode 100644
index 00000000..c987be7e
--- /dev/null
+++ b/rocketmq-cpp/src/common/InputStream.h
@@ -0,0 +1,241 @@
+#ifndef INPUTSTREAM_H_INCLUDED
+#define INPUTSTREAM_H_INCLUDED
+
+#include "ByteOrder.h"
+#include "dataBlock.h"
+//==============================================================================
+/** The base class for streams that read data.
+
+ Input and output streams are used throughout the library - subclasses can
+ override
+ some or all of the virtual functions to implement their behaviour.
+
+ @see OutputStream, MemoryInputStream, BufferedInputStream, FileInputStream
+*/
+namespace rocketmq {
+class ROCKETMQCLIENT_API InputStream {
+ public:
+ /** Destructor. */
+ virtual ~InputStream() {}
+
+ //==============================================================================
+ /** Returns the total number of bytes available for reading in this stream.
+
+ Note that this is the number of bytes available from the start of the
+ stream, not from the current position.
+
+ If the size of the stream isn't actually known, this will return -1.
+
+ @see getNumBytesRemaining
+ */
+ virtual int64 getTotalLength() = 0;
+
+ /** Returns the number of bytes available for reading, or a negative value if
+ the remaining length is not known.
+ @see getTotalLength
+ */
+ int64 getNumBytesRemaining();
+
+ /** Returns true if the stream has no more data to read. */
+ virtual bool isExhausted() = 0;
+
+ //==============================================================================
+ /** Reads some data from the stream into a memory buffer.
+
+ This is the only read method that subclasses actually need to implement,
+ as the
+ InputStream base class implements the other read methods in terms of this
+ one (although
+ it's often more efficient for subclasses to implement them directly).
+
+ @param destBuffer the destination buffer for the data. This must not
+ be null.
+ @param maxBytesToRead the maximum number of bytes to read - make sure
+ the
+ memory block passed in is big enough to contain
+ this
+ many bytes. This value must not be negative.
+
+ @returns the actual number of bytes that were read, which may be less
+ than
+ maxBytesToRead if the stream is exhausted before it gets that
+ far
+ */
+ virtual int read(void* destBuffer, int maxBytesToRead) = 0;
+
+ /** Reads a byte from the stream.
+ If the stream is exhausted, this will return zero.
+ @see OutputStream::writeByte
+ */
+ virtual char readByte();
+
+ /** Reads a boolean from the stream.
+ The bool is encoded as a single byte - non-zero for true, 0 for false.
+ If the stream is exhausted, this will return false.
+ @see OutputStream::writeBool
+ */
+ virtual bool readBool();
+
+ /** Reads two bytes from the stream as a little-endian 16-bit value.
+ If the next two bytes read are byte1 and byte2, this returns (byte1 |
+ (byte2 << 8)).
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+ @see OutputStream::writeShort, readShortBigEndian
+ */
+ virtual short readShort();
+
+ /** Reads two bytes from the stream as a little-endian 16-bit value.
+ If the next two bytes read are byte1 and byte2, this returns (byte2 |
+ (byte1 << 8)).
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+ @see OutputStream::writeShortBigEndian, readShort
+ */
+ virtual short readShortBigEndian();
+
+ /** Reads four bytes from the stream as a little-endian 32-bit value.
+
+ If the next four bytes are byte1 to byte4, this returns
+ (byte1 | (byte2 << 8) | (byte3 << 16) | (byte4 << 24)).
+
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+
+ @see OutputStream::writeInt, readIntBigEndian
+ */
+ virtual int readInt();
+
+ /** Reads four bytes from the stream as a big-endian 32-bit value.
+
+ If the next four bytes are byte1 to byte4, this returns
+ (byte4 | (byte3 << 8) | (byte2 << 16) | (byte1 << 24)).
+
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+
+ @see OutputStream::writeIntBigEndian, readInt
+ */
+ virtual int readIntBigEndian();
+
+ /** Reads eight bytes from the stream as a little-endian 64-bit value.
+
+ If the next eight bytes are byte1 to byte8, this returns
+ (byte1 | (byte2 << 8) | (byte3 << 16) | (byte4 << 24) | (byte5 << 32) |
+ (byte6 << 40) | (byte7 << 48) | (byte8 << 56)).
+
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+
+ @see OutputStream::writeInt64, readInt64BigEndian
+ */
+ virtual int64 readInt64();
+
+ /** Reads eight bytes from the stream as a big-endian 64-bit value.
+
+ If the next eight bytes are byte1 to byte8, this returns
+ (byte8 | (byte7 << 8) | (byte6 << 16) | (byte5 << 24) | (byte4 << 32) |
+ (byte3 << 40) | (byte2 << 48) | (byte1 << 56)).
+
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+
+ @see OutputStream::writeInt64BigEndian, readInt64
+ */
+ virtual int64 readInt64BigEndian();
+
+ /** Reads four bytes as a 32-bit floating point value.
+ The raw 32-bit encoding of the float is read from the stream as a
+ little-endian int.
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+ @see OutputStream::writeFloat, readDouble
+ */
+ virtual float readFloat();
+
+ /** Reads four bytes as a 32-bit floating point value.
+ The raw 32-bit encoding of the float is read from the stream as a
+ big-endian int.
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+ @see OutputStream::writeFloatBigEndian, readDoubleBigEndian
+ */
+ virtual float readFloatBigEndian();
+
+ /** Reads eight bytes as a 64-bit floating point value.
+ The raw 64-bit encoding of the double is read from the stream as a
+ little-endian int64.
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+ @see OutputStream::writeDouble, readFloat
+ */
+ virtual double readDouble();
+
+ /** Reads eight bytes as a 64-bit floating point value.
+ The raw 64-bit encoding of the double is read from the stream as a
+ big-endian int64.
+ If the stream is exhausted partway through reading the bytes, this will
+ return zero.
+ @see OutputStream::writeDoubleBigEndian, readFloatBigEndian
+ */
+ virtual double readDoubleBigEndian();
+
+ /** Reads an encoded 32-bit number from the stream using a space-saving
+ compressed format.
+ For small values, this is more space-efficient than using readInt() and
+ OutputStream::writeInt()
+ The format used is: number of significant bytes + up to 4 bytes in
+ little-endian order.
+ @see OutputStream::writeCompressedInt()
+ */
+ virtual int readCompressedInt();
+
+ //==============================================================================whole
+ // stream and turn it into a string.
+ /** Reads from the stream and appends the data to a MemoryBlock.
+
+ @param destBlock the block to append the data onto
+ @param maxNumBytesToRead if this is a positive value, it sets a limit
+ to the number
+ of bytes that will be read - if it's negative,
+ data
+ will be read until the stream is exhausted.
+ @returns the number of bytes that were added to the memory block
+ */
+ virtual size_t readIntoMemoryBlock(MemoryBlock& destBlock,
+ ssize_t maxNumBytesToRead = -1);
+
+ //==============================================================================
+ /** Returns the offset of the next byte that will be read from the stream.
+ @see setPosition
+ */
+ virtual int64 getPosition() = 0;
+
+ /** Tries to move the current read position of the stream.
+
+ The position is an absolute number of bytes from the stream's start.
+
+ Some streams might not be able to do this, in which case they should do
+ nothing and return false. Others might be able to manage it by resetting
+ themselves and skipping to the correct position, although this is
+ obviously a bit slow.
+
+ @returns true if the stream manages to reposition itself correctly
+ @see getPosition
+ */
+ virtual bool setPosition(int64 newPosition) = 0;
+
+ /** Reads and discards a number of bytes from the stream.
+
+ Some input streams might implement this efficiently, but the base
+ class will just keep reading data until the requisite number of bytes
+ have been done.
+ */
+ virtual void skipNextBytes(int64 numBytesToSkip);
+
+ protected:
+ //==============================================================================
+ InputStream() {}
+};
+}
+#endif // INPUTSTREAM_H_INCLUDED
diff --git a/rocketmq-cpp/src/common/MQClient.cpp b/rocketmq-cpp/src/common/MQClient.cpp
new file mode 100755
index 00000000..25d84de1
--- /dev/null
+++ b/rocketmq-cpp/src/common/MQClient.cpp
@@ -0,0 +1,201 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "MQClient.h"
+#include "Logging.h"
+#include "MQClientFactory.h"
+#include "MQClientManager.h"
+#include "TopicPublishInfo.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+
+#define METAQCPP_VERSION "1.0.0"
+#define BUILD_DATE "08-08-2017"
+// display version: strings bin/librocketmq.so |grep VERSION
+const char *metaq_build_time =
+ "VERSION: " METAQCPP_VERSION ", BUILD DATE: " BUILD_DATE " ";
+
+//<!************************************************************************
+MQClient::MQClient() {
+ string NAMESRV_ADDR_ENV = "NAMESRV_ADDR";
+ if (const char *addr = getenv(NAMESRV_ADDR_ENV.c_str()))
+ m_namesrvAddr = addr;
+ else
+ m_namesrvAddr = "";
+
+ m_instanceName = "DEFAULT";
+ m_clientFactory = NULL;
+ m_serviceState = CREATE_JUST;
+ m_pullThreadNum = boost::thread::hardware_concurrency();
+ m_tcpConnectTimeout = 3000; // 3s
+ m_tcpTransportTryLockTimeout = 3; // 3s
+ m_unitName = "";
+}
+
+MQClient::~MQClient() {}
+
+string MQClient::getMQClientId() const {
+ string clientIP = UtilAll::getLocalAddress();
+ string processId = UtilAll::to_string(getpid());
+ return processId + "-" + clientIP + "@" + m_instanceName;
+}
+
+//<!groupName;
+const string &MQClient::getGroupName() const { return m_GroupName; }
+
+void MQClient::setGroupName(const string &groupname) {
+ m_GroupName = groupname;
+}
+
+const string &MQClient::getNamesrvAddr() const { return m_namesrvAddr; }
+
+void MQClient::setNamesrvAddr(const string &namesrvAddr) {
+ m_namesrvAddr = namesrvAddr;
+}
+
+const string &MQClient::getNamesrvDomain() const { return m_namesrvDomain; }
+
+void MQClient::setNamesrvDomain(const string &namesrvDomain) {
+ m_namesrvDomain = namesrvDomain;
+}
+
+const string &MQClient::getInstanceName() const { return m_instanceName; }
+
+void MQClient::setInstanceName(const string &instanceName) {
+ m_instanceName = instanceName;
+}
+
+void MQClient::createTopic(const string &key, const string &newTopic,
+ int queueNum) {
+ try {
+ getFactory()->createTopic(key, newTopic, queueNum, m_SessionCredentials);
+ } catch (MQException &e) {
+ LOG_ERROR(e.what());
+ }
+}
+
+int64 MQClient::earliestMsgStoreTime(const MQMessageQueue &mq) {
+ return getFactory()->earliestMsgStoreTime(mq, m_SessionCredentials);
+}
+
+QueryResult MQClient::queryMessage(const string &topic, const string &key,
+ int maxNum, int64 begin, int64 end) {
+ return getFactory()->queryMessage(topic, key, maxNum, begin, end,
+ m_SessionCredentials);
+}
+
+int64 MQClient::minOffset(const MQMessageQueue &mq) {
+ return getFactory()->minOffset(mq, m_SessionCredentials);
+}
+
+int64 MQClient::maxOffset(const MQMessageQueue &mq) {
+ return getFactory()->maxOffset(mq, m_SessionCredentials);
+}
+
+int64 MQClient::searchOffset(const MQMessageQueue &mq, uint64_t timestamp) {
+ return getFactory()->searchOffset(mq, timestamp, m_SessionCredentials);
+}
+
+MQMessageExt *MQClient::viewMessage(const string &msgId) {
+ return getFactory()->viewMessage(msgId, m_SessionCredentials);
+}
+
+vector<MQMessageQueue> MQClient::getTopicMessageQueueInfo(const string &topic) {
+ boost::weak_ptr<TopicPublishInfo> weak_topicPublishInfo(
+ getFactory()->tryToFindTopicPublishInfo(topic, m_SessionCredentials));
+ boost::shared_ptr<TopicPublishInfo> topicPublishInfo(
+ weak_topicPublishInfo.lock());
+ if (topicPublishInfo) {
+ return topicPublishInfo->getMessageQueueList();
+ }
+ THROW_MQEXCEPTION(
+ MQClientException,
+ "could not find MessageQueue Info of topic: [" + topic + "].", -1);
+}
+
+void MQClient::start() {
+ if (getFactory() == NULL) {
+ m_clientFactory = MQClientManager::getInstance()->getMQClientFactory(
+ getMQClientId(), m_pullThreadNum, m_tcpConnectTimeout,
+ m_tcpTransportTryLockTimeout, m_unitName);
+ }
+ LOG_INFO(
+ "MQClient "
+ "start,groupname:%s,clientID:%s,instanceName:%s,nameserveraddr:%s",
+ getGroupName().c_str(), getMQClientId().c_str(),
+ getInstanceName().c_str(), getNamesrvAddr().c_str());
+}
+
+void MQClient::shutdown() { m_clientFactory = NULL; }
+
+MQClientFactory *MQClient::getFactory() const { return m_clientFactory; }
+
+bool MQClient::isServiceStateOk() { return m_serviceState == RUNNING; }
+
+void MQClient::setMetaqLogLevel(elogLevel inputLevel) {
+ ALOG_ADAPTER.setLogLevel(inputLevel);
+}
+
+void MQClient::setMetaqLogFileSizeAndNum(int fileNum, long perFileSize) {
+ ALOG_ADAPTER.setLogFileNumAndSize(fileNum, perFileSize);
+}
+
+void MQClient::setTcpTransportPullThreadNum(int num) {
+ if (num > m_pullThreadNum) {
+ m_pullThreadNum = num;
+ }
+}
+
+const int MQClient::getTcpTransportPullThreadNum() const {
+ return m_pullThreadNum;
+}
+
+void MQClient::setTcpTransportConnectTimeout(uint64_t timeout) {
+ m_tcpConnectTimeout = timeout;
+}
+const uint64_t MQClient::getTcpTransportConnectTimeout() const {
+ return m_tcpConnectTimeout;
+}
+
+void MQClient::setTcpTransportTryLockTimeout(uint64_t timeout) {
+ if (timeout < 1000) {
+ timeout = 1000;
+ }
+ m_tcpTransportTryLockTimeout = timeout / 1000;
+}
+const uint64_t MQClient::getTcpTransportTryLockTimeout() const {
+ return m_tcpTransportTryLockTimeout;
+}
+
+void MQClient::setUnitName(string unitName) { m_unitName = unitName; }
+const string &MQClient::getUnitName() { return m_unitName; }
+
+void MQClient::setSessionCredentials(const string &input_accessKey,
+ const string &input_secretKey,
+ const string &input_onsChannel) {
+ m_SessionCredentials.setAccessKey(input_accessKey);
+ m_SessionCredentials.setSecretKey(input_secretKey);
+ m_SessionCredentials.setAuthChannel(input_onsChannel);
+}
+
+const SessionCredentials &MQClient::getSessionCredentials() const {
+ return m_SessionCredentials;
+}
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/MQVersion.cpp b/rocketmq-cpp/src/common/MQVersion.cpp
new file mode 100755
index 00000000..015390c9
--- /dev/null
+++ b/rocketmq-cpp/src/common/MQVersion.cpp
@@ -0,0 +1,31 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "MQVersion.h"
+
+namespace rocketmq {
+int MQVersion::s_CurrentVersion = MQVersion::V3_1_8;
+
+//<!************************************************************************
+const char* MQVersion::getVersionDesc(int value) {
+ switch (value) {
+ // case V1_0_0:
+ // return "V1_0_0";
+ }
+ return "";
+}
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/MQVersion.h b/rocketmq-cpp/src/common/MQVersion.h
new file mode 100755
index 00000000..aa9e9cd1
--- /dev/null
+++ b/rocketmq-cpp/src/common/MQVersion.h
@@ -0,0 +1,229 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MQVERSION_H__
+#define __MQVERSION_H__
+
+#include <string>
+
+namespace rocketmq {
+//<!***************************************************************************
+class MQVersion {
+ public:
+ enum Version {
+ V3_0_0_SNAPSHOT,
+ V3_0_0_ALPHA1,
+ V3_0_0_BETA1,
+ V3_0_0_BETA2,
+ V3_0_0_BETA3,
+ V3_0_0_BETA4,
+ V3_0_0_BETA5,
+ V3_0_0_BETA6_SNAPSHOT,
+ V3_0_0_BETA6,
+ V3_0_0_BETA7_SNAPSHOT,
+ V3_0_0_BETA7,
+ V3_0_0_BETA8_SNAPSHOT,
+ V3_0_0_BETA8,
+ V3_0_0_BETA9_SNAPSHOT,
+ V3_0_0_BETA9,
+ V3_0_0_FINAL,
+ V3_0_1_SNAPSHOT,
+ V3_0_1,
+ V3_0_2_SNAPSHOT,
+ V3_0_2,
+ V3_0_3_SNAPSHOT,
+ V3_0_3,
+ V3_0_4_SNAPSHOT,
+ V3_0_4,
+ V3_0_5_SNAPSHOT,
+ V3_0_5,
+ V3_0_6_SNAPSHOT,
+ V3_0_6,
+ V3_0_7_SNAPSHOT,
+ V3_0_7,
+ V3_0_8_SNAPSHOT,
+ V3_0_8,
+ V3_0_9_SNAPSHOT,
+ V3_0_9,
+
+ V3_0_10_SNAPSHOT,
+ V3_0_10,
+
+ V3_0_11_SNAPSHOT,
+ V3_0_11,
+
+ V3_0_12_SNAPSHOT,
+ V3_0_12,
+
+ V3_0_13_SNAPSHOT,
+ V3_0_13,
+
+ V3_0_14_SNAPSHOT,
+ V3_0_14,
+
+ V3_0_15_SNAPSHOT,
+ V3_0_15,
+
+ V3_1_0_SNAPSHOT,
+ V3_1_0,
+
+ V3_1_1_SNAPSHOT,
+ V3_1_1,
+
+ V3_1_2_SNAPSHOT,
+ V3_1_2,
+
+ V3_1_3_SNAPSHOT,
+ V3_1_3,
+
+ V3_1_4_SNAPSHOT,
+ V3_1_4,
+
+ V3_1_5_SNAPSHOT,
+ V3_1_5,
+
+ V3_1_6_SNAPSHOT,
+ V3_1_6,
+
+ V3_1_7_SNAPSHOT,
+ V3_1_7,
+
+ V3_1_8_SNAPSHOT,
+ V3_1_8,
+
+ V3_1_9_SNAPSHOT,
+ V3_1_9,
+
+ V3_2_0_SNAPSHOT,
+ V3_2_0,
+
+ V3_2_1_SNAPSHOT,
+ V3_2_1,
+
+ V3_2_2_SNAPSHOT,
+ V3_2_2,
+
+ V3_2_3_SNAPSHOT,
+ V3_2_3,
+
+ V3_2_4_SNAPSHOT,
+ V3_2_4,
+
+ V3_2_5_SNAPSHOT,
+ V3_2_5,
+
+ V3_2_6_SNAPSHOT,
+ V3_2_6,
+
+ V3_2_7_SNAPSHOT,
+ V3_2_7,
+
+ V3_2_8_SNAPSHOT,
+ V3_2_8,
+
+ V3_2_9_SNAPSHOT,
+ V3_2_9,
+
+ V3_3_1_SNAPSHOT,
+ V3_3_1,
+
+ V3_3_2_SNAPSHOT,
+ V3_3_2,
+
+ V3_3_3_SNAPSHOT,
+ V3_3_3,
+
+ V3_3_4_SNAPSHOT,
+ V3_3_4,
+
+ V3_3_5_SNAPSHOT,
+ V3_3_5,
+
+ V3_3_6_SNAPSHOT,
+ V3_3_6,
+
+ V3_3_7_SNAPSHOT,
+ V3_3_7,
+
+ V3_3_8_SNAPSHOT,
+ V3_3_8,
+
+ V3_3_9_SNAPSHOT,
+ V3_3_9,
+
+ V3_4_1_SNAPSHOT,
+ V3_4_1,
+
+ V3_4_2_SNAPSHOT,
+ V3_4_2,
+
+ V3_4_3_SNAPSHOT,
+ V3_4_3,
+
+ V3_4_4_SNAPSHOT,
+ V3_4_4,
+
+ V3_4_5_SNAPSHOT,
+ V3_4_5,
+
+ V3_4_6_SNAPSHOT,
+ V3_4_6,
+
+ V3_4_7_SNAPSHOT,
+ V3_4_7,
+
+ V3_4_8_SNAPSHOT,
+ V3_4_8,
+
+ V3_4_9_SNAPSHOT,
+ V3_4_9,
+ V3_5_1_SNAPSHOT,
+ V3_5_1,
+
+ V3_5_2_SNAPSHOT,
+ V3_5_2,
+
+ V3_5_3_SNAPSHOT,
+ V3_5_3,
+
+ V3_5_4_SNAPSHOT,
+ V3_5_4,
+
+ V3_5_5_SNAPSHOT,
+ V3_5_5,
+
+ V3_5_6_SNAPSHOT,
+ V3_5_6,
+
+ V3_5_7_SNAPSHOT,
+ V3_5_7,
+
+ V3_5_8_SNAPSHOT,
+ V3_5_8,
+
+ V3_5_9_SNAPSHOT,
+ V3_5_9,
+ };
+
+ static const char* getVersionDesc(int value);
+
+ public:
+ static int s_CurrentVersion;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/MemoryInputStream.cpp b/rocketmq-cpp/src/common/MemoryInputStream.cpp
new file mode 100644
index 00000000..bfbd772a
--- /dev/null
+++ b/rocketmq-cpp/src/common/MemoryInputStream.cpp
@@ -0,0 +1,55 @@
+#include "MemoryInputStream.h"
+
+namespace rocketmq {
+MemoryInputStream::MemoryInputStream(const void* const sourceData,
+ const size_t sourceDataSize,
+ const bool keepInternalCopy)
+ : data(sourceData),
+ dataSize(sourceDataSize),
+ position(0),
+ internalCopy(NULL) {
+ if (keepInternalCopy) createInternalCopy();
+}
+
+MemoryInputStream::MemoryInputStream(const MemoryBlock& sourceData,
+ const bool keepInternalCopy)
+ : data(sourceData.getData()),
+ dataSize(sourceData.getSize()),
+ position(0),
+ internalCopy(NULL) {
+ if (keepInternalCopy) createInternalCopy();
+}
+
+void MemoryInputStream::createInternalCopy() {
+ std::free(internalCopy);
+ internalCopy = static_cast<char*>(std::malloc(dataSize));
+ memcpy(internalCopy, data, dataSize);
+ data = internalCopy;
+}
+
+MemoryInputStream::~MemoryInputStream() { std::free(internalCopy); }
+
+int64 MemoryInputStream::getTotalLength() { return (int64)dataSize; }
+
+int MemoryInputStream::read(void* const buffer, const int howMany) {
+ const int num = std::min(howMany, (int)(dataSize - position));
+ if (num <= 0) return 0;
+
+ memcpy(buffer, data + position, (size_t)num);
+ position += (unsigned int)num;
+ return num;
+}
+
+bool MemoryInputStream::isExhausted() { return position >= dataSize; }
+
+bool MemoryInputStream::setPosition(const int64 pos) {
+ if (pos < 0)
+ position = 0;
+ else
+ position = (int64)dataSize < pos ? (int64)dataSize : pos;
+
+ return true;
+}
+
+int64 MemoryInputStream::getPosition() { return (int64)position; }
+}
diff --git a/rocketmq-cpp/src/common/MemoryInputStream.h b/rocketmq-cpp/src/common/MemoryInputStream.h
new file mode 100644
index 00000000..a25f0799
--- /dev/null
+++ b/rocketmq-cpp/src/common/MemoryInputStream.h
@@ -0,0 +1,80 @@
+#ifndef MEMORYINPUTSTREAM_H_INCLUDED
+#define MEMORYINPUTSTREAM_H_INCLUDED
+
+#include "InputStream.h"
+
+namespace rocketmq {
+//==============================================================================
+/**
+ Allows a block of data to be accessed as a stream.
+
+ This can either be used to refer to a shared block of memory, or can make
+ its
+ own internal copy of the data when the MemoryInputStream is created.
+*/
+class ROCKETMQCLIENT_API MemoryInputStream : public InputStream {
+ public:
+ //==============================================================================
+ /** Creates a MemoryInputStream.
+
+ @param sourceData the block of data to use as the stream's
+ source
+ @param sourceDataSize the number of bytes in the source data
+ block
+ @param keepInternalCopyOfData if false, the stream will just keep a
+ pointer to
+ the source data, so this data shouldn't be
+ changed
+ for the lifetime of the stream; if this
+ parameter is
+ true, the stream will make its own copy of
+ the
+ data and use that.
+ */
+ MemoryInputStream(const void* sourceData, size_t sourceDataSize,
+ bool keepInternalCopyOfData);
+
+ /** Creates a MemoryInputStream.
+
+ @param data a block of data to use as the stream's
+ source
+ @param keepInternalCopyOfData if false, the stream will just keep a
+ reference to
+ the source data, so this data shouldn't be
+ changed
+ for the lifetime of the stream; if this
+ parameter is
+ true, the stream will make its own copy of
+ the
+ data and use that.
+ */
+ MemoryInputStream(const MemoryBlock& data, bool keepInternalCopyOfData);
+
+ /** Destructor. */
+ ~MemoryInputStream();
+
+ /** Returns a pointer to the source data block from which this stream is
+ * reading. */
+ const void* getData() const { return data; }
+
+ /** Returns the number of bytes of source data in the block from which this
+ * stream is reading. */
+ size_t getDataSize() const { return dataSize; }
+
+ //==============================================================================
+ int64 getPosition();
+ bool setPosition(int64 pos);
+ int64 getTotalLength();
+ bool isExhausted();
+ int read(void* destBuffer, int maxBytesToRead);
+
+ private:
+ //==============================================================================
+ const void* data;
+ size_t dataSize, position;
+ char* internalCopy;
+
+ void createInternalCopy();
+};
+}
+#endif
diff --git a/rocketmq-cpp/src/common/MemoryOutputStream.cpp b/rocketmq-cpp/src/common/MemoryOutputStream.cpp
new file mode 100644
index 00000000..36d9f8c4
--- /dev/null
+++ b/rocketmq-cpp/src/common/MemoryOutputStream.cpp
@@ -0,0 +1,148 @@
+#include "MemoryOutputStream.h"
+
+namespace rocketmq {
+MemoryOutputStream::MemoryOutputStream(const size_t initialSize)
+ : blockToUse(&internalBlock),
+ externalData(NULL),
+ position(0),
+ size(0),
+ availableSize(0) {
+ internalBlock.setSize(initialSize, false);
+}
+
+MemoryOutputStream::MemoryOutputStream(MemoryBlock& memoryBlockToWriteTo,
+ const bool appendToExistingBlockContent)
+ : blockToUse(&memoryBlockToWriteTo),
+ externalData(NULL),
+ position(0),
+ size(0),
+ availableSize(0) {
+ if (appendToExistingBlockContent)
+ position = size = memoryBlockToWriteTo.getSize();
+}
+
+MemoryOutputStream::MemoryOutputStream(void* destBuffer, size_t destBufferSize)
+ : blockToUse(NULL),
+ externalData(destBuffer),
+ position(0),
+ size(0),
+ availableSize(destBufferSize) {}
+
+MemoryOutputStream::~MemoryOutputStream() { trimExternalBlockSize(); }
+
+void MemoryOutputStream::flush() { trimExternalBlockSize(); }
+
+void MemoryOutputStream::trimExternalBlockSize() {
+ if (blockToUse != &internalBlock && blockToUse != NULL)
+ blockToUse->setSize(size, false);
+}
+
+void MemoryOutputStream::preallocate(const size_t bytesToPreallocate) {
+ if (blockToUse != NULL) blockToUse->ensureSize(bytesToPreallocate + 1);
+}
+
+void MemoryOutputStream::reset() {
+ position = 0;
+ size = 0;
+}
+
+char* MemoryOutputStream::prepareToWrite(size_t numBytes) {
+ size_t storageNeeded = position + numBytes;
+
+ char* data;
+
+ if (blockToUse != NULL) {
+ if (storageNeeded >= (unsigned int)(blockToUse->getSize()))
+ blockToUse->ensureSize(
+ (storageNeeded + std::min(storageNeeded / 2, (size_t)(1024 * 1024)) +
+ 32) &
+ ~31u);
+
+ data = static_cast<char*>(blockToUse->getData());
+ } else {
+ if (storageNeeded > availableSize) return NULL;
+
+ data = static_cast<char*>(externalData);
+ }
+
+ char* const writePointer = data + position;
+ position += numBytes;
+ size = std::max(size, position);
+ return writePointer;
+}
+
+bool MemoryOutputStream::write(const void* const buffer, size_t howMany) {
+ if (howMany == 0) return true;
+
+ if (char* dest = prepareToWrite(howMany)) {
+ memcpy(dest, buffer, howMany);
+ return true;
+ }
+
+ return false;
+}
+
+bool MemoryOutputStream::writeRepeatedByte(uint8 byte, size_t howMany) {
+ if (howMany == 0) return true;
+
+ if (char* dest = prepareToWrite(howMany)) {
+ memset(dest, byte, howMany);
+ return true;
+ }
+
+ return false;
+}
+
+MemoryBlock MemoryOutputStream::getMemoryBlock() const {
+ return MemoryBlock(getData(), getDataSize());
+}
+
+const void* MemoryOutputStream::getData() const {
+ if (blockToUse == NULL) return externalData;
+
+ if ((unsigned int)blockToUse->getSize() > size)
+ static_cast<char*>(blockToUse->getData())[size] = 0;
+
+ return blockToUse->getData();
+}
+
+bool MemoryOutputStream::setPosition(int64 newPosition) {
+ if (newPosition <= (int64)size) {
+ // ok to seek backwards
+ if (newPosition < 0)
+ position = 0;
+ else
+ position = (int64)size < newPosition ? size : newPosition;
+ return true;
+ }
+
+ // can't move beyond the end of the stream..
+ return false;
+}
+
+int64 MemoryOutputStream::writeFromInputStream(InputStream& source,
+ int64 maxNumBytesToWrite) {
+ // before writing from an input, see if we can preallocate to make it more
+ // efficient..
+ int64 availableData = source.getTotalLength() - source.getPosition();
+
+ if (availableData > 0) {
+ if (maxNumBytesToWrite > availableData || maxNumBytesToWrite < 0)
+ maxNumBytesToWrite = availableData;
+
+ if (blockToUse != NULL)
+ preallocate(blockToUse->getSize() + (size_t)maxNumBytesToWrite);
+ }
+
+ return OutputStream::writeFromInputStream(source, maxNumBytesToWrite);
+}
+
+OutputStream& operator<<(OutputStream& stream,
+ const MemoryOutputStream& streamToRead) {
+ const size_t dataSize = streamToRead.getDataSize();
+
+ if (dataSize > 0) stream.write(streamToRead.getData(), dataSize);
+
+ return stream;
+}
+}
diff --git a/rocketmq-cpp/src/common/MemoryOutputStream.h b/rocketmq-cpp/src/common/MemoryOutputStream.h
new file mode 100644
index 00000000..53fe66cf
--- /dev/null
+++ b/rocketmq-cpp/src/common/MemoryOutputStream.h
@@ -0,0 +1,115 @@
+#ifndef MEMORYOUTPUTSTREAM_H_INCLUDED
+#define MEMORYOUTPUTSTREAM_H_INCLUDED
+
+#include "OutputStream.h"
+
+namespace rocketmq {
+//==============================================================================
+/**
+ Writes data to an internal memory buffer, which grows as required.
+
+ The data that was written into the stream can then be accessed later as
+ a contiguous block of memory.
+*/
+class ROCKETMQCLIENT_API MemoryOutputStream : public OutputStream {
+ public:
+ //==============================================================================
+ /** Creates an empty memory stream, ready to be written into.
+ @param initialSize the intial amount of capacity to allocate for writing
+ into
+ */
+ MemoryOutputStream(size_t initialSize = 256);
+
+ /** Creates a memory stream for writing into into a pre-existing MemoryBlock
+ object.
+
+ Note that the destination block will always be larger than the amount of
+ data
+ that has been written to the stream, because the MemoryOutputStream keeps
+ some
+ spare capactity at its end. To trim the block's size down to fit the
+ actual
+ data, call flush(), or delete the MemoryOutputStream.
+
+ @param memoryBlockToWriteTo the block into which new data will
+ be written.
+ @param appendToExistingBlockContent if this is true, the contents of
+ the block will be
+ kept, and new data will be
+ appended to it. If false,
+ the block will be cleared before
+ use
+ */
+ MemoryOutputStream(MemoryBlock& memoryBlockToWriteTo,
+ bool appendToExistingBlockContent);
+
+ /** Creates a MemoryOutputStream that will write into a user-supplied,
+ fixed-size
+ block of memory.
+ When using this mode, the stream will write directly into this memory area
+ until
+ it's full, at which point write operations will fail.
+ */
+ MemoryOutputStream(void* destBuffer, size_t destBufferSize);
+
+ /** Destructor.
+ This will free any data that was written to it.
+ */
+ ~MemoryOutputStream();
+
+ //==============================================================================
+ /** Returns a pointer to the data that has been written to the stream.
+ @see getDataSize
+ */
+ const void* getData() const;
+
+ /** Returns the number of bytes of data that have been written to the stream.
+ @see getData
+ */
+ size_t getDataSize() const { return size; }
+
+ /** Resets the stream, clearing any data that has been written to it so far.
+ */
+ void reset();
+
+ /** Increases the internal storage capacity to be able to contain at least the
+ specified
+ amount of data without needing to be resized.
+ */
+ void preallocate(size_t bytesToPreallocate);
+
+ /** Returns a copy of the stream's data as a memory block. */
+ MemoryBlock getMemoryBlock() const;
+
+ //==============================================================================
+ /** If the stream is writing to a user-supplied MemoryBlock, this will trim
+ any excess
+ capacity off the block, so that its length matches the amount of actual
+ data that
+ has been written so far.
+ */
+ void flush();
+
+ bool write(const void*, size_t);
+ int64 getPosition() { return (int64)position; }
+ bool setPosition(int64);
+ int64 writeFromInputStream(InputStream&, int64 maxNumBytesToWrite);
+ bool writeRepeatedByte(uint8 byte, size_t numTimesToRepeat);
+
+ private:
+ //==============================================================================
+ MemoryBlock* const blockToUse;
+ MemoryBlock internalBlock;
+ void* externalData;
+ size_t position, size, availableSize;
+
+ void trimExternalBlockSize();
+ char* prepareToWrite(size_t);
+};
+
+/** Copies all the data that has been written to a MemoryOutputStream into
+ * another stream. */
+OutputStream& operator<<(OutputStream& stream,
+ const MemoryOutputStream& streamToRead);
+}
+#endif // MEMORYOUTPUTSTREAM_H_INCLUDED
diff --git a/rocketmq-cpp/src/common/MessageSysFlag.cpp b/rocketmq-cpp/src/common/MessageSysFlag.cpp
new file mode 100755
index 00000000..50a28b47
--- /dev/null
+++ b/rocketmq-cpp/src/common/MessageSysFlag.cpp
@@ -0,0 +1,37 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "MessageSysFlag.h"
+
+namespace rocketmq {
+int MessageSysFlag::CompressedFlag = (0x1 << 0);
+int MessageSysFlag::MultiTagsFlag = (0x1 << 1);
+
+int MessageSysFlag::TransactionNotType = (0x0 << 2);
+int MessageSysFlag::TransactionPreparedType = (0x1 << 2);
+int MessageSysFlag::TransactionCommitType = (0x2 << 2);
+int MessageSysFlag::TransactionRollbackType = (0x3 << 2);
+
+int MessageSysFlag::getTransactionValue(int flag) {
+ return flag & TransactionRollbackType;
+}
+
+int MessageSysFlag::resetTransactionValue(int flag, int type) {
+ return (flag & (~TransactionRollbackType)) | type;
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/MessageSysFlag.h b/rocketmq-cpp/src/common/MessageSysFlag.h
new file mode 100755
index 00000000..d7f7993d
--- /dev/null
+++ b/rocketmq-cpp/src/common/MessageSysFlag.h
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MESSAGESYSFLAG_H__
+#define __MESSAGESYSFLAG_H__
+
+namespace rocketmq {
+//<!************************************************************************
+class MessageSysFlag {
+ public:
+ static int getTransactionValue(int flag);
+ static int resetTransactionValue(int flag, int type);
+
+ public:
+ static int CompressedFlag;
+ static int MultiTagsFlag;
+ static int TransactionNotType;
+ static int TransactionPreparedType;
+ static int TransactionCommitType;
+ static int TransactionRollbackType;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/NamesrvConfig.h b/rocketmq-cpp/src/common/NamesrvConfig.h
new file mode 100755
index 00000000..6c0259f3
--- /dev/null
+++ b/rocketmq-cpp/src/common/NamesrvConfig.h
@@ -0,0 +1,56 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __NAMESRVCONFIG_H__
+#define __NAMESRVCONFIG_H__
+
+#include <stdlib.h>
+#include <string>
+namespace rocketmq {
+//<!***************************************************************************
+class NamesrvConfig {
+ public:
+ NamesrvConfig() {
+ m_kvConfigPath = "";
+
+ char* home = getenv(ROCKETMQ_HOME_ENV.c_str());
+ if (home) {
+ m_rocketmqHome = home;
+ } else {
+ m_rocketmqHome = "";
+ }
+ }
+
+ const string& getRocketmqHome() const { return m_rocketmqHome; }
+
+ void setRocketmqHome(const string& rocketmqHome) {
+ m_rocketmqHome = rocketmqHome;
+ }
+
+ const string& getKvConfigPath() const { return m_kvConfigPath; }
+
+ void setKvConfigPath(const string& kvConfigPath) {
+ m_kvConfigPath = kvConfigPath;
+ }
+
+ private:
+ string m_rocketmqHome;
+ string m_kvConfigPath;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/OutputStream.cpp b/rocketmq-cpp/src/common/OutputStream.cpp
new file mode 100644
index 00000000..59d8c0f2
--- /dev/null
+++ b/rocketmq-cpp/src/common/OutputStream.cpp
@@ -0,0 +1,129 @@
+#include "OutputStream.h"
+#include <limits>
+
+namespace rocketmq {
+//==============================================================================
+OutputStream::OutputStream() {}
+
+OutputStream::~OutputStream() {}
+
+//==============================================================================
+bool OutputStream::writeBool(const bool b) {
+ return writeByte(b ? (char)1 : (char)0);
+}
+
+bool OutputStream::writeByte(char byte) { return write(&byte, 1); }
+
+bool OutputStream::writeRepeatedByte(uint8 byte, size_t numTimesToRepeat) {
+ for (size_t i = 0; i < numTimesToRepeat; ++i)
+ if (!writeByte((char)byte)) return false;
+
+ return true;
+}
+
+bool OutputStream::writeShort(short value) {
+ const unsigned short v = ByteOrder::swapIfBigEndian((unsigned short)value);
+ return write(&v, 2);
+}
+
+bool OutputStream::writeShortBigEndian(short value) {
+ const unsigned short v = ByteOrder::swapIfLittleEndian((unsigned short)value);
+ return write(&v, 2);
+}
+
+bool OutputStream::writeInt(int value) {
+ const unsigned int v = ByteOrder::swapIfBigEndian((unsigned int)value);
+ return write(&v, 4);
+}
+
+bool OutputStream::writeIntBigEndian(int value) {
+ const unsigned int v = ByteOrder::swapIfLittleEndian((unsigned int)value);
+ return write(&v, 4);
+}
+
+bool OutputStream::writeCompressedInt(int value) {
+ unsigned int un = (value < 0) ? (unsigned int)-value : (unsigned int)value;
+
+ uint8 data[5];
+ int num = 0;
+
+ while (un > 0) {
+ data[++num] = (uint8)un;
+ un >>= 8;
+ }
+
+ data[0] = (uint8)num;
+
+ if (value < 0) data[0] |= 0x80;
+
+ return write(data, (size_t)num + 1);
+}
+
+bool OutputStream::writeInt64(int64 value) {
+ const uint64 v = ByteOrder::swapIfBigEndian((uint64)value);
+ return write(&v, 8);
+}
+
+bool OutputStream::writeInt64BigEndian(int64 value) {
+ const uint64 v = ByteOrder::swapIfLittleEndian((uint64)value);
+ return write(&v, 8);
+}
+
+bool OutputStream::writeFloat(float value) {
+ union {
+ int asInt;
+ float asFloat;
+ } n;
+ n.asFloat = value;
+ return writeInt(n.asInt);
+}
+
+bool OutputStream::writeFloatBigEndian(float value) {
+ union {
+ int asInt;
+ float asFloat;
+ } n;
+ n.asFloat = value;
+ return writeIntBigEndian(n.asInt);
+}
+
+bool OutputStream::writeDouble(double value) {
+ union {
+ int64 asInt;
+ double asDouble;
+ } n;
+ n.asDouble = value;
+ return writeInt64(n.asInt);
+}
+
+bool OutputStream::writeDoubleBigEndian(double value) {
+ union {
+ int64 asInt;
+ double asDouble;
+ } n;
+ n.asDouble = value;
+ return writeInt64BigEndian(n.asInt);
+}
+
+int64 OutputStream::writeFromInputStream(InputStream& source,
+ int64 numBytesToWrite) {
+ if (numBytesToWrite < 0) numBytesToWrite = std::numeric_limits<int64>::max();
+
+ int64 numWritten = 0;
+
+ while (numBytesToWrite > 0) {
+ char buffer[8192];
+ const int num = source.read(
+ buffer, (int)std::min(numBytesToWrite, (int64)sizeof(buffer)));
+
+ if (num <= 0) break;
+
+ write(buffer, (size_t)num);
+
+ numBytesToWrite -= num;
+ numWritten += num;
+ }
+
+ return numWritten;
+}
+}
diff --git a/rocketmq-cpp/src/common/OutputStream.h b/rocketmq-cpp/src/common/OutputStream.h
new file mode 100644
index 00000000..1fb2124e
--- /dev/null
+++ b/rocketmq-cpp/src/common/OutputStream.h
@@ -0,0 +1,184 @@
+#ifndef OUTPUTSTREAM_H_INCLUDED
+#define OUTPUTSTREAM_H_INCLUDED
+
+#include "ByteOrder.h"
+#include "InputStream.h"
+namespace rocketmq {
+//==============================================================================
+/**
+ The base class for streams that write data to some kind of destination.
+
+ Input and output streams are used throughout the library - subclasses can
+ override
+ some or all of the virtual functions to implement their behaviour.
+
+ @see InputStream, MemoryOutputStream, FileOutputStream
+*/
+class ROCKETMQCLIENT_API OutputStream {
+ protected:
+ //==============================================================================
+ OutputStream();
+
+ public:
+ /** Destructor.
+
+ Some subclasses might want to do things like call flush() during their
+ destructors.
+ */
+ virtual ~OutputStream();
+
+ //==============================================================================
+ /** If the stream is using a buffer, this will ensure it gets written
+ out to the destination. */
+ virtual void flush() = 0;
+
+ /** Tries to move the stream's output position.
+
+ Not all streams will be able to seek to a new position - this will return
+ false if it fails to work.
+
+ @see getPosition
+ */
+ virtual bool setPosition(int64 newPosition) = 0;
+
+ /** Returns the stream's current position.
+
+ @see setPosition
+ */
+ virtual int64 getPosition() = 0;
+
+ //==============================================================================
+ /** Writes a block of data to the stream.
+
+ When creating a subclass of OutputStream, this is the only write method
+ that needs to be overloaded - the base class has methods for writing other
+ types of data which use this to do the work.
+
+ @param dataToWrite the target buffer to receive the data. This must
+ not be null.
+ @param numberOfBytes the number of bytes to write.
+ @returns false if the write operation fails for some reason
+ */
+ virtual bool write(const void* dataToWrite, size_t numberOfBytes) = 0;
+
+ //==============================================================================
+ /** Writes a single byte to the stream.
+ @returns false if the write operation fails for some reason
+ @see InputStream::readByte
+ */
+ virtual bool writeByte(char byte);
+
+ /** Writes a boolean to the stream as a single byte.
+ This is encoded as a binary byte (not as text) with a value of 1 or 0.
+ @returns false if the write operation fails for some reason
+ @see InputStream::readBool
+ */
+ virtual bool writeBool(bool boolValue);
+
+ /** Writes a 16-bit integer to the stream in a little-endian byte order.
+ This will write two bytes to the stream: (value & 0xff), then (value >>
+ 8).
+ @returns false if the write operation fails for some reason
+ @see InputStream::readShort
+ */
+ virtual bool writeShort(short value);
+
+ /** Writes a 16-bit integer to the stream in a big-endian byte order.
+ This will write two bytes to the stream: (value >> 8), then (value &
+ 0xff).
+ @returns false if the write operation fails for some reason
+ @see InputStream::readShortBigEndian
+ */
+ virtual bool writeShortBigEndian(short value);
+
+ /** Writes a 32-bit integer to the stream in a little-endian byte order.
+ @returns false if the write operation fails for some reason
+ @see InputStream::readInt
+ */
+ virtual bool writeInt(int value);
+
+ /** Writes a 32-bit integer to the stream in a big-endian byte order.
+ @returns false if the write operation fails for some reason
+ @see InputStream::readIntBigEndian
+ */
+ virtual bool writeIntBigEndian(int value);
+
+ /** Writes a 64-bit integer to the stream in a little-endian byte order.
+ @returns false if the write operation fails for some reason
+ @see InputStream::readInt64
+ */
+ virtual bool writeInt64(int64 value);
+
+ /** Writes a 64-bit integer to the stream in a big-endian byte order.
+ @returns false if the write operation fails for some reason
+ @see InputStream::readInt64BigEndian
+ */
+ virtual bool writeInt64BigEndian(int64 value);
+
+ /** Writes a 32-bit floating point value to the stream in a binary format.
+ The binary 32-bit encoding of the float is written as a little-endian int.
+ @returns false if the write operation fails for some reason
+ @see InputStream::readFloat
+ */
+ virtual bool writeFloat(float value);
+
+ /** Writes a 32-bit floating point value to the stream in a binary format.
+ The binary 32-bit encoding of the float is written as a big-endian int.
+ @returns false if the write operation fails for some reason
+ @see InputStream::readFloatBigEndian
+ */
+ virtual bool writeFloatBigEndian(float value);
+
+ /** Writes a 64-bit floating point value to the stream in a binary format.
+ The eight raw bytes of the double value are written out as a little-endian
+ 64-bit int.
+ @returns false if the write operation fails for some reason
+ @see InputStream::readDouble
+ */
+ virtual bool writeDouble(double value);
+
+ /** Writes a 64-bit floating point value to the stream in a binary format.
+ The eight raw bytes of the double value are written out as a big-endian
+ 64-bit int.
+ @see InputStream::readDoubleBigEndian
+ @returns false if the write operation fails for some reason
+ */
+ virtual bool writeDoubleBigEndian(double value);
+
+ /** Writes a byte to the output stream a given number of times.
+ @returns false if the write operation fails for some reason
+ */
+ virtual bool writeRepeatedByte(uint8 byte, size_t numTimesToRepeat);
+
+ /** Writes a condensed binary encoding of a 32-bit integer.
+
+ If you're storing a lot of integers which are unlikely to have very large
+ values,
+ this can save a lot of space, because values under 0xff will only take up
+ 2 bytes,
+ under 0xffff only 3 bytes, etc.
+
+ The format used is: number of significant bytes + up to 4 bytes in
+ little-endian order.
+
+ @returns false if the write operation fails for some reason
+ @see InputStream::readCompressedInt
+ */
+ virtual bool writeCompressedInt(int value);
+
+ /** Reads data from an input stream and writes it to this stream.
+
+ @param source the stream to read from
+ @param maxNumBytesToWrite the number of bytes to read from the stream
+ (if this is
+ less than zero, it will keep reading until the
+ input
+ is exhausted)
+ @returns the number of bytes written
+ */
+ virtual int64 writeFromInputStream(InputStream& source,
+ int64 maxNumBytesToWrite);
+};
+}
+
+#endif // OUTPUTSTREAM_H_INCLUDED
diff --git a/rocketmq-cpp/src/common/PermName.cpp b/rocketmq-cpp/src/common/PermName.cpp
new file mode 100755
index 00000000..7f168a41
--- /dev/null
+++ b/rocketmq-cpp/src/common/PermName.cpp
@@ -0,0 +1,55 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "PermName.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+int PermName::PERM_PRIORITY = 0x1 << 3;
+int PermName::PERM_READ = 0x1 << 2;
+int PermName::PERM_WRITE = 0x1 << 1;
+int PermName::PERM_INHERIT = 0x1 << 0;
+
+bool PermName::isReadable(int perm) { return (perm & PERM_READ) == PERM_READ; }
+
+bool PermName::isWriteable(int perm) {
+ return (perm & PERM_WRITE) == PERM_WRITE;
+}
+
+bool PermName::isInherited(int perm) {
+ return (perm & PERM_INHERIT) == PERM_INHERIT;
+}
+
+string PermName::perm2String(int perm) {
+ string pm("---");
+ if (isReadable(perm)) {
+ pm.replace(0, 1, "R");
+ }
+
+ if (isWriteable(perm)) {
+ pm.replace(1, 2, "W");
+ }
+
+ if (isInherited(perm)) {
+ pm.replace(2, 3, "X");
+ }
+
+ return pm;
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/PermName.h b/rocketmq-cpp/src/common/PermName.h
new file mode 100755
index 00000000..6556382b
--- /dev/null
+++ b/rocketmq-cpp/src/common/PermName.h
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __PERMNAME_H__
+#define __PERMNAME_H__
+
+#include <string>
+
+namespace rocketmq {
+//<!***************************************************************************
+class PermName {
+ public:
+ static int PERM_PRIORITY;
+ static int PERM_READ;
+ static int PERM_WRITE;
+ static int PERM_INHERIT;
+
+ static bool isReadable(int perm);
+ static bool isWriteable(int perm);
+ static bool isInherited(int perm);
+ static std::string perm2String(int perm);
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/PullSysFlag.cpp b/rocketmq-cpp/src/common/PullSysFlag.cpp
new file mode 100755
index 00000000..6d684579
--- /dev/null
+++ b/rocketmq-cpp/src/common/PullSysFlag.cpp
@@ -0,0 +1,70 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "PullSysFlag.h"
+
+namespace rocketmq {
+//<!************************************************************************
+int PullSysFlag::FLAG_COMMIT_OFFSET = 0x1 << 0;
+int PullSysFlag::FLAG_SUSPEND = 0x1 << 1;
+int PullSysFlag::FLAG_SUBSCRIPTION = 0x1 << 2;
+int PullSysFlag::FLAG_CLASS_FILTER = 0x1 << 3;
+
+int PullSysFlag::buildSysFlag(bool commitOffset, bool suspend,
+ bool subscription, bool classFilter) {
+ int flag = 0;
+
+ if (commitOffset) {
+ flag |= FLAG_COMMIT_OFFSET;
+ }
+
+ if (suspend) {
+ flag |= FLAG_SUSPEND;
+ }
+
+ if (subscription) {
+ flag |= FLAG_SUBSCRIPTION;
+ }
+
+ if (classFilter) {
+ flag |= FLAG_CLASS_FILTER;
+ }
+
+ return flag;
+}
+
+int PullSysFlag::clearCommitOffsetFlag(int sysFlag) {
+ return sysFlag & (~FLAG_COMMIT_OFFSET);
+}
+
+bool PullSysFlag::hasCommitOffsetFlag(int sysFlag) {
+ return (sysFlag & FLAG_COMMIT_OFFSET) == FLAG_COMMIT_OFFSET;
+}
+
+bool PullSysFlag::hasSuspendFlag(int sysFlag) {
+ return (sysFlag & FLAG_SUSPEND) == FLAG_SUSPEND;
+}
+
+bool PullSysFlag::hasSubscriptionFlag(int sysFlag) {
+ return (sysFlag & FLAG_SUBSCRIPTION) == FLAG_SUBSCRIPTION;
+}
+
+bool PullSysFlag::hasClassFilterFlag(int sysFlag) {
+ return (sysFlag & FLAG_CLASS_FILTER) == FLAG_CLASS_FILTER;
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/PullSysFlag.h b/rocketmq-cpp/src/common/PullSysFlag.h
new file mode 100755
index 00000000..c809772e
--- /dev/null
+++ b/rocketmq-cpp/src/common/PullSysFlag.h
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __PULLSYSFLAG_H__
+#define __PULLSYSFLAG_H__
+namespace rocketmq {
+//<!************************************************************************
+class PullSysFlag {
+ public:
+ static int buildSysFlag(bool commitOffset, bool suspend, bool subscription,
+ bool classFilter);
+
+ static int clearCommitOffsetFlag(int sysFlag);
+ static bool hasCommitOffsetFlag(int sysFlag);
+ static bool hasSuspendFlag(int sysFlag);
+ static bool hasSubscriptionFlag(int sysFlag);
+ static bool hasClassFilterFlag(int sysFlag);
+
+ private:
+ static int FLAG_COMMIT_OFFSET;
+ static int FLAG_SUSPEND;
+ static int FLAG_SUBSCRIPTION;
+ static int FLAG_CLASS_FILTER;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/ServiceState.h b/rocketmq-cpp/src/common/ServiceState.h
new file mode 100755
index 00000000..a8ae7926
--- /dev/null
+++ b/rocketmq-cpp/src/common/ServiceState.h
@@ -0,0 +1,25 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __SERVICESTATE_H__
+#define __SERVICESTATE_H__
+namespace rocketmq {
+//<!***************************************************************************
+enum ServiceState { CREATE_JUST, RUNNING, SHUTDOWN_ALREADY, START_FAILED };
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/SubscriptionGroupConfig.h b/rocketmq-cpp/src/common/SubscriptionGroupConfig.h
new file mode 100755
index 00000000..9a541407
--- /dev/null
+++ b/rocketmq-cpp/src/common/SubscriptionGroupConfig.h
@@ -0,0 +1,49 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __SUBSCRIPTIONGROUPCONFIG_H__
+#define __SUBSCRIPTIONGROUPCONFIG_H__
+
+#include <string>
+
+namespace rocketmq {
+//<!***************************************************************************
+class SubscriptionGroupConfig {
+ public:
+ SubscriptionGroupConfig(const string& groupName) {
+ this->groupName = groupName;
+ consumeEnable = true;
+ consumeFromMinEnable = true;
+ consumeBroadcastEnable = true;
+ retryQueueNums = 1;
+ retryMaxTimes = 5;
+ brokerId = MASTER_ID;
+ whichBrokerWhenConsumeSlowly = 1;
+ }
+
+ string groupName;
+ bool consumeEnable;
+ bool consumeFromMinEnable;
+ bool consumeBroadcastEnable;
+ int retryQueueNums;
+ int retryMaxTimes;
+ int brokerId;
+ int whichBrokerWhenConsumeSlowly;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/TopAddressing.cpp b/rocketmq-cpp/src/common/TopAddressing.cpp
new file mode 100644
index 00000000..3a1742d3
--- /dev/null
+++ b/rocketmq-cpp/src/common/TopAddressing.cpp
@@ -0,0 +1,108 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "TopAddressing.h"
+#include <arpa/inet.h>
+#include <netdb.h>
+#include <netinet/in.h>
+#include <sys/socket.h>
+#include <vector>
+#include "UtilAll.h"
+#include "sync_http_client.h"
+#include "url.h"
+
+namespace rocketmq {
+TopAddressing::TopAddressing(string unitName) : m_unitName(unitName) {}
+
+TopAddressing::~TopAddressing() {}
+
+int TopAddressing::IsIPAddr(const char* sValue) {
+ if (NULL == sValue) return -1;
+
+ while (*sValue != '\0') {
+ if ((*sValue < '0' || *sValue > '9') && (*sValue != '.')) return -1;
+ sValue++;
+ }
+ return 0;
+}
+
+void TopAddressing::updateNameServerAddressList(const string& adds) {
+ boost::lock_guard<boost::mutex> lock(m_addrLock);
+ vector<string> out;
+ UtilAll::Split(out, adds, ";");
+ if (out.size() > 0) m_addrs.clear();
+ for (size_t i = 0; i < out.size(); i++) {
+ string addr = out[i];
+ UtilAll::Trim(addr);
+
+ list<string>::iterator findit = find(m_addrs.begin(), m_addrs.end(), addr);
+ if (findit == m_addrs.end()) {
+ string hostName;
+ short portNumber;
+ if (UtilAll::SplitURL(addr, hostName, portNumber)) {
+ LOG_INFO("updateNameServerAddressList:%s", addr.c_str());
+ m_addrs.push_back(addr);
+ }
+ }
+ }
+}
+
+string TopAddressing::fetchNSAddr(const string& NSDomain) {
+ LOG_DEBUG("fetchNSAddr begin");
+ string nsAddr = NSDomain.empty() ? WS_ADDR : NSDomain;
+ if (!m_unitName.empty()) {
+ nsAddr = nsAddr + "-" + m_unitName + "?nofix=1";
+ LOG_INFO("NSAddr is:%s", nsAddr.c_str());
+ }
+
+ std::string tmp_nameservers;
+ std::string nameservers;
+ Url url_s(nsAddr);
+ LOG_INFO("fetchNSAddr protocol: %s, port: %s, host:%s, path:%s, ",
+ url_s.protocol_.c_str(), url_s.port_.c_str(), url_s.host_.c_str(),
+ url_s.path_.c_str());
+
+ bool ret = SyncfetchNsAddr(url_s, tmp_nameservers);
+ if (ret) {
+ nameservers = clearNewLine(tmp_nameservers);
+ if (nameservers.empty()) {
+ LOG_ERROR("fetchNSAddr with domain is empty");
+ } else {
+ updateNameServerAddressList(nameservers);
+ }
+ } else {
+ LOG_ERROR(
+ "fetchNSAddr with domain failed, connect failure or wrong response");
+ }
+
+ return nameservers;
+}
+
+string TopAddressing::clearNewLine(const string& str) {
+ string newString = str;
+ size_t index = newString.find("\r");
+ if (index != string::npos) {
+ return newString.substr(0, index);
+ }
+
+ index = newString.find("\n");
+ if (index != string::npos) {
+ return newString.substr(0, index);
+ }
+
+ return newString;
+}
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/TopAddressing.h b/rocketmq-cpp/src/common/TopAddressing.h
new file mode 100755
index 00000000..a8500234
--- /dev/null
+++ b/rocketmq-cpp/src/common/TopAddressing.h
@@ -0,0 +1,48 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __TOPADDRESSING_H__
+#define __TOPADDRESSING_H__
+
+#include <sys/time.h>
+#include <boost/thread/thread.hpp>
+#include <list>
+#include <map>
+#include <string>
+#include "Logging.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+class TopAddressing {
+ public:
+ TopAddressing(string unitName);
+ virtual ~TopAddressing();
+
+ public:
+ string fetchNSAddr(const string& NSDomain);
+
+ private:
+ string clearNewLine(const string& str);
+ void updateNameServerAddressList(const string& adds);
+ int IsIPAddr(const char* sValue);
+
+ private:
+ boost::mutex m_addrLock;
+ list<string> m_addrs;
+ string m_unitName;
+};
+}
+#endif
diff --git a/rocketmq-cpp/src/common/TopicConfig.cpp b/rocketmq-cpp/src/common/TopicConfig.cpp
new file mode 100755
index 00000000..e0e1b4d4
--- /dev/null
+++ b/rocketmq-cpp/src/common/TopicConfig.cpp
@@ -0,0 +1,104 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "TopicConfig.h"
+#include <stdlib.h>
+#include <sstream>
+#include "PermName.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+int TopicConfig::DefaultReadQueueNums = 16;
+int TopicConfig::DefaultWriteQueueNums = 16;
+string TopicConfig::SEPARATOR = " ";
+
+TopicConfig::TopicConfig()
+ : m_topicName(""),
+ m_readQueueNums(DefaultReadQueueNums),
+ m_writeQueueNums(DefaultWriteQueueNums),
+ m_perm(PermName::PERM_READ | PermName::PERM_WRITE),
+ m_topicFilterType(SINGLE_TAG) {}
+
+TopicConfig::TopicConfig(const string& topicName)
+ : m_topicName(topicName),
+ m_readQueueNums(DefaultReadQueueNums),
+ m_writeQueueNums(DefaultWriteQueueNums),
+ m_perm(PermName::PERM_READ | PermName::PERM_WRITE),
+ m_topicFilterType(SINGLE_TAG) {}
+
+TopicConfig::TopicConfig(const string& topicName, int readQueueNums,
+ int writeQueueNums, int perm)
+ : m_topicName(topicName),
+ m_readQueueNums(readQueueNums),
+ m_writeQueueNums(writeQueueNums),
+ m_perm(perm),
+ m_topicFilterType(SINGLE_TAG) {}
+
+TopicConfig::~TopicConfig() {}
+
+string TopicConfig::encode() {
+ stringstream ss;
+ ss << m_topicName << SEPARATOR << m_readQueueNums << SEPARATOR
+ << m_writeQueueNums << SEPARATOR << m_perm << SEPARATOR
+ << m_topicFilterType;
+
+ return ss.str();
+}
+
+bool TopicConfig::decode(const string& in) {
+ stringstream ss(in);
+
+ ss >> m_topicName;
+ ss >> m_readQueueNums;
+ ss >> m_writeQueueNums;
+ ss >> m_perm;
+
+ int type;
+ ss >> type;
+ m_topicFilterType = (TopicFilterType)type;
+
+ return true;
+}
+
+const string& TopicConfig::getTopicName() { return m_topicName; }
+
+void TopicConfig::setTopicName(const string& topicName) {
+ m_topicName = topicName;
+}
+
+int TopicConfig::getReadQueueNums() { return m_readQueueNums; }
+
+void TopicConfig::setReadQueueNums(int readQueueNums) {
+ m_readQueueNums = readQueueNums;
+}
+
+int TopicConfig::getWriteQueueNums() { return m_writeQueueNums; }
+
+void TopicConfig::setWriteQueueNums(int writeQueueNums) {
+ m_writeQueueNums = writeQueueNums;
+}
+
+int TopicConfig::getPerm() { return m_perm; }
+
+void TopicConfig::setPerm(int perm) { m_perm = perm; }
+
+TopicFilterType TopicConfig::getTopicFilterType() { return m_topicFilterType; }
+
+void TopicConfig::setTopicFilterType(TopicFilterType topicFilterType) {
+ m_topicFilterType = topicFilterType;
+}
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/TopicConfig.h b/rocketmq-cpp/src/common/TopicConfig.h
new file mode 100755
index 00000000..0e7c17a6
--- /dev/null
+++ b/rocketmq-cpp/src/common/TopicConfig.h
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __TOPICCONFIG_H__
+#define __TOPICCONFIG_H__
+
+#include <string>
+#include "TopicFilterType.h"
+#include "UtilAll.h"
+namespace rocketmq {
+//<!************************************************************************
+class TopicConfig {
+ public:
+ TopicConfig();
+ TopicConfig(const string& topicName);
+ TopicConfig(const string& topicName, int readQueueNums, int writeQueueNums,
+ int perm);
+ ~TopicConfig();
+
+ string encode();
+ bool decode(const string& in);
+ const string& getTopicName();
+ void setTopicName(const string& topicName);
+ int getReadQueueNums();
+ void setReadQueueNums(int readQueueNums);
+ int getWriteQueueNums();
+ void setWriteQueueNums(int writeQueueNums);
+ int getPerm();
+ void setPerm(int perm);
+ TopicFilterType getTopicFilterType();
+ void setTopicFilterType(TopicFilterType topicFilterType);
+
+ public:
+ static int DefaultReadQueueNums;
+ static int DefaultWriteQueueNums;
+
+ private:
+ static string SEPARATOR;
+
+ string m_topicName;
+ int m_readQueueNums;
+ int m_writeQueueNums;
+ int m_perm;
+ TopicFilterType m_topicFilterType;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/TopicFilterType.h b/rocketmq-cpp/src/common/TopicFilterType.h
new file mode 100755
index 00000000..9055003a
--- /dev/null
+++ b/rocketmq-cpp/src/common/TopicFilterType.h
@@ -0,0 +1,34 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __TOPICFILTERTYPE_H__
+#define __TOPICFILTERTYPE_H__
+
+namespace rocketmq {
+//<!***************************************************************************
+enum TopicFilterType {
+ /**
+ * each msg could only have one tag
+ */
+ SINGLE_TAG,
+ /**
+ * not support now
+ */
+ MULTI_TAG
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/UtilAll.cpp b/rocketmq-cpp/src/common/UtilAll.cpp
new file mode 100755
index 00000000..8d8ff9c5
--- /dev/null
+++ b/rocketmq-cpp/src/common/UtilAll.cpp
@@ -0,0 +1,301 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!************************************************************************
+std::string UtilAll::s_localHostName;
+std::string UtilAll::s_localIpAddress;
+
+bool UtilAll::startsWith_retry(const string &topic) {
+ return topic.find(RETRY_GROUP_TOPIC_PREFIX) == 0;
+}
+
+string UtilAll::getRetryTopic(const string &consumerGroup) {
+ return RETRY_GROUP_TOPIC_PREFIX + consumerGroup;
+}
+
+void UtilAll::Trim(string &str) {
+ str.erase(0, str.find_first_not_of(' ')); // prefixing spaces
+ str.erase(str.find_last_not_of(' ') + 1); // surfixing spaces
+}
+
+bool UtilAll::isBlank(const string &str) {
+ if (str.empty()) {
+ return true;
+ }
+
+ string::size_type left = str.find_first_not_of(WHITESPACE);
+
+ if (left == string::npos) {
+ return true;
+ }
+
+ return false;
+}
+
+uint64 UtilAll::hexstr2ull(const char *str) {
+ return boost::lexical_cast<uint64>(str);
+}
+
+int64 UtilAll::str2ll(const char *str) {
+ return boost::lexical_cast<int64>(str);
+}
+
+string UtilAll::bytes2string(const char *bytes, int len) {
+ if (bytes == NULL || len <= 0) {
+ return string();
+ }
+
+ char hex_str[] = "0123456789ABCDEF";
+ char result[len * 2 + 1];
+ result[len * 2] = 0;
+
+ for (int i = 0; i < len; i++) {
+ result[i * 2 + 0] = hex_str[(bytes[i] >> 4) & 0x0F];
+ result[i * 2 + 1] = hex_str[(bytes[i]) & 0x0F];
+ }
+
+ string buffer(result);
+ return buffer;
+}
+
+bool UtilAll::SplitURL(const string &serverURL, string &addr, short &nPort) {
+ size_t pos = serverURL.find(':');
+ if (pos == string::npos) {
+ return false;
+ }
+
+ addr = serverURL.substr(0, pos);
+ if (0 == addr.compare("localhost")) {
+ addr = "127.0.0.1";
+ }
+
+ pos++;
+ string port = serverURL.substr(pos, serverURL.length() - pos);
+ nPort = atoi(port.c_str());
+ if (nPort == 0) {
+ return false;
+ }
+ return true;
+}
+
+int UtilAll::Split(vector<string> &ret_, const string &strIn, const char sep) {
+ if (strIn.empty()) return 0;
+
+ string tmp;
+ string::size_type pos_begin = strIn.find_first_not_of(sep);
+ string::size_type comma_pos = 0;
+
+ while (pos_begin != string::npos) {
+ comma_pos = strIn.find(sep, pos_begin);
+ if (comma_pos != string::npos) {
+ tmp = strIn.substr(pos_begin, comma_pos - pos_begin);
+ pos_begin = comma_pos + 1;
+ } else {
+ tmp = strIn.substr(pos_begin);
+ pos_begin = comma_pos;
+ }
+
+ if (!tmp.empty()) {
+ ret_.push_back(tmp);
+ tmp.clear();
+ }
+ }
+ return ret_.size();
+}
+int UtilAll::Split(vector<string> &ret_, const string &strIn,
+ const string &sep) {
+ if (strIn.empty()) return 0;
+
+ string tmp;
+ string::size_type pos_begin = strIn.find_first_not_of(sep);
+ string::size_type comma_pos = 0;
+
+ while (pos_begin != string::npos) {
+ comma_pos = strIn.find(sep, pos_begin);
+ if (comma_pos != string::npos) {
+ tmp = strIn.substr(pos_begin, comma_pos - pos_begin);
+ pos_begin = comma_pos + sep.length();
+ } else {
+ tmp = strIn.substr(pos_begin);
+ pos_begin = comma_pos;
+ }
+
+ if (!tmp.empty()) {
+ ret_.push_back(tmp);
+ tmp.clear();
+ }
+ }
+ return ret_.size();
+}
+
+int32_t UtilAll::StringToInt32(const std::string &str, int32_t &out) {
+ out = 0;
+ if (str.empty()) {
+ return false;
+ }
+
+ char *end = NULL;
+ errno = 0;
+ long l = strtol(str.c_str(), &end, 10);
+ /* Both checks are needed because INT_MAX == LONG_MAX is possible. */
+ if (l > INT_MAX || (errno == ERANGE && l == LONG_MAX)) return false;
+ if (l < INT_MIN || (errno == ERANGE && l == LONG_MIN)) return false;
+ if (*end != '\0') return false;
+ out = l;
+ return true;
+}
+
+int64_t UtilAll::StringToInt64(const std::string &str, int64_t &val) {
+ char *endptr = NULL;
+ errno = 0; /* To distinguish success/failure after call */
+ val = strtoll(str.c_str(), &endptr, 10);
+
+ /* Check for various possible errors */
+ if ((errno == ERANGE && (val == LONG_MAX || val == LONG_MIN)) ||
+ (errno != 0 && val == 0)) {
+ return false;
+ }
+ /*no digit was found Or Further characters after number*/
+ if (endptr == str.c_str()) {
+ return false;
+ }
+ /*no digit was found Or Further characters after number*/
+ if (*endptr != '\0') {
+ return false;
+ }
+ /* If we got here, strtol() successfully parsed a number */
+ return true;
+}
+
+string UtilAll::getLocalHostName() {
+ if (s_localHostName.empty()) {
+ // boost::system::error_code error;
+ // s_localHostName = boost::asio::ip::host_name(error);
+
+ char name[1024];
+ boost::system::error_code ec;
+ if (boost::asio::detail::socket_ops::gethostname(name, sizeof(name), ec) !=
+ 0) {
+ return std::string();
+ }
+ s_localHostName.append(name, strlen(name));
+ }
+ return s_localHostName;
+}
+
+string UtilAll::getLocalAddress() {
+ if (s_localIpAddress.empty()) {
+ boost::asio::io_service io_service;
+ boost::asio::ip::tcp::resolver resolver(io_service);
+ boost::asio::ip::tcp::resolver::query query(getLocalHostName(), "");
+ boost::system::error_code error;
+ boost::asio::ip::tcp::resolver::iterator iter =
+ resolver.resolve(query, error);
+ if (error) {
+ return "";
+ }
+ boost::asio::ip::tcp::resolver::iterator end; // End marker.
+ boost::asio::ip::tcp::endpoint ep;
+ while (iter != end) {
+ ep = *iter++;
+ }
+ s_localIpAddress = ep.address().to_string();
+ }
+ return s_localIpAddress;
+}
+
+string UtilAll::getHomeDirectory() {
+ char *homeEnv = getenv("HOME");
+ string homeDir;
+ if (homeEnv == NULL) {
+ homeDir.append(getpwuid(getuid())->pw_dir);
+ } else {
+ homeDir.append(homeEnv);
+ }
+ return homeDir;
+}
+
+int UtilAll::getRandomNum(int baseNum) {
+ struct timeval tv;
+ gettimeofday(&tv, NULL);
+ long time = (tv.tv_sec * long(1000000)) + tv.tv_usec;
+ return (int)(time % baseNum);
+}
+
+string UtilAll::getProcessName() {
+ char buf[PATH_MAX + 1] = {0};
+ int count = PATH_MAX + 1;
+ char procpath[PATH_MAX + 1] = {0};
+ sprintf(procpath, "/proc/%d/exe", getpid());
+
+ if (access(procpath, F_OK) == -1) {
+ return "";
+ }
+
+ int retval = readlink(procpath, buf, count - 1);
+ if ((retval < 0 || retval >= count - 1)) {
+ return "";
+ }
+ if (!strcmp(buf + retval - 10, " (deleted)"))
+ buf[retval - 10] = '\0'; // remove last " (deleted)"
+ else
+ buf[retval] = '\0';
+
+ char *process_name = strrchr(buf, '/');
+ if (process_name) {
+ return std::string(process_name + 1);
+ } else {
+ return "";
+ }
+}
+
+uint64_t UtilAll::currentTimeMillis() {
+ struct timeval tv;
+ gettimeofday(&tv, NULL);
+ return ((uint64_t)tv.tv_sec) * 1000 + tv.tv_usec / 1000;
+}
+
+uint64_t UtilAll::currentTimeSeconds() {
+ struct timeval tv;
+ gettimeofday(&tv, NULL);
+ return (uint64_t)tv.tv_sec;
+}
+
+bool UtilAll::deflate(std::string &input, std::string &out, int level) {
+ boost::iostreams::zlib_params zlibParams(level,
+ boost::iostreams::zlib::deflated);
+ boost::iostreams::filtering_ostream compressingStream;
+ compressingStream.push(boost::iostreams::zlib_compressor(zlibParams));
+ compressingStream.push(boost::iostreams::back_inserter(out));
+ compressingStream << input;
+ boost::iostreams::close(compressingStream);
+
+ return true;
+}
+
+bool UtilAll::inflate(std::string &input, std::string &out) {
+ boost::iostreams::filtering_ostream decompressingStream;
+ decompressingStream.push(boost::iostreams::zlib_decompressor());
+ decompressingStream.push(boost::iostreams::back_inserter(out));
+ decompressingStream << input;
+ boost::iostreams::close(decompressingStream);
+
+ return true;
+}
+}
diff --git a/rocketmq-cpp/src/common/UtilAll.h b/rocketmq-cpp/src/common/UtilAll.h
new file mode 100755
index 00000000..cf66688c
--- /dev/null
+++ b/rocketmq-cpp/src/common/UtilAll.h
@@ -0,0 +1,131 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __UTILALL_H__
+#define __UTILALL_H__
+
+#include <assert.h>
+#include <errno.h>
+#include <pwd.h>
+#include <stdint.h>
+#include <stdlib.h>
+#include <string.h>
+#include <sys/stat.h>
+#include <sys/time.h>
+#include <sys/types.h>
+
+#include <boost/asio.hpp>
+#include <boost/iostreams/copy.hpp>
+#include <boost/iostreams/device/back_inserter.hpp>
+#include <boost/iostreams/filter/gzip.hpp>
+#include <boost/iostreams/filter/zlib.hpp>
+#include <boost/iostreams/filtering_stream.hpp>
+#include <boost/lexical_cast.hpp>
+#include <boost/locale/conversion.hpp>
+#include <boost/locale/encoding.hpp>
+#include <sstream>
+#include "RocketMQClient.h"
+
+using namespace std;
+namespace rocketmq {
+//<!************************************************************************
+const string WHITESPACE = " \t\r\n";
+const int MASTER_ID = 0;
+const string SUB_ALL = "*";
+const string DEFAULT_TOPIC = "TBW102";
+const string BENCHMARK_TOPIC = "BenchmarkTest";
+const string DEFAULT_PRODUCER_GROUP = "DEFAULT_PRODUCER";
+const string DEFAULT_CONSUMER_GROUP = "DEFAULT_CONSUMER";
+const string TOOLS_CONSUMER_GROUP = "TOOLS_CONSUMER";
+const string CLIENT_INNER_PRODUCER_GROUP = "CLIENT_INNER_PRODUCER";
+const string SELF_TEST_TOPIC = "SELF_TEST_TOPIC";
+const string RETRY_GROUP_TOPIC_PREFIX = "%RETRY%";
+const string DLQ_GROUP_TOPIC_PREFIX = "%DLQ%";
+const string ROCKETMQ_HOME_ENV = "ROCKETMQ_HOME";
+const string ROCKETMQ_HOME_PROPERTY = "rocketmq.home.dir";
+const string MESSAGE_COMPRESS_LEVEL = "rocketmq.message.compressLevel";
+const int POLL_NAMESERVER_INTEVAL = 1000 * 30;
+const int HEARTBEAT_BROKER_INTERVAL = 1000 * 30;
+const int PERSIST_CONSUMER_OFFSET_INTERVAL = 1000 * 5;
+const string WS_ADDR = "please set nameserver domain by setDomainName, there is no default nameserver domain";
+
+const int LINE_SEPARATOR = 1; // metaq::UtilAll::charToString((char) 1);
+const int WORD_SEPARATOR = 2; // metaq::UtilAll::charToString((char) 2);
+
+const int HTTP_TIMEOUT = 3000; // 3S
+const int HTTP_CONFLICT = 409;
+const int HTTP_OK = 200;
+const int HTTP_NOTFOUND = 404;
+const int CONNETERROR = -1;
+const string null = "";
+
+template <typename Type>
+inline void deleteAndZero(Type &pointer) {
+ delete pointer;
+ pointer = NULL;
+}
+#define EMPTY_STR_PTR(ptr) (ptr == NULL || ptr[0] == '\0')
+
+//<!************************************************************************
+class UtilAll {
+ public:
+ static bool startsWith_retry(const string &topic);
+ static string getRetryTopic(const string &consumerGroup);
+
+ static void Trim(string &str);
+ static bool isBlank(const string &str);
+ static uint64 hexstr2ull(const char *str);
+ static int64 str2ll(const char *str);
+ static string bytes2string(const char *bytes, int len);
+
+ template <typename T>
+ static string to_string(const T &n) {
+ std::ostringstream stm;
+ stm << n;
+ return stm.str();
+ }
+
+ static bool to_bool(std::string const &s) { return atoi(s.c_str()); }
+
+ static bool SplitURL(const string &serverURL, string &addr, short &nPort);
+ static int Split(vector<string> &ret_, const string &strIn, const char sep);
+ static int Split(vector<string> &ret_, const string &strIn,
+ const string &sep);
+
+ static int32_t StringToInt32(const std::string &str, int32_t &out);
+ static int64_t StringToInt64(const std::string &str, int64_t &val);
+
+ static string getLocalHostName();
+ static string getLocalAddress();
+ static string getHomeDirectory();
+
+ static int getRandomNum(int baseNum);
+
+ static string getProcessName();
+
+ static uint64_t currentTimeMillis();
+ static uint64_t currentTimeSeconds();
+
+ static bool deflate(std::string &input, std::string &out, int level);
+ static bool inflate(std::string &input, std::string &out);
+
+ private:
+ static std::string s_localHostName;
+ static std::string s_localIpAddress;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/Validators.cpp b/rocketmq-cpp/src/common/Validators.cpp
new file mode 100755
index 00000000..7484c983
--- /dev/null
+++ b/rocketmq-cpp/src/common/Validators.cpp
@@ -0,0 +1,115 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "Validators.h"
+#include <stdio.h>
+#include <stdlib.h>
+namespace rocketmq {
+
+const string Validators::validPatternStr = "^[a-zA-Z0-9_-]+$";
+const int Validators::CHARACTER_MAX_LENGTH = 255;
+//<!***************************************************************************
+bool Validators::regularExpressionMatcher(const string& origin,
+ const string& patternStr) {
+ if (UtilAll::isBlank(origin)) {
+ return false;
+ }
+
+ if (UtilAll::isBlank(patternStr)) {
+ return true;
+ }
+
+ // Pattern pattern = Pattern.compile(patternStr);
+ // Matcher matcher = pattern.matcher(origin);
+
+ // return matcher.matches();
+ return true;
+}
+
+string Validators::getGroupWithRegularExpression(const string& origin,
+ const string& patternStr) {
+ /*Pattern pattern = Pattern.compile(patternStr);
+ Matcher matcher = pattern.matcher(origin);
+ while (matcher.find()) {
+ return matcher.group(0);
+ }*/
+ return "";
+}
+
+void Validators::checkTopic(const string& topic) {
+ if (UtilAll::isBlank(topic)) {
+ THROW_MQEXCEPTION(MQClientException, "the specified topic is blank", -1);
+ }
+
+ if ((int)topic.length() > CHARACTER_MAX_LENGTH) {
+ THROW_MQEXCEPTION(
+ MQClientException,
+ "the specified topic is longer than topic max length 255.", -1);
+ }
+
+ if (topic == DEFAULT_TOPIC) {
+ THROW_MQEXCEPTION(
+ MQClientException,
+ "the topic[" + topic + "] is conflict with default topic.", -1);
+ }
+
+ if (!regularExpressionMatcher(topic, validPatternStr)) {
+ string str;
+ str = "the specified topic[" + topic +
+ "] contains illegal characters, allowing only" + validPatternStr;
+
+ THROW_MQEXCEPTION(MQClientException, str.c_str(), -1);
+ }
+}
+
+void Validators::checkGroup(const string& group) {
+ if (UtilAll::isBlank(group)) {
+ THROW_MQEXCEPTION(MQClientException, "the specified group is blank", -1);
+ }
+
+ if (!regularExpressionMatcher(group, validPatternStr)) {
+ string str;
+ str = "the specified group[" + group +
+ "] contains illegal characters, allowing only" + validPatternStr;
+
+ THROW_MQEXCEPTION(MQClientException, str.c_str(), -1);
+ }
+ if ((int)group.length() > CHARACTER_MAX_LENGTH) {
+ THROW_MQEXCEPTION(
+ MQClientException,
+ "the specified group is longer than group max length 255.", -1);
+ }
+}
+
+void Validators::checkMessage(const MQMessage& msg, int maxMessageSize) {
+ checkTopic(msg.getTopic());
+
+ string body = msg.getBody();
+ //<!body;
+ if (body.empty()) {
+ THROW_MQEXCEPTION(MQClientException, "the message body is empty", -1);
+ }
+
+ if ((int)body.length() > maxMessageSize) {
+ char info[256];
+ sprintf(info, "the message body size over max value, MAX: %d",
+ maxMessageSize);
+ THROW_MQEXCEPTION(MQClientException, info, -1);
+ }
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/Validators.h b/rocketmq-cpp/src/common/Validators.h
new file mode 100755
index 00000000..41905881
--- /dev/null
+++ b/rocketmq-cpp/src/common/Validators.h
@@ -0,0 +1,43 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __VALIDATORST_H__
+#define __VALIDATORST_H__
+
+#include <string>
+#include "MQClientException.h"
+#include "MQMessage.h"
+#include "UtilAll.h"
+namespace rocketmq {
+//<!***************************************************************************
+class Validators {
+ public:
+ static bool regularExpressionMatcher(const string& origin,
+ const string& patternStr);
+ static string getGroupWithRegularExpression(const string& origin,
+ const string& patternStr);
+ static void checkTopic(const string& topic);
+ static void checkGroup(const string& group);
+ static void checkMessage(const MQMessage& msg, int maxMessageSize);
+
+ public:
+ static const string validPatternStr;
+ static const int CHARACTER_MAX_LENGTH;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/VirtualEnvUtil.cpp b/rocketmq-cpp/src/common/VirtualEnvUtil.cpp
new file mode 100755
index 00000000..6daf7318
--- /dev/null
+++ b/rocketmq-cpp/src/common/VirtualEnvUtil.cpp
@@ -0,0 +1,56 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "VirtualEnvUtil.h"
+#include <stdio.h>
+#include <stdlib.h>
+#include "UtilAll.h"
+
+namespace rocketmq {
+const char* VirtualEnvUtil::VIRTUAL_APPGROUP_PREFIX = "%%PROJECT_%s%%";
+
+//<!***************************************************************************
+string VirtualEnvUtil::buildWithProjectGroup(const string& origin,
+ const string& projectGroup) {
+ if (!UtilAll::isBlank(projectGroup)) {
+ char prefix[1024];
+ sprintf(prefix, VIRTUAL_APPGROUP_PREFIX, projectGroup.c_str());
+
+ if (origin.find_last_of(prefix) == string::npos) {
+ return origin + prefix;
+ } else {
+ return origin;
+ }
+ } else {
+ return origin;
+ }
+}
+
+string VirtualEnvUtil::clearProjectGroup(const string& origin,
+ const string& projectGroup) {
+ char prefix[1024];
+ sprintf(prefix, VIRTUAL_APPGROUP_PREFIX, projectGroup.c_str());
+ string::size_type pos = origin.find_last_of(prefix);
+
+ if (!UtilAll::isBlank(prefix) && pos != string::npos) {
+ return origin.substr(0, pos);
+ } else {
+ return origin;
+ }
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/common/VirtualEnvUtil.h b/rocketmq-cpp/src/common/VirtualEnvUtil.h
new file mode 100755
index 00000000..88e44f8b
--- /dev/null
+++ b/rocketmq-cpp/src/common/VirtualEnvUtil.h
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __VIRTUALENVUTIL_H__
+#define __VIRTUALENVUTIL_H__
+
+#include <string>
+namespace rocketmq {
+//<!***************************************************************************
+class VirtualEnvUtil {
+ public:
+ static std::string buildWithProjectGroup(const std::string& origin,
+ const std::string& projectGroup);
+ static std::string clearProjectGroup(const std::string& origin,
+ const std::string& projectGroup);
+
+ public:
+ static const char* VIRTUAL_APPGROUP_PREFIX;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/common/dataBlock.cpp b/rocketmq-cpp/src/common/dataBlock.cpp
new file mode 100644
index 00000000..19162710
--- /dev/null
+++ b/rocketmq-cpp/src/common/dataBlock.cpp
@@ -0,0 +1,173 @@
+#include "dataBlock.h"
+#include <algorithm>
+
+namespace rocketmq {
+MemoryBlock::MemoryBlock() : size(0), data(NULL) {}
+
+MemoryBlock::MemoryBlock(const int initialSize, const bool initialiseToZero)
+ : size(0), data(NULL) {
+ if (initialSize > 0) {
+ size = initialSize;
+ data = static_cast<char*>(initialiseToZero
+ ? std::calloc(initialSize, sizeof(char))
+ : std::malloc(initialSize * sizeof(char)));
+ }
+}
+
+MemoryBlock::MemoryBlock(const void* const dataToInitialiseFrom,
+ const size_t sizeInBytes)
+ : size(sizeInBytes), data(NULL) {
+ if (size > 0) {
+ data = static_cast<char*>(std::malloc(size * sizeof(char)));
+
+ if (dataToInitialiseFrom != NULL) memcpy(data, dataToInitialiseFrom, size);
+ }
+}
+
+MemoryBlock::MemoryBlock(const MemoryBlock& other)
+ : size(other.size), data(NULL) {
+ if (size > 0) {
+ data = static_cast<char*>(std::malloc(size * sizeof(char)));
+ memcpy(data, other.data, size);
+ }
+}
+
+MemoryBlock::~MemoryBlock() { std::free(data); }
+
+MemoryBlock& MemoryBlock::operator=(const MemoryBlock& other) {
+ if (this != &other) {
+ setSize(other.size, false);
+ memcpy(data, other.data, size);
+ }
+
+ return *this;
+}
+
+//==============================================================================
+bool MemoryBlock::operator==(const MemoryBlock& other) const {
+ return matches(other.data, other.size);
+}
+
+bool MemoryBlock::operator!=(const MemoryBlock& other) const {
+ return !operator==(other);
+}
+
+bool MemoryBlock::matches(const void* dataToCompare, int dataSize) const {
+ return size == dataSize && memcmp(data, dataToCompare, size) == 0;
+}
+
+//==============================================================================
+// this will resize the block to this size
+void MemoryBlock::setSize(const int newSize, const bool initialiseToZero) {
+ if (size != newSize) {
+ if (newSize <= 0) {
+ reset();
+ } else {
+ if (data != NULL) {
+ data = static_cast<char*>(
+ data == NULL ? std::malloc(newSize * sizeof(char))
+ : std::realloc(data, newSize * sizeof(char)));
+
+ if (initialiseToZero && (newSize > size))
+ memset(data + size, 0, newSize - size);
+ } else {
+ std::free(data);
+ data = static_cast<char*>(initialiseToZero
+ ? std::calloc(newSize, sizeof(char))
+ : std::malloc(newSize * sizeof(char)));
+ }
+
+ size = newSize;
+ }
+ }
+}
+
+void MemoryBlock::reset() {
+ std::free(data);
+ data = NULL;
+ size = 0;
+}
+
+void MemoryBlock::ensureSize(const int minimumSize,
+ const bool initialiseToZero) {
+ if (size < minimumSize) setSize(minimumSize, initialiseToZero);
+}
+
+//==============================================================================
+void MemoryBlock::fillWith(const int value) { memset(data, (int)value, size); }
+
+void MemoryBlock::append(const void* const srcData, const int numBytes) {
+ if (numBytes > 0) {
+ const int oldSize = size;
+ setSize(size + numBytes);
+ memcpy(data + oldSize, srcData, numBytes);
+ }
+}
+
+void MemoryBlock::replaceWith(const void* const srcData, const int numBytes) {
+ if (numBytes > 0) {
+ setSize(numBytes);
+ memcpy(data, srcData, numBytes);
+ }
+}
+
+void MemoryBlock::insert(const void* const srcData, const int numBytes,
+ int insertPosition) {
+ if (numBytes > 0) {
+ insertPosition = std::min(insertPosition, size);
+ const int trailingDataSize = size - insertPosition;
+ setSize(size + numBytes, false);
+
+ if (trailingDataSize > 0)
+ memmove(data + insertPosition + numBytes, data + insertPosition,
+ trailingDataSize);
+
+ memcpy(data + insertPosition, srcData, numBytes);
+ }
+}
+
+void MemoryBlock::removeSection(const int startByte,
+ const int numBytesToRemove) {
+ if (startByte + numBytesToRemove >= size) {
+ setSize(startByte);
+ } else if (numBytesToRemove > 0) {
+ memmove(data + startByte, data + startByte + numBytesToRemove,
+ size - (startByte + numBytesToRemove));
+
+ setSize(size - numBytesToRemove);
+ }
+}
+
+void MemoryBlock::copyFrom(const void* const src, int offset, int num) {
+ const char* d = static_cast<const char*>(src);
+
+ if (offset < 0) {
+ d -= offset;
+ num += (size_t)-offset;
+ offset = 0;
+ }
+
+ if ((size_t)offset + num > (unsigned int)size) num = size - (size_t)offset;
+
+ if (num > 0) memcpy(data + offset, d, num);
+}
+
+void MemoryBlock::copyTo(void* const dst, int offset, int num) const {
+ char* d = static_cast<char*>(dst);
+
+ if (offset < 0) {
+ memset(d, 0, (size_t)-offset);
+ d -= offset;
+ num -= (size_t)-offset;
+ offset = 0;
+ }
+
+ if ((size_t)offset + num > (unsigned int)size) {
+ const int newNum = (size_t)size - (size_t)offset;
+ memset(d + newNum, 0, num - newNum);
+ num = newNum;
+ }
+
+ if (num > 0) memcpy(d, data + offset, num);
+}
+}
diff --git a/rocketmq-cpp/src/common/dataBlock.h b/rocketmq-cpp/src/common/dataBlock.h
new file mode 100755
index 00000000..b86404aa
--- /dev/null
+++ b/rocketmq-cpp/src/common/dataBlock.h
@@ -0,0 +1,185 @@
+#ifndef __DATABLOCK_H__
+#define __DATABLOCK_H__
+
+#include <cstdlib>
+#include <cstring>
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+
+class ROCKETMQCLIENT_API MemoryBlock {
+ public:
+ //==============================================================================
+ /** Create an uninitialised block with 0 size. */
+ MemoryBlock();
+
+ /** Creates a memory block with a given initial size.
+
+ @param initialSize the size of block to create
+ @param initialiseToZero whether to clear the memory or just leave it
+ uninitialised
+ */
+ MemoryBlock(const int initialSize, bool initialiseToZero = false);
+
+ /** Creates a memory block using a copy of a block of data.
+
+ @param dataToInitialiseFrom some data to copy into this block
+ @param sizeInBytes how much space to use
+ */
+ MemoryBlock(const void* dataToInitialiseFrom, size_t sizeInBytes);
+
+ /** Creates a copy of another memory block. */
+ MemoryBlock(const MemoryBlock&);
+
+ /** Destructor. */
+ ~MemoryBlock();
+
+ /** Copies another memory block onto this one.
+ This block will be resized and copied to exactly match the other one.
+ */
+ MemoryBlock& operator=(const MemoryBlock&);
+
+ //==============================================================================
+ /** Compares two memory blocks.
+ @returns true only if the two blocks are the same size and have identical
+ contents.
+ */
+ bool operator==(const MemoryBlock& other) const;
+
+ /** Compares two memory blocks.
+ @returns true if the two blocks are different sizes or have different
+ contents.
+ */
+ bool operator!=(const MemoryBlock& other) const;
+
+ //==============================================================================
+ /** Returns a void pointer to the data.
+
+ Note that the pointer returned will probably become invalid when the
+ block is resized.
+ */
+ void* getData() const { return data; }
+
+ /** Returns a byte from the memory block.
+ This returns a reference, so you can also use it to set a byte.
+ */
+ template <typename Type>
+ char& operator[](const Type offset) const {
+ return data[offset];
+ }
+
+ /** Returns true if the data in this MemoryBlock matches the raw bytes
+ * passed-in. */
+ bool matches(const void* data, int dataSize) const;
+
+ //==============================================================================
+ /** Returns the block's current allocated size, in bytes. */
+ int getSize() const { return size; }
+
+ /** Resizes the memory block.
+
+ Any data that is present in both the old and new sizes will be retained.
+ When enlarging the block, the new space that is allocated at the end can
+ either be
+ cleared, or left uninitialised.
+
+ @param newSize the new desired size for the block
+ @param initialiseNewSpaceToZero if the block gets enlarged, this
+ determines
+ whether to clear the new section or
+ just leave it
+ uninitialised
+ @see ensureSize
+ */
+ void setSize(const int newSize, bool initialiseNewSpaceToZero = false);
+
+ /** Increases the block's size only if it's smaller than a given size.
+
+ @param minimumSize if the block is already bigger than
+ this size, no action
+ will be taken; otherwise it will be
+ increased to this size
+ @param initialiseNewSpaceToZero if the block gets enlarged, this
+ determines
+ whether to clear the new section or
+ just leave it
+ uninitialised
+ @see setSize
+ */
+ void ensureSize(const int minimumSize, bool initialiseNewSpaceToZero = false);
+
+ /** Frees all the blocks data, setting its size to 0. */
+ void reset();
+
+ //==============================================================================
+ /** Fills the entire memory block with a repeated byte value.
+ This is handy for clearing a block of memory to zero.
+ */
+ void fillWith(int valueToUse);
+
+ /** Adds another block of data to the end of this one.
+ The data pointer must not be null. This block's size will be increased
+ accordingly.
+ */
+ void append(const void* data, int numBytes);
+
+ /** Resizes this block to the given size and fills its contents from the
+ supplied buffer.
+ The data pointer must not be null.
+ */
+ void replaceWith(const void* data, int numBytes);
+
+ /** Inserts some data into the block.
+ The dataToInsert pointer must not be null. This block's size will be
+ increased accordingly.
+ If the insert position lies outside the valid range of the block, it will
+ be clipped to
+ within the range before being used.
+ */
+ void insert(const void* dataToInsert, int numBytesToInsert,
+ int insertPosition);
+
+ /** Chops out a section of the block.
+
+ This will remove a section of the memory block and close the gap around
+ it,
+ shifting any subsequent data downwards and reducing the size of the block.
+
+ If the range specified goes beyond the size of the block, it will be
+ clipped.
+ */
+ void removeSection(int startByte, int numBytesToRemove);
+
+ //==============================================================================
+ /** Copies data into this MemoryBlock from a memory address.
+
+ @param srcData the memory location of the data to copy into
+ this block
+ @param destinationOffset the offset in this block at which the data
+ being copied should begin
+ @param numBytes how much to copy in (if this goes beyond the
+ size of the memory block,
+ it will be clipped so not to do anything
+ nasty)
+ */
+ void copyFrom(const void* srcData, int destinationOffset, int numBytes);
+
+ /** Copies data from this MemoryBlock to a memory address.
+
+ @param destData the memory location to write to
+ @param sourceOffset the offset within this block from which the copied
+ data will be read
+ @param numBytes how much to copy (if this extends beyond the
+ limits of the memory block,
+ zeros will be used for that portion of the data)
+ */
+ void copyTo(void* destData, int sourceOffset, int numBytes) const;
+
+ private:
+ //==============================================================================
+ int size;
+ char* data;
+};
+}
+
+#endif
diff --git a/rocketmq-cpp/src/common/sync_http_client.cpp b/rocketmq-cpp/src/common/sync_http_client.cpp
new file mode 100755
index 00000000..f07ac0d9
--- /dev/null
+++ b/rocketmq-cpp/src/common/sync_http_client.cpp
@@ -0,0 +1,156 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include <boost/asio.hpp>
+#include <boost/bind.hpp>
+#include <boost/lambda/bind.hpp>
+#include <boost/lambda/lambda.hpp>
+#include <iostream>
+#include <istream>
+#include <ostream>
+#include <string>
+
+#include "Logging.h"
+#include "url.h"
+
+using boost::lambda::var;
+using boost::asio::ip::tcp;
+using boost::asio::deadline_timer;
+
+namespace {
+void check_deadline(deadline_timer* deadline, tcp::socket* socket,
+ const boost::system::error_code& ec) {
+ // Check whether the deadline has passed. We compare the deadline against
+ // the current time since a new asynchronous operation may have moved the
+ // deadline before this actor had a chance to run.
+ if (deadline->expires_at() <= deadline_timer::traits_type::now()) {
+ // The deadline has passed. The socket is closed so that any outstanding
+ // asynchronous operations are cancelled. This allows the blocked
+ // connect(), read_line() or write_line() functions to return.
+ boost::system::error_code ignored_ec;
+ socket->close(ignored_ec);
+
+ // There is no longer an active deadline. The expiry is set to positive
+ // infinity so that the actor takes no action until a new deadline is set.
+ deadline->expires_at(boost::posix_time::pos_infin);
+ }
+
+ // Put the actor back to sleep.
+ deadline->async_wait(boost::bind(&check_deadline, deadline, socket,
+ boost::asio::placeholders::error));
+}
+} // namespace
+
+namespace rocketmq {
+bool SyncfetchNsAddr(const Url& url_s, std::string& body) {
+ bool ret = true;
+ try {
+ boost::asio::io_service io_service;
+ // Get a list of endpoints corresponding to the server name.
+ tcp::resolver resolver(io_service);
+ tcp::resolver::query query(url_s.host_, url_s.port_);
+ tcp::resolver::iterator endpoint_iterator = resolver.resolve(query);
+ boost::system::error_code ec = boost::asio::error::would_block;
+ deadline_timer deadline(io_service);
+ // TODO hardcode
+ boost::posix_time::seconds timeout(3);
+ deadline.expires_from_now(timeout);
+ // Try each endpoint until we successfully establish a connection.
+ tcp::socket socket(io_service);
+ boost::system::error_code deadline_ec;
+ check_deadline(&deadline, &socket, deadline_ec);
+
+ boost::asio::async_connect(socket, endpoint_iterator,
+ boost::lambda::var(ec) = boost::lambda::_1);
+
+ do {
+ io_service.run_one();
+ } while (ec == boost::asio::error::would_block);
+
+ if (ec || !socket.is_open()) {
+ LOG_ERROR("socket connect failure, connect timeout or connect failure");
+ return false;
+ }
+
+ // Form the request. We specify the "Connection: close" header so that the
+ // server will close the socket after transmitting the response. This will
+ // allow us to treat all data up until the EOF as the content.
+ boost::asio::streambuf request;
+ std::ostream request_stream(&request);
+ request_stream << "GET " << url_s.path_ << " HTTP/1.0\r\n";
+ request_stream << "Host: " << url_s.host_ << "\r\n";
+ request_stream << "Accept: */*\r\n";
+ request_stream << "Connection: close\r\n\r\n";
+
+ // Send the request.
+ boost::asio::write(socket, request);
+
+ // Read the response status line. The response streambuf will automatically
+ // grow to accommodate the entire line. The growth may be limited by passing
+ // a maximum size to the streambuf constructor.
+ boost::asio::streambuf response;
+ boost::asio::read_until(socket, response, "\r\n");
+
+ // Check that response is OK.
+ std::istream response_stream(&response);
+ std::string http_version;
+ response_stream >> http_version;
+ unsigned int status_code;
+ response_stream >> status_code;
+ std::string status_message;
+ std::getline(response_stream, status_message);
+ if (!response_stream || http_version.substr(0, 5) != "HTTP/") {
+ LOG_INFO("Invalid response %s\n", status_message.c_str());
+ return false;
+ }
+
+ if (status_code != 200) {
+ LOG_INFO("Response returned with status code %d ", status_code);
+ return false;
+ }
+
+ // Read the response headers, which are terminated by a blank line.
+ boost::asio::read_until(socket, response, "\r\n\r\n");
+
+ // Process the response headers.
+ std::string header;
+ while (std::getline(response_stream, header) && header != "\r")
+ ;
+
+ // Write whatever content we already have to output.
+ if (response.size() > 0) {
+ boost::asio::streambuf::const_buffers_type cbt = response.data();
+ body.clear();
+ body.insert(body.begin(), boost::asio::buffers_begin(cbt),
+ boost::asio::buffers_end(cbt));
+ }
+
+ // Read until EOF, writing data to output as we go.
+ boost::system::error_code error;
+ while (boost::asio::read(socket, response,
+ boost::asio::transfer_at_least(1), error))
+ std::cout << &response;
+ if (error != boost::asio::error::eof)
+ throw boost::system::system_error(error);
+
+ } catch (std::exception& e) {
+ LOG_ERROR("Exception: %s", e.what());
+ ret = false;
+ }
+
+ return ret;
+}
+} // end of namespace ons
diff --git a/rocketmq-cpp/src/common/sync_http_client.h b/rocketmq-cpp/src/common/sync_http_client.h
new file mode 100755
index 00000000..b25cc77d
--- /dev/null
+++ b/rocketmq-cpp/src/common/sync_http_client.h
@@ -0,0 +1,29 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef ROCKETMQ_CLIENT4CPP__SYNC_HTTP_CLIENT_H_
+#define ROCKETMQ_CLIENT4CPP_SYNC_HTTP_CLIENT_H_
+
+#include <string>
+
+namespace rocketmq {
+class Url;
+
+extern bool SyncfetchNsAddr(const Url& url_s, std::string& body);
+
+} // namespace ons
+
+#endif // ROCKETMQ_CLIENT4CPP__SYNC_HTTP_CLIENT_H_
diff --git a/rocketmq-cpp/src/common/url.cpp b/rocketmq-cpp/src/common/url.cpp
new file mode 100755
index 00000000..348f27a3
--- /dev/null
+++ b/rocketmq-cpp/src/common/url.cpp
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "url.h"
+#include <algorithm>
+#include <cctype>
+#include <functional>
+#include <iterator>
+#include <string>
+
+namespace rocketmq {
+
+Url::Url(const std::string& url_s) { parse(url_s); }
+
+void Url::parse(const std::string& url_s) {
+ const std::string prot_end("://");
+ auto prot_i =
+ std::search(url_s.begin(), url_s.end(), prot_end.begin(), prot_end.end());
+ protocol_.reserve(std::distance(url_s.begin(), prot_i));
+ std::transform(url_s.begin(), prot_i, std::back_inserter(protocol_),
+ std::ptr_fun<int, int>(tolower)); // protocol is icase
+
+ if (prot_i == url_s.end()) return;
+
+ std::advance(prot_i, prot_end.length());
+
+ auto path_i = find(prot_i, url_s.end(), ':');
+ std::string::const_iterator path_end_i;
+ if (path_i == url_s.end()) {
+ // not include port, use default port
+ port_ = "80";
+ path_i = std::find(prot_i, url_s.end(), '/');
+ path_end_i = path_i;
+ } else {
+ auto port_i = find(path_i + 1, url_s.end(), '/');
+ port_.insert(port_.begin(), path_i + 1, port_i);
+ path_end_i = path_i + port_.length() + 1;
+ }
+
+ host_.reserve(distance(prot_i, path_i));
+ std::transform(prot_i, path_i, std::back_inserter(host_),
+ std::ptr_fun<int, int>(tolower)); // host is icase}
+
+ auto query_i = find(path_end_i, url_s.end(), '?');
+ path_.assign(path_end_i, query_i);
+ if (query_i != url_s.end()) ++query_i;
+ query_.assign(query_i, url_s.end());
+}
+
+} // namespace ons
diff --git a/rocketmq-cpp/src/common/url.h b/rocketmq-cpp/src/common/url.h
new file mode 100755
index 00000000..0fbcb85f
--- /dev/null
+++ b/rocketmq-cpp/src/common/url.h
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef ROCKETMQ_CLIENT4CPP_URL_HH_
+#define ROCKETMQ_CLIENT4CPP_URL_HH_
+
+#include <string>
+
+namespace rocketmq {
+class Url {
+ public:
+ Url(const std::string& url_s); // omitted copy, ==, accessors, ...
+
+ private:
+ void parse(const std::string& url_s);
+
+ public:
+ std::string protocol_;
+ std::string host_;
+ std::string port_;
+ std::string path_;
+ std::string query_;
+};
+}
+#endif // ROCKETMQ_CLIENT4CPP_URL_HH_
diff --git a/rocketmq-cpp/src/consumer/AllocateMQStrategy.h b/rocketmq-cpp/src/consumer/AllocateMQStrategy.h
new file mode 100755
index 00000000..f77cff77
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/AllocateMQStrategy.h
@@ -0,0 +1,98 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __ALLOCATEMESSAGEQUEUESTRATEGY_H__
+#define __ALLOCATEMESSAGEQUEUESTRATEGY_H__
+
+#include "Logging.h"
+#include "MQClientException.h"
+#include "MQMessageQueue.h"
+#include "RocketMQClient.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class AllocateMQStrategy {
+ public:
+ virtual ~AllocateMQStrategy() {}
+ virtual void allocate(const std::string& currentCID, std::vector<MQMessageQueue>& mqAll,
+ std::vector<std::string>& cidAll,
+ std::vector<MQMessageQueue>& outReuslt) = 0;
+};
+
+//<!************************************************************************
+class AllocateMQAveragely : public AllocateMQStrategy {
+ public:
+ virtual ~AllocateMQAveragely() {}
+ virtual void allocate(const std::string& currentCID, std::vector<MQMessageQueue>& mqAll,
+ std::vector<std::string>& cidAll,
+ std::vector<MQMessageQueue>& outReuslt) {
+ outReuslt.clear();
+ if (currentCID.empty()) {
+ THROW_MQEXCEPTION(MQClientException, "currentCID is empty", -1);
+ }
+
+ if (mqAll.empty()) {
+ THROW_MQEXCEPTION(MQClientException, "mqAll is empty", -1);
+ }
+
+ if (cidAll.empty()) {
+ THROW_MQEXCEPTION(MQClientException, "cidAll is empty", -1);
+ }
+
+ int index = -1;
+ int cidAllSize = cidAll.size();
+ for (int i = 0; i < cidAllSize; i++) {
+ if (cidAll[i] == currentCID) {
+ index = i;
+ break;
+ }
+ }
+
+ if (index == -1) {
+ LOG_ERROR("could not find clientId from Broker");
+ return;
+ }
+
+ int mqAllSize = mqAll.size();
+ int mod = mqAllSize % cidAllSize;
+ int averageSize = mqAllSize <= cidAllSize
+ ? 1
+ : (mod > 0 && index < mod ? mqAllSize / cidAllSize + 1
+ : mqAllSize / cidAllSize);
+ int startIndex = (mod > 0 && index < mod) ? index * averageSize
+ : index * averageSize + mod;
+ int range = std::min(averageSize, mqAllSize - startIndex);
+ LOG_INFO(
+ "range is:%d, index is:%d, mqAllSize is:%d, averageSize is:%d, "
+ "startIndex is:%d",
+ range, index, mqAllSize, averageSize, startIndex);
+ //<!out;
+ if (range >= 0) // example: range is:-1, index is:1, mqAllSize is:1,
+ // averageSize is:1, startIndex is:2
+ {
+ for (int i = 0; i < range; i++) {
+ if ((startIndex + i) >= 0) {
+ outReuslt.push_back(mqAll.at((startIndex + i) % mqAllSize));
+ }
+ }
+ }
+ }
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/consumer/ConsumeMessageConcurrentlyService.cpp b/rocketmq-cpp/src/consumer/ConsumeMessageConcurrentlyService.cpp
new file mode 100755
index 00000000..0a457c77
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/ConsumeMessageConcurrentlyService.cpp
@@ -0,0 +1,147 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include <sys/prctl.h>
+#include "ConsumeMsgService.h"
+#include "DefaultMQPushConsumer.h"
+#include "Logging.h"
+#include "UtilAll.h"
+namespace rocketmq {
+
+//<!************************************************************************
+ConsumeMessageConcurrentlyService::ConsumeMessageConcurrentlyService(
+ MQConsumer* consumer, int threadCount, MQMessageListener* msgListener)
+ : m_pConsumer(consumer),
+ m_pMessageListener(msgListener),
+ m_ioServiceWork(m_ioService) {
+ string taskName = UtilAll::getProcessName();
+ prctl(PR_SET_NAME, "ConsumeTP", 0, 0, 0);
+ for (int i = 0; i != threadCount; ++i) {
+ m_threadpool.create_thread(
+ boost::bind(&boost::asio::io_service::run, &m_ioService));
+ }
+ prctl(PR_SET_NAME, taskName.c_str(), 0, 0, 0);
+}
+
+ConsumeMessageConcurrentlyService::~ConsumeMessageConcurrentlyService(void) {
+ m_pConsumer = NULL;
+ m_pMessageListener = NULL;
+}
+
+void ConsumeMessageConcurrentlyService::start() {}
+
+void ConsumeMessageConcurrentlyService::shutdown() { stopThreadPool(); }
+
+void ConsumeMessageConcurrentlyService::stopThreadPool() {
+ m_ioService.stop();
+ m_threadpool.join_all();
+}
+
+MessageListenerType
+ConsumeMessageConcurrentlyService::getConsumeMsgSerivceListenerType() {
+ return m_pMessageListener->getMessageListenerType();
+}
+
+void ConsumeMessageConcurrentlyService::submitConsumeRequest(
+ PullRequest* request, vector<MQMessageExt>& msgs) {
+ m_ioService.post(boost::bind(
+ &ConsumeMessageConcurrentlyService::ConsumeRequest, this, request, msgs));
+}
+
+void ConsumeMessageConcurrentlyService::ConsumeRequest(
+ PullRequest* request, vector<MQMessageExt>& msgs) {
+ if (!request || request->isDroped()) {
+ LOG_WARN("the pull result is NULL or Had been dropped");
+ request->clearAllMsgs(); // add clear operation to avoid bad state when
+ // dropped pullRequest returns normal
+ return;
+ }
+
+ //<!��ȡ����;
+ if (msgs.empty()) {
+ LOG_WARN("the msg of pull result is NULL,its mq:%s",
+ (request->m_messageQueue).toString().c_str());
+ return;
+ }
+
+ ConsumeStatus status = CONSUME_SUCCESS;
+ if (m_pMessageListener != NULL) {
+ resetRetryTopic(msgs);
+ request->setLastConsumeTimestamp(UtilAll::currentTimeMillis());
+ status = m_pMessageListener->consumeMessage(msgs);
+ }
+
+ /*LOG_DEBUG("Consumed MSG size:%d of mq:%s",
+ msgs.size(), (request->m_messageQueue).toString().c_str());*/
+ int ackIndex = -1;
+ switch (status) {
+ case CONSUME_SUCCESS:
+ ackIndex = msgs.size();
+ break;
+ case RECONSUME_LATER:
+ ackIndex = -1;
+ break;
+ default:
+ break;
+ }
+
+ switch (m_pConsumer->getMessageModel()) {
+ case BROADCASTING:
+ //Note: broadcasting reconsume should do by application, as it has big affect to broker cluster
+ LOG_WARN("BROADCASTING, the message consume failed, drop it:%s", (request->m_messageQueue).toString().c_str());
+ break;
+ case CLUSTERING:
+ //send back msg to broker;
+ for (size_t i = ackIndex + 1; i < msgs.size(); i++) {
+ LOG_WARN(
+ "consume fail, MQ is:%s, its msgId is:%s, index is:%zu, reconsume "
+ "times is:%d",
+ (request->m_messageQueue).toString().c_str(),
+ msgs[i].getMsgId().c_str(), i, msgs[i].getReconsumeTimes());
+ m_pConsumer->sendMessageBack(msgs[i], 0);
+ }
+ break;
+ default:
+ break;
+ }
+
+ //update offset
+ int64 offset = request->removeMessage(msgs);
+ // LOG_DEBUG("update offset:%lld of mq: %s",
+ // offset,(request->m_messageQueue).toString().c_str());
+ if (offset >= 0) {
+ m_pConsumer->updateConsumeOffset(request->m_messageQueue, offset);
+ } else {
+ LOG_WARN("Note: accumulation consume occurs on mq:%s",
+ (request->m_messageQueue).toString().c_str());
+ }
+}
+
+void ConsumeMessageConcurrentlyService::resetRetryTopic(
+ vector<MQMessageExt>& msgs) {
+ string groupTopic = UtilAll::getRetryTopic(m_pConsumer->getGroupName());
+ for (size_t i = 0; i < msgs.size(); i++) {
+ MQMessageExt& msg = msgs[i];
+ string retryTopic = msg.getProperty(MQMessage::PROPERTY_RETRY_TOPIC);
+ if (!retryTopic.empty() && groupTopic.compare(msg.getTopic()) == 0) {
+ msg.setTopic(retryTopic);
+ }
+ }
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/ConsumeMessageOrderlyService.cpp b/rocketmq-cpp/src/consumer/ConsumeMessageOrderlyService.cpp
new file mode 100755
index 00000000..a336b724
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/ConsumeMessageOrderlyService.cpp
@@ -0,0 +1,214 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include <sys/prctl.h>
+#include "ConsumeMsgService.h"
+#include "DefaultMQPushConsumer.h"
+#include "Logging.h"
+#include "Rebalance.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+
+//<!***************************************************************************
+ConsumeMessageOrderlyService::ConsumeMessageOrderlyService(
+ MQConsumer* consumer, int threadCount, MQMessageListener* msgListener)
+ : m_pConsumer(consumer),
+ m_shutdownInprogress(false),
+ m_pMessageListener(msgListener),
+ m_MaxTimeConsumeContinuously(60 * 1000),
+ m_ioServiceWork(m_ioService),
+ m_async_service_thread(NULL) {
+ string taskName = UtilAll::getProcessName();
+ prctl(PR_SET_NAME, "oderlyConsumeTP", 0, 0, 0);
+ for (int i = 0; i != threadCount; ++i) {
+ m_threadpool.create_thread(
+ boost::bind(&boost::asio::io_service::run, &m_ioService));
+ }
+ prctl(PR_SET_NAME, taskName.c_str(), 0, 0, 0);
+
+}
+
+void ConsumeMessageOrderlyService::boost_asio_work() {
+ LOG_INFO("ConsumeMessageOrderlyService::boost asio async service runing");
+ boost::asio::io_service::work work(m_async_ioService); // avoid async io
+ // service stops after
+ // first timer timeout
+ // callback
+ boost::system::error_code ec;
+ boost::asio::deadline_timer t(m_async_ioService,
+ boost::posix_time::milliseconds(PullRequest::RebalanceLockInterval));
+ t.async_wait(
+ boost::bind(&ConsumeMessageOrderlyService::lockMQPeriodically, this, ec, &t));
+
+ m_async_ioService.run();
+}
+
+ConsumeMessageOrderlyService::~ConsumeMessageOrderlyService(void) {
+ m_pConsumer = NULL;
+ m_pMessageListener = NULL;
+}
+
+void ConsumeMessageOrderlyService::start() {
+ m_async_service_thread.reset(new boost::thread(
+ boost::bind(&ConsumeMessageOrderlyService::boost_asio_work, this)));
+}
+
+void ConsumeMessageOrderlyService::shutdown() {
+ stopThreadPool();
+ unlockAllMQ();
+}
+
+void ConsumeMessageOrderlyService::lockMQPeriodically(
+ boost::system::error_code& ec, boost::asio::deadline_timer* t) {
+ m_pConsumer->getRebalance()->lockAll();
+
+ boost::system::error_code e;
+ t->expires_at(t->expires_at() + boost::posix_time::milliseconds(PullRequest::RebalanceLockInterval), e);
+ t->async_wait(boost::bind(&ConsumeMessageOrderlyService::lockMQPeriodically,
+ this, ec, t));
+}
+
+void ConsumeMessageOrderlyService::unlockAllMQ() {
+ m_pConsumer->getRebalance()->unlockAll(false);
+}
+
+bool ConsumeMessageOrderlyService::lockOneMQ(const MQMessageQueue& mq) {
+ return m_pConsumer->getRebalance()->lock(mq);
+}
+
+void ConsumeMessageOrderlyService::stopThreadPool() {
+ m_shutdownInprogress = true;
+ m_ioService.stop();
+ m_async_ioService.stop();
+ m_async_service_thread->interrupt();
+ m_async_service_thread->join();
+ m_threadpool.join_all();
+}
+
+MessageListenerType
+ConsumeMessageOrderlyService::getConsumeMsgSerivceListenerType() {
+ return m_pMessageListener->getMessageListenerType();
+}
+
+void ConsumeMessageOrderlyService::submitConsumeRequest(
+ PullRequest* request, vector<MQMessageExt>& msgs) {
+ m_ioService.post(boost::bind(&ConsumeMessageOrderlyService::ConsumeRequest,
+ this, request));
+}
+
+void ConsumeMessageOrderlyService::static_submitConsumeRequestLater(
+ void* context, PullRequest* request, bool tryLockMQ,
+ boost::asio::deadline_timer* t) {
+ LOG_INFO("submit consumeRequest later for mq:%s",
+ request->m_messageQueue.toString().c_str());
+ vector<MQMessageExt> msgs;
+ ConsumeMessageOrderlyService* orderlyService =
+ (ConsumeMessageOrderlyService*)context;
+ orderlyService->submitConsumeRequest(request, msgs);
+ if (tryLockMQ) {
+ orderlyService->lockOneMQ(request->m_messageQueue);
+ }
+ if (t) deleteAndZero(t);
+}
+
+void ConsumeMessageOrderlyService::ConsumeRequest(PullRequest* request) {
+ bool bGetMutex = false;
+ boost::unique_lock<boost::timed_mutex> lock(
+ request->getPullRequestCriticalSection(), boost::try_to_lock);
+ if (!lock.owns_lock()) {
+ if (!lock.timed_lock(boost::get_system_time() +
+ boost::posix_time::seconds(1))) {
+ LOG_ERROR("ConsumeRequest of:%s get timed_mutex timeout",
+ request->m_messageQueue.toString().c_str());
+ return;
+ } else {
+ bGetMutex = true;
+ }
+ } else {
+ bGetMutex = true;
+ }
+ if (!bGetMutex) {
+ // LOG_INFO("pullrequest of mq:%s consume inprogress",
+ // request->m_messageQueue.toString().c_str());
+ return;
+ }
+ if (!request || request->isDroped()) {
+ LOG_WARN("the pull result is NULL or Had been dropped");
+ request->clearAllMsgs(); // add clear operation to avoid bad state when
+ // dropped pullRequest returns normal
+ return;
+ }
+
+ if (m_pMessageListener) {
+ if ((request->isLocked() && !request->isLockExpired()) ||
+ m_pConsumer->getMessageModel() == BROADCASTING) {
+ DefaultMQPushConsumer* pConsumer = (DefaultMQPushConsumer*)m_pConsumer;
+ uint64_t beginTime = UtilAll::currentTimeMillis();
+ bool continueConsume = true;
+ while (continueConsume) {
+ if ((UtilAll::currentTimeMillis() - beginTime) >
+ m_MaxTimeConsumeContinuously) {
+ LOG_INFO(
+ "continuely consume message queue:%s more than 60s, consume it "
+ "later",
+ request->m_messageQueue.toString().c_str());
+ tryLockLaterAndReconsume(request, false);
+ break;
+ }
+ vector<MQMessageExt> msgs;
+ request->takeMessages(msgs, pConsumer->getConsumeMessageBatchMaxSize());
+ if (!msgs.empty()) {
+ request->setLastConsumeTimestamp(UtilAll::currentTimeMillis());
+ ConsumeStatus consumeStatus =
+ m_pMessageListener->consumeMessage(msgs);
+ if (consumeStatus == RECONSUME_LATER) {
+ request->makeMessageToCosumeAgain(msgs);
+ continueConsume = false;
+ tryLockLaterAndReconsume(request, false);
+ } else {
+ m_pConsumer->updateConsumeOffset(request->m_messageQueue,
+ request->commit());
+ }
+ } else {
+ continueConsume = false;
+ }
+ msgs.clear();
+ if (m_shutdownInprogress) {
+ LOG_INFO("shutdown inprogress, break the consuming");
+ return;
+ }
+ }
+ LOG_DEBUG("consume once exit of mq:%s",
+ request->m_messageQueue.toString().c_str());
+ } else {
+ LOG_ERROR("message queue:%s was not locked",
+ request->m_messageQueue.toString().c_str());
+ tryLockLaterAndReconsume(request, true);
+ }
+ }
+}
+void ConsumeMessageOrderlyService::tryLockLaterAndReconsume(
+ PullRequest* request, bool tryLockMQ) {
+ int retryTimer = tryLockMQ ? 500 : 100;
+ boost::asio::deadline_timer* t = new boost::asio::deadline_timer(
+ m_async_ioService, boost::posix_time::milliseconds(retryTimer));
+ t->async_wait(boost::bind(
+ &(ConsumeMessageOrderlyService::static_submitConsumeRequestLater), this,
+ request, tryLockMQ, t));
+}
+}
diff --git a/rocketmq-cpp/src/consumer/ConsumeMsgService.h b/rocketmq-cpp/src/consumer/ConsumeMsgService.h
new file mode 100755
index 00000000..5878cb46
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/ConsumeMsgService.h
@@ -0,0 +1,112 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef _CONSUMEMESSAGESERVICE_H_
+#define _CONSUMEMESSAGESERVICE_H_
+
+#include <boost/asio.hpp>
+#include <boost/asio/io_service.hpp>
+#include <boost/bind.hpp>
+#include <boost/date_time/posix_time/posix_time.hpp>
+#include <boost/scoped_ptr.hpp>
+#include <boost/thread/thread.hpp>
+#include "Logging.h"
+#include "MQMessageListener.h"
+#include "PullRequest.h"
+
+namespace rocketmq {
+class MQConsumer;
+//<!***************************************************************************
+class ConsumeMsgService {
+ public:
+ ConsumeMsgService() {}
+ virtual ~ConsumeMsgService() {}
+ virtual void start() {}
+ virtual void shutdown() {}
+ virtual void stopThreadPool() {}
+ virtual void submitConsumeRequest(PullRequest* request,
+ vector<MQMessageExt>& msgs) {}
+ virtual MessageListenerType getConsumeMsgSerivceListenerType() {
+ return messageListenerDefaultly;
+ }
+};
+
+class ConsumeMessageConcurrentlyService : public ConsumeMsgService {
+ public:
+ ConsumeMessageConcurrentlyService(MQConsumer*, int threadCount,
+ MQMessageListener* msgListener);
+ virtual ~ConsumeMessageConcurrentlyService();
+ virtual void start();
+ virtual void shutdown();
+ virtual void submitConsumeRequest(PullRequest* request,
+ vector<MQMessageExt>& msgs);
+ virtual MessageListenerType getConsumeMsgSerivceListenerType();
+ virtual void stopThreadPool();
+
+ void ConsumeRequest(PullRequest* request, vector<MQMessageExt>& msgs);
+
+ private:
+ void resetRetryTopic(vector<MQMessageExt>& msgs);
+
+ private:
+ MQConsumer* m_pConsumer;
+ MQMessageListener* m_pMessageListener;
+ boost::asio::io_service m_ioService;
+ boost::thread_group m_threadpool;
+ boost::asio::io_service::work m_ioServiceWork;
+};
+
+class ConsumeMessageOrderlyService : public ConsumeMsgService {
+ public:
+ ConsumeMessageOrderlyService(MQConsumer*, int threadCount,
+ MQMessageListener* msgListener);
+ virtual ~ConsumeMessageOrderlyService();
+ virtual void start();
+ virtual void shutdown();
+ virtual void submitConsumeRequest(PullRequest* request,
+ vector<MQMessageExt>& msgs);
+ virtual void stopThreadPool();
+ virtual MessageListenerType getConsumeMsgSerivceListenerType();
+
+ void boost_asio_work();
+ void tryLockLaterAndReconsume(PullRequest* request, bool tryLockMQ);
+ static void static_submitConsumeRequestLater(void* context,
+ PullRequest* request,
+ bool tryLockMQ,
+ boost::asio::deadline_timer* t);
+ void ConsumeRequest(PullRequest* request);
+ void lockMQPeriodically(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t);
+ void unlockAllMQ();
+ bool lockOneMQ(const MQMessageQueue& mq);
+
+ private:
+ MQConsumer* m_pConsumer;
+ bool m_shutdownInprogress;
+ MQMessageListener* m_pMessageListener;
+ uint64_t m_MaxTimeConsumeContinuously;
+ boost::asio::io_service m_ioService;
+ boost::thread_group m_threadpool;
+ boost::asio::io_service::work m_ioServiceWork;
+ boost::asio::io_service m_async_ioService;
+ boost::scoped_ptr<boost::thread> m_async_service_thread;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+
+#endif //<! _CONSUMEMESSAGESERVICE_H_
diff --git a/rocketmq-cpp/src/consumer/DefaultMQPullConsumer.cpp b/rocketmq-cpp/src/consumer/DefaultMQPullConsumer.cpp
new file mode 100755
index 00000000..9ee2ac95
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/DefaultMQPullConsumer.cpp
@@ -0,0 +1,371 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "DefaultMQPullConsumer.h"
+#include "AsyncArg.h"
+#include "CommunicationMode.h"
+#include "FilterAPI.h"
+#include "Logging.h"
+#include "MQClientAPIImpl.h"
+#include "MQClientFactory.h"
+#include "MQClientManager.h"
+#include "MQProtos.h"
+#include "OffsetStore.h"
+#include "PullAPIWrapper.h"
+#include "PullSysFlag.h"
+#include "Rebalance.h"
+#include "Validators.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+DefaultMQPullConsumer::DefaultMQPullConsumer(const string& groupname)
+ : m_pMessageQueueListener(NULL),
+ m_pOffsetStore(NULL),
+ m_pRebalance(NULL),
+ m_pPullAPIWrapper(NULL)
+
+{
+ //<!set default group name;
+ string gname = groupname.empty() ? DEFAULT_CONSUMER_GROUP : groupname;
+ setGroupName(gname);
+
+ setMessageModel(BROADCASTING);
+}
+
+DefaultMQPullConsumer::~DefaultMQPullConsumer() {
+ m_pMessageQueueListener = NULL;
+ deleteAndZero(m_pRebalance);
+ deleteAndZero(m_pOffsetStore);
+ deleteAndZero(m_pPullAPIWrapper);
+}
+
+// MQConsumer
+//<!************************************************************************
+void DefaultMQPullConsumer::start() {
+ /* Ignore the SIGPIPE */
+ struct sigaction sa;
+ sa.sa_handler = SIG_IGN;
+ sa.sa_flags = 0;
+ sigaction(SIGPIPE, &sa, 0);
+
+ switch (m_serviceState) {
+ case CREATE_JUST: {
+ m_serviceState = START_FAILED;
+ MQClient::start();
+ LOG_INFO("DefaultMQPullConsumer:%s start", m_GroupName.c_str());
+
+ //<!create rebalance;
+ m_pRebalance = new RebalancePull(this, getFactory());
+
+ string groupname = getGroupName();
+ m_pPullAPIWrapper = new PullAPIWrapper(getFactory(), groupname);
+
+ //<!data;
+ checkConfig();
+ copySubscription();
+
+ //<! registe;
+ bool registerOK = getFactory()->registerConsumer(this);
+ if (!registerOK) {
+ m_serviceState = CREATE_JUST;
+ THROW_MQEXCEPTION(
+ MQClientException,
+ "The cousumer group[" + getGroupName() +
+ "] has been created before, specify another name please.",
+ -1);
+ }
+
+ //<!msg model;
+ switch (getMessageModel()) {
+ case BROADCASTING:
+ m_pOffsetStore = new LocalFileOffsetStore(groupname, getFactory());
+ break;
+ case CLUSTERING:
+ m_pOffsetStore = new RemoteBrokerOffsetStore(groupname, getFactory());
+ break;
+ }
+ m_pOffsetStore->load();
+
+ getFactory()->start();
+ m_serviceState = RUNNING;
+ break;
+ }
+ case RUNNING:
+ case START_FAILED:
+ case SHUTDOWN_ALREADY:
+ break;
+ default:
+ break;
+ }
+}
+
+void DefaultMQPullConsumer::shutdown() {
+ switch (m_serviceState) {
+ case RUNNING: {
+ LOG_INFO("DefaultMQPullConsumer:%s shutdown", m_GroupName.c_str());
+ persistConsumerOffset();
+ getFactory()->unregisterConsumer(this);
+ getFactory()->shutdown();
+ m_serviceState = SHUTDOWN_ALREADY;
+ break;
+ }
+ case SHUTDOWN_ALREADY:
+ case CREATE_JUST:
+ break;
+ default:
+ break;
+ }
+}
+
+void DefaultMQPullConsumer::sendMessageBack(MQMessageExt& msg, int delayLevel) {
+
+}
+
+void DefaultMQPullConsumer::fetchSubscribeMessageQueues(
+ const string& topic, vector<MQMessageQueue>& mqs) {
+ mqs.clear();
+ try {
+ getFactory()->fetchSubscribeMessageQueues(topic, mqs,
+ getSessionCredentials());
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+}
+
+void DefaultMQPullConsumer::updateTopicSubscribeInfo(
+ const string& topic, vector<MQMessageQueue>& info) {}
+
+void DefaultMQPullConsumer::registerMessageQueueListener(
+ const string& topic, MQueueListener* pListener) {
+ m_registerTopics.insert(topic);
+ if (pListener) {
+ m_pMessageQueueListener = pListener;
+ }
+}
+
+PullResult DefaultMQPullConsumer::pull(const MQMessageQueue& mq,
+ const string& subExpression,
+ int64 offset, int maxNums) {
+ return pullSyncImpl(mq, subExpression, offset, maxNums, false);
+}
+
+void DefaultMQPullConsumer::pull(const MQMessageQueue& mq,
+ const string& subExpression, int64 offset,
+ int maxNums, PullCallback* pPullCallback) {
+ pullAsyncImpl(mq, subExpression, offset, maxNums, false, pPullCallback);
+}
+
+PullResult DefaultMQPullConsumer::pullBlockIfNotFound(
+ const MQMessageQueue& mq, const string& subExpression, int64 offset,
+ int maxNums) {
+ return pullSyncImpl(mq, subExpression, offset, maxNums, true);
+}
+
+void DefaultMQPullConsumer::pullBlockIfNotFound(const MQMessageQueue& mq,
+ const string& subExpression,
+ int64 offset, int maxNums,
+ PullCallback* pPullCallback) {
+ pullAsyncImpl(mq, subExpression, offset, maxNums, true, pPullCallback);
+}
+
+PullResult DefaultMQPullConsumer::pullSyncImpl(const MQMessageQueue& mq,
+ const string& subExpression,
+ int64 offset, int maxNums,
+ bool block) {
+ if (offset < 0) THROW_MQEXCEPTION(MQClientException, "offset < 0", -1);
+
+ if (maxNums <= 0) THROW_MQEXCEPTION(MQClientException, "maxNums <= 0", -1);
+
+ //<!auto subscript,all sub;
+ subscriptionAutomatically(mq.getTopic());
+
+ int sysFlag = PullSysFlag::buildSysFlag(false, block, true, false);
+
+ //<!this sub;
+ unique_ptr<SubscriptionData> pSData(
+ FilterAPI::buildSubscriptionData(mq.getTopic(), subExpression));
+
+ int timeoutMillis = block ? 1000 * 30 : 1000 * 10;
+
+ try {
+ unique_ptr<PullResult> pullResult(
+ m_pPullAPIWrapper->pullKernelImpl(mq, // 1
+ pSData->getSubString(), // 2
+ 0L, // 3
+ offset, // 4
+ maxNums, // 5
+ sysFlag, // 6
+ 0, // 7
+ 1000 * 20, // 8
+ timeoutMillis, // 9
+ ComMode_SYNC, // 10
+ NULL, //<!callback;
+ getSessionCredentials(), NULL));
+ return m_pPullAPIWrapper->processPullResult(mq, pullResult.get(),
+ pSData.get());
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+ return PullResult(BROKER_TIMEOUT);
+}
+
+void DefaultMQPullConsumer::pullAsyncImpl(const MQMessageQueue& mq,
+ const string& subExpression,
+ int64 offset, int maxNums, bool block,
+ PullCallback* pPullCallback) {
+ if (offset < 0) THROW_MQEXCEPTION(MQClientException, "offset < 0", -1);
+
+ if (maxNums <= 0) THROW_MQEXCEPTION(MQClientException, "maxNums <= 0", -1);
+
+ if (!pPullCallback)
+ THROW_MQEXCEPTION(MQClientException, "pPullCallback is null", -1);
+
+ //<!auto subscript,all sub;
+ subscriptionAutomatically(mq.getTopic());
+
+ int sysFlag = PullSysFlag::buildSysFlag(false, block, true, false);
+
+ //<!this sub;
+ unique_ptr<SubscriptionData> pSData(
+ FilterAPI::buildSubscriptionData(mq.getTopic(), subExpression));
+
+ int timeoutMillis = block ? 1000 * 30 : 1000 * 10;
+
+ //<!�첽����;
+ AsyncArg arg;
+ arg.mq = mq;
+ arg.subData = *pSData;
+ arg.pPullWrapper = m_pPullAPIWrapper;
+
+ try {
+ unique_ptr<PullResult> pullResult(m_pPullAPIWrapper->pullKernelImpl(
+ mq, // 1
+ pSData->getSubString(), // 2
+ 0L, // 3
+ offset, // 4
+ maxNums, // 5
+ sysFlag, // 6
+ 0, // 7
+ 1000 * 20, // 8
+ timeoutMillis, // 9
+ ComMode_ASYNC, // 10
+ pPullCallback, getSessionCredentials(), &arg));
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+}
+
+void DefaultMQPullConsumer::subscriptionAutomatically(const string& topic) {
+ SubscriptionData* pSdata = m_pRebalance->getSubscriptionData(topic);
+ if (pSdata == NULL) {
+ unique_ptr<SubscriptionData> subscriptionData(
+ FilterAPI::buildSubscriptionData(topic, SUB_ALL));
+ m_pRebalance->setSubscriptionData(topic, subscriptionData.release());
+ }
+}
+
+void DefaultMQPullConsumer::updateConsumeOffset(const MQMessageQueue& mq,
+ int64 offset) {
+ m_pOffsetStore->updateOffset(mq, offset);
+}
+
+void DefaultMQPullConsumer::removeConsumeOffset(const MQMessageQueue& mq) {
+ m_pOffsetStore->removeOffset(mq);
+}
+
+int64 DefaultMQPullConsumer::fetchConsumeOffset(const MQMessageQueue& mq,
+ bool fromStore) {
+ return m_pOffsetStore->readOffset(
+ mq, fromStore ? READ_FROM_STORE : MEMORY_FIRST_THEN_STORE,
+ getSessionCredentials());
+}
+
+void DefaultMQPullConsumer::persistConsumerOffset() {
+ /*As do not execute rebalance for pullConsumer now, requestTable is always empty
+ map<MQMessageQueue, PullRequest*> requestTable =
+ m_pRebalance->getPullRequestTable();
+ map<MQMessageQueue, PullRequest*>::iterator it = requestTable.begin();
+ vector<MQMessageQueue> mqs;
+ for (; it != requestTable.end(); ++it)
+ {
+ if (it->second)
+ {
+ mqs.push_back(it->first);
+ }
+ }
+ m_pOffsetStore->persistAll(mqs);*/
+}
+
+void DefaultMQPullConsumer::persistConsumerOffsetByResetOffset() {}
+
+void DefaultMQPullConsumer::persistConsumerOffset4PullConsumer(
+ const MQMessageQueue& mq) {
+ if (isServiceStateOk()) {
+ m_pOffsetStore->persist(mq, getSessionCredentials());
+ }
+}
+
+void DefaultMQPullConsumer::fetchMessageQueuesInBalance(
+ const string& topic, vector<MQMessageQueue> mqs) {}
+
+void DefaultMQPullConsumer::checkConfig() {
+ string groupname = getGroupName();
+ // check consumerGroup
+ Validators::checkGroup(groupname);
+
+ // consumerGroup
+ if (!groupname.compare(DEFAULT_CONSUMER_GROUP)) {
+ THROW_MQEXCEPTION(MQClientException,
+ "consumerGroup can not equal DEFAULT_CONSUMER", -1);
+ }
+
+ if (getMessageModel() != BROADCASTING && getMessageModel() != CLUSTERING) {
+ THROW_MQEXCEPTION(MQClientException, "messageModel is valid ", -1);
+ }
+}
+
+void DefaultMQPullConsumer::doRebalance() {}
+
+void DefaultMQPullConsumer::copySubscription() {
+ set<string>::iterator it = m_registerTopics.begin();
+ for (; it != m_registerTopics.end(); ++it) {
+ unique_ptr<SubscriptionData> subscriptionData(
+ FilterAPI::buildSubscriptionData((*it), SUB_ALL));
+ m_pRebalance->setSubscriptionData((*it), subscriptionData.release());
+ }
+}
+
+ConsumeType DefaultMQPullConsumer::getConsumeType() { return CONSUME_ACTIVELY; }
+
+ConsumeFromWhere DefaultMQPullConsumer::getConsumeFromWhere() {
+ return CONSUME_FROM_LAST_OFFSET;
+}
+
+void DefaultMQPullConsumer::getSubscriptions(vector<SubscriptionData>& result) {
+ set<string>::iterator it = m_registerTopics.begin();
+ for (; it != m_registerTopics.end(); ++it) {
+ SubscriptionData ms(*it, SUB_ALL);
+ result.push_back(ms);
+ }
+}
+
+void DefaultMQPullConsumer::producePullMsgTask(PullRequest*) {}
+
+Rebalance* DefaultMQPullConsumer::getRebalance() const { return NULL; }
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/DefaultMQPushConsumer.cpp b/rocketmq-cpp/src/consumer/DefaultMQPushConsumer.cpp
new file mode 100755
index 00000000..84073503
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/DefaultMQPushConsumer.cpp
@@ -0,0 +1,897 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "DefaultMQPushConsumer.h"
+#include "CommunicationMode.h"
+#include "ConsumeMsgService.h"
+#include "ConsumerRunningInfo.h"
+#include "FilterAPI.h"
+#include "Logging.h"
+#include "MQClientAPIImpl.h"
+#include "MQClientFactory.h"
+#include "MQClientManager.h"
+#include "MQProtos.h"
+#include "OffsetStore.h"
+#include "PullAPIWrapper.h"
+#include "PullSysFlag.h"
+#include "Rebalance.h"
+#include "UtilAll.h"
+#include "Validators.h"
+#include "task_queue.h"
+
+namespace rocketmq {
+
+class AsyncPullCallback : public PullCallback {
+ public:
+ AsyncPullCallback(DefaultMQPushConsumer* pushConsumer, PullRequest* request)
+ : m_callbackOwner(pushConsumer),
+ m_pullRequest(request),
+ m_bShutdown(false) {}
+ virtual ~AsyncPullCallback() {
+ m_callbackOwner = NULL;
+ m_pullRequest = NULL;
+ }
+ virtual void onSuccess(MQMessageQueue& mq, PullResult& result,
+ bool bProducePullRequest) {
+ if (m_bShutdown == true) {
+ LOG_INFO("pullrequest for:%s in shutdown, return",
+ (m_pullRequest->m_messageQueue).toString().c_str());
+ return;
+ }
+
+ switch (result.pullStatus) {
+ case FOUND: {
+ if (!m_pullRequest->isDroped()) // if request is setted to dropped,
+ // don't add msgFoundList to
+ // m_msgTreeMap and don't call
+ // producePullMsgTask
+ { // avoid issue: pullMsg is sent out, rebalance is doing concurrently
+ // and this request is dropped, and then received pulled msgs.
+ m_pullRequest->setNextOffset(result.nextBeginOffset);
+ m_pullRequest->putMessage(result.msgFoundList);
+
+ m_callbackOwner->getConsumerMsgService()->submitConsumeRequest(
+ m_pullRequest, result.msgFoundList);
+
+ if (bProducePullRequest)
+ m_callbackOwner->producePullMsgTask(m_pullRequest);
+
+ LOG_DEBUG("FOUND:%s with size:%zu,nextBeginOffset:%lld",
+ (m_pullRequest->m_messageQueue).toString().c_str(),
+ result.msgFoundList.size(), result.nextBeginOffset);
+ }
+ break;
+ }
+ case NO_NEW_MSG: {
+ m_pullRequest->setNextOffset(result.nextBeginOffset);
+
+ vector<MQMessageExt> msgs;
+ m_pullRequest->getMessage(msgs);
+ if ((msgs.size() == 0) && (result.nextBeginOffset > 0)) {
+ /*if broker losted/cleared msgs of one msgQueue, but the brokerOffset
+ is kept, then consumer will enter following situation:
+ 1>. get pull offset with 0 when do rebalance, and set
+ m_offsetTable[mq] to 0;
+ 2>. NO_NEW_MSG or NO_MATCHED_MSG got when pullMessage, and nextBegin
+ offset increase by 800
+ 3>. request->getMessage(msgs) always NULL
+ 4>. we need update consumerOffset to nextBeginOffset indicated by
+ broker
+ but if really no new msg could be pulled, also go to this CASE
+
+ LOG_INFO("maybe misMatch between broker and client happens, update
+ consumerOffset to nextBeginOffset indicated by broker");*/
+ m_callbackOwner->updateConsumeOffset(m_pullRequest->m_messageQueue,
+ result.nextBeginOffset);
+ }
+ if (bProducePullRequest)
+ m_callbackOwner->producePullMsgTask(m_pullRequest);
+
+ /*LOG_INFO("NO_NEW_MSG:%s,nextBeginOffset:%lld",
+ (m_pullRequest->m_messageQueue).toString().c_str(),
+ result.nextBeginOffset);*/
+ break;
+ }
+ case NO_MATCHED_MSG: {
+ m_pullRequest->setNextOffset(result.nextBeginOffset);
+
+ vector<MQMessageExt> msgs;
+ m_pullRequest->getMessage(msgs);
+ if ((msgs.size() == 0) && (result.nextBeginOffset > 0)) {
+ /*if broker losted/cleared msgs of one msgQueue, but the brokerOffset
+ is kept, then consumer will enter following situation:
+ 1>. get pull offset with 0 when do rebalance, and set
+ m_offsetTable[mq] to 0;
+ 2>. NO_NEW_MSG or NO_MATCHED_MSG got when pullMessage, and nextBegin
+ offset increase by 800
+ 3>. request->getMessage(msgs) always NULL
+ 4>. we need update consumerOffset to nextBeginOffset indicated by
+ broker
+ but if really no new msg could be pulled, also go to this CASE
+
+ LOG_INFO("maybe misMatch between broker and client happens, update
+ consumerOffset to nextBeginOffset indicated by broker");*/
+ m_callbackOwner->updateConsumeOffset(m_pullRequest->m_messageQueue,
+ result.nextBeginOffset);
+ }
+ if (bProducePullRequest)
+ m_callbackOwner->producePullMsgTask(m_pullRequest);
+ /*LOG_INFO("NO_MATCHED_MSG:%s,nextBeginOffset:%lld",
+ (m_pullRequest->m_messageQueue).toString().c_str(),
+ result.nextBeginOffset);*/
+ break;
+ }
+ case OFFSET_ILLEGAL: {
+ m_pullRequest->setNextOffset(result.nextBeginOffset);
+ if (bProducePullRequest)
+ m_callbackOwner->producePullMsgTask(m_pullRequest);
+
+ /*LOG_INFO("OFFSET_ILLEGAL:%s,nextBeginOffset:%lld",
+ (m_pullRequest->m_messageQueue).toString().c_str(),
+ result.nextBeginOffset);*/
+ break;
+ }
+ case BROKER_TIMEOUT: { // as BROKER_TIMEOUT is defined by client, broker
+ // will not returns this status, so this case
+ // could not be entered.
+ LOG_ERROR("impossible BROKER_TIMEOUT Occurs");
+ m_pullRequest->setNextOffset(result.nextBeginOffset);
+ if (bProducePullRequest)
+ m_callbackOwner->producePullMsgTask(m_pullRequest);
+ break;
+ }
+ }
+ }
+
+ virtual void onException(MQException& e) {
+ if (m_bShutdown == true) {
+ LOG_INFO("pullrequest for:%s in shutdown, return",
+ (m_pullRequest->m_messageQueue).toString().c_str());
+ return;
+ }
+ LOG_WARN("pullrequest for:%s occurs exception, reproduce it",
+ (m_pullRequest->m_messageQueue).toString().c_str());
+ m_callbackOwner->producePullMsgTask(m_pullRequest);
+ }
+
+ void setShutdownStatus() { m_bShutdown = true; }
+
+ private:
+ DefaultMQPushConsumer* m_callbackOwner;
+ PullRequest* m_pullRequest;
+ bool m_bShutdown;
+};
+
+//<!***************************************************************************
+static boost::mutex m_asyncCallbackLock;
+DefaultMQPushConsumer::DefaultMQPushConsumer(const string& groupname)
+ : m_consumeFromWhere(CONSUME_FROM_LAST_OFFSET),
+ m_pOffsetStore(NULL),
+ m_pPullAPIWrapper(NULL),
+ m_pMessageListener(NULL),
+ m_consumeMessageBatchMaxSize(1),
+ m_maxMsgCacheSize(1000) {
+ //<!set default group name;
+ string gname = groupname.empty() ? DEFAULT_CONSUMER_GROUP : groupname;
+ setGroupName(gname);
+ m_asyncPull = true;
+ m_asyncPullTimeout = 30 * 1000;
+ setMessageModel(CLUSTERING);
+
+ m_startTime = UtilAll::currentTimeMillis();
+ m_consumeThreadCount = boost::thread::hardware_concurrency();
+ m_pullMsgThreadPoolNum = boost::thread::hardware_concurrency();
+ m_async_service_thread.reset(new boost::thread(
+ boost::bind(&DefaultMQPushConsumer::boost_asio_work, this)));
+}
+
+void DefaultMQPushConsumer::boost_asio_work() {
+ LOG_INFO("DefaultMQPushConsumer::boost asio async service runing");
+ boost::asio::io_service::work work(m_async_ioService); // avoid async io
+ // service stops after
+ // first timer timeout
+ // callback
+ m_async_ioService.run();
+}
+
+DefaultMQPushConsumer::~DefaultMQPushConsumer() {
+ m_pMessageListener = NULL;
+ deleteAndZero(m_pullmsgQueue);
+ deleteAndZero(m_pRebalance);
+ deleteAndZero(m_pOffsetStore);
+ deleteAndZero(m_pPullAPIWrapper);
+ deleteAndZero(m_consumerServeice);
+ PullMAP::iterator it = m_PullCallback.begin();
+ for (; it != m_PullCallback.end(); ++it) {
+ deleteAndZero(it->second);
+ }
+ m_PullCallback.clear();
+ m_subTopics.clear();
+}
+
+void DefaultMQPushConsumer::sendMessageBack(MQMessageExt& msg, int delayLevel) {
+ try {
+ getFactory()->getMQClientAPIImpl()->consumerSendMessageBack(
+ msg, getGroupName(), delayLevel, 3000, getSessionCredentials());
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+}
+
+void DefaultMQPushConsumer::fetchSubscribeMessageQueues(
+ const string& topic, vector<MQMessageQueue>& mqs) {
+ mqs.clear();
+ try {
+ getFactory()->fetchSubscribeMessageQueues(topic, mqs,
+ getSessionCredentials());
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+}
+
+void DefaultMQPushConsumer::doRebalance() {
+ if (isServiceStateOk()) {
+ try {
+ m_pRebalance->doRebalance();
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+ }
+}
+
+void DefaultMQPushConsumer::persistConsumerOffset() {
+ if (isServiceStateOk()) {
+ m_pRebalance->persistConsumerOffset();
+ }
+}
+
+void DefaultMQPushConsumer::persistConsumerOffsetByResetOffset() {
+ if (isServiceStateOk()) {
+ m_pRebalance->persistConsumerOffsetByResetOffset();
+ }
+}
+
+void DefaultMQPushConsumer::start() {
+ /* Ignore the SIGPIPE */
+ struct sigaction sa;
+ sa.sa_handler = SIG_IGN;
+ sa.sa_flags = 0;
+ sigaction(SIGPIPE, &sa, 0);
+
+ switch (m_serviceState) {
+ case CREATE_JUST: {
+ m_serviceState = START_FAILED;
+ MQClient::start();
+ LOG_INFO("DefaultMQPushConsumer:%s start", m_GroupName.c_str());
+
+ //<!data;
+ checkConfig();
+
+ //<!create rebalance;
+ m_pRebalance = new RebalancePush(this, getFactory());
+
+ string groupname = getGroupName();
+ m_pPullAPIWrapper = new PullAPIWrapper(getFactory(), groupname);
+
+ if (m_pMessageListener) {
+ if (m_pMessageListener->getMessageListenerType() ==
+ messageListenerOrderly) {
+ LOG_INFO("start orderly consume service:%s", getGroupName().c_str());
+ m_consumerServeice = new ConsumeMessageOrderlyService(
+ this, m_consumeThreadCount, m_pMessageListener);
+ } else // for backward compatible, defaultly and concurrently listeners
+ // are allocating ConsumeMessageConcurrentlyService
+ {
+ LOG_INFO("start concurrently consume service:%s",
+ getGroupName().c_str());
+ m_consumerServeice = new ConsumeMessageConcurrentlyService(
+ this, m_consumeThreadCount, m_pMessageListener);
+ }
+ }
+
+ m_pullmsgQueue = new TaskQueue(m_pullMsgThreadPoolNum);
+ m_pullmsgThread.reset(new boost::thread(boost::bind(
+ &DefaultMQPushConsumer::runPullMsgQueue, this, m_pullmsgQueue)));
+
+ copySubscription();
+
+ //<! registe;
+ bool registerOK = getFactory()->registerConsumer(this);
+ if (!registerOK) {
+ m_serviceState = CREATE_JUST;
+ THROW_MQEXCEPTION(
+ MQClientException,
+ "The cousumer group[" + getGroupName() +
+ "] has been created before, specify another name please.",
+ -1);
+ }
+
+ //<!msg model;
+ switch (getMessageModel()) {
+ case BROADCASTING:
+ m_pOffsetStore = new LocalFileOffsetStore(groupname, getFactory());
+ break;
+ case CLUSTERING:
+ m_pOffsetStore = new RemoteBrokerOffsetStore(groupname, getFactory());
+ break;
+ }
+ m_pOffsetStore->load();
+ m_consumerServeice->start();
+
+ getFactory()->start();
+
+ //<!����ط����ʱ��ܳ���;
+ updateTopicSubscribeInfoWhenSubscriptionChanged();
+ getFactory()->sendHeartbeatToAllBroker();
+
+ m_serviceState = RUNNING;
+ break;
+ }
+ case RUNNING:
+ case START_FAILED:
+ case SHUTDOWN_ALREADY:
+ break;
+ default:
+ break;
+ }
+
+ getFactory()->rebalanceImmediately();
+}
+
+void DefaultMQPushConsumer::shutdown() {
+ switch (m_serviceState) {
+ case RUNNING: {
+ LOG_INFO("DefaultMQPushConsumer shutdown");
+ m_async_ioService.stop();
+ m_async_service_thread->interrupt();
+ m_async_service_thread->join();
+ m_pullmsgQueue->close();
+ m_pullmsgThread->interrupt();
+ m_pullmsgThread->join();
+ m_consumerServeice->shutdown();
+ persistConsumerOffset();
+ shutdownAsyncPullCallBack(); // delete aync pullMsg resources
+ getFactory()->unregisterConsumer(this);
+ getFactory()->shutdown();
+ m_serviceState = SHUTDOWN_ALREADY;
+ break;
+ }
+ case CREATE_JUST:
+ case SHUTDOWN_ALREADY:
+ break;
+ default:
+ break;
+ }
+}
+
+void DefaultMQPushConsumer::registerMessageListener(
+ MQMessageListener* pMessageListener) {
+ if (NULL != pMessageListener) {
+ m_pMessageListener = pMessageListener;
+ }
+}
+
+MessageListenerType DefaultMQPushConsumer::getMessageListenerType() {
+ if (NULL != m_pMessageListener) {
+ return m_pMessageListener->getMessageListenerType();
+ }
+ return messageListenerDefaultly;
+}
+
+ConsumeMsgService* DefaultMQPushConsumer::getConsumerMsgService() const {
+ return m_consumerServeice;
+}
+
+OffsetStore* DefaultMQPushConsumer::getOffsetStore() const {
+ return m_pOffsetStore;
+}
+
+Rebalance* DefaultMQPushConsumer::getRebalance() const { return m_pRebalance; }
+
+void DefaultMQPushConsumer::subscribe(const string& topic,
+ const string& subExpression) {
+ m_subTopics[topic] = subExpression;
+}
+
+void DefaultMQPushConsumer::checkConfig() {
+ string groupname = getGroupName();
+ // check consumerGroup
+ Validators::checkGroup(groupname);
+
+ // consumerGroup
+ if (!groupname.compare(DEFAULT_CONSUMER_GROUP)) {
+ THROW_MQEXCEPTION(MQClientException,
+ "consumerGroup can not equal DEFAULT_CONSUMER", -1);
+ }
+
+ if (getMessageModel() != BROADCASTING && getMessageModel() != CLUSTERING) {
+ THROW_MQEXCEPTION(MQClientException, "messageModel is valid ", -1);
+ }
+
+ if (m_pMessageListener == NULL) {
+ THROW_MQEXCEPTION(MQClientException, "messageListener is null ", -1);
+ }
+}
+
+void DefaultMQPushConsumer::copySubscription() {
+ map<string, string>::iterator it = m_subTopics.begin();
+ for (; it != m_subTopics.end(); ++it) {
+ LOG_INFO("buildSubscriptionData,:%s,%s", it->first.c_str(),
+ it->second.c_str());
+ unique_ptr<SubscriptionData> pSData(
+ FilterAPI::buildSubscriptionData(it->first, it->second));
+
+ m_pRebalance->setSubscriptionData(it->first, pSData.release());
+ }
+
+ switch (getMessageModel()) {
+ case BROADCASTING:
+ break;
+ case CLUSTERING: {
+ string retryTopic = UtilAll::getRetryTopic(getGroupName());
+
+ //<!this sub;
+ unique_ptr<SubscriptionData> pSData(
+ FilterAPI::buildSubscriptionData(retryTopic, SUB_ALL));
+
+ m_pRebalance->setSubscriptionData(retryTopic, pSData.release());
+ break;
+ }
+ default:
+ break;
+ }
+}
+
+void DefaultMQPushConsumer::updateTopicSubscribeInfo(
+ const string& topic, vector<MQMessageQueue>& info) {
+ m_pRebalance->setTopicSubscribeInfo(topic, info);
+}
+
+void DefaultMQPushConsumer::updateTopicSubscribeInfoWhenSubscriptionChanged() {
+ map<string, SubscriptionData*>& subTable =
+ m_pRebalance->getSubscriptionInner();
+ map<string, SubscriptionData*>::iterator it = subTable.begin();
+ for (; it != subTable.end(); ++it) {
+ bool btopic = getFactory()->updateTopicRouteInfoFromNameServer(
+ it->first, getSessionCredentials());
+ if (btopic == false) {
+ LOG_WARN("The topic:[%s] not exist", it->first.c_str());
+ }
+ }
+}
+
+ConsumeType DefaultMQPushConsumer::getConsumeType() {
+ return CONSUME_PASSIVELY;
+}
+
+ConsumeFromWhere DefaultMQPushConsumer::getConsumeFromWhere() {
+ return m_consumeFromWhere;
+}
+
+void DefaultMQPushConsumer::setConsumeFromWhere(
+ ConsumeFromWhere consumeFromWhere) {
+ m_consumeFromWhere = consumeFromWhere;
+}
+
+void DefaultMQPushConsumer::getSubscriptions(vector<SubscriptionData>& result) {
+ map<string, SubscriptionData*>& subTable =
+ m_pRebalance->getSubscriptionInner();
+ map<string, SubscriptionData*>::iterator it = subTable.begin();
+ for (; it != subTable.end(); ++it) {
+ result.push_back(*(it->second));
+ }
+}
+
+void DefaultMQPushConsumer::updateConsumeOffset(const MQMessageQueue& mq,
+ int64 offset) {
+ if (offset >= 0) {
+ m_pOffsetStore->updateOffset(mq, offset);
+ } else {
+ LOG_ERROR("updateConsumeOffset of mq:%s error", mq.toString().c_str());
+ }
+}
+void DefaultMQPushConsumer::removeConsumeOffset(const MQMessageQueue& mq) {
+ m_pOffsetStore->removeOffset(mq);
+}
+
+void DefaultMQPushConsumer::triggerNextPullRequest(
+ boost::asio::deadline_timer* t, PullRequest* request) {
+ // LOG_INFO("trigger pullrequest for:%s",
+ // (request->m_messageQueue).toString().c_str());
+ producePullMsgTask(request);
+ deleteAndZero(t);
+}
+
+void DefaultMQPushConsumer::producePullMsgTask(PullRequest* request) {
+ if (m_pullmsgQueue->bTaskQueueStatusOK() && isServiceStateOk()) {
+ if (m_asyncPull) {
+ m_pullmsgQueue->produce(TaskBinder::gen(
+ &DefaultMQPushConsumer::pullMessageAsync, this, request));
+ } else {
+ m_pullmsgQueue->produce(
+ TaskBinder::gen(&DefaultMQPushConsumer::pullMessage, this, request));
+ }
+ }
+}
+
+void DefaultMQPushConsumer::runPullMsgQueue(TaskQueue* pTaskQueue) {
+ pTaskQueue->run();
+}
+
+void DefaultMQPushConsumer::pullMessage(PullRequest* request) {
+ if (request == NULL || request->isDroped()) {
+ LOG_WARN("Pull request is set drop, return");
+ return;
+ }
+
+ MQMessageQueue& messageQueue = request->m_messageQueue;
+ if (m_consumerServeice->getConsumeMsgSerivceListenerType() ==
+ messageListenerOrderly) {
+ if (!request->isLocked() || request->isLockExpired()) {
+ if (!m_pRebalance->lock(messageQueue)) {
+ producePullMsgTask(request);
+ return;
+ }
+ }
+ }
+
+ if (request->getCacheMsgCount() > m_maxMsgCacheSize) {
+ // LOG_INFO("retry pullrequest for:%s after 1s, as cachMsgSize:%d is larger
+ // than:%d", (request->m_messageQueue).toString().c_str(),
+ // request->getCacheMsgCount(), m_maxMsgCacheSize);
+ boost::asio::deadline_timer* t = new boost::asio::deadline_timer(
+ m_async_ioService, boost::posix_time::milliseconds(1 * 1000));
+ t->async_wait(boost::bind(&DefaultMQPushConsumer::triggerNextPullRequest,
+ this, t, request));
+ return;
+ }
+
+ bool commitOffsetEnable = false;
+ int64 commitOffsetValue = 0;
+ if (CLUSTERING == getMessageModel()) {
+ commitOffsetValue = m_pOffsetStore->readOffset(
+ messageQueue, READ_FROM_MEMORY, getSessionCredentials());
+ if (commitOffsetValue > 0) {
+ commitOffsetEnable = true;
+ }
+ }
+
+ string subExpression;
+ SubscriptionData* pSdata =
+ m_pRebalance->getSubscriptionData(messageQueue.getTopic());
+ if (pSdata == NULL) {
+ producePullMsgTask(request);
+ return;
+ }
+ subExpression = pSdata->getSubString();
+
+ int sysFlag =
+ PullSysFlag::buildSysFlag(commitOffsetEnable, // commitOffset
+ false, // suspend
+ !subExpression.empty(), // subscription
+ false); // class filter
+
+ try {
+ request->setLastPullTimestamp(UtilAll::currentTimeMillis());
+ unique_ptr<PullResult> result(
+ m_pPullAPIWrapper->pullKernelImpl(messageQueue, // 1
+ subExpression, // 2
+ pSdata->getSubVersion(), // 3
+ request->getNextOffset(), // 4
+ 32, // 5
+ sysFlag, // 6
+ commitOffsetValue, // 7
+ 1000 * 15, // 8
+ 1000 * 30, // 9
+ ComMode_SYNC, // 10
+ NULL, getSessionCredentials()));
+
+ PullResult pullResult = m_pPullAPIWrapper->processPullResult(
+ messageQueue, result.get(), pSdata);
+
+ switch (pullResult.pullStatus) {
+ case FOUND: {
+ if (!request->isDroped()) // if request is setted to dropped, don't add
+ // msgFoundList to m_msgTreeMap and don't
+ // call producePullMsgTask
+ { // avoid issue: pullMsg is sent out, rebalance is doing concurrently
+ // and this request is dropped, and then received pulled msgs.
+ request->setNextOffset(pullResult.nextBeginOffset);
+ request->putMessage(pullResult.msgFoundList);
+
+ m_consumerServeice->submitConsumeRequest(request,
+ pullResult.msgFoundList);
+ producePullMsgTask(request);
+
+ LOG_DEBUG("FOUND:%s with size:%zu,nextBeginOffset:%lld",
+ messageQueue.toString().c_str(),
+ pullResult.msgFoundList.size(), pullResult.nextBeginOffset);
+ }
+ break;
+ }
+ case NO_NEW_MSG: {
+ request->setNextOffset(pullResult.nextBeginOffset);
+ vector<MQMessageExt> msgs;
+ request->getMessage(msgs);
+ if ((msgs.size() == 0) && (pullResult.nextBeginOffset > 0)) {
+ /*if broker losted/cleared msgs of one msgQueue, but the brokerOffset
+ is kept, then consumer will enter following situation:
+ 1>. get pull offset with 0 when do rebalance, and set
+ m_offsetTable[mq] to 0;
+ 2>. NO_NEW_MSG or NO_MATCHED_MSG got when pullMessage, and nextBegin
+ offset increase by 800
+ 3>. request->getMessage(msgs) always NULL
+ 4>. we need update consumerOffset to nextBeginOffset indicated by
+ broker
+ but if really no new msg could be pulled, also go to this CASE
+ */
+ // LOG_DEBUG("maybe misMatch between broker and client happens, update
+ // consumerOffset to nextBeginOffset indicated by broker");
+ updateConsumeOffset(messageQueue, pullResult.nextBeginOffset);
+ }
+ producePullMsgTask(request);
+ LOG_DEBUG("NO_NEW_MSG:%s,nextBeginOffset:%lld",
+ messageQueue.toString().c_str(), pullResult.nextBeginOffset);
+ break;
+ }
+ case NO_MATCHED_MSG: {
+ request->setNextOffset(pullResult.nextBeginOffset);
+ vector<MQMessageExt> msgs;
+ request->getMessage(msgs);
+ if ((msgs.size() == 0) && (pullResult.nextBeginOffset > 0)) {
+ // LOG_DEBUG("maybe misMatch between broker and client happens, update
+ // consumerOffset to nextBeginOffset indicated by broker");
+ updateConsumeOffset(messageQueue, pullResult.nextBeginOffset);
+ }
+ producePullMsgTask(request);
+
+ LOG_DEBUG("NO_MATCHED_MSG:%s,nextBeginOffset:%lld",
+ messageQueue.toString().c_str(), pullResult.nextBeginOffset);
+ break;
+ }
+ case OFFSET_ILLEGAL: {
+ request->setNextOffset(pullResult.nextBeginOffset);
+ producePullMsgTask(request);
+
+ LOG_DEBUG("OFFSET_ILLEGAL:%s,nextBeginOffset:%lld",
+ messageQueue.toString().c_str(), pullResult.nextBeginOffset);
+ break;
+ }
+ case BROKER_TIMEOUT: { // as BROKER_TIMEOUT is defined by client, broker
+ // will not returns this status, so this case
+ // could not be entered.
+ LOG_ERROR("impossible BROKER_TIMEOUT Occurs");
+ request->setNextOffset(pullResult.nextBeginOffset);
+ producePullMsgTask(request);
+ break;
+ }
+ }
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ producePullMsgTask(request);
+ }
+}
+
+AsyncPullCallback* DefaultMQPushConsumer::getAsyncPullCallBack(
+ PullRequest* request, MQMessageQueue msgQueue) {
+ boost::lock_guard<boost::mutex> lock(m_asyncCallbackLock);
+ if (m_asyncPull && request) {
+ PullMAP::iterator it = m_PullCallback.find(msgQueue);
+ if (it == m_PullCallback.end()) {
+ LOG_INFO("new pull callback for mq:%s", msgQueue.toString().c_str());
+ m_PullCallback[msgQueue] = new AsyncPullCallback(this, request);
+ }
+ return m_PullCallback[msgQueue];
+ }
+
+ return NULL;
+}
+
+void DefaultMQPushConsumer::shutdownAsyncPullCallBack() {
+ boost::lock_guard<boost::mutex> lock(m_asyncCallbackLock);
+ if (m_asyncPull) {
+ PullMAP::iterator it = m_PullCallback.begin();
+ for (; it != m_PullCallback.end(); ++it) {
+ if (it->second) {
+ it->second->setShutdownStatus();
+ } else {
+ LOG_ERROR("could not find asyncPullCallback for:%s",
+ it->first.toString().c_str());
+ }
+ }
+ }
+}
+
+void DefaultMQPushConsumer::pullMessageAsync(PullRequest* request) {
+ if (request == NULL || request->isDroped()) {
+ LOG_WARN("Pull request is set drop with mq:%s, return",
+ (request->m_messageQueue).toString().c_str());
+ return;
+ }
+
+ MQMessageQueue& messageQueue = request->m_messageQueue;
+ if (m_consumerServeice->getConsumeMsgSerivceListenerType() ==
+ messageListenerOrderly) {
+ if (!request->isLocked() || request->isLockExpired()) {
+ if (!m_pRebalance->lock(messageQueue)) {
+ producePullMsgTask(request);
+ return;
+ }
+ }
+ }
+
+ if (request->getCacheMsgCount() > m_maxMsgCacheSize) {
+ // LOG_INFO("retry pullrequest for:%s after 1s, as cachMsgSize:%d is larger
+ // than:%d", (request->m_messageQueue).toString().c_str(),
+ // request->getCacheMsgCount(), m_maxMsgCacheSize);
+ boost::asio::deadline_timer* t = new boost::asio::deadline_timer(
+ m_async_ioService, boost::posix_time::milliseconds(1 * 1000));
+ t->async_wait(boost::bind(&DefaultMQPushConsumer::triggerNextPullRequest,
+ this, t, request));
+ return;
+ }
+
+ bool commitOffsetEnable = false;
+ int64 commitOffsetValue = 0;
+ if (CLUSTERING == getMessageModel()) {
+ commitOffsetValue = m_pOffsetStore->readOffset(
+ messageQueue, READ_FROM_MEMORY, getSessionCredentials());
+ if (commitOffsetValue > 0) {
+ commitOffsetEnable = true;
+ }
+ }
+
+ string subExpression;
+ SubscriptionData* pSdata =
+ (m_pRebalance->getSubscriptionData(messageQueue.getTopic()));
+ if (pSdata == NULL) {
+ producePullMsgTask(request);
+ return;
+ }
+ subExpression = pSdata->getSubString();
+
+ int sysFlag =
+ PullSysFlag::buildSysFlag(commitOffsetEnable, // commitOffset
+ true, // suspend
+ !subExpression.empty(), // subscription
+ false); // class filter
+
+ AsyncArg arg;
+ arg.mq = messageQueue;
+ arg.subData = *pSdata;
+ arg.pPullWrapper = m_pPullAPIWrapper;
+
+ try {
+ request->setLastPullTimestamp(UtilAll::currentTimeMillis());
+ m_pPullAPIWrapper->pullKernelImpl(
+ messageQueue, // 1
+ subExpression, // 2
+ pSdata->getSubVersion(), // 3
+ request->getNextOffset(), // 4
+ 32, // 5
+ sysFlag, // 6
+ commitOffsetValue, // 7
+ 1000 * 15, // 8
+ m_asyncPullTimeout, // 9
+ ComMode_ASYNC, // 10
+ getAsyncPullCallBack(request, messageQueue), // 11
+ getSessionCredentials(), // 12
+ &arg); // 13
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ producePullMsgTask(request);
+ }
+}
+
+void DefaultMQPushConsumer::setAsyncPull(bool asyncFlag) {
+ if(asyncFlag) {
+ LOG_INFO("set pushConsumer:%s to async default pull mode", getGroupName().c_str());
+ } else {
+ LOG_INFO("set pushConsumer:%s to sync pull mode", getGroupName().c_str());
+ }
+ m_asyncPull = asyncFlag;
+}
+
+void DefaultMQPushConsumer::setConsumeThreadCount(int threadCount) {
+ if (threadCount > 0) {
+ m_consumeThreadCount = threadCount;
+ } else {
+ LOG_ERROR("setConsumeThreadCount with invalid value");
+ }
+}
+
+int DefaultMQPushConsumer::getConsumeThreadCount() const {
+ return m_consumeThreadCount;
+}
+
+void DefaultMQPushConsumer::setPullMsgThreadPoolCount(int threadCount) {
+ m_pullMsgThreadPoolNum = threadCount;
+}
+
+int DefaultMQPushConsumer::getPullMsgThreadPoolCount() const {
+ return m_pullMsgThreadPoolNum;
+}
+
+int DefaultMQPushConsumer::getConsumeMessageBatchMaxSize() const {
+ return m_consumeMessageBatchMaxSize;
+}
+
+void DefaultMQPushConsumer::setConsumeMessageBatchMaxSize(
+ int consumeMessageBatchMaxSize) {
+ if (consumeMessageBatchMaxSize >= 1)
+ m_consumeMessageBatchMaxSize = consumeMessageBatchMaxSize;
+}
+
+void DefaultMQPushConsumer::setMaxCacheMsgSizePerQueue(int maxCacheSize) {
+ if (maxCacheSize > 0 && maxCacheSize < 65535) {
+ LOG_INFO("set maxCacheSize to:%d for consumer:%s", maxCacheSize,
+ getGroupName().c_str());
+ m_maxMsgCacheSize = maxCacheSize;
+ }
+}
+
+int DefaultMQPushConsumer::getMaxCacheMsgSizePerQueue() const {
+ return m_maxMsgCacheSize;
+}
+
+ConsumerRunningInfo* DefaultMQPushConsumer::getConsumerRunningInfo() {
+ ConsumerRunningInfo* info = new ConsumerRunningInfo();
+ if (info) {
+ if(m_consumerServeice->getConsumeMsgSerivceListenerType() == messageListenerOrderly)
+ info->setProperty(ConsumerRunningInfo::PROP_CONSUME_ORDERLY, "true");
+ else
+ info->setProperty(ConsumerRunningInfo::PROP_CONSUME_ORDERLY, "flase");
+ info->setProperty(ConsumerRunningInfo::PROP_THREADPOOL_CORE_SIZE, UtilAll::to_string(m_consumeThreadCount));
+ info->setProperty(ConsumerRunningInfo::PROP_CONSUMER_START_TIMESTAMP,
+ UtilAll::to_string(m_startTime));
+
+ vector<SubscriptionData> result;
+ getSubscriptions(result);
+ info->setSubscriptionSet(result);
+
+ map<MQMessageQueue, PullRequest*> requestTable =
+ m_pRebalance->getPullRequestTable();
+ map<MQMessageQueue, PullRequest*>::iterator it = requestTable.begin();
+
+ for (; it != requestTable.end(); ++it) {
+ if (!it->second->isDroped()) {
+ map<MessageQueue, ProcessQueueInfo> queueTable;
+ MessageQueue queue((it->first).getTopic(), (it->first).getBrokerName(),
+ (it->first).getQueueId());
+ ProcessQueueInfo processQueue;
+ processQueue.cachedMsgMinOffset = it->second->getCacheMinOffset();
+ processQueue.cachedMsgMaxOffset = it->second->getCacheMaxOffset();
+ processQueue.cachedMsgCount = it->second->getCacheMsgCount();
+ processQueue.setCommitOffset(m_pOffsetStore->readOffset(
+ it->first, MEMORY_FIRST_THEN_STORE, getSessionCredentials()));
+ processQueue.setDroped(it->second->isDroped());
+ processQueue.setLocked(it->second->isLocked());
+ processQueue.lastLockTimestamp = it->second->getLastLockTimestamp();
+ processQueue.lastPullTimestamp = it->second->getLastPullTimestamp();
+ processQueue.lastConsumeTimestamp =
+ it->second->getLastConsumeTimestamp();
+ info->setMqTable(queue, processQueue);
+ }
+ }
+
+ return info;
+ }
+ return NULL;
+}
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/FindBrokerResult.h b/rocketmq-cpp/src/consumer/FindBrokerResult.h
new file mode 100755
index 00000000..a224b14d
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/FindBrokerResult.h
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __FINDBROKERRESULT_H__
+#define __FINDBROKERRESULT_H__
+
+namespace rocketmq {
+//<!************************************************************************
+struct FindBrokerResult {
+ FindBrokerResult(const std::string& sbrokerAddr, bool bslave)
+ : brokerAddr(sbrokerAddr), slave(bslave) {}
+
+ public:
+ std::string brokerAddr;
+ bool slave;
+};
+}
+
+#endif
diff --git a/rocketmq-cpp/src/consumer/OffsetStore.cpp b/rocketmq-cpp/src/consumer/OffsetStore.cpp
new file mode 100755
index 00000000..33cf9edc
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/OffsetStore.cpp
@@ -0,0 +1,344 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "OffsetStore.h"
+#include "Logging.h"
+#include "MQClientFactory.h"
+#include "MessageQueue.h"
+
+#include <fstream>
+#include <sstream>
+
+#include <boost/archive/binary_iarchive.hpp>
+#include <boost/archive/binary_oarchive.hpp>
+#include <boost/archive/text_iarchive.hpp>
+#include <boost/archive/text_oarchive.hpp>
+#include <boost/serialization/map.hpp>
+
+namespace rocketmq {
+
+//<!***************************************************************************
+OffsetStore::OffsetStore(const string& groupName, MQClientFactory* pfactory)
+ : m_groupName(groupName), m_pClientFactory(pfactory) {}
+
+OffsetStore::~OffsetStore() {
+ m_pClientFactory = NULL;
+ m_offsetTable.clear();
+}
+
+//<!***************************************************************************
+LocalFileOffsetStore::LocalFileOffsetStore(const string& groupName,
+ MQClientFactory* pfactory)
+ : OffsetStore(groupName, pfactory) {
+ MQConsumer* pConsumer = pfactory->selectConsumer(groupName);
+ if (pConsumer) {
+ LOG_INFO("new LocalFileOffsetStore");
+ string directoryName =
+ UtilAll::getLocalAddress() + "@" + pConsumer->getInstanceName();
+ m_storePath = ".rocketmq_offsets/" + directoryName + "/" + groupName + "/";
+ string homeDir(UtilAll::getHomeDirectory());
+ m_storeFile = homeDir + "/" + m_storePath + "offsets.Json";
+
+ string storePath(homeDir);
+ storePath.append(m_storePath);
+ if (access(storePath.c_str(), F_OK) != 0) {
+ if (mkdir(storePath.c_str(), S_IRWXU | S_IRWXG | S_IRWXO) != 0) {
+ LOG_ERROR("create data dir:%s error", storePath.c_str());
+ }
+ }
+ }
+}
+
+LocalFileOffsetStore::~LocalFileOffsetStore() {}
+
+void LocalFileOffsetStore::load() {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+
+ std::ifstream ifs(m_storeFile.c_str(), std::ios::in);
+ if (ifs.good()) {
+ if (ifs.is_open()) {
+ if (ifs.peek() != std::ifstream::traits_type::eof()) {
+ map<string, int64> m_offsetTable_tmp;
+ boost::archive::text_iarchive ia(ifs);
+ ia >> m_offsetTable_tmp;
+ ifs.close();
+
+ for (map<string, int64>::iterator it = m_offsetTable_tmp.begin();
+ it != m_offsetTable_tmp.end(); ++it) {
+ // LOG_INFO("it->first:%s, it->second:%lld", it->first.c_str(),
+ // it->second);
+ Json::Reader reader;
+ Json::Value object;
+ reader.parse(it->first.c_str(), object);
+ MQMessageQueue mq(object["topic"].asString(),
+ object["brokerName"].asString(),
+ object["queueId"].asInt());
+ m_offsetTable[mq] = it->second;
+ }
+ m_offsetTable_tmp.clear();
+ /*for(map<MQMessageQueue, int64>::iterator it2 = m_offsetTable.begin();
+ it2!=m_offsetTable.end();++it2 ){
+ LOG_INFO("it->first:%s, it->second:%lld",
+ it2->first.toString().c_str(), it2->second);
+ }*/
+ } else {
+ LOG_ERROR(
+ "open offset store file failed, please check whether file: %s is "
+ "cleared by operator, if so, delete this offsets.Json file and "
+ "then restart consumer",
+ m_storeFile.c_str());
+ THROW_MQEXCEPTION(MQClientException,
+ "open offset store file failed, please check whether "
+ "offsets.Json is cleared by operator, if so, delete "
+ "this offsets.Json file and then restart consumer",
+ -1);
+ }
+ } else {
+ LOG_ERROR(
+ "open offset store file failed, please check whether file:%s is "
+ "deleted by operator and then restart consumer",
+ m_storeFile.c_str());
+ THROW_MQEXCEPTION(MQClientException,
+ "open offset store file failed, please check "
+ "directory:%s is deleted by operator or offset.Json "
+ "file is cleared by operator, and then restart "
+ "consumer",
+ -1);
+ }
+ } else {
+ LOG_WARN(
+ "offsets.Json file not exist, maybe this is the first time "
+ "consumation");
+ }
+}
+
+void LocalFileOffsetStore::updateOffset(const MQMessageQueue& mq,
+ int64 offset) {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+ m_offsetTable[mq] = offset;
+}
+
+int64 LocalFileOffsetStore::readOffset(
+ const MQMessageQueue& mq, ReadOffsetType type,
+ const SessionCredentials& session_credentials) {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+
+ switch (type) {
+ case MEMORY_FIRST_THEN_STORE:
+ case READ_FROM_MEMORY: {
+ MQ2OFFSET::iterator it = m_offsetTable.find(mq);
+ if (it != m_offsetTable.end()) {
+ return it->second;
+ } else if (READ_FROM_MEMORY == type) {
+ return -1;
+ }
+ }
+ case READ_FROM_STORE: {
+ try {
+ load();
+ } catch (MQException& e) {
+ LOG_ERROR("catch exception when load local file");
+ return -1;
+ }
+ MQ2OFFSET::iterator it = m_offsetTable.find(mq);
+ if (it != m_offsetTable.end()) {
+ return it->second;
+ }
+ }
+ default:
+ break;
+ }
+ LOG_ERROR(
+ "can not readOffset from offsetStore.json, maybe first time consumation");
+ return -1;
+}
+
+void LocalFileOffsetStore::persist(
+ const MQMessageQueue& mq, const SessionCredentials& session_credentials) {}
+
+void LocalFileOffsetStore::persistAll(const std::vector<MQMessageQueue>& mqs) {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+
+ map<string, int64> m_offsetTable_tmp;
+ vector<MQMessageQueue>::const_iterator it = mqs.begin();
+ for (; it != mqs.end(); ++it) {
+ MessageQueue mq_tmp((*it).getTopic(), (*it).getBrokerName(),
+ (*it).getQueueId());
+ string mqKey = mq_tmp.toJson().toStyledString();
+ m_offsetTable_tmp[mqKey] = m_offsetTable[*it];
+ }
+
+ std::ofstream s;
+ s.open(m_storeFile.c_str(), std::ios::out);
+ if (s.is_open()) {
+ boost::archive::text_oarchive oa(s);
+ // Boost is nervous that archiving non-const class instances which might
+ // cause a problem with object tracking if different tracked objects use the
+ // same address.
+ oa << const_cast<const map<string, int64>&>(m_offsetTable_tmp);
+ s.close();
+ m_offsetTable_tmp.clear();
+ } else {
+ LOG_ERROR("open offset store file failed");
+ m_offsetTable_tmp.clear();
+ THROW_MQEXCEPTION(MQClientException,
+ "persistAll:open offset store file failed", -1);
+ }
+}
+
+void LocalFileOffsetStore::removeOffset(const MQMessageQueue& mq) {}
+
+//<!***************************************************************************
+RemoteBrokerOffsetStore::RemoteBrokerOffsetStore(const string& groupName,
+ MQClientFactory* pfactory)
+ : OffsetStore(groupName, pfactory) {}
+
+RemoteBrokerOffsetStore::~RemoteBrokerOffsetStore() {}
+
+void RemoteBrokerOffsetStore::load() {}
+
+void RemoteBrokerOffsetStore::updateOffset(const MQMessageQueue& mq,
+ int64 offset) {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+ m_offsetTable[mq] = offset;
+}
+
+int64 RemoteBrokerOffsetStore::readOffset(
+ const MQMessageQueue& mq, ReadOffsetType type,
+ const SessionCredentials& session_credentials) {
+ switch (type) {
+ case MEMORY_FIRST_THEN_STORE:
+ case READ_FROM_MEMORY: {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+
+ MQ2OFFSET::iterator it = m_offsetTable.find(mq);
+ if (it != m_offsetTable.end()) {
+ return it->second;
+ } else if (READ_FROM_MEMORY == type) {
+ return -1;
+ }
+ }
+ case READ_FROM_STORE: {
+ try {
+ int64 brokerOffset =
+ fetchConsumeOffsetFromBroker(mq, session_credentials);
+ //<!update;
+ updateOffset(mq, brokerOffset);
+ return brokerOffset;
+ } catch (MQBrokerException& e) {
+ LOG_ERROR(e.what());
+ return -1;
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ return -2;
+ }
+ }
+ default:
+ break;
+ }
+ return -1;
+}
+
+void RemoteBrokerOffsetStore::persist(
+ const MQMessageQueue& mq, const SessionCredentials& session_credentials) {
+ MQ2OFFSET offsetTable;
+ {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+ offsetTable = m_offsetTable;
+ }
+
+ MQ2OFFSET::iterator it = offsetTable.find(mq);
+ if (it != offsetTable.end()) {
+ try {
+ updateConsumeOffsetToBroker(mq, it->second, session_credentials);
+ } catch (MQException& e) {
+ LOG_ERROR("updateConsumeOffsetToBroker error");
+ }
+ }
+}
+
+void RemoteBrokerOffsetStore::persistAll(
+ const std::vector<MQMessageQueue>& mq) {}
+
+void RemoteBrokerOffsetStore::removeOffset(const MQMessageQueue& mq) {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+ if (m_offsetTable.find(mq) != m_offsetTable.end()) m_offsetTable.erase(mq);
+}
+
+void RemoteBrokerOffsetStore::updateConsumeOffsetToBroker(
+ const MQMessageQueue& mq, int64 offset,
+ const SessionCredentials& session_credentials) {
+ unique_ptr<FindBrokerResult> pFindBrokerResult(
+ m_pClientFactory->findBrokerAddressInAdmin(mq.getBrokerName()));
+
+ if (pFindBrokerResult == NULL) {
+ m_pClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic(),
+ session_credentials);
+ pFindBrokerResult.reset(
+ m_pClientFactory->findBrokerAddressInAdmin(mq.getBrokerName()));
+ }
+
+ if (pFindBrokerResult != NULL) {
+ UpdateConsumerOffsetRequestHeader* pRequestHeader =
+ new UpdateConsumerOffsetRequestHeader();
+ pRequestHeader->topic = mq.getTopic();
+ pRequestHeader->consumerGroup = m_groupName;
+ pRequestHeader->queueId = mq.getQueueId();
+ pRequestHeader->commitOffset = offset;
+
+ try {
+ LOG_INFO(
+ "oneway updateConsumeOffsetToBroker of mq:%s, its offset is:%lld",
+ mq.toString().c_str(), offset);
+ return m_pClientFactory->getMQClientAPIImpl()->updateConsumerOffsetOneway(
+ pFindBrokerResult->brokerAddr, pRequestHeader, 1000 * 5,
+ session_credentials);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+ }
+ LOG_WARN("The broker not exist");
+}
+
+int64 RemoteBrokerOffsetStore::fetchConsumeOffsetFromBroker(
+ const MQMessageQueue& mq, const SessionCredentials& session_credentials) {
+ unique_ptr<FindBrokerResult> pFindBrokerResult(
+ m_pClientFactory->findBrokerAddressInAdmin(mq.getBrokerName()));
+
+ if (pFindBrokerResult == NULL) {
+ m_pClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic(),
+ session_credentials);
+ pFindBrokerResult.reset(
+ m_pClientFactory->findBrokerAddressInAdmin(mq.getBrokerName()));
+ }
+
+ if (pFindBrokerResult != NULL) {
+ QueryConsumerOffsetRequestHeader* pRequestHeader =
+ new QueryConsumerOffsetRequestHeader();
+ pRequestHeader->topic = mq.getTopic();
+ pRequestHeader->consumerGroup = m_groupName;
+ pRequestHeader->queueId = mq.getQueueId();
+
+ return m_pClientFactory->getMQClientAPIImpl()->queryConsumerOffset(
+ pFindBrokerResult->brokerAddr, pRequestHeader, 1000 * 5,
+ session_credentials);
+ } else {
+ LOG_ERROR("The broker not exist when fetchConsumeOffsetFromBroker");
+ THROW_MQEXCEPTION(MQClientException, "The broker not exist", -1);
+ }
+}
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/OffsetStore.h b/rocketmq-cpp/src/consumer/OffsetStore.h
new file mode 100755
index 00000000..269198fa
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/OffsetStore.h
@@ -0,0 +1,108 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __OFFSETSTORE_H__
+#define __OFFSETSTORE_H__
+
+#include <boost/asio.hpp>
+#include <boost/thread/mutex.hpp>
+#include <boost/thread/thread.hpp>
+#include <map>
+#include "MQMessageQueue.h"
+#include "RocketMQClient.h"
+#include "SessionCredentials.h"
+
+namespace rocketmq {
+class MQClientFactory;
+//<!***************************************************************************
+enum ReadOffsetType {
+ //read offset from memory
+ READ_FROM_MEMORY,
+ //read offset from remoting
+ READ_FROM_STORE,
+ //read offset from memory firstly, then from remoting
+ MEMORY_FIRST_THEN_STORE,
+};
+
+//<!***************************************************************************
+class OffsetStore {
+ public:
+ OffsetStore(const std::string& groupName, MQClientFactory*);
+ virtual ~OffsetStore();
+
+ virtual void load() = 0;
+ virtual void updateOffset(const MQMessageQueue& mq, int64 offset) = 0;
+ virtual int64 readOffset(const MQMessageQueue& mq, ReadOffsetType type,
+ const SessionCredentials& session_credentials) = 0;
+ virtual void persist(const MQMessageQueue& mq,
+ const SessionCredentials& session_credentials) = 0;
+ virtual void persistAll(const std::vector<MQMessageQueue>& mq) = 0;
+ virtual void removeOffset(const MQMessageQueue& mq) = 0;
+
+ protected:
+ std::string m_groupName;
+ typedef std::map<MQMessageQueue, int64> MQ2OFFSET;
+ MQ2OFFSET m_offsetTable;
+ MQClientFactory* m_pClientFactory;
+ boost::mutex m_lock;
+};
+
+//<!***************************************************************************
+class LocalFileOffsetStore : public OffsetStore {
+ public:
+ LocalFileOffsetStore(const std::string& groupName, MQClientFactory*);
+ virtual ~LocalFileOffsetStore();
+
+ virtual void load();
+ virtual void updateOffset(const MQMessageQueue& mq, int64 offset);
+ virtual int64 readOffset(const MQMessageQueue& mq, ReadOffsetType type,
+ const SessionCredentials& session_credentials);
+ virtual void persist(const MQMessageQueue& mq,
+ const SessionCredentials& session_credentials);
+ virtual void persistAll(const std::vector<MQMessageQueue>& mq);
+ virtual void removeOffset(const MQMessageQueue& mq);
+
+ private:
+ std::string m_storePath;
+ std::string m_storeFile;
+};
+
+//<!***************************************************************************
+class RemoteBrokerOffsetStore : public OffsetStore {
+ public:
+ RemoteBrokerOffsetStore(const std::string& groupName, MQClientFactory*);
+ virtual ~RemoteBrokerOffsetStore();
+
+ virtual void load();
+ virtual void updateOffset(const MQMessageQueue& mq, int64 offset);
+ virtual int64 readOffset(const MQMessageQueue& mq, ReadOffsetType type,
+ const SessionCredentials& session_credentials);
+ virtual void persist(const MQMessageQueue& mq,
+ const SessionCredentials& session_credentials);
+ virtual void persistAll(const std::vector<MQMessageQueue>& mq);
+ virtual void removeOffset(const MQMessageQueue& mq);
+
+ private:
+ void updateConsumeOffsetToBroker(
+ const MQMessageQueue& mq, int64 offset,
+ const SessionCredentials& session_credentials);
+ int64 fetchConsumeOffsetFromBroker(
+ const MQMessageQueue& mq, const SessionCredentials& session_credentials);
+};
+//<!***************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/consumer/PullAPIWrapper.cpp b/rocketmq-cpp/src/consumer/PullAPIWrapper.cpp
new file mode 100755
index 00000000..6a4b507c
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/PullAPIWrapper.cpp
@@ -0,0 +1,139 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "PullAPIWrapper.h"
+#include "CommunicationMode.h"
+#include "MQClientFactory.h"
+#include "PullResultExt.h"
+#include "PullSysFlag.h"
+namespace rocketmq {
+//<!************************************************************************
+PullAPIWrapper::PullAPIWrapper(MQClientFactory* mQClientFactory,
+ const string& consumerGroup) {
+ m_MQClientFactory = mQClientFactory;
+ m_consumerGroup = consumerGroup;
+}
+
+PullAPIWrapper::~PullAPIWrapper() {
+ m_MQClientFactory = NULL;
+ m_pullFromWhichNodeTable.clear();
+}
+
+void PullAPIWrapper::updatePullFromWhichNode(const MQMessageQueue& mq,
+ int brokerId) {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+ m_pullFromWhichNodeTable[mq] = brokerId;
+}
+
+int PullAPIWrapper::recalculatePullFromWhichNode(const MQMessageQueue& mq) {
+ boost::lock_guard<boost::mutex> lock(m_lock);
+ if (m_pullFromWhichNodeTable.find(mq) != m_pullFromWhichNodeTable.end()) {
+ return m_pullFromWhichNodeTable[mq];
+ }
+ return MASTER_ID;
+}
+
+PullResult PullAPIWrapper::processPullResult(
+ const MQMessageQueue& mq, PullResult* pullResult,
+ SubscriptionData* subscriptionData) {
+ PullResultExt* pResultExt = static_cast<PullResultExt*>(pullResult);
+ if (pResultExt == NULL) {
+ string errMsg("The pullResult NULL of");
+ errMsg.append(mq.toString());
+ THROW_MQEXCEPTION(MQClientException, errMsg, -1);
+ }
+
+ //<!update;
+ updatePullFromWhichNode(mq, pResultExt->suggestWhichBrokerId);
+
+ vector<MQMessageExt> msgFilterList;
+ if (pResultExt->pullStatus == FOUND) {
+ //<!decode all msg list;
+ vector<MQMessageExt> msgAllList;
+ MQDecoder::decodes(&pResultExt->msgMemBlock, msgAllList);
+
+ //<!filter msg list again;
+ if (subscriptionData != NULL && !subscriptionData->getTagsSet().empty()) {
+ msgFilterList.reserve(msgAllList.size());
+ vector<MQMessageExt>::iterator it = msgAllList.begin();
+ for (; it != msgAllList.end(); ++it) {
+ string msgTag = (*it).getTags();
+ if (subscriptionData->containTag(msgTag)) {
+ msgFilterList.push_back(*it);
+ }
+ }
+ } else
+ {
+ msgFilterList.swap(msgAllList);
+ }
+ }
+
+ return PullResult(pResultExt->pullStatus, pResultExt->nextBeginOffset,
+ pResultExt->minOffset, pResultExt->maxOffset,
+ msgFilterList);
+}
+
+PullResult* PullAPIWrapper::pullKernelImpl(
+ const MQMessageQueue& mq, // 1
+ string subExpression, // 2
+ int64 subVersion, // 3
+ int64 offset, // 4
+ int maxNums, // 5
+ int sysFlag, // 6
+ int64 commitOffset, // 7
+ int brokerSuspendMaxTimeMillis, // 8
+ int timeoutMillis, // 9
+ int communicationMode, // 10
+ PullCallback* pullCallback, const SessionCredentials& session_credentials,
+ void* pArg /*= NULL*/) {
+ unique_ptr<FindBrokerResult> pFindBrokerResult(
+ m_MQClientFactory->findBrokerAddressInSubscribe(
+ mq.getBrokerName(), recalculatePullFromWhichNode(mq), false));
+ //<!goto nameserver;
+ if (pFindBrokerResult == NULL) {
+ m_MQClientFactory->updateTopicRouteInfoFromNameServer(mq.getTopic(),
+ session_credentials);
+ pFindBrokerResult.reset(m_MQClientFactory->findBrokerAddressInSubscribe(
+ mq.getBrokerName(), recalculatePullFromWhichNode(mq), false));
+ }
+
+ if (pFindBrokerResult != NULL) {
+ int sysFlagInner = sysFlag;
+
+ if (pFindBrokerResult->slave) {
+ sysFlagInner = PullSysFlag::clearCommitOffsetFlag(sysFlagInner);
+ }
+
+ PullMessageRequestHeader* pRequestHeader = new PullMessageRequestHeader();
+ pRequestHeader->consumerGroup = m_consumerGroup;
+ pRequestHeader->topic = mq.getTopic();
+ pRequestHeader->queueId = mq.getQueueId();
+ pRequestHeader->queueOffset = offset;
+ pRequestHeader->maxMsgNums = maxNums;
+ pRequestHeader->sysFlag = sysFlagInner;
+ pRequestHeader->commitOffset = commitOffset;
+ pRequestHeader->suspendTimeoutMillis = brokerSuspendMaxTimeMillis;
+ pRequestHeader->subscription = subExpression;
+ pRequestHeader->subVersion = subVersion;
+
+ return m_MQClientFactory->getMQClientAPIImpl()->pullMessage(
+ pFindBrokerResult->brokerAddr, pRequestHeader, timeoutMillis,
+ communicationMode, pullCallback, pArg, session_credentials);
+ }
+ THROW_MQEXCEPTION(MQClientException, "The broker not exist", -1);
+}
+
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/PullAPIWrapper.h b/rocketmq-cpp/src/consumer/PullAPIWrapper.h
new file mode 100755
index 00000000..e3d0a1e3
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/PullAPIWrapper.h
@@ -0,0 +1,67 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef _PULLAPIWRAPPER_H_
+#define _PULLAPIWRAPPER_H_
+
+#include <boost/thread/mutex.hpp>
+#include <boost/thread/thread.hpp>
+#include "AsyncCallback.h"
+#include "MQMessageQueue.h"
+#include "SessionCredentials.h"
+#include "SubscriptionData.h"
+
+namespace rocketmq {
+class MQClientFactory;
+//<!***************************************************************************
+class PullAPIWrapper {
+ public:
+ PullAPIWrapper(MQClientFactory* mQClientFactory, const string& consumerGroup);
+ ~PullAPIWrapper();
+
+ PullResult processPullResult(const MQMessageQueue& mq, PullResult* pullResult,
+ SubscriptionData* subscriptionData);
+
+ PullResult* pullKernelImpl(const MQMessageQueue& mq, // 1
+ string subExpression, // 2
+ int64 subVersion, // 3
+ int64 offset, // 4
+ int maxNums, // 5
+ int sysFlag, // 6
+ int64 commitOffset, // 7
+ int brokerSuspendMaxTimeMillis, // 8
+ int timeoutMillis, // 9
+ int communicationMode, // 10
+ PullCallback* pullCallback,
+ const SessionCredentials& session_credentials,
+ void* pArg = NULL);
+
+ private:
+ void updatePullFromWhichNode(const MQMessageQueue& mq, int brokerId);
+
+ int recalculatePullFromWhichNode(const MQMessageQueue& mq);
+
+ private:
+ MQClientFactory* m_MQClientFactory;
+ string m_consumerGroup;
+ boost::mutex m_lock;
+ map<MQMessageQueue, int /* brokerId */> m_pullFromWhichNodeTable;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+
+#endif //<! _PULLAPIWRAPPER_H_
diff --git a/rocketmq-cpp/src/consumer/PullRequest.cpp b/rocketmq-cpp/src/consumer/PullRequest.cpp
new file mode 100755
index 00000000..d9b953f6
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/PullRequest.cpp
@@ -0,0 +1,244 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "PullRequest.h"
+#include "Logging.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+const uint64 PullRequest::RebalanceLockInterval = 20 * 1000;
+const uint64 PullRequest::RebalanceLockMaxLiveTime = 30 * 1000;
+
+PullRequest::PullRequest(const string& groupname)
+ : m_groupname(groupname), m_nextOffset(0), m_queueOffsetMax(0), m_bDroped(false), m_bLocked(false) {}
+
+PullRequest::~PullRequest() {
+ m_msgTreeMapTemp.clear();
+ m_msgTreeMap.clear();
+}
+
+PullRequest& PullRequest::operator=(const PullRequest& other) {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+ if (this != &other) {
+ m_groupname = other.m_groupname;
+ m_nextOffset = other.m_nextOffset;
+ m_bDroped.store(other.m_bDroped.load());
+ m_queueOffsetMax = other.m_queueOffsetMax;
+ m_messageQueue = other.m_messageQueue;
+ m_msgTreeMap = other.m_msgTreeMap;
+ m_msgTreeMapTemp = other.m_msgTreeMapTemp;
+ }
+ return *this;
+}
+
+void PullRequest::putMessage(vector<MQMessageExt>& msgs) {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+
+ vector<MQMessageExt>::iterator it = msgs.begin();
+ for (; it != msgs.end(); it++) {
+ m_msgTreeMap[it->getQueueOffset()] = *it;
+ m_queueOffsetMax = std::max(m_queueOffsetMax, it->getQueueOffset());
+ }
+ LOG_DEBUG("PullRequest: putMessage m_queueOffsetMax:%lld ", m_queueOffsetMax);
+}
+
+void PullRequest::getMessage(vector<MQMessageExt>& msgs) {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+
+ map<int64, MQMessageExt>::iterator it = m_msgTreeMap.begin();
+ for (; it != m_msgTreeMap.end(); it++) {
+ msgs.push_back(it->second);
+ }
+}
+
+int64 PullRequest::getCacheMinOffset() {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+ if (m_msgTreeMap.empty()) {
+ return 0;
+ } else {
+ map<int64, MQMessageExt>::iterator it = m_msgTreeMap.begin();
+ MQMessageExt msg = it->second;
+ return msg.getQueueOffset();
+ }
+}
+
+int64 PullRequest::getCacheMaxOffset() { return m_queueOffsetMax; }
+
+int PullRequest::getCacheMsgCount() {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+ return m_msgTreeMap.size();
+}
+
+void PullRequest::getMessageByQueueOffset(vector<MQMessageExt>& msgs,
+ int64 minQueueOffset,
+ int64 maxQueueOffset) {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+
+ int64 it = minQueueOffset;
+ for (; it <= maxQueueOffset; it++) {
+ msgs.push_back(m_msgTreeMap[it]);
+ }
+}
+
+int64 PullRequest::removeMessage(vector<MQMessageExt>& msgs) {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+
+ int64 result = -1;
+ LOG_DEBUG("m_queueOffsetMax is:%lld", m_queueOffsetMax);
+ if (!m_msgTreeMap.empty()) {
+ result = m_queueOffsetMax + 1;
+ LOG_DEBUG(" offset result is:%lld, m_queueOffsetMax is:%lld, msgs size:%zu",
+ result, m_queueOffsetMax, msgs.size());
+ vector<MQMessageExt>::iterator it = msgs.begin();
+ for (; it != msgs.end(); it++) {
+ LOG_DEBUG("remove these msg from m_msgTreeMap, its offset:%lld",
+ it->getQueueOffset());
+ m_msgTreeMap.erase(it->getQueueOffset());
+ }
+
+ if (!m_msgTreeMap.empty()) {
+ map<int64, MQMessageExt>::iterator it = m_msgTreeMap.begin();
+ result = it->first;
+ LOG_INFO("cache msg size:%zu of pullRequest:%s, return offset result is:%lld",
+ m_msgTreeMap.size(), m_messageQueue.toString().c_str(), result);
+ }
+ }
+
+ return result;
+}
+
+void PullRequest::clearAllMsgs() {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+
+ if (isDroped()) {
+ LOG_DEBUG("clear m_msgTreeMap as PullRequest had been dropped.");
+ m_msgTreeMap.clear();
+ m_msgTreeMapTemp.clear();
+ }
+}
+
+void PullRequest::updateQueueMaxOffset(int64 queueOffset) {
+ // following 2 cases which may set queueOffset smaller than m_queueOffsetMax:
+ // 1. resetOffset cmd
+ // 2. during rebalance, if configured with CONSUMER_FROM_FIRST_OFFSET, when
+ // readOffset called by computePullFromWhere was failed, m_nextOffset will be
+ // setted to 0
+ m_queueOffsetMax = queueOffset;
+}
+
+void PullRequest::setDroped(bool droped) {
+ int temp = (droped == true ? 1 : 0);
+ m_bDroped.store(temp);
+ /*
+ m_queueOffsetMax = 0;
+ m_nextOffset = 0;
+ //the reason why not clear m_queueOffsetMax and m_nextOffset is due to
+ ConsumeMsgService and drop mq are concurrent running.
+ consider following situation:
+ 1>. ConsumeMsgService running
+ 2>. dorebalance, drop mq, reset m_nextOffset and m_queueOffsetMax
+ 3>. ConsumeMsgService calls removeMessages, if no other msgs in
+ m_msgTreeMap, m_queueOffsetMax(0)+1 will return;
+ 4>. updateOffset with 1, which is more smaller than correct offset.
+ */
+}
+
+bool PullRequest::isDroped() const { return m_bDroped.load() == 1; }
+
+int64 PullRequest::getNextOffset() {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+ return m_nextOffset;
+}
+
+void PullRequest::setLocked(bool Locked) {
+ int temp = (Locked == true ? 1 : 0);
+ m_bLocked.store(temp);
+}
+bool PullRequest::isLocked() const { return m_bLocked.load() == 1; }
+
+bool PullRequest::isLockExpired() const {
+ return (UtilAll::currentTimeMillis() - m_lastLockTimestamp) >
+ RebalanceLockMaxLiveTime;
+}
+
+void PullRequest::setLastLockTimestamp(int64 time) {
+ m_lastLockTimestamp = time;
+}
+
+int64 PullRequest::getLastLockTimestamp() const { return m_lastLockTimestamp; }
+
+void PullRequest::setLastPullTimestamp(uint64 time) {
+ m_lastPullTimestamp = time;
+}
+
+uint64 PullRequest::getLastPullTimestamp() const { return m_lastPullTimestamp; }
+
+void PullRequest::setLastConsumeTimestamp(uint64 time) {
+ m_lastConsumeTimestamp = time;
+}
+
+uint64 PullRequest::getLastConsumeTimestamp() const {
+ return m_lastConsumeTimestamp;
+}
+
+void PullRequest::setTryUnlockTimes(int time) { m_lastLockTimestamp = time; }
+
+int PullRequest::getTryUnlockTimes() const { return m_lastLockTimestamp; }
+
+void PullRequest::setNextOffset(int64 nextoffset) {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+ m_nextOffset = nextoffset;
+}
+
+string PullRequest::getGroupName() const { return m_groupname; }
+
+boost::timed_mutex& PullRequest::getPullRequestCriticalSection() {
+ return m_consumeLock;
+}
+
+void PullRequest::takeMessages(vector<MQMessageExt>& msgs, int batchSize) {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+ for (int i = 0; i != batchSize; i++) {
+ map<int64, MQMessageExt>::iterator it = m_msgTreeMap.begin();
+ if (it != m_msgTreeMap.end()) {
+ msgs.push_back(it->second);
+ m_msgTreeMapTemp[it->first] = it->second;
+ m_msgTreeMap.erase(it);
+ }
+ }
+}
+
+void PullRequest::makeMessageToCosumeAgain(vector<MQMessageExt>& msgs) {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+ for (unsigned int it = 0; it != msgs.size(); ++it) {
+ m_msgTreeMap[msgs[it].getQueueOffset()] = msgs[it];
+ m_msgTreeMapTemp.erase(msgs[it].getQueueOffset());
+ }
+}
+
+int64 PullRequest::commit() {
+ boost::lock_guard<boost::mutex> lock(m_pullRequestLock);
+ if (!m_msgTreeMapTemp.empty()) {
+ int64 offset = (--m_msgTreeMapTemp.end())->first;
+ m_msgTreeMapTemp.clear();
+ return offset + 1;
+ } else {
+ return -1;
+ }
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/PullRequest.h b/rocketmq-cpp/src/consumer/PullRequest.h
new file mode 100755
index 00000000..6cd21801
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/PullRequest.h
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __PULLREQUEST_H__
+#define __PULLREQUEST_H__
+
+#include <boost/atomic.hpp>
+#include <boost/thread/mutex.hpp>
+#include <boost/thread/thread.hpp>
+#include "ByteOrder.h"
+#include "MQMessageExt.h"
+#include "MQMessageQueue.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class PullRequest {
+ public:
+ PullRequest(const string& groupname);
+ virtual ~PullRequest();
+
+ void putMessage(vector<MQMessageExt>& msgs);
+ void getMessage(vector<MQMessageExt>& msgs);
+ int64 getCacheMinOffset();
+ int64 getCacheMaxOffset();
+ int getCacheMsgCount();
+ void getMessageByQueueOffset(vector<MQMessageExt>& msgs, int64 minQueueOffset,
+ int64 maxQueueOffset);
+ int64 removeMessage(vector<MQMessageExt>& msgs);
+ void clearAllMsgs();
+
+ PullRequest& operator=(const PullRequest& other);
+
+ void setDroped(bool droped);
+ bool isDroped() const;
+
+ int64 getNextOffset();
+ void setNextOffset(int64 nextoffset);
+
+ string getGroupName() const;
+
+ void updateQueueMaxOffset(int64 queueOffset);
+
+ void setLocked(bool Locked);
+ bool isLocked() const;
+ bool isLockExpired() const;
+ void setLastLockTimestamp(int64 time);
+ int64 getLastLockTimestamp() const;
+ void setLastPullTimestamp(uint64 time);
+ uint64 getLastPullTimestamp() const;
+ void setLastConsumeTimestamp(uint64 time);
+ uint64 getLastConsumeTimestamp() const;
+ void setTryUnlockTimes(int time);
+ int getTryUnlockTimes() const;
+ void takeMessages(vector<MQMessageExt>& msgs, int batchSize);
+ int64 commit();
+ void makeMessageToCosumeAgain(vector<MQMessageExt>& msgs);
+ boost::timed_mutex& getPullRequestCriticalSection();
+
+ public:
+ MQMessageQueue m_messageQueue;
+ static const uint64 RebalanceLockInterval; // ms
+ static const uint64 RebalanceLockMaxLiveTime; // ms
+
+ private:
+ string m_groupname;
+ int64 m_nextOffset;
+ int64 m_queueOffsetMax;
+ boost::atomic<bool> m_bDroped;
+ boost::atomic<bool> m_bLocked;
+ map<int64, MQMessageExt> m_msgTreeMap;
+ map<int64, MQMessageExt> m_msgTreeMapTemp;
+ boost::mutex m_pullRequestLock;
+ uint64 m_lastLockTimestamp; // ms
+ uint64 m_tryUnlockTimes;
+ uint64 m_lastPullTimestamp;
+ uint64 m_lastConsumeTimestamp;
+ boost::timed_mutex m_consumeLock;
+};
+//<!************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/consumer/PullResult.cpp b/rocketmq-cpp/src/consumer/PullResult.cpp
new file mode 100755
index 00000000..8648abea
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/PullResult.cpp
@@ -0,0 +1,54 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "PullResult.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!************************************************************************
+PullResult::PullResult()
+ : pullStatus(NO_MATCHED_MSG),
+ nextBeginOffset(0),
+ minOffset(0),
+ maxOffset(0) {}
+
+PullResult::PullResult(PullStatus status)
+ : pullStatus(status), nextBeginOffset(0), minOffset(0), maxOffset(0) {}
+
+PullResult::PullResult(PullStatus pullStatus, int64 nextBeginOffset,
+ int64 minOffset, int64 maxOffset)
+ : pullStatus(pullStatus),
+ nextBeginOffset(nextBeginOffset),
+ minOffset(minOffset),
+ maxOffset(maxOffset) {}
+
+PullResult::PullResult(PullStatus pullStatus, int64 nextBeginOffset,
+ int64 minOffset, int64 maxOffset,
+ const vector<MQMessageExt>& src)
+ : pullStatus(pullStatus),
+ nextBeginOffset(nextBeginOffset),
+ minOffset(minOffset),
+ maxOffset(maxOffset) {
+ msgFoundList.reserve(src.size());
+ for (size_t i = 0; i < src.size(); i++) {
+ msgFoundList.push_back(src[i]);
+ }
+}
+
+PullResult::~PullResult() { msgFoundList.clear(); }
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/PullResultExt.h b/rocketmq-cpp/src/consumer/PullResultExt.h
new file mode 100755
index 00000000..ac6b8e99
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/PullResultExt.h
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "PullResult.h"
+#include "UtilAll.h"
+#include "dataBlock.h"
+
+namespace rocketmq {
+/**
+ * ֻ���ڲ�ʹ�ã��������
+ */
+//<!***************************************************************************
+class PullResultExt : public PullResult {
+ public:
+ PullResultExt(PullStatus pullStatus, int64 nextBeginOffset, int64 minOffset,
+ int64 maxOffset, int suggestWhichBrokerId,
+ const MemoryBlock& messageBinary)
+ : PullResult(pullStatus, nextBeginOffset, minOffset, maxOffset),
+ suggestWhichBrokerId(suggestWhichBrokerId),
+ msgMemBlock(messageBinary) {}
+ PullResultExt(PullStatus pullStatus, int64 nextBeginOffset, int64 minOffset,
+ int64 maxOffset, int suggestWhichBrokerId)
+ : PullResult(pullStatus, nextBeginOffset, minOffset, maxOffset),
+ suggestWhichBrokerId(suggestWhichBrokerId) {}
+ virtual ~PullResultExt() {}
+
+ public:
+ int suggestWhichBrokerId;
+ MemoryBlock msgMemBlock;
+};
+
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/Rebalance.cpp b/rocketmq-cpp/src/consumer/Rebalance.cpp
new file mode 100755
index 00000000..a19e7a7f
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/Rebalance.cpp
@@ -0,0 +1,677 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "Rebalance.h"
+#include "DefaultMQPushConsumer.h"
+#include "LockBatchBody.h"
+#include "Logging.h"
+#include "MQClientAPIImpl.h"
+#include "MQClientFactory.h"
+#include "OffsetStore.h"
+
+namespace rocketmq {
+//<!************************************************************************
+Rebalance::Rebalance(MQConsumer* consumer, MQClientFactory* pfactory)
+ : m_pConsumer(consumer), m_pClientFactory(pfactory) {
+ m_pAllocateMQStrategy = new AllocateMQAveragely();
+}
+
+Rebalance::~Rebalance() {
+ {
+ map<string, SubscriptionData*>::iterator it = m_subscriptionData.begin();
+ for (; it != m_subscriptionData.end(); ++it) deleteAndZero(it->second);
+ m_subscriptionData.clear();
+ }
+ {
+ MQ2PULLREQ::iterator it = m_requestQueueTable.begin();
+ for (; it != m_requestQueueTable.end(); ++it) {
+ delete it->second;
+ it->second = NULL;
+ }
+ m_requestQueueTable.clear();
+ }
+ m_topicSubscribeInfoTable.clear();
+ m_pConsumer = NULL;
+ m_pClientFactory = NULL;
+ deleteAndZero(m_pAllocateMQStrategy);
+}
+
+void Rebalance::doRebalance() {
+ LOG_DEBUG("start doRebalance");
+ try {
+ map<string, SubscriptionData*>::iterator it = m_subscriptionData.begin();
+ for (; it != m_subscriptionData.end(); ++it) {
+ string topic = (it->first);
+ LOG_INFO("current topic is:%s", topic.c_str());
+ //<!topic -> mqs
+ vector<MQMessageQueue> mqAll;
+ if (!getTopicSubscribeInfo(topic, mqAll)) {
+ continue;
+ }
+ if (mqAll.empty()) {
+ if (!UtilAll::startsWith_retry(topic))
+ THROW_MQEXCEPTION(MQClientException, "doRebalance the topic is empty",
+ -1);
+ }
+
+ //<!msg model;
+ switch (m_pConsumer->getMessageModel()) {
+ case BROADCASTING: {
+ bool changed = updateRequestTableInRebalance(topic, mqAll);
+ if (changed) {
+ messageQueueChanged(topic, mqAll, mqAll);
+ }
+ break;
+ }
+ case CLUSTERING: {
+ vector<string> cidAll;
+ m_pClientFactory->findConsumerIds(
+ topic, m_pConsumer->getGroupName(), cidAll,
+ m_pConsumer->getSessionCredentials());
+
+ if (cidAll.empty()) {
+ /*remove the droping pullRequest changes for recovery consume fastly
+ from network broken
+ //drop all pullRequest
+ MQ2PULLREQ::iterator it = m_requestQueueTable.begin();
+ for (; it != m_requestQueueTable.end(); ++it)
+ {
+ if(!(it->second->isDroped()))
+ {
+ MQMessageQueue mqtemp = it->first;
+ it->second->setDroped(true);
+ removeUnnecessaryMessageQueue(mqtemp);
+ it->second->clearAllMsgs();//add clear operation to
+ avoid bad
+ state when dropped pullRequest returns normal
+ LOG_INFO("find consumer failed, drop undropped mq:%s",
+ mqtemp.toString().c_str());
+ }
+ }*/
+
+ THROW_MQEXCEPTION(MQClientException,
+ "doRebalance the cidAll is empty", -1);
+ }
+ // log
+ for (int i = 0; i < (int)cidAll.size(); ++i) {
+ LOG_INFO("client id:%s of topic:%s", cidAll[i].c_str(),
+ topic.c_str());
+ }
+ //<! sort;
+ sort(mqAll.begin(), mqAll.end());
+ sort(cidAll.begin(), cidAll.end());
+
+ //<! allocate;
+ vector<MQMessageQueue> allocateResult;
+ try {
+ m_pAllocateMQStrategy->allocate(m_pConsumer->getMQClientId(), mqAll,
+ cidAll, allocateResult);
+ } catch (MQException& e) {
+ THROW_MQEXCEPTION(MQClientException, "allocate error", -1);
+ }
+
+ // log
+ for (int i = 0; i < (int)allocateResult.size(); ++i) {
+ LOG_INFO("allocate mq:%s", allocateResult[i].toString().c_str());
+ }
+
+ //<!update local;
+ bool changed = updateRequestTableInRebalance(topic, allocateResult);
+ if (changed) {
+ messageQueueChanged(topic, mqAll, allocateResult);
+ break;
+ }
+ }
+ default:
+ break;
+ }
+ }
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ }
+}
+
+void Rebalance::persistConsumerOffset() {
+ DefaultMQPushConsumer* pConsumer =
+ static_cast<DefaultMQPushConsumer*>(m_pConsumer);
+ OffsetStore* pOffsetStore = pConsumer->getOffsetStore();
+ vector<MQMessageQueue> mqs;
+ {
+ boost::lock_guard<boost::mutex> lock(m_requestTableMutex);
+ MQ2PULLREQ::iterator it = m_requestQueueTable.begin();
+ for (; it != m_requestQueueTable.end(); ++it) {
+ if (it->second && (!it->second->isDroped())) {
+ mqs.push_back(it->first);
+ }
+ }
+ }
+
+ if (pConsumer->getMessageModel() == BROADCASTING) {
+ pOffsetStore->persistAll(mqs);
+ } else {
+ vector<MQMessageQueue>::iterator it2 = mqs.begin();
+ for (; it2 != mqs.end(); ++it2) {
+ pOffsetStore->persist(*it2, m_pConsumer->getSessionCredentials());
+ }
+ }
+}
+
+void Rebalance::persistConsumerOffsetByResetOffset() {
+ boost::lock_guard<boost::mutex> lock(m_requestTableMutex);
+ DefaultMQPushConsumer* pConsumer =
+ static_cast<DefaultMQPushConsumer*>(m_pConsumer);
+ OffsetStore* pOffsetStore = pConsumer->getOffsetStore();
+ vector<MQMessageQueue> mqs;
+ {
+ boost::lock_guard<boost::mutex> lock(m_requestTableMutex);
+ MQ2PULLREQ::iterator it = m_requestQueueTable.begin();
+ for (; it != m_requestQueueTable.end(); ++it) {
+ if (it->second) { // even if it was dropped, also need update offset when
+ // rcv resetOffset cmd
+ mqs.push_back(it->first);
+ }
+ }
+ }
+ vector<MQMessageQueue>::iterator it2 = mqs.begin();
+ for (; it2 != mqs.end(); ++it2) {
+ pOffsetStore->persist(*it2, m_pConsumer->getSessionCredentials());
+ }
+}
+
+SubscriptionData* Rebalance::getSubscriptionData(const string& topic) {
+ if (m_subscriptionData.find(topic) != m_subscriptionData.end()) {
+ return m_subscriptionData[topic];
+ }
+ return NULL;
+}
+
+map<string, SubscriptionData*>& Rebalance::getSubscriptionInner() {
+ return m_subscriptionData;
+}
+
+void Rebalance::setSubscriptionData(const string& topic,
+ SubscriptionData* pdata) {
+ if (pdata != NULL &&
+ m_subscriptionData.find(topic) == m_subscriptionData.end())
+ m_subscriptionData[topic] = pdata;
+}
+
+void Rebalance::setTopicSubscribeInfo(const string& topic,
+ vector<MQMessageQueue>& mqs) {
+ if (m_subscriptionData.find(topic) != m_subscriptionData.end()) {
+ {
+ boost::lock_guard<boost::mutex> lock(m_topicSubscribeInfoTableMutex);
+ if (m_topicSubscribeInfoTable.find(topic) !=
+ m_topicSubscribeInfoTable.end())
+ m_topicSubscribeInfoTable.erase(topic);
+ m_topicSubscribeInfoTable[topic] = mqs;
+ }
+ // log
+ vector<MQMessageQueue>::iterator it = mqs.begin();
+ for (; it != mqs.end(); ++it) {
+ LOG_DEBUG("topic [%s] has :%s", topic.c_str(), (*it).toString().c_str());
+ }
+ }
+}
+
+bool Rebalance::getTopicSubscribeInfo(const string& topic,
+ vector<MQMessageQueue>& mqs) {
+ boost::lock_guard<boost::mutex> lock(m_topicSubscribeInfoTableMutex);
+ if (m_topicSubscribeInfoTable.find(topic) !=
+ m_topicSubscribeInfoTable.end()) {
+ mqs = m_topicSubscribeInfoTable[topic];
+ return true;
+ }
+ return false;
+}
+
+void Rebalance::addPullRequest(MQMessageQueue mq, PullRequest* pPullRequest) {
+ boost::lock_guard<boost::mutex> lock(m_requestTableMutex);
+ m_requestQueueTable[mq] = pPullRequest;
+}
+
+PullRequest* Rebalance::getPullRequest(MQMessageQueue mq) {
+ boost::lock_guard<boost::mutex> lock(m_requestTableMutex);
+ if (m_requestQueueTable.find(mq) != m_requestQueueTable.end()) {
+ return m_requestQueueTable[mq];
+ }
+ return NULL;
+}
+
+map<MQMessageQueue, PullRequest*> Rebalance::getPullRequestTable() {
+ boost::lock_guard<boost::mutex> lock(m_requestTableMutex);
+ return m_requestQueueTable;
+}
+
+void Rebalance::unlockAll(bool oneway) {
+ map<string, vector<MQMessageQueue>*> brokerMqs;
+ MQ2PULLREQ requestQueueTable = getPullRequestTable();
+ for (MQ2PULLREQ::iterator it = requestQueueTable.begin();
+ it != requestQueueTable.end(); ++it) {
+ if (!(it->second->isDroped())) {
+ if (brokerMqs.find(it->first.getBrokerName()) == brokerMqs.end()) {
+ vector<MQMessageQueue>* mqs = new vector<MQMessageQueue>;
+ brokerMqs[it->first.getBrokerName()] = mqs;
+ } else {
+ brokerMqs[it->first.getBrokerName()]->push_back(it->first);
+ }
+ }
+ }
+ LOG_INFO("unLockAll %zu broker mqs", brokerMqs.size());
+ for (map<string, vector<MQMessageQueue>*>::iterator itb = brokerMqs.begin();
+ itb != brokerMqs.end(); ++itb) {
+ unique_ptr<FindBrokerResult> pFindBrokerResult(
+ m_pClientFactory->findBrokerAddressInSubscribe(itb->first, MASTER_ID,
+ true));
+ unique_ptr<UnlockBatchRequestBody> unlockBatchRequest(
+ new UnlockBatchRequestBody());
+ vector<MQMessageQueue> mqs(*(itb->second));
+ unlockBatchRequest->setClientId(m_pConsumer->getMQClientId());
+ unlockBatchRequest->setConsumerGroup(m_pConsumer->getGroupName());
+ unlockBatchRequest->setMqSet(mqs);
+
+ try {
+ m_pClientFactory->getMQClientAPIImpl()->unlockBatchMQ(
+ pFindBrokerResult->brokerAddr, unlockBatchRequest.get(), 1000,
+ m_pConsumer->getSessionCredentials());
+ for (unsigned int i = 0; i != mqs.size(); ++i) {
+ PullRequest* pullreq = getPullRequest(mqs[i]);
+ if (pullreq) {
+ LOG_INFO("unlockBatchMQ success of mq:%s", mqs[i].toString().c_str());
+ pullreq->setLocked(true);
+ } else {
+ LOG_ERROR("unlockBatchMQ fails of mq:%s", mqs[i].toString().c_str());
+ }
+ }
+ } catch (MQException& e) {
+ LOG_ERROR("unlockBatchMQ fails");
+ }
+ deleteAndZero(itb->second);
+ }
+ brokerMqs.clear();
+}
+
+void Rebalance::unlock(MQMessageQueue mq) {
+ unique_ptr<FindBrokerResult> pFindBrokerResult(
+ m_pClientFactory->findBrokerAddressInSubscribe(mq.getBrokerName(),
+ MASTER_ID, true));
+ unique_ptr<UnlockBatchRequestBody> unlockBatchRequest(
+ new UnlockBatchRequestBody());
+ vector<MQMessageQueue> mqs;
+ mqs.push_back(mq);
+ unlockBatchRequest->setClientId(m_pConsumer->getMQClientId());
+ unlockBatchRequest->setConsumerGroup(m_pConsumer->getGroupName());
+ unlockBatchRequest->setMqSet(mqs);
+
+ try {
+ m_pClientFactory->getMQClientAPIImpl()->unlockBatchMQ(
+ pFindBrokerResult->brokerAddr, unlockBatchRequest.get(), 1000,
+ m_pConsumer->getSessionCredentials());
+ for (unsigned int i = 0; i != mqs.size(); ++i) {
+ PullRequest* pullreq = getPullRequest(mqs[i]);
+ if (pullreq) {
+ LOG_INFO("unlock success of mq:%s", mqs[i].toString().c_str());
+ pullreq->setLocked(true);
+ } else {
+ LOG_ERROR("unlock fails of mq:%s", mqs[i].toString().c_str());
+ }
+ }
+ } catch (MQException& e) {
+ LOG_ERROR("unlock fails of mq:%s", mq.toString().c_str());
+ }
+}
+
+void Rebalance::lockAll() {
+ map<string, vector<MQMessageQueue>*> brokerMqs;
+ MQ2PULLREQ requestQueueTable = getPullRequestTable();
+ for (MQ2PULLREQ::iterator it = requestQueueTable.begin();
+ it != requestQueueTable.end(); ++it) {
+ if (!(it->second->isDroped())) {
+ string brokerKey = it->first.getBrokerName() + it->first.getTopic();
+ if (brokerMqs.find(brokerKey) == brokerMqs.end()) {
+ vector<MQMessageQueue>* mqs = new vector<MQMessageQueue>;
+ brokerMqs[brokerKey] = mqs;
+ brokerMqs[brokerKey]->push_back(it->first);
+ } else {
+ brokerMqs[brokerKey]->push_back(it->first);
+ }
+ }
+ }
+ LOG_INFO("LockAll %zu broker mqs", brokerMqs.size());
+ for (map<string, vector<MQMessageQueue>*>::iterator itb = brokerMqs.begin();
+ itb != brokerMqs.end(); ++itb) {
+ unique_ptr<FindBrokerResult> pFindBrokerResult(
+ m_pClientFactory->findBrokerAddressInSubscribe(
+ (*(itb->second))[0].getBrokerName(), MASTER_ID, true));
+ unique_ptr<LockBatchRequestBody> lockBatchRequest(
+ new LockBatchRequestBody());
+ lockBatchRequest->setClientId(m_pConsumer->getMQClientId());
+ lockBatchRequest->setConsumerGroup(m_pConsumer->getGroupName());
+ lockBatchRequest->setMqSet(*(itb->second));
+ LOG_INFO("try to lock:%zu mqs of broker:%s", itb->second->size(),
+ itb->first.c_str());
+ try {
+ vector<MQMessageQueue> messageQueues;
+ m_pClientFactory->getMQClientAPIImpl()->lockBatchMQ(
+ pFindBrokerResult->brokerAddr, lockBatchRequest.get(), messageQueues,
+ 1000, m_pConsumer->getSessionCredentials());
+ for (unsigned int i = 0; i != messageQueues.size(); ++i) {
+ PullRequest* pullreq = getPullRequest(messageQueues[i]);
+ if (pullreq) {
+ LOG_INFO("lockBatchMQ success of mq:%s",
+ messageQueues[i].toString().c_str());
+ pullreq->setLocked(true);
+ pullreq->setLastLockTimestamp(UtilAll::currentTimeMillis());
+ } else {
+ LOG_ERROR("lockBatchMQ fails of mq:%s",
+ messageQueues[i].toString().c_str());
+ }
+ }
+ messageQueues.clear();
+ } catch (MQException& e) {
+ LOG_ERROR("lockBatchMQ fails");
+ }
+ deleteAndZero(itb->second);
+ }
+ brokerMqs.clear();
+}
+bool Rebalance::lock(MQMessageQueue mq) {
+ unique_ptr<FindBrokerResult> pFindBrokerResult(
+ m_pClientFactory->findBrokerAddressInSubscribe(mq.getBrokerName(),
+ MASTER_ID, true));
+ unique_ptr<LockBatchRequestBody> lockBatchRequest(new LockBatchRequestBody());
+ lockBatchRequest->setClientId(m_pConsumer->getMQClientId());
+ lockBatchRequest->setConsumerGroup(m_pConsumer->getGroupName());
+ vector<MQMessageQueue> in_mqSet;
+ in_mqSet.push_back(mq);
+ lockBatchRequest->setMqSet(in_mqSet);
+ bool lockResult = false;
+
+ try {
+ vector<MQMessageQueue> messageQueues;
+ LOG_DEBUG("try to lock mq:%s", mq.toString().c_str());
+ m_pClientFactory->getMQClientAPIImpl()->lockBatchMQ(
+ pFindBrokerResult->brokerAddr, lockBatchRequest.get(), messageQueues,
+ 1000, m_pConsumer->getSessionCredentials());
+ if (messageQueues.size() == 0) {
+ LOG_ERROR("lock mq on broker:%s failed",
+ pFindBrokerResult->brokerAddr.c_str());
+ return false;
+ }
+ for (unsigned int i = 0; i != messageQueues.size(); ++i) {
+ PullRequest* pullreq = getPullRequest(messageQueues[i]);
+ if (pullreq) {
+ LOG_INFO("lock success of mq:%s", messageQueues[i].toString().c_str());
+ pullreq->setLocked(true);
+ pullreq->setLastLockTimestamp(UtilAll::currentTimeMillis());
+ lockResult = true;
+ } else {
+ LOG_ERROR("lock fails of mq:%s", messageQueues[i].toString().c_str());
+ }
+ }
+ messageQueues.clear();
+ return lockResult;
+ } catch (MQException& e) {
+ LOG_ERROR("lock fails of mq:%s", mq.toString().c_str());
+ return false;
+ }
+}
+
+//<!************************************************************************
+RebalancePull::RebalancePull(MQConsumer* consumer, MQClientFactory* pfactory)
+ : Rebalance(consumer, pfactory) {}
+
+bool RebalancePull::updateRequestTableInRebalance(
+ const string& topic, vector<MQMessageQueue>& mqsSelf) {
+ return false;
+}
+
+int64 RebalancePull::computePullFromWhere(const MQMessageQueue& mq) {
+ return 0;
+}
+
+void RebalancePull::messageQueueChanged(const string& topic,
+ vector<MQMessageQueue>& mqAll,
+ vector<MQMessageQueue>& mqDivided) {}
+
+void RebalancePull::removeUnnecessaryMessageQueue(const MQMessageQueue& mq) {}
+
+//<!***************************************************************************
+RebalancePush::RebalancePush(MQConsumer* consumer, MQClientFactory* pfactory)
+ : Rebalance(consumer, pfactory) {}
+
+bool RebalancePush::updateRequestTableInRebalance(
+ const string& topic, vector<MQMessageQueue>& mqsSelf) {
+ LOG_DEBUG("updateRequestTableInRebalance Enter");
+ if (mqsSelf.empty()) {
+ LOG_WARN("allocated queue is empty for topic:%s", topic.c_str());
+ }
+
+ bool changed = false;
+
+ //<!remove
+ MQ2PULLREQ requestQueueTable(getPullRequestTable());
+ MQ2PULLREQ::iterator it = requestQueueTable.begin();
+ for (; it != requestQueueTable.end(); ++it) {
+ MQMessageQueue mqtemp = it->first;
+ if (mqtemp.getTopic().compare(topic) == 0) {
+ if (mqsSelf.empty() ||
+ (find(mqsSelf.begin(), mqsSelf.end(), mqtemp) == mqsSelf.end())) {
+ if (!(it->second->isDroped())) {
+ it->second->setDroped(true);
+ removeUnnecessaryMessageQueue(mqtemp);
+ it->second->clearAllMsgs(); // add clear operation to avoid bad state
+ // when dropped pullRequest returns
+ // normal
+ LOG_INFO("drop mq:%s", mqtemp.toString().c_str());
+ }
+ changed = true;
+ }
+ }
+ }
+
+ //<!add
+ vector<PullRequest*> pullrequestAdd;
+ DefaultMQPushConsumer* pConsumer =
+ static_cast<DefaultMQPushConsumer*>(m_pConsumer);
+ vector<MQMessageQueue>::iterator it2 = mqsSelf.begin();
+ for (; it2 != mqsSelf.end(); ++it2) {
+ PullRequest* pPullRequest(getPullRequest(*it2));
+ if (pPullRequest && pPullRequest->isDroped()) {
+ LOG_DEBUG(
+ "before resume the pull handle of this pullRequest, its mq is:%s, "
+ "its offset is:%lld",
+ (it2->toString()).c_str(), pPullRequest->getNextOffset());
+ pConsumer->getOffsetStore()->removeOffset(
+ *it2); // remove dirty offset which maybe update to
+ // OffsetStore::m_offsetTable by consuming After last
+ // drop
+ int64 nextOffset = computePullFromWhere(*it2);
+ if (nextOffset >= 0) {
+ pPullRequest->setDroped(false);
+ pPullRequest->clearAllMsgs(); // avoid consume accumulation and consume
+ // dumplication issues
+ pPullRequest->setNextOffset(nextOffset);
+ pPullRequest->updateQueueMaxOffset(nextOffset);
+ LOG_INFO(
+ "after resume the pull handle of this pullRequest, its mq is:%s, "
+ "its offset is:%lld",
+ (it2->toString()).c_str(), pPullRequest->getNextOffset());
+ changed = true;
+ pConsumer->producePullMsgTask(pPullRequest);
+ } else {
+ LOG_ERROR(
+ "get fatel error QueryOffset of mq:%s, do not reconsume this queue",
+ (it2->toString()).c_str());
+ }
+ }
+
+ if (!pPullRequest) {
+ LOG_INFO("updateRequestTableInRebalance Doesn't find old mq");
+ PullRequest* pullRequest = new PullRequest(m_pConsumer->getGroupName());
+ pullRequest->m_messageQueue = *it2;
+
+ int64 nextOffset = computePullFromWhere(*it2);
+ if (nextOffset >= 0) {
+ pullRequest->setNextOffset(nextOffset);
+ pullRequest->clearAllMsgs(); // avoid consume accumulation and consume
+ // dumplication issues
+ changed = true;
+ //<! mq-> pq;
+ addPullRequest(*it2, pullRequest);
+ pullrequestAdd.push_back(pullRequest);
+ LOG_INFO("add mq:%s, request initiall offset:%lld",
+ (*it2).toString().c_str(), nextOffset);
+ }
+ }
+ }
+
+ vector<PullRequest*>::iterator it3 = pullrequestAdd.begin();
+ for (; it3 != pullrequestAdd.end(); ++it3) {
+ LOG_DEBUG("start pull request");
+ pConsumer->producePullMsgTask(*it3);
+ }
+
+ LOG_DEBUG("updateRequestTableInRebalance exit");
+ return changed;
+}
+
+int64 RebalancePush::computePullFromWhere(const MQMessageQueue& mq) {
+ int64 result = -1;
+ DefaultMQPushConsumer* pConsumer =
+ static_cast<DefaultMQPushConsumer*>(m_pConsumer);
+ ConsumeFromWhere consumeFromWhere = pConsumer->getConsumeFromWhere();
+ OffsetStore* pOffsetStore = pConsumer->getOffsetStore();
+ switch (consumeFromWhere) {
+ case CONSUME_FROM_LAST_OFFSET: {
+ int64 lastOffset = pOffsetStore->readOffset(
+ mq, READ_FROM_STORE, m_pConsumer->getSessionCredentials());
+ if (lastOffset >= 0) {
+ LOG_INFO("CONSUME_FROM_LAST_OFFSET, lastOffset of mq:%s is:%lld",
+ mq.toString().c_str(), lastOffset);
+ result = lastOffset;
+ }
+ else if (-1 == lastOffset) {
+ LOG_WARN("CONSUME_FROM_LAST_OFFSET, lastOffset of mq:%s is -1",
+ mq.toString().c_str());
+ if (UtilAll::startsWith_retry(mq.getTopic())) {
+ LOG_INFO("CONSUME_FROM_LAST_OFFSET, lastOffset of mq:%s is 0",
+ mq.toString().c_str());
+ result = 0;
+ }
+ else {
+ try {
+ result = pConsumer->maxOffset(mq);
+ LOG_INFO("CONSUME_FROM_LAST_OFFSET, maxOffset of mq:%s is:%lld",
+ mq.toString().c_str(), result);
+ } catch (MQException& e) {
+ LOG_ERROR(
+ "CONSUME_FROM_LAST_OFFSET error, lastOffset of mq:%s is -1",
+ mq.toString().c_str());
+ result = -1;
+ }
+ }
+ }
+ else {
+ LOG_ERROR("CONSUME_FROM_LAST_OFFSET error, lastOffset of mq:%s is -1",
+ mq.toString().c_str());
+ result = -1;
+ }
+ break;
+ }
+ case CONSUME_FROM_FIRST_OFFSET: {
+ int64 lastOffset = pOffsetStore->readOffset(
+ mq, READ_FROM_STORE, m_pConsumer->getSessionCredentials());
+ if (lastOffset >= 0) {
+ LOG_INFO("CONSUME_FROM_FIRST_OFFSET, lastOffset of mq:%s is:%lld",
+ mq.toString().c_str(), lastOffset);
+ result = lastOffset;
+ } else if (-1 == lastOffset)
+ {
+ LOG_INFO("CONSUME_FROM_FIRST_OFFSET, lastOffset of mq:%s, return 0",
+ mq.toString().c_str());
+ result = 0;
+ }
+ else {
+ LOG_ERROR("CONSUME_FROM_FIRST_OFFSET, lastOffset of mq:%s, return -1",
+ mq.toString().c_str());
+ result = -1;
+ }
+ break;
+ }
+ case CONSUME_FROM_TIMESTAMP: {
+ int64 lastOffset = pOffsetStore->readOffset(
+ mq, READ_FROM_STORE, m_pConsumer->getSessionCredentials());
+ if (lastOffset >= 0) {
+ LOG_INFO("CONSUME_FROM_TIMESTAMP, lastOffset of mq:%s is:%lld",
+ mq.toString().c_str(), lastOffset);
+ result = lastOffset;
+ }
+ else if (-1 == lastOffset) {
+ if (UtilAll::startsWith_retry(mq.getTopic())) {
+ try {
+ result = pConsumer->maxOffset(mq);
+ LOG_INFO("CONSUME_FROM_TIMESTAMP, maxOffset of mq:%s is:%lld",
+ mq.toString().c_str(), result);
+ } catch (MQException& e) {
+ LOG_ERROR(
+ "CONSUME_FROM_TIMESTAMP error, lastOffset of mq:%s is -1",
+ mq.toString().c_str());
+ result = -1;
+ }
+ }
+ else {
+ try {
+ } catch (MQException& e) {
+ LOG_ERROR(
+ "CONSUME_FROM_TIMESTAMP error, lastOffset of mq:%s, return 0",
+ mq.toString().c_str());
+ result = -1;
+ }
+ }
+ }
+ else {
+ LOG_ERROR(
+ "CONSUME_FROM_TIMESTAMP error, lastOffset of mq:%s, return -1",
+ mq.toString().c_str());
+ result = -1;
+ }
+ break;
+ }
+ default:
+ break;
+ }
+ return result;
+}
+
+void RebalancePush::messageQueueChanged(const string& topic,
+ vector<MQMessageQueue>& mqAll,
+ vector<MQMessageQueue>& mqDivided) {}
+
+void RebalancePush::removeUnnecessaryMessageQueue(const MQMessageQueue& mq) {
+ DefaultMQPushConsumer* pConsumer =
+ static_cast<DefaultMQPushConsumer*>(m_pConsumer);
+ OffsetStore* pOffsetStore = pConsumer->getOffsetStore();
+
+ pOffsetStore->persist(mq, m_pConsumer->getSessionCredentials());
+ pOffsetStore->removeOffset(mq);
+ if (pConsumer->getMessageListenerType() == messageListenerOrderly) {
+ unlock(mq);
+ }
+}
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/Rebalance.h b/rocketmq-cpp/src/consumer/Rebalance.h
new file mode 100755
index 00000000..42f86679
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/Rebalance.h
@@ -0,0 +1,123 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __REBALANCEIMPL_H__
+#define __REBALANCEIMPL_H__
+
+#include "AllocateMQStrategy.h"
+#include "ConsumeType.h"
+#include "MQConsumer.h"
+#include "MQMessageQueue.h"
+#include "PullRequest.h"
+#include "SubscriptionData.h"
+
+#include <boost/thread/mutex.hpp>
+
+namespace rocketmq {
+class MQClientFactory;
+//<!************************************************************************
+class Rebalance {
+ public:
+ Rebalance(MQConsumer*, MQClientFactory*);
+ virtual ~Rebalance();
+
+ virtual void messageQueueChanged(const string& topic,
+ vector<MQMessageQueue>& mqAll,
+ vector<MQMessageQueue>& mqDivided) = 0;
+
+ virtual void removeUnnecessaryMessageQueue(const MQMessageQueue& mq) = 0;
+
+ virtual int64 computePullFromWhere(const MQMessageQueue& mq) = 0;
+
+ virtual bool updateRequestTableInRebalance(
+ const string& topic, vector<MQMessageQueue>& mqsSelf) = 0;
+
+ public:
+ void doRebalance();
+ void persistConsumerOffset();
+ void persistConsumerOffsetByResetOffset();
+ //<!m_subscriptionInner;
+ SubscriptionData* getSubscriptionData(const string& topic);
+ void setSubscriptionData(const string& topic, SubscriptionData* pdata);
+
+ map<string, SubscriptionData*>& getSubscriptionInner();
+
+ //<!m_topicSubscribeInfoTable;
+ void setTopicSubscribeInfo(const string& topic, vector<MQMessageQueue>& mqs);
+ bool getTopicSubscribeInfo(const string& topic, vector<MQMessageQueue>& mqs);
+
+ void addPullRequest(MQMessageQueue mq, PullRequest* pPullRequest);
+ PullRequest* getPullRequest(MQMessageQueue mq);
+ map<MQMessageQueue, PullRequest*> getPullRequestTable();
+ void lockAll();
+ bool lock(MQMessageQueue mq);
+ void unlockAll(bool oneway = false);
+ void unlock(MQMessageQueue mq);
+
+ protected:
+ map<string, SubscriptionData*> m_subscriptionData;
+
+ boost::mutex m_topicSubscribeInfoTableMutex;
+ map<string, vector<MQMessageQueue>> m_topicSubscribeInfoTable;
+ typedef map<MQMessageQueue, PullRequest*> MQ2PULLREQ;
+ MQ2PULLREQ m_requestQueueTable;
+ boost::mutex m_requestTableMutex;
+
+ AllocateMQStrategy* m_pAllocateMQStrategy;
+ MQConsumer* m_pConsumer;
+ MQClientFactory* m_pClientFactory;
+};
+
+//<!************************************************************************
+class RebalancePull : public Rebalance {
+ public:
+ RebalancePull(MQConsumer*, MQClientFactory*);
+ virtual ~RebalancePull(){};
+
+ virtual void messageQueueChanged(const string& topic,
+ vector<MQMessageQueue>& mqAll,
+ vector<MQMessageQueue>& mqDivided);
+
+ virtual void removeUnnecessaryMessageQueue(const MQMessageQueue& mq);
+
+ virtual int64 computePullFromWhere(const MQMessageQueue& mq);
+
+ virtual bool updateRequestTableInRebalance(const string& topic,
+ vector<MQMessageQueue>& mqsSelf);
+};
+
+//<!***************************************************************************
+class RebalancePush : public Rebalance {
+ public:
+ RebalancePush(MQConsumer*, MQClientFactory*);
+ virtual ~RebalancePush(){};
+
+ virtual void messageQueueChanged(const string& topic,
+ vector<MQMessageQueue>& mqAll,
+ vector<MQMessageQueue>& mqDivided);
+
+ virtual void removeUnnecessaryMessageQueue(const MQMessageQueue& mq);
+
+ virtual int64 computePullFromWhere(const MQMessageQueue& mq);
+
+ virtual bool updateRequestTableInRebalance(const string& topic,
+ vector<MQMessageQueue>& mqsSelf);
+};
+
+//<!************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/consumer/SubscriptionData.cpp b/rocketmq-cpp/src/consumer/SubscriptionData.cpp
new file mode 100755
index 00000000..9b206423
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/SubscriptionData.cpp
@@ -0,0 +1,120 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "SubscriptionData.h"
+#include <algorithm>
+#include <sstream>
+#include <vector>
+#include "UtilAll.h"
+#include "Logging.h"
+namespace rocketmq {
+//<!************************************************************************
+SubscriptionData::SubscriptionData() {
+ m_subVersion = UtilAll::currentTimeMillis();
+}
+
+SubscriptionData::SubscriptionData(const string& topic, const string& subString)
+ : m_topic(topic), m_subString(subString) {
+ m_subVersion = UtilAll::currentTimeMillis();
+}
+
+SubscriptionData::SubscriptionData(const SubscriptionData& other) {
+ m_subString = other.m_subString;
+ m_subVersion = other.m_subVersion;
+ m_tagSet = other.m_tagSet;
+ m_topic = other.m_topic;
+ m_codeSet = other.m_codeSet;
+}
+
+const string& SubscriptionData::getTopic() const { return m_topic; }
+
+const string& SubscriptionData::getSubString() const { return m_subString; }
+
+void SubscriptionData::setSubString(const string& sub) { m_subString = sub; }
+
+int64 SubscriptionData::getSubVersion() const { return m_subVersion; }
+
+void SubscriptionData::putTagsSet(const string& tag) {
+ m_tagSet.push_back(tag);
+}
+
+bool SubscriptionData::containTag(const string& tag) {
+ return std::find(m_tagSet.begin(), m_tagSet.end(), tag) != m_tagSet.end();
+}
+
+vector<string>& SubscriptionData::getTagsSet() { return m_tagSet; }
+
+bool SubscriptionData::operator==(const SubscriptionData& other) const {
+ if (!m_subString.compare(other.m_subString)) {
+ return false;
+ }
+ if (m_subVersion != other.m_subVersion) {
+ return false;
+ }
+ if (m_tagSet.size() != other.m_tagSet.size()) {
+ return false;
+ }
+ if (!m_topic.compare(other.m_topic)) {
+ return false;
+ }
+ return true;
+}
+
+bool SubscriptionData::operator<(const SubscriptionData& other) const {
+ int ret = m_topic.compare(other.m_topic);
+ if (ret < 0) {
+ return true;
+ } else if (ret == 0) {
+ ret = m_subString.compare(other.m_subString);
+ if (ret < 0) {
+ return true;
+ } else {
+ return false;
+ }
+ } else {
+ return false;
+ }
+}
+
+void SubscriptionData::putCodeSet(const string& tag) {
+ int value = atoi(tag.c_str());
+ m_codeSet.push_back(value);
+}
+
+Json::Value SubscriptionData::toJson() const {
+ Json::Value outJson;
+ outJson["subString"] = m_subString;
+ outJson["subVersion"] = UtilAll::to_string(m_subVersion);
+ outJson["topic"] = m_topic;
+
+ {
+ vector<string>::const_iterator it = m_tagSet.begin();
+ for (; it != m_tagSet.end(); it++) {
+ outJson["tagsSet"].append(*it);
+ }
+ }
+
+ {
+ vector<int>::const_iterator it = m_codeSet.begin();
+ for (; it != m_codeSet.end(); it++) {
+ outJson["codeSet"].append(*it);
+ }
+ }
+ return outJson;
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/consumer/SubscriptionData.h b/rocketmq-cpp/src/consumer/SubscriptionData.h
new file mode 100755
index 00000000..89be74fe
--- /dev/null
+++ b/rocketmq-cpp/src/consumer/SubscriptionData.h
@@ -0,0 +1,62 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __SUBSCRIPTIONDATA_H__
+#define __SUBSCRIPTIONDATA_H__
+
+#include <string>
+#include "UtilAll.h"
+#include "json/json.h"
+
+namespace rocketmq {
+//<!************************************************************************
+class SubscriptionData {
+ public:
+ SubscriptionData();
+ virtual ~SubscriptionData() {
+ m_tagSet.clear();
+ m_codeSet.clear();
+ }
+ SubscriptionData(const string& topic, const string& subString);
+ SubscriptionData(const SubscriptionData& other);
+
+ const string& getTopic() const;
+ const string& getSubString() const;
+ void setSubString(const string& sub);
+ int64 getSubVersion() const;
+
+ void putTagsSet(const string& tag);
+ bool containTag(const string& tag);
+ vector<string>& getTagsSet();
+
+ void putCodeSet(const string& tag);
+
+ bool operator==(const SubscriptionData& other) const;
+ bool operator<(const SubscriptionData& other) const;
+
+ Json::Value toJson() const;
+
+ private:
+ string m_topic;
+ string m_subString;
+ int64 m_subVersion;
+ vector<string> m_tagSet;
+ vector<int> m_codeSet;
+};
+//<!***************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/dllmain.cpp b/rocketmq-cpp/src/dllmain.cpp
new file mode 100755
index 00000000..72f61fd4
--- /dev/null
+++ b/rocketmq-cpp/src/dllmain.cpp
@@ -0,0 +1,34 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include <stdio.h>
+#include "windows.h"
+
+BOOL APIENTRY DllMain(HMODULE hModule, DWORD ul_reason_for_call,
+ LPVOID lpReserved) {
+ switch (ul_reason_for_call) {
+ case DLL_PROCESS_ATTACH:
+ break;
+ case DLL_THREAD_ATTACH:
+ break;
+ case DLL_THREAD_DETACH:
+ break;
+ case DLL_PROCESS_DETACH:
+ break;
+ }
+ return TRUE;
+}
diff --git a/rocketmq-cpp/src/log/Logging.cpp b/rocketmq-cpp/src/log/Logging.cpp
new file mode 100644
index 00000000..9ac812f4
--- /dev/null
+++ b/rocketmq-cpp/src/log/Logging.cpp
@@ -0,0 +1,96 @@
+#include "Logging.h"
+#include <boost/date_time/gregorian/gregorian.hpp>
+#include "UtilAll.h"
+#define BOOST_DATE_TIME_SOURCE
+
+namespace rocketmq {
+
+logAdapter::~logAdapter() { logging::core::get()->remove_all_sinks(); }
+
+logAdapter& logAdapter::getLogInstance() {
+ static logAdapter alogInstance;
+ return alogInstance;
+}
+
+logAdapter::logAdapter() : m_logLevel(eLOG_LEVEL_INFO) {
+ string homeDir(UtilAll::getHomeDirectory());
+ homeDir.append("/logs/metaq-client4cpp/");
+ m_logFile += homeDir;
+ std::string fileName =
+ UtilAll::to_string(getpid()) + "_" + "rocketmq-cpp.log.%N";
+ m_logFile += fileName;
+
+ // boost::log::expressions::attr<
+ // boost::log::attributes::current_thread_id::value_type>("ThreadID");
+ boost::log::register_simple_formatter_factory<
+ boost::log::trivial::severity_level, char>("Severity");
+ m_logSink = logging::add_file_log(
+ keywords::file_name = m_logFile,
+ keywords::rotation_size = 10 * 1024 * 1024,
+ keywords::time_based_rotation =
+ sinks::file::rotation_at_time_point(0, 0, 0),
+ keywords::format = "[%TimeStamp%](%Severity%):%Message%",
+ keywords::min_free_space = 300 * 1024 * 1024, keywords::target = homeDir,
+ keywords::max_size = 20 * 1024 * 1024, // max keep 3 log file defaultly
+ keywords::auto_flush = true);
+ logging::core::get()->set_filter(logging::trivial::severity >=
+ logging::trivial::info);
+
+ logging::add_common_attributes();
+}
+
+void logAdapter::setLogLevel(elogLevel logLevel) {
+ m_logLevel = logLevel;
+ switch (logLevel) {
+ case eLOG_LEVEL_DISABLE:
+ logging::core::get()->set_filter(logging::trivial::severity >
+ logging::trivial::fatal);
+
+ break;
+ case eLOG_LEVEL_FATAL:
+ logging::core::get()->set_filter(logging::trivial::severity >=
+ logging::trivial::fatal);
+ break;
+ case eLOG_LEVEL_ERROR:
+ logging::core::get()->set_filter(logging::trivial::severity >=
+ logging::trivial::error);
+
+ break;
+ case eLOG_LEVEL_WARN:
+ logging::core::get()->set_filter(logging::trivial::severity >=
+ logging::trivial::warning);
+
+ break;
+ case eLOG_LEVEL_INFO:
+ logging::core::get()->set_filter(logging::trivial::severity >=
+ logging::trivial::info);
+
+ break;
+ case eLOG_LEVEL_DEBUG:
+ logging::core::get()->set_filter(logging::trivial::severity >=
+ logging::trivial::debug);
+
+ break;
+ case eLOG_LEVEL_TRACE:
+ logging::core::get()->set_filter(logging::trivial::severity >=
+ logging::trivial::trace);
+
+ break;
+ default:
+ logging::core::get()->set_filter(logging::trivial::severity >=
+ logging::trivial::info);
+
+ break;
+ }
+}
+
+elogLevel logAdapter::getLogLevel() { return m_logLevel; }
+
+void logAdapter::setLogFileNumAndSize(int logNum, int sizeOfPerFile) {
+ string homeDir(UtilAll::getHomeDirectory());
+ homeDir.append("/logs/metaq-client4cpp/");
+ m_logSink->locked_backend()->set_file_collector(sinks::file::make_collector(
+ keywords::target = homeDir,
+ keywords::max_size = logNum * sizeOfPerFile * 1024 * 1024));
+}
+}
diff --git a/rocketmq-cpp/src/log/Logging.h b/rocketmq-cpp/src/log/Logging.h
new file mode 100644
index 00000000..98e96599
--- /dev/null
+++ b/rocketmq-cpp/src/log/Logging.h
@@ -0,0 +1,75 @@
+#ifndef _ALOG_ADAPTER_H_
+#define _ALOG_ADAPTER_H_
+
+#include <boost/date_time/posix_time/posix_time_types.hpp>
+#include <boost/log/core.hpp>
+#include <boost/log/expressions.hpp>
+#include <boost/log/sinks/text_file_backend.hpp>
+#include <boost/log/sources/record_ostream.hpp>
+#include <boost/log/sources/severity_logger.hpp>
+#include <boost/log/trivial.hpp>
+#include <boost/log/utility/manipulators/add_value.hpp>
+#include <boost/log/utility/setup/common_attributes.hpp>
+#include <boost/log/utility/setup/file.hpp>
+#include <boost/scoped_array.hpp>
+#include <boost/shared_ptr.hpp>
+#include "MQClient.h"
+
+namespace logging = boost::log;
+namespace src = boost::log::sources;
+namespace sinks = boost::log::sinks;
+namespace expr = boost::log::expressions;
+namespace keywords = boost::log::keywords;
+using namespace boost::log::trivial;
+namespace rocketmq {
+
+class logAdapter {
+ public:
+ ~logAdapter();
+ static logAdapter& getLogInstance();
+ void setLogLevel(elogLevel logLevel);
+ elogLevel getLogLevel();
+ void setLogFileNumAndSize(int logNum, int sizeOfPerFile);
+ src::severity_logger<boost::log::trivial::severity_level>&
+ getSeverityLogger() {
+ return m_severityLogger;
+ }
+
+ private:
+ logAdapter();
+ elogLevel m_logLevel;
+ std::string m_logFile;
+ src::severity_logger<boost::log::trivial::severity_level> m_severityLogger;
+ typedef sinks::synchronous_sink<sinks::text_file_backend> logSink_t;
+ boost::shared_ptr<logSink_t> m_logSink;
+};
+
+#define ALOG_ADAPTER logAdapter::getLogInstance()
+
+#define AGENT_LOGGER ALOG_ADAPTER.getSeverityLogger()
+
+class LogUtil {
+ public:
+ static void VLogError(boost::log::trivial::severity_level level,
+ const char* format, ...) {
+ va_list arg_ptr;
+ va_start(arg_ptr, format);
+ boost::scoped_array<char> formattedString(new char[1024]);
+ vsnprintf(formattedString.get(), 1024, format, arg_ptr);
+ BOOST_LOG_SEV(AGENT_LOGGER, level) << formattedString.get();
+ va_end(arg_ptr);
+ }
+};
+
+#define LOG_FATAL(format, args...) \
+ LogUtil::VLogError(boost::log::trivial::fatal, format, ##args)
+#define LOG_ERROR(format, args...) \
+ LogUtil::VLogError(boost::log::trivial::error, format, ##args)
+#define LOG_WARN(format, args...) \
+ LogUtil::VLogError(boost::log::trivial::warning, format, ##args)
+#define LOG_INFO(format, args...) \
+ LogUtil::VLogError(boost::log::trivial::info, format, ##args)
+#define LOG_DEBUG(format, args...) \
+ LogUtil::VLogError(boost::log::trivial::debug, format, ##args)
+}
+#endif
diff --git a/rocketmq-cpp/src/message/MQDecoder.cpp b/rocketmq-cpp/src/message/MQDecoder.cpp
new file mode 100755
index 00000000..4dde1f54
--- /dev/null
+++ b/rocketmq-cpp/src/message/MQDecoder.cpp
@@ -0,0 +1,254 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "MQDecoder.h"
+#include <stdio.h>
+#include <stdlib.h>
+#include <string.h>
+#include <sstream>
+#include "Logging.h"
+#include "MemoryOutputStream.h"
+#include "MessageSysFlag.h"
+#include "UtilAll.h"
+namespace rocketmq {
+//<!***************************************************************************
+const int MQDecoder::MSG_ID_LENGTH = 8 + 8;
+
+const char MQDecoder::NAME_VALUE_SEPARATOR = 1;
+const char MQDecoder::PROPERTY_SEPARATOR = 2;
+
+int MQDecoder::MessageMagicCodePostion = 4;
+int MQDecoder::MessageFlagPostion = 16;
+int MQDecoder::MessagePhysicOffsetPostion = 28;
+int MQDecoder::MessageStoreTimestampPostion = 56;
+//<!***************************************************************************
+string MQDecoder::createMessageId(sockaddr addr, int64 offset) {
+ int host, port;
+ socketAddress2IPPort(addr, host, port);
+
+ MemoryOutputStream outputmen(MSG_ID_LENGTH);
+ outputmen.writeIntBigEndian(host);
+ outputmen.writeIntBigEndian(port);
+ outputmen.writeInt64BigEndian(offset);
+
+ const char* bytes = static_cast<const char*>(outputmen.getData());
+ int len = outputmen.getDataSize();
+
+ return UtilAll::bytes2string(bytes, len);
+}
+
+MQMessageId MQDecoder::decodeMessageId(const string& msgId) {
+
+ string ipstr = msgId.substr(0, 8);
+ string portstr = msgId.substr(8, 8);
+ string offsetstr = msgId.substr(16);
+
+ char* end;
+ int ipint = strtoul(ipstr.c_str(), &end, 16);
+ int portint = strtoul(portstr.c_str(), &end, 16);
+
+ int64 offset = UtilAll::hexstr2ull(offsetstr.c_str());
+
+ offset = n2hll(offset);
+
+ portint = ntohl(portint);
+ short port = portint;
+
+ struct sockaddr_in sa;
+ sa.sin_family = AF_INET;
+ sa.sin_port = htons(port);
+ sa.sin_addr.s_addr = ipint;
+
+ sockaddr addr;
+ memcpy(&addr, &sa, sizeof(sockaddr));
+
+ MQMessageId id(addr, offset);
+
+ return id;
+}
+
+MQMessageExt* MQDecoder::decode(MemoryInputStream& byteBuffer) {
+ return decode(byteBuffer, true);
+}
+
+MQMessageExt* MQDecoder::decode(MemoryInputStream& byteBuffer, bool readBody) {
+ MQMessageExt* msgExt = new MQMessageExt();
+
+ // 1 TOTALSIZE
+ int storeSize = byteBuffer.readIntBigEndian();
+ msgExt->setStoreSize(storeSize);
+
+ // 2 MAGICCODE sizeof(int)
+ byteBuffer.skipNextBytes(sizeof(int));
+
+ // 3 BODYCRC
+ int bodyCRC = byteBuffer.readIntBigEndian();
+ msgExt->setBodyCRC(bodyCRC);
+
+ // 4 QUEUEID
+ int queueId = byteBuffer.readIntBigEndian();
+ msgExt->setQueueId(queueId);
+
+ // 5 FLAG
+ int flag = byteBuffer.readIntBigEndian();
+ msgExt->setFlag(flag);
+
+ // 6 QUEUEOFFSET
+ int64 queueOffset = byteBuffer.readInt64BigEndian();
+ msgExt->setQueueOffset(queueOffset);
+
+ // 7 PHYSICALOFFSET
+ int64 physicOffset = byteBuffer.readInt64BigEndian();
+ msgExt->setCommitLogOffset(physicOffset);
+
+ // 8 SYSFLAG
+ int sysFlag = byteBuffer.readIntBigEndian();
+ msgExt->setSysFlag(sysFlag);
+
+ // 9 BORNTIMESTAMP
+ int64 bornTimeStamp = byteBuffer.readInt64BigEndian();
+ msgExt->setBornTimestamp(bornTimeStamp);
+
+ // 10 BORNHOST
+ int bornHost = byteBuffer.readIntBigEndian();
+ int port = byteBuffer.readIntBigEndian();
+ sockaddr bornAddr = IPPort2socketAddress(bornHost, port);
+ msgExt->setBornHost(bornAddr);
+
+ // 11 STORETIMESTAMP
+ int64 storeTimestamp = byteBuffer.readInt64BigEndian();
+ msgExt->setStoreTimestamp(storeTimestamp);
+
+ // // 12 STOREHOST
+ int storeHost = byteBuffer.readIntBigEndian();
+ port = byteBuffer.readIntBigEndian();
+ sockaddr storeAddr = IPPort2socketAddress(storeHost, port);
+ msgExt->setStoreHost(storeAddr);
+
+ // 13 RECONSUMETIMES
+ int reconsumeTimes = byteBuffer.readIntBigEndian();
+ msgExt->setReconsumeTimes(reconsumeTimes);
+
+ // 14 Prepared Transaction Offset
+ int64 preparedTransactionOffset = byteBuffer.readInt64BigEndian();
+ msgExt->setPreparedTransactionOffset(preparedTransactionOffset);
+
+ // 15 BODY
+ int bodyLen = byteBuffer.readIntBigEndian();
+ if (bodyLen > 0) {
+ if (readBody) {
+ MemoryBlock block;
+ byteBuffer.readIntoMemoryBlock(block, bodyLen);
+
+ const char* const pBody = static_cast<const char*>(block.getData());
+ int len = block.getSize();
+ string msgbody(pBody, len);
+
+ // decompress body
+ if ((sysFlag & MessageSysFlag::CompressedFlag) ==
+ MessageSysFlag::CompressedFlag) {
+ string outbody;
+ if (UtilAll::inflate(msgbody, outbody)) {
+ msgExt->setBody(outbody);
+ }
+ } else {
+ msgExt->setBody(msgbody);
+ }
+ } else {
+ byteBuffer.skipNextBytes(bodyLen);
+ }
+ }
+
+ // 16 TOPIC
+ int topicLen = (int)byteBuffer.readByte();
+ MemoryBlock block;
+ byteBuffer.readIntoMemoryBlock(block, topicLen);
+ const char* const pTopic = static_cast<const char*>(block.getData());
+ topicLen = block.getSize();
+ msgExt->setTopic(pTopic, topicLen);
+
+ // 17 properties
+ short propertiesLen = byteBuffer.readShortBigEndian();
+ if (propertiesLen > 0) {
+ MemoryBlock block;
+ byteBuffer.readIntoMemoryBlock(block, propertiesLen);
+ const char* const pProperty = static_cast<const char*>(block.getData());
+ int len = block.getSize();
+ string propertiesString(pProperty, len);
+
+ map<string, string> propertiesMap;
+ string2messageProperties(propertiesString, propertiesMap);
+ msgExt->setProperties(propertiesMap);
+ propertiesMap.clear();
+ }
+
+ // 18 msg ID
+ string msgId = createMessageId(msgExt->getStoreHost(),
+ (int64)msgExt->getCommitLogOffset());
+ msgExt->setMsgId(msgId);
+
+ // LOG_INFO("get msgExt from remote server, its contents
+ // are:%s",msgExt->toString().c_str());
+ return msgExt;
+}
+
+void MQDecoder::decodes(const MemoryBlock* mem, vector<MQMessageExt>& mqvec) {
+ mqvec.clear();
+ decodes(mem, mqvec, true);
+}
+
+void MQDecoder::decodes(const MemoryBlock* mem, vector<MQMessageExt>& mqvec,
+ bool readBody) {
+ MemoryInputStream rawInput(*mem, true);
+
+ while (rawInput.getNumBytesRemaining() > 0) {
+ unique_ptr<MQMessageExt> msg(decode(rawInput, readBody));
+ mqvec.push_back(*msg);
+ }
+}
+
+string MQDecoder::messageProperties2String(
+ const map<string, string>& properties) {
+ string os;
+ map<string, string>::const_iterator it = properties.begin();
+
+ for (; it != properties.end(); ++it) {
+ // os << it->first << NAME_VALUE_SEPARATOR << it->second <<
+ // PROPERTY_SEPARATOR;
+ os.append(it->first);
+ os += NAME_VALUE_SEPARATOR;
+ os.append(it->second);
+ os += PROPERTY_SEPARATOR;
+ }
+
+ return os;
+}
+
+void MQDecoder::string2messageProperties(const string& propertiesString,
+ map<string, string>& properties) {
+ vector<string> out;
+ UtilAll::Split(out, propertiesString, PROPERTY_SEPARATOR);
+
+ for (size_t i = 0; i < out.size(); i++) {
+ vector<string> outValue;
+ UtilAll::Split(outValue, out[i], NAME_VALUE_SEPARATOR);
+
+ if (outValue.size() == 2) {
+ properties[outValue[0]] = outValue[1];
+ }
+ }
+}
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/message/MQDecoder.h b/rocketmq-cpp/src/message/MQDecoder.h
new file mode 100755
index 00000000..393e4c72
--- /dev/null
+++ b/rocketmq-cpp/src/message/MQDecoder.h
@@ -0,0 +1,57 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MESSAGEDECODER_H__
+#define __MESSAGEDECODER_H__
+
+#include "MQClientException.h"
+#include "MQMessageExt.h"
+#include "MQMessageId.h"
+#include "MemoryInputStream.h"
+#include "SocketUtil.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class MQDecoder {
+ public:
+ static string createMessageId(sockaddr addr, int64 offset);
+ static MQMessageId decodeMessageId(const string& msgId);
+
+ static void decodes(const MemoryBlock* mem, vector<MQMessageExt>& mqvec);
+
+ static void decodes(const MemoryBlock* mem, vector<MQMessageExt>& mqvec,
+ bool readBody);
+
+ static string messageProperties2String(const map<string, string>& properties);
+ static void string2messageProperties(const string& propertiesString,
+ map<string, string>& properties);
+
+ private:
+ static MQMessageExt* decode(MemoryInputStream& byteBuffer);
+ static MQMessageExt* decode(MemoryInputStream& byteBuffer, bool readBody);
+
+ public:
+ static const char NAME_VALUE_SEPARATOR;
+ static const char PROPERTY_SEPARATOR;
+ static const int MSG_ID_LENGTH;
+ static int MessageMagicCodePostion;
+ static int MessageFlagPostion;
+ static int MessagePhysicOffsetPostion;
+ static int MessageStoreTimestampPostion;
+};
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/message/MQMessage.cpp b/rocketmq-cpp/src/message/MQMessage.cpp
new file mode 100755
index 00000000..db5487f1
--- /dev/null
+++ b/rocketmq-cpp/src/message/MQMessage.cpp
@@ -0,0 +1,197 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "MQMessage.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+
+const string MQMessage::PROPERTY_KEYS = "KEYS";
+const string MQMessage::PROPERTY_TAGS = "TAGS";
+const string MQMessage::PROPERTY_WAIT_STORE_MSG_OK = "WAIT";
+const string MQMessage::PROPERTY_DELAY_TIME_LEVEL = "DELAY";
+const string MQMessage::PROPERTY_RETRY_TOPIC = "RETRY_TOPIC";
+const string MQMessage::PROPERTY_REAL_TOPIC = "REAL_TOPIC";
+const string MQMessage::PROPERTY_REAL_QUEUE_ID = "REAL_QID";
+const string MQMessage::PROPERTY_TRANSACTION_PREPARED = "TRAN_MSG";
+const string MQMessage::PROPERTY_PRODUCER_GROUP = "PGROUP";
+const string MQMessage::PROPERTY_MIN_OFFSET = "MIN_OFFSET";
+const string MQMessage::PROPERTY_MAX_OFFSET = "MAX_OFFSET";
+const string MQMessage::KEY_SEPARATOR = " ";
+//<!************************************************************************
+MQMessage::MQMessage() { Init("", "", "", 0, "", true); }
+
+MQMessage::MQMessage(const string& topic, const string& body) {
+ Init(topic, "", "", 0, body, true);
+}
+
+MQMessage::MQMessage(const string& topic, const string& tags,
+ const string& body) {
+ Init(topic, tags, "", 0, body, true);
+}
+
+MQMessage::MQMessage(const string& topic, const string& tags,
+ const string& keys, const string& body) {
+ Init(topic, tags, keys, 0, body, true);
+}
+
+MQMessage::MQMessage(const string& topic, const string& tags,
+ const string& keys, const int flag, const string& body,
+ bool waitStoreMsgOK) {
+ Init(topic, tags, keys, flag, body, waitStoreMsgOK);
+}
+
+MQMessage::~MQMessage() { m_properties.clear(); }
+
+MQMessage::MQMessage(const MQMessage& other) {
+ m_body = other.m_body;
+ m_topic = other.m_topic;
+ m_flag = other.m_flag;
+ m_properties = other.m_properties;
+}
+
+MQMessage& MQMessage::operator=(const MQMessage& other) {
+ if (this != &other) {
+ m_body = other.m_body;
+ m_topic = other.m_topic;
+ m_flag = other.m_flag;
+ m_properties = other.m_properties;
+ }
+ return *this;
+}
+
+void MQMessage::setProperty(const string& name, const string& value) {
+ m_properties[name] = value;
+}
+
+string MQMessage::getProperty(const string& name) const {
+ map<string, string>::const_iterator it = m_properties.find(name);
+
+ return (it == m_properties.end()) ? "" : (*it).second;
+}
+
+string MQMessage::getTopic() const { return m_topic; }
+
+void MQMessage::setTopic(const string& topic) { m_topic = topic; }
+
+void MQMessage::setTopic(const char* body, int len) {
+ m_topic.clear();
+ m_topic.append(body, len);
+}
+
+string MQMessage::getTags() const { return getProperty(PROPERTY_TAGS); }
+
+void MQMessage::setTags(const string& tags) {
+ setProperty(PROPERTY_TAGS, tags);
+}
+
+string MQMessage::getKeys() const { return getProperty(PROPERTY_KEYS); }
+
+void MQMessage::setKeys(const string& keys) {
+ setProperty(PROPERTY_KEYS, keys);
+}
+
+void MQMessage::setKeys(const vector<string>& keys) {
+ if (keys.empty()) {
+ return;
+ }
+
+ vector<string>::const_iterator it = keys.begin();
+ string str;
+ str += *it;
+ it++;
+
+ for (; it != keys.end(); it++) {
+ str += KEY_SEPARATOR;
+ str += *it;
+ }
+
+ setKeys(str);
+}
+
+int MQMessage::getDelayTimeLevel() const {
+ string tmp = getProperty(PROPERTY_DELAY_TIME_LEVEL);
+ if (!tmp.empty()) {
+ return atoi(tmp.c_str());
+ }
+ return 0;
+}
+
+void MQMessage::setDelayTimeLevel(int level) {
+ char tmp[16];
+ sprintf(tmp, "%d", level);
+
+ setProperty(PROPERTY_DELAY_TIME_LEVEL, tmp);
+}
+
+bool MQMessage::isWaitStoreMsgOK() {
+ string tmp = getProperty(PROPERTY_WAIT_STORE_MSG_OK);
+ if (tmp.empty()) {
+ return true;
+ } else {
+ return (tmp == "true") ? true : false;
+ }
+}
+
+void MQMessage::setWaitStoreMsgOK(bool waitStoreMsgOK) {
+ if (waitStoreMsgOK) {
+ setProperty(PROPERTY_WAIT_STORE_MSG_OK, "true");
+ } else {
+ setProperty(PROPERTY_WAIT_STORE_MSG_OK, "false");
+ }
+}
+
+int MQMessage::getFlag() const { return m_flag; }
+
+void MQMessage::setFlag(int flag) { m_flag = flag; }
+
+string MQMessage::getBody() const { return m_body; }
+
+void MQMessage::setBody(const char* body, int len) {
+ m_body.clear();
+ m_body.append(body, len);
+}
+
+void MQMessage::setBody(const string &body) {
+ m_body.clear();
+ m_body.append(body);
+}
+
+map<string, string> MQMessage::getProperties() const { return m_properties; }
+
+void MQMessage::setProperties(map<string, string>& properties) {
+ m_properties = properties;
+}
+
+void MQMessage::Init(const string& topic, const string& tags,
+ const string& keys, const int flag, const string& body,
+ bool waitStoreMsgOK) {
+ m_topic = topic;
+ m_flag = flag;
+ m_body = body;
+
+ if (tags.length() > 0) {
+ setTags(tags);
+ }
+
+ if (keys.length() > 0) {
+ setKeys(keys);
+ }
+
+ setWaitStoreMsgOK(waitStoreMsgOK);
+}
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/message/MQMessageExt.cpp b/rocketmq-cpp/src/message/MQMessageExt.cpp
new file mode 100755
index 00000000..bfba42d1
--- /dev/null
+++ b/rocketmq-cpp/src/message/MQMessageExt.cpp
@@ -0,0 +1,148 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "MQMessageExt.h"
+#include "MessageSysFlag.h"
+#include "SocketUtil.h"
+#include "TopicFilterType.h"
+
+namespace rocketmq {
+//<!************************************************************************
+MQMessageExt::MQMessageExt()
+ : m_queueOffset(0),
+ m_commitLogOffset(0),
+ m_bornTimestamp(0),
+ m_storeTimestamp(0),
+ m_preparedTransactionOffset(0),
+ m_queueId(0),
+ m_storeSize(0),
+ m_sysFlag(0),
+ m_bodyCRC(0),
+ m_reconsumeTimes(3),
+ m_msgId("") {}
+
+MQMessageExt::MQMessageExt(int queueId, int64 bornTimestamp, sockaddr bornHost,
+ int64 storeTimestamp, sockaddr storeHost,
+ string msgId)
+ : m_queueOffset(0),
+ m_commitLogOffset(0),
+ m_bornTimestamp(bornTimestamp),
+ m_storeTimestamp(storeTimestamp),
+ m_preparedTransactionOffset(0),
+ m_queueId(queueId),
+ m_storeSize(0),
+ m_sysFlag(0),
+ m_bodyCRC(0),
+ m_reconsumeTimes(3),
+ m_bornHost(bornHost),
+ m_storeHost(storeHost),
+ m_msgId(msgId) {}
+
+MQMessageExt::~MQMessageExt() {}
+
+int MQMessageExt::getQueueId() const { return m_queueId; }
+
+void MQMessageExt::setQueueId(int queueId) { m_queueId = queueId; }
+
+int64 MQMessageExt::getBornTimestamp() const { return m_bornTimestamp; }
+
+void MQMessageExt::setBornTimestamp(int64 bornTimestamp) {
+ m_bornTimestamp = bornTimestamp;
+}
+
+sockaddr MQMessageExt::getBornHost() const { return m_bornHost; }
+
+string MQMessageExt::getBornHostString() const {
+ return socketAddress2String(m_bornHost);
+}
+
+string MQMessageExt::getBornHostNameString() const {
+ return getHostName(m_bornHost);
+}
+
+void MQMessageExt::setBornHost(const sockaddr& bornHost) {
+ m_bornHost = bornHost;
+}
+
+int64 MQMessageExt::getStoreTimestamp() const { return m_storeTimestamp; }
+
+void MQMessageExt::setStoreTimestamp(int64 storeTimestamp) {
+ m_storeTimestamp = storeTimestamp;
+}
+
+sockaddr MQMessageExt::getStoreHost() const { return m_storeHost; }
+
+string MQMessageExt::getStoreHostString() const {
+ return socketAddress2String(m_storeHost);
+}
+
+void MQMessageExt::setStoreHost(const sockaddr& storeHost) {
+ m_storeHost = storeHost;
+}
+
+const string& MQMessageExt::getMsgId() const { return m_msgId; }
+
+void MQMessageExt::setMsgId(const string& msgId) { m_msgId = msgId; }
+
+int MQMessageExt::getSysFlag() const { return m_sysFlag; }
+
+void MQMessageExt::setSysFlag(int sysFlag) { m_sysFlag = sysFlag; }
+
+int MQMessageExt::getBodyCRC() const { return m_bodyCRC; }
+
+void MQMessageExt::setBodyCRC(int bodyCRC) { m_bodyCRC = bodyCRC; }
+
+int64 MQMessageExt::getQueueOffset() const { return m_queueOffset; }
+
+void MQMessageExt::setQueueOffset(int64 queueOffset) {
+ m_queueOffset = queueOffset;
+}
+
+int64 MQMessageExt::getCommitLogOffset() const { return m_commitLogOffset; }
+
+void MQMessageExt::setCommitLogOffset(int64 physicOffset) {
+ m_commitLogOffset = physicOffset;
+}
+
+int MQMessageExt::getStoreSize() const { return m_storeSize; }
+
+void MQMessageExt::setStoreSize(int storeSize) { m_storeSize = storeSize; }
+
+int MQMessageExt::parseTopicFilterType(int sysFlag) {
+ if ((sysFlag & MessageSysFlag::MultiTagsFlag) ==
+ MessageSysFlag::MultiTagsFlag) {
+ return MULTI_TAG;
+ }
+ return SINGLE_TAG;
+}
+
+int MQMessageExt::getReconsumeTimes() const { return m_reconsumeTimes; }
+
+void MQMessageExt::setReconsumeTimes(int reconsumeTimes) {
+ m_reconsumeTimes = reconsumeTimes;
+}
+
+int64 MQMessageExt::getPreparedTransactionOffset() const {
+ return m_preparedTransactionOffset;
+}
+
+void MQMessageExt::setPreparedTransactionOffset(
+ int64 preparedTransactionOffset) {
+ m_preparedTransactionOffset = preparedTransactionOffset;
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/message/MQMessageId.h b/rocketmq-cpp/src/message/MQMessageId.h
new file mode 100755
index 00000000..366ac204
--- /dev/null
+++ b/rocketmq-cpp/src/message/MQMessageId.h
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MESSAGEID_H__
+#define __MESSAGEID_H__
+
+#include "SocketUtil.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class MQMessageId {
+ public:
+ MQMessageId(sockaddr address, int64 offset)
+ : m_address(address), m_offset(offset) {}
+
+ sockaddr getAddress() const { return m_address; }
+
+ void setAddress(sockaddr address) { m_address = address; }
+
+ int64 getOffset() const { return m_offset; }
+
+ void setOffset(int64 offset) { m_offset = offset; }
+
+ private:
+ sockaddr m_address;
+ int64 m_offset;
+};
+
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/message/MQMessageQueue.cpp b/rocketmq-cpp/src/message/MQMessageQueue.cpp
new file mode 100755
index 00000000..60481e53
--- /dev/null
+++ b/rocketmq-cpp/src/message/MQMessageQueue.cpp
@@ -0,0 +1,98 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "MQMessageQueue.h"
+
+namespace rocketmq {
+//<!************************************************************************
+MQMessageQueue::MQMessageQueue() {
+ m_queueId = -1; // invalide mq
+ m_topic.clear();
+ m_brokerName.clear();
+}
+
+MQMessageQueue::MQMessageQueue(const std::string& topic, const std::string& brokerName,
+ int queueId)
+ : m_topic(topic), m_brokerName(brokerName), m_queueId(queueId) {}
+
+MQMessageQueue::MQMessageQueue(const MQMessageQueue& other)
+ : m_topic(other.m_topic),
+ m_brokerName(other.m_brokerName),
+ m_queueId(other.m_queueId) {}
+
+MQMessageQueue& MQMessageQueue::operator=(const MQMessageQueue& other) {
+ if (this != &other) {
+ m_brokerName = other.m_brokerName;
+ m_topic = other.m_topic;
+ m_queueId = other.m_queueId;
+ }
+ return *this;
+}
+
+std::string MQMessageQueue::getTopic() const { return m_topic; }
+
+void MQMessageQueue::setTopic(const std::string& topic) { m_topic = topic; }
+
+std::string MQMessageQueue::getBrokerName() const { return m_brokerName; }
+
+void MQMessageQueue::setBrokerName(const std::string& brokerName) {
+ m_brokerName = brokerName;
+}
+
+int MQMessageQueue::getQueueId() const { return m_queueId; }
+
+void MQMessageQueue::setQueueId(int queueId) { m_queueId = queueId; }
+
+bool MQMessageQueue::operator==(const MQMessageQueue& mq) const {
+ if (this == &mq) {
+ return true;
+ }
+
+ if (m_brokerName != mq.m_brokerName) {
+ return false;
+ }
+
+ if (m_queueId != mq.m_queueId) {
+ return false;
+ }
+
+ if (m_topic != mq.m_topic) {
+ return false;
+ }
+
+ return true;
+}
+
+int MQMessageQueue::compareTo(const MQMessageQueue& mq) const {
+ int result = m_topic.compare(mq.m_topic);
+ if (result != 0) {
+ return result;
+ }
+
+ result = m_brokerName.compare(mq.m_brokerName);
+ if (result != 0) {
+ return result;
+ }
+
+ return m_queueId - mq.m_queueId;
+}
+
+bool MQMessageQueue::operator<(const MQMessageQueue& mq) const {
+ return compareTo(mq) < 0;
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/producer/DefaultMQProducer.cpp b/rocketmq-cpp/src/producer/DefaultMQProducer.cpp
new file mode 100755
index 00000000..9c539300
--- /dev/null
+++ b/rocketmq-cpp/src/producer/DefaultMQProducer.cpp
@@ -0,0 +1,494 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "DefaultMQProducer.h"
+#include <assert.h>
+#include "CommandHeader.h"
+#include "CommunicationMode.h"
+#include "Logging.h"
+#include "MQClientAPIImpl.h"
+#include "MQClientException.h"
+#include "MQClientFactory.h"
+#include "MQClientManager.h"
+#include "MQDecoder.h"
+#include "MQProtos.h"
+#include "MessageSysFlag.h"
+#include "TopicPublishInfo.h"
+#include "Validators.h"
+
+namespace rocketmq {
+
+//<!************************************************************************
+DefaultMQProducer::DefaultMQProducer(const string& groupname)
+ : m_sendMsgTimeout(3000),
+ m_compressMsgBodyOverHowmuch(4 * 1024),
+ m_maxMessageSize(1024 * 128),
+ m_retryAnotherBrokerWhenNotStoreOK(false),
+ m_compressLevel(5),
+ m_retryTimes(5) {
+ //<!set default group name;
+ string gname = groupname.empty() ? DEFAULT_PRODUCER_GROUP : groupname;
+ setGroupName(gname);
+}
+
+DefaultMQProducer::~DefaultMQProducer() {}
+
+void DefaultMQProducer::start() {
+ /* Ignore the SIGPIPE */
+ struct sigaction sa;
+ sa.sa_handler = SIG_IGN;
+ sa.sa_flags = 0;
+ sigaction(SIGPIPE, &sa, 0);
+
+ switch (m_serviceState) {
+ case CREATE_JUST: {
+ m_serviceState = START_FAILED;
+ MQClient::start();
+ LOG_INFO("DefaultMQProducer:%s start", m_GroupName.c_str());
+
+ bool registerOK = getFactory()->registerProducer(this);
+ if (!registerOK) {
+ m_serviceState = CREATE_JUST;
+ THROW_MQEXCEPTION(
+ MQClientException,
+ "The producer group[" + getGroupName() +
+ "] has been created before, specify another name please.",
+ -1);
+ }
+
+ getFactory()->start();
+ getFactory()->sendHeartbeatToAllBroker();
+ m_serviceState = RUNNING;
+ break;
+ }
+ case RUNNING:
+ case START_FAILED:
+ case SHUTDOWN_ALREADY:
+ break;
+ default:
+ break;
+ }
+}
+
+void DefaultMQProducer::shutdown() {
+ switch (m_serviceState) {
+ case RUNNING: {
+ LOG_INFO("DefaultMQProducer shutdown");
+ getFactory()->unregisterProducer(this);
+ getFactory()->shutdown();
+ m_serviceState = SHUTDOWN_ALREADY;
+ break;
+ }
+ case SHUTDOWN_ALREADY:
+ case CREATE_JUST:
+ break;
+ default:
+ break;
+ }
+}
+
+SendResult DefaultMQProducer::send(MQMessage& msg, bool bSelectActiveBroker) {
+ Validators::checkMessage(msg, getMaxMessageSize());
+ try {
+ return sendDefaultImpl(msg, ComMode_SYNC, NULL, bSelectActiveBroker);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+ return SendResult();
+}
+
+void DefaultMQProducer::send(MQMessage& msg, SendCallback* pSendCallback,
+ bool bSelectActiveBroker) {
+ Validators::checkMessage(msg, getMaxMessageSize());
+ try {
+ sendDefaultImpl(msg, ComMode_ASYNC, pSendCallback, bSelectActiveBroker);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+}
+
+SendResult DefaultMQProducer::send(MQMessage& msg, const MQMessageQueue& mq) {
+ Validators::checkMessage(msg, getMaxMessageSize());
+ if (msg.getTopic() != mq.getTopic()) {
+ LOG_WARN("message's topic not equal mq's topic");
+ }
+ try {
+ return sendKernelImpl(msg, mq, ComMode_SYNC, NULL);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+ return SendResult();
+}
+
+void DefaultMQProducer::send(MQMessage& msg, const MQMessageQueue& mq,
+ SendCallback* pSendCallback) {
+ Validators::checkMessage(msg, getMaxMessageSize());
+ if (msg.getTopic() != mq.getTopic()) {
+ LOG_WARN("message's topic not equal mq's topic");
+ }
+ try {
+ sendKernelImpl(msg, mq, ComMode_ASYNC, pSendCallback);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+}
+
+void DefaultMQProducer::sendOneway(MQMessage& msg, bool bSelectActiveBroker) {
+ Validators::checkMessage(msg, getMaxMessageSize());
+ try {
+ sendDefaultImpl(msg, ComMode_ONEWAY, NULL, bSelectActiveBroker);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+}
+
+void DefaultMQProducer::sendOneway(MQMessage& msg, const MQMessageQueue& mq) {
+ Validators::checkMessage(msg, getMaxMessageSize());
+ if (msg.getTopic() != mq.getTopic()) {
+ LOG_WARN("message's topic not equal mq's topic");
+ }
+ try {
+ sendKernelImpl(msg, mq, ComMode_ONEWAY, NULL);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+}
+
+SendResult DefaultMQProducer::send(MQMessage& msg,
+ MessageQueueSelector* pSelector, void* arg) {
+ try {
+ return sendSelectImpl(msg, pSelector, arg, ComMode_SYNC, NULL);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+ return SendResult();
+}
+
+SendResult DefaultMQProducer::send(MQMessage& msg,
+ MessageQueueSelector* pSelector, void* arg,
+ int autoRetryTimes, bool bActiveBroker) {
+ try {
+ return sendAutoRetrySelectImpl(msg, pSelector, arg, ComMode_SYNC, NULL,
+ autoRetryTimes, bActiveBroker);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+ return SendResult();
+}
+
+void DefaultMQProducer::send(MQMessage& msg, MessageQueueSelector* pSelector,
+ void* arg, SendCallback* pSendCallback) {
+ try {
+ sendSelectImpl(msg, pSelector, arg, ComMode_ASYNC, pSendCallback);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+}
+
+void DefaultMQProducer::sendOneway(MQMessage& msg,
+ MessageQueueSelector* pSelector, void* arg) {
+ try {
+ sendSelectImpl(msg, pSelector, arg, ComMode_ONEWAY, NULL);
+ } catch (MQException& e) {
+ LOG_ERROR(e.what());
+ throw e;
+ }
+}
+
+int DefaultMQProducer::getSendMsgTimeout() const { return m_sendMsgTimeout; }
+
+void DefaultMQProducer::setSendMsgTimeout(int sendMsgTimeout) {
+ m_sendMsgTimeout = sendMsgTimeout;
+}
+
+int DefaultMQProducer::getCompressMsgBodyOverHowmuch() const {
+ return m_compressMsgBodyOverHowmuch;
+}
+
+void DefaultMQProducer::setCompressMsgBodyOverHowmuch(
+ int compressMsgBodyOverHowmuch) {
+ m_compressMsgBodyOverHowmuch = compressMsgBodyOverHowmuch;
+}
+
+int DefaultMQProducer::getMaxMessageSize() const { return m_maxMessageSize; }
+
+void DefaultMQProducer::setMaxMessageSize(int maxMessageSize) {
+ m_maxMessageSize = maxMessageSize;
+}
+
+int DefaultMQProducer::getCompressLevel() const { return m_compressLevel; }
+
+void DefaultMQProducer::setCompressLevel(int compressLevel) {
+ assert(compressLevel >= 0 && compressLevel <= 9 || compressLevel == -1);
+
+ m_compressLevel = compressLevel;
+}
+
+//<!************************************************************************
+SendResult DefaultMQProducer::sendDefaultImpl(MQMessage& msg,
+ int communicationMode,
+ SendCallback* pSendCallback,
+ bool bActiveMQ) {
+ MQMessageQueue lastmq;
+ int mq_index = 0;
+ for (int times = 1; times <= m_retryTimes; times++) {
+ boost::weak_ptr<TopicPublishInfo> weak_topicPublishInfo(
+ getFactory()->tryToFindTopicPublishInfo(msg.getTopic(),
+ getSessionCredentials()));
+ boost::shared_ptr<TopicPublishInfo> topicPublishInfo(
+ weak_topicPublishInfo.lock());
+ if (topicPublishInfo) {
+ if (times == 1) {
+ mq_index = topicPublishInfo->getWhichQueue();
+ } else {
+ mq_index++;
+ }
+
+ SendResult sendResult;
+ MQMessageQueue mq;
+ if (bActiveMQ)
+ mq = topicPublishInfo->selectOneActiveMessageQueue(lastmq, mq_index);
+ else
+ mq = topicPublishInfo->selectOneMessageQueue(lastmq, mq_index);
+
+ lastmq = mq;
+ if (mq.getQueueId() == -1) {
+ // THROW_MQEXCEPTION(MQClientException, "the MQMessageQueue is
+ // invalide", -1);
+ continue;
+ }
+
+ try {
+ LOG_DEBUG("send to brokerName:%s", mq.getBrokerName().c_str());
+ sendResult = sendKernelImpl(msg, mq, communicationMode, pSendCallback);
+ switch (communicationMode) {
+ case ComMode_ASYNC:
+ return sendResult;
+ case ComMode_ONEWAY:
+ return sendResult;
+ case ComMode_SYNC:
+ if (sendResult.getSendStatus() != SEND_OK) {
+ if (bActiveMQ) {
+ topicPublishInfo->updateNonServiceMessageQueue(
+ mq, getSendMsgTimeout());
+ }
+ continue;
+ }
+ return sendResult;
+ default:
+ break;
+ }
+ } catch (...) {
+ LOG_ERROR("send failed of times:%d,brokerName:%s", times,
+ mq.getBrokerName().c_str());
+ if (bActiveMQ) {
+ topicPublishInfo->updateNonServiceMessageQueue(mq,
+ getSendMsgTimeout());
+ }
+ continue;
+ }
+ } // end of for
+ LOG_WARN("Retry many times, still failed");
+ }
+ THROW_MQEXCEPTION(MQClientException, "No route info of this topic, ", -1);
+}
+
+SendResult DefaultMQProducer::sendKernelImpl(MQMessage& msg,
+ const MQMessageQueue& mq,
+ int communicationMode,
+ SendCallback* sendCallback) {
+ string brokerAddr =
+ getFactory()->findBrokerAddressInPublish(mq.getBrokerName());
+
+ if (brokerAddr.empty()) {
+ getFactory()->tryToFindTopicPublishInfo(mq.getTopic(),
+ getSessionCredentials());
+ brokerAddr = getFactory()->findBrokerAddressInPublish(mq.getBrokerName());
+ }
+
+ if (!brokerAddr.empty()) {
+ try {
+ LOG_DEBUG("produce before:%s to %s", msg.toString().c_str(),
+ mq.toString().c_str());
+ int sysFlag = 0;
+ if (tryToCompressMessage(msg)) {
+ sysFlag |= MessageSysFlag::CompressedFlag;
+ }
+
+ string tranMsg =
+ msg.getProperty(MQMessage::PROPERTY_TRANSACTION_PREPARED);
+ if (!tranMsg.empty() && tranMsg == "true") {
+ sysFlag |= MessageSysFlag::TransactionPreparedType;
+ }
+
+ SendMessageRequestHeader* requestHeader = new SendMessageRequestHeader();
+ requestHeader->producerGroup = getGroupName();
+ requestHeader->topic = (msg.getTopic());
+ requestHeader->defaultTopic = DEFAULT_TOPIC;
+ requestHeader->defaultTopicQueueNums = 4;
+ requestHeader->queueId = (mq.getQueueId());
+ requestHeader->sysFlag = (sysFlag);
+ requestHeader->bornTimestamp = UtilAll::currentTimeMillis();
+ requestHeader->flag = (msg.getFlag());
+ requestHeader->properties =
+ (MQDecoder::messageProperties2String(msg.getProperties()));
+
+ return getFactory()->getMQClientAPIImpl()->sendMessage(
+ brokerAddr, mq.getBrokerName(), msg, requestHeader,
+ getSendMsgTimeout(), communicationMode, sendCallback,
+ getSessionCredentials());
+ } catch (MQException& e) {
+ throw e;
+ }
+ }
+ THROW_MQEXCEPTION(MQClientException,
+ "The broker[" + mq.getBrokerName() + "] not exist", -1);
+}
+
+SendResult DefaultMQProducer::sendSelectImpl(MQMessage& msg,
+ MessageQueueSelector* pSelector,
+ void* pArg, int communicationMode,
+ SendCallback* sendCallback) {
+ Validators::checkMessage(msg, getMaxMessageSize());
+
+ boost::weak_ptr<TopicPublishInfo> weak_topicPublishInfo(
+ getFactory()->tryToFindTopicPublishInfo(msg.getTopic(),
+ getSessionCredentials()));
+ boost::shared_ptr<TopicPublishInfo> topicPublishInfo(
+ weak_topicPublishInfo.lock());
+ if (topicPublishInfo) //&& topicPublishInfo->ok())
+ {
+ MQMessageQueue mq =
+ pSelector->select(topicPublishInfo->getMessageQueueList(), msg, pArg);
+ return sendKernelImpl(msg, mq, communicationMode, sendCallback);
+ }
+ THROW_MQEXCEPTION(MQClientException, "No route info for this topic", -1);
+}
+
+SendResult DefaultMQProducer::sendAutoRetrySelectImpl(
+ MQMessage& msg, MessageQueueSelector* pSelector, void* pArg,
+ int communicationMode, SendCallback* pSendCallback, int autoRetryTimes,
+ bool bActiveMQ) {
+ Validators::checkMessage(msg, getMaxMessageSize());
+
+ MQMessageQueue lastmq;
+ MQMessageQueue mq;
+ int mq_index = 0;
+ for (int times = 1; times <= autoRetryTimes + 1; times++) {
+ boost::weak_ptr<TopicPublishInfo> weak_topicPublishInfo(
+ getFactory()->tryToFindTopicPublishInfo(msg.getTopic(),
+ getSessionCredentials()));
+ boost::shared_ptr<TopicPublishInfo> topicPublishInfo(
+ weak_topicPublishInfo.lock());
+ if (topicPublishInfo) {
+ SendResult sendResult;
+ if (times == 1) { // always send to selected MQ firstly, evenif bActiveMQ
+ // was setted to true
+ mq = pSelector->select(topicPublishInfo->getMessageQueueList(), msg,
+ pArg);
+ lastmq = mq;
+ } else {
+ LOG_INFO("sendAutoRetrySelectImpl with times:%d", times);
+ vector<MQMessageQueue> mqs(topicPublishInfo->getMessageQueueList());
+ for (size_t i = 0; i < mqs.size(); i++) {
+ if (mqs[i] == lastmq) mq_index = i;
+ }
+ if (bActiveMQ)
+ mq = topicPublishInfo->selectOneActiveMessageQueue(lastmq, mq_index);
+ else
+ mq = topicPublishInfo->selectOneMessageQueue(lastmq, mq_index);
+ lastmq = mq;
+ if (mq.getQueueId() == -1) {
+ // THROW_MQEXCEPTION(MQClientException, "the MQMessageQueue is
+ // invalide", -1);
+ continue;
+ }
+ }
+
+ try {
+ LOG_DEBUG("send to broker:%s", mq.toString().c_str());
+ sendResult = sendKernelImpl(msg, mq, communicationMode, pSendCallback);
+ switch (communicationMode) {
+ case ComMode_ASYNC:
+ return sendResult;
+ case ComMode_ONEWAY:
+ return sendResult;
+ case ComMode_SYNC:
+ if (sendResult.getSendStatus() != SEND_OK) {
+ if (bActiveMQ) {
+ topicPublishInfo->updateNonServiceMessageQueue(
+ mq, getSendMsgTimeout());
+ }
+ continue;
+ }
+ return sendResult;
+ default:
+ break;
+ }
+ } catch (...) {
+ LOG_ERROR("send failed of times:%d,mq:%s", times,
+ mq.toString().c_str());
+ if (bActiveMQ) {
+ topicPublishInfo->updateNonServiceMessageQueue(mq,
+ getSendMsgTimeout());
+ }
+ continue;
+ }
+ } // end of for
+ LOG_WARN("Retry many times, still failed");
+ }
+ THROW_MQEXCEPTION(MQClientException, "No route info of this topic, ", -1);
+}
+
+bool DefaultMQProducer::tryToCompressMessage(MQMessage& msg) {
+ string body = msg.getBody();
+ if ((int)body.length() >= getCompressMsgBodyOverHowmuch()) {
+ string outBody;
+ if (UtilAll::deflate(body, outBody, getCompressLevel())) {
+ msg.setBody(outBody);
+ return true;
+ }
+ }
+
+ return false;
+}
+int DefaultMQProducer::getRetryTimes() const { return m_retryTimes; }
+void DefaultMQProducer::setRetryTimes(int times) {
+ if (times <= 0) {
+ LOG_WARN("set retry times illegal, use default value:5");
+ return;
+ }
+
+ if (times > 15) {
+ LOG_WARN("set retry times illegal, use max value:15");
+ m_retryTimes = 15;
+ return;
+ }
+ LOG_WARN("set retry times to:%d", times);
+ m_retryTimes = times;
+}
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/producer/SendResult.cpp b/rocketmq-cpp/src/producer/SendResult.cpp
new file mode 100755
index 00000000..7fd844e7
--- /dev/null
+++ b/rocketmq-cpp/src/producer/SendResult.cpp
@@ -0,0 +1,60 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "SendResult.h"
+#include "UtilAll.h"
+#include "VirtualEnvUtil.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+SendResult::SendResult() : m_sendStatus(SEND_OK), m_queueOffset(0) {}
+
+SendResult::SendResult(const SendStatus& sendStatus, const string& msgId,
+ const MQMessageQueue& messageQueue, int64 queueOffset)
+ : m_sendStatus(sendStatus),
+ m_msgId(msgId),
+ m_messageQueue(messageQueue),
+ m_queueOffset(queueOffset) {}
+
+SendResult::SendResult(const SendResult& other) {
+ m_sendStatus = other.m_sendStatus;
+ m_msgId = other.m_msgId;
+ m_messageQueue = other.m_messageQueue;
+ m_queueOffset = other.m_queueOffset;
+}
+
+SendResult& SendResult::operator=(const SendResult& other) {
+ if (this != &other) {
+ m_sendStatus = other.m_sendStatus;
+ m_msgId = other.m_msgId;
+ m_messageQueue = other.m_messageQueue;
+ m_queueOffset = other.m_queueOffset;
+ }
+ return *this;
+}
+
+SendResult::~SendResult() {}
+
+const string& SendResult::getMsgId() const { return m_msgId; }
+
+SendStatus SendResult::getSendStatus() const { return m_sendStatus; }
+
+MQMessageQueue SendResult::getMessageQueue() const { return m_messageQueue; }
+
+int64 SendResult::getQueueOffset() const { return m_queueOffset; }
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/producer/TopicPublishInfo.h b/rocketmq-cpp/src/producer/TopicPublishInfo.h
new file mode 100755
index 00000000..726b231f
--- /dev/null
+++ b/rocketmq-cpp/src/producer/TopicPublishInfo.h
@@ -0,0 +1,277 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __TOPICPUBLISHINFO_H__
+#define __TOPICPUBLISHINFO_H__
+
+#include <boost/asio.hpp>
+#include <boost/asio/io_service.hpp>
+#include <boost/atomic.hpp>
+#include <boost/bind.hpp>
+#include <boost/date_time/posix_time/posix_time.hpp>
+#include <boost/scoped_ptr.hpp>
+#include <boost/thread/thread.hpp>
+#include "Logging.h"
+#include "MQMessageQueue.h"
+
+namespace rocketmq {
+//<!************************************************************************/
+class TopicPublishInfo {
+ public:
+ TopicPublishInfo() : m_sendWhichQueue(0) {
+ m_async_service_thread.reset(new boost::thread(
+ boost::bind(&TopicPublishInfo::boost_asio_work, this)));
+ }
+
+ void boost_asio_work() {
+ boost::asio::io_service::work work(m_async_ioService); // avoid async io
+ // service stops
+ // after first timer
+ // timeout callback
+ boost::system::error_code e;
+ boost::asio::deadline_timer t(m_async_ioService,
+ boost::posix_time::seconds(60));
+ t.async_wait(boost::bind(
+ &TopicPublishInfo::op_resumeNonServiceMessageQueueList, this, e, &t));
+ boost::system::error_code ec;
+ m_async_ioService.run(ec);
+ }
+
+ virtual ~TopicPublishInfo() {
+ m_async_ioService.stop();
+ m_async_service_thread->interrupt();
+ m_async_service_thread->join();
+
+ m_nonSerivceQueues.clear();
+ m_onSerivceQueues.clear();
+ m_brokerTimerMap.clear();
+ m_queues.clear();
+ }
+
+ bool ok() {
+ boost::lock_guard<boost::mutex> lock(m_queuelock);
+ return !m_queues.empty();
+ }
+
+ void updateMessageQueueList(const MQMessageQueue& mq) {
+ boost::lock_guard<boost::mutex> lock(m_queuelock);
+ m_queues.push_back(mq);
+ string key = mq.getBrokerName() + UtilAll::to_string(mq.getQueueId());
+ m_onSerivceQueues[key] = mq;
+ if (m_nonSerivceQueues.find(key) != m_nonSerivceQueues.end()) {
+ m_nonSerivceQueues.erase(key); // if topicPublishInfo changed, erase this
+ // mq from m_nonSerivceQueues to avoid 2
+ // copies both in m_onSerivceQueues and
+ // m_nonSerivceQueues
+ }
+ }
+
+ void op_resumeNonServiceMessageQueueList(boost::system::error_code& ec,
+ boost::asio::deadline_timer* t) {
+ resumeNonServiceMessageQueueList();
+ boost::system::error_code e;
+ t->expires_at(t->expires_at() + boost::posix_time::seconds(60), e);
+ t->async_wait(boost::bind(
+ &TopicPublishInfo::op_resumeNonServiceMessageQueueList, this, e, t));
+ }
+
+ void resumeNonServiceMessageQueueList() {
+ boost::lock_guard<boost::mutex> lock(m_queuelock);
+ for (map<MQMessageQueue, int64>::iterator it = m_brokerTimerMap.begin();
+ it != m_brokerTimerMap.end(); ++it) {
+ if (UtilAll::currentTimeMillis() - it->second >= 1000 * 60 * 5) {
+ string key = it->first.getBrokerName() +
+ UtilAll::to_string(it->first.getQueueId());
+ if (m_nonSerivceQueues.find(key) != m_nonSerivceQueues.end()) {
+ m_nonSerivceQueues.erase(key);
+ }
+ m_onSerivceQueues[key] = it->first;
+ }
+ }
+ }
+
+ void updateNonServiceMessageQueue(const MQMessageQueue& mq,
+ int timeoutMilliseconds) {
+ boost::lock_guard<boost::mutex> lock(m_queuelock);
+
+ string key = mq.getBrokerName() + UtilAll::to_string(mq.getQueueId());
+ if (m_nonSerivceQueues.find(key) != m_nonSerivceQueues.end()) {
+ return;
+ }
+ LOG_INFO("updateNonServiceMessageQueue of mq:%s", mq.toString().c_str());
+ m_brokerTimerMap[mq] = UtilAll::currentTimeMillis();
+ m_nonSerivceQueues[key] = mq;
+ if (m_onSerivceQueues.find(key) != m_onSerivceQueues.end()) {
+ m_onSerivceQueues.erase(key);
+ }
+ }
+
+ vector<MQMessageQueue>& getMessageQueueList() {
+ boost::lock_guard<boost::mutex> lock(m_queuelock);
+ return m_queues;
+ }
+
+ int getWhichQueue() {
+ return m_sendWhichQueue.load(boost::memory_order_acquire);
+ }
+
+ MQMessageQueue selectOneMessageQueue(const MQMessageQueue& lastmq,
+ int& mq_index) {
+ boost::lock_guard<boost::mutex> lock(m_queuelock);
+
+ if (m_queues.size() > 0) {
+ LOG_DEBUG("selectOneMessageQueue Enter, queue size:%zu", m_queues.size());
+ unsigned int pos = 0;
+ if (mq_index >= 0) {
+ pos = mq_index % m_queues.size();
+ } else {
+ LOG_ERROR("mq_index is negative");
+ return MQMessageQueue();
+ }
+ if (!lastmq.getBrokerName().empty()) {
+ for (size_t i = 0; i < m_queues.size(); i++) {
+ if (m_sendWhichQueue.load(boost::memory_order_acquire) ==
+ numeric_limits<int>::max()) {
+ m_sendWhichQueue.store(0, boost::memory_order_release);
+ }
+
+ if (pos >= m_queues.size()) pos = pos % m_queues.size();
+
+ ++m_sendWhichQueue;
+ MQMessageQueue mq = m_queues.at(pos);
+ LOG_DEBUG("lastmq broker not empty, m_sendWhichQueue:%d, pos:%d",
+ m_sendWhichQueue.load(boost::memory_order_acquire), pos);
+ if (mq.getBrokerName().compare(lastmq.getBrokerName()) != 0) {
+ mq_index = pos;
+ return mq;
+ }
+ ++pos;
+ }
+ LOG_ERROR("could not find property mq");
+ return MQMessageQueue();
+ } else {
+ if (m_sendWhichQueue.load(boost::memory_order_acquire) ==
+ numeric_limits<int>::max()) {
+ m_sendWhichQueue.store(0, boost::memory_order_release);
+ }
+
+ ++m_sendWhichQueue;
+ LOG_DEBUG("lastmq broker empty, m_sendWhichQueue:%d, pos:%d",
+ m_sendWhichQueue.load(boost::memory_order_acquire), pos);
+ mq_index = pos;
+ return m_queues.at(pos);
+ }
+ } else {
+ LOG_ERROR("m_queues empty");
+ return MQMessageQueue();
+ }
+ }
+
+ MQMessageQueue selectOneActiveMessageQueue(const MQMessageQueue& lastmq,
+ int& mq_index) {
+ boost::lock_guard<boost::mutex> lock(m_queuelock);
+
+ if (m_queues.size() > 0) {
+ unsigned int pos = 0;
+ if (mq_index >= 0) {
+ pos = mq_index % m_queues.size();
+ } else {
+ LOG_ERROR("mq_index is negative");
+ return MQMessageQueue();
+ }
+ if (!lastmq.getBrokerName().empty()) {
+ for (size_t i = 0; i < m_queues.size(); i++) {
+ if (m_sendWhichQueue.load(boost::memory_order_acquire) ==
+ numeric_limits<int>::max()) {
+ m_sendWhichQueue.store(0, boost::memory_order_release);
+ }
+
+ if (pos >= m_queues.size()) pos = pos % m_queues.size();
+
+ ++m_sendWhichQueue;
+ MQMessageQueue mq = m_queues.at(pos);
+ string key = mq.getBrokerName() + UtilAll::to_string(mq.getQueueId());
+ if ((mq.getBrokerName().compare(lastmq.getBrokerName()) != 0) &&
+ (m_onSerivceQueues.find(key) != m_onSerivceQueues.end())) {
+ mq_index = pos;
+ return mq;
+ }
+ ++pos;
+ }
+
+ for (MQMAP::iterator it = m_nonSerivceQueues.begin();
+ it != m_nonSerivceQueues.end();
+ ++it) { // if no MQMessageQueue(except lastmq) in
+ // m_onSerivceQueues, search m_nonSerivceQueues
+ if (it->second.getBrokerName().compare(lastmq.getBrokerName()) != 0)
+ return it->second;
+ }
+ LOG_ERROR("can not find property mq");
+ return MQMessageQueue();
+ } else {
+ for (size_t i = 0; i < m_queues.size(); i++) {
+ if (m_sendWhichQueue.load(boost::memory_order_acquire) ==
+ numeric_limits<int>::max()) {
+ m_sendWhichQueue.store(0, boost::memory_order_release);
+ }
+ if (pos >= m_queues.size()) pos = pos % m_queues.size();
+
+ ++m_sendWhichQueue;
+ LOG_DEBUG("lastmq broker empty, m_sendWhichQueue:%d, pos:%d",
+ m_sendWhichQueue.load(boost::memory_order_acquire), pos);
+ mq_index = pos;
+ MQMessageQueue mq = m_queues.at(pos);
+ string key = mq.getBrokerName() + UtilAll::to_string(mq.getQueueId());
+ if (m_onSerivceQueues.find(key) != m_onSerivceQueues.end()) {
+ return mq;
+ } else {
+ ++pos;
+ }
+ }
+
+ for (MQMAP::iterator it = m_nonSerivceQueues.begin();
+ it != m_nonSerivceQueues.end();
+ ++it) { // if no MQMessageQueue(except lastmq) in
+ // m_onSerivceQueues, search m_nonSerivceQueues
+ if (it->second.getBrokerName().compare(lastmq.getBrokerName()) != 0)
+ return it->second;
+ }
+ LOG_ERROR("can not find property mq");
+ return MQMessageQueue();
+ }
+ } else {
+ LOG_ERROR("m_queues empty");
+ return MQMessageQueue();
+ }
+ }
+
+ private:
+ boost::mutex m_queuelock;
+ typedef vector<MQMessageQueue> QueuesVec;
+ QueuesVec m_queues;
+ typedef map<string, MQMessageQueue> MQMAP;
+ MQMAP m_onSerivceQueues;
+ MQMAP m_nonSerivceQueues;
+ boost::atomic<int> m_sendWhichQueue;
+ map<MQMessageQueue, int64> m_brokerTimerMap;
+ boost::asio::io_service m_async_ioService;
+ boost::scoped_ptr<boost::thread> m_async_service_thread;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/protocol/CommandHeader.cpp b/rocketmq-cpp/src/protocol/CommandHeader.cpp
new file mode 100644
index 00000000..366ac2e4
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/CommandHeader.cpp
@@ -0,0 +1,592 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "CommandHeader.h"
+#include <cstdlib>
+#include <sstream>
+#include "Logging.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!************************************************************************
+void GetRouteInfoRequestHeader::Encode(Json::Value& outData) {
+ outData["topic"] = topic;
+}
+
+void GetRouteInfoRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("topic", topic));
+}
+//<!***************************************************************************
+void UnregisterClientRequestHeader::Encode(Json::Value& outData) {
+ outData["clientID"] = clientID;
+ outData["producerGroup"] = producerGroup;
+ outData["consumerGroup"] = consumerGroup;
+}
+
+void UnregisterClientRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("clientID", clientID));
+ requestMap.insert(pair<string, string>("producerGroup", producerGroup));
+ requestMap.insert(pair<string, string>("consumerGroup", consumerGroup));
+}
+//<!************************************************************************
+void CreateTopicRequestHeader::Encode(Json::Value& outData) {
+ outData["topic"] = topic;
+ outData["defaultTopic"] = defaultTopic;
+ outData["readQueueNums"] = readQueueNums;
+ outData["writeQueueNums"] = writeQueueNums;
+ outData["perm"] = perm;
+ outData["topicFilterType"] = topicFilterType;
+}
+void CreateTopicRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("topic", topic));
+ requestMap.insert(pair<string, string>("defaultTopic", defaultTopic));
+ requestMap.insert(
+ pair<string, string>("readQueueNums", UtilAll::to_string(readQueueNums)));
+ requestMap.insert(pair<string, string>("writeQueueNums",
+ UtilAll::to_string(writeQueueNums)));
+ requestMap.insert(pair<string, string>("perm", UtilAll::to_string(perm)));
+ requestMap.insert(pair<string, string>("topicFilterType", topicFilterType));
+}
+
+//<!************************************************************************
+void SendMessageRequestHeader::Encode(Json::Value& outData) {
+ outData["producerGroup"] = producerGroup;
+ outData["topic"] = topic;
+ outData["defaultTopic"] = defaultTopic;
+ outData["defaultTopicQueueNums"] = defaultTopicQueueNums;
+ outData["queueId"] = queueId;
+ outData["sysFlag"] = sysFlag;
+ outData["bornTimestamp"] = UtilAll::to_string(bornTimestamp);
+ outData["flag"] = flag;
+ outData["properties"] = properties;
+#ifdef ONS
+ outData["reconsumeTimes"] = UtilAll::to_string(reconsumeTimes);
+ outData["unitMode"] = UtilAll::to_string(unitMode);
+#endif
+}
+
+int SendMessageRequestHeader::getReconsumeTimes() { return reconsumeTimes; }
+
+void SendMessageRequestHeader::setReconsumeTimes(int input_reconsumeTimes) {
+ reconsumeTimes = input_reconsumeTimes;
+}
+
+void SendMessageRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ LOG_DEBUG(
+ "SendMessageRequestHeader producerGroup is:%s,topic is:%s, defaulttopic "
+ "is:%s, properties is:%s,UtilAll::to_string( defaultTopicQueueNums) "
+ "is:%s,UtilAll::to_string( queueId):%s, UtilAll::to_string( sysFlag) "
+ "is:%s, UtilAll::to_string( bornTimestamp) is:%s,UtilAll::to_string( "
+ "flag) is:%s",
+ producerGroup.c_str(), topic.c_str(), defaultTopic.c_str(),
+ properties.c_str(), UtilAll::to_string(defaultTopicQueueNums).c_str(),
+ UtilAll::to_string(queueId).c_str(), UtilAll::to_string(sysFlag).c_str(),
+ UtilAll::to_string(bornTimestamp).c_str(),
+ UtilAll::to_string(flag).c_str());
+
+ requestMap.insert(pair<string, string>("producerGroup", producerGroup));
+ requestMap.insert(pair<string, string>("topic", topic));
+ requestMap.insert(pair<string, string>("defaultTopic", defaultTopic));
+ requestMap.insert(pair<string, string>(
+ "defaultTopicQueueNums", UtilAll::to_string(defaultTopicQueueNums)));
+ requestMap.insert(
+ pair<string, string>("queueId", UtilAll::to_string(queueId)));
+ requestMap.insert(
+ pair<string, string>("sysFlag", UtilAll::to_string(sysFlag)));
+ requestMap.insert(
+ pair<string, string>("bornTimestamp", UtilAll::to_string(bornTimestamp)));
+ requestMap.insert(pair<string, string>("flag", UtilAll::to_string(flag)));
+ requestMap.insert(pair<string, string>("properties", properties));
+#ifdef ONS
+ requestMap.insert(pair<string, string>("reconsumeTimes",
+ UtilAll::to_string(reconsumeTimes)));
+ requestMap.insert(
+ pair<string, string>("unitMode", UtilAll::to_string(unitMode)));
+#endif
+}
+
+//<!************************************************************************
+CommandHeader* SendMessageResponseHeader::Decode(Json::Value& ext) {
+ SendMessageResponseHeader* h = new SendMessageResponseHeader();
+
+ Json::Value& tempValue = ext["msgId"];
+ if (tempValue.isString()) {
+ h->msgId = tempValue.asString();
+ }
+
+ tempValue = ext["queueId"];
+ if (tempValue.isString()) {
+ h->queueId = atoi(tempValue.asCString());
+ }
+
+ tempValue = ext["queueOffset"];
+ if (tempValue.isString()) {
+ h->queueOffset = UtilAll::str2ll(tempValue.asCString());
+ }
+ return h;
+}
+
+void SendMessageResponseHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("msgId", msgId));
+ requestMap.insert(
+ pair<string, string>("queueId", UtilAll::to_string(queueId)));
+ requestMap.insert(
+ pair<string, string>("queueOffset", UtilAll::to_string(queueOffset)));
+}
+//<!************************************************************************
+void PullMessageRequestHeader::Encode(Json::Value& outData) {
+ outData["consumerGroup"] = consumerGroup;
+ outData["topic"] = topic;
+ outData["queueId"] = queueId;
+ outData["queueOffset"] = UtilAll::to_string(queueOffset);
+ ;
+ outData["maxMsgNums"] = maxMsgNums;
+ outData["sysFlag"] = sysFlag;
+ outData["commitOffset"] = UtilAll::to_string(commitOffset);
+ ;
+ outData["subVersion"] = UtilAll::to_string(subVersion);
+ ;
+ outData["suspendTimeoutMillis"] = UtilAll::to_string(suspendTimeoutMillis);
+ ;
+ outData["subscription"] = subscription;
+}
+
+void PullMessageRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("consumerGroup", consumerGroup));
+ requestMap.insert(pair<string, string>("topic", topic));
+ requestMap.insert(
+ pair<string, string>("queueId", UtilAll::to_string(queueId)));
+ requestMap.insert(
+ pair<string, string>("queueOffset", UtilAll::to_string(queueOffset)));
+ requestMap.insert(
+ pair<string, string>("maxMsgNums", UtilAll::to_string(maxMsgNums)));
+ requestMap.insert(
+ pair<string, string>("sysFlag", UtilAll::to_string(sysFlag)));
+ requestMap.insert(
+ pair<string, string>("commitOffset", UtilAll::to_string(commitOffset)));
+ requestMap.insert(
+ pair<string, string>("subVersion", UtilAll::to_string(subVersion)));
+ requestMap.insert(pair<string, string>(
+ "suspendTimeoutMillis", UtilAll::to_string(suspendTimeoutMillis)));
+ requestMap.insert(pair<string, string>("subscription", subscription));
+}
+//<!************************************************************************
+CommandHeader* PullMessageResponseHeader::Decode(Json::Value& ext) {
+ PullMessageResponseHeader* h = new PullMessageResponseHeader();
+
+ Json::Value& tempValue = ext["suggestWhichBrokerId"];
+ if (tempValue.isString()) {
+ h->suggestWhichBrokerId = UtilAll::str2ll(tempValue.asCString());
+ }
+
+ tempValue = ext["nextBeginOffset"];
+ if (tempValue.isString()) {
+ h->nextBeginOffset = UtilAll::str2ll(tempValue.asCString());
+ }
+
+ tempValue = ext["minOffset"];
+ if (tempValue.isString()) {
+ h->minOffset = UtilAll::str2ll(tempValue.asCString());
+ }
+
+ tempValue = ext["maxOffset"];
+ if (tempValue.isString()) {
+ h->maxOffset = UtilAll::str2ll(tempValue.asCString());
+ }
+
+ return h;
+}
+
+void PullMessageResponseHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>(
+ "suggestWhichBrokerId", UtilAll::to_string(suggestWhichBrokerId)));
+ requestMap.insert(pair<string, string>("nextBeginOffset",
+ UtilAll::to_string(nextBeginOffset)));
+ requestMap.insert(
+ pair<string, string>("minOffset", UtilAll::to_string(minOffset)));
+ requestMap.insert(
+ pair<string, string>("maxOffset", UtilAll::to_string(maxOffset)));
+}
+//<!************************************************************************
+void GetConsumerListByGroupResponseHeader::Encode(Json::Value& outData) {
+ // outData = "{}";
+}
+
+void GetConsumerListByGroupResponseHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {}
+//<!***************************************************************************
+void GetMinOffsetRequestHeader::Encode(Json::Value& outData) {
+ outData["topic"] = topic;
+ outData["queueId"] = queueId;
+}
+
+void GetMinOffsetRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("topic", topic));
+ requestMap.insert(
+ pair<string, string>("queueId", UtilAll::to_string(queueId)));
+}
+//<!***************************************************************************
+CommandHeader* GetMinOffsetResponseHeader::Decode(Json::Value& ext) {
+ GetMinOffsetResponseHeader* h = new GetMinOffsetResponseHeader();
+
+ Json::Value& tempValue = ext["offset"];
+ if (tempValue.isString()) {
+ h->offset = UtilAll::str2ll(tempValue.asCString());
+ }
+ return h;
+}
+
+void GetMinOffsetResponseHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("offset", UtilAll::to_string(offset)));
+}
+//<!***************************************************************************
+void GetMaxOffsetRequestHeader::Encode(Json::Value& outData) {
+ outData["topic"] = topic;
+ outData["queueId"] = queueId;
+}
+
+void GetMaxOffsetRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("topic", topic));
+ requestMap.insert(
+ pair<string, string>("queueId", UtilAll::to_string(queueId)));
+}
+//<!***************************************************************************
+CommandHeader* GetMaxOffsetResponseHeader::Decode(Json::Value& ext) {
+ GetMaxOffsetResponseHeader* h = new GetMaxOffsetResponseHeader();
+
+ Json::Value& tempValue = ext["offset"];
+ if (tempValue.isString()) {
+ h->offset = UtilAll::str2ll(tempValue.asCString());
+ }
+ return h;
+}
+
+void GetMaxOffsetResponseHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("offset", UtilAll::to_string(offset)));
+}
+//<!***************************************************************************
+void SearchOffsetRequestHeader::Encode(Json::Value& outData) {
+ outData["topic"] = topic;
+ outData["queueId"] = queueId;
+ outData["timestamp"] = UtilAll::to_string(timestamp);
+}
+
+void SearchOffsetRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("topic", topic));
+ requestMap.insert(
+ pair<string, string>("queueId", UtilAll::to_string(queueId)));
+ requestMap.insert(
+ pair<string, string>("timestamp", UtilAll::to_string(timestamp)));
+}
+//<!***************************************************************************
+CommandHeader* SearchOffsetResponseHeader::Decode(Json::Value& ext) {
+ SearchOffsetResponseHeader* h = new SearchOffsetResponseHeader();
+
+ Json::Value& tempValue = ext["offset"];
+ if (tempValue.isString()) {
+ h->offset = UtilAll::str2ll(tempValue.asCString());
+ }
+ return h;
+}
+
+void SearchOffsetResponseHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("offset", UtilAll::to_string(offset)));
+}
+//<!***************************************************************************
+void ViewMessageRequestHeader::Encode(Json::Value& outData) {
+ outData["offset"] = UtilAll::to_string(offset);
+}
+
+void ViewMessageRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("offset", UtilAll::to_string(offset)));
+}
+//<!***************************************************************************
+void GetEarliestMsgStoretimeRequestHeader::Encode(Json::Value& outData) {
+ outData["topic"] = topic;
+ outData["queueId"] = queueId;
+}
+
+void GetEarliestMsgStoretimeRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("topic", topic));
+ requestMap.insert(
+ pair<string, string>("queueId", UtilAll::to_string(queueId)));
+}
+//<!***************************************************************************
+CommandHeader* GetEarliestMsgStoretimeResponseHeader::Decode(
+ Json::Value& ext) {
+ GetEarliestMsgStoretimeResponseHeader* h =
+ new GetEarliestMsgStoretimeResponseHeader();
+
+ Json::Value& tempValue = ext["timestamp"];
+ if (tempValue.isString()) {
+ h->timestamp = UtilAll::str2ll(tempValue.asCString());
+ }
+ return h;
+}
+
+void GetEarliestMsgStoretimeResponseHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(
+ pair<string, string>("timestamp", UtilAll::to_string(timestamp)));
+}
+//<!***************************************************************************
+void GetConsumerListByGroupRequestHeader::Encode(Json::Value& outData) {
+ outData["consumerGroup"] = consumerGroup;
+}
+
+void GetConsumerListByGroupRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("consumerGroup", consumerGroup));
+}
+//<!***************************************************************************
+void QueryConsumerOffsetRequestHeader::Encode(Json::Value& outData) {
+ outData["consumerGroup"] = consumerGroup;
+ outData["topic"] = topic;
+ outData["queueId"] = queueId;
+}
+
+void QueryConsumerOffsetRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("consumerGroup", consumerGroup));
+ requestMap.insert(pair<string, string>("topic", topic));
+ requestMap.insert(
+ pair<string, string>("queueId", UtilAll::to_string(queueId)));
+}
+//<!***************************************************************************
+CommandHeader* QueryConsumerOffsetResponseHeader::Decode(
+ Json::Value& ext) {
+ QueryConsumerOffsetResponseHeader* h =
+ new QueryConsumerOffsetResponseHeader();
+ Json::Value& tempValue = ext["offset"];
+ if (tempValue.isString()) {
+ h->offset = UtilAll::str2ll(tempValue.asCString());
+ }
+ return h;
+}
+
+void QueryConsumerOffsetResponseHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("offset", UtilAll::to_string(offset)));
+}
+//<!***************************************************************************
+void UpdateConsumerOffsetRequestHeader::Encode(Json::Value& outData) {
+ outData["consumerGroup"] = consumerGroup;
+ outData["topic"] = topic;
+ outData["queueId"] = queueId;
+ outData["commitOffset"] = UtilAll::to_string(commitOffset);
+}
+
+void UpdateConsumerOffsetRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("consumerGroup", consumerGroup));
+ requestMap.insert(pair<string, string>("topic", topic));
+ requestMap.insert(
+ pair<string, string>("queueId", UtilAll::to_string(queueId)));
+ requestMap.insert(
+ pair<string, string>("commitOffset", UtilAll::to_string(commitOffset)));
+}
+//<!***************************************************************************
+void ConsumerSendMsgBackRequestHeader::Encode(Json::Value& outData) {
+ outData["group"] = group;
+ outData["delayLevel"] = delayLevel;
+ outData["offset"] = UtilAll::to_string(offset);
+#ifdef ONS
+ outData["originMsgId"] = originMsgId;
+ outData["originTopic"] = originTopic;
+#endif
+}
+
+void ConsumerSendMsgBackRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("group", group));
+ requestMap.insert(
+ pair<string, string>("delayLevel", UtilAll::to_string(delayLevel)));
+ requestMap.insert(pair<string, string>("offset", UtilAll::to_string(offset)));
+}
+//<!***************************************************************************
+void GetConsumerListByGroupResponseBody::Decode(const MemoryBlock* mem,
+ vector<string>& cids) {
+ cids.clear();
+ //<! decode;
+ const char* const pData = static_cast<const char*>(mem->getData());
+
+ Json::Reader reader;
+ Json::Value root;
+ if (!reader.parse(pData, root)) {
+ LOG_ERROR("GetConsumerListByGroupResponse error");
+ return;
+ }
+
+ Json::Value ids = root["consumerIdList"];
+ for (unsigned int i = 0; i < ids.size(); i++) {
+ if (ids[i].isString()) {
+ cids.push_back(ids[i].asString());
+ }
+ }
+}
+
+void GetConsumerListByGroupResponseBody::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {}
+
+void ResetOffsetRequestHeader::setTopic(const string& tmp) { topic = tmp; }
+
+void ResetOffsetRequestHeader::setGroup(const string& tmp) { group = tmp; }
+
+void ResetOffsetRequestHeader::setTimeStamp(const int64& tmp) {
+ timestamp = tmp;
+}
+
+void ResetOffsetRequestHeader::setForceFlag(const bool& tmp) { isForce = tmp; }
+
+const string ResetOffsetRequestHeader::getTopic() const { return topic; }
+
+const string ResetOffsetRequestHeader::getGroup() const { return group; }
+
+const int64 ResetOffsetRequestHeader::getTimeStamp() const { return timestamp; }
+
+const bool ResetOffsetRequestHeader::getForceFlag() const { return isForce; }
+
+CommandHeader* ResetOffsetRequestHeader::Decode(Json::Value& ext) {
+ ResetOffsetRequestHeader* h = new ResetOffsetRequestHeader();
+
+ Json::Value& tempValue = ext["topic"];
+ if (tempValue.isString()) {
+ h->topic = tempValue.asString();
+ }
+
+ tempValue = ext["group"];
+ if (tempValue.isString()) {
+ h->group = tempValue.asString();
+ }
+
+ tempValue = ext["timestamp"];
+ if (tempValue.isString()) {
+ h->timestamp = UtilAll::str2ll(tempValue.asCString());
+ }
+
+ tempValue = ext["isForce"];
+ if (tempValue.isString()) {
+ h->isForce = UtilAll::to_bool(tempValue.asCString());
+ }
+ LOG_INFO("topic:%s, group:%s, timestamp:%lld, isForce:%d,isForce:%s",
+ h->topic.c_str(), h->group.c_str(), h->timestamp, h->isForce,
+ tempValue.asCString());
+ return h;
+}
+
+CommandHeader* GetConsumerRunningInfoRequestHeader::Decode(
+ Json::Value& ext) {
+ GetConsumerRunningInfoRequestHeader* h =
+ new GetConsumerRunningInfoRequestHeader();
+
+ Json::Value& tempValue = ext["consumerGroup"];
+ if (tempValue.isString()) {
+ h->consumerGroup = tempValue.asString();
+ }
+
+ tempValue = ext["clientId"];
+ if (tempValue.isString()) {
+ h->clientId = tempValue.asString();
+ }
+
+ tempValue = ext["jstackEnable"];
+ if (tempValue.isString()) {
+ h->jstackEnable = UtilAll::to_bool(tempValue.asCString());
+ }
+ LOG_INFO("consumerGroup:%s, clientId:%s, jstackEnable:%d",
+ h->consumerGroup.c_str(), h->clientId.c_str(), h->jstackEnable);
+ return h;
+}
+
+void GetConsumerRunningInfoRequestHeader::Encode(Json::Value& outData) {
+ outData["consumerGroup"] = consumerGroup;
+ outData["clientId"] = clientId;
+ outData["jstackEnable"] = jstackEnable;
+}
+
+void GetConsumerRunningInfoRequestHeader::SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {
+ requestMap.insert(pair<string, string>("consumerGroup", consumerGroup));
+ requestMap.insert(pair<string, string>("clientId", clientId));
+ requestMap.insert(
+ pair<string, string>("jstackEnable", UtilAll::to_string(jstackEnable)));
+}
+
+const string GetConsumerRunningInfoRequestHeader::getConsumerGroup() const {
+ return consumerGroup;
+}
+
+void GetConsumerRunningInfoRequestHeader::setConsumerGroup(
+ const string& Group) {
+ consumerGroup = Group;
+}
+
+const string GetConsumerRunningInfoRequestHeader::getClientId() const {
+ return clientId;
+}
+
+void GetConsumerRunningInfoRequestHeader::setClientId(
+ const string& input_clientId) {
+ clientId = input_clientId;
+}
+
+const bool GetConsumerRunningInfoRequestHeader::isJstackEnable() const {
+ return jstackEnable;
+}
+
+void GetConsumerRunningInfoRequestHeader::setJstackEnable(
+ const bool& input_jstackEnable) {
+ jstackEnable = input_jstackEnable;
+}
+
+CommandHeader* NotifyConsumerIdsChangedRequestHeader::Decode(
+ Json::Value& ext) {
+ NotifyConsumerIdsChangedRequestHeader* h =
+ new NotifyConsumerIdsChangedRequestHeader();
+
+ Json::Value& tempValue = ext["consumerGroup"];
+ if (tempValue.isString()) {
+ h->consumerGroup = tempValue.asString();
+ }
+
+ return h;
+}
+
+void NotifyConsumerIdsChangedRequestHeader::setGroup(const string& tmp) {
+ consumerGroup = tmp;
+}
+const string NotifyConsumerIdsChangedRequestHeader::getGroup() const {
+ return consumerGroup;
+}
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/protocol/CommandHeader.h b/rocketmq-cpp/src/protocol/CommandHeader.h
new file mode 100644
index 00000000..5a55c553
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/CommandHeader.h
@@ -0,0 +1,431 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __COMMANDCUSTOMHEADER_H__
+#define __COMMANDCUSTOMHEADER_H__
+
+#include <string>
+#include "MQClientException.h"
+#include "MessageSysFlag.h"
+#include "UtilAll.h"
+#include "dataBlock.h"
+#include "json/json.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+
+class CommandHeader {
+ public:
+ virtual ~CommandHeader() {}
+ virtual void Encode(Json::Value& outData) {}
+ virtual void SetDeclaredFieldOfCommandHeader(
+ map<string, string>& requestMap) {}
+};
+
+//<!************************************************************************
+class GetRouteInfoRequestHeader : public CommandHeader {
+ public:
+ GetRouteInfoRequestHeader(const string& top) : topic(top) {}
+ virtual ~GetRouteInfoRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ private:
+ string topic;
+};
+
+//<!************************************************************************
+class UnregisterClientRequestHeader : public CommandHeader {
+ public:
+ UnregisterClientRequestHeader(string cID, string proGroup, string conGroup)
+ : clientID(cID), producerGroup(proGroup), consumerGroup(conGroup) {}
+ virtual ~UnregisterClientRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ private:
+ string clientID;
+ string producerGroup;
+ string consumerGroup;
+};
+
+//<!************************************************************************
+class CreateTopicRequestHeader : public CommandHeader {
+ public:
+ CreateTopicRequestHeader() : readQueueNums(0), writeQueueNums(0), perm(0) {}
+ virtual ~CreateTopicRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string topic;
+ string defaultTopic;
+ int readQueueNums;
+ int writeQueueNums;
+ int perm;
+ string topicFilterType;
+};
+
+//<!************************************************************************
+class SendMessageRequestHeader : public CommandHeader {
+ public:
+ SendMessageRequestHeader()
+ : defaultTopicQueueNums(0),
+ queueId(0),
+ sysFlag(0),
+ bornTimestamp(0),
+ flag(0),
+ reconsumeTimes(0),
+ unitMode(false) {}
+ virtual ~SendMessageRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+ int getReconsumeTimes();
+ void setReconsumeTimes(int input_reconsumeTimes);
+
+ public:
+ string producerGroup;
+ string topic;
+ string defaultTopic;
+ int defaultTopicQueueNums;
+ int queueId;
+ int sysFlag;
+ int64 bornTimestamp;
+ int flag;
+ string properties;
+ int reconsumeTimes;
+ bool unitMode;
+};
+
+//<!************************************************************************
+class SendMessageResponseHeader : public CommandHeader {
+ public:
+ SendMessageResponseHeader() : queueId(0), queueOffset(0) { msgId.clear(); }
+ virtual ~SendMessageResponseHeader() {}
+ static CommandHeader* Decode(Json::Value& ext);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string msgId;
+ int queueId;
+ int64 queueOffset;
+};
+
+//<!************************************************************************
+class PullMessageRequestHeader : public CommandHeader {
+ public:
+ PullMessageRequestHeader()
+ : queueId(0),
+ maxMsgNums(0),
+ sysFlag(0),
+ queueOffset(0),
+ commitOffset(0),
+ suspendTimeoutMillis(0),
+ subVersion(0) {}
+ virtual ~PullMessageRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string consumerGroup;
+ string topic;
+ int queueId;
+ int maxMsgNums;
+ int sysFlag;
+ string subscription;
+ int64 queueOffset;
+ int64 commitOffset;
+ int64 suspendTimeoutMillis;
+ int64 subVersion;
+};
+
+//<!************************************************************************
+class PullMessageResponseHeader : public CommandHeader {
+ public:
+ PullMessageResponseHeader()
+ : suggestWhichBrokerId(0),
+ nextBeginOffset(0),
+ minOffset(0),
+ maxOffset(0) {}
+ virtual ~PullMessageResponseHeader() {}
+ static CommandHeader* Decode(Json::Value& ext);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ int64 suggestWhichBrokerId;
+ int64 nextBeginOffset;
+ int64 minOffset;
+ int64 maxOffset;
+};
+
+//<!************************************************************************
+class GetConsumerListByGroupResponseHeader : public CommandHeader {
+ public:
+ GetConsumerListByGroupResponseHeader() {}
+ virtual ~GetConsumerListByGroupResponseHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+};
+
+//<!***************************************************************************
+class GetMinOffsetRequestHeader : public CommandHeader {
+ public:
+ GetMinOffsetRequestHeader() : queueId(0){};
+ virtual ~GetMinOffsetRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string topic;
+ int queueId;
+};
+
+//<!***************************************************************************
+class GetMinOffsetResponseHeader : public CommandHeader {
+ public:
+ GetMinOffsetResponseHeader() : offset(0){};
+ virtual ~GetMinOffsetResponseHeader() {}
+ static CommandHeader* Decode(Json::Value& ext);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ int64 offset;
+};
+
+//<!***************************************************************************
+class GetMaxOffsetRequestHeader : public CommandHeader {
+ public:
+ GetMaxOffsetRequestHeader() : queueId(0){};
+ virtual ~GetMaxOffsetRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string topic;
+ int queueId;
+};
+
+//<!***************************************************************************
+class GetMaxOffsetResponseHeader : public CommandHeader {
+ public:
+ GetMaxOffsetResponseHeader() : offset(0){};
+ virtual ~GetMaxOffsetResponseHeader() {}
+ static CommandHeader* Decode(Json::Value& ext);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ int64 offset;
+};
+
+//<!***************************************************************************
+class SearchOffsetRequestHeader : public CommandHeader {
+ public:
+ SearchOffsetRequestHeader() : queueId(0), timestamp(0){};
+ virtual ~SearchOffsetRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string topic;
+ int queueId;
+ int64 timestamp;
+};
+
+//<!***************************************************************************
+class SearchOffsetResponseHeader : public CommandHeader {
+ public:
+ SearchOffsetResponseHeader() : offset(0){};
+ virtual ~SearchOffsetResponseHeader() {}
+ static CommandHeader* Decode(Json::Value& ext);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ int64 offset;
+};
+
+//<!***************************************************************************
+class ViewMessageRequestHeader : public CommandHeader {
+ public:
+ ViewMessageRequestHeader() : offset(0){};
+ virtual ~ViewMessageRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ int64 offset;
+};
+
+//<!***************************************************************************
+class GetEarliestMsgStoretimeRequestHeader : public CommandHeader {
+ public:
+ GetEarliestMsgStoretimeRequestHeader() : queueId(0){};
+ virtual ~GetEarliestMsgStoretimeRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string topic;
+ int queueId;
+};
+
+//<!***************************************************************************
+class GetEarliestMsgStoretimeResponseHeader : public CommandHeader {
+ public:
+ GetEarliestMsgStoretimeResponseHeader() : timestamp(0){};
+ virtual ~GetEarliestMsgStoretimeResponseHeader() {}
+ static CommandHeader* Decode(Json::Value& ext);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ int64 timestamp;
+};
+
+//<!***************************************************************************
+class GetConsumerListByGroupRequestHeader : public CommandHeader {
+ public:
+ GetConsumerListByGroupRequestHeader(){};
+ virtual ~GetConsumerListByGroupRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string consumerGroup;
+};
+
+//<!************************************************************************
+class QueryConsumerOffsetRequestHeader : public CommandHeader {
+ public:
+ QueryConsumerOffsetRequestHeader() : queueId(0){};
+ virtual ~QueryConsumerOffsetRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string consumerGroup;
+ string topic;
+ int queueId;
+};
+
+//<!************************************************************************
+class QueryConsumerOffsetResponseHeader : public CommandHeader {
+ public:
+ QueryConsumerOffsetResponseHeader() : offset(0){};
+ virtual ~QueryConsumerOffsetResponseHeader() {}
+ static CommandHeader* Decode(Json::Value& ext);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ int64 offset;
+};
+
+//<!************************************************************************
+class UpdateConsumerOffsetRequestHeader : public CommandHeader {
+ public:
+ UpdateConsumerOffsetRequestHeader() : queueId(0), commitOffset(0){};
+ virtual ~UpdateConsumerOffsetRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string consumerGroup;
+ string topic;
+ int queueId;
+ int64 commitOffset;
+};
+
+//<!***************************************************************************
+class ConsumerSendMsgBackRequestHeader : public CommandHeader {
+ public:
+ ConsumerSendMsgBackRequestHeader() : delayLevel(0), offset(0){};
+ virtual ~ConsumerSendMsgBackRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ string group;
+ int delayLevel;
+ int64 offset;
+};
+
+//<!***************************************************************************
+class GetConsumerListByGroupResponseBody {
+ public:
+ GetConsumerListByGroupResponseBody(){};
+ virtual ~GetConsumerListByGroupResponseBody() {}
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+
+ public:
+ static void Decode(const MemoryBlock* mem, vector<string>& cids);
+};
+
+class ResetOffsetRequestHeader : public CommandHeader {
+ public:
+ ResetOffsetRequestHeader() {}
+ ~ResetOffsetRequestHeader() {}
+ static CommandHeader* Decode(Json::Value& ext);
+ void setTopic(const string& tmp);
+ void setGroup(const string& tmp);
+ void setTimeStamp(const int64& tmp);
+ void setForceFlag(const bool& tmp);
+ const string getTopic() const;
+ const string getGroup() const;
+ const int64 getTimeStamp() const;
+ const bool getForceFlag() const;
+
+ private:
+ string topic;
+ string group;
+ int64 timestamp;
+ bool isForce;
+};
+
+class GetConsumerRunningInfoRequestHeader : public CommandHeader {
+ public:
+ GetConsumerRunningInfoRequestHeader() {}
+ virtual ~GetConsumerRunningInfoRequestHeader() {}
+ virtual void Encode(Json::Value& outData);
+ virtual void SetDeclaredFieldOfCommandHeader(map<string, string>& requestMap);
+ static CommandHeader* Decode(Json::Value& ext);
+ const string getConsumerGroup() const;
+ void setConsumerGroup(const string& consumerGroup);
+ const string getClientId() const;
+ void setClientId(const string& clientId);
+ const bool isJstackEnable() const;
+ void setJstackEnable(const bool& jstackEnable);
+
+ private:
+ string consumerGroup;
+ string clientId;
+ bool jstackEnable;
+};
+
+class NotifyConsumerIdsChangedRequestHeader : public CommandHeader {
+ public:
+ NotifyConsumerIdsChangedRequestHeader() {}
+ virtual ~NotifyConsumerIdsChangedRequestHeader() {}
+ static CommandHeader* Decode(Json::Value& ext);
+ void setGroup(const string& tmp);
+ const string getGroup() const;
+
+ private:
+ string consumerGroup;
+};
+
+//<!***************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/protocol/ConsumerRunningInfo.cpp b/rocketmq-cpp/src/protocol/ConsumerRunningInfo.cpp
new file mode 100644
index 00000000..10ac0aa6
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/ConsumerRunningInfo.cpp
@@ -0,0 +1,109 @@
+#include "ConsumerRunningInfo.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+const string ConsumerRunningInfo::PROP_NAMESERVER_ADDR = "PROP_NAMESERVER_ADDR";
+const string ConsumerRunningInfo::PROP_THREADPOOL_CORE_SIZE =
+ "PROP_THREADPOOL_CORE_SIZE";
+const string ConsumerRunningInfo::PROP_CONSUME_ORDERLY = "PROP_CONSUMEORDERLY";
+const string ConsumerRunningInfo::PROP_CONSUME_TYPE = "PROP_CONSUME_TYPE";
+const string ConsumerRunningInfo::PROP_CLIENT_VERSION = "PROP_CLIENT_VERSION";
+const string ConsumerRunningInfo::PROP_CONSUMER_START_TIMESTAMP =
+ "PROP_CONSUMER_START_TIMESTAMP";
+
+const map<string, string> ConsumerRunningInfo::getProperties() const {
+ return properties;
+}
+
+void ConsumerRunningInfo::setProperties(
+ const map<string, string>& input_properties) {
+ properties = input_properties;
+}
+
+void ConsumerRunningInfo::setProperty(const string& key, const string& value) {
+ properties[key] = value;
+}
+
+const map<MessageQueue, ProcessQueueInfo> ConsumerRunningInfo::getMqTable()
+ const {
+ return mqTable;
+}
+
+void ConsumerRunningInfo::setMqTable(MessageQueue queue,
+ ProcessQueueInfo queueInfo) {
+ mqTable[queue] = queueInfo;
+}
+
+/*const map<string, ConsumeStatus> ConsumerRunningInfo::getStatusTable() const
+{
+return statusTable;
+}
+
+
+void ConsumerRunningInfo::setStatusTable(const map<string, ConsumeStatus>&
+input_statusTable)
+{
+statusTable = input_statusTable;
+} */
+
+const vector<SubscriptionData> ConsumerRunningInfo::getSubscriptionSet() const {
+ return subscriptionSet;
+}
+
+void ConsumerRunningInfo::setSubscriptionSet(
+ const vector<SubscriptionData>& input_subscriptionSet) {
+ subscriptionSet = input_subscriptionSet;
+}
+
+const string ConsumerRunningInfo::getJstack() const { return jstack; }
+
+void ConsumerRunningInfo::setJstack(const string& input_jstack) {
+ jstack = input_jstack;
+}
+
+string ConsumerRunningInfo::encode() {
+ Json::Value outData;
+
+ outData[PROP_NAMESERVER_ADDR] = properties[PROP_NAMESERVER_ADDR];
+ outData[PROP_CONSUME_TYPE] = properties[PROP_CONSUME_TYPE];
+ outData[PROP_CLIENT_VERSION] = properties[PROP_CLIENT_VERSION];
+ outData[PROP_CONSUMER_START_TIMESTAMP] =
+ properties[PROP_CONSUMER_START_TIMESTAMP];
+ outData[PROP_CONSUME_ORDERLY] = properties[PROP_CONSUME_ORDERLY];
+ outData[PROP_THREADPOOL_CORE_SIZE] = properties[PROP_THREADPOOL_CORE_SIZE];
+
+ Json::Value root;
+ root["jstack"] = jstack;
+ root["properties"] = outData;
+
+ {
+ vector<SubscriptionData>::const_iterator it = subscriptionSet.begin();
+ for (; it != subscriptionSet.end(); it++) {
+ root["subscriptionSet"].append(it->toJson());
+ }
+ }
+
+ Json::FastWriter fastwrite;
+ string finals = fastwrite.write(root);
+
+ Json::Value mq;
+ string key = "\"mqTable\":";
+ key.append("{");
+ for (map<MessageQueue, ProcessQueueInfo>::iterator it = mqTable.begin();
+ it != mqTable.end(); ++it) {
+ key.append((it->first).toJson().toStyledString());
+ key.erase(key.end() - 1);
+ key.append(":");
+ key.append((it->second).toJson().toStyledString());
+ key.append(",");
+ }
+ key.erase(key.end() - 1);
+ key.append("}");
+
+ // insert mqTable to final string
+ key.append(",");
+ finals.insert(1, key);
+
+ return finals;
+}
+}
diff --git a/rocketmq-cpp/src/protocol/ConsumerRunningInfo.h b/rocketmq-cpp/src/protocol/ConsumerRunningInfo.h
new file mode 100644
index 00000000..6467ad5d
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/ConsumerRunningInfo.h
@@ -0,0 +1,50 @@
+#ifndef __CONSUMERRUNNINGINFO_H__
+#define __CONSUMERRUNNINGINFO_H__
+
+#include "MessageQueue.h"
+#include "ProcessQueueInfo.h"
+#include "SubscriptionData.h"
+
+namespace rocketmq {
+
+class ConsumerRunningInfo {
+ public:
+ ConsumerRunningInfo() {}
+ virtual ~ConsumerRunningInfo() {
+ properties.clear();
+ mqTable.clear();
+ subscriptionSet.clear();
+ }
+
+ public:
+ static const string PROP_NAMESERVER_ADDR;
+ static const string PROP_THREADPOOL_CORE_SIZE;
+ static const string PROP_CONSUME_ORDERLY;
+ static const string PROP_CONSUME_TYPE;
+ static const string PROP_CLIENT_VERSION;
+ static const string PROP_CONSUMER_START_TIMESTAMP;
+
+ public:
+ const map<string, string> getProperties() const;
+ void setProperties(const map<string, string>& input_properties);
+ void setProperty(const string& key, const string& value);
+ const map<MessageQueue, ProcessQueueInfo> getMqTable() const;
+ void setMqTable(MessageQueue queue, ProcessQueueInfo queueInfo);
+ // const map<string, ConsumeStatus> getStatusTable() const;
+ // void setStatusTable(const map<string, ConsumeStatus>& input_statusTable) ;
+ const vector<SubscriptionData> getSubscriptionSet() const;
+ void setSubscriptionSet(
+ const vector<SubscriptionData>& input_subscriptionSet);
+ const string getJstack() const;
+ void setJstack(const string& input_jstack);
+ string encode();
+
+ private:
+ map<string, string> properties;
+ vector<SubscriptionData> subscriptionSet;
+ map<MessageQueue, ProcessQueueInfo> mqTable;
+ // map<string, ConsumeStatus> statusTable;
+ string jstack;
+};
+}
+#endif
diff --git a/rocketmq-cpp/src/protocol/HeartbeatData.h b/rocketmq-cpp/src/protocol/HeartbeatData.h
new file mode 100755
index 00000000..9b74280c
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/HeartbeatData.h
@@ -0,0 +1,143 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __HEARTBEATDATA_H__
+#define __HEARTBEATDATA_H__
+#include <boost/thread/thread.hpp>
+#include <cstdlib>
+#include <string>
+#include <vector>
+#include "ConsumeType.h"
+#include "SubscriptionData.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class ProducerData {
+ public:
+ ProducerData(){};
+ bool operator<(const ProducerData& pd) const {
+ return groupName < pd.groupName;
+ }
+ Json::Value toJson() const {
+ Json::Value outJson;
+ outJson["groupName"] = groupName;
+ return outJson;
+ }
+
+ public:
+ string groupName;
+};
+
+//<!***************************************************************************
+class ConsumerData {
+ public:
+ ConsumerData(){};
+ virtual ~ConsumerData() { subscriptionDataSet.clear(); }
+ bool operator<(const ConsumerData& cd) const {
+ return groupName < cd.groupName;
+ }
+
+ Json::Value toJson() const {
+ Json::Value outJson;
+ outJson["groupName"] = groupName;
+ outJson["consumeFromWhere"] = consumeFromWhere;
+ outJson["consumeType"] = consumeType;
+ outJson["messageModel"] = messageModel;
+
+ vector<SubscriptionData>::const_iterator it = subscriptionDataSet.begin();
+ for (; it != subscriptionDataSet.end(); it++) {
+ outJson["subscriptionDataSet"].append((*it).toJson());
+ }
+
+ return outJson;
+ }
+
+ public:
+ string groupName;
+ ConsumeType consumeType;
+ MessageModel messageModel;
+ ConsumeFromWhere consumeFromWhere;
+ vector<SubscriptionData> subscriptionDataSet;
+};
+
+//<!***************************************************************************
+class HeartbeatData {
+ public:
+ virtual ~HeartbeatData() {
+ m_producerDataSet.clear();
+ m_consumerDataSet.clear();
+ }
+ void Encode(string& outData) {
+ Json::Value root;
+
+ //<!id;
+ root["clientID"] = m_clientID;
+
+ //<!consumer;
+ {
+ boost::lock_guard<boost::mutex> lock(m_consumerDataMutex);
+ vector<ConsumerData>::iterator itc = m_consumerDataSet.begin();
+ for (; itc != m_consumerDataSet.end(); itc++) {
+ root["consumerDataSet"].append((*itc).toJson());
+ }
+ }
+
+ //<!producer;
+ {
+ boost::lock_guard<boost::mutex> lock(m_producerDataMutex);
+ vector<ProducerData>::iterator itp = m_producerDataSet.begin();
+ for (; itp != m_producerDataSet.end(); itp++) {
+ root["producerDataSet"].append((*itp).toJson());
+ }
+ }
+ //<!output;
+ Json::FastWriter fastwrite;
+ outData = fastwrite.write(root);
+ }
+
+ void setClientID(const string& clientID) { m_clientID = clientID; }
+
+ bool isProducerDataSetEmpty() {
+ boost::lock_guard<boost::mutex> lock(m_producerDataMutex);
+ return m_producerDataSet.empty();
+ }
+
+ void insertDataToProducerDataSet(ProducerData& producerData) {
+ boost::lock_guard<boost::mutex> lock(m_producerDataMutex);
+ m_producerDataSet.push_back(producerData);
+ }
+
+ bool isConsumerDataSetEmpty() {
+ boost::lock_guard<boost::mutex> lock(m_consumerDataMutex);
+ return m_consumerDataSet.empty();
+ }
+
+ void insertDataToConsumerDataSet(ConsumerData& consumerData) {
+ boost::lock_guard<boost::mutex> lock(m_consumerDataMutex);
+ m_consumerDataSet.push_back(consumerData);
+ }
+
+ private:
+ string m_clientID;
+ vector<ProducerData> m_producerDataSet;
+ vector<ConsumerData> m_consumerDataSet;
+ boost::mutex m_producerDataMutex;
+ boost::mutex m_consumerDataMutex;
+};
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/protocol/KVTable.h b/rocketmq-cpp/src/protocol/KVTable.h
new file mode 100755
index 00000000..69191b79
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/KVTable.h
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __KVTABLE_H__
+#define __KVTABLE_H__
+#include <map>
+#include <string>
+#include "RemotingSerializable.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class KVTable : public RemotingSerializable {
+ public:
+ virtual ~KVTable() { m_table.clear(); }
+
+ void Encode(string& outData) {}
+
+ const map<string, string>& getTable() { return m_table; }
+
+ void setTable(const map<string, string>& table) { m_table = table; }
+
+ private:
+ map<string, string> m_table;
+};
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/protocol/LockBatchBody.cpp b/rocketmq-cpp/src/protocol/LockBatchBody.cpp
new file mode 100755
index 00000000..c56c17f9
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/LockBatchBody.cpp
@@ -0,0 +1,124 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "LockBatchBody.h"
+#include "Logging.h"
+namespace rocketmq { //<!end namespace;
+
+string LockBatchRequestBody::getConsumerGroup() { return consumerGroup; }
+void LockBatchRequestBody::setConsumerGroup(string in_consumerGroup) {
+ consumerGroup = in_consumerGroup;
+}
+string LockBatchRequestBody::getClientId() { return clientId; }
+void LockBatchRequestBody::setClientId(string in_clientId) {
+ clientId = in_clientId;
+}
+vector<MQMessageQueue> LockBatchRequestBody::getMqSet() { return mqSet; }
+void LockBatchRequestBody::setMqSet(vector<MQMessageQueue> in_mqSet) {
+ mqSet.swap(in_mqSet);
+}
+void LockBatchRequestBody::Encode(string& outData) {
+ Json::Value root;
+ root["consumerGroup"] = consumerGroup;
+ root["clientId"] = clientId;
+
+ vector<MQMessageQueue>::const_iterator it = mqSet.begin();
+ for (; it != mqSet.end(); it++) {
+ root["mqSet"].append(toJson(*it));
+ }
+
+ Json::FastWriter fastwrite;
+ outData = fastwrite.write(root);
+}
+
+Json::Value LockBatchRequestBody::toJson(const MQMessageQueue& mq) const {
+ Json::Value outJson;
+ outJson["topic"] = mq.getTopic();
+ outJson["brokerName"] = mq.getBrokerName();
+ outJson["queueId"] = mq.getQueueId();
+ return outJson;
+}
+
+vector<MQMessageQueue> LockBatchResponseBody::getLockOKMQSet() {
+ return lockOKMQSet;
+}
+void LockBatchResponseBody::setLockOKMQSet(
+ vector<MQMessageQueue> in_lockOKMQSet) {
+ lockOKMQSet.swap(in_lockOKMQSet);
+}
+
+void LockBatchResponseBody::Decode(const MemoryBlock* mem,
+ vector<MQMessageQueue>& messageQueues) {
+ messageQueues.clear();
+ //<! decode;
+ const char* const pData = static_cast<const char*>(mem->getData());
+
+ Json::Reader reader;
+ Json::Value root;
+ if (!reader.parse(pData, root)) {
+ LOG_WARN("decode LockBatchResponseBody error");
+ return;
+ }
+
+ Json::Value mqs = root["lockOKMQSet"];
+ LOG_DEBUG("LockBatchResponseBody mqs size:%d", mqs.size());
+ for (unsigned int i = 0; i < mqs.size(); i++) {
+ MQMessageQueue mq;
+ Json::Value qd = mqs[i];
+ mq.setTopic(qd["topic"].asString());
+ mq.setBrokerName(qd["brokerName"].asString());
+ mq.setQueueId(qd["queueId"].asInt());
+ LOG_INFO("LockBatchResponseBody MQ:%s", mq.toString().c_str());
+ messageQueues.push_back(mq);
+ }
+}
+
+string UnlockBatchRequestBody::getConsumerGroup() { return consumerGroup; }
+void UnlockBatchRequestBody::setConsumerGroup(string in_consumerGroup) {
+ consumerGroup = in_consumerGroup;
+}
+string UnlockBatchRequestBody::getClientId() { return clientId; }
+void UnlockBatchRequestBody::setClientId(string in_clientId) {
+ clientId = in_clientId;
+}
+vector<MQMessageQueue> UnlockBatchRequestBody::getMqSet() { return mqSet; }
+void UnlockBatchRequestBody::setMqSet(vector<MQMessageQueue> in_mqSet) {
+ mqSet.swap(in_mqSet);
+}
+void UnlockBatchRequestBody::Encode(string& outData) {
+ Json::Value root;
+ root["consumerGroup"] = consumerGroup;
+ root["clientId"] = clientId;
+
+ vector<MQMessageQueue>::const_iterator it = mqSet.begin();
+ for (; it != mqSet.end(); it++) {
+ root["mqSet"].append(toJson(*it));
+ }
+
+ Json::FastWriter fastwrite;
+ outData = fastwrite.write(root);
+}
+
+Json::Value UnlockBatchRequestBody::toJson(
+ const MQMessageQueue& mq) const {
+ Json::Value outJson;
+ outJson["topic"] = mq.getTopic();
+ outJson["brokerName"] = mq.getBrokerName();
+ outJson["queueId"] = mq.getQueueId();
+ return outJson;
+}
+}
diff --git a/rocketmq-cpp/src/protocol/LockBatchBody.h b/rocketmq-cpp/src/protocol/LockBatchBody.h
new file mode 100755
index 00000000..c1d71556
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/LockBatchBody.h
@@ -0,0 +1,80 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#ifndef __LOCKBATCHBODY_H__
+#define __LOCKBATCHBODY_H__
+#include <set>
+#include <string>
+#include "MQMessageQueue.h"
+#include "RemotingSerializable.h"
+#include "dataBlock.h"
+#include "json/json.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+
+class LockBatchRequestBody {
+ public:
+ virtual ~LockBatchRequestBody() { mqSet.clear(); }
+ string getConsumerGroup();
+ void setConsumerGroup(string consumerGroup);
+ string getClientId();
+ void setClientId(string clientId);
+ vector<MQMessageQueue> getMqSet();
+ void setMqSet(vector<MQMessageQueue> mqSet);
+ void Encode(string& outData);
+ Json::Value toJson(const MQMessageQueue& mq) const;
+
+ private:
+ string consumerGroup;
+ string clientId;
+ vector<MQMessageQueue> mqSet;
+};
+
+class LockBatchResponseBody {
+ public:
+ virtual ~LockBatchResponseBody() { lockOKMQSet.clear(); }
+ vector<MQMessageQueue> getLockOKMQSet();
+ void setLockOKMQSet(vector<MQMessageQueue> lockOKMQSet);
+ static void Decode(const MemoryBlock* mem,
+ vector<MQMessageQueue>& messageQueues);
+
+ private:
+ vector<MQMessageQueue> lockOKMQSet;
+};
+
+class UnlockBatchRequestBody {
+ public:
+ virtual ~UnlockBatchRequestBody() { mqSet.clear(); }
+ string getConsumerGroup();
+ void setConsumerGroup(string consumerGroup);
+ string getClientId();
+ void setClientId(string clientId);
+ vector<MQMessageQueue> getMqSet();
+ void setMqSet(vector<MQMessageQueue> mqSet);
+ void Encode(string& outData);
+ Json::Value toJson(const MQMessageQueue& mq) const;
+
+ private:
+ string consumerGroup;
+ string clientId;
+ vector<MQMessageQueue> mqSet;
+};
+
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/protocol/MQProtos.h b/rocketmq-cpp/src/protocol/MQProtos.h
new file mode 100755
index 00000000..50c1841d
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/MQProtos.h
@@ -0,0 +1,199 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MQPROTOS_H__
+#define __MQPROTOS_H__
+
+namespace rocketmq {
+//<!***************************************************************************
+enum MQRequestCode {
+ // send msg to Broker
+ SEND_MESSAGE = 10,
+ // subscribe msg from Broker
+ PULL_MESSAGE = 11,
+ // query msg from Broker
+ QUERY_MESSAGE = 12,
+ // query Broker Offset
+ QUERY_BROKER_OFFSET = 13,
+ // query Consumer Offset from broker
+ QUERY_CONSUMER_OFFSET = 14,
+ // update Consumer Offset to broker
+ UPDATE_CONSUMER_OFFSET = 15,
+ // create or update Topic to broker
+ UPDATE_AND_CREATE_TOPIC = 17,
+ // get all topic config info from broker
+ GET_ALL_TOPIC_CONFIG = 21,
+ //git all topic list from broker
+ GET_TOPIC_CONFIG_LIST = 22,
+ //get topic name list from broker
+ GET_TOPIC_NAME_LIST = 23,
+ UPDATE_BROKER_CONFIG = 25,
+ GET_BROKER_CONFIG = 26,
+ TRIGGER_DELETE_FILES = 27,
+ GET_BROKER_RUNTIME_INFO = 28,
+ SEARCH_OFFSET_BY_TIMESTAMP = 29,
+ GET_MAX_OFFSET = 30,
+ GET_MIN_OFFSET = 31,
+ GET_EARLIEST_MSG_STORETIME = 32,
+ VIEW_MESSAGE_BY_ID = 33,
+ //send heartbeat to broker, and register itself
+ HEART_BEAT = 34,
+ //unregister client to broker
+ UNREGISTER_CLIENT = 35,
+ //send back consume fail msg to broker
+ CONSUMER_SEND_MSG_BACK = 36,
+ //Commit Or Rollback transaction
+ END_TRANSACTION = 37,
+ // get consumer list by group from broker
+ GET_CONSUMER_LIST_BY_GROUP = 38,
+
+ CHECK_TRANSACTION_STATE = 39,
+ //broker send notify to consumer when consumer lists changes
+ NOTIFY_CONSUMER_IDS_CHANGED = 40,
+ //lock mq before orderly consume
+ LOCK_BATCH_MQ = 41,
+ //unlock mq after orderly consume
+ UNLOCK_BATCH_MQ = 42,
+ GET_ALL_CONSUMER_OFFSET = 43,
+ GET_ALL_DELAY_OFFSET = 45,
+ PUT_KV_CONFIG = 100,
+ GET_KV_CONFIG = 101,
+ DELETE_KV_CONFIG = 102,
+ REGISTER_BROKER = 103,
+ UNREGISTER_BROKER = 104,
+ GET_ROUTEINTO_BY_TOPIC = 105,
+ GET_BROKER_CLUSTER_INFO = 106,
+ UPDATE_AND_CREATE_SUBSCRIPTIONGROUP = 200,
+ GET_ALL_SUBSCRIPTIONGROUP_CONFIG = 201,
+ GET_TOPIC_STATS_INFO = 202,
+ GET_CONSUMER_CONNECTION_LIST = 203,
+ GET_PRODUCER_CONNECTION_LIST = 204,
+ WIPE_WRITE_PERM_OF_BROKER = 205,
+
+ GET_ALL_TOPIC_LIST_FROM_NAMESERVER = 206,
+ DELETE_SUBSCRIPTIONGROUP = 207,
+ GET_CONSUME_STATS = 208,
+ SUSPEND_CONSUMER = 209,
+ RESUME_CONSUMER = 210,
+ RESET_CONSUMER_OFFSET_IN_CONSUMER = 211,
+ RESET_CONSUMER_OFFSET_IN_BROKER = 212,
+ ADJUST_CONSUMER_THREAD_POOL = 213,
+ WHO_CONSUME_THE_MESSAGE = 214,
+
+ DELETE_TOPIC_IN_BROKER = 215,
+ DELETE_TOPIC_IN_NAMESRV = 216,
+
+ GET_KV_CONFIG_BY_VALUE = 217,
+
+ DELETE_KV_CONFIG_BY_VALUE = 218,
+
+ GET_KVLIST_BY_NAMESPACE = 219,
+
+
+ RESET_CONSUMER_CLIENT_OFFSET = 220,
+
+ GET_CONSUMER_STATUS_FROM_CLIENT = 221,
+
+ INVOKE_BROKER_TO_RESET_OFFSET = 222,
+
+ INVOKE_BROKER_TO_GET_CONSUMER_STATUS = 223,
+
+ QUERY_TOPIC_CONSUME_BY_WHO = 300,
+
+ GET_TOPICS_BY_CLUSTER = 224,
+
+ REGISTER_FILTER_SERVER = 301,
+
+ REGISTER_MESSAGE_FILTER_CLASS = 302,
+
+ QUERY_CONSUME_TIME_SPAN = 303,
+
+ GET_SYSTEM_TOPIC_LIST_FROM_NS = 304,
+ GET_SYSTEM_TOPIC_LIST_FROM_BROKER = 305,
+
+ CLEAN_EXPIRED_CONSUMEQUEUE = 306,
+
+ GET_CONSUMER_RUNNING_INFO = 307,
+
+ QUERY_CORRECTION_OFFSET = 308,
+
+ CONSUME_MESSAGE_DIRECTLY = 309,
+
+ SEND_MESSAGE_V2 = 310,
+
+ GET_UNIT_TOPIC_LIST = 311,
+ GET_HAS_UNIT_SUB_TOPIC_LIST = 312,
+ GET_HAS_UNIT_SUB_UNUNIT_TOPIC_LIST = 313,
+
+ CLONE_GROUP_OFFSET = 314,
+
+ VIEW_BROKER_STATS_DATA = 315
+};
+
+//<!***************************************************************************
+enum MQResponseCode {
+ //rcv success response from broker
+ SUCCESS_VALUE = 0,
+ //rcv exception from broker
+ SYSTEM_ERROR = 1,
+ //rcv symtem busy from broker
+ SYSTEM_BUSY = 2,
+ //broker don't support the request code
+ REQUEST_CODE_NOT_SUPPORTED = 3,
+ //broker flush disk timeout error
+ FLUSH_DISK_TIMEOUT = 10,
+ //broker sync double write, slave broker not available
+ SLAVE_NOT_AVAILABLE = 11,
+ //broker sync double write, slave broker flush msg timeout
+ FLUSH_SLAVE_TIMEOUT = 12,
+ //broker rcv illegal mesage
+ MESSAGE_ILLEGAL = 13,
+ //service not available due to broker or namesrv in shutdown status
+ SERVICE_NOT_AVAILABLE = 14,
+ //this version is not supported on broker or namesrv
+ VERSION_NOT_SUPPORTED = 15,
+ //broker or Namesrv has no permission to do this operation
+ NO_PERMISSION = 16,
+ //topic is not exist on broker
+ TOPIC_NOT_EXIST = 17,
+ //broker already created this topic
+ TOPIC_EXIST_ALREADY = 18,
+ //pulled msg was not found
+ PULL_NOT_FOUND = 19,
+ //retry later
+ PULL_RETRY_IMMEDIATELY = 20,
+ //pull msg with wrong offset
+ PULL_OFFSET_MOVED = 21,
+ //could not find the query msg
+ QUERY_NOT_FOUND = 22,
+
+ SUBSCRIPTION_PARSE_FAILED = 23,
+ SUBSCRIPTION_NOT_EXIST = 24,
+ SUBSCRIPTION_NOT_LATEST = 25,
+ SUBSCRIPTION_GROUP_NOT_EXIST = 26,
+
+ TRANSACTION_SHOULD_COMMIT = 200,
+ TRANSACTION_SHOULD_ROLLBACK = 201,
+ TRANSACTION_STATE_UNKNOW = 202,
+ TRANSACTION_STATE_GROUP_WRONG = 203,
+
+ CONSUMER_NOT_ONLINE = 206,
+ CONSUME_MSG_TIMEOUT = 207
+};
+//<!************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/protocol/MessageQueue.cpp b/rocketmq-cpp/src/protocol/MessageQueue.cpp
new file mode 100755
index 00000000..f1b3f8f8
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/MessageQueue.cpp
@@ -0,0 +1,108 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+#include "MessageQueue.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!************************************************************************
+MessageQueue::MessageQueue() {
+ m_queueId = -1; // invalide mq
+ m_topic.clear();
+ m_brokerName.clear();
+}
+
+MessageQueue::MessageQueue(const string& topic, const string& brokerName,
+ int queueId)
+ : m_topic(topic), m_brokerName(brokerName), m_queueId(queueId) {}
+
+MessageQueue::MessageQueue(const MessageQueue& other)
+ : m_topic(other.m_topic),
+ m_brokerName(other.m_brokerName),
+ m_queueId(other.m_queueId) {}
+
+MessageQueue& MessageQueue::operator=(const MessageQueue& other) {
+ if (this != &other) {
+ m_brokerName = other.m_brokerName;
+ m_topic = other.m_topic;
+ m_queueId = other.m_queueId;
+ }
+ return *this;
+}
+
+string MessageQueue::getTopic() const { return m_topic; }
+
+void MessageQueue::setTopic(const string& topic) { m_topic = topic; }
+
+string MessageQueue::getBrokerName() const { return m_brokerName; }
+
+void MessageQueue::setBrokerName(const string& brokerName) {
+ m_brokerName = brokerName;
+}
+
+int MessageQueue::getQueueId() const { return m_queueId; }
+
+void MessageQueue::setQueueId(int queueId) { m_queueId = queueId; }
+
+bool MessageQueue::operator==(const MessageQueue& mq) const {
+ if (this == &mq) {
+ return true;
+ }
+
+ if (m_brokerName != mq.m_brokerName) {
+ return false;
+ }
+
+ if (m_queueId != mq.m_queueId) {
+ return false;
+ }
+
+ if (m_topic != mq.m_topic) {
+ return false;
+ }
+
+ return true;
+}
+
+int MessageQueue::compareTo(const MessageQueue& mq) const {
+ int result = m_topic.compare(mq.m_topic);
+ if (result != 0) {
+ return result;
+ }
+
+ result = m_brokerName.compare(mq.m_brokerName);
+ if (result != 0) {
+ return result;
+ }
+
+ return m_queueId - mq.m_queueId;
+}
+
+bool MessageQueue::operator<(const MessageQueue& mq) const {
+ return compareTo(mq) < 0;
+}
+
+Json::Value MessageQueue::toJson() const {
+ Json::Value outJson;
+ outJson["topic"] = m_topic;
+ outJson["brokerName"] = m_brokerName;
+ outJson["queueId"] = m_queueId;
+ return outJson;
+}
+
+//<!***************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/protocol/MessageQueue.h b/rocketmq-cpp/src/protocol/MessageQueue.h
new file mode 100755
index 00000000..0d47bf8a
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/MessageQueue.h
@@ -0,0 +1,56 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __MESSAGEQUEUE_H__
+#define __MESSAGEQUEUE_H__
+
+#include <string>
+#include "json/json.h"
+
+namespace rocketmq {
+//<!************************************************************************/
+//<!* MQ(T,B,ID);
+//<!************************************************************************/
+class MessageQueue {
+ public:
+ MessageQueue();
+ MessageQueue(const std::string& topic, const std::string& brokerName,
+ int queueId);
+ MessageQueue(const MessageQueue& other);
+ MessageQueue& operator=(const MessageQueue& other);
+
+ std::string getTopic() const;
+ void setTopic(const std::string& topic);
+
+ std::string getBrokerName() const;
+ void setBrokerName(const std::string& brokerName);
+
+ int getQueueId() const;
+ void setQueueId(int queueId);
+
+ bool operator==(const MessageQueue& mq) const;
+ bool operator<(const MessageQueue& mq) const;
+ int compareTo(const MessageQueue& mq) const;
+ Json::Value toJson() const;
+
+ private:
+ std::string m_topic;
+ std::string m_brokerName;
+ int m_queueId;
+};
+//<!***************************************************************************
+} //<!end namespace;
+#endif
diff --git a/rocketmq-cpp/src/protocol/ProcessQueueInfo.h b/rocketmq-cpp/src/protocol/ProcessQueueInfo.h
new file mode 100644
index 00000000..d7493a57
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/ProcessQueueInfo.h
@@ -0,0 +1,86 @@
+#ifndef __PROCESSQUEUEINFO_H__
+#define __PROCESSQUEUEINFO_H__
+
+#include "UtilAll.h"
+#include "json/json.h"
+
+namespace rocketmq {
+class ProcessQueueInfo {
+ public:
+ ProcessQueueInfo() {
+ commitOffset = 0;
+ cachedMsgMinOffset = 0;
+ cachedMsgMaxOffset = 0;
+ cachedMsgCount = 0;
+ transactionMsgMinOffset = 0;
+ transactionMsgMaxOffset = 0;
+ transactionMsgCount = 0;
+ locked = false;
+ tryUnlockTimes = 0;
+ lastLockTimestamp = 123;
+ droped = false;
+ lastPullTimestamp = 0;
+ lastConsumeTimestamp = 0;
+ }
+ virtual ~ProcessQueueInfo() {}
+
+ public:
+ const uint64 getCommitOffset() const { return commitOffset; }
+
+ void setCommitOffset(uint64 input_commitOffset) {
+ commitOffset = input_commitOffset;
+ }
+
+ void setLocked(bool in_locked) { locked = in_locked; }
+
+ const bool isLocked() const { return locked; }
+
+ void setDroped(bool in_dropped) { droped = in_dropped; }
+
+ const bool isDroped() const { return droped; }
+
+ Json::Value toJson() const {
+ Json::Value outJson;
+ outJson["commitOffset"] = (UtilAll::to_string(commitOffset)).c_str();
+ outJson["cachedMsgMinOffset"] =
+ (UtilAll::to_string(cachedMsgMinOffset)).c_str();
+ outJson["cachedMsgMaxOffset"] =
+ (UtilAll::to_string(cachedMsgMaxOffset)).c_str();
+ outJson["cachedMsgCount"] = (int)(cachedMsgCount);
+ outJson["transactionMsgMinOffset"] =
+ (UtilAll::to_string(transactionMsgMinOffset)).c_str();
+ outJson["transactionMsgMaxOffset"] =
+ (UtilAll::to_string(transactionMsgMaxOffset)).c_str();
+ outJson["transactionMsgCount"] = (int)(transactionMsgCount);
+ outJson["locked"] = (locked);
+ outJson["tryUnlockTimes"] = (int)(tryUnlockTimes);
+ outJson["lastLockTimestamp"] =
+ (UtilAll::to_string(lastLockTimestamp)).c_str();
+ outJson["droped"] = (droped);
+ outJson["lastPullTimestamp"] =
+ (UtilAll::to_string(lastPullTimestamp)).c_str();
+ outJson["lastConsumeTimestamp"] =
+ (UtilAll::to_string(lastConsumeTimestamp)).c_str();
+
+ return outJson;
+ }
+
+ public:
+ uint64 commitOffset;
+ uint64 cachedMsgMinOffset;
+ uint64 cachedMsgMaxOffset;
+ int cachedMsgCount;
+ uint64 transactionMsgMinOffset;
+ uint64 transactionMsgMaxOffset;
+ int transactionMsgCount;
+ bool locked;
+ int tryUnlockTimes;
+ uint64 lastLockTimestamp;
+
+ bool droped;
+ uint64 lastPullTimestamp;
+ uint64 lastConsumeTimestamp;
+};
+}
+
+#endif
diff --git a/rocketmq-cpp/src/protocol/RemotingCommand.cpp b/rocketmq-cpp/src/protocol/RemotingCommand.cpp
new file mode 100644
index 00000000..ff6e53e3
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/RemotingCommand.cpp
@@ -0,0 +1,253 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "RemotingCommand.h"
+#include "ByteOrder.h"
+#include "Logging.h"
+#include "MQProtos.h"
+#include "MQVersion.h"
+#include "SessionCredentials.h"
+
+namespace rocketmq {
+boost::atomic<int> RemotingCommand::s_seqNumber;
+boost::mutex RemotingCommand::m_clock;
+//<!************************************************************************
+RemotingCommand::RemotingCommand(int code,
+ CommandHeader* pExtHeader /* = NULL */)
+ : m_code(code),
+ m_language("CPP"),
+ m_version(MQVersion::s_CurrentVersion),
+ m_flag(0),
+ m_remark(""),
+ m_pExtHeader(pExtHeader) {
+ boost::lock_guard<boost::mutex> lock(m_clock);
+ m_opaque = (s_seqNumber.load(boost::memory_order_acquire)) %
+ (numeric_limits<int>::max());
+ s_seqNumber.store(m_opaque, boost::memory_order_release);
+ ++s_seqNumber;
+}
+
+RemotingCommand::RemotingCommand(int code, string language, int version,
+ int opaque, int flag, string remark,
+ CommandHeader* pExtHeader)
+ : m_code(code),
+ m_language(language),
+ m_version(version),
+ m_opaque(opaque),
+ m_flag(flag),
+ m_remark(remark),
+ m_pExtHeader(pExtHeader) {}
+
+RemotingCommand::~RemotingCommand() { m_pExtHeader = NULL; }
+
+void RemotingCommand::Encode() {
+ Json::Value root;
+ root["code"] = m_code;
+ root["language"] = "CPP";
+ root["version"] = m_version;
+ root["opaque"] = m_opaque;
+ root["flag"] = m_flag;
+ root["remark"] = m_remark;
+
+ if (m_pExtHeader) {
+ Json::Value extJson;
+ m_pExtHeader->Encode(extJson);
+
+ extJson[SessionCredentials::Signature] =
+ m_extFields[SessionCredentials::Signature];
+ extJson[SessionCredentials::AccessKey] =
+ m_extFields[SessionCredentials::AccessKey];
+ extJson[SessionCredentials::ONSChannelKey] =
+ m_extFields[SessionCredentials::ONSChannelKey];
+
+ root["extFields"] = extJson;
+ } else { // for heartbeat
+ Json::Value extJson;
+ extJson[SessionCredentials::Signature] =
+ m_extFields[SessionCredentials::Signature];
+ extJson[SessionCredentials::AccessKey] =
+ m_extFields[SessionCredentials::AccessKey];
+ extJson[SessionCredentials::ONSChannelKey] =
+ m_extFields[SessionCredentials::ONSChannelKey];
+ root["extFields"] = extJson;
+ }
+
+ Json::FastWriter fastwrite;
+ string data = fastwrite.write(root);
+
+ uint32 headLen = data.size();
+ uint32 totalLen = 4 + headLen + m_body.getSize();
+
+ uint32 messageHeader[2];
+ messageHeader[0] = ByteOrder::swapIfLittleEndian(totalLen);
+ messageHeader[1] = ByteOrder::swapIfLittleEndian(headLen);
+
+ //<!include self 4 bytes, see : doc/protocol.txt;
+ m_head.setSize(4 + 4 + headLen);
+ m_head.copyFrom(messageHeader, 0, sizeof(messageHeader));
+ m_head.copyFrom(data.c_str(), sizeof(messageHeader), headLen);
+}
+
+const MemoryBlock* RemotingCommand::GetHead() const { return &m_head; }
+
+const MemoryBlock* RemotingCommand::GetBody() const { return &m_body; }
+
+void RemotingCommand::SetBody(const char* pData, int len) {
+ m_body.reset();
+ m_body.setSize(len);
+ m_body.copyFrom(pData, 0, len);
+}
+
+RemotingCommand* RemotingCommand::Decode(const MemoryBlock& mem) {
+ //<!decode 1 bytes,4+head+body
+ uint32 messageHeader[1];
+ mem.copyTo(messageHeader, 0, sizeof(messageHeader));
+ int totalLen = mem.getSize();
+ int headLen = ByteOrder::swapIfLittleEndian(messageHeader[0]);
+ int bodyLen = totalLen - 4 - headLen;
+
+ //<!decode header;
+ const char* const pData = static_cast<const char*>(mem.getData());
+ Json::Reader reader;
+ Json::Value object;
+ const char* begin = pData + 4;
+ const char* end = pData + 4 + headLen;
+
+ if (!reader.parse(begin, end, object)) {
+ THROW_MQEXCEPTION(MQClientException, "conn't parse json", -1);
+ }
+
+ int code = object["code"].asInt();
+
+ string language = object["language"].asString();
+ int version = object["version"].asInt();
+ int opaque = object["opaque"].asInt();
+ int flag = object["flag"].asInt();
+ Json::Value v = object["remark"];
+ string remark = "";
+ if (!v.isNull()) {
+ remark = object["remark"].asString();
+ }
+ LOG_DEBUG("code:%d, remark:%s, version:%d, opaque:%d, flag:%d, remark:%s, headLen:%d, bodyLen:%d ",
+ code, language.c_str(), version, opaque, flag, remark.c_str(), headLen, bodyLen);
+ RemotingCommand* cmd =
+ new RemotingCommand(code, language, version, opaque, flag, remark, NULL);
+ cmd->setParsedJson(object);
+ if (bodyLen > 0) {
+ cmd->SetBody(pData + 4 + headLen, bodyLen);
+ }
+ return cmd;
+}
+
+void RemotingCommand::markResponseType() {
+ int bits = 1 << RPC_TYPE;
+ m_flag |= bits;
+}
+
+bool RemotingCommand::isResponseType() {
+ int bits = 1 << RPC_TYPE;
+ return (m_flag & bits) == bits;
+}
+
+void RemotingCommand::markOnewayRPC() {
+ int bits = 1 << RPC_ONEWAY;
+ m_flag |= bits;
+}
+
+bool RemotingCommand::isOnewayRPC() {
+ int bits = 1 << RPC_ONEWAY;
+ return (m_flag & bits) == bits;
+}
+
+void RemotingCommand::setOpaque(const int opa) { m_opaque = opa; }
+
+void RemotingCommand::SetExtHeader(int code) {
+ try {
+ Json::Value ext = m_parsedJson["extFields"];
+ if (!ext.isNull()) {
+ m_pExtHeader = NULL;
+ switch (code) {
+ case SEND_MESSAGE:
+ m_pExtHeader.reset(SendMessageResponseHeader::Decode(ext));
+ break;
+ case PULL_MESSAGE:
+ m_pExtHeader.reset(PullMessageResponseHeader::Decode(ext));
+ break;
+ case GET_MIN_OFFSET:
+ m_pExtHeader.reset(GetMinOffsetResponseHeader::Decode(ext));
+ break;
+ case GET_MAX_OFFSET:
+ m_pExtHeader.reset(GetMaxOffsetResponseHeader::Decode(ext));
+ break;
+ case SEARCH_OFFSET_BY_TIMESTAMP:
+ m_pExtHeader.reset(SearchOffsetResponseHeader::Decode(ext));
+ break;
+ case GET_EARLIEST_MSG_STORETIME:
+ m_pExtHeader.reset(
+ GetEarliestMsgStoretimeResponseHeader::Decode(ext));
+ break;
+ case QUERY_CONSUMER_OFFSET:
+ m_pExtHeader.reset(QueryConsumerOffsetResponseHeader::Decode(ext));
+ break;
+ case RESET_CONSUMER_CLIENT_OFFSET:
+ m_pExtHeader.reset(ResetOffsetRequestHeader::Decode(ext));
+ break;
+ case GET_CONSUMER_RUNNING_INFO:
+ m_pExtHeader.reset(GetConsumerRunningInfoRequestHeader::Decode(ext));
+ break;
+ case NOTIFY_CONSUMER_IDS_CHANGED:
+ m_pExtHeader.reset(
+ NotifyConsumerIdsChangedRequestHeader::Decode(ext));
+ default:
+ break;
+ }
+ }
+ } catch (MQException& e) {
+ LOG_ERROR("set response head error");
+ }
+}
+
+void RemotingCommand::setCode(int code) { m_code = code; }
+
+int RemotingCommand::getCode() const { return m_code; }
+
+int RemotingCommand::getOpaque() const { return m_opaque; }
+
+string RemotingCommand::getRemark() const { return m_remark; }
+
+void RemotingCommand::setRemark(string mark) { m_remark = mark; }
+
+CommandHeader* RemotingCommand::getCommandHeader() const {
+ return m_pExtHeader.get();
+}
+
+void RemotingCommand::setParsedJson(Json::Value json) {
+ m_parsedJson = json;
+}
+
+const int RemotingCommand::getFlag() const { return m_flag; }
+
+const int RemotingCommand::getVersion() const { return m_version; }
+
+void RemotingCommand::setMsgBody(const string& body) { m_msgBody = body; }
+
+string RemotingCommand::getMsgBody() const { return m_msgBody; }
+
+void RemotingCommand::addExtField(const string& key, const string& value) {
+ m_extFields[key] = value;
+}
+
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/protocol/RemotingCommand.h b/rocketmq-cpp/src/protocol/RemotingCommand.h
new file mode 100755
index 00000000..633a5113
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/RemotingCommand.h
@@ -0,0 +1,90 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __REMOTINGCOMMAND_H__
+#define __REMOTINGCOMMAND_H__
+#include <boost/atomic.hpp>
+#include <boost/thread/mutex.hpp>
+#include <boost/thread/thread.hpp>
+#include <memory>
+#include <sstream>
+#include "CommandHeader.h"
+#include "dataBlock.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+const int RPC_TYPE = 0; // 0, REQUEST_COMMAND // 1, RESPONSE_COMMAND;
+const int RPC_ONEWAY = 1; // 0, RPC // 1, Oneway;
+//<!***************************************************************************
+class RemotingCommand {
+ public:
+ RemotingCommand(int code, CommandHeader* pCustomHeader = NULL);
+ RemotingCommand(int code, string language, int version, int opaque, int flag,
+ string remark, CommandHeader* pCustomHeader);
+ virtual ~RemotingCommand();
+
+ const MemoryBlock* GetHead() const;
+ const MemoryBlock* GetBody() const;
+
+ void SetBody(const char* pData, int len);
+ void setOpaque(const int opa);
+ void SetExtHeader(int code);
+
+ void setCode(int code);
+ int getCode() const;
+ int getOpaque() const;
+ void setRemark(string mark);
+ string getRemark() const;
+ void markResponseType();
+ bool isResponseType();
+ void markOnewayRPC();
+ bool isOnewayRPC();
+ void setParsedJson(Json::Value json);
+
+ CommandHeader* getCommandHeader() const;
+ const int getFlag() const;
+ const int getVersion() const;
+
+ void addExtField(const string& key, const string& value);
+ string getMsgBody() const;
+ void setMsgBody(const string& body);
+
+ public:
+ void Encode();
+ static RemotingCommand* Decode(const MemoryBlock& mem);
+
+ private:
+ int m_code;
+ string m_language;
+ int m_version;
+ int m_opaque;
+ int m_flag;
+ string m_remark;
+ string m_msgBody;
+ map<string, string> m_extFields;
+
+ static boost::mutex m_clock;
+ MemoryBlock m_head;
+ MemoryBlock m_body;
+ //<!save here
+ Json::Value m_parsedJson;
+ static boost::atomic<int> s_seqNumber;
+ unique_ptr<CommandHeader> m_pExtHeader;
+};
+
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/protocol/RemotingSerializable.h b/rocketmq-cpp/src/protocol/RemotingSerializable.h
new file mode 100755
index 00000000..812a892b
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/RemotingSerializable.h
@@ -0,0 +1,32 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __REMOTINGSERIALIZABLE_H__
+#define __REMOTINGSERIALIZABLE_H__
+#include "json/json.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class RemotingSerializable {
+ public:
+ virtual ~RemotingSerializable(){};
+ virtual void Encode(std::string& outData) = 0;
+};
+
+//<!************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/protocol/TopicList.h b/rocketmq-cpp/src/protocol/TopicList.h
new file mode 100755
index 00000000..d8d14a76
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/TopicList.h
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __TOPICLIST_H__
+#define __TOPICLIST_H__
+#include <string>
+#include <vector>
+#include "dataBlock.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+class TopicList {
+ public:
+ static TopicList* Decode(const MemoryBlock* mem) { return new TopicList(); }
+
+ private:
+ vector<string> m_topicList;
+};
+//<!************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/protocol/TopicRouteData.h b/rocketmq-cpp/src/protocol/TopicRouteData.h
new file mode 100755
index 00000000..ec8f842c
--- /dev/null
+++ b/rocketmq-cpp/src/protocol/TopicRouteData.h
@@ -0,0 +1,177 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __TOPICROUTEDATA_H__
+#define __TOPICROUTEDATA_H__
+#include <algorithm>
+#include "Logging.h"
+#include "UtilAll.h"
+#include "dataBlock.h"
+#include "json/json.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+struct QueueData {
+ string brokerName;
+ int readQueueNums;
+ int writeQueueNums;
+ int perm;
+
+ bool operator<(const QueueData& other) const {
+ return brokerName < other.brokerName;
+ }
+
+ bool operator==(const QueueData& other) const {
+ if (brokerName == other.brokerName &&
+ readQueueNums == other.readQueueNums &&
+ writeQueueNums == other.writeQueueNums && perm == other.perm) {
+ return true;
+ }
+ return false;
+ }
+};
+
+//<!***************************************************************************
+struct BrokerData {
+ string brokerName;
+ map<int, string> brokerAddrs; //<!0:master,1,2.. slave
+
+ bool operator<(const BrokerData& other) const {
+ return brokerName < other.brokerName;
+ }
+
+ bool operator==(const BrokerData& other) const {
+ if (brokerName == other.brokerName && brokerAddrs == other.brokerAddrs) {
+ return true;
+ }
+ return false;
+ }
+};
+
+//<!************************************************************************/
+class TopicRouteData {
+ public:
+ virtual ~TopicRouteData() {
+ m_brokerDatas.clear();
+ m_queueDatas.clear();
+ }
+
+ static TopicRouteData* Decode(const MemoryBlock* mem) {
+ //<!see doc/TopicRouteData.json;
+ const char* const pData = static_cast<const char*>(mem->getData());
+ string data(pData, mem->getSize());
+
+ Json::Value root;
+ Json::CharReaderBuilder charReaderBuilder;
+ charReaderBuilder.settings_["allowNumericKeys"] = true;
+ unique_ptr<Json::CharReader> pCharReaderPtr(charReaderBuilder.newCharReader());
+ const char* begin = pData;
+ const char* end = pData + mem->getSize();
+ string errs;
+ if (!pCharReaderPtr->parse(begin, end, &root, &errs)) {
+ LOG_ERROR("parse json error:%s, value isArray:%d, isObject:%d", errs.c_str(), root.isArray(), root.isObject());
+ return NULL;
+ }
+
+ TopicRouteData* trd = new TopicRouteData();
+ trd->setOrderTopicConf(root["orderTopicConf"].asString());
+
+ Json::Value qds = root["queueDatas"];
+ for (unsigned int i = 0; i < qds.size(); i++) {
+ QueueData d;
+ Json::Value qd = qds[i];
+ d.brokerName = qd["brokerName"].asString();
+ d.readQueueNums = qd["readQueueNums"].asInt();
+ d.writeQueueNums = qd["writeQueueNums"].asInt();
+ d.perm = qd["perm"].asInt();
+
+ trd->getQueueDatas().push_back(d);
+ }
+
+ sort(trd->getQueueDatas().begin(), trd->getQueueDatas().end());
+
+ Json::Value bds = root["brokerDatas"];
+ for (unsigned int i = 0; i < bds.size(); i++) {
+ BrokerData d;
+ Json::Value bd = bds[i];
+ d.brokerName = bd["brokerName"].asString();
+
+ LOG_DEBUG("brokerName:%s", d.brokerName.c_str());
+
+ Json::Value bas = bd["brokerAddrs"];
+ Json::Value::Members mbs = bas.getMemberNames();
+ for (size_t i = 0; i < mbs.size(); i++) {
+ string key = mbs.at(i);
+ LOG_DEBUG("brokerid:%s,brokerAddr:%s", key.c_str(),
+ bas[key].asString().c_str());
+ d.brokerAddrs[atoi(key.c_str())] = bas[key].asString();
+ }
+
+ trd->getBrokerDatas().push_back(d);
+ }
+
+ sort(trd->getBrokerDatas().begin(), trd->getBrokerDatas().end());
+
+ return trd;
+ }
+
+ string selectBrokerAddr() {
+ vector<BrokerData>::iterator it = m_brokerDatas.begin();
+ for (; it != m_brokerDatas.end(); ++it) {
+ map<int, string>::iterator it1 = (*it).brokerAddrs.find(MASTER_ID);
+ if (it1 != (*it).brokerAddrs.end()) {
+ return it1->second;
+ }
+ }
+ return "";
+ }
+
+
+ vector<QueueData>& getQueueDatas() { return m_queueDatas; }
+
+ vector<BrokerData>& getBrokerDatas() { return m_brokerDatas; }
+
+ const string& getOrderTopicConf() const { return m_orderTopicConf; }
+
+ void setOrderTopicConf(const string& orderTopicConf) {
+ m_orderTopicConf = orderTopicConf;
+ }
+
+ bool operator==(const TopicRouteData& other) const {
+ if (m_brokerDatas != other.m_brokerDatas) {
+ return false;
+ }
+
+ if (m_orderTopicConf != other.m_orderTopicConf) {
+ return false;
+ }
+
+ if (m_queueDatas != other.m_queueDatas) {
+ return false;
+ }
+ return true;
+ }
+
+ public:
+ private:
+ string m_orderTopicConf;
+ vector<QueueData> m_queueDatas;
+ vector<BrokerData> m_brokerDatas;
+};
+
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/thread/disruptor/batch_descriptor.h b/rocketmq-cpp/src/thread/disruptor/batch_descriptor.h
new file mode 100755
index 00000000..ba1a035f
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/batch_descriptor.h
@@ -0,0 +1,70 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_BATCH_DESCRIPTOR_H_ // NOLINT
+#define DISRUPTOR_BATCH_DESCRIPTOR_H_ // NOLINT
+
+#include "sequence.h"
+
+namespace rocketmq {
+
+// Used to record the batch of sequences claimed via {@link Sequencer}.
+class BatchDescriptor {
+ public:
+ // Create a holder for tracking a batch of claimed sequences in a
+ // {@link Sequencer}
+ //
+ // @param size of the batch to claim.
+ BatchDescriptor(int size) :
+ size_(size),
+ end_(kInitialCursorValue) {}
+
+ // Get the size of the batch
+ int size() const { return size_; }
+
+ // Get the end sequence of a batch.
+ //
+ // @return the end sequence in the batch.
+ int64_t end() const { return end_; }
+
+ // Set the end sequence of a batch.
+ //
+ // @param end sequence in the batch.
+ void set_end(int64_t end) { end_ = end; }
+
+
+ // Get the starting sequence of the batch.
+ //
+ // @return starting sequence in the batch.
+ int64_t Start() const { return end_ - size_ + 1L; }
+
+ private:
+ int size_;
+ int64_t end_;
+};
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_SEQUENCE_BATCH_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/claim_strategy.h b/rocketmq-cpp/src/thread/disruptor/claim_strategy.h
new file mode 100755
index 00000000..0f3263a3
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/claim_strategy.h
@@ -0,0 +1,231 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_CLAIM_STRATEGY_H_ // NOLINT
+#define DISRUPTOR_CLAIM_STRATEGY_H_ // NOLINT
+
+#include <boost/thread.hpp>
+#include <boost/noncopyable.hpp>
+#include <vector>
+
+#include "interface.h"
+
+namespace rocketmq {
+
+enum ClaimStrategyOption {
+ kSingleThreadedStrategy,
+ kMultiThreadedStrategy
+};
+
+// Optimised strategy can be used when there is a single publisher thread
+// claiming {@link AbstractEvent}s.
+class SingleThreadedStrategy :public noncopyable, public ClaimStrategyInterface {
+ public:
+ SingleThreadedStrategy(const int& buffer_size) :
+ buffer_size_(buffer_size),
+ sequence_(kInitialCursorValue),
+ min_gating_sequence_(kInitialCursorValue) {}
+
+ virtual int64_t IncrementAndGet(
+ const std::vector<Sequence*>& dependent_sequences) {
+ int64_t next_sequence = sequence_.IncrementAndGet(1L);
+ WaitForFreeSlotAt(next_sequence, dependent_sequences);
+ return next_sequence;
+ }
+
+ virtual int64_t IncrementAndGet(const int& delta,
+ const std::vector<Sequence*>& dependent_sequences) {
+ int64_t next_sequence = sequence_.IncrementAndGet(delta);
+ WaitForFreeSlotAt(next_sequence, dependent_sequences);
+ return next_sequence;
+ }
+
+ virtual bool HasAvalaibleCapacity(
+ const std::vector<Sequence*>& dependent_sequences) {
+ int64_t wrap_point = sequence_.sequence() + 1L - buffer_size_;
+ if (wrap_point > min_gating_sequence_.sequence()) {
+ int64_t min_sequence = GetMinimumSequence(dependent_sequences);
+ min_gating_sequence_.set_sequence(min_sequence);
+ if (wrap_point > min_sequence)
+ return false;
+ }
+ return true;
+ }
+
+ virtual void SetSequence(const int64_t& sequence,
+ const std::vector<Sequence*>& dependent_sequences) {
+ sequence_.set_sequence(sequence);
+ WaitForFreeSlotAt(sequence, dependent_sequences);
+ }
+
+ virtual void SerialisePublishing(const int64_t& sequence,
+ const Sequence& cursor,
+ const int64_t& batch_size) {}
+
+ private:
+ SingleThreadedStrategy();
+
+ void WaitForFreeSlotAt(const int64_t& sequence,
+ const std::vector<Sequence*>& dependent_sequences) {
+ int64_t wrap_point = sequence - buffer_size_;
+ if (wrap_point > min_gating_sequence_.sequence()) {
+ int64_t min_sequence;
+ while (wrap_point > (min_sequence = GetMinimumSequence(dependent_sequences))) {
+ boost::this_thread::yield();
+ }
+ }
+ }
+
+ const int buffer_size_;
+ PaddedLong sequence_;
+ PaddedLong min_gating_sequence_;
+
+};
+
+// Strategy to be used when there are multiple publisher threads claiming
+// {@link AbstractEvent}s.
+/*
+class MultiThreadedStrategy : public ClaimStrategyInterface {
+ public:
+ MultiThreadedStrategy(const int& buffer_size) :
+ buffer_size_(buffer_size),
+ sequence_(kInitialCursorValue),
+ min_processor_sequence_(kInitialCursorValue) {}
+
+ virtual int64_t IncrementAndGet(
+ const std::vector<Sequence*>& dependent_sequences) {
+ WaitForCapacity(dependent_sequences, min_gating_sequence_local_);
+ int64_t next_sequence = sequence_.IncrementAndGet();
+ WaitForFreeSlotAt(next_sequence,
+ dependent_sequences,
+ min_gating_sequence_local_);
+ return next_sequence;
+ }
+
+ virtual int64_t IncrementAndGet(const int& delta,
+ const std::vector<Sequence*>& dependent_sequences) {
+ int64_t next_sequence = sequence_.IncrementAndGet(delta);
+ WaitForFreeSlotAt(next_sequence,
+ dependent_sequences,
+ min_gating_sequence_local_);
+ return next_sequence;
+ }
+ virtual void SetSequence(const int64_t& sequence,
+ const std::vector<Sequence*>& dependent_sequences) {
+ sequence_.set_sequence(sequence);
+ WaitForFreeSlotAt(sequence,
+ dependent_sequences,
+ min_gating_sequence_local_);
+ }
+
+ virtual bool HasAvalaibleCapacity(
+ const std::vector<Sequence*>& dependent_sequences) {
+ const int64_t wrap_point = sequence_.sequence() + 1L - buffer_size_;
+ if (wrap_point > min_gating_sequence_local_.sequence()) {
+ int64_t min_sequence = GetMinimumSequence(dependent_sequences);
+ min_gating_sequence_local_.set_sequence(min_sequence);
+ if (wrap_point > min_sequence)
+ return false;
+ }
+ return true;
+ }
+
+ virtual void SerialisePublishing(const Sequence& cursor,
+ const int64_t& sequence,
+ const int64_t& batch_size) {
+ int64_t expected_sequence = sequence - batch_size;
+ int counter = retries;
+
+ while (expected_sequence != cursor.sequence()) {
+ if (0 == --counter) {
+ counter = retries;
+ std::this_thread::yield();
+ }
+ }
+ }
+
+ private:
+ // Methods
+ void WaitForCapacity(const std::vector<Sequence*>& dependent_sequences,
+ const MutableLong& min_gating_sequence) {
+ const int64_t wrap_point = sequence_.sequence() + 1L - buffer_size_;
+ if (wrap_point > min_gating_sequence.sequence()) {
+ int counter = retries;
+ int64_t min_sequence;
+ while (wrap_point > (min_sequence = GetMinimumSequence(dependent_sequences))) {
+ counter = ApplyBackPressure(counter);
+ }
+ min_gating_sequence.set_sequence(min_sequence);
+ }
+ }
+
+ void WaitForFreeSlotAt(const int64_t& sequence,
+ const std::vector<Sequence*>& dependent_sequences,
+ const MutableLong& min_gating_sequence) {
+ const int64_t wrap_point = sequence - buffer_size_;
+ if (wrap_point > min_gating_sequence.sequence()) {
+ int64_t min_sequence;
+ while (wrap_point > (min_sequence = GetMinimumSequence(dependent_sequences))) {
+ std::this_thread::yield();
+ }
+ min_gating_sequence.set_sequence(min_sequence);
+ }
+ }
+
+ int ApplyBackPressure(int counter) {
+ if (0 != counter) {
+ --counter;
+ std::this_thread::yield();
+ } else {
+ std::this_thread::sleep_for(std::chrono::milliseconds(1));
+ }
+
+ return counter;
+ }
+
+ const int buffer_size_;
+ PaddedSequence sequence_;
+ thread_local PaddedLong min_gating_sequence_local_;
+
+ const int retries = 100;
+
+};
+*/
+
+ClaimStrategyInterface* CreateClaimStrategy(ClaimStrategyOption option,
+ const int& buffer_size) {
+ switch (option) {
+ case kSingleThreadedStrategy:
+ return new SingleThreadedStrategy(buffer_size);
+ // case kMultiThreadedStrategy:
+ // return new MultiThreadedStrategy(buffer_size);
+ default:
+ return NULL;
+ }
+};
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_CLAIM_STRATEGY_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/event_processor.h b/rocketmq-cpp/src/thread/disruptor/event_processor.h
new file mode 100755
index 00000000..fb628127
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/event_processor.h
@@ -0,0 +1,130 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_EVENT_PROCESSOR_H_ // NOLINT
+#define DISRUPTOR_EVENT_PROCESSOR_H_ // NOLINT
+
+#include <stdexcept>
+#include "ring_buffer.h"
+
+namespace rocketmq {
+
+template <typename T>
+class NoOpEventProcessor : public EventProcessorInterface<T> {
+ public:
+ NoOpEventProcessor(RingBuffer<T>* ring_buffer) :
+ ring_buffer_(ring_buffer) { }
+
+ virtual Sequence* GetSequence() {
+ return ring_buffer_->GetSequencePtr();
+ }
+
+ virtual void Halt() {}
+
+ virtual void Run() {}
+
+ private:
+ RingBuffer<T>* ring_buffer_;
+};
+
+template <typename T>
+class BatchEventProcessor : public boost::noncopyable, public EventProcessorInterface<T> {
+ public:
+ BatchEventProcessor(RingBuffer<T>* ring_buffer,
+ SequenceBarrierInterface* sequence_barrier,
+ EventHandlerInterface<T>* event_handler,
+ ExceptionHandlerInterface<T>* exception_handler) :
+ running_(false),
+ ring_buffer_(ring_buffer),
+ sequence_barrier_(sequence_barrier),
+ event_handler_(event_handler),
+ exception_handler_(exception_handler) {}
+
+
+ virtual Sequence* GetSequence() { return &sequence_; }
+
+ virtual void Halt() {
+ running_.store(false);
+ sequence_barrier_->Alert();
+ }
+
+ virtual void Run() {
+ if (running_.load())
+ {
+ printf("Thread is already running\r\n");
+ }
+ running_.store(true);
+ sequence_barrier_->ClearAlert();
+ event_handler_->OnStart();
+
+ T* event = NULL;
+ int64_t next_sequence = sequence_.sequence() + 1L;
+
+ while (true) {
+ try {
+ int64_t avalaible_sequence = \
+ sequence_barrier_->WaitFor(next_sequence, 300*1000);//wait 300 milliseconds to avoid taskThread blocking on BlockingStrategy::WaitFor when shutdown
+ //metaq::LOG_INFO("avalaible_sequence:%d, next_sequence:%d", avalaible_sequence,next_sequence);
+ while (next_sequence <= avalaible_sequence) {
+ event = ring_buffer_->Get(next_sequence);
+ event_handler_->OnEvent(next_sequence,
+ next_sequence == avalaible_sequence, event);
+ next_sequence++;
+ }
+
+ sequence_.set_sequence(next_sequence - 1L);
+ } catch(const AlertException& e) {
+ //metaq::LOG_INFO("catch alertException");
+ if (!running_.load())
+ break;
+ } catch(const std::exception& e) {
+ //metaq::LOG_ERROR("catch stdException");
+ exception_handler_->Handle(e, next_sequence, event);
+ sequence_.set_sequence(next_sequence);
+ next_sequence++;
+ }
+ }
+ //metaq::LOG_INFO("BatchEventProcessor shutdown");
+ event_handler_->OnShutdown();
+ running_.store(false);
+ }
+
+ void operator()() { Run(); }
+
+ private:
+ boost::atomic<bool> running_;
+ Sequence sequence_;
+
+ RingBuffer<T>* ring_buffer_;
+ SequenceBarrierInterface* sequence_barrier_;
+ EventHandlerInterface<T>* event_handler_;
+ ExceptionHandlerInterface<T>* exception_handler_;
+
+};
+
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_EVENT_PROCESSOR_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/event_publisher.h b/rocketmq-cpp/src/thread/disruptor/event_publisher.h
new file mode 100755
index 00000000..ae0efd9e
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/event_publisher.h
@@ -0,0 +1,50 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_EVENT_PUBLISHER_H_ // NOLINT
+#define DISRUPTOR_EVENT_PUBLISHER_H_ // NOLINT
+
+#include "ring_buffer.h"
+
+namespace rocketmq {
+
+template<typename T>
+class EventPublisher {
+ public:
+ EventPublisher(RingBuffer<T>* ring_buffer) : ring_buffer_(ring_buffer) {}
+
+ void PublishEvent(EventTranslatorInterface<T>* translator) {
+ int64_t sequence = ring_buffer_->Next();
+ translator->TranslateTo(sequence, ring_buffer_->Get(sequence));
+ ring_buffer_->Publish(sequence);
+ }
+
+ private:
+ RingBuffer<T>* ring_buffer_;
+};
+
+}; // namespace rocketmq
+
+#endif
diff --git a/rocketmq-cpp/src/thread/disruptor/exception_handler.h b/rocketmq-cpp/src/thread/disruptor/exception_handler.h
new file mode 100755
index 00000000..e7979a04
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/exception_handler.h
@@ -0,0 +1,59 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_EXCEPTION_HANDLER_H_ // NOLINT
+#define DISRUPTOR_EXCEPTION_HANDLER_H_ // NOLINT
+
+#include <exception>
+
+#include "interface.h"
+
+namespace rocketmq {
+
+template<typename T>
+class IgnoreExceptionHandler: public ExceptionHandlerInterface<T> {
+ public:
+ virtual void Handle(const std::exception& exception,
+ const int64_t& sequence,
+ T* event) {
+ // do nothing with the exception.
+ ;
+ }
+};
+
+template<typename T>
+class FatalExceptionHandler: public ExceptionHandlerInterface<T> {
+ public:
+ virtual void Handle(const std::exception& exception,
+ const int64_t& sequence,
+ T* event) {
+ // rethrow the exception
+ throw exception;
+ }
+};
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_EXCEPTION_HANDLER_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/exceptions.h b/rocketmq-cpp/src/thread/disruptor/exceptions.h
new file mode 100755
index 00000000..f968043a
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/exceptions.h
@@ -0,0 +1,38 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_EXCEPTIONS_H_ // NOLINT
+#define DISRUPTOR_EXCEPTIONS_H_ // NOLINT
+
+#include <exception>
+
+namespace rocketmq {
+
+class AlertException : public std::exception {
+};
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_EXCEPTIONS_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/interface.h b/rocketmq-cpp/src/thread/disruptor/interface.h
new file mode 100755
index 00000000..0c07774c
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/interface.h
@@ -0,0 +1,278 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_INTERFACE_H_ // NOLINT
+#define DISRUPTOR_INTERFACE_H_ // NOLINT
+
+#include <climits>
+#include <vector>
+
+#include "sequence.h"
+#include "batch_descriptor.h"
+
+namespace rocketmq {
+
+// Strategies employed for claiming the sequence of events in the
+// {@link Seqencer} by publishers.
+class ClaimStrategyInterface {
+ public:
+ // Is there available capacity in the buffer for the requested sequence.
+ //
+ // @param dependent_sequences to be checked for range.
+ // @return true if the buffer has capacity for the requested sequence.
+ virtual ~ClaimStrategyInterface() {}
+ virtual bool HasAvalaibleCapacity(
+ const std::vector<Sequence*>& dependent_sequences) = 0;
+
+ // Claim the next sequence in the {@link Sequencer}.
+ //
+ // @param dependent_sequences to be checked for range.
+ // @return the index to be used for the publishing.
+ virtual int64_t IncrementAndGet(
+ const std::vector<Sequence*>& dependent_sequences) = 0;
+
+ // Claim the next sequence in the {@link Sequencer}.
+ //
+ // @param delta to increment by.
+ // @param dependent_sequences to be checked for range.
+ // @return the index to be used for the publishing.
+ virtual int64_t IncrementAndGet(const int& delta,
+ const std::vector<Sequence*>& dependent_sequences) = 0;
+
+ // Set the current sequence value for claiming an event in the
+ // {@link Sequencer}.
+ //
+ // @param sequence to be set as the current value.
+ // @param dependent_sequences to be checked for range.
+ virtual void SetSequence(const int64_t& sequence,
+ const std::vector<Sequence*>& dependent_sequences) = 0;
+
+ // Serialise publishing in sequence.
+ //
+ // @param sequence to be applied.
+ // @param cursor to be serialise against.
+ // @param batch_size of the sequence.
+ virtual void SerialisePublishing(const int64_t& sequence,
+ const Sequence& cursor,
+ const int64_t& batch_size) = 0;
+};
+
+// Coordination barrier for tracking the cursor for publishers and sequence of
+// dependent {@link EventProcessor}s for processing a data structure.
+class SequenceBarrierInterface {
+ public:
+ // Wait for the given sequence to be available for consumption.
+ //
+ // @param sequence to wait for.
+ // @return the sequence up to which is available.
+ //
+ // @throws AlertException if a status change has occurred for the
+ // Disruptor.
+ virtual ~SequenceBarrierInterface(){}
+ virtual int64_t WaitFor(const int64_t& sequence) = 0;
+
+ // Wait for the given sequence to be available for consumption with a
+ // time out.
+ //
+ // @param sequence to wait for.
+ // @param timeout in microseconds.
+ // @return the sequence up to which is available.
+ //
+ // @throws AlertException if a status change has occurred for the
+ // Disruptor.
+ virtual int64_t WaitFor(const int64_t& sequence,
+ const int64_t& timeout_micro) = 0;
+
+ // Delegate a call to the {@link Sequencer#getCursor()}
+ //
+ // @return value of the cursor for entries that have been published.
+ virtual int64_t GetCursor() const = 0;
+
+ // The current alert status for the barrier.
+ //
+ // @return true if in alert otherwise false.
+ virtual bool IsAlerted() const = 0;
+
+ // Alert the {@link EventProcessor}s of a status change and stay in this
+ // status until cleared.
+ virtual void Alert() = 0;
+
+ // Clear the current alert status.
+ virtual void ClearAlert() = 0;
+
+ // Check if barrier is alerted, if so throws an AlertException
+ //
+ // @throws AlertException if barrier is alerted
+ virtual void CheckAlert() const = 0;
+};
+
+// Called by the {@link RingBuffer} to pre-populate all the events to fill the
+// RingBuffer.
+//
+// @param <T> event implementation storing the data for sharing during exchange
+// or parallel coordination of an event.
+template<typename T>
+class EventFactoryInterface {
+ public:
+ virtual ~EventFactoryInterface(){}
+ virtual T* NewInstance(const int& size) const = 0;
+};
+
+// Callback interface to be implemented for processing events as they become
+// available in the {@link RingBuffer}.
+//
+// @param <T> event implementation storing the data for sharing during exchange
+// or parallel coordination of an event.
+template<typename T>
+class EventHandlerInterface {
+ public:
+ // Called when a publisher has published an event to the {@link RingBuffer}
+ //
+ // @param event published to the {@link RingBuffer}
+ // @param sequence of the event being processed
+ // @param end_of_batch flag to indicate if this is the last event in a batch
+ // from the {@link RingBuffer}
+ //
+ // @throws Exception if the EventHandler would like the exception handled
+ // further up the chain.
+ virtual ~EventHandlerInterface(){}
+ virtual void OnEvent(const int64_t& sequence,
+ const bool& end_of_batch,
+ T* event) = 0;
+
+ // Called once on thread start before processing the first event.
+ virtual void OnStart() = 0;
+
+ // Called once on thread stop just before shutdown.
+ virtual void OnShutdown() = 0;
+};
+
+// Implementations translate another data representations into events claimed
+// for the {@link RingBuffer}.
+//
+// @param <T> event implementation storing the data for sharing during exchange
+// or parallel coordination of an event.
+template<typename T>
+class EventTranslatorInterface {
+ public:
+ // Translate a data representation into fields set in given event
+ //
+ // @param event into which the data should be translated.
+ // @param sequence that is assigned to events.
+ // @return the resulting event after it has been translated.
+ virtual ~EventTranslatorInterface(){}
+ virtual T* TranslateTo(const int64_t& sequence, T* event) { return NULL;}
+};
+
+// EventProcessors wait for events to become available for consumption from
+// the {@link RingBuffer}. An event processor should be associated with a
+// thread.
+//
+// @param <T> event implementation storing the data for sharing during exchange
+// or parallel coordination of an event.
+template<typename T>
+class EventProcessorInterface {
+ public:
+ // Get a pointer to the {@link Sequence} being used by this
+ // {@link EventProcessor}.
+ //
+ // @return pointer to the {@link Sequence} for this
+ // {@link EventProcessor}
+ virtual ~EventProcessorInterface(){}
+ virtual Sequence* GetSequence() = 0;
+
+ // Signal that this EventProcessor should stop when it has finished
+ // consuming at the next clean break.
+ // It will call {@link DependencyBarrier#alert()} to notify the thread to
+ // check status.
+ virtual void Halt() = 0;
+};
+
+// Callback handler for uncaught exception in the event processing cycle
+// of the {@link BatchEventProcessor}.
+//
+// @param <T> event type stored in the {@link RingBuffer}.
+template<typename T>
+class ExceptionHandlerInterface {
+ public:
+ // Strategy for handling uncaught exceptions when processing an event.
+ // If the strategy wishes to suspend further processing by the
+ // {@link BatchEventProcessor} then it should throw a std::runtime_error.
+ //
+ // @param exception that propagated from the {@link EventHandler}.
+ // @param sequence of the event which caused the exception.
+ // @param event being processed when the exception occured.
+ virtual ~ExceptionHandlerInterface(){}
+ virtual void Handle(const std::exception& exception,
+ const int64_t& sequence,
+ T* event) = 0;
+};
+
+// Strategy employed for making {@link EventProcessor}s wait on a cursor
+// {@link Sequence}.
+class WaitStrategyInterface: public boost::noncopyable {
+ public:
+ // Wait for the given sequence to be available for consumption.
+ //
+ // @param dependents further back the chain that must advance first.
+ // @param cursor on which to wait.
+ // @param barrier the consumer is waiting on.
+ // @param sequence to be waited on.
+ // @return the sequence that is available which may be greater than the
+ // requested sequence.
+ //
+ // @throws AlertException if the status of the Disruptor has changed.
+ virtual ~WaitStrategyInterface(){}
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t& sequence) = 0;
+
+ // Wait for the given sequence to be available for consumption in a
+ // {@link RingBuffer} with a timeout specified.
+ //
+ // @param dependents further back the chain that must advance first
+ // @param cursor on which to wait.
+ // @param barrier the consumer is waiting on.
+ // @param sequence to be waited on.
+ // @param timeout value in micro seconds to abort after.
+ // @return the sequence that is available which may be greater than the
+ // requested sequence.
+ //
+ // @throws AlertException if the status of the Disruptor has changed.
+ // @throws InterruptedException if the thread is interrupted.
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t & sequence,
+ const int64_t & timeout_micros) = 0;
+
+ // Signal those waiting that the cursor has advanced.
+ virtual void SignalAllWhenBlocking() = 0;
+};
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_INTERFACE_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/ring_buffer.h b/rocketmq-cpp/src/thread/disruptor/ring_buffer.h
new file mode 100755
index 00000000..c7150f15
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/ring_buffer.h
@@ -0,0 +1,90 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_RING_BUFFER_H_ // NOLINT
+#define DISRUPTOR_RING_BUFFER_H_ // NOLINT
+
+#include <boost/array.hpp>
+#include <vector>
+
+#include "interface.h"
+#include "claim_strategy.h"
+#include "wait_strategy.h"
+#include "sequencer.h"
+#include "sequence_barrier.h"
+
+namespace rocketmq {
+
+// Ring based store of reusable entries containing the data representing an
+// event beign exchanged between publisher and {@link EventProcessor}s.
+//
+// @param <T> implementation storing the data for sharing during exchange
+// or parallel coordination of an event.
+template<typename T>
+class RingBuffer : public Sequencer {
+ public:
+ // Construct a RingBuffer with the full option set.
+ //
+ // @param event_factory to instance new entries for filling the RingBuffer.
+ // @param buffer_size of the RingBuffer, must be a power of 2.
+ // @param claim_strategy_option threading strategy for publishers claiming
+ // entries in the ring.
+ // @param wait_strategy_option waiting strategy employed by
+ // processors_to_track waiting in entries becoming available.
+ RingBuffer(EventFactoryInterface<T>* event_factory,
+ int buffer_size,
+ ClaimStrategyOption claim_strategy_option,
+ WaitStrategyOption wait_strategy_option) :
+ Sequencer(buffer_size,
+ claim_strategy_option,
+ wait_strategy_option),
+ buffer_size_(buffer_size),
+ mask_(buffer_size - 1),
+ events_(event_factory->NewInstance(buffer_size)) {
+ }
+
+ ~RingBuffer() {
+ delete[] events_;
+ }
+
+ // Get the event for a given sequence in the RingBuffer.
+ //
+ // @param sequence for the event
+ // @return event pointer at the specified sequence position.
+ T* Get(const int64_t& sequence) {
+ return &events_[sequence & mask_];
+ }
+
+ private:
+ // Members
+ int buffer_size_;
+ int mask_;
+ T* events_;
+
+};
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_RING_BUFFER_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/sequence.h b/rocketmq-cpp/src/thread/disruptor/sequence.h
new file mode 100755
index 00000000..f1396f39
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/sequence.h
@@ -0,0 +1,139 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef CACHE_LINE_SIZE_IN_BYTES // NOLINT
+#define CACHE_LINE_SIZE_IN_BYTES 64 // NOLINT
+#endif // NOLINT
+#define ATOMIC_SEQUENCE_PADDING_LENGTH \
+ (CACHE_LINE_SIZE_IN_BYTES - sizeof(boost::atomic<int64_t>))/8
+#define SEQUENCE_PADDING_LENGTH \
+ (CACHE_LINE_SIZE_IN_BYTES - sizeof(int64_t))/8
+
+#ifndef DISRUPTOR_SEQUENCE_H_ // NOLINT
+#define DISRUPTOR_SEQUENCE_H_ // NOLINT
+
+#include <boost/atomic.hpp>
+#include <boost/memory_order.hpp>
+#include <boost/noncopyable.hpp>
+#include <vector>
+#include <limits>
+using namespace boost;
+namespace rocketmq {
+
+const int64_t kInitialCursorValue = -1L;
+
+// Sequence counter.
+class Sequence:public noncopyable {
+ public:
+ // Construct a sequence counter that can be tracked across threads.
+ //
+ // @param initial_value for the counter.
+ Sequence(int64_t initial_value = kInitialCursorValue) :
+ value_(initial_value) {}
+
+ // Get the current value of the {@link Sequence}.
+ //
+ // @return the current value.
+ int64_t sequence() const { return value_.load(boost::memory_order_acquire); }
+
+ // Set the current value of the {@link Sequence}.
+ //
+ // @param the value to which the {@link Sequence} will be set.
+ void set_sequence(int64_t value) { value_.store(value, boost::memory_order_release); }
+
+ // Increment and return the value of the {@link Sequence}.
+ //
+ // @param increment the {@link Sequence}.
+ // @return the new value incremented.
+ int64_t IncrementAndGet(const int64_t& increment) {
+ return value_.fetch_add(increment, boost::memory_order_release) + increment;
+ }
+
+ private:
+ // members
+ boost::atomic<int64_t> value_;
+
+};
+
+// Cache line padded sequence counter.
+//
+// Can be used across threads without worrying about false sharing if a
+// located adjacent to another counter in memory.
+class PaddedSequence : public Sequence {
+ public:
+ PaddedSequence(int64_t initial_value = kInitialCursorValue) :
+ Sequence(initial_value) {}
+
+ private:
+ // padding
+ int64_t padding_[ATOMIC_SEQUENCE_PADDING_LENGTH];
+
+};
+
+// Non-atomic sequence counter.
+//
+// This counter is not thread safe.
+class MutableLong {
+ public:
+ MutableLong(int64_t initial_value = kInitialCursorValue) :
+ sequence_(initial_value) {}
+
+ int64_t sequence() const { return sequence_; }
+
+ void set_sequence(const int64_t& sequence) { sequence_ = sequence; };
+
+ int64_t IncrementAndGet(const int64_t& delta) { sequence_ += delta; return sequence_; }
+
+ private:
+ volatile int64_t sequence_;
+};
+
+// Cache line padded non-atomic sequence counter.
+//
+// This counter is not thread safe.
+class PaddedLong : public MutableLong {
+ public:
+ PaddedLong(int64_t initial_value = kInitialCursorValue) :
+ MutableLong(initial_value) {}
+ private:
+ int64_t padding_[SEQUENCE_PADDING_LENGTH];
+};
+
+int64_t GetMinimumSequence(
+ const std::vector<Sequence*>& sequences) {
+ int64_t minimum = std::numeric_limits<int64_t>::max();
+
+ std::vector<Sequence*>::const_iterator it= sequences.begin();
+ for (;it!=sequences.end();it++) {
+ int64_t sequence = (*it)->sequence();
+ minimum = minimum < sequence ? minimum : sequence;
+ }
+
+ return minimum;
+};
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_SEQUENCE_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/sequence_barrier.h b/rocketmq-cpp/src/thread/disruptor/sequence_barrier.h
new file mode 100755
index 00000000..c1563881
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/sequence_barrier.h
@@ -0,0 +1,92 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_SEQUENCE_BARRIER_H_ // NOLINT
+#define DISRUPTOR_SEQUENCE_BARRIER_H_ // NOLINT
+
+#include <memory>
+#include <vector>
+
+#include "exceptions.h"
+#include "interface.h"
+namespace rocketmq {
+
+class ProcessingSequenceBarrier : SequenceBarrierInterface {
+ public:
+ ProcessingSequenceBarrier(WaitStrategyInterface* wait_strategy,
+ Sequence* sequence,
+ const std::vector<Sequence*>& sequences) :
+ wait_strategy_(wait_strategy),
+ cursor_(sequence),
+ dependent_sequences_(sequences),
+ alerted_(false) {
+ }
+
+ virtual int64_t WaitFor(const int64_t& sequence) {
+ return wait_strategy_->WaitFor(dependent_sequences_, *cursor_, *this,
+ sequence);
+ }
+
+ virtual int64_t WaitFor(const int64_t& sequence,
+ const int64_t& timeout_micros) {
+ return wait_strategy_->WaitFor(dependent_sequences_, *cursor_, *this,
+ sequence, timeout_micros);
+ }
+
+ virtual int64_t GetCursor() const {
+ return cursor_->sequence();
+ }
+
+ virtual bool IsAlerted() const {
+ return alerted_.load(boost::memory_order_acquire);
+ }
+
+ virtual void Alert() {
+ //metaq::LOG_INFO("set alert to true");
+ alerted_.store(true, boost::memory_order_release);
+ }
+
+ virtual void ClearAlert() {
+ alerted_.store(false, boost::memory_order_release);
+ }
+
+ virtual void CheckAlert() const {
+ if (IsAlerted())
+ {
+ //metaq::LOG_INFO("throw alert exception\r\n");
+ throw AlertException();
+ }
+ }
+
+ private:
+ WaitStrategyInterface* wait_strategy_;
+ Sequence* cursor_;
+ std::vector<Sequence*> dependent_sequences_;
+ boost::atomic<bool> alerted_;
+};
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_DEPENDENCY_BARRIER_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/sequencer.h b/rocketmq-cpp/src/thread/disruptor/sequencer.h
new file mode 100755
index 00000000..98d617f5
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/sequencer.h
@@ -0,0 +1,190 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_SEQUENCER_H_ // NOLINT
+#define DISRUPTOR_SEQUENCER_H_ // NOLINT
+
+#include <vector>
+
+#include "batch_descriptor.h"
+#include "claim_strategy.h"
+#include "interface.h"
+#include "sequence_barrier.h"
+#include "wait_strategy.h"
+
+namespace rocketmq {
+
+// Coordinator for claiming sequences for access to a data structures while
+// tracking dependent {@link Sequence}s
+class Sequencer: public boost::noncopyable {
+ public:
+ // Construct a Sequencer with the selected strategies.
+ //
+ // @param buffer_size over which sequences are valid.
+ // @param claim_strategy_option for those claiming sequences.
+ // @param wait_strategy_option for those waiting on sequences.
+ Sequencer(int buffer_size,
+ ClaimStrategyOption claim_strategy_option,
+ WaitStrategyOption wait_strategy_option) :
+ buffer_size_(buffer_size),
+ claim_strategy_(CreateClaimStrategy(claim_strategy_option,
+ buffer_size_)),
+ wait_strategy_(CreateWaitStrategy(wait_strategy_option)) { }
+
+ ~Sequencer() {
+ delete claim_strategy_;
+ delete wait_strategy_;
+ }
+
+ // Set the sequences that will gate publishers to prevent the buffer
+ // wrapping.
+ //
+ // @param sequences to be gated on.
+ void set_gating_sequences(
+ const std::vector<Sequence*>& sequences) {
+ gating_sequences_ = sequences;
+ }
+
+ // Create a {@link SequenceBarrier} that gates on the cursor and a list of
+ // {@link Sequence}s.
+ //
+ // @param sequences_to_track this barrier will track.
+ // @return the barrier gated as required.
+ ProcessingSequenceBarrier* NewBarrier(
+ const std::vector<Sequence*>& sequences_to_track) {
+ return new ProcessingSequenceBarrier(wait_strategy_, &cursor_,
+ sequences_to_track);
+ }
+
+ // Create a new {@link BatchDescriptor} that is the minimum of the
+ // requested size and the buffer_size.
+ //
+ // @param size for the new batch.
+ // @return the new {@link BatchDescriptor}.
+ BatchDescriptor* NewBatchDescriptor(const int& size) {
+ return new BatchDescriptor(size<buffer_size_?size:buffer_size_);
+ }
+
+ // The capacity of the data structure to hold entries.
+ //
+ // @return capacity of the data structure.
+ int buffer_size() { return buffer_size_; }
+
+
+ // Get the value of the cursor indicating the published sequence.
+ //
+ // @return value of the cursor for events that have been published.
+ int64_t GetCursor() { return cursor_.sequence(); }
+
+ // Has the buffer capacity left to allocate another sequence. This is a
+ // concurrent method so the response should only be taken as an indication
+ // of available capacity.
+ //
+ // @return true if the buffer has the capacity to allocated another event.
+ bool HasAvalaibleCapacity() {
+ return claim_strategy_->HasAvalaibleCapacity(gating_sequences_);
+ }
+
+ // Claim the next event in sequence for publishing to the {@link RingBuffer}.
+ //
+ // @return the claimed sequence.
+ int64_t Next() {
+ return claim_strategy_->IncrementAndGet(gating_sequences_);
+ }
+
+ // Claim the next batch of sequence numbers for publishing.
+ //
+ // @param batch_descriptor to be updated for the batch range.
+ // @return the updated batch_descriptor.
+ BatchDescriptor* Next(BatchDescriptor* batch_descriptor) {
+ int64_t sequence = claim_strategy_->IncrementAndGet(batch_descriptor->size(), gating_sequences_);
+ batch_descriptor->set_end(sequence);
+ return batch_descriptor;
+ }
+
+ // Claim a specific sequence when only one publisher is involved.
+ //
+ // @param sequence to be claimed.
+ // @return sequence just claime.
+ int64_t Claim(const int64_t& sequence) {
+ claim_strategy_->SetSequence(sequence, gating_sequences_);
+ return sequence;
+ }
+
+ // Publish an event and make it visible to {@link EventProcessor}s.
+ //
+ // @param sequence to be published.
+ void Publish(const int64_t& sequence) {
+ Publish(sequence, 1);
+ }
+
+ // Publish the batch of events in sequence.
+ //
+ // @param sequence to be published.
+ void Publish(const BatchDescriptor& batch_descriptor) {
+ Publish(batch_descriptor.end(), batch_descriptor.size());
+ }
+
+ // Force the publication of a cursor sequence.
+ //
+ // Only use this method when forcing a sequence and you are sure only one
+ // publisher exists. This will cause the cursor to advance to this
+ // sequence.
+ //
+ // @param sequence to which is to be forced for publication.
+ void ForcePublish(const int64_t& sequence) {
+ cursor_.set_sequence(sequence);
+ wait_strategy_->SignalAllWhenBlocking();
+ }
+
+ // TODO(fsaintjacques): This was added to overcome
+ // NoOpEventProcessor::GetSequence(), this is not a clean solution.
+ Sequence* GetSequencePtr() {
+ return &cursor_;
+ }
+
+ private:
+ // Helpers
+ void Publish(const int64_t& sequence, const int64_t& batch_size) {
+ //LOG_DEBUG("publish sequence:%d", sequence);
+ claim_strategy_->SerialisePublishing(sequence, cursor_, batch_size);
+ cursor_.set_sequence(sequence);
+ wait_strategy_->SignalAllWhenBlocking();
+ }
+
+ // Members
+ const int buffer_size_;
+
+ PaddedSequence cursor_;
+ std::vector<Sequence*> gating_sequences_;
+
+ ClaimStrategyInterface* claim_strategy_;
+ WaitStrategyInterface* wait_strategy_;
+
+};
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_RING_BUFFER_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/utils.h b/rocketmq-cpp/src/thread/disruptor/utils.h
new file mode 100755
index 00000000..0730093e
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/utils.h
@@ -0,0 +1,35 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_UTILS_H_ // NOLINT
+#define DISRUPTOR_UTILS_H_ // NOLINT
+
+// From Google C++ Standard, modified to use C++11 deleted functions.
+// A macro to disallow the copy constructor and operator= functions.
+#define DISALLOW_COPY_AND_ASSIGN(TypeName) \
+ TypeName(const TypeName&) delete \
+ void operator=(const TypeName&) delete;
+
+#endif // DISRUPTOR_UTILS_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptor/wait_strategy.h b/rocketmq-cpp/src/thread/disruptor/wait_strategy.h
new file mode 100755
index 00000000..fb2e58a1
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptor/wait_strategy.h
@@ -0,0 +1,377 @@
+// Copyright (c) 2011, François Saint-Jacques
+// All rights reserved.
+//
+// Redistribution and use in source and binary forms, with or without
+// modification, are permitted provided that the following conditions are met:
+// * Redistributions of source code must retain the above copyright
+// notice, this list of conditions and the following disclaimer.
+// * Redistributions in binary form must reproduce the above copyright
+// notice, this list of conditions and the following disclaimer in the
+// documentation and/or other materials provided with the distribution.
+// * Neither the name of the disruptor-- nor the
+// names of its contributors may be used to endorse or promote products
+// derived from this software without specific prior written permission.
+//
+// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+// ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+// WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+// DISCLAIMED. IN NO EVENT SHALL FRANÇOIS SAINT-JACQUES BE LIABLE FOR ANY
+// DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+// (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
+// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
+// ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+// SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+#ifndef DISRUPTOR_WAITSTRATEGY_H_ // NOLINT
+#define DISRUPTOR_WAITSTRATEGY_H_ // NOLINT
+
+#include <sys/time.h>
+
+#include <boost/chrono.hpp>
+#include <boost/thread.hpp>
+#include <vector>
+
+#include "exceptions.h"
+#include "interface.h"
+#include "sequence.h"
+
+namespace rocketmq {
+
+// Strategy options which are available to those waiting on a
+// {@link RingBuffer}
+enum WaitStrategyOption {
+ // This strategy uses a condition variable inside a lock to block the
+ // event procesor which saves CPU resource at the expense of lock
+ // contention.
+ kBlockingStrategy,
+ // This strategy uses a progressive back off strategy by first spinning,
+ // then yielding, then sleeping for 1ms period. This is a good strategy
+ // for burst traffic then quiet periods when latency is not critical.
+ kSleepingStrategy,
+ // This strategy calls Thread.yield() in a loop as a waiting strategy
+ // which reduces contention at the expense of CPU resource.
+ kYieldingStrategy,
+ // This strategy call spins in a loop as a waiting strategy which is
+ // lowest and most consistent latency but ties up a CPU.
+ kBusySpinStrategy
+};
+
+// Blocking strategy that uses a lock and condition variable for
+// {@link Consumer}s waiting on a barrier.
+// This strategy should be used when performance and low-latency are not as
+// important as CPU resource.
+class BlockingStrategy : public WaitStrategyInterface {
+ public:
+ BlockingStrategy() {}
+
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t& sequence) {
+ int64_t available_sequence = 0;
+ // We need to wait.
+ if ((available_sequence = cursor.sequence()) < sequence) {
+ // acquire lock
+ boost::unique_lock<boost::recursive_mutex> ulock(mutex_);
+ while ((available_sequence = cursor.sequence()) < sequence) {
+ barrier.CheckAlert();
+ consumer_notify_condition_.wait(ulock);
+ }
+ } // unlock happens here, on ulock destruction.
+
+ if (0 != dependents.size()) {
+ while ((available_sequence = GetMinimumSequence(dependents)) < \
+ sequence) {
+ barrier.CheckAlert();
+ }
+ }
+
+ return available_sequence;
+ }
+
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t& sequence,
+ const int64_t& timeout_micros) {
+ int64_t available_sequence = 0;
+ // We have to wait
+ if ((available_sequence = cursor.sequence()) < sequence) {
+ boost::unique_lock<boost::recursive_mutex> ulock(mutex_);
+ while ((available_sequence = cursor.sequence()) < sequence) {
+ barrier.CheckAlert();
+ if (boost::cv_status::timeout == consumer_notify_condition_.wait_for(ulock,
+ boost::chrono::microseconds(timeout_micros)))
+ break;
+
+ }
+ } // unlock happens here, on ulock destruction
+
+ if (0 != dependents.size()) {
+ while ((available_sequence = GetMinimumSequence(dependents)) \
+ < sequence) {
+ barrier.CheckAlert();
+ }
+ }
+
+ return available_sequence;
+ }
+
+ virtual void SignalAllWhenBlocking() {
+ boost::unique_lock<boost::recursive_mutex> ulock(mutex_);
+ consumer_notify_condition_.notify_all();
+ }
+
+ private:
+ boost::recursive_mutex mutex_;
+ boost::condition_variable_any consumer_notify_condition_;
+
+};
+
+// Sleeping strategy
+class SleepingStrategy : public WaitStrategyInterface {
+ public:
+ SleepingStrategy() {}
+
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t& sequence) {
+ int64_t available_sequence = 0;
+ int counter = kRetries;
+
+ if (0 == dependents.size()) {
+ while ((available_sequence = cursor.sequence()) < sequence) {
+ counter = ApplyWaitMethod(barrier, counter);
+ }
+ } else {
+ while ((available_sequence = GetMinimumSequence(dependents)) < \
+ sequence) {
+ counter = ApplyWaitMethod(barrier, counter);
+ }
+ }
+
+ return available_sequence;
+ }
+
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t& sequence,
+ const int64_t& timeout_micros) {
+ // timing
+ struct timeval start_time, end_time;
+ gettimeofday(&start_time, NULL);
+ int64_t start_micro = start_time.tv_sec*1000000 + start_time.tv_usec;
+
+ int64_t available_sequence = 0;
+ int counter = kRetries;
+
+ if (0 == dependents.size()) {
+ while ((available_sequence = cursor.sequence()) < sequence) {
+ counter = ApplyWaitMethod(barrier, counter);
+ gettimeofday(&end_time, NULL);
+ int64_t end_micro = end_time.tv_sec*1000000 + end_time.tv_usec;
+ if (timeout_micros < (end_micro - start_micro))
+ break;
+ }
+ } else {
+ while ((available_sequence = GetMinimumSequence(dependents)) < \
+ sequence) {
+ counter = ApplyWaitMethod(barrier, counter);
+ gettimeofday(&end_time, NULL);
+ int64_t end_micro = end_time.tv_sec*1000000 + end_time.tv_usec;
+ if (timeout_micros < (end_micro - start_micro))
+ break;
+ }
+ }
+
+ return available_sequence;
+ }
+
+ virtual void SignalAllWhenBlocking() {}
+
+ static const int kRetries = 200;
+
+ private:
+ int ApplyWaitMethod(const SequenceBarrierInterface& barrier, int counter) {
+ barrier.CheckAlert();
+ if (counter > 100) {
+ counter--;
+ } else if (counter > 0) {
+ counter--;
+ boost::this_thread::yield();
+ } else {
+ boost::this_thread::sleep_for(boost::chrono::milliseconds(1));
+ }
+
+ return counter;
+ }
+
+};
+
+// Yielding strategy that uses a sleep(0) for {@link EventProcessor}s waiting
+// on a barrier. This strategy is a good compromise between performance and
+// CPU resource.
+class YieldingStrategy : public WaitStrategyInterface {
+ public:
+ YieldingStrategy() {}
+
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t& sequence) {
+ int64_t available_sequence = 0;
+ int counter = kSpinTries;
+
+ if (0 == dependents.size()) {
+ while ((available_sequence = cursor.sequence()) < sequence) {
+ counter = ApplyWaitMethod(barrier, counter);
+ }
+ } else {
+ while ((available_sequence = GetMinimumSequence(dependents)) < \
+ sequence) {
+ counter = ApplyWaitMethod(barrier, counter);
+ }
+ }
+
+ return available_sequence;
+ }
+
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t& sequence,
+ const int64_t& timeout_micros) {
+ struct timeval start_time, end_time;
+ gettimeofday(&start_time, NULL);
+ int64_t start_micro = start_time.tv_sec*1000000 + start_time.tv_usec;
+
+ int64_t available_sequence = 0;
+ int counter = kSpinTries;
+
+ if (0 == dependents.size()) {
+ while ((available_sequence = cursor.sequence()) < sequence) {
+ counter = ApplyWaitMethod(barrier, counter);
+ gettimeofday(&end_time, NULL);
+ int64_t end_micro = end_time.tv_sec*1000000 + end_time.tv_usec;
+ if (timeout_micros < (end_micro - start_micro))
+ break;
+ }
+ } else {
+ while ((available_sequence = GetMinimumSequence(dependents)) < \
+ sequence) {
+ counter = ApplyWaitMethod(barrier, counter);
+ gettimeofday(&end_time, NULL);
+ int64_t end_micro = end_time.tv_sec*1000000 + end_time.tv_usec;
+ if (timeout_micros < (end_micro - start_micro))
+ break;
+ }
+ }
+
+ return available_sequence;
+ }
+
+ virtual void SignalAllWhenBlocking() {}
+
+ static const int kSpinTries = 100;
+
+ private:
+ int ApplyWaitMethod(const SequenceBarrierInterface& barrier, int counter) {
+ barrier.CheckAlert();
+ if (counter == 0) {
+ boost::this_thread::yield();
+ } else {
+ counter--;
+ }
+
+ return counter;
+ }
+
+};
+
+
+// Busy Spin strategy that uses a busy spin loop for {@link EventProcessor}s
+// waiting on a barrier.
+// This strategy will use CPU resource to avoid syscalls which can introduce
+// latency jitter. It is best used when threads can be bound to specific
+// CPU cores.
+class BusySpinStrategy : public WaitStrategyInterface {
+ public:
+ BusySpinStrategy() {}
+
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t& sequence) {
+ int64_t available_sequence = 0;
+ if (0 == dependents.size()) {
+ while ((available_sequence = cursor.sequence()) < sequence) {
+ barrier.CheckAlert();
+ }
+ } else {
+ while ((available_sequence = GetMinimumSequence(dependents)) < \
+ sequence) {
+ barrier.CheckAlert();
+ }
+ }
+
+ return available_sequence;
+ }
+
+ virtual int64_t WaitFor(const std::vector<Sequence*>& dependents,
+ const Sequence& cursor,
+ const SequenceBarrierInterface& barrier,
+ const int64_t& sequence,
+ const int64_t& timeout_micros) {
+ struct timeval start_time, end_time;
+ gettimeofday(&start_time, NULL);
+ int64_t start_micro = start_time.tv_sec*1000000 + start_time.tv_usec;
+ int64_t available_sequence = 0;
+
+ if (0 == dependents.size()) {
+ while ((available_sequence = cursor.sequence()) < sequence) {
+ barrier.CheckAlert();
+ gettimeofday(&end_time, NULL);
+ int64_t end_micro = end_time.tv_sec*1000000 + end_time.tv_usec;
+ if (timeout_micros < (end_micro - start_micro))
+ break;
+ }
+ } else {
+ while ((available_sequence = GetMinimumSequence(dependents)) < \
+ sequence) {
+ barrier.CheckAlert();
+ gettimeofday(&end_time, NULL);
+ int64_t end_micro = end_time.tv_sec*1000000 + end_time.tv_usec;
+ if (timeout_micros < (end_micro - start_micro))
+ break;
+ }
+ }
+
+ return available_sequence;
+ }
+
+ virtual void SignalAllWhenBlocking() {}
+
+};
+
+WaitStrategyInterface* CreateWaitStrategy(WaitStrategyOption wait_option) {
+ switch (wait_option) {
+ case kBlockingStrategy:
+ return new BlockingStrategy();
+ case kSleepingStrategy:
+ return new SleepingStrategy();
+ case kYieldingStrategy:
+ return new YieldingStrategy();
+ case kBusySpinStrategy:
+ return new BusySpinStrategy();
+ default:
+ return NULL;
+ }
+}
+
+
+}; // namespace rocketmq
+
+#endif // DISRUPTOR_WAITSTRATEGY_H_ NOLINT
diff --git a/rocketmq-cpp/src/thread/disruptorLFQ.h b/rocketmq-cpp/src/thread/disruptorLFQ.h
new file mode 100644
index 00000000..a05b0cd8
--- /dev/null
+++ b/rocketmq-cpp/src/thread/disruptorLFQ.h
@@ -0,0 +1,113 @@
+#ifndef _DISRUPTORLFQ_
+#define _DISRUPTORLFQ_
+
+#include <disruptor/event_processor.h>
+#include <disruptor/event_publisher.h>
+#include <disruptor/exception_handler.h>
+#include <disruptor/interface.h>
+
+#include <boost/asio/io_service.hpp>
+#include <boost/bind.hpp>
+#include <boost/scoped_ptr.hpp>
+#include <boost/thread/thread.hpp>
+
+namespace rocketmq {
+class Task;
+class taskEventFactory : public EventFactoryInterface<Task> {
+ public:
+ virtual Task* NewInstance(const int& size) const;
+};
+
+class taskBatchHandler : public EventHandlerInterface<Task> {
+ public:
+ taskBatchHandler(int pullMsgThreadPoolNum);
+ virtual ~taskBatchHandler() {}
+
+ virtual void OnEvent(const int64_t& sequence, const bool& end_of_batch,
+ Task* event);
+ virtual void OnStart() {}
+ virtual void OnShutdown() {}
+ void runTaskEvent(Task event, int64_t sequence);
+ void stopIOService();
+
+ private:
+ boost::asio::io_service m_ioService;
+ boost::thread_group m_threadpool;
+ boost::asio::io_service::work m_ioServiceWork;
+};
+
+class taskEventTranslator : public EventTranslatorInterface<Task> {
+ public:
+ taskEventTranslator(Task* event);
+ virtual ~taskEventTranslator() {}
+ virtual Task* TranslateTo(const int64_t& sequence, Task* event);
+
+ private:
+ Task* m_taskEvent;
+};
+
+class taskExceptionHandler : public ExceptionHandlerInterface<Task> {
+ public:
+ virtual void Handle(const std::exception& exception, const int64_t& sequence,
+ Task* event) {}
+};
+
+class disruptorLFQ {
+ public:
+ disruptorLFQ(int threadCount) {
+ m_task_factory.reset(new taskEventFactory());
+ m_ring_buffer.reset(new RingBuffer<Task>(
+ m_task_factory.get(),
+ 1024, // default size is 1024, must be n power of 2
+ kSingleThreadedStrategy,
+ // metaq::kBusySpinStrategy);//load normal, high cpu occupy, and
+ // smallest consume latency
+ // metaq::kYieldingStrategy); //load normal, high cpu occupy, and
+ // smaller consume latency
+ // metaq::kSleepingStrategy);//load normal, lowest cpu occupy, but
+ // largest consume latency
+ kBlockingStrategy)); // load normal, lowest CPU occupy, but
+ // largest consume latency
+
+ m_sequence_to_track.reset(new std::vector<Sequence*>(0));
+ m_sequenceBarrier.reset(
+ m_ring_buffer->NewBarrier(*(m_sequence_to_track.get())));
+
+ m_task_handler.reset(new taskBatchHandler(threadCount));
+ m_task_exception_handler.reset(new taskExceptionHandler());
+ m_processor.reset(new BatchEventProcessor<Task>(
+ m_ring_buffer.get(),
+ (SequenceBarrierInterface*)m_sequenceBarrier.get(),
+ m_task_handler.get(), m_task_exception_handler.get()));
+
+ /*
+ Publisher will try to publish BUFFER_SIZE + 1 events.
+ The last event should wait for at least one consume before publishing, thus
+ preventing an overwrite.
+ After the single consume, the publisher should resume and publish the last
+ event.
+ */
+ m_gating_sequences.push_back(m_processor.get()->GetSequence());
+ m_ring_buffer->set_gating_sequences(
+ m_gating_sequences); // prevent overlap, publishEvent will be blocked
+ // on ring_buffer_->Next();
+
+ m_publisher.reset(new EventPublisher<Task>(m_ring_buffer.get()));
+ }
+ virtual ~disruptorLFQ() {}
+
+ public:
+ boost::scoped_ptr<taskEventFactory> m_task_factory;
+ boost::scoped_ptr<taskBatchHandler> m_task_handler;
+ boost::scoped_ptr<taskExceptionHandler> m_task_exception_handler;
+ boost::scoped_ptr<std::vector<Sequence*>> m_sequence_to_track;
+ boost::scoped_ptr<RingBuffer<Task>> m_ring_buffer;
+ boost::scoped_ptr<ProcessingSequenceBarrier> m_sequenceBarrier;
+ boost::scoped_ptr<BatchEventProcessor<Task>> m_processor;
+ boost::scoped_ptr<EventPublisher<Task>> m_publisher;
+ std::vector<Sequence*> m_gating_sequences;
+};
+}
+//<!***************************************************************************
+
+#endif
diff --git a/rocketmq-cpp/src/thread/task_queue.cpp b/rocketmq-cpp/src/thread/task_queue.cpp
new file mode 100755
index 00000000..510425c3
--- /dev/null
+++ b/rocketmq-cpp/src/thread/task_queue.cpp
@@ -0,0 +1,103 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "task_queue.h"
+#include <sys/prctl.h>
+#include "UtilAll.h"
+#include "disruptorLFQ.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+Task* taskEventFactory::NewInstance(const int& size) const {
+ return new Task[size];
+}
+
+taskBatchHandler::taskBatchHandler(int pullMsgThreadPoolNum)
+ : m_ioServiceWork(m_ioService) {
+ string taskName = UtilAll::getProcessName();
+ prctl(PR_SET_NAME, "PullMsgTP", 0, 0, 0);
+ for (int i = 0; i != pullMsgThreadPoolNum; ++i) {
+ m_threadpool.create_thread(
+ boost::bind(&boost::asio::io_service::run, &m_ioService));
+ }
+ prctl(PR_SET_NAME, taskName.c_str(), 0, 0, 0);
+}
+
+void taskBatchHandler::OnEvent(const int64_t& sequence,
+ const bool& end_of_batch, Task* event) {
+ //cp Task event out, avoid publish event override current Task event
+ Task currentTask(*event);
+ m_ioService.post(boost::bind(&taskBatchHandler::runTaskEvent, this,
+ currentTask, sequence));
+}
+
+void taskBatchHandler::runTaskEvent(Task event, int64_t sequence) {
+ // LOG_INFO("processor event sequence:%lld", sequence);
+ event.run();
+}
+
+void taskBatchHandler::stopIOService() {
+ m_ioService.stop();
+ m_threadpool.join_all();
+}
+
+taskEventTranslator::taskEventTranslator(Task* event) : m_taskEvent(event) {}
+
+Task* taskEventTranslator::TranslateTo(const int64_t& sequence, Task* event) {
+ // LOG_INFO("publish sequence:%lld, event:%x", sequence, event);
+ *event = *m_taskEvent;
+ return event;
+};
+
+//******************************************************************************************8
+TaskQueue::TaskQueue(int threadCount) {
+ m_flag.store(true, boost::memory_order_release);
+ m_disruptorLFQ = new disruptorLFQ(threadCount);
+}
+
+TaskQueue::~TaskQueue() {
+ delete m_disruptorLFQ;
+ m_disruptorLFQ = NULL;
+}
+
+void TaskQueue::close() {
+ m_flag.store(false, boost::memory_order_release);
+ m_disruptorLFQ->m_task_handler->stopIOService();
+ m_disruptorLFQ->m_processor->Halt();
+}
+
+bool TaskQueue::bTaskQueueStatusOK() {
+ return m_flag.load(boost::memory_order_acquire) == true;
+}
+
+void TaskQueue::produce(const Task& task) {
+ boost::mutex::scoped_lock lock(m_publishLock);
+ taskEventTranslator pTranslator(const_cast<Task*>(&task));
+ m_disruptorLFQ->m_publisher->PublishEvent(&pTranslator);
+}
+
+int TaskQueue::run() {
+ while (true) {
+ m_disruptorLFQ->m_processor->Run();
+ if (m_flag.load(boost::memory_order_acquire) == false) {
+ break;
+ }
+ }
+ return 0;
+}
+
+//<!***************************************************************************
+} //<! end namespace;
diff --git a/rocketmq-cpp/src/thread/task_queue.h b/rocketmq-cpp/src/thread/task_queue.h
new file mode 100755
index 00000000..e60607c6
--- /dev/null
+++ b/rocketmq-cpp/src/thread/task_queue.h
@@ -0,0 +1,679 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ *//********************************************************************
+author: qiwei.wqw@alibaba-inc.com
+*********************************************************************/
+#ifndef _TASK_QUEUE_I_
+#define _TASK_QUEUE_I_
+
+#include <boost/atomic.hpp>
+#include <boost/thread/mutex.hpp>
+#include <list>
+#include <vector>
+using namespace std;
+
+namespace rocketmq {
+
+//<!***************************************************************************
+typedef void (*taskfunc)(void*);
+
+//<! 数据加操作的集合
+class ITask_impl {
+ public:
+ virtual ~ITask_impl() {}
+ virtual void run() = 0;
+ virtual ITask_impl* fork() = 0;
+};
+
+//<!***************************************************************************
+class Task_impl : public ITask_impl {
+ public:
+ Task_impl(taskfunc func, void* arg_) : m_func(func), m_arg(arg_) {}
+ virtual ~Task_impl() {
+ m_func = 0;
+ m_arg = 0;
+ }
+ virtual void run() {
+ if (m_func != 0) m_func(m_arg);
+ }
+ virtual ITask_impl* fork() { return new Task_impl(m_func, m_arg); }
+
+ protected:
+ taskfunc m_func;
+ void* m_arg;
+};
+
+//<!***************************************************************************
+//<! 构造ITask_impl的子类对象时，为其赋予不同的数据和操作即可。
+//<! 这里使用了组合的方式实现了接口和实现的分离;
+//<!***************************************************************************
+struct Task {
+ static void dumy(void*) {}
+
+ Task(taskfunc f_, void* d_) { m_pTaskImpl = new Task_impl(f_, d_); }
+ Task(ITask_impl* task_imp_) : m_pTaskImpl(task_imp_) {}
+ Task(const Task& src_) : m_pTaskImpl(src_.m_pTaskImpl->fork()) {}
+ Task() { m_pTaskImpl = new Task_impl(&Task::dumy, 0); }
+ virtual ~Task() { delete m_pTaskImpl; }
+ Task& operator=(const Task& src_) {
+ delete m_pTaskImpl;
+ m_pTaskImpl = src_.m_pTaskImpl->fork();
+ return *this;
+ }
+ void run() {
+ if (m_pTaskImpl) m_pTaskImpl->run();
+ }
+
+ private:
+ ITask_impl* m_pTaskImpl;
+};
+
+//<!***************************************************************************
+class ITaskQueue {
+ public:
+ typedef list<Task> TaskList;
+
+ public:
+ virtual ~ITaskQueue() {}
+ virtual void close() = 0;
+ virtual void produce(const Task& task) = 0;
+ // virtual void multi_produce(const TaskList& tasks) = 0;
+ // virtual int consume(Task& task) = 0;
+ // virtual int consume_all(TaskList& tasks) = 0;
+ virtual int run() = 0;
+ // virtual int batch_run() = 0;
+ virtual bool bTaskQueueStatusOK() = 0;
+};
+
+//<!***************************************************************************
+//<! 由于不同的操作和数据可能需要构造不同ITask_impl子类，
+//<!
+//我们需要提供一些泛型函数，能够将用户的所有操作和数据都能轻易的转换成Task对象。
+//<! TaskBinder 提供一系列的gen函数，能够转换用户的普通函数和数据为Task对象;
+//<!***************************************************************************
+struct TaskBinder {
+ static Task gen(void (*func)(void*), void* p_) { return Task(func, p_); }
+
+ template <typename RET>
+ static Task gen(RET (*func)(void)) {
+ struct lambda {
+ static void taskfunc(void* p_) { (*(RET(*)(void))p_)(); };
+ };
+ return Task(lambda::taskfunc, (void*)func);
+ }
+
+ template <typename FUNCT, typename ARG1>
+ static Task gen(FUNCT func, ARG1 arg1) {
+ struct lambda : public ITask_impl {
+ FUNCT dest_func;
+ ARG1 arg1;
+ lambda(FUNCT func, const ARG1& arg1) : dest_func(func), arg1(arg1) {}
+ virtual void run() { (*dest_func)(arg1); }
+ virtual ITask_impl* fork() { return new lambda(dest_func, arg1); }
+ };
+ return Task(new lambda(func, arg1));
+ }
+
+ template <typename FUNCT, typename ARG1, typename ARG2>
+ static Task gen(FUNCT func, ARG1 arg1, ARG2 arg2) {
+ struct lambda : public ITask_impl {
+ FUNCT dest_func;
+ ARG1 arg1;
+ ARG2 arg2;
+ lambda(FUNCT func, const ARG1& arg1, const ARG2& arg2)
+ : dest_func(func), arg1(arg1), arg2(arg2) {}
+ virtual void run() { (*dest_func)(arg1, arg2); }
+ virtual ITask_impl* fork() { return new lambda(dest_func, arg1, arg2); }
+ };
+ return Task(new lambda(func, arg1, arg2));
+ }
+
+ template <typename FUNCT, typename ARG1, typename ARG2, typename ARG3>
+ static Task gen(FUNCT func, ARG1 arg1, ARG2 arg2, ARG3 arg3) {
+ struct lambda : public ITask_impl {
+ FUNCT dest_func;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ lambda(FUNCT func, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3)
+ : dest_func(func), arg1(arg1), arg2(arg2), arg3(arg3) {}
+ virtual void run() { (*dest_func)(arg1, arg2, arg3); }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, arg1, arg2, arg3);
+ }
+ };
+ return Task(new lambda(func, arg1, arg2, arg3));
+ }
+
+ template <typename FUNCT, typename ARG1, typename ARG2, typename ARG3,
+ typename ARG4>
+ static Task gen(FUNCT func, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4) {
+ struct lambda : public ITask_impl {
+ FUNCT dest_func;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ lambda(FUNCT func, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4)
+ : dest_func(func), arg1(arg1), arg2(arg2), arg3(arg3), arg4(arg4) {}
+ virtual void run() { (*dest_func)(arg1, arg2, arg3, arg4); }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, arg1, arg2, arg3, arg4);
+ }
+ };
+ return Task(new lambda(func, arg1, arg2, arg3, arg4));
+ }
+
+ template <typename FUNCT, typename ARG1, typename ARG2, typename ARG3,
+ typename ARG4, typename ARG5>
+ static Task gen(FUNCT func, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4,
+ ARG5 arg5) {
+ struct lambda : public ITask_impl {
+ FUNCT dest_func;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ lambda(FUNCT func, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5)
+ : dest_func(func),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5) {}
+ virtual void run() { (*dest_func)(arg1, arg2, arg3, arg4, arg5); }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, arg1, arg2, arg3, arg4, arg5);
+ }
+ };
+ return Task(new lambda(func, arg1, arg2, arg3, arg4, arg5));
+ }
+
+ template <typename FUNCT, typename ARG1, typename ARG2, typename ARG3,
+ typename ARG4, typename ARG5, typename ARG6>
+ static Task gen(FUNCT func, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4,
+ ARG5 arg5, ARG6 arg6) {
+ struct lambda : public ITask_impl {
+ FUNCT dest_func;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ ARG6 arg6;
+ lambda(FUNCT func, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5, const ARG6& arg6)
+ : dest_func(func),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5),
+ arg6(arg6) {}
+ virtual void run() { (*dest_func)(arg1, arg2, arg3, arg4, arg5, arg6); }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, arg1, arg2, arg3, arg4, arg5, arg6);
+ }
+ };
+ return Task(new lambda(func, arg1, arg2, arg3, arg4, arg5, arg6));
+ }
+
+ template <typename FUNCT, typename ARG1, typename ARG2, typename ARG3,
+ typename ARG4, typename ARG5, typename ARG6, typename ARG7>
+ static Task gen(FUNCT func, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4,
+ ARG5 arg5, ARG6 arg6, ARG7 arg7) {
+ struct lambda : public ITask_impl {
+ FUNCT dest_func;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ ARG6 arg6;
+ ARG7 arg7;
+ lambda(FUNCT func, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5, const ARG6& arg6,
+ const ARG7& arg7)
+ : dest_func(func),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5),
+ arg6(arg6),
+ arg7(arg7) {}
+ virtual void run() {
+ (*dest_func)(arg1, arg2, arg3, arg4, arg5, arg6, arg7);
+ }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, arg1, arg2, arg3, arg4, arg5, arg6, arg7);
+ }
+ };
+ return Task(new lambda(func, arg1, arg2, arg3, arg4, arg5, arg6, arg7));
+ }
+
+ template <typename FUNCT, typename ARG1, typename ARG2, typename ARG3,
+ typename ARG4, typename ARG5, typename ARG6, typename ARG7,
+ typename ARG8>
+ static Task gen(FUNCT func, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4,
+ ARG5 arg5, ARG6 arg6, ARG7 arg7, ARG8 arg8) {
+ struct lambda : public ITask_impl {
+ FUNCT dest_func;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ ARG6 arg6;
+ ARG7 arg7;
+ ARG8 arg8;
+ lambda(FUNCT func, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5, const ARG6& arg6,
+ const ARG7& arg7, const ARG8& arg8)
+ : dest_func(func),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5),
+ arg6(arg6),
+ arg7(arg7),
+ arg8(arg8) {}
+ virtual void run() {
+ (*dest_func)(arg1, arg2, arg3, arg4, arg5, arg6, arg7, arg8);
+ }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, arg1, arg2, arg3, arg4, arg5, arg6, arg7,
+ arg8);
+ }
+ };
+ return Task(
+ new lambda(func, arg1, arg2, arg3, arg4, arg5, arg6, arg7, arg8));
+ }
+
+ template <typename FUNCT, typename ARG1, typename ARG2, typename ARG3,
+ typename ARG4, typename ARG5, typename ARG6, typename ARG7,
+ typename ARG8, typename ARG9>
+ static Task gen(FUNCT func, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4,
+ ARG5 arg5, ARG6 arg6, ARG7 arg7, ARG8 arg8, ARG9 arg9) {
+ struct lambda : public ITask_impl {
+ FUNCT dest_func;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ ARG6 arg6;
+ ARG7 arg7;
+ ARG8 arg8;
+ ARG9 arg9;
+ lambda(FUNCT func, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5, const ARG6& arg6,
+ const ARG7& arg7, const ARG8& arg8, const ARG9& arg9)
+ : dest_func(func),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5),
+ arg6(arg6),
+ arg7(arg7),
+ arg8(arg8),
+ arg9(arg9) {}
+ virtual void run() {
+ (*dest_func)(arg1, arg2, arg3, arg4, arg5, arg6, arg7, arg8, arg9);
+ }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, arg1, arg2, arg3, arg4, arg5, arg6, arg7,
+ arg8, arg9);
+ }
+ };
+ return Task(
+ new lambda(func, arg1, arg2, arg3, arg4, arg5, arg6, arg7, arg8, arg9));
+ }
+
+ //<!***************************************************************************
+ //<! class fuctions;;
+ //<!***************************************************************************
+ template <typename T, typename RET>
+ static Task gen(RET (T::*func)(void), T* obj) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)(void);
+ T* obj;
+ lambda(RET (T::*func)(void), T* obj) : dest_func(func), obj(obj) {}
+ virtual void run() { (obj->*dest_func)(); }
+ virtual ITask_impl* fork() { return new lambda(dest_func, obj); }
+ };
+ return Task(new lambda(func, obj));
+ }
+
+ template <typename T, typename RET, typename FARG1, typename ARG1>
+ static Task gen(RET (T::*func)(FARG1), T* obj, ARG1 arg1) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)(FARG1);
+ T* obj;
+ ARG1 arg1;
+ lambda(RET (T::*pfunc)(FARG1), T* obj, const ARG1& arg1)
+ : dest_func(pfunc), obj(obj), arg1(arg1) {}
+ virtual void run() { (obj->*dest_func)(arg1); }
+ virtual ITask_impl* fork() { return new lambda(dest_func, obj, arg1); }
+ };
+ return Task(new lambda(func, obj, arg1));
+ }
+
+ template <typename T, typename RET, typename FARG1, typename FARG2,
+ typename ARG1, typename ARG2>
+ static Task gen(RET (T::*func)(FARG1, FARG2), T* obj, ARG1 arg1, ARG2 arg2) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)(FARG1, FARG2);
+ T* obj;
+ ARG1 arg1;
+ ARG2 arg2;
+ lambda(RET (T::*func)(FARG1, FARG2), T* obj, const ARG1& arg1,
+ const ARG2& arg2)
+ : dest_func(func), obj(obj), arg1(arg1), arg2(arg2) {}
+ virtual void run() { (obj->*dest_func)(arg1, arg2); }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, obj, arg1, arg2);
+ }
+ };
+ return Task(new lambda(func, obj, arg1, arg2));
+ }
+
+ template <typename T, typename RET, typename FARG1, typename FARG2,
+ typename FARG3, typename ARG1, typename ARG2, typename ARG3>
+ static Task gen(RET (T::*func)(FARG1, FARG2, FARG3), T* obj, ARG1 arg1,
+ ARG2 arg2, ARG3 arg3) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)(FARG1, FARG2, FARG3);
+ T* obj;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ lambda(RET (T::*func)(FARG1, FARG2, FARG3), T* obj, const ARG1& arg1,
+ const ARG2& arg2, const ARG3& arg3)
+ : dest_func(func), obj(obj), arg1(arg1), arg2(arg2), arg3(arg3) {}
+ virtual void run() { (obj->*dest_func)(arg1, arg2, arg3); }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, obj, arg1, arg2, arg3);
+ }
+ };
+ return Task(new lambda(func, obj, arg1, arg2, arg3));
+ }
+
+ template <typename T, typename RET, typename FARG1, typename FARG2,
+ typename FARG3, typename FARG4, typename ARG1, typename ARG2,
+ typename ARG3, typename ARG4>
+ static Task gen(RET (T::*func)(FARG1, FARG2, FARG3, FARG4), T* obj, ARG1 arg1,
+ ARG2 arg2, ARG3 arg3, ARG4 arg4) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)(FARG1, FARG2, FARG3, FARG4);
+ T* obj;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ lambda(RET (T::*func)(FARG1, FARG2, FARG3, FARG4), T* obj,
+ const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4)
+ : dest_func(func),
+ obj(obj),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4) {}
+ virtual void run() { (obj->*dest_func)(arg1, arg2, arg3, arg4); }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, obj, arg1, arg2, arg3, arg4);
+ }
+ };
+ return Task(new lambda(func, obj, arg1, arg2, arg3, arg4));
+ }
+
+ template <typename T, typename RET, typename FARG1, typename FARG2,
+ typename FARG3, typename FARG4, typename FARG5, typename ARG1,
+ typename ARG2, typename ARG3, typename ARG4, typename ARG5>
+ static Task gen(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5), T* obj,
+ ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4, ARG5 arg5) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)(FARG1, FARG2, FARG3, FARG4, FARG5);
+ T* obj;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ lambda(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5), T* obj,
+ const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5)
+ : dest_func(func),
+ obj(obj),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5) {}
+ virtual void run() { (obj->*dest_func)(arg1, arg2, arg3, arg4, arg5); }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, obj, arg1, arg2, arg3, arg4, arg5);
+ }
+ };
+ return Task(new lambda(func, obj, arg1, arg2, arg3, arg4, arg5));
+ }
+
+ template <typename T, typename RET, typename FARG1, typename FARG2,
+ typename FARG3, typename FARG4, typename FARG5, typename FARG6,
+ typename ARG1, typename ARG2, typename ARG3, typename ARG4,
+ typename ARG5, typename ARG6>
+ static Task gen(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6),
+ T* obj, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4, ARG5 arg5,
+ ARG6 arg6) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6);
+ T* obj;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ ARG6 arg6;
+ lambda(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6), T* obj,
+ const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5, const ARG6& arg6)
+ : dest_func(func),
+ obj(obj),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5),
+ arg6(arg6) {}
+ virtual void run() {
+ (obj->*dest_func)(arg1, arg2, arg3, arg4, arg5, arg6);
+ }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, obj, arg1, arg2, arg3, arg4, arg5, arg6);
+ }
+ };
+ return Task(new lambda(func, obj, arg1, arg2, arg3, arg4, arg5, arg6));
+ }
+
+ template <typename T, typename RET, typename FARG1, typename FARG2,
+ typename FARG3, typename FARG4, typename FARG5, typename FARG6,
+ typename FARG7, typename ARG1, typename ARG2, typename ARG3,
+ typename ARG4, typename ARG5, typename ARG6, typename ARG7>
+ static Task gen(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6,
+ FARG7),
+ T* obj, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4, ARG5 arg5,
+ ARG6 arg6, ARG7 arg7) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6, FARG7);
+ T* obj;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ ARG6 arg6;
+ ARG7 arg7;
+ lambda(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6, FARG7),
+ T* obj, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5, const ARG6& arg6,
+ const ARG7& arg7)
+ : dest_func(func),
+ obj(obj),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5),
+ arg6(arg6),
+ arg7(arg7) {}
+ virtual void run() {
+ (obj->*dest_func)(arg1, arg2, arg3, arg4, arg5, arg6, arg7);
+ }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, obj, arg1, arg2, arg3, arg4, arg5, arg6,
+ arg7);
+ }
+ };
+ return Task(
+ new lambda(func, obj, arg1, arg2, arg3, arg4, arg5, arg6, arg7));
+ }
+
+ template <typename T, typename RET, typename FARG1, typename FARG2,
+ typename FARG3, typename FARG4, typename FARG5, typename FARG6,
+ typename FARG7, typename FARG8, typename ARG1, typename ARG2,
+ typename ARG3, typename ARG4, typename ARG5, typename ARG6,
+ typename ARG7, typename ARG8>
+ static Task gen(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6,
+ FARG7, FARG8),
+ T* obj, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4, ARG5 arg5,
+ ARG6 arg6, ARG7 arg7, ARG8 arg8) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)
+ (FARG1, FARG2, FARG3, FARG4, FARG5, FARG6, FARG7, FARG8);
+ T* obj;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ ARG6 arg6;
+ ARG7 arg7;
+ ARG8 arg8;
+ lambda(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6, FARG7,
+ FARG8),
+ T* obj, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5, const ARG6& arg6,
+ const ARG7& arg7, const ARG8& arg8)
+ : dest_func(func),
+ obj(obj),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5),
+ arg6(arg6),
+ arg7(arg7),
+ arg8(arg8) {}
+ virtual void run() {
+ (obj->*dest_func)(arg1, arg2, arg3, arg4, arg5, arg6, arg7, arg8);
+ }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, obj, arg1, arg2, arg3, arg4, arg5, arg6,
+ arg7, arg8);
+ }
+ };
+ return Task(
+ new lambda(func, obj, arg1, arg2, arg3, arg4, arg5, arg6, arg7, arg8));
+ }
+
+ template <typename T, typename RET, typename FARG1, typename FARG2,
+ typename FARG3, typename FARG4, typename FARG5, typename FARG6,
+ typename FARG7, typename FARG8, typename FARG9, typename ARG1,
+ typename ARG2, typename ARG3, typename ARG4, typename ARG5,
+ typename ARG6, typename ARG7, typename ARG8, typename ARG9>
+ static Task gen(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6,
+ FARG7, FARG8, FARG9),
+ T* obj, ARG1 arg1, ARG2 arg2, ARG3 arg3, ARG4 arg4, ARG5 arg5,
+ ARG6 arg6, ARG7 arg7, ARG8 arg8, ARG9 arg9) {
+ struct lambda : public ITask_impl {
+ RET (T::*dest_func)
+ (FARG1, FARG2, FARG3, FARG4, FARG5, FARG6, FARG7, FARG8, FARG9);
+ T* obj;
+ ARG1 arg1;
+ ARG2 arg2;
+ ARG3 arg3;
+ ARG4 arg4;
+ ARG5 arg5;
+ ARG6 arg6;
+ ARG7 arg7;
+ ARG8 arg8;
+ ARG9 arg9;
+ lambda(RET (T::*func)(FARG1, FARG2, FARG3, FARG4, FARG5, FARG6, FARG7,
+ FARG8, FARG9),
+ T* obj, const ARG1& arg1, const ARG2& arg2, const ARG3& arg3,
+ const ARG4& arg4, const ARG5& arg5, const ARG6& arg6,
+ const ARG7& arg7, const ARG8& arg8, const ARG9& arg9)
+ : dest_func(func),
+ obj(obj),
+ arg1(arg1),
+ arg2(arg2),
+ arg3(arg3),
+ arg4(arg4),
+ arg5(arg5),
+ arg6(arg6),
+ arg7(arg7),
+ arg8(arg8),
+ arg9(arg9) {}
+ virtual void run() {
+ (obj->*dest_func)(arg1, arg2, arg3, arg4, arg5, arg6, arg7, arg8, arg9);
+ }
+ virtual ITask_impl* fork() {
+ return new lambda(dest_func, obj, arg1, arg2, arg3, arg4, arg5, arg6,
+ arg7, arg8, arg9);
+ }
+ };
+ return Task(new lambda(func, obj, arg1, arg2, arg3, arg4, arg5, arg6, arg7,
+ arg8, arg9));
+ }
+};
+
+//<!***************************************************************************
+class disruptorLFQ;
+class TaskQueue : public ITaskQueue {
+ public:
+ TaskQueue(int threadCount);
+ virtual ~TaskQueue();
+ virtual void close();
+ virtual void produce(const Task& task);
+ virtual int run();
+ virtual bool bTaskQueueStatusOK();
+
+ private:
+ boost::atomic<bool> m_flag;
+ disruptorLFQ* m_disruptorLFQ;
+ boost::mutex m_publishLock;
+};
+
+//<!***************************************************************************
+} //<! end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/transport/ClientRemotingProcessor.cpp b/rocketmq-cpp/src/transport/ClientRemotingProcessor.cpp
new file mode 100644
index 00000000..a1462e6e
--- /dev/null
+++ b/rocketmq-cpp/src/transport/ClientRemotingProcessor.cpp
@@ -0,0 +1,146 @@
+#include "ClientRemotingProcessor.h"
+#include "ClientRPCHook.h"
+#include "ConsumerRunningInfo.h"
+#include "MQClientFactory.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+
+ClientRemotingProcessor::ClientRemotingProcessor(
+ MQClientFactory* mqClientFactory)
+ : m_mqClientFactory(mqClientFactory) {}
+
+ClientRemotingProcessor::~ClientRemotingProcessor() {}
+
+RemotingCommand* ClientRemotingProcessor::processRequest(
+ const string& addr, RemotingCommand* request) {
+ LOG_DEBUG("request Command received:processRequest");
+ switch (request->getCode()) {
+ case CHECK_TRANSACTION_STATE:
+ // return checkTransactionState( request);
+ break;
+ case NOTIFY_CONSUMER_IDS_CHANGED:
+ return notifyConsumerIdsChanged(request);
+ break;
+ case RESET_CONSUMER_CLIENT_OFFSET: // oneWayRPC
+ return resetOffset(request);
+ case GET_CONSUMER_STATUS_FROM_CLIENT:
+ // return getConsumeStatus( request);
+ break;
+ case GET_CONSUMER_RUNNING_INFO:
+ return getConsumerRunningInfo(addr, request);
+ break;
+ case CONSUME_MESSAGE_DIRECTLY:
+ // return consumeMessageDirectly( request);
+ break;
+ default:
+ break;
+ }
+ return NULL;
+}
+
+RemotingCommand* ClientRemotingProcessor::resetOffset(
+ RemotingCommand* request) {
+ request->SetExtHeader(request->getCode());
+ const MemoryBlock* pbody = request->GetBody();
+ if (pbody->getSize()) {
+ ResetOffsetBody* offsetBody = ResetOffsetBody::Decode(pbody);
+ ResetOffsetRequestHeader* offsetHeader =
+ (ResetOffsetRequestHeader*)request->getCommandHeader();
+ if (offsetBody) {
+ m_mqClientFactory->resetOffset(offsetHeader->getGroup(),
+ offsetHeader->getTopic(),
+ offsetBody->getOffsetTable());
+ } else {
+ LOG_ERROR(
+ "resetOffset failed as received data could not be unserialized");
+ }
+ }
+ return NULL; // as resetOffset is oneWayRPC, do not need return any response
+}
+
+std::map<MQMessageQueue, int64> ResetOffsetBody::getOffsetTable() {
+ return m_offsetTable;
+}
+
+void ResetOffsetBody::setOffsetTable(MQMessageQueue mq, int64 offset) {
+ m_offsetTable[mq] = offset;
+}
+
+ResetOffsetBody* ResetOffsetBody::Decode(const MemoryBlock* mem) {
+ const char* const pData = static_cast<const char*>(mem->getData());
+ Json::Reader reader;
+ Json::Value root;
+ const char* begin = pData;
+ const char* end = pData + mem->getSize();
+
+ if (!reader.parse(begin, end, root, true)) {
+ LOG_ERROR("ResetOffsetBody::Decode fail");
+ return NULL;
+ }
+
+ ResetOffsetBody* rfb = new ResetOffsetBody();
+ Json::Value qds = root["offsetTable"];
+ for (unsigned int i = 0; i < qds.size(); i++) {
+ MQMessageQueue mq;
+ Json::Value qd = qds[i];
+ mq.setBrokerName(qd["brokerName"].asString());
+ mq.setQueueId(qd["queueId"].asInt());
+ mq.setTopic(qd["topic"].asString());
+ int64 offset = qd["offset"].asInt();
+ LOG_INFO("ResetOffsetBody brokerName:%s, queueID:%d, topic:%s, offset:%lld",
+ mq.getBrokerName().c_str(), mq.getQueueId(), mq.getTopic().c_str(),
+ offset);
+ rfb->setOffsetTable(mq, offset);
+ }
+ return rfb;
+}
+
+RemotingCommand* ClientRemotingProcessor::getConsumerRunningInfo(
+ const string& addr, RemotingCommand* request) {
+ request->SetExtHeader(request->getCode());
+ GetConsumerRunningInfoRequestHeader* requestHeader =
+ (GetConsumerRunningInfoRequestHeader*)request->getCommandHeader();
+ LOG_INFO("getConsumerRunningInfo:%s",
+ requestHeader->getConsumerGroup().c_str());
+
+ RemotingCommand* pResponse = new RemotingCommand(
+ request->getCode(), "CPP", request->getVersion(), request->getOpaque(),
+ request->getFlag(), request->getRemark(), NULL);
+
+ unique_ptr<ConsumerRunningInfo> runningInfo(
+ m_mqClientFactory->consumerRunningInfo(
+ requestHeader->getConsumerGroup()));
+ if (runningInfo) {
+ if (requestHeader->isJstackEnable()) {
+ /*string jstack = UtilAll::jstack();
+ consumerRunningInfo->setJstack(jstack);*/
+ }
+ pResponse->setCode(SUCCESS_VALUE);
+ string body = runningInfo->encode();
+ pResponse->SetBody(body.c_str(), body.length());
+ pResponse->setMsgBody(body);
+ } else {
+ pResponse->setCode(SYSTEM_ERROR);
+ pResponse->setRemark("The Consumer Group not exist in this consumer");
+ }
+
+ SessionCredentials sessionCredentials;
+ m_mqClientFactory->getSessionCredentialFromConsumer(
+ requestHeader->getConsumerGroup(), sessionCredentials);
+ ClientRPCHook rpcHook(sessionCredentials);
+ rpcHook.doBeforeRequest(addr, *pResponse);
+ pResponse->Encode();
+ return pResponse;
+}
+
+RemotingCommand* ClientRemotingProcessor::notifyConsumerIdsChanged(
+ RemotingCommand* request) {
+ request->SetExtHeader(request->getCode());
+ NotifyConsumerIdsChangedRequestHeader* requestHeader =
+ (NotifyConsumerIdsChangedRequestHeader*)request->getCommandHeader();
+ LOG_INFO("notifyConsumerIdsChanged:%s", requestHeader->getGroup().c_str());
+ m_mqClientFactory->doRebalanceByConsumerGroup(requestHeader->getGroup());
+ return NULL;
+}
+}
diff --git a/rocketmq-cpp/src/transport/ClientRemotingProcessor.h b/rocketmq-cpp/src/transport/ClientRemotingProcessor.h
new file mode 100644
index 00000000..1bb757eb
--- /dev/null
+++ b/rocketmq-cpp/src/transport/ClientRemotingProcessor.h
@@ -0,0 +1,39 @@
+#ifndef __CLIENTREMOTINGPROCESSOR_H__
+#define __CLIENTREMOTINGPROCESSOR_H__
+
+#include "MQMessageQueue.h"
+#include "MQProtos.h"
+#include "RemotingCommand.h"
+
+namespace rocketmq {
+
+class MQClientFactory;
+class ClientRemotingProcessor {
+ public:
+ ClientRemotingProcessor(MQClientFactory* mqClientFactory);
+ virtual ~ClientRemotingProcessor();
+
+ RemotingCommand* processRequest(const string& addr, RemotingCommand* request);
+ RemotingCommand* resetOffset(RemotingCommand* request);
+ RemotingCommand* getConsumerRunningInfo(const string& addr,
+ RemotingCommand* request);
+ RemotingCommand* notifyConsumerIdsChanged(RemotingCommand* request);
+
+ private:
+ MQClientFactory* m_mqClientFactory;
+};
+
+class ResetOffsetBody {
+ public:
+ ResetOffsetBody() {}
+ virtual ~ResetOffsetBody() { m_offsetTable.clear(); }
+ void setOffsetTable(MQMessageQueue mq, int64 offset);
+ std::map<MQMessageQueue, int64> getOffsetTable();
+ static ResetOffsetBody* Decode(const MemoryBlock* mem);
+
+ private:
+ std::map<MQMessageQueue, int64> m_offsetTable;
+};
+}
+
+#endif
diff --git a/rocketmq-cpp/src/transport/ResponseFuture.cpp b/rocketmq-cpp/src/transport/ResponseFuture.cpp
new file mode 100755
index 00000000..05cef84d
--- /dev/null
+++ b/rocketmq-cpp/src/transport/ResponseFuture.cpp
@@ -0,0 +1,176 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "ResponseFuture.h"
+#include "Logging.h"
+#include "TcpRemotingClient.h"
+
+namespace rocketmq {
+//<!************************************************************************
+ResponseFuture::ResponseFuture(int requestCode, int opaque,
+ TcpRemotingClient* powner, int64 timeout,
+ bool bAsync /* = false */,
+ AsyncCallbackWrap* pcall /* = NULL */) {
+ m_bAsync.store(bAsync);
+ m_requestCode = requestCode;
+ m_opaque = opaque;
+ m_timeout = timeout;
+ m_pCallbackWrap = pcall;
+ m_pResponseCommand = NULL;
+ m_sendRequestOK = false;
+ m_beginTimestamp = UtilAll::currentTimeMillis();
+ m_asyncCallbackStatus = asyncCallBackStatus_init;
+ if (getASyncFlag()) {
+ m_asyncResponse.store(false);
+ m_syncResponse.store(true);
+ } else {
+ m_asyncResponse.store(true);
+ m_syncResponse.store(false);
+ }
+}
+
+ResponseFuture::~ResponseFuture() {
+ deleteAndZero(m_pCallbackWrap);
+ /*
+ do not set m_pResponseCommand to NULL when destruct, as m_pResponseCommand
+ is used by MQClientAPIImpl concurrently, and will be released by producer or
+ consumer;
+ m_pResponseCommand = NULL;
+ */
+}
+
+void ResponseFuture::releaseThreadCondition() { m_defaultEvent.notify_all(); }
+
+RemotingCommand* ResponseFuture::waitResponse(int timeoutMillis) {
+ boost::unique_lock<boost::mutex> lk(m_defaultEventLock);
+ if (!m_defaultEvent.timed_wait(
+ lk, boost::posix_time::milliseconds(timeoutMillis))) {
+ LOG_WARN("waitResponse of code:%d with opaque:%d timeout", m_requestCode,
+ m_opaque);
+ m_syncResponse.store(true);
+ }
+ return m_pResponseCommand;
+}
+
+void ResponseFuture::setResponse(RemotingCommand* pResponseCommand) {
+ // LOG_DEBUG("setResponse of opaque:%d",m_opaque);
+ m_pResponseCommand = pResponseCommand;
+
+ if (!getASyncFlag()) {
+ if (m_syncResponse.load() == false) {
+ m_defaultEvent.notify_all();
+ m_syncResponse.store(true);
+ }
+ }
+}
+
+const bool ResponseFuture::getSyncResponseFlag() {
+ if (m_syncResponse.load() == true) {
+ return true;
+ }
+ return false;
+}
+
+const bool ResponseFuture::getAsyncResponseFlag() {
+ if (m_asyncResponse.load() == true) {
+ // LOG_DEBUG("ASYNC flag is TRUE,opaque is:%d",getOpaque() );
+ return true;
+ }
+
+ return false;
+}
+
+void ResponseFuture::setAsyncResponseFlag() { m_asyncResponse.store(true); }
+
+const bool ResponseFuture::getASyncFlag() {
+ if (m_bAsync.load() == true) {
+ // LOG_DEBUG("ASYNC flag is TRUE,opaque is:%d",getOpaque() );
+ return true;
+ }
+ return false;
+}
+
+bool ResponseFuture::isSendRequestOK() { return m_sendRequestOK; }
+
+void ResponseFuture::setSendRequestOK(bool sendRequestOK) {
+ m_sendRequestOK = sendRequestOK;
+}
+
+int ResponseFuture::getOpaque() const { return m_opaque; }
+
+int ResponseFuture::getRequestCode() const { return m_requestCode; }
+
+void ResponseFuture::setAsyncCallBackStatus(
+ asyncCallBackStatus asyncCallbackStatus) {
+ boost::lock_guard<boost::mutex> lock(m_asyncCallbackLock);
+ if (m_asyncCallbackStatus == asyncCallBackStatus_init) {
+ m_asyncCallbackStatus = asyncCallbackStatus;
+ }
+}
+
+void ResponseFuture::executeInvokeCallback() {
+ if (m_pCallbackWrap == NULL) {
+ deleteAndZero(m_pResponseCommand);
+ return;
+ } else {
+ if (m_asyncCallbackStatus == asyncCallBackStatus_response) {
+ m_pCallbackWrap->operationComplete(this, true);
+ } else {
+ if (m_pResponseCommand)
+ deleteAndZero(m_pResponseCommand); // the responseCommand from
+ // RemotingCommand::Decode(mem) will
+ // only deleted by operationComplete
+ // automatically
+ LOG_WARN(
+ "timeout and response incoming concurrently of opaque:%d, and "
+ "executeInvokeCallbackException was called earlier",
+ m_opaque);
+ }
+ }
+}
+
+void ResponseFuture::executeInvokeCallbackException() {
+ if (m_pCallbackWrap == NULL) {
+ LOG_ERROR("m_pCallbackWrap is NULL, critical error");
+ return;
+ } else {
+ if (m_asyncCallbackStatus == asyncCallBackStatus_timeout) {
+ m_pCallbackWrap->onException();
+ } else {
+ LOG_WARN(
+ "timeout and response incoming concurrently of opaque:%d, and "
+ "executeInvokeCallback was called earlier",
+ m_opaque);
+ }
+ }
+}
+
+bool ResponseFuture::isTimeOut() const {
+ int64 diff = UtilAll::currentTimeMillis() - m_beginTimestamp;
+ //<!only async;
+ return m_bAsync.load() == 1 && diff > m_timeout;
+}
+
+RemotingCommand* ResponseFuture::getCommand() const {
+ return m_pResponseCommand;
+}
+
+AsyncCallbackWrap* ResponseFuture::getAsyncCallbackWrap() {
+ return m_pCallbackWrap;
+}
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/transport/ResponseFuture.h b/rocketmq-cpp/src/transport/ResponseFuture.h
new file mode 100755
index 00000000..92fa7722
--- /dev/null
+++ b/rocketmq-cpp/src/transport/ResponseFuture.h
@@ -0,0 +1,83 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __RESPONSEFUTURE_H__
+#define __RESPONSEFUTURE_H__
+#include <boost/atomic.hpp>
+#include <boost/thread/condition_variable.hpp>
+#include "AsyncCallbackWrap.h"
+#include "RemotingCommand.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+
+typedef enum asyncCallBackStatus {
+ asyncCallBackStatus_init = 0,
+ asyncCallBackStatus_response = 1,
+ asyncCallBackStatus_timeout = 2
+} asyncCallBackStatus;
+
+class TcpRemotingClient;
+//<!***************************************************************************
+class ResponseFuture {
+ public:
+ ResponseFuture(int requestCode, int opaque, TcpRemotingClient* powner,
+ int64 timeoutMilliseconds, bool bAsync = false,
+ AsyncCallbackWrap* pcall = NULL);
+ virtual ~ResponseFuture();
+ void releaseThreadCondition();
+ RemotingCommand* waitResponse(int timeoutMillis);
+ RemotingCommand* getCommand() const;
+
+ void setResponse(RemotingCommand* pResponseCommand);
+ bool isSendRequestOK();
+ void setSendRequestOK(bool sendRequestOK);
+ int getRequestCode() const;
+ int getOpaque() const;
+
+ //<!callback;
+ void executeInvokeCallback();
+ void executeInvokeCallbackException();
+ bool isTimeOut() const;
+ // bool isTimeOutMoreThan30s() const;
+ const bool getASyncFlag();
+ void setAsyncResponseFlag();
+ const bool getAsyncResponseFlag();
+ const bool getSyncResponseFlag();
+ AsyncCallbackWrap* getAsyncCallbackWrap();
+ void setAsyncCallBackStatus(asyncCallBackStatus asyncCallbackStatus);
+
+ private:
+ int m_requestCode;
+ int m_opaque;
+ bool m_sendRequestOK;
+ boost::mutex m_defaultEventLock;
+ boost::condition_variable_any m_defaultEvent;
+ int64 m_beginTimestamp;
+ int64 m_timeout; // ms
+ boost::atomic<bool> m_bAsync;
+ RemotingCommand* m_pResponseCommand; //<!delete outside;
+ AsyncCallbackWrap* m_pCallbackWrap;
+ boost::mutex m_asyncCallbackLock;
+ asyncCallBackStatus m_asyncCallbackStatus;
+ boost::atomic<bool> m_asyncResponse;
+ boost::atomic<bool> m_syncResponse;
+ // TcpRemotingClient* m_tcpRemoteClient;
+};
+//<!************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/transport/SocketUtil.cpp b/rocketmq-cpp/src/transport/SocketUtil.cpp
new file mode 100755
index 00000000..d428f242
--- /dev/null
+++ b/rocketmq-cpp/src/transport/SocketUtil.cpp
@@ -0,0 +1,86 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "SocketUtil.h"
+
+namespace rocketmq {
+//<!***************************************************************************
+sockaddr IPPort2socketAddress(int host, int port) {
+ struct sockaddr_in sa;
+ sa.sin_family = AF_INET;
+ sa.sin_port = htons((uint16)port);
+ sa.sin_addr.s_addr = htonl(host);
+
+ sockaddr bornAddr;
+ memcpy(&bornAddr, &sa, sizeof(sockaddr));
+ return bornAddr;
+}
+
+string socketAddress2IPPort(sockaddr addr) {
+ sockaddr_in sa;
+ memcpy(&sa, &addr, sizeof(sockaddr));
+
+ char tmp[32];
+ sprintf(tmp, "%s:%d", inet_ntoa(sa.sin_addr), ntohs(sa.sin_port));
+
+ string ipport = tmp;
+ return ipport;
+}
+
+void socketAddress2IPPort(sockaddr addr, int& host, int& port) {
+ struct sockaddr_in sa;
+ memcpy(&sa, &addr, sizeof(sockaddr));
+
+ host = ntohl(sa.sin_addr.s_addr);
+ port = ntohs(sa.sin_port);
+}
+
+string socketAddress2String(sockaddr addr) {
+ sockaddr_in in;
+ memcpy(&in, &addr, sizeof(sockaddr));
+
+ return inet_ntoa(in.sin_addr);
+}
+
+string getHostName(sockaddr addr) {
+ sockaddr_in in;
+ memcpy(&in, &addr, sizeof(sockaddr));
+
+ struct hostent* remoteHost = gethostbyaddr((char*)&(in.sin_addr), 4, AF_INET);
+ char** alias = remoteHost->h_aliases;
+ if (*alias != 0) {
+ return *alias;
+ } else {
+ return inet_ntoa(in.sin_addr);
+ }
+}
+
+uint64 swapll(uint64 v) {
+#ifdef ENDIANMODE_BIG
+ return v;
+#else
+ uint64 ret = ((v << 56) | ((v & 0xff00) << 40) | ((v & 0xff0000) << 24) |
+ ((v & 0xff000000) << 8) | ((v >> 8) & 0xff000000) |
+ ((v >> 24) & 0xff0000) | ((v >> 40) & 0xff00) | (v >> 56));
+
+ return ret;
+#endif
+}
+
+uint64 h2nll(uint64 v) { return swapll(v); }
+
+uint64 n2hll(uint64 v) { return swapll(v); }
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/transport/SocketUtil.h b/rocketmq-cpp/src/transport/SocketUtil.h
new file mode 100755
index 00000000..7cbba0cd
--- /dev/null
+++ b/rocketmq-cpp/src/transport/SocketUtil.h
@@ -0,0 +1,62 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __SOCKETUTIL_H__
+#define __SOCKETUTIL_H__
+
+#ifdef WIN32
+#include <WS2tcpip.h>
+#include <Windows.h>
+#include <Winsock2.h>
+#pragma comment(lib, "ws2_32.lib")
+#else
+#include <arpa/inet.h>
+#include <errno.h>
+#include <fcntl.h>
+#include <net/if.h>
+#include <netdb.h>
+#include <netinet/in.h>
+#include <netinet/tcp.h>
+#include <signal.h>
+#include <sys/ioctl.h>
+#include <sys/select.h>
+#include <sys/socket.h>
+#include <sys/time.h>
+#include <sys/types.h>
+#include <unistd.h>
+#endif
+#include <sys/socket.h>
+#include "UtilAll.h"
+
+namespace rocketmq {
+//<!************************************************************************
+/**
+* IP:PORT
+*/
+sockaddr IPPort2socketAddress(int host, int port);
+string socketAddress2IPPort(sockaddr addr);
+void socketAddress2IPPort(sockaddr addr, int& host, int& port);
+
+string socketAddress2String(sockaddr addr);
+string getHostName(sockaddr addr);
+
+uint64 h2nll(uint64 v);
+uint64 n2hll(uint64 v);
+
+//<!************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/transport/TcpRemotingClient.cpp b/rocketmq-cpp/src/transport/TcpRemotingClient.cpp
new file mode 100755
index 00000000..f74d5293
--- /dev/null
+++ b/rocketmq-cpp/src/transport/TcpRemotingClient.cpp
@@ -0,0 +1,728 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "TcpRemotingClient.h"
+#include <stddef.h>
+#include <sys/prctl.h>
+#include "Logging.h"
+#include "MemoryOutputStream.h"
+#include "TopAddressing.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+
+//<!************************************************************************
+TcpRemotingClient::TcpRemotingClient(int pullThreadNum,
+ uint64_t tcpConnectTimeout,
+ uint64_t tcpTransportTryLockTimeout)
+ : m_pullThreadNum(pullThreadNum),
+ m_tcpConnectTimeout(tcpConnectTimeout),
+ m_tcpTransportTryLockTimeout(tcpTransportTryLockTimeout),
+ m_namesrvIndex(0),
+ m_ioServiceWork(m_ioService) {
+ string taskName = UtilAll::getProcessName();
+ prctl(PR_SET_NAME, "networkTP", 0, 0, 0);
+ for (int i = 0; i != pullThreadNum; ++i) {
+ m_threadpool.create_thread(
+ boost::bind(&boost::asio::io_service::run, &m_ioService));
+ }
+ prctl(PR_SET_NAME, taskName.c_str(), 0, 0, 0);
+
+ LOG_INFO(
+ "m_tcpConnectTimeout:%ju, m_tcpTransportTryLockTimeout:%ju, "
+ "m_pullThreadNum:%d",
+ m_tcpConnectTimeout, m_tcpTransportTryLockTimeout, m_pullThreadNum);
+ m_async_service_thread.reset(new boost::thread(
+ boost::bind(&TcpRemotingClient::boost_asio_work, this)));
+}
+
+void TcpRemotingClient::boost_asio_work() {
+ LOG_INFO("TcpRemotingClient::boost asio async service runing");
+ boost::asio::io_service::work work(m_async_ioService); // avoid async io
+ // service stops after
+ // first timer timeout
+ // callback
+ m_async_ioService.run();
+}
+
+TcpRemotingClient::~TcpRemotingClient() {
+ m_tcpTable.clear();
+ m_futureTable.clear();
+ m_asyncFutureTable.clear();
+ m_namesrvAddrList.clear();
+ removeAllTimerCallback();
+}
+
+void TcpRemotingClient::stopAllTcpTransportThread() {
+ LOG_DEBUG("TcpRemotingClient::stopAllTcpTransportThread Begin");
+ m_async_ioService.stop();
+ m_async_service_thread->interrupt();
+ m_async_service_thread->join();
+ removeAllTimerCallback();
+
+ {
+ TcpMap::iterator it = m_tcpTable.begin();
+ for (; it != m_tcpTable.end(); ++it) {
+ it->second->disconnect(it->first);
+ }
+ m_tcpTable.clear();
+ }
+
+ m_ioService.stop();
+ m_threadpool.join_all();
+
+ {
+ boost::lock_guard<boost::mutex> lock(m_futureTableMutex);
+ for (ResMap::iterator it = m_futureTable.begin(); it != m_futureTable.end();
+ ++it) {
+ if (it->second) it->second->releaseThreadCondition();
+ }
+ }
+ LOG_DEBUG("TcpRemotingClient::stopAllTcpTransportThread End");
+}
+
+void TcpRemotingClient::updateNameServerAddressList(const string& addrs) {
+ if (!addrs.empty()) {
+ boost::unique_lock<boost::timed_mutex> lock(m_namesrvlock,
+ boost::try_to_lock);
+ if (!lock.owns_lock()) {
+ if (!lock.timed_lock(boost::get_system_time() +
+ boost::posix_time::seconds(10))) {
+ LOG_ERROR("updateNameServerAddressList get timed_mutex timeout");
+ return;
+ }
+ }
+ // clear first;
+ m_namesrvAddrList.clear();
+
+ vector<string> out;
+ UtilAll::Split(out, addrs, ";");
+ for (size_t i = 0; i < out.size(); i++) {
+ string addr = out[i];
+ UtilAll::Trim(addr);
+
+ string hostName;
+ short portNumber;
+ if (UtilAll::SplitURL(addr, hostName, portNumber)) {
+ LOG_INFO("update Namesrv:%s", addr.c_str());
+ m_namesrvAddrList.push_back(addr);
+ }
+ }
+ out.clear();
+ }
+}
+
+bool TcpRemotingClient::invokeHeartBeat(const string& addr,
+ RemotingCommand& request) {
+ boost::shared_ptr<TcpTransport> pTcp = GetTransport(addr, true);
+ if (pTcp != NULL) {
+ int code = request.getCode();
+ int opaque = request.getOpaque();
+ boost::shared_ptr<ResponseFuture> responseFuture(
+ new ResponseFuture(code, opaque, this, 3000, false, NULL));
+ addResponseFuture(opaque, responseFuture);
+ // LOG_INFO("invokeHeartbeat success, addr:%s, code:%d, opaque:%d,
+ // timeoutms:%d", addr.c_str(), code, opaque, 3000);
+
+ if (SendCommand(pTcp, request)) {
+ responseFuture->setSendRequestOK(true);
+ unique_ptr<RemotingCommand> pRsp(responseFuture->waitResponse(3000));
+ if (pRsp == NULL) {
+ LOG_ERROR(
+ "wait response timeout of heartbeat, so closeTransport of addr:%s",
+ addr.c_str());
+ CloseTransport(addr, pTcp);
+ return false;
+ } else if (pRsp->getCode() == SUCCESS_VALUE) {
+ return true;
+ } else {
+ LOG_WARN("get error response:%d of heartbeat to addr:%s",
+ pRsp->getCode(), addr.c_str());
+ return false;
+ }
+ } else {
+ CloseTransport(addr, pTcp);
+ }
+ }
+ return false;
+}
+
+RemotingCommand* TcpRemotingClient::invokeSync(const string& addr,
+ RemotingCommand& request,
+ int timeoutMillis /* = 3000 */) {
+ boost::shared_ptr<TcpTransport> pTcp = GetTransport(addr, true);
+ if (pTcp != NULL) {
+ int code = request.getCode();
+ int opaque = request.getOpaque();
+ boost::shared_ptr<ResponseFuture> responseFuture(
+ new ResponseFuture(code, opaque, this, timeoutMillis, false, NULL));
+ addResponseFuture(opaque, responseFuture);
+
+ if (SendCommand(pTcp, request)) {
+ // LOG_INFO("invokeSync success, addr:%s, code:%d, opaque:%d,
+ // timeoutms:%d", addr.c_str(), code, opaque, timeoutMillis);
+ responseFuture->setSendRequestOK(true);
+ RemotingCommand* pRsp = responseFuture->waitResponse(timeoutMillis);
+ if (pRsp == NULL) {
+ if (code != GET_CONSUMER_LIST_BY_GROUP) {
+ LOG_WARN(
+ "wait response timeout or get NULL response of code:%d, so "
+ "closeTransport of addr:%s",
+ code, addr.c_str());
+ CloseTransport(addr, pTcp);
+ }
+ // avoid responseFuture leak;
+ findAndDeleteResponseFuture(opaque);
+ return NULL;
+ } else {
+ return pRsp;
+ }
+ } else {
+ // avoid responseFuture leak;
+ findAndDeleteResponseFuture(opaque);
+ CloseTransport(addr, pTcp);
+ }
+ }
+ return NULL;
+}
+
+bool TcpRemotingClient::invokeAsync(const string& addr,
+ RemotingCommand& request,
+ AsyncCallbackWrap* cbw,
+ int64 timeoutMilliseconds) {
+ boost::shared_ptr<TcpTransport> pTcp = GetTransport(addr, true);
+ if (pTcp != NULL) {
+ //<!not delete, for callback to delete;
+ int code = request.getCode();
+ int opaque = request.getOpaque();
+ boost::shared_ptr<ResponseFuture> responseFuture(
+ new ResponseFuture(code, opaque, this, timeoutMilliseconds, true, cbw));
+ addAsyncResponseFuture(opaque, responseFuture);
+ if (cbw) {
+ boost::asio::deadline_timer* t = new boost::asio::deadline_timer(
+ m_async_ioService,
+ boost::posix_time::milliseconds(timeoutMilliseconds));
+ addTimerCallback(t, opaque);
+ boost::system::error_code e;
+ t->async_wait(
+ boost::bind(&TcpRemotingClient::handleAsyncPullForResponseTimeout,
+ this, e, opaque));
+ }
+
+ if (SendCommand(pTcp, request)) // Even if send failed, asyncTimerThread
+ // will trigger next pull request or report
+ // send msg failed
+ {
+ LOG_DEBUG("invokeAsync success, addr:%s, code:%d, opaque:%d",
+ addr.c_str(), code, opaque);
+ responseFuture->setSendRequestOK(true);
+ }
+ return true;
+ }
+ LOG_ERROR("invokeAsync failed of addr:%s", addr.c_str());
+ return false;
+}
+
+void TcpRemotingClient::invokeOneway(const string& addr,
+ RemotingCommand& request) {
+ //<!not need callback;
+ boost::shared_ptr<TcpTransport> pTcp = GetTransport(addr, true);
+ if (pTcp != NULL) {
+ request.markOnewayRPC();
+ LOG_DEBUG("invokeOneway success, addr:%s, code:%d", addr.c_str(),
+ request.getCode());
+ SendCommand(pTcp, request);
+ }
+}
+
+boost::shared_ptr<TcpTransport> TcpRemotingClient::GetTransport(
+ const string& addr, bool needRespons) {
+ if (addr.empty()) return CreateNameserverTransport(needRespons);
+
+ return CreateTransport(addr, needRespons);
+}
+
+boost::shared_ptr<TcpTransport> TcpRemotingClient::CreateTransport(
+ const string& addr, bool needRespons) {
+ boost::shared_ptr<TcpTransport> tts;
+ {
+ // try get m_tcpLock util m_tcpTransportTryLockTimeout to avoid blocking
+ // long
+ // time, if could not get m_tcpLock, return NULL
+ bool bGetMutex = false;
+ boost::unique_lock<boost::timed_mutex> lock(m_tcpLock, boost::try_to_lock);
+ if (!lock.owns_lock()) {
+ if (!lock.timed_lock(
+ boost::get_system_time() +
+ boost::posix_time::seconds(m_tcpTransportTryLockTimeout))) {
+ LOG_ERROR("GetTransport of:%s get timed_mutex timeout", addr.c_str());
+ boost::shared_ptr<TcpTransport> pTcp;
+ return pTcp;
+ } else {
+ bGetMutex = true;
+ }
+ } else {
+ bGetMutex = true;
+ }
+ if (bGetMutex) {
+ if (m_tcpTable.find(addr) != m_tcpTable.end()) {
+ boost::weak_ptr<TcpTransport> weakPtcp(m_tcpTable[addr]);
+ boost::shared_ptr<TcpTransport> tcp = weakPtcp.lock();
+ if (tcp) {
+ tcpConnectStatus connectStatus = tcp->getTcpConnectStatus();
+ if (connectStatus == e_connectWaitResponse) {
+ boost::shared_ptr<TcpTransport> pTcp;
+ return pTcp;
+ } else if (connectStatus == e_connectFail) {
+ LOG_ERROR("tcpTransport with server disconnected, erase server:%s",
+ addr.c_str());
+ tcp->disconnect(
+ addr); // avoid coredump when connection with broker was broken
+ m_tcpTable.erase(addr);
+ } else if (connectStatus == e_connectSuccess) {
+ return tcp;
+ } else {
+ LOG_ERROR(
+ "go to fault state, erase:%s from tcpMap, and reconnect "
+ "it",
+ addr.c_str());
+ m_tcpTable.erase(addr);
+ }
+ }
+ }
+
+ //<!callback;
+ READ_CALLBACK callback =
+ needRespons ? &TcpRemotingClient::static_messageReceived : NULL;
+
+ tts.reset(new TcpTransport(this, callback));
+ tcpConnectStatus connectStatus = tts->connect(addr, m_tcpConnectTimeout);
+ if (connectStatus != e_connectWaitResponse) {
+ LOG_WARN("can not connect to :%s", addr.c_str());
+ tts->disconnect(addr);
+ boost::shared_ptr<TcpTransport> pTcp;
+ return pTcp;
+ } else {
+ m_tcpTable[addr] = tts; // even if connecting failed finally, this
+ // server transport will be erased by next
+ // CreateTransport
+ }
+ } else {
+ LOG_WARN("get tcpTransport mutex failed :%s", addr.c_str());
+ boost::shared_ptr<TcpTransport> pTcp;
+ return pTcp;
+ }
+ }
+
+ tcpConnectStatus connectStatus =
+ tts->waitTcpConnectEvent(m_tcpConnectTimeout);
+ if (connectStatus != e_connectSuccess) {
+ LOG_WARN("can not connect to server:%s", addr.c_str());
+ tts->disconnect(addr);
+ boost::shared_ptr<TcpTransport> pTcp;
+ return pTcp;
+ } else {
+ LOG_INFO("connect server with addr:%s success", addr.c_str());
+ return tts;
+ }
+}
+
+boost::shared_ptr<TcpTransport> TcpRemotingClient::CreateNameserverTransport(
+ bool needRespons) {
+ // m_namesrvLock was added to avoid operation of nameServer was blocked by
+ // m_tcpLock, it was used by single Thread mostly, so no performance impact
+ // try get m_tcpLock util m_tcpTransportTryLockTimeout to avoid blocking long
+ // time, if could not get m_namesrvlock, return NULL
+ bool bGetMutex = false;
+ boost::unique_lock<boost::timed_mutex> lock(m_namesrvlock,
+ boost::try_to_lock);
+ if (!lock.owns_lock()) {
+ if (!lock.timed_lock(
+ boost::get_system_time() +
+ boost::posix_time::seconds(m_tcpTransportTryLockTimeout))) {
+ LOG_ERROR("CreateNameserverTransport get timed_mutex timeout");
+ boost::shared_ptr<TcpTransport> pTcp;
+ return pTcp;
+ } else {
+ bGetMutex = true;
+ }
+ } else {
+ bGetMutex = true;
+ }
+
+ if (bGetMutex) {
+ if (!m_namesrvAddrChoosed.empty()) {
+ boost::shared_ptr<TcpTransport> pTcp =
+ GetTransport(m_namesrvAddrChoosed, true);
+ if (pTcp)
+ return pTcp;
+ else
+ m_namesrvAddrChoosed.clear();
+ }
+
+ vector<string>::iterator itp = m_namesrvAddrList.begin();
+ for (; itp != m_namesrvAddrList.end(); ++itp) {
+ unsigned int index = m_namesrvIndex % m_namesrvAddrList.size();
+ if (m_namesrvIndex == numeric_limits<unsigned int>::max())
+ m_namesrvIndex = 0;
+ m_namesrvIndex++;
+ LOG_INFO("namesrvIndex is:%d, index:%d, namesrvaddrlist size:%zu",
+ m_namesrvIndex, index, m_namesrvAddrList.size());
+ boost::shared_ptr<TcpTransport> pTcp =
+ GetTransport(m_namesrvAddrList[index], true);
+ if (pTcp) {
+ m_namesrvAddrChoosed = m_namesrvAddrList[index];
+ return pTcp;
+ }
+ }
+ boost::shared_ptr<TcpTransport> pTcp;
+ return pTcp;
+ } else {
+ LOG_WARN("get nameServer tcpTransport mutex failed");
+ boost::shared_ptr<TcpTransport> pTcp;
+ return pTcp;
+ }
+}
+
+void TcpRemotingClient::CloseTransport(const string& addr,
+ boost::shared_ptr<TcpTransport> pTcp) {
+ if (addr.empty()) {
+ return CloseNameServerTransport(pTcp);
+ }
+
+ bool bGetMutex = false;
+ boost::unique_lock<boost::timed_mutex> lock(m_tcpLock, boost::try_to_lock);
+ if (!lock.owns_lock()) {
+ if (!lock.timed_lock(
+ boost::get_system_time() +
+ boost::posix_time::seconds(m_tcpTransportTryLockTimeout))) {
+ LOG_ERROR("CloseTransport of:%s get timed_mutex timeout", addr.c_str());
+ return;
+ } else {
+ bGetMutex = true;
+ }
+ } else {
+ bGetMutex = true;
+ }
+ LOG_ERROR("CloseTransport of:%s", addr.c_str());
+ if (bGetMutex) {
+ bool removeItemFromTable = true;
+ if (m_tcpTable.find(addr) != m_tcpTable.end()) {
+ if (m_tcpTable[addr]->getStartTime() != pTcp->getStartTime()) {
+ LOG_INFO(
+ "tcpTransport with addr:%s has been closed before, and has been "
+ "created again, nothing to do",
+ addr.c_str());
+ removeItemFromTable = false;
+ }
+ } else {
+ LOG_INFO(
+ "tcpTransport with addr:%s had been removed from tcpTable before",
+ addr.c_str());
+ removeItemFromTable = false;
+ }
+
+ if (removeItemFromTable == true) {
+ LOG_WARN("closeTransport: disconnect broker:%s with state:%d",
+ addr.c_str(), m_tcpTable[addr]->getTcpConnectStatus());
+ if (m_tcpTable[addr]->getTcpConnectStatus() == e_connectSuccess)
+ m_tcpTable[addr]->disconnect(
+ addr); // avoid coredump when connection with server was broken
+ LOG_WARN("closeTransport: erase broker: %s", addr.c_str());
+ m_tcpTable.erase(addr);
+ }
+ } else {
+ LOG_WARN("CloseTransport::get tcpTransport mutex failed:%s", addr.c_str());
+ return;
+ }
+ LOG_ERROR("CloseTransport of:%s end", addr.c_str());
+}
+
+void TcpRemotingClient::CloseNameServerTransport(
+ boost::shared_ptr<TcpTransport> pTcp) {
+ bool bGetMutex = false;
+ boost::unique_lock<boost::timed_mutex> lock(m_namesrvlock,
+ boost::try_to_lock);
+ if (!lock.owns_lock()) {
+ if (!lock.timed_lock(
+ boost::get_system_time() +
+ boost::posix_time::seconds(m_tcpTransportTryLockTimeout))) {
+ LOG_ERROR("CreateNameserverTransport get timed_mutex timeout");
+ return;
+ } else {
+ bGetMutex = true;
+ }
+ } else {
+ bGetMutex = true;
+ }
+ if (bGetMutex) {
+ string addr = m_namesrvAddrChoosed;
+ bool removeItemFromTable = true;
+ if (m_tcpTable.find(addr) != m_tcpTable.end()) {
+ if (m_tcpTable[addr]->getStartTime() != pTcp->getStartTime()) {
+ LOG_INFO(
+ "tcpTransport with addr:%s has been closed before, and has been "
+ "created again, nothing to do",
+ addr.c_str());
+ removeItemFromTable = false;
+ }
+ } else {
+ LOG_INFO(
+ "tcpTransport with addr:%s had been removed from tcpTable before",
+ addr.c_str());
+ removeItemFromTable = false;
+ }
+
+ if (removeItemFromTable == true) {
+ m_tcpTable[addr]->disconnect(
+ addr); // avoid coredump when connection with server was broken
+ LOG_WARN("closeTransport: erase broker: %s", addr.c_str());
+ m_tcpTable.erase(addr);
+ m_namesrvAddrChoosed.clear();
+ }
+ } else {
+ LOG_WARN("CloseNameServerTransport::get tcpTransport mutex failed:%s",
+ m_namesrvAddrChoosed.c_str());
+ return;
+ }
+}
+
+bool TcpRemotingClient::SendCommand(boost::shared_ptr<TcpTransport> pTts,
+ RemotingCommand& msg) {
+ const MemoryBlock* phead = msg.GetHead();
+ const MemoryBlock* pbody = msg.GetBody();
+
+ unique_ptr<MemoryOutputStream> result(new MemoryOutputStream(1024));
+ if (phead->getData()) {
+ result->write(phead->getData(), phead->getSize());
+ }
+ if (pbody->getData()) {
+ result->write(pbody->getData(), pbody->getSize());
+ }
+ const char* pData = static_cast<const char*>(result->getData());
+ int len = result->getDataSize();
+ return pTts->sendMessage(pData, len);
+}
+
+void TcpRemotingClient::static_messageReceived(void* context,
+ const MemoryBlock& mem,
+ const string& addr) {
+ TcpRemotingClient* pTcpRemotingClient = (TcpRemotingClient*)context;
+ if (pTcpRemotingClient) pTcpRemotingClient->messageReceived(mem, addr);
+}
+
+void TcpRemotingClient::messageReceived(const MemoryBlock& mem,
+ const string& addr) {
+ m_ioService.post(
+ boost::bind(&TcpRemotingClient::ProcessData, this, mem, addr));
+}
+
+void TcpRemotingClient::ProcessData(const MemoryBlock& mem,
+ const string& addr) {
+ RemotingCommand* pRespondCmd = NULL;
+ try {
+ pRespondCmd = RemotingCommand::Decode(mem);
+ } catch (...) {
+ LOG_ERROR("processData_error");
+ return;
+ }
+
+ int opaque = pRespondCmd->getOpaque();
+
+ //<!process self;
+ if (pRespondCmd->isResponseType()) {
+ boost::shared_ptr<ResponseFuture> pFuture(
+ findAndDeleteAsyncResponseFuture(opaque));
+ if (!pFuture) {
+ pFuture = findAndDeleteResponseFuture(opaque);
+ if (pFuture) {
+ if (pFuture->getSyncResponseFlag()) {
+ LOG_WARN("waitResponse already timeout of opaque:%d", opaque);
+ deleteAndZero(pRespondCmd);
+ return;
+ }
+ LOG_DEBUG("find_response opaque:%d", opaque);
+ } else {
+ LOG_DEBUG("responseFuture was deleted by timeout of opaque:%d", opaque);
+ deleteAndZero(pRespondCmd);
+ return;
+ }
+ }
+ processResponseCommand(pRespondCmd, pFuture);
+ } else {
+ processRequestCommand(pRespondCmd, addr);
+ }
+}
+
+void TcpRemotingClient::processResponseCommand(
+ RemotingCommand* pCmd, boost::shared_ptr<ResponseFuture> pfuture) {
+ int code = pfuture->getRequestCode();
+ int opaque = pCmd->getOpaque();
+ LOG_DEBUG("processResponseCommand, code:%d,opaque:%d", code, opaque);
+ pCmd->SetExtHeader(code); // set head , for response use
+
+ pfuture->setResponse(pCmd);
+
+ if (pfuture->getASyncFlag()) {
+ if (!pfuture->getAsyncResponseFlag()) {
+ pfuture->setAsyncResponseFlag();
+ pfuture->setAsyncCallBackStatus(asyncCallBackStatus_response);
+ pfuture->executeInvokeCallback();
+ cancelTimerCallback(opaque);
+ }
+ }
+}
+
+void TcpRemotingClient::processRequestCommand(RemotingCommand* pCmd,
+ const string& addr) {
+ unique_ptr<RemotingCommand> pRequestCommand(pCmd);
+ int requestCode = pRequestCommand->getCode();
+ if (m_requestTable.find(requestCode) == m_requestTable.end()) {
+ LOG_ERROR("can_not_find request:%d processor", requestCode);
+ } else {
+ unique_ptr<RemotingCommand> pResponse(
+ m_requestTable[requestCode]->processRequest(addr,
+ pRequestCommand.get()));
+ if (!pRequestCommand->isOnewayRPC()) {
+ if (pResponse) {
+ pResponse->setOpaque(pRequestCommand->getOpaque());
+ pResponse->markResponseType();
+ pResponse->Encode();
+
+ invokeOneway(addr, *pResponse);
+ }
+ }
+ }
+}
+
+void TcpRemotingClient::addResponseFuture(
+ int opaque, boost::shared_ptr<ResponseFuture> pfuture) {
+ boost::lock_guard<boost::mutex> lock(m_futureTableMutex);
+ m_futureTable[opaque] = pfuture;
+}
+
+// Note: after call this function, shared_ptr of m_syncFutureTable[opaque] will
+// be erased, so caller must ensure the life cycle of returned shared_ptr;
+boost::shared_ptr<ResponseFuture>
+TcpRemotingClient::findAndDeleteResponseFuture(int opaque) {
+ boost::lock_guard<boost::mutex> lock(m_futureTableMutex);
+ boost::shared_ptr<ResponseFuture> pResponseFuture;
+ if (m_futureTable.find(opaque) != m_futureTable.end()) {
+ pResponseFuture = m_futureTable[opaque];
+ m_futureTable.erase(opaque);
+ }
+ return pResponseFuture;
+}
+
+void TcpRemotingClient::handleAsyncPullForResponseTimeout(
+ const boost::system::error_code& e, int opaque) {
+ if (e == boost::asio::error::operation_aborted) {
+ return;
+ }
+
+ boost::shared_ptr<ResponseFuture> pFuture(
+ findAndDeleteAsyncResponseFuture(opaque));
+ if (pFuture && pFuture->getASyncFlag() && (pFuture->getAsyncCallbackWrap())) {
+ if ((pFuture->getAsyncResponseFlag() !=
+ true)) // if no response received, then check timeout or not
+ {
+ LOG_ERROR("no response got for opaque:%d", opaque);
+ pFuture->setAsyncCallBackStatus(asyncCallBackStatus_timeout);
+ pFuture->executeInvokeCallbackException();
+ }
+ }
+
+ eraseTimerCallback(opaque);
+}
+
+void TcpRemotingClient::addAsyncResponseFuture(
+ int opaque, boost::shared_ptr<ResponseFuture> pfuture) {
+ boost::lock_guard<boost::mutex> lock(m_asyncFutureLock);
+ m_asyncFutureTable[opaque] = pfuture;
+}
+
+// Note: after call this function, shared_ptr of m_asyncFutureTable[opaque] will
+// be erased, so caller must ensure the life cycle of returned shared_ptr;
+boost::shared_ptr<ResponseFuture>
+TcpRemotingClient::findAndDeleteAsyncResponseFuture(int opaque) {
+ boost::lock_guard<boost::mutex> lock(m_asyncFutureLock);
+ boost::shared_ptr<ResponseFuture> pResponseFuture;
+ if (m_asyncFutureTable.find(opaque) != m_asyncFutureTable.end()) {
+ pResponseFuture = m_asyncFutureTable[opaque];
+ m_asyncFutureTable.erase(opaque);
+ }
+
+ return pResponseFuture;
+}
+
+void TcpRemotingClient::registerProcessor(
+ MQRequestCode requestCode,
+ ClientRemotingProcessor* clientRemotingProcessor) {
+ if (m_requestTable.find(requestCode) != m_requestTable.end())
+ m_requestTable.erase(requestCode);
+ m_requestTable[requestCode] = clientRemotingProcessor;
+}
+
+void TcpRemotingClient::addTimerCallback(boost::asio::deadline_timer* t,
+ int opaque) {
+ boost::lock_guard<boost::mutex> lock(m_timerMapMutex);
+ if (m_async_timer_map.find(opaque) != m_async_timer_map.end()) {
+ // AGENT_INFO("addTimerCallback:erase timerCallback opaque:%lld", opaque);
+ boost::asio::deadline_timer* old_t = m_async_timer_map[opaque];
+ old_t->cancel();
+ delete old_t;
+ old_t = NULL;
+ m_async_timer_map.erase(opaque);
+ }
+ m_async_timer_map[opaque] = t;
+}
+
+void TcpRemotingClient::eraseTimerCallback(int opaque) {
+ boost::lock_guard<boost::mutex> lock(m_timerMapMutex);
+ if (m_async_timer_map.find(opaque) != m_async_timer_map.end()) {
+ boost::asio::deadline_timer* t = m_async_timer_map[opaque];
+ delete t;
+ t = NULL;
+ m_async_timer_map.erase(opaque);
+ }
+}
+
+void TcpRemotingClient::cancelTimerCallback(int opaque) {
+ boost::lock_guard<boost::mutex> lock(m_timerMapMutex);
+ if (m_async_timer_map.find(opaque) != m_async_timer_map.end()) {
+ // AGENT_INFO("cancel timerCallback opaque:%lld", opaque);
+ boost::asio::deadline_timer* t = m_async_timer_map[opaque];
+ t->cancel();
+ delete t;
+ t = NULL;
+ m_async_timer_map.erase(opaque);
+ }
+}
+
+void TcpRemotingClient::removeAllTimerCallback() {
+ boost::lock_guard<boost::mutex> lock(m_timerMapMutex);
+ for (asyncTimerMap::iterator it = m_async_timer_map.begin();
+ it != m_async_timer_map.end(); ++it) {
+ boost::asio::deadline_timer* t = it->second;
+ t->cancel();
+ delete t;
+ t = NULL;
+ }
+ m_async_timer_map.clear();
+}
+
+//<!************************************************************************
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/transport/TcpRemotingClient.h b/rocketmq-cpp/src/transport/TcpRemotingClient.h
new file mode 100755
index 00000000..832b49ad
--- /dev/null
+++ b/rocketmq-cpp/src/transport/TcpRemotingClient.h
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __TCPREMOTINGCLIENT_H__
+#define __TCPREMOTINGCLIENT_H__
+
+#include <boost/asio.hpp>
+#include <boost/asio/io_service.hpp>
+#include <boost/bind.hpp>
+#include <boost/date_time/posix_time/posix_time.hpp>
+#include <boost/weak_ptr.hpp>
+#include <map>
+#include "ClientRemotingProcessor.h"
+#include "RemotingCommand.h"
+#include "ResponseFuture.h"
+#include "SocketUtil.h"
+#include "TcpTransport.h"
+
+namespace rocketmq {
+//<!************************************************************************
+
+class TcpRemotingClient {
+ public:
+ TcpRemotingClient(int pullThreadNum, uint64_t tcpConnectTimeout,
+ uint64_t tcpTransportTryLockTimeout);
+ virtual ~TcpRemotingClient();
+ void stopAllTcpTransportThread();
+ void updateNameServerAddressList(const string& addrs);
+
+ //<!delete outsite;
+ RemotingCommand* invokeSync(const string& addr, RemotingCommand& request,
+ int timeoutMillis = 3000);
+
+ bool invokeHeartBeat(const string& addr, RemotingCommand& request);
+
+ bool invokeAsync(const string& addr, RemotingCommand& request,
+ AsyncCallbackWrap* cbw, int64 timeoutMilliseconds);
+
+ void invokeOneway(const string& addr, RemotingCommand& request);
+
+ void ProcessData(const MemoryBlock& mem, const string& addr);
+
+ void registerProcessor(MQRequestCode requestCode,
+ ClientRemotingProcessor* clientRemotingProcessor);
+
+ void boost_asio_work();
+ void handleAsyncPullForResponseTimeout(const boost::system::error_code& e,
+ int opaque);
+
+ private:
+ static void static_messageReceived(void* context, const MemoryBlock& mem,
+ const string& addr);
+ void messageReceived(const MemoryBlock& mem, const string& addr);
+ boost::shared_ptr<TcpTransport> GetTransport(const string& addr,
+ bool needRespons);
+ boost::shared_ptr<TcpTransport> CreateTransport(const string& addr,
+ bool needRespons);
+ boost::shared_ptr<TcpTransport> CreateNameserverTransport(bool needRespons);
+ void CloseTransport(const string& addr, boost::shared_ptr<TcpTransport> pTcp);
+ void CloseNameServerTransport(boost::shared_ptr<TcpTransport> pTcp);
+ bool SendCommand(boost::shared_ptr<TcpTransport> pTts, RemotingCommand& msg);
+ void processRequestCommand(RemotingCommand* pCmd, const string& addr);
+ void processResponseCommand(RemotingCommand* pCmd,
+ boost::shared_ptr<ResponseFuture> pfuture);
+
+ void addResponseFuture(int opaque, boost::shared_ptr<ResponseFuture> pfuture);
+ boost::shared_ptr<ResponseFuture> findAndDeleteResponseFuture(int opaque);
+
+ void addAsyncResponseFuture(int opaque,
+ boost::shared_ptr<ResponseFuture> pfuture);
+ boost::shared_ptr<ResponseFuture> findAndDeleteAsyncResponseFuture(
+ int opaque);
+
+ void addTimerCallback(boost::asio::deadline_timer* t, int opaque);
+ void eraseTimerCallback(int opaque);
+ void cancelTimerCallback(int opaque);
+ void removeAllTimerCallback();
+
+ private:
+ typedef map<string, boost::shared_ptr<TcpTransport>> TcpMap;
+ typedef map<int, boost::shared_ptr<ResponseFuture>> ResMap;
+
+ typedef map<int, ClientRemotingProcessor*> RequestMap;
+ RequestMap m_requestTable;
+
+ boost::mutex m_futureTableMutex;
+ ResMap m_futureTable; //<! id->future;
+
+ ResMap m_asyncFutureTable;
+ boost::mutex m_asyncFutureLock;
+
+ TcpMap m_tcpTable; //<! ip->tcp;
+ boost::timed_mutex m_tcpLock;
+
+ // ThreadPool m_threadpool;
+ int m_pullThreadNum;
+ uint64_t m_tcpConnectTimeout; // ms
+ uint64_t m_tcpTransportTryLockTimeout; // s
+
+ //<! Nameserver
+ boost::timed_mutex m_namesrvlock;
+ vector<string> m_namesrvAddrList;
+ string m_namesrvAddrChoosed;
+ unsigned int m_namesrvIndex;
+ boost::asio::io_service m_ioService;
+ boost::thread_group m_threadpool;
+ boost::asio::io_service::work m_ioServiceWork;
+
+ boost::asio::io_service m_async_ioService;
+ unique_ptr<boost::thread> m_async_service_thread;
+
+ typedef map<int, boost::asio::deadline_timer*> asyncTimerMap;
+ boost::mutex m_timerMapMutex;
+ asyncTimerMap m_async_timer_map;
+};
+
+//<!************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-cpp/src/transport/TcpTransport.cpp b/rocketmq-cpp/src/transport/TcpTransport.cpp
new file mode 100755
index 00000000..82e9526c
--- /dev/null
+++ b/rocketmq-cpp/src/transport/TcpTransport.cpp
@@ -0,0 +1,330 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#include "TcpTransport.h"
+#include <arpa/inet.h> // for sockaddr_in and inet_ntoa...
+#include <netinet/tcp.h>
+#include <sys/socket.h> // for socket(), bind(), and connect()...
+#include "Logging.h"
+#include "TcpRemotingClient.h"
+#include "UtilAll.h"
+
+namespace rocketmq {
+
+//<!************************************************************************
+TcpTransport::TcpTransport(TcpRemotingClient *pTcpRemointClient,
+ READ_CALLBACK handle /* = NULL */)
+ : m_tcpConnectStatus(e_connectInit),
+ m_ReadDatathread(NULL),
+ m_readcallback(handle),
+ m_tcpRemotingClient(pTcpRemointClient) {
+ m_startTime = UtilAll::currentTimeMillis();
+ evthread_use_pthreads();
+ m_eventBase = NULL;
+ m_bufferEvent = NULL;
+}
+TcpTransport::~TcpTransport() {
+ m_readcallback = NULL;
+ m_bufferEvent = NULL;
+ m_eventBase = NULL;
+}
+
+tcpConnectStatus TcpTransport::connect(const string &strServerURL,
+ int timeOutMillisecs /* = 3000 */) {
+ string hostName;
+ short portNumber;
+ if (!UtilAll::SplitURL(strServerURL, hostName, portNumber)) {
+ return e_connectFail;
+ }
+
+ boost::lock_guard<boost::mutex> lock(m_socketLock);
+
+ struct sockaddr_in sin;
+ memset(&sin, 0, sizeof(sin));
+ sin.sin_family = AF_INET;
+ sin.sin_addr.s_addr = inet_addr(hostName.c_str());
+ sin.sin_port = htons(portNumber);
+
+ m_eventBase = event_base_new();
+ m_bufferEvent = bufferevent_socket_new(
+ m_eventBase, -1, BEV_OPT_CLOSE_ON_FREE | BEV_OPT_THREADSAFE);
+ bufferevent_setcb(m_bufferEvent, readNextMessageIntCallback, NULL, eventcb,
+ this);
+ bufferevent_enable(m_bufferEvent, EV_READ | EV_WRITE);
+ bufferevent_setwatermark(m_bufferEvent, EV_READ, 4, 0);
+
+ setTcpConnectStatus(e_connectWaitResponse);
+ if (bufferevent_socket_connect(m_bufferEvent, (struct sockaddr *)&sin,
+ sizeof(sin)) < 0) {
+ LOG_INFO("connect to fd:%d failed", bufferevent_getfd(m_bufferEvent));
+ setTcpConnectStatus(e_connectFail);
+ freeBufferEvent();
+ return e_connectFail;
+ } else {
+ int fd = bufferevent_getfd(m_bufferEvent);
+ LOG_INFO("try to connect to fd:%d, addr:%s", fd, (hostName.c_str()));
+ /*struct timeval timeout;
+ timeout.tv_sec = timeOutMillisecs/1000;
+ timeout.tv_usec = 0;
+ struct event* evtimeout = evtimer_new(m_eventBase, timeoutcb, this);
+ evtimer_add(evtimeout, &timeout);*/
+ evthread_make_base_notifiable(m_eventBase);
+ m_ReadDatathread =
+ new boost::thread(boost::bind(&TcpTransport::runThread, this));
+ return e_connectWaitResponse;
+ }
+}
+
+void TcpTransport::setTcpConnectStatus(tcpConnectStatus connectStatus) {
+ m_tcpConnectStatus = connectStatus;
+}
+
+tcpConnectStatus TcpTransport::getTcpConnectStatus() {
+ return m_tcpConnectStatus;
+}
+
+tcpConnectStatus TcpTransport::waitTcpConnectEvent(int timeoutMillisecs) {
+ boost::unique_lock<boost::mutex> lk(m_connectEventLock);
+ if (!m_connectEvent.timed_wait(
+ lk, boost::posix_time::milliseconds(timeoutMillisecs))) {
+ LOG_INFO("connect timeout");
+ }
+ return getTcpConnectStatus();
+}
+
+void TcpTransport::setTcpConnectEvent(tcpConnectStatus connectStatus) {
+ tcpConnectStatus baseStatus(getTcpConnectStatus());
+ setTcpConnectStatus(connectStatus);
+ if (baseStatus == e_connectWaitResponse) {
+ LOG_INFO("received libevent callback event");
+ m_connectEvent.notify_all();
+ }
+}
+
+void TcpTransport::disconnect(const string &addr) {
+ boost::lock_guard<boost::mutex> lock(m_socketLock);
+ if (getTcpConnectStatus() != e_connectInit) {
+ clearBufferEventCallback();
+ LOG_INFO("disconnect:%s start", addr.c_str());
+ m_connectEvent.notify_all();
+ setTcpConnectStatus(e_connectInit);
+ if (m_ReadDatathread) {
+ m_ReadDatathread->interrupt();
+ exitBaseDispatch();
+ while (m_ReadDatathread->timed_join(boost::posix_time::seconds(1)) ==
+ false) {
+ LOG_WARN("join readDataThread fail, retry");
+ m_ReadDatathread->interrupt();
+ exitBaseDispatch();
+ }
+ delete m_ReadDatathread;
+ m_ReadDatathread = NULL;
+ }
+ freeBufferEvent();
+ LOG_INFO("disconnect:%s completely", addr.c_str());
+ }
+}
+
+void TcpTransport::clearBufferEventCallback() {
+ if (m_bufferEvent) {
+ // Bufferevents are internally reference-counted, so if the bufferevent has
+ // pending deferred callbacks when you free it, it won't be deleted until
+ // the callbacks are done.
+ // so just empty callback to avoid future callback by libevent
+ bufferevent_setcb(m_bufferEvent, NULL, NULL, NULL, NULL);
+ }
+}
+
+void TcpTransport::freeBufferEvent() {
+ if (m_bufferEvent) {
+ bufferevent_free(m_bufferEvent);
+ }
+ if (m_eventBase) {
+ event_base_free(m_eventBase);
+ }
+}
+void TcpTransport::exitBaseDispatch() {
+ if (m_eventBase) {
+ event_base_loopbreak(m_eventBase);
+ // event_base_loopexit(m_eventBase, NULL); //Note: memory leak will be
+ // occured when timer callback was not done;
+ }
+}
+
+void TcpTransport::runThread() {
+ while (m_ReadDatathread) {
+ if (m_eventBase != NULL) {
+ event_base_dispatch(m_eventBase);
+ // event_base_loop(m_eventBase, EVLOOP_ONCE);//EVLOOP_NONBLOCK should not
+ // be used, as could not callback event immediatly
+ }
+ LOG_INFO("event_base_dispatch exit once");
+ boost::this_thread::sleep(boost::posix_time::milliseconds(1));
+ if (getTcpConnectStatus() != e_connectSuccess) return;
+ }
+}
+
+void TcpTransport::timeoutcb(evutil_socket_t fd, short what, void *arg) {
+ LOG_INFO("timeoutcb: received event:%d on fd:%d", what, fd);
+ TcpTransport *tcpTrans = (TcpTransport *)arg;
+ if (tcpTrans->getTcpConnectStatus() != e_connectSuccess) {
+ LOG_INFO("timeoutcb: after connect time, tcp was not established on fd:%d",
+ fd);
+ tcpTrans->setTcpConnectStatus(e_connectFail);
+ } else {
+ LOG_INFO("timeoutcb: after connect time, tcp was established on fd:%d", fd);
+ }
+}
+
+void TcpTransport::eventcb(struct bufferevent *bev, short what, void *ctx) {
+ evutil_socket_t fd = bufferevent_getfd(bev);
+ TcpTransport *tcpTrans = (TcpTransport *)ctx;
+ LOG_INFO("eventcb: received event:%x on fd:%d", what, fd);
+ if (what & BEV_EVENT_CONNECTED) {
+ int val = 1;
+ setsockopt(fd, IPPROTO_TCP, TCP_NODELAY, (char *)&val, sizeof(val));
+ LOG_INFO("eventcb:connect to fd:%d successfully", fd);
+ tcpTrans->setTcpConnectEvent(e_connectSuccess);
+ } else if (what & (BEV_EVENT_ERROR | BEV_EVENT_EOF | BEV_EVENT_READING |
+ BEV_EVENT_WRITING)) {
+ LOG_INFO("eventcb:rcv error event cb:%x on fd:%d", what, fd);
+ tcpTrans->setTcpConnectEvent(e_connectFail);
+ bufferevent_setcb(bev, NULL, NULL, NULL, NULL);
+ // bufferevent_disable(bev, EV_READ|EV_WRITE);
+ // bufferevent_free(bev);
+ } else {
+ LOG_ERROR("eventcb: received error event:%d on fd:%d", what, fd);
+ }
+}
+
+void TcpTransport::readNextMessageIntCallback(struct bufferevent *bev,
+ void *ctx) {
+ /* This callback is invoked when there is data to read on bev. */
+
+ // protocol: <length> <header length> <header data> <body data>
+ // 1 2 3 4
+ // rocketmq protocol contains 4 parts as following:
+ // 1��big endian 4 bytes int, its length is sum of 2,3 and 4
+ // 2��big endian 4 bytes int, its length is 3
+ // 3��use json to serialization data
+ // 4��application could self-defination binary data
+
+ struct evbuffer *input = bufferevent_get_input(bev);
+ while (1) {
+ struct evbuffer_iovec v[4];
+ int n = evbuffer_peek(input, 4, NULL, v, sizeof(v) / sizeof(v[0]));
+
+ int idx = 0;
+ char hdr[4];
+ char *p = hdr;
+ unsigned int needed = 4;
+
+ for (idx = 0; idx < n; idx++) {
+ if (needed) {
+ unsigned int tmp = needed < v[idx].iov_len ? needed : v[idx].iov_len;
+ memcpy(p, v[idx].iov_base, tmp);
+ p += tmp;
+ needed -= tmp;
+ } else {
+ break;
+ }
+ }
+
+ if (needed) {
+ LOG_DEBUG(" too little data received with sum = %d ", 4 - needed);
+ return;
+ }
+ uint32 totalLenOfOneMsg =
+ *(uint32 *)hdr; // first 4 bytes, which indicates 1st part of protocol
+ uint32 bytesInMessage = ntohl(totalLenOfOneMsg);
+ LOG_DEBUG("fd:%d, totalLen:%zu, bytesInMessage:%d", bufferevent_getfd(bev),
+ v[0].iov_len, bytesInMessage);
+
+ uint32 len = evbuffer_get_length(input);
+ if (len >= bytesInMessage + 4) {
+ LOG_DEBUG("had received all data with len:%d from fd:%d", len,
+ bufferevent_getfd(bev));
+ } else {
+ LOG_DEBUG(
+ "didn't received whole bytesInMessage:%d, from fd:%d, totalLen:%d",
+ bytesInMessage, bufferevent_getfd(bev), len);
+ return; // consider large data which was not received completely by now
+ }
+
+ if (bytesInMessage > 0) {
+ MemoryBlock messageData(bytesInMessage, true);
+ uint32 bytesRead = 0;
+ void *data = (void *)(messageData.getData() + bytesRead);
+ bufferevent_read(bev, data, 4);
+ bytesRead = bufferevent_read(bev, data, bytesInMessage);
+
+ TcpTransport *tcpTrans = (TcpTransport *)ctx;
+ tcpTrans->messageReceived(messageData);
+ }
+ }
+}
+
+bool TcpTransport::sendMessage(const char *pData, int len) {
+ boost::lock_guard<boost::mutex> lock(m_socketLock);
+ if (getTcpConnectStatus() != e_connectSuccess) {
+ return false;
+ }
+
+ int bytes_left = len;
+ int bytes_written = 0;
+ const char *ptr = pData;
+
+ /*NOTE:
+ 1. do not need to consider large data which could not send by once, as
+ bufferevent could handle this case;
+ */
+ if (m_bufferEvent) {
+ bytes_written = bufferevent_write(m_bufferEvent, ptr, bytes_left);
+ if (bytes_written == 0)
+ return true;
+ else
+ return false;
+ }
+ return false;
+}
+
+void TcpTransport::messageReceived(const MemoryBlock &mem) {
+ if (m_readcallback) {
+ m_readcallback(m_tcpRemotingClient, mem, getPeerAddrAndPort());
+ }
+}
+
+const string TcpTransport::getPeerAddrAndPort() {
+ struct sockaddr_in broker;
+ socklen_t cLen = sizeof(broker);
+
+ // getsockname(m_socket->getRawSocketHandle(), (struct sockaddr*) &s, &sLen);
+ // // ! use connectSock here.
+ getpeername(bufferevent_getfd(m_bufferEvent), (struct sockaddr *)&broker,
+ &cLen); // ! use connectSock here.
+ LOG_DEBUG("broker addr: %s, broker port: %d", inet_ntoa(broker.sin_addr),
+ ntohs(broker.sin_port));
+ string brokerAddr(inet_ntoa(broker.sin_addr));
+ brokerAddr.append(":");
+ string brokerPort(UtilAll::to_string(ntohs(broker.sin_port)));
+ brokerAddr.append(brokerPort);
+ LOG_DEBUG("brokerAddr:%s", brokerAddr.c_str());
+ return brokerAddr;
+}
+
+const uint64_t TcpTransport::getStartTime() const { return m_startTime; }
+
+} //<!end namespace;
diff --git a/rocketmq-cpp/src/transport/TcpTransport.h b/rocketmq-cpp/src/transport/TcpTransport.h
new file mode 100755
index 00000000..7ba32dca
--- /dev/null
+++ b/rocketmq-cpp/src/transport/TcpTransport.h
@@ -0,0 +1,91 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+#ifndef __TCPTRANSPORT_H__
+#define __TCPTRANSPORT_H__
+
+#include <boost/atomic.hpp>
+#include <boost/thread/condition_variable.hpp>
+#include <boost/thread/mutex.hpp>
+#include <boost/thread/thread.hpp>
+#include "dataBlock.h"
+
+extern "C" {
+#include "event2/buffer.h"
+#include "event2/bufferevent.h"
+#include "event2/event.h"
+#include "event2/thread.h"
+}
+
+namespace rocketmq {
+//<!***************************************************************************
+typedef enum {
+ e_connectInit = 0,
+ e_connectWaitResponse = 1,
+ e_connectSuccess = 2,
+ e_connectFail = 3
+} tcpConnectStatus;
+
+typedef void (*READ_CALLBACK)(void *context, const MemoryBlock &,
+ const std::string &);
+class TcpRemotingClient;
+class TcpTransport {
+ public:
+ TcpTransport(TcpRemotingClient *pTcpRemointClient,
+ READ_CALLBACK handle = NULL);
+ virtual ~TcpTransport();
+
+ tcpConnectStatus connect(const std::string &strServerURL,
+ int timeOutMillisecs = 3000);
+ void disconnect(const std::string &addr);
+ tcpConnectStatus waitTcpConnectEvent(int timeoutMillisecs = 3000);
+ void setTcpConnectStatus(tcpConnectStatus connectStatus);
+ tcpConnectStatus getTcpConnectStatus();
+ bool sendMessage(const char *pData, int len);
+ const std::string getPeerAddrAndPort();
+ const uint64_t getStartTime() const;
+
+ private:
+ void messageReceived(const MemoryBlock &mem);
+ static void readNextMessageIntCallback(struct bufferevent *bev, void *ctx);
+ static void eventcb(struct bufferevent *bev, short what, void *ctx);
+ static void timeoutcb(evutil_socket_t fd, short what, void *arg);
+ void runThread();
+ void clearBufferEventCallback();
+ void freeBufferEvent();
+ void exitBaseDispatch();
+ void setTcpConnectEvent(tcpConnectStatus connectStatus);
+
+ private:
+ uint64_t m_startTime;
+ boost::mutex m_socketLock;
+ struct event_base *m_eventBase;
+ struct bufferevent *m_bufferEvent;
+ boost::atomic<tcpConnectStatus> m_tcpConnectStatus;
+ boost::mutex m_connectEventLock;
+ boost::condition_variable_any m_connectEvent;
+ //<!read data thread
+ boost::thread *m_ReadDatathread;
+
+ //<! read data callback
+ READ_CALLBACK m_readcallback;
+ TcpRemotingClient *m_tcpRemotingClient;
+};
+
+//<!************************************************************************
+} //<!end namespace;
+
+#endif
diff --git a/rocketmq-donet/.gitignore b/rocketmq-donet/.gitignore
deleted file mode 100644
index d4baaf02..00000000
--- a/rocketmq-donet/.gitignore
+++ /dev/null
@@ -1,9 +0,0 @@
-bin
-coverage.out
-.idea/
-*.iml
-*.swp
-*.log
-tags
-temp_parser_file
-y.output
\ No newline at end of file
diff --git a/rocketmq-donet/LICENSE b/rocketmq-donet/LICENSE
deleted file mode 100644
index b67d9091..00000000
--- a/rocketmq-donet/LICENSE
+++ /dev/null
@@ -1,201 +0,0 @@
-Apache License
- Version 2.0, January 2004
- http://www.apache.org/licenses/
-
- TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
-
- 1. Definitions.
-
- "License" shall mean the terms and conditions for use, reproduction,
- and distribution as defined by Sections 1 through 9 of this document.
-
- "Licensor" shall mean the copyright owner or entity authorized by
- the copyright owner that is granting the License.
-
- "Legal Entity" shall mean the union of the acting entity and all
- other entities that control, are controlled by, or are under common
- control with that entity. For the purposes of this definition,
- "control" means (i) the power, direct or indirect, to cause the
- direction or management of such entity, whether by contract or
- otherwise, or (ii) ownership of fifty percent (50%) or more of the
- outstanding shares, or (iii) beneficial ownership of such entity.
-
- "You" (or "Your") shall mean an individual or Legal Entity
- exercising permissions granted by this License.
-
- "Source" form shall mean the preferred form for making modifications,
- including but not limited to software source code, documentation
- source, and configuration files.
-
- "Object" form shall mean any form resulting from mechanical
- transformation or translation of a Source form, including but
- not limited to compiled object code, generated documentation,
- and conversions to other media types.
-
- "Work" shall mean the work of authorship, whether in Source or
- Object form, made available under the License, as indicated by a
- copyright notice that is included in or attached to the work
- (an example is provided in the Appendix below).
-
- "Derivative Works" shall mean any work, whether in Source or Object
- form, that is based on (or derived from) the Work and for which the
- editorial revisions, annotations, elaborations, or other modifications
- represent, as a whole, an original work of authorship. For the purposes
- of this License, Derivative Works shall not include works that remain
- separable from, or merely link (or bind by name) to the interfaces of,
- the Work and Derivative Works thereof.
-
- "Contribution" shall mean any work of authorship, including
- the original version of the Work and any modifications or additions
- to that Work or Derivative Works thereof, that is intentionally
- submitted to Licensor for inclusion in the Work by the copyright owner
- or by an individual or Legal Entity authorized to submit on behalf of
- the copyright owner. For the purposes of this definition, "submitted"
- means any form of electronic, verbal, or written communication sent
- to the Licensor or its representatives, including but not limited to
- communication on electronic mailing lists, source code control systems,
- and issue tracking systems that are managed by, or on behalf of, the
- Licensor for the purpose of discussing and improving the Work, but
- excluding communication that is conspicuously marked or otherwise
- designated in writing by the copyright owner as "Not a Contribution."
-
- "Contributor" shall mean Licensor and any individual or Legal Entity
- on behalf of whom a Contribution has been received by Licensor and
- subsequently incorporated within the Work.
-
- 2. Grant of Copyright License. Subject to the terms and conditions of
- this License, each Contributor hereby grants to You a perpetual,
- worldwide, non-exclusive, no-charge, royalty-free, irrevocable
- copyright license to reproduce, prepare Derivative Works of,
- publicly display, publicly perform, sublicense, and distribute the
- Work and such Derivative Works in Source or Object form.
-
- 3. Grant of Patent License. Subject to the terms and conditions of
- this License, each Contributor hereby grants to You a perpetual,
- worldwide, non-exclusive, no-charge, royalty-free, irrevocable
- (except as stated in this section) patent license to make, have made,
- use, offer to sell, sell, import, and otherwise transfer the Work,
- where such license applies only to those patent claims licensable
- by such Contributor that are necessarily infringed by their
- Contribution(s) alone or by combination of their Contribution(s)
- with the Work to which such Contribution(s) was submitted. If You
- institute patent litigation against any entity (including a
- cross-claim or counterclaim in a lawsuit) alleging that the Work
- or a Contribution incorporated within the Work constitutes direct
- or contributory patent infringement, then any patent licenses
- granted to You under this License for that Work shall terminate
- as of the date such litigation is filed.
-
- 4. Redistribution. You may reproduce and distribute copies of the
- Work or Derivative Works thereof in any medium, with or without
- modifications, and in Source or Object form, provided that You
- meet the following conditions:
-
- (a) You must give any other recipients of the Work or
- Derivative Works a copy of this License; and
-
- (b) You must cause any modified files to carry prominent notices
- stating that You changed the files; and
-
- (c) You must retain, in the Source form of any Derivative Works
- that You distribute, all copyright, patent, trademark, and
- attribution notices from the Source form of the Work,
- excluding those notices that do not pertain to any part of
- the Derivative Works; and
-
- (d) If the Work includes a "NOTICE" text file as part of its
- distribution, then any Derivative Works that You distribute must
- include a readable copy of the attribution notices contained
- within such NOTICE file, excluding those notices that do not
- pertain to any part of the Derivative Works, in at least one
- of the following places: within a NOTICE text file distributed
- as part of the Derivative Works; within the Source form or
- documentation, if provided along with the Derivative Works; or,
- within a display generated by the Derivative Works, if and
- wherever such third-party notices normally appear. The contents
- of the NOTICE file are for informational purposes only and
- do not modify the License. You may add Your own attribution
- notices within Derivative Works that You distribute, alongside
- or as an addendum to the NOTICE text from the Work, provided
- that such additional attribution notices cannot be construed
- as modifying the License.
-
- You may add Your own copyright statement to Your modifications and
- may provide additional or different license terms and conditions
- for use, reproduction, or distribution of Your modifications, or
- for any such Derivative Works as a whole, provided Your use,
- reproduction, and distribution of the Work otherwise complies with
- the conditions stated in this License.
-
- 5. Submission of Contributions. Unless You explicitly state otherwise,
- any Contribution intentionally submitted for inclusion in the Work
- by You to the Licensor shall be under the terms and conditions of
- this License, without any additional terms or conditions.
- Notwithstanding the above, nothing herein shall supersede or modify
- the terms of any separate license agreement you may have executed
- with Licensor regarding such Contributions.
-
- 6. Trademarks. This License does not grant permission to use the trade
- names, trademarks, service marks, or product names of the Licensor,
- except as required for reasonable and customary use in describing the
- origin of the Work and reproducing the content of the NOTICE file.
-
- 7. Disclaimer of Warranty. Unless required by applicable law or
- agreed to in writing, Licensor provides the Work (and each
- Contributor provides its Contributions) on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
- implied, including, without limitation, any warranties or conditions
- of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
- PARTICULAR PURPOSE. You are solely responsible for determining the
- appropriateness of using or redistributing the Work and assume any
- risks associated with Your exercise of permissions under this License.
-
- 8. Limitation of Liability. In no event and under no legal theory,
- whether in tort (including negligence), contract, or otherwise,
- unless required by applicable law (such as deliberate and grossly
- negligent acts) or agreed to in writing, shall any Contributor be
- liable to You for damages, including any direct, indirect, special,
- incidental, or consequential damages of any character arising as a
- result of this License or out of the use or inability to use the
- Work (including but not limited to damages for loss of goodwill,
- work stoppage, computer failure or malfunction, or any and all
- other commercial damages or losses), even if such Contributor
- has been advised of the possibility of such damages.
-
- 9. Accepting Warranty or Additional Liability. While redistributing
- the Work or Derivative Works thereof, You may choose to offer,
- and charge a fee for, acceptance of support, warranty, indemnity,
- or other liability obligations and/or rights consistent with this
- License. However, in accepting such obligations, You may act only
- on Your own behalf and on Your sole responsibility, not on behalf
- of any other Contributor, and only if You agree to indemnify,
- defend, and hold each Contributor harmless for any liability
- incurred by, or claims asserted against, such Contributor by reason
- of your accepting any such warranty or additional liability.
-
- END OF TERMS AND CONDITIONS
-
- APPENDIX: How to apply the Apache License to your work.
-
- To apply the Apache License to your work, attach the following
- boilerplate notice, with the fields enclosed by brackets "{}"
- replaced with your own identifying information. (Don't include
- the brackets!) The text should be enclosed in the appropriate
- comment syntax for the file format. We also recommend that a
- file or class name and description of purpose be included on the
- same "printed page" as the copyright notice for easier
- identification within third-party archives.
-
- Copyright {}
-
- Licensed under the Apache License, Version 2.0 (the "License");
- you may not use this file except in compliance with the License.
- You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing, software
- distributed under the License is distributed on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- See the License for the specific language governing permissions and
- limitations under the License.
diff --git a/rocketmq-donet/NOTICE b/rocketmq-donet/NOTICE
deleted file mode 100644
index 53848573..00000000
--- a/rocketmq-donet/NOTICE
+++ /dev/null
@@ -1,5 +0,0 @@
-Apache RocketMQ (incubating)
-Copyright 2016-2017 The Apache Software Foundation
-
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
\ No newline at end of file
diff --git a/rocketmq-mongodb/LICENSE b/rocketmq-mongodb/LICENSE
deleted file mode 100644
index b67d9091..00000000
--- a/rocketmq-mongodb/LICENSE
+++ /dev/null
@@ -1,201 +0,0 @@
-Apache License
- Version 2.0, January 2004
- http://www.apache.org/licenses/
-
- TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
-
- 1. Definitions.
-
- "License" shall mean the terms and conditions for use, reproduction,
- and distribution as defined by Sections 1 through 9 of this document.
-
- "Licensor" shall mean the copyright owner or entity authorized by
- the copyright owner that is granting the License.
-
- "Legal Entity" shall mean the union of the acting entity and all
- other entities that control, are controlled by, or are under common
- control with that entity. For the purposes of this definition,
- "control" means (i) the power, direct or indirect, to cause the
- direction or management of such entity, whether by contract or
- otherwise, or (ii) ownership of fifty percent (50%) or more of the
- outstanding shares, or (iii) beneficial ownership of such entity.
-
- "You" (or "Your") shall mean an individual or Legal Entity
- exercising permissions granted by this License.
-
- "Source" form shall mean the preferred form for making modifications,
- including but not limited to software source code, documentation
- source, and configuration files.
-
- "Object" form shall mean any form resulting from mechanical
- transformation or translation of a Source form, including but
- not limited to compiled object code, generated documentation,
- and conversions to other media types.
-
- "Work" shall mean the work of authorship, whether in Source or
- Object form, made available under the License, as indicated by a
- copyright notice that is included in or attached to the work
- (an example is provided in the Appendix below).
-
- "Derivative Works" shall mean any work, whether in Source or Object
- form, that is based on (or derived from) the Work and for which the
- editorial revisions, annotations, elaborations, or other modifications
- represent, as a whole, an original work of authorship. For the purposes
- of this License, Derivative Works shall not include works that remain
- separable from, or merely link (or bind by name) to the interfaces of,
- the Work and Derivative Works thereof.
-
- "Contribution" shall mean any work of authorship, including
- the original version of the Work and any modifications or additions
- to that Work or Derivative Works thereof, that is intentionally
- submitted to Licensor for inclusion in the Work by the copyright owner
- or by an individual or Legal Entity authorized to submit on behalf of
- the copyright owner. For the purposes of this definition, "submitted"
- means any form of electronic, verbal, or written communication sent
- to the Licensor or its representatives, including but not limited to
- communication on electronic mailing lists, source code control systems,
- and issue tracking systems that are managed by, or on behalf of, the
- Licensor for the purpose of discussing and improving the Work, but
- excluding communication that is conspicuously marked or otherwise
- designated in writing by the copyright owner as "Not a Contribution."
-
- "Contributor" shall mean Licensor and any individual or Legal Entity
- on behalf of whom a Contribution has been received by Licensor and
- subsequently incorporated within the Work.
-
- 2. Grant of Copyright License. Subject to the terms and conditions of
- this License, each Contributor hereby grants to You a perpetual,
- worldwide, non-exclusive, no-charge, royalty-free, irrevocable
- copyright license to reproduce, prepare Derivative Works of,
- publicly display, publicly perform, sublicense, and distribute the
- Work and such Derivative Works in Source or Object form.
-
- 3. Grant of Patent License. Subject to the terms and conditions of
- this License, each Contributor hereby grants to You a perpetual,
- worldwide, non-exclusive, no-charge, royalty-free, irrevocable
- (except as stated in this section) patent license to make, have made,
- use, offer to sell, sell, import, and otherwise transfer the Work,
- where such license applies only to those patent claims licensable
- by such Contributor that are necessarily infringed by their
- Contribution(s) alone or by combination of their Contribution(s)
- with the Work to which such Contribution(s) was submitted. If You
- institute patent litigation against any entity (including a
- cross-claim or counterclaim in a lawsuit) alleging that the Work
- or a Contribution incorporated within the Work constitutes direct
- or contributory patent infringement, then any patent licenses
- granted to You under this License for that Work shall terminate
- as of the date such litigation is filed.
-
- 4. Redistribution. You may reproduce and distribute copies of the
- Work or Derivative Works thereof in any medium, with or without
- modifications, and in Source or Object form, provided that You
- meet the following conditions:
-
- (a) You must give any other recipients of the Work or
- Derivative Works a copy of this License; and
-
- (b) You must cause any modified files to carry prominent notices
- stating that You changed the files; and
-
- (c) You must retain, in the Source form of any Derivative Works
- that You distribute, all copyright, patent, trademark, and
- attribution notices from the Source form of the Work,
- excluding those notices that do not pertain to any part of
- the Derivative Works; and
-
- (d) If the Work includes a "NOTICE" text file as part of its
- distribution, then any Derivative Works that You distribute must
- include a readable copy of the attribution notices contained
- within such NOTICE file, excluding those notices that do not
- pertain to any part of the Derivative Works, in at least one
- of the following places: within a NOTICE text file distributed
- as part of the Derivative Works; within the Source form or
- documentation, if provided along with the Derivative Works; or,
- within a display generated by the Derivative Works, if and
- wherever such third-party notices normally appear. The contents
- of the NOTICE file are for informational purposes only and
- do not modify the License. You may add Your own attribution
- notices within Derivative Works that You distribute, alongside
- or as an addendum to the NOTICE text from the Work, provided
- that such additional attribution notices cannot be construed
- as modifying the License.
-
- You may add Your own copyright statement to Your modifications and
- may provide additional or different license terms and conditions
- for use, reproduction, or distribution of Your modifications, or
- for any such Derivative Works as a whole, provided Your use,
- reproduction, and distribution of the Work otherwise complies with
- the conditions stated in this License.
-
- 5. Submission of Contributions. Unless You explicitly state otherwise,
- any Contribution intentionally submitted for inclusion in the Work
- by You to the Licensor shall be under the terms and conditions of
- this License, without any additional terms or conditions.
- Notwithstanding the above, nothing herein shall supersede or modify
- the terms of any separate license agreement you may have executed
- with Licensor regarding such Contributions.
-
- 6. Trademarks. This License does not grant permission to use the trade
- names, trademarks, service marks, or product names of the Licensor,
- except as required for reasonable and customary use in describing the
- origin of the Work and reproducing the content of the NOTICE file.
-
- 7. Disclaimer of Warranty. Unless required by applicable law or
- agreed to in writing, Licensor provides the Work (and each
- Contributor provides its Contributions) on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
- implied, including, without limitation, any warranties or conditions
- of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
- PARTICULAR PURPOSE. You are solely responsible for determining the
- appropriateness of using or redistributing the Work and assume any
- risks associated with Your exercise of permissions under this License.
-
- 8. Limitation of Liability. In no event and under no legal theory,
- whether in tort (including negligence), contract, or otherwise,
- unless required by applicable law (such as deliberate and grossly
- negligent acts) or agreed to in writing, shall any Contributor be
- liable to You for damages, including any direct, indirect, special,
- incidental, or consequential damages of any character arising as a
- result of this License or out of the use or inability to use the
- Work (including but not limited to damages for loss of goodwill,
- work stoppage, computer failure or malfunction, or any and all
- other commercial damages or losses), even if such Contributor
- has been advised of the possibility of such damages.
-
- 9. Accepting Warranty or Additional Liability. While redistributing
- the Work or Derivative Works thereof, You may choose to offer,
- and charge a fee for, acceptance of support, warranty, indemnity,
- or other liability obligations and/or rights consistent with this
- License. However, in accepting such obligations, You may act only
- on Your own behalf and on Your sole responsibility, not on behalf
- of any other Contributor, and only if You agree to indemnify,
- defend, and hold each Contributor harmless for any liability
- incurred by, or claims asserted against, such Contributor by reason
- of your accepting any such warranty or additional liability.
-
- END OF TERMS AND CONDITIONS
-
- APPENDIX: How to apply the Apache License to your work.
-
- To apply the Apache License to your work, attach the following
- boilerplate notice, with the fields enclosed by brackets "{}"
- replaced with your own identifying information. (Don't include
- the brackets!) The text should be enclosed in the appropriate
- comment syntax for the file format. We also recommend that a
- file or class name and description of purpose be included on the
- same "printed page" as the copyright notice for easier
- identification within third-party archives.
-
- Copyright {}
-
- Licensed under the Apache License, Version 2.0 (the "License");
- you may not use this file except in compliance with the License.
- You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing, software
- distributed under the License is distributed on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- See the License for the specific language governing permissions and
- limitations under the License.
diff --git a/rocketmq-mongodb/NOTICE b/rocketmq-mongodb/NOTICE
deleted file mode 100644
index 53848573..00000000
--- a/rocketmq-mongodb/NOTICE
+++ /dev/null
@@ -1,5 +0,0 @@
-Apache RocketMQ (incubating)
-Copyright 2016-2017 The Apache Software Foundation
-
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
\ No newline at end of file
diff --git a/rocketmq-redis/.gitignore b/rocketmq-redis/.gitignore
new file mode 100644
index 00000000..c3600ecd
--- /dev/null
+++ b/rocketmq-redis/.gitignore
@@ -0,0 +1,22 @@
+/target
+*.class
+
+# Mobile Tools for Java (J2ME)
+.mtj.tmp/
+
+# Package Files #
+*.jar
+*.war
+*.ear
+
+# virtual machine crash logs, see http://www.java.com/en/download/help/error_hotspot.xml
+hs_err_pid*
+
+# Eclipse
+/.project
+/.classpath
+
+# Idea
+/*.iml
+/.idea
+
diff --git a/rocketmq-client4cpp/docs/roadmap.md b/rocketmq-redis/CHANGELOG.md
similarity index 100%
rename from rocketmq-client4cpp/docs/roadmap.md
rename to rocketmq-redis/CHANGELOG.md
diff --git a/rocketmq-redis/CONTRIBUTING.md b/rocketmq-redis/CONTRIBUTING.md
new file mode 100644
index 00000000..e26b50e8
--- /dev/null
+++ b/rocketmq-redis/CONTRIBUTING.md
@@ -0,0 +1,13 @@
+## Before pull request
+
+* execute following commands and make sure you can pass all testcase.
+
+```
+sudo wget https://github.com/antirez/redis/archive/3.2.3.tar.gz && tar -xvzf 3.2.3.tar.gz && cd redis-3.2.3 && make
+cd src && nohup ./redis-server --port 6380 --requirepass test &
+sudo wget https://github.com/antirez/redis/archive/3.0.7.tar.gz && tar -xvzf 3.0.7.tar.gz && cd redis-3.0.7 && make
+cd src && nohup ./redis-server --port 6379 &
+sudo wget -O stunnel.tar.gz ftp://ftp.stunnel.org/stunnel/archive/5.x/stunnel-5.29.tar.gz && tar -xvzf stunnel.tar.gz && cd stunnel-5.29 && ./configure && make && sudo make install && cd src && wget https://raw.githubusercontent.com/leonchen83/redis-replicator/master/src/test/resources/keystore/stunnel.conf && wget https://raw.githubusercontent.com/leonchen83/redis-replicator/master/src/test/resources/keystore/private.pem && ./stunnel stunnel.conf
+sudo mvn clean package
+```
+
diff --git a/rocketmq-redis/INTEGRATION-TEST b/rocketmq-redis/INTEGRATION-TEST
new file mode 100644
index 00000000..27bd7e23
--- /dev/null
+++ b/rocketmq-redis/INTEGRATION-TEST
@@ -0,0 +1,14 @@
+#!/usr/bin/env bash
+set -ev
+export REDIS_REPLICATOR_HOME=`pwd`
+cd ..
+wget https://github.com/antirez/redis/archive/3.2.3.tar.gz
+tar -xvzf 3.2.3.tar.gz
+cd redis-3.2.3
+make
+cd src
+nohup ./redis-server --port 6379 &
+sleep 1
+cd $REDIS_REPLICATOR_HOME
+mvn -B clean apache-rat:check findbugs:findbugs checkstyle:checkstyle
+mvn clean install -DskipITs
\ No newline at end of file
diff --git a/rocketmq-beam/LICENSE b/rocketmq-redis/LICENSE-BIN
similarity index 72%
rename from rocketmq-beam/LICENSE
rename to rocketmq-redis/LICENSE-BIN
index b67d9091..22b0aa40 100644
--- a/rocketmq-beam/LICENSE
+++ b/rocketmq-redis/LICENSE-BIN
@@ -199,3 +199,103 @@ Apache License
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
+
+
+------
+This product has a bundle logback, which is available under the EPL v1.0 License.
+The source code of logback can be found at https://github.com/qos-ch/logback.
+
+Logback LICENSE
+---------------
+
+Logback: the reliable, generic, fast and flexible logging framework.
+Copyright (C) 1999-2015, QOS.ch. All rights reserved.
+
+This program and the accompanying materials are dual-licensed under
+either the terms of the Eclipse Public License v1.0 as published by
+the Eclipse Foundation
+
+ or (per the licensee's choosing)
+
+under the terms of the GNU Lesser General Public License version 2.1
+as published by the Free Software Foundation.
+
+------
+This product has a bundle slf4j, which is available under the MIT License.
+The source code of slf4j can be found at https://github.com/qos-ch/slf4j.
+
+ Copyright (c) 2004-2017 QOS.ch
+ All rights reserved.
+
+ Permission is hereby granted, free of charge, to any person obtaining
+ a copy of this software and associated documentation files (the
+ "Software"), to deal in the Software without restriction, including
+ without limitation the rights to use, copy, modify, merge, publish,
+ distribute, sublicense, and/or sell copies of the Software, and to
+ permit persons to whom the Software is furnished to do so, subject to
+ the following conditions:
+
+ The above copyright notice and this permission notice shall be
+ included in all copies or substantial portions of the Software.
+
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+ EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+ MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+ NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+ LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+ OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+ WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
+
+------
+This product has a bundle fastjson, which is available under the ASL2 License.
+The source code of fastjson can be found at https://github.com/alibaba/fastjson.
+
+ Copyright 1999-2017 Alibaba Group Holding Ltd.
+
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+
+------
+ This product has a bundle druid, which is available under the ASL2 License.
+ The source code of druid can be found at https://github.com/alibaba/druid.
+
+ Copyright 1999-2017 Alibaba Group Holding Ltd.
+
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+
+------
+This product has a bundle commons-codec, which is available under the ASL2 License.
+The source code of commons-codec can be found at http://svn.apache.org/viewvc/commons/proper/codec/trunk/.
+
+Apache Commons Codec
+Copyright 2002-2016 The Apache Software Foundation
+
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
+
+src/test/org/apache/commons/codec/language/DoubleMetaphoneTest.java
+contains test data from http://aspell.net/test/orig/batch0.tab.
+Copyright (C) 2002 Kevin Atkinson (kevina@gnu.org)
+
+------
+This product has a bundle mysql-binlog-connector-java, which is available under the ASL2 License.
+The source code of mysql-binlog-connector-java can be found at https://github.com/shyiko/mysql-binlog-connector-java.
diff --git a/rocketmq-beam/NOTICE b/rocketmq-redis/NOTICE-BIN
similarity index 100%
rename from rocketmq-beam/NOTICE
rename to rocketmq-redis/NOTICE-BIN
diff --git a/rocketmq-redis/README.md b/rocketmq-redis/README.md
new file mode 100644
index 00000000..bf22f547
--- /dev/null
+++ b/rocketmq-redis/README.md
@@ -0,0 +1,161 @@
+Table of Contents
+=================
+
+ * [1. Rocketmq-redis-replicator](#1-rocketmq-redis-replicator)
+ * [1.1. Brief introduction](#11-brief-introduction)
+ * [2. Install](#2-install)
+ * [2.1. Requirements](#21-requirements)
+ * [2.2. Install from source code](#22-install-from-source-code)
+ * [3. Simple usage](#3-simple-usage)
+ * [3.1. Downstream via socket](#31-downstream-via-socket)
+ * [3.2. Deploy as an independent service](#32-deploy-as-an-independent-service)
+ * [4. Configuration](#4-configuration)
+ * [4.1. Rocketmq configuration](#41-rocketmq-configuration)
+ * [4.1. Redis configuration](#42-redis-configuration)
+ * [5. Other topics](#5-other-topics)
+ * [5.1. Built-in command parser](#51-built-in-command-parser)
+ * [5.2. EOFException](#52-eofexception)
+ * [5.3. Trace event log](#53-trace-event-log)
+ * [5.4. Auth](#54-auth)
+ * [5.5. Avoid full sync](#55-avoid-full-sync)
+
+# 1. Rocketmq-redis-replicator
+
+## 1.1. Brief introduction
+
+Rocketmq redis replicator implement Redis Replication protocol written in java. It can parse, filter, broadcast the RDB and AOF events in a real time manner and downstream these event to RocketMQ.
+
+
+
+# 2. Install
+## 2.1. Requirements
+jdk 1.7+
+maven-3.2.3+
+redis 2.6 - 4.0.x
+rocketmq 4.1.0 or higher
+
+## 2.2. Install from source code
+
+```
+ $mvn clean install package -Dmaven.test.skip=true
+```
+
+# 3. Simple usage
+
+## 3.1. Downstream via socket
+
+```java
+ Configure configure = new Configure();
+ Replicator replicator = new RocketMQRedisReplicator(configure);
+ final RocketMQProducer producer = new RocketMQProducer(configure);
+
+ replicator.addRdbListener(new RdbListener.Adaptor() {
+ @Override public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ try {
+ boolean success = producer.sendKeyValuePair(kv);
+ if (!success) {
+ LOGGER.error("Fail to send KeyValuePair[key={}]", kv.getKey());
+ }
+ } catch (Exception e) {
+ LOGGER.error(String.format("Fail to send KeyValuePair[key=%s]", kv.getKey()), e);
+ }
+ }
+ });
+
+ replicator.addCommandListener(new CommandListener() {
+ @Override public void handle(Replicator replicator, Command command) {
+ try {
+ boolean success = producer.sendCommand(command);
+ if (!success) {
+ LOGGER.error("Fail to send command[{}]", command);
+ }
+ } catch (Exception e) {
+ LOGGER.error(String.format("Fail to send command[%s]", command), e);
+ }
+ }
+ });
+
+ replicator.open();
+```
+## 3.2. Deploy as an independent service
+1. `mvn clean package -Dmaven.test.skip`
+2. `sh target/rocketmq-redis-pack/bin/start.sh`
+
+# 4. Configuration
+
+The config file located at target/rocketmq-redis-pack/conf/replicator.conf
+
+## 4.1. Rocketmq configuration
+
+| parameter | default value| detail |
+|-----------|--------------|--------|
+| rocketmq.nameserver.address | 127.0.0.1:9876 | rocketmq server address|
+| rocketmq.producer.groupname | redis_replicator_producer_group_name | rocketmq group name |
+| rocketmq.producer.instancename | redis_replicator_producer_instance_name | rocketmq instance name |
+| rocketmq.data.topic | redisdata | rocketmq topic name |
+| order.model | global | global or partial |
+| deploy.model | single | single or cluster |
+| zookeeper.address | 127.0.0.1:2181 | run on cluster model |
+| redis.uri | redis://127.0.0.1:6379 | the uri of redis master which replicate from |
+
+# 5. Other topics
+
+## 5.1. Built-in command parser
+
+|**commands**|**commands** | **commands** |**commands**|**commands** | **commands** |
+| ---------- | ------------ | ---------------| ---------- | ------------ | ------------------ |
+| **PING** | **APPEND** | **SET** | **SETEX** | **MSET** | **DEL** |
+| **SADD** | **HMSET** | **HSET** | **LSET** | **EXPIRE** | **EXPIREAT** |
+| **GETSET** | **HSETNX** | **MSETNX** | **PSETEX** | **SETNX** | **SETRANGE** |
+| **HDEL** | **UNLINK** | **SREM** | **LPOP** | **LPUSH** | **LPUSHX** |
+| **LRem** | **RPOP** | **RPUSH** | **RPUSHX** | **ZREM** | **ZINTERSTORE** |
+| **INCR** | **DECR** | **INCRBY** |**PERSIST** | **SELECT** | **FLUSHALL** |
+|**FLUSHDB** | **HINCRBY** | **ZINCRBY** | **MOVE** | **SMOVE** |**BRPOPLPUSH** |
+|**PFCOUNT** | **PFMERGE** | **SDIFFSTORE** |**RENAMENX**| **PEXPIREAT**|**SINTERSTORE** |
+|**ZADD** | **BITFIELD** |**SUNIONSTORE** |**RESTORE** | **LINSERT** |**ZREMRANGEBYLEX** |
+|**GEOADD** | **PEXPIRE** |**ZUNIONSTORE** |**EVAL** | **SCRIPT** |**ZREMRANGEBYRANK** |
+|**PUBLISH** | **BITOP** |**SETBIT** | **SWAPDB** | **PFADD** |**ZREMRANGEBYSCORE**|
+|**RENAME** | **MULTI** | **EXEC** | **LTRIM** |**RPOPLPUSH** | **SORT** |
+
+## 5.2. EOFException
+
+* Adjust redis server setting like the following. more details please refer to [redis.conf](https://raw.githubusercontent.com/antirez/redis/3.0/redis.conf)
+
+```java
+ client-output-buffer-limit slave 0 0 0
+```
+**WARNNING: this setting may run out of memory of redis server in some cases.**
+
+## 5.3. Trace event log
+
+* Set log level to **debug**
+* If you are using log4j2, add logger like the following:
+
+```xml
+ <Logger name="com.moilioncircle" level="debug">
+ <AppenderRef ref="YourAppender"/>
+ </Logger>
+```
+
+```java
+ // redis uri
+ "redis://127.0.0.1:6379?verbose=yes"
+```
+
+## 5.4. Auth
+
+```java
+ // redis uri
+ "redis://127.0.0.1:6379?authPassword=foobared"
+```
+
+## 5.5. Avoid full sync
+
+* Adjust redis server setting like the following
+
+```java
+ repl-backlog-size
+ repl-backlog-ttl
+ repl-ping-slave-periods
+```
+`repl-ping-slave-period` **MUST** less than `readTimeout`, default `readTimeout` is 30 seconds
diff --git a/rocketmq-redis/doc/image1.png b/rocketmq-redis/doc/image1.png
new file mode 100644
index 00000000..a746327f
Binary files /dev/null and b/rocketmq-redis/doc/image1.png differ
diff --git a/rocketmq-redis/pom.xml b/rocketmq-redis/pom.xml
new file mode 100644
index 00000000..23c35b9d
--- /dev/null
+++ b/rocketmq-redis/pom.xml
@@ -0,0 +1,317 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+<project xmlns="http://maven.apache.org/POM/4.0.0"
+ xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
+ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
+ <modelVersion>4.0.0</modelVersion>
+
+ <groupId>org.apache.rocketmq</groupId>
+ <artifactId>rocketmq-redis-replicator</artifactId>
+ <version>1.0.0</version>
+
+ <name>redis-replicator</name>
+ <description>Redis Replicator is a redis RDB and Command parser written in java.
+ It can parse,filter,broadcast the RDB and Command events in a real time manner
+ and resent to Apache RocketMQ, then consumer could subscribe topic to receive data.
+ </description>
+ <url>https://github.com/apache/incubator-rocketmq-externals/tree/master/rocketmq-redis</url>
+
+ <licenses>
+ <license>
+ <name>The Apache Software License, Version 2.0</name>
+ <url>http://www.apache.org/licenses/LICENSE-2.0.txt</url>
+ </license>
+ </licenses>
+
+ <developers>
+ <developer>
+ <name>Leon Chen</name>
+ <email>chen.bao.yi@gmail.com</email>
+ <organization>moilioncircle</organization>
+ <organizationUrl>http://www.moilioncircle.com/</organizationUrl>
+ <roles>
+ <role>Developer</role>
+ </roles>
+ <timezone>+8</timezone>
+ </developer>
+
+ <developer>
+ <name>Adrian Yao</name>
+ <email>adrianyaofly@gmail.com</email>
+ <organization>unstudy</organization>
+ <timezone>+8</timezone>
+ </developer>
+
+ <developer>
+ <name>Rick Zhang</name>
+ <email>zhangke.huangshan@gmail.com</email>
+ <organization>treefinance.com.cn</organization>
+ <roles>
+ <role>Developer</role>
+ </roles>
+ <timezone>+8</timezone>
+ </developer>
+ </developers>
+
+ <issueManagement>
+ <system>jira</system>
+ <url>https://issues.apache.org/jira/browse/RocketMQ</url>
+ </issueManagement>
+
+ <properties>
+ <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
+ <maven.compiler.source>1.7</maven.compiler.source>
+ <maven.compiler.target>1.7</maven.compiler.target>
+ <!-- zookeeper -->
+ <zookeeper.version>3.4.6</zookeeper.version>
+ <curator.version>2.9.1</curator.version>
+ <logback.version>1.1.3</logback.version>
+ <rocketmq.client.version>4.1.0-incubating</rocketmq.client.version>
+ </properties>
+
+ <dependencies>
+ <dependency>
+ <groupId>org.apache.rocketmq</groupId>
+ <artifactId>rocketmq-client</artifactId>
+ <version>${rocketmq.client.version}</version>
+ <exclusions>
+ <exclusion>
+ <groupId>org.slf4j</groupId>
+ <artifactId>slf4j-api</artifactId>
+ </exclusion>
+ </exclusions>
+ </dependency>
+ <dependency>
+ <groupId>ch.qos.logback</groupId>
+ <artifactId>logback-classic</artifactId>
+ <version>${logback.version}</version>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.curator</groupId>
+ <artifactId>curator-recipes</artifactId>
+ <version>${curator.version}</version>
+ <exclusions>
+ <exclusion>
+ <groupId>log4j</groupId>
+ <artifactId>log4j</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>org.slf4j</groupId>
+ <artifactId>slf4j-api</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>org.slf4j</groupId>
+ <artifactId>slf4j-log4j12</artifactId>
+ </exclusion>
+ </exclusions>
+ </dependency>
+ <!-- test -->
+ <dependency>
+ <groupId>junit</groupId>
+ <artifactId>junit</artifactId>
+ <version>4.11</version>
+ <scope>test</scope>
+ </dependency>
+ <dependency>
+ <groupId>redis.clients</groupId>
+ <artifactId>jedis</artifactId>
+ <version>2.9.0</version>
+ <scope>test</scope>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.rocketmq</groupId>
+ <artifactId>rocketmq-test</artifactId>
+ <version>4.1.0-incubating</version>
+ <scope>test</scope>
+ </dependency>
+ </dependencies>
+
+ <build>
+ <finalName>rocketmq-redis</finalName>
+ <sourceDirectory>${project.basedir}/src/main/java</sourceDirectory>
+ <outputDirectory>${project.basedir}/target/classes</outputDirectory>
+ <resources>
+ <resource>
+ <directory>${project.basedir}/src/main/resources</directory>
+ <filtering>true</filtering>
+ </resource>
+ </resources>
+ <plugins>
+ <plugin>
+ <groupId>org.codehaus.mojo</groupId>
+ <artifactId>clirr-maven-plugin</artifactId>
+ <version>2.8</version>
+ </plugin>
+ <plugin>
+ <artifactId>maven-enforcer-plugin</artifactId>
+ <version>1.4.1</version>
+ <executions>
+ <execution>
+ <id>enforce-ban-circular-dependencies</id>
+ <goals>
+ <goal>enforce</goal>
+ </goals>
+ </execution>
+ </executions>
+ <configuration>
+ <rules>
+ <banCircularDependencies/>
+ </rules>
+ <fail>true</fail>
+ </configuration>
+ <dependencies>
+ <dependency>
+ <groupId>org.codehaus.mojo</groupId>
+ <artifactId>extra-enforcer-rules</artifactId>
+ <version>1.0-beta-6</version>
+ </dependency>
+ </dependencies>
+ </plugin>
+ <plugin>
+ <artifactId>maven-compiler-plugin</artifactId>
+ <version>3.5.1</version>
+ <configuration>
+ <source>${maven.compiler.source}</source>
+ <target>${maven.compiler.target}</target>
+ <compilerVersion>${maven.compiler.source}</compilerVersion>
+ <showDeprecation>true</showDeprecation>
+ <showWarnings>true</showWarnings>
+ </configuration>
+ </plugin>
+ <plugin>
+ <artifactId>maven-javadoc-plugin</artifactId>
+ <version>2.10.4</version>
+ <configuration>
+ <charset>UTF-8</charset>
+ </configuration>
+ <executions>
+ <execution>
+ <id>attach-javadocs</id>
+ <goals>
+ <goal>jar</goal>
+ </goals>
+ </execution>
+ </executions>
+ </plugin>
+ <plugin>
+ <artifactId>maven-source-plugin</artifactId>
+ <version>3.0.1</version>
+ <executions>
+ <execution>
+ <id>attach-sources</id>
+ <goals>
+ <goal>jar</goal>
+ </goals>
+ </execution>
+ </executions>
+ </plugin>
+ <plugin>
+ <groupId>org.codehaus.mojo</groupId>
+ <artifactId>findbugs-maven-plugin</artifactId>
+ <version>3.0.4</version>
+ </plugin>
+ <plugin>
+ <groupId>org.apache.rat</groupId>
+ <artifactId>apache-rat-plugin</artifactId>
+ <version>0.12</version>
+ <configuration>
+ <excludes>
+ <exclude>README.md</exclude>
+ <exclude>CHANGELOG.md</exclude>
+ <exclude>CONTRIBUTING.md</exclude>
+ <exclude>NOTICE-BIN</exclude>
+ <exclude>INTEGRATION-TEST</exclude>
+ <exclude>doc/image1.png</exclude>
+ <exclude>src/main/assembly/scripts/start.sh</exclude>
+ <exclude>src/main/assembly/scripts/stop.sh</exclude>
+ <exclude>src/main/resources/replicator.conf</exclude>
+ <exclude>src/test/resources/appendonly1.aof</exclude>
+ <exclude>src/test/resources/appendonly2.aof</exclude>
+ <exclude>src/test/resources/appendonly3.aof</exclude>
+ <exclude>src/test/resources/appendonly5.aof</exclude>
+ <exclude>src/test/resources/appendonly6.aof</exclude>
+ <exclude>src/test/resources/keystore/stunnel.conf</exclude>
+ <exclude>src/test/resources/low-comp-120k.txt</exclude>
+ <exclude>src/test/resources/zoo.cfg</exclude>
+ </excludes>
+ </configuration>
+ </plugin>
+ <plugin>
+ <artifactId>maven-checkstyle-plugin</artifactId>
+ <version>2.17</version>
+ <executions>
+ <execution>
+ <id>verify</id>
+ <phase>verify</phase>
+ <configuration>
+ <configLocation>style/rmq_checkstyle.xml</configLocation>
+ <encoding>UTF-8</encoding>
+ <consoleOutput>true</consoleOutput>
+ <failsOnError>true</failsOnError>
+ <includeTestSourceDirectory>false</includeTestSourceDirectory>
+ <includeTestResources>false</includeTestResources>
+ </configuration>
+ <goals>
+ <goal>check</goal>
+ </goals>
+ </execution>
+ </executions>
+ </plugin>
+
+ <plugin>
+ <artifactId>maven-jar-plugin</artifactId>
+ <version>2.4</version>
+ <configuration>
+ <archive>
+ <addMavenDescriptor>false</addMavenDescriptor>
+ <manifest>
+ <addClasspath>true</addClasspath>
+ <classpathPrefix>lib/</classpathPrefix>
+ </manifest>
+ <manifestEntries>
+ <Automatic-Module-Name>org.apache.rocketmq.redis.replicator</Automatic-Module-Name>
+ </manifestEntries>
+ </archive>
+ <excludes>
+ <exclude>replicator.conf</exclude>
+ <exclude>logback.xml</exclude>
+ </excludes>
+ </configuration>
+ </plugin>
+ <plugin>
+ <artifactId>maven-assembly-plugin</artifactId>
+ <version>2.4</version>
+ <configuration>
+ <descriptors>
+ <descriptor>src/main/assembly/assembly.xml</descriptor>
+ </descriptors>
+ </configuration>
+ <executions>
+ <execution>
+ <id>make-assembly</id>
+ <phase>package</phase>
+ <goals>
+ <goal>single</goal>
+ </goals>
+ </execution>
+ </executions>
+ </plugin>
+ </plugins>
+ </build>
+</project>
diff --git a/rocketmq-redis/src/main/assembly/assembly.xml b/rocketmq-redis/src/main/assembly/assembly.xml
new file mode 100644
index 00000000..b280aa60
--- /dev/null
+++ b/rocketmq-redis/src/main/assembly/assembly.xml
@@ -0,0 +1,61 @@
+<!--
+ ~ Licensed to the Apache Software Foundation (ASF) under one or more
+ ~ contributor license agreements. See the NOTICE file distributed with
+ ~ this work for additional information regarding copyright ownership.
+ ~ The ASF licenses this file to You under the Apache License, Version 2.0
+ ~ (the "License"); you may not use this file except in compliance with
+ ~ the License. You may obtain a copy of the License at
+ ~
+ ~ http://www.apache.org/licenses/LICENSE-2.0
+ ~
+ ~ Unless required by applicable law or agreed to in writing, software
+ ~ distributed under the License is distributed on an "AS IS" BASIS,
+ ~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ ~ See the License for the specific language governing permissions and
+ ~ limitations under the License.
+ -->
+
+<assembly
+ xmlns="http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.0"
+ xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
+ xsi:schemaLocation="http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.0 http://maven.apache.org/xsd/assembly-1.1.0.xsd">
+ <id>pack</id>
+ <formats>
+ <format>tar.gz</format>
+ <format>dir</format>
+ </formats>
+ <includeBaseDirectory>false</includeBaseDirectory>
+ <dependencySets>
+ <dependencySet>
+ <useProjectArtifact>true</useProjectArtifact>
+ <outputDirectory>lib</outputDirectory>
+ </dependencySet>
+ </dependencySets>
+ <fileSets>
+ <fileSet>
+ <directory>src/main/assembly/scripts</directory>
+ <outputDirectory>bin</outputDirectory>
+ <fileMode>0755</fileMode>
+ </fileSet>
+ <fileSet>
+ <directory>target/classes</directory>
+ <outputDirectory>conf</outputDirectory>
+ <fileMode>0755</fileMode>
+ <includes>
+ <include>*.conf</include>
+ <include>logback.xml</include>
+ </includes>
+ </fileSet>
+ </fileSets>
+
+ <files>
+ <file>
+ <source>LICENSE-BIN</source>
+ <destName>LICENSE</destName>
+ </file>
+ <file>
+ <source>NOTICE-BIN</source>
+ <destName>NOTICE</destName>
+ </file>
+ </files>
+</assembly>
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/assembly/scripts/start.sh b/rocketmq-redis/src/main/assembly/scripts/start.sh
new file mode 100644
index 00000000..780515bc
--- /dev/null
+++ b/rocketmq-redis/src/main/assembly/scripts/start.sh
@@ -0,0 +1,23 @@
+#!/usr/bin/env bash
+
+binPath=$(cd "$(dirname "$0")"; pwd);
+cd $binPath
+cd ..
+parentPath=`pwd`
+libPath=$parentPath/lib/
+
+
+function exportClassPath(){
+ jarFileList=`find "$libPath" -name *.jar |awk -F'/' '{print $(NF)}' 2>>/dev/null`
+ CLASSPATH=".:$binPath";
+ for jarItem in $jarFileList
+ do
+ CLASSPATH="$CLASSPATH:$libPath$jarItem"
+ done
+ CLASSPATH=$CLASSPATH:./conf
+ export CLASSPATH
+}
+ulimit -n 65535
+exportClassPath
+
+java -server -Xms512m -Xmx512m -Xss2m -XX:NewRatio=2 -XX:+UseGCOverheadLimit -XX:-UseParallelGC -XX:ParallelGCThreads=24 org.apache.rocketmq.redis.replicator.RocketMQRedisReplicator
diff --git a/rocketmq-redis/src/main/assembly/scripts/stop.sh b/rocketmq-redis/src/main/assembly/scripts/stop.sh
new file mode 100644
index 00000000..a01e8304
--- /dev/null
+++ b/rocketmq-redis/src/main/assembly/scripts/stop.sh
@@ -0,0 +1,18 @@
+#!/bin/bash
+
+PROGRAM_NAME="org.apache.rocketmq.redis.replicator.RocketMQRedisReplicator"
+PIDS=`ps -ef | grep $PROGRAM_NAME | grep -v "grep" | awk '{print $2}'`
+
+if [ -z $PIDS ]; then
+ echo "No this process."
+else
+ echo "Find process is $PIDS."
+fi
+
+#####kill####
+echo -e "Stopping the $PROGRAM_NAME...\c"
+for PID in $PIDS ; do
+ kill $PID
+done
+
+echo "SUCCESS!"
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/AbstractReplicator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/AbstractReplicator.java
new file mode 100644
index 00000000..a5f4f49a
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/AbstractReplicator.java
@@ -0,0 +1,296 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.IOException;
+import java.util.Map;
+import java.util.concurrent.ConcurrentHashMap;
+import java.util.concurrent.atomic.AtomicReference;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandName;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.AppendParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.BRPopLPushParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.BitOpParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.DecrByParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.DecrParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.DelParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.EvalParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ExecParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ExpireAtParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ExpireParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.FlushAllParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.FlushDBParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.GeoAddParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.GetSetParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.HDelParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.HIncrByParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.HMSetParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.HSetNxParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.HSetParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.IncrByParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.IncrParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.LInsertParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.LPushParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.LPushXParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.LRemParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.MSetNxParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.MultiParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.PExpireAtParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.PExpireParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.PFAddParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.PFCountParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.PFMergeParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.PSetExParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.PersistParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.PingParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.PublishParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.RPopLPushParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.RPushParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.RPushXParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.RenameNxParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.RenameParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.RestoreParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SAddParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SDiffStoreParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SInterStoreParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SMoveParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SRemParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SUnionStoreParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ScriptParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SelectParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SetBitParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SetExParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SetNxParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SortParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SwapDBParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.UnLinkParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ZAddParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ZIncrByParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ZInterStoreParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ZRemParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ZUnionStoreParser;
+import org.apache.rocketmq.redis.replicator.event.Event;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.RdbVisitor;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.AuxField;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.module.ModuleKey;
+import org.apache.rocketmq.redis.replicator.rdb.module.ModuleParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.BitFieldParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.LPopParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.LSetParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.LTrimParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.MSetParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.MoveParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.RPopParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SetParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.SetRangeParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ZRemRangeByLexParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ZRemRangeByRankParser;
+import org.apache.rocketmq.redis.replicator.cmd.parser.ZRemRangeByScoreParser;
+import org.apache.rocketmq.redis.replicator.event.PostFullSyncEvent;
+import org.apache.rocketmq.redis.replicator.event.PreFullSyncEvent;
+import org.apache.rocketmq.redis.replicator.rdb.DefaultRdbVisitor;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.Module;
+
+import static org.apache.rocketmq.redis.replicator.Status.CONNECTED;
+import static org.apache.rocketmq.redis.replicator.Status.DISCONNECTED;
+import static org.apache.rocketmq.redis.replicator.Status.DISCONNECTING;
+
+public abstract class AbstractReplicator extends AbstractReplicatorListener implements Replicator {
+ protected Configuration configuration;
+ protected volatile RedisInputStream inputStream;
+ protected RdbVisitor rdbVisitor = new DefaultRdbVisitor(this);
+ protected final AtomicReference<Status> connected = new AtomicReference<>(DISCONNECTED);
+ protected final Map<ModuleKey, ModuleParser<? extends Module>> modules = new ConcurrentHashMap<>();
+ protected final Map<CommandName, CommandParser<? extends Command>> commands = new ConcurrentHashMap<>();
+
+ @Override
+ public CommandParser<? extends Command> getCommandParser(CommandName command) {
+ return commands.get(command);
+ }
+
+ @Override
+ public <T extends Command> void addCommandParser(CommandName command, CommandParser<T> parser) {
+ commands.put(command, parser);
+ }
+
+ @Override
+ public CommandParser<? extends Command> removeCommandParser(CommandName command) {
+ return commands.remove(command);
+ }
+
+ @Override
+ public ModuleParser<? extends Module> getModuleParser(String moduleName, int moduleVersion) {
+ return modules.get(ModuleKey.key(moduleName, moduleVersion));
+ }
+
+ @Override
+ public <T extends Module> void addModuleParser(String moduleName, int moduleVersion, ModuleParser<T> parser) {
+ modules.put(ModuleKey.key(moduleName, moduleVersion), parser);
+ }
+
+ @Override
+ public ModuleParser<? extends Module> removeModuleParser(String moduleName, int moduleVersion) {
+ return modules.remove(ModuleKey.key(moduleName, moduleVersion));
+ }
+
+ public void submitEvent(Event event) {
+ try {
+ if (event instanceof KeyValuePair<?>) {
+ doRdbListener(this, (KeyValuePair<?>) event);
+ } else if (event instanceof Command) {
+ doCommandListener(this, (Command) event);
+ } else if (event instanceof PreFullSyncEvent) {
+ doPreFullSync(this);
+ } else if (event instanceof PostFullSyncEvent) {
+ doPostFullSync(this, ((PostFullSyncEvent) event).getChecksum());
+ } else if (event instanceof AuxField) {
+ doAuxFieldListener(this, (AuxField) event);
+ }
+ } catch (UncheckedIOException e) {
+ throw e;
+ //ignore UncheckedIOException so that to propagate to caller.
+ } catch (Throwable e) {
+ doExceptionListener(this, e, event);
+ }
+ }
+
+ @Override
+ public boolean verbose() {
+ return configuration != null && configuration.isVerbose();
+ }
+
+ @Override
+ public Status getStatus() {
+ return connected.get();
+ }
+
+ @Override
+ public Configuration getConfiguration() {
+ return configuration;
+ }
+
+ @Override
+ public void setRdbVisitor(RdbVisitor rdbVisitor) {
+ this.rdbVisitor = rdbVisitor;
+ }
+
+ @Override
+ public RdbVisitor getRdbVisitor() {
+ return this.rdbVisitor;
+ }
+
+ @Override
+ public void builtInCommandParserRegister() {
+ addCommandParser(CommandName.name("PING"), new PingParser());
+ addCommandParser(CommandName.name("APPEND"), new AppendParser());
+ addCommandParser(CommandName.name("SET"), new SetParser());
+ addCommandParser(CommandName.name("SETEX"), new SetExParser());
+ addCommandParser(CommandName.name("MSET"), new MSetParser());
+ addCommandParser(CommandName.name("DEL"), new DelParser());
+ addCommandParser(CommandName.name("SADD"), new SAddParser());
+ addCommandParser(CommandName.name("HMSET"), new HMSetParser());
+ addCommandParser(CommandName.name("HSET"), new HSetParser());
+ addCommandParser(CommandName.name("LSET"), new LSetParser());
+ addCommandParser(CommandName.name("EXPIRE"), new ExpireParser());
+ addCommandParser(CommandName.name("EXPIREAT"), new ExpireAtParser());
+ addCommandParser(CommandName.name("GETSET"), new GetSetParser());
+ addCommandParser(CommandName.name("HSETNX"), new HSetNxParser());
+ addCommandParser(CommandName.name("MSETNX"), new MSetNxParser());
+ addCommandParser(CommandName.name("PSETEX"), new PSetExParser());
+ addCommandParser(CommandName.name("SETNX"), new SetNxParser());
+ addCommandParser(CommandName.name("SETRANGE"), new SetRangeParser());
+ addCommandParser(CommandName.name("HDEL"), new HDelParser());
+ addCommandParser(CommandName.name("LPOP"), new LPopParser());
+ addCommandParser(CommandName.name("LPUSH"), new LPushParser());
+ addCommandParser(CommandName.name("LPUSHX"), new LPushXParser());
+ addCommandParser(CommandName.name("LRem"), new LRemParser());
+ addCommandParser(CommandName.name("RPOP"), new RPopParser());
+ addCommandParser(CommandName.name("RPUSH"), new RPushParser());
+ addCommandParser(CommandName.name("RPUSHX"), new RPushXParser());
+ addCommandParser(CommandName.name("ZREM"), new ZRemParser());
+ addCommandParser(CommandName.name("RENAME"), new RenameParser());
+ addCommandParser(CommandName.name("INCR"), new IncrParser());
+ addCommandParser(CommandName.name("DECR"), new DecrParser());
+ addCommandParser(CommandName.name("INCRBY"), new IncrByParser());
+ addCommandParser(CommandName.name("DECRBY"), new DecrByParser());
+ addCommandParser(CommandName.name("PERSIST"), new PersistParser());
+ addCommandParser(CommandName.name("SELECT"), new SelectParser());
+ addCommandParser(CommandName.name("FLUSHALL"), new FlushAllParser());
+ addCommandParser(CommandName.name("FLUSHDB"), new FlushDBParser());
+ addCommandParser(CommandName.name("HINCRBY"), new HIncrByParser());
+ addCommandParser(CommandName.name("ZINCRBY"), new ZIncrByParser());
+ addCommandParser(CommandName.name("MOVE"), new MoveParser());
+ addCommandParser(CommandName.name("SMOVE"), new SMoveParser());
+ addCommandParser(CommandName.name("PFADD"), new PFAddParser());
+ addCommandParser(CommandName.name("PFCOUNT"), new PFCountParser());
+ addCommandParser(CommandName.name("PFMERGE"), new PFMergeParser());
+ addCommandParser(CommandName.name("SDIFFSTORE"), new SDiffStoreParser());
+ addCommandParser(CommandName.name("SINTERSTORE"), new SInterStoreParser());
+ addCommandParser(CommandName.name("SUNIONSTORE"), new SUnionStoreParser());
+ addCommandParser(CommandName.name("ZADD"), new ZAddParser());
+ addCommandParser(CommandName.name("ZINTERSTORE"), new ZInterStoreParser());
+ addCommandParser(CommandName.name("ZUNIONSTORE"), new ZUnionStoreParser());
+ addCommandParser(CommandName.name("BRPOPLPUSH"), new BRPopLPushParser());
+ addCommandParser(CommandName.name("LINSERT"), new LInsertParser());
+ addCommandParser(CommandName.name("RENAMENX"), new RenameNxParser());
+ addCommandParser(CommandName.name("RESTORE"), new RestoreParser());
+ addCommandParser(CommandName.name("PEXPIRE"), new PExpireParser());
+ addCommandParser(CommandName.name("PEXPIREAT"), new PExpireAtParser());
+ addCommandParser(CommandName.name("GEOADD"), new GeoAddParser());
+ addCommandParser(CommandName.name("EVAL"), new EvalParser());
+ addCommandParser(CommandName.name("SCRIPT"), new ScriptParser());
+ addCommandParser(CommandName.name("PUBLISH"), new PublishParser());
+ addCommandParser(CommandName.name("BITOP"), new BitOpParser());
+ addCommandParser(CommandName.name("BITFIELD"), new BitFieldParser());
+ addCommandParser(CommandName.name("SETBIT"), new SetBitParser());
+ addCommandParser(CommandName.name("SREM"), new SRemParser());
+ addCommandParser(CommandName.name("UNLINK"), new UnLinkParser());
+ addCommandParser(CommandName.name("SWAPDB"), new SwapDBParser());
+ addCommandParser(CommandName.name("MULTI"), new MultiParser());
+ addCommandParser(CommandName.name("EXEC"), new ExecParser());
+ addCommandParser(CommandName.name("ZREMRANGEBYSCORE"), new ZRemRangeByScoreParser());
+ addCommandParser(CommandName.name("ZREMRANGEBYRANK"), new ZRemRangeByRankParser());
+ addCommandParser(CommandName.name("ZREMRANGEBYLEX"), new ZRemRangeByLexParser());
+ addCommandParser(CommandName.name("LTRIM"), new LTrimParser());
+ addCommandParser(CommandName.name("SORT"), new SortParser());
+ addCommandParser(CommandName.name("RPOPLPUSH"), new RPopLPushParser());
+ }
+
+ @Override
+ public void close() throws IOException {
+ this.connected.compareAndSet(CONNECTED, DISCONNECTING);
+ }
+
+ protected void doClose() throws IOException {
+ this.connected.compareAndSet(CONNECTED, DISCONNECTING);
+ try {
+ if (inputStream != null) {
+ this.inputStream.setRawByteListeners(null);
+ inputStream.close();
+ }
+ } catch (IOException ignore) {
+ /*NOP*/
+ } finally {
+ this.connected.set(DISCONNECTED);
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/AbstractReplicatorListener.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/AbstractReplicatorListener.java
new file mode 100644
index 00000000..a16f2947
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/AbstractReplicatorListener.java
@@ -0,0 +1,142 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.util.List;
+import java.util.concurrent.CopyOnWriteArrayList;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandListener;
+import org.apache.rocketmq.redis.replicator.event.Event;
+import org.apache.rocketmq.redis.replicator.io.RawByteListener;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.AuxField;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.RdbListener;
+
+public class AbstractReplicatorListener implements ReplicatorListener {
+ protected final List<RdbListener> rdbListeners = new CopyOnWriteArrayList<>();
+ protected final List<CloseListener> closeListeners = new CopyOnWriteArrayList<>();
+ protected final List<CommandListener> commandListeners = new CopyOnWriteArrayList<>();
+ protected final List<RawByteListener> rawByteListeners = new CopyOnWriteArrayList<>();
+ protected final List<ExceptionListener> exceptionListeners = new CopyOnWriteArrayList<>();
+
+ @Override
+ public boolean addCommandListener(CommandListener listener) {
+ return commandListeners.add(listener);
+ }
+
+ @Override
+ public boolean removeCommandListener(CommandListener listener) {
+ return commandListeners.remove(listener);
+ }
+
+ @Override
+ public boolean addRdbListener(RdbListener listener) {
+ return rdbListeners.add(listener);
+ }
+
+ @Override
+ public boolean removeRdbListener(RdbListener listener) {
+ return rdbListeners.remove(listener);
+ }
+
+ @Override
+ public boolean addRawByteListener(RawByteListener listener) {
+ return this.rawByteListeners.add(listener);
+ }
+
+ @Override
+ public boolean removeRawByteListener(RawByteListener listener) {
+ return this.rawByteListeners.remove(listener);
+ }
+
+ @Override
+ public boolean addCloseListener(CloseListener listener) {
+ return closeListeners.add(listener);
+ }
+
+ @Override
+ public boolean removeCloseListener(CloseListener listener) {
+ return closeListeners.remove(listener);
+ }
+
+ @Override
+ public boolean addExceptionListener(ExceptionListener listener) {
+ return exceptionListeners.add(listener);
+ }
+
+ @Override
+ public boolean removeExceptionListener(ExceptionListener listener) {
+ return exceptionListeners.remove(listener);
+ }
+
+ protected void doCommandListener(Replicator replicator, Command command) {
+ if (commandListeners.isEmpty())
+ return;
+ for (CommandListener listener : commandListeners) {
+ listener.handle(replicator, command);
+ }
+ }
+
+ protected void doRdbListener(Replicator replicator, KeyValuePair<?> kv) {
+ if (rdbListeners.isEmpty())
+ return;
+ for (RdbListener listener : rdbListeners) {
+ listener.handle(replicator, kv);
+ }
+ }
+
+ protected void doAuxFieldListener(Replicator replicator, AuxField auxField) {
+ if (rdbListeners.isEmpty())
+ return;
+ for (RdbListener listener : rdbListeners) {
+ listener.auxField(replicator, auxField);
+ }
+ }
+
+ protected void doPreFullSync(Replicator replicator) {
+ if (rdbListeners.isEmpty())
+ return;
+ for (RdbListener listener : rdbListeners) {
+ listener.preFullSync(replicator);
+ }
+ }
+
+ protected void doPostFullSync(Replicator replicator, final long checksum) {
+ if (rdbListeners.isEmpty())
+ return;
+ for (RdbListener listener : rdbListeners) {
+ listener.postFullSync(replicator, checksum);
+ }
+ }
+
+ protected void doCloseListener(Replicator replicator) {
+ if (closeListeners.isEmpty())
+ return;
+ for (CloseListener listener : closeListeners) {
+ listener.handle(replicator);
+ }
+ }
+
+ protected void doExceptionListener(Replicator replicator, Throwable throwable, Event event) {
+ if (exceptionListeners.isEmpty())
+ return;
+ for (ExceptionListener listener : exceptionListeners) {
+ listener.handle(replicator, throwable, event);
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/CloseListener.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/CloseListener.java
new file mode 100644
index 00000000..02508d22
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/CloseListener.java
@@ -0,0 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+public interface CloseListener {
+ void handle(Replicator replicator);
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/Configuration.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/Configuration.java
new file mode 100644
index 00000000..d7f201f3
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/Configuration.java
@@ -0,0 +1,455 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.util.Map;
+import java.util.concurrent.atomic.AtomicLong;
+import javax.net.ssl.HostnameVerifier;
+import javax.net.ssl.SSLParameters;
+import javax.net.ssl.SSLSocketFactory;
+
+public class Configuration {
+
+ private Configuration() {
+ }
+
+ /**
+ * factory
+ *
+ * @return Configuration
+ */
+ public static Configuration defaultSetting() {
+ return new Configuration();
+ }
+
+ /**
+ * socket connection timeout
+ */
+ private int connectionTimeout = 30000;
+
+ /**
+ * socket input stream read timeout
+ */
+ private int readTimeout = 30000;
+
+ /**
+ * socket receive buffer size
+ */
+ private int receiveBufferSize = 0;
+
+ /**
+ * socket send buffer size
+ */
+ private int sendBufferSize = 0;
+
+ /**
+ * connection retry times. if retries <= 0 then always retry
+ */
+ private int retries = 5;
+
+ /**
+ * retry time interval
+ */
+ private int retryTimeInterval = 1000;
+
+ /**
+ * redis input stream buffer size
+ */
+ private int bufferSize = 8 * 1024;
+
+ /**
+ * auth password
+ */
+ private String authPassword = null;
+
+ /**
+ * discard rdb event
+ */
+ private boolean discardRdbEvent = false;
+
+ /**
+ * async buffer size
+ */
+ private int asyncCachedBytes = 512 * 1024;
+
+ /**
+ * rate limit (unit : bytes/second)
+ */
+ private int rateLimit = 0;
+
+ /**
+ * trace event log
+ */
+ private boolean verbose = false;
+
+ /**
+ * used in psync heartbeat
+ */
+ private int heartBeatPeriod = 1000;
+
+ /**
+ * use default exception handler
+ */
+ private boolean useDefaultExceptionListener = true;
+
+ /**
+ * open ssl connection
+ */
+ private boolean ssl = false;
+
+ /**
+ * ssl socket factory
+ */
+ private SSLSocketFactory sslSocketFactory = (SSLSocketFactory) SSLSocketFactory.getDefault();
+
+ /**
+ * ssl parameters
+ */
+ private SSLParameters sslParameters;
+
+ /**
+ * hostname verifier
+ */
+ private HostnameVerifier hostnameVerifier;
+
+ /**
+ * psync master repl_id
+ */
+ private String replId = "?";
+
+ /**
+ * psync2 repl_stream_db
+ */
+ private int replStreamDB = -1;
+
+ /**
+ * psync offset
+ */
+ private final AtomicLong replOffset = new AtomicLong(-1);
+
+ public int getConnectionTimeout() {
+ return connectionTimeout;
+ }
+
+ public Configuration setConnectionTimeout(int connectionTimeout) {
+ this.connectionTimeout = connectionTimeout;
+ return this;
+ }
+
+ public int getReadTimeout() {
+ return readTimeout;
+ }
+
+ public Configuration setReadTimeout(int readTimeout) {
+ this.readTimeout = readTimeout;
+ return this;
+ }
+
+ public int getRetries() {
+ return retries;
+ }
+
+ public Configuration setRetries(int retries) {
+ this.retries = retries;
+ return this;
+ }
+
+ public String getAuthPassword() {
+ return authPassword;
+ }
+
+ public Configuration setAuthPassword(String authPassword) {
+ this.authPassword = authPassword;
+ return this;
+ }
+
+ public int getReceiveBufferSize() {
+ return receiveBufferSize;
+ }
+
+ public Configuration setReceiveBufferSize(int receiveBufferSize) {
+ this.receiveBufferSize = receiveBufferSize;
+ return this;
+ }
+
+ public int getSendBufferSize() {
+ return sendBufferSize;
+ }
+
+ public Configuration setSendBufferSize(int sendBufferSize) {
+ this.sendBufferSize = sendBufferSize;
+ return this;
+ }
+
+ public int getBufferSize() {
+ return bufferSize;
+ }
+
+ public Configuration setBufferSize(int bufferSize) {
+ this.bufferSize = bufferSize;
+ return this;
+ }
+
+ public boolean isDiscardRdbEvent() {
+ return discardRdbEvent;
+ }
+
+ public Configuration setDiscardRdbEvent(boolean discardRdbEvent) {
+ this.discardRdbEvent = discardRdbEvent;
+ return this;
+ }
+
+ public String getReplId() {
+ return replId;
+ }
+
+ public Configuration setReplId(String replId) {
+ this.replId = replId;
+ return this;
+ }
+
+ public int getReplStreamDB() {
+ return replStreamDB;
+ }
+
+ public Configuration setReplStreamDB(int replStreamDB) {
+ this.replStreamDB = replStreamDB;
+ return this;
+ }
+
+ public long getReplOffset() {
+ return replOffset.get();
+ }
+
+ public Configuration setReplOffset(long replOffset) {
+ this.replOffset.set(replOffset);
+ return this;
+ }
+
+ public Configuration addOffset(long offset) {
+ this.replOffset.addAndGet(offset);
+ return this;
+ }
+
+ public int getAsyncCachedBytes() {
+ return asyncCachedBytes;
+ }
+
+ public Configuration setAsyncCachedBytes(int asyncCachedBytes) {
+ this.asyncCachedBytes = asyncCachedBytes;
+ return this;
+ }
+
+ public int getRateLimit() {
+ return rateLimit;
+ }
+
+ public Configuration setRateLimit(int rateLimit) {
+ this.rateLimit = rateLimit;
+ return this;
+ }
+
+ public boolean isVerbose() {
+ return verbose;
+ }
+
+ public Configuration setVerbose(boolean verbose) {
+ this.verbose = verbose;
+ return this;
+ }
+
+ public int getHeartBeatPeriod() {
+ return heartBeatPeriod;
+ }
+
+ public Configuration setHeartBeatPeriod(int heartBeatPeriod) {
+ this.heartBeatPeriod = heartBeatPeriod;
+ return this;
+ }
+
+ public boolean isUseDefaultExceptionListener() {
+ return useDefaultExceptionListener;
+ }
+
+ public Configuration setUseDefaultExceptionListener(boolean useDefaultExceptionListener) {
+ this.useDefaultExceptionListener = useDefaultExceptionListener;
+ return this;
+ }
+
+ public int getRetryTimeInterval() {
+ return retryTimeInterval;
+ }
+
+ public Configuration setRetryTimeInterval(int retryTimeInterval) {
+ this.retryTimeInterval = retryTimeInterval;
+ return this;
+ }
+
+ public boolean isSsl() {
+ return ssl;
+ }
+
+ public Configuration setSsl(boolean ssl) {
+ this.ssl = ssl;
+ return this;
+ }
+
+ public SSLSocketFactory getSslSocketFactory() {
+ return sslSocketFactory;
+ }
+
+ public Configuration setSslSocketFactory(SSLSocketFactory sslSocketFactory) {
+ this.sslSocketFactory = sslSocketFactory;
+ return this;
+ }
+
+ public SSLParameters getSslParameters() {
+ return sslParameters;
+ }
+
+ public Configuration setSslParameters(SSLParameters sslParameters) {
+ this.sslParameters = sslParameters;
+ return this;
+ }
+
+ public HostnameVerifier getHostnameVerifier() {
+ return hostnameVerifier;
+ }
+
+ public Configuration setHostnameVerifier(HostnameVerifier hostnameVerifier) {
+ this.hostnameVerifier = hostnameVerifier;
+ return this;
+ }
+
+ public static Configuration valueOf(RedisURI uri) {
+ Configuration configuration = defaultSetting();
+ Map<String, String> parameters = uri.parameters;
+ if (parameters.containsKey("connectionTimeout")) {
+ configuration.setConnectionTimeout(getInt(parameters.get("connectionTimeout"), 30000));
+ }
+ if (parameters.containsKey("readTimeout")) {
+ configuration.setReadTimeout(getInt(parameters.get("readTimeout"), 30000));
+ }
+ if (parameters.containsKey("receiveBufferSize")) {
+ configuration.setReceiveBufferSize(getInt(parameters.get("receiveBufferSize"), 0));
+ }
+ if (parameters.containsKey("sendBufferSize")) {
+ configuration.setSendBufferSize(getInt(parameters.get("sendBufferSize"), 0));
+ }
+ if (parameters.containsKey("retries")) {
+ configuration.setRetries(getInt(parameters.get("retries"), 5));
+ }
+ if (parameters.containsKey("retryTimeInterval")) {
+ configuration.setRetryTimeInterval(getInt(parameters.get("retryTimeInterval"), 1000));
+ }
+ if (parameters.containsKey("bufferSize")) {
+ configuration.setBufferSize(getInt(parameters.get("bufferSize"), 8 * 1024));
+ }
+ if (parameters.containsKey("authPassword")) {
+ configuration.setAuthPassword(parameters.get("authPassword"));
+ }
+ if (parameters.containsKey("discardRdbEvent")) {
+ configuration.setDiscardRdbEvent(getBool(parameters.get("discardRdbEvent"), false));
+ }
+ if (parameters.containsKey("asyncCachedBytes")) {
+ configuration.setAsyncCachedBytes(getInt(parameters.get("asyncCachedBytes"), 512 * 1024));
+ }
+ if (parameters.containsKey("rateLimit")) {
+ configuration.setRateLimit(getInt(parameters.get("rateLimit"), 0));
+ }
+ if (parameters.containsKey("verbose")) {
+ configuration.setVerbose(getBool(parameters.get("verbose"), false));
+ }
+ if (parameters.containsKey("heartBeatPeriod")) {
+ configuration.setHeartBeatPeriod(getInt(parameters.get("heartBeatPeriod"), 1000));
+ }
+ if (parameters.containsKey("useDefaultExceptionListener")) {
+ configuration.setUseDefaultExceptionListener(getBool(parameters.get("useDefaultExceptionListener"), false));
+ }
+ if (parameters.containsKey("ssl")) {
+ configuration.setSsl(getBool(parameters.get("ssl"), false));
+ }
+ if (parameters.containsKey("replId")) {
+ configuration.setReplId(parameters.get("replId"));
+ }
+ if (parameters.containsKey("replStreamDB")) {
+ configuration.setReplStreamDB(getInt(parameters.get("replStreamDB"), -1));
+ }
+ if (parameters.containsKey("replOffset")) {
+ configuration.setReplOffset(getLong(parameters.get("replOffset"), -1L));
+ }
+ return configuration;
+ }
+
+ private static boolean getBool(String value, boolean defaultValue) {
+ if (value == null)
+ return defaultValue;
+ if (value.equals("false") || value.equals("no"))
+ return false;
+ if (value.equals("true") || value.equals("yes"))
+ return true;
+ return defaultValue;
+ }
+
+ private static int getInt(String value, int defaultValue) {
+ if (value == null)
+ return defaultValue;
+ try {
+ return Integer.parseInt(value);
+ } catch (NumberFormatException e) {
+ return defaultValue;
+ }
+ }
+
+ private static long getLong(String value, long defaultValue) {
+ if (value == null)
+ return defaultValue;
+ try {
+ return Long.parseLong(value);
+ } catch (NumberFormatException e) {
+ return defaultValue;
+ }
+ }
+
+ @Override
+ public String toString() {
+ return "Configuration{" +
+ "connectionTimeout=" + connectionTimeout +
+ ", readTimeout=" + readTimeout +
+ ", receiveBufferSize=" + receiveBufferSize +
+ ", sendBufferSize=" + sendBufferSize +
+ ", retries=" + retries +
+ ", retryTimeInterval=" + retryTimeInterval +
+ ", bufferSize=" + bufferSize +
+ ", authPassword='" + authPassword + '\'' +
+ ", discardRdbEvent=" + discardRdbEvent +
+ ", asyncCachedBytes=" + asyncCachedBytes +
+ ", rateLimit=" + rateLimit +
+ ", verbose=" + verbose +
+ ", heartBeatPeriod=" + heartBeatPeriod +
+ ", useDefaultExceptionListener=" + useDefaultExceptionListener +
+ ", ssl=" + ssl +
+ ", sslSocketFactory=" + sslSocketFactory +
+ ", sslParameters=" + sslParameters +
+ ", hostnameVerifier=" + hostnameVerifier +
+ ", replId='" + replId + '\'' +
+ ", replStreamDB=" + replStreamDB +
+ ", replOffset=" + replOffset +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/DefaultExceptionListener.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/DefaultExceptionListener.java
new file mode 100644
index 00000000..eaad0de0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/DefaultExceptionListener.java
@@ -0,0 +1,31 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import org.apache.rocketmq.redis.replicator.event.Event;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+public class DefaultExceptionListener implements ExceptionListener {
+ private static final Logger LOGGER = LoggerFactory.getLogger(DefaultExceptionListener.class);
+
+ @Override
+ public void handle(Replicator replicator, Throwable throwable, Event event) {
+ LOGGER.error("error on event [" + event + "]", throwable);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/ExceptionListener.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/ExceptionListener.java
new file mode 100644
index 00000000..66638fd6
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/ExceptionListener.java
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import org.apache.rocketmq.redis.replicator.event.Event;
+
+public interface ExceptionListener {
+ void handle(Replicator replicator, Throwable throwable, Event event);
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/FileType.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/FileType.java
new file mode 100644
index 00000000..ede7385d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/FileType.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+public enum FileType {
+ AOF, RDB, MIXED;
+
+ static FileType parse(String type) {
+ if (type == null) {
+ return null;
+ } else if (type.equalsIgnoreCase("aof")) {
+ return AOF;
+ } else if (type.equalsIgnoreCase("rdb")) {
+ return RDB;
+ } else if (type.equalsIgnoreCase("mix")) {
+ return MIXED;
+ } else if (type.equalsIgnoreCase("mixed")) {
+ return MIXED;
+ } else {
+ return null;
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisAofReplicator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisAofReplicator.java
new file mode 100644
index 00000000..6c1ff56f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisAofReplicator.java
@@ -0,0 +1,101 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.EOFException;
+import java.io.File;
+import java.io.FileInputStream;
+import java.io.FileNotFoundException;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.Objects;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandName;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.ReplyParser;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.util.Arrays;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+import static org.apache.rocketmq.redis.replicator.Status.CONNECTED;
+import static org.apache.rocketmq.redis.replicator.Status.DISCONNECTED;
+
+public class RedisAofReplicator extends AbstractReplicator {
+
+ protected static final Logger LOGGER = LoggerFactory.getLogger(RedisAofReplicator.class);
+ protected final ReplyParser replyParser;
+
+ public RedisAofReplicator(File file, Configuration configuration) throws FileNotFoundException {
+ this(new FileInputStream(file), configuration);
+ }
+
+ public RedisAofReplicator(InputStream in, Configuration configuration) {
+ Objects.requireNonNull(in);
+ Objects.requireNonNull(configuration);
+ this.configuration = configuration;
+ this.inputStream = new RedisInputStream(in, this.configuration.getBufferSize());
+ this.inputStream.setRawByteListeners(this.rawByteListeners);
+ this.replyParser = new ReplyParser(inputStream);
+ builtInCommandParserRegister();
+ if (configuration.isUseDefaultExceptionListener())
+ addExceptionListener(new DefaultExceptionListener());
+ }
+
+ @Override
+ public void open() throws IOException {
+ if (!this.connected.compareAndSet(DISCONNECTED, CONNECTED)) return;
+ try {
+ doOpen();
+ } catch (EOFException ignore) {
+ } catch (UncheckedIOException e) {
+ if (!(e.getCause() instanceof EOFException))
+ throw e.getCause();
+ } finally {
+ doClose();
+ doCloseListener(this);
+ }
+ }
+
+ protected void doOpen() throws IOException {
+ while (getStatus() == CONNECTED) {
+ Object obj = replyParser.parse();
+
+ if (obj instanceof Object[]) {
+ if (configuration.isVerbose())
+ LOGGER.info(Arrays.deepToString((Object[]) obj));
+ Object[] command = (Object[]) obj;
+ CommandName cmdName = CommandName.name(new String((byte[]) command[0], UTF_8));
+ final CommandParser<? extends Command> operations;
+ if ((operations = commands.get(cmdName)) == null) {
+ if (LOGGER.isWarnEnabled()) {
+ LOGGER.warn("command [" + cmdName + "] not register. raw command:[" + Arrays.deepToString(command) + "]");
+ }
+ continue;
+ }
+ Command parsedCommand = operations.parse(command);
+ this.submitEvent(parsedCommand);
+ } else {
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("redis reply:" + obj);
+ }
+ }
+ }
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisConstants.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisConstants.java
new file mode 100644
index 00000000..53de735c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisConstants.java
@@ -0,0 +1,112 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+public class RedisConstants {
+
+ private RedisConstants() {
+ }
+
+ public static final char[] MODULE_SET = new char[] {
+ 'A', 'B', 'C', 'D', 'E', 'F', 'G', 'H', 'I', 'J', 'K', 'L', 'M', 'N', 'O', 'P', 'Q', 'R', 'S', 'T', 'U', 'V', 'W', 'X', 'Y', 'Z',
+ 'a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j', 'k', 'l', 'm', 'n', 'o', 'p', 'q', 'r', 's', 't', 'u', 'v', 'w', 'x', 'y', 'z',
+ '0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '-', '_'
+ };
+
+ /**
+ * len type
+ */
+ public static final int RDB_ENCVAL = 3;
+ public static final int RDB_6BITLEN = 0;
+ public static final int RDB_14BITLEN = 1;
+ public static final int RDB_32BITLEN = 0x80;
+ public static final int RDB_64BITLEN = 0x81;
+
+ /**
+ * string type
+ */
+ public static final int RDB_LOAD_NONE = 0;
+ public static final int RDB_LOAD_ENC = 1 << 0;
+ public static final int RDB_LOAD_PLAIN = 1 << 1;
+
+ /**
+ * string encoding
+ */
+ public static final int RDB_ENC_INT8 = 0;
+ public static final int RDB_ENC_INT16 = 1;
+ public static final int RDB_ENC_INT32 = 2;
+ public static final int RDB_ENC_LZF = 3;
+
+ /**
+ * rdb protocol
+ */
+ public static final int RDB_OPCODE_AUX = 0xfa; /*250*/
+ public static final int RDB_OPCODE_RESIZEDB = 0xfb; /*251*/
+ public static final int RDB_OPCODE_EXPIRETIME_MS = 0xfc;/* 252 */
+ public static final int RDB_OPCODE_EXPIRETIME = 0xfd; /* 253 */
+ public static final int RDB_OPCODE_SELECTDB = 0xfe; /* 254 */
+ public static final int RDB_OPCODE_EOF = 0xff; /* 255 */
+
+ /**
+ * rdb object encoding
+ */
+ public static final int RDB_TYPE_STRING = 0;
+ public static final int RDB_TYPE_LIST = 1;
+ public static final int RDB_TYPE_SET = 2;
+ public static final int RDB_TYPE_ZSET = 3;
+ public static final int RDB_TYPE_HASH = 4;
+ public static final int RDB_TYPE_ZSET_2 = 5;
+ public static final int RDB_TYPE_MODULE = 6;
+ public static final int RDB_TYPE_MODULE_2 = 7;
+ public static final int RDB_TYPE_HASH_ZIPMAP = 9;
+ public static final int RDB_TYPE_LIST_ZIPLIST = 10;
+ public static final int RDB_TYPE_SET_INTSET = 11;
+ public static final int RDB_TYPE_ZSET_ZIPLIST = 12;
+ public static final int RDB_TYPE_HASH_ZIPLIST = 13;
+ public static final int RDB_TYPE_LIST_QUICKLIST = 14;
+
+ /**
+ * Module serialized values sub opcodes
+ */
+ public static final int RDB_MODULE_OPCODE_EOF = 0; /* End of module value. */
+ // this variable only used in rdb check tool. useless for now.
+ public static final int RDB_MODULE_OPCODE_SINT = 1; /* Signed integer. */
+ public static final int RDB_MODULE_OPCODE_UINT = 2; /* Unsigned integer. */
+ public static final int RDB_MODULE_OPCODE_FLOAT = 3; /* Float. */
+ public static final int RDB_MODULE_OPCODE_DOUBLE = 4; /* Double. */
+ public static final int RDB_MODULE_OPCODE_STRING = 5; /* String. */
+
+ /**
+ * zip entry
+ */
+ public static final int ZIP_INT_8B = 0xfe; /*11111110*/
+ public static final int ZIP_INT_16B = 0xc0 | 0 << 4; /* 11000000*/
+ public static final int ZIP_INT_24B = 0xc0 | 3 << 4; /* 11110000*/
+ public static final int ZIP_INT_32B = 0xc0 | 1 << 4; /* 11010000*/
+ public static final int ZIP_INT_64B = 0xc0 | 2 << 4; /* 11100000*/
+
+ /**
+ * transfer protocol
+ */
+ public static final byte DOLLAR = '$';
+ public static final byte STAR = '*';
+ public static final byte PLUS = '+';
+ public static final byte MINUS = '-';
+ public static final byte COLON = ':';
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisMixReplicator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisMixReplicator.java
new file mode 100644
index 00000000..30dd5afd
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisMixReplicator.java
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.EOFException;
+import java.io.File;
+import java.io.FileInputStream;
+import java.io.FileNotFoundException;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.Objects;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandName;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.io.PeekableInputStream;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.RdbParser;
+import org.apache.rocketmq.redis.replicator.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.ReplyParser;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+import static org.apache.rocketmq.redis.replicator.Status.CONNECTED;
+import static org.apache.rocketmq.redis.replicator.Status.DISCONNECTED;
+
+public class RedisMixReplicator extends AbstractReplicator {
+ protected static final Logger LOGGER = LoggerFactory.getLogger(RedisAofReplicator.class);
+ protected final ReplyParser replyParser;
+ protected final PeekableInputStream peekable;
+
+ public RedisMixReplicator(File file, Configuration configuration) throws FileNotFoundException {
+ this(new FileInputStream(file), configuration);
+ }
+
+ public RedisMixReplicator(InputStream in, Configuration configuration) {
+ Objects.requireNonNull(in);
+ Objects.requireNonNull(configuration);
+ this.configuration = configuration;
+ if (in instanceof PeekableInputStream) {
+ this.peekable = (PeekableInputStream) in;
+ } else {
+ in = this.peekable = new PeekableInputStream(in);
+ }
+ this.inputStream = new RedisInputStream(in, this.configuration.getBufferSize());
+ this.inputStream.setRawByteListeners(this.rawByteListeners);
+ this.replyParser = new ReplyParser(inputStream);
+ builtInCommandParserRegister();
+ if (configuration.isUseDefaultExceptionListener())
+ addExceptionListener(new DefaultExceptionListener());
+ }
+
+ @Override
+ public void open() throws IOException {
+ if (!this.connected.compareAndSet(DISCONNECTED, CONNECTED)) return;
+ try {
+ doOpen();
+ } catch (EOFException ignore) {
+ } catch (UncheckedIOException e) {
+ if (!(e.getCause() instanceof EOFException))
+ throw e.getCause();
+ } finally {
+ doClose();
+ doCloseListener(this);
+ }
+ }
+
+ protected void doOpen() throws IOException {
+ if (peekable.peek() == 'R') {
+ RdbParser parser = new RdbParser(inputStream, this);
+ parser.parse();
+ }
+ while (getStatus() == CONNECTED) {
+ Object obj = replyParser.parse();
+ if (obj instanceof Object[]) {
+ if (configuration.isVerbose())
+ LOGGER.info(Arrays.deepToString((Object[]) obj));
+ Object[] command = (Object[]) obj;
+ CommandName cmdName = CommandName.name(new String((byte[]) command[0], UTF_8));
+ final CommandParser<? extends Command> operations;
+ if ((operations = commands.get(cmdName)) == null) {
+ if (LOGGER.isWarnEnabled()) {
+ LOGGER.warn("command [" + cmdName + "] not register. raw command:[" + Arrays.deepToString(command) + "]");
+ }
+ continue;
+ }
+ Command parsedCommand = operations.parse(command);
+ this.submitEvent(parsedCommand);
+ } else {
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("redis reply:" + obj);
+ }
+ }
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisRdbReplicator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisRdbReplicator.java
new file mode 100644
index 00000000..c9bd7311
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisRdbReplicator.java
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.EOFException;
+import java.io.File;
+import java.io.FileInputStream;
+import java.io.FileNotFoundException;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.Objects;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.RdbParser;
+
+import static org.apache.rocketmq.redis.replicator.Status.CONNECTED;
+import static org.apache.rocketmq.redis.replicator.Status.DISCONNECTED;
+
+public class RedisRdbReplicator extends AbstractReplicator {
+
+ public RedisRdbReplicator(File file, Configuration configuration) throws FileNotFoundException {
+ this(new FileInputStream(file), configuration);
+ }
+
+ public RedisRdbReplicator(InputStream in, Configuration configuration) {
+ Objects.requireNonNull(in);
+ Objects.requireNonNull(configuration);
+ this.configuration = configuration;
+ this.inputStream = new RedisInputStream(in, this.configuration.getBufferSize());
+ this.inputStream.setRawByteListeners(this.rawByteListeners);
+ if (configuration.isUseDefaultExceptionListener())
+ addExceptionListener(new DefaultExceptionListener());
+ }
+
+ @Override
+ public void open() throws IOException {
+ if (!this.connected.compareAndSet(DISCONNECTED, CONNECTED)) return;
+ try {
+ doOpen();
+ } catch (EOFException ignore) {
+ } catch (UncheckedIOException e) {
+ if (!(e.getCause() instanceof EOFException))
+ throw e.getCause();
+ } finally {
+ doClose();
+ doCloseListener(this);
+ }
+ }
+
+ protected void doOpen() throws IOException {
+ RdbParser parser = new RdbParser(inputStream, this);
+ parser.parse();
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisReplicator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisReplicator.java
new file mode 100644
index 00000000..3b0574e9
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisReplicator.java
@@ -0,0 +1,231 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.File;
+import java.io.FileNotFoundException;
+import java.io.IOException;
+import java.io.InputStream;
+import java.net.URISyntaxException;
+import java.util.Objects;
+import org.apache.rocketmq.redis.replicator.rdb.RdbVisitor;
+import org.apache.rocketmq.redis.replicator.rdb.module.ModuleParser;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandListener;
+import org.apache.rocketmq.redis.replicator.cmd.CommandName;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.io.PeekableInputStream;
+import org.apache.rocketmq.redis.replicator.io.RawByteListener;
+import org.apache.rocketmq.redis.replicator.rdb.RdbListener;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.Module;
+
+public class RedisReplicator implements Replicator {
+ protected Replicator replicator;
+
+ public RedisReplicator(File file, FileType fileType, Configuration configuration) throws FileNotFoundException {
+ switch (fileType) {
+ case AOF:
+ this.replicator = new RedisAofReplicator(file, configuration);
+ break;
+ case RDB:
+ this.replicator = new RedisRdbReplicator(file, configuration);
+ break;
+ case MIXED:
+ this.replicator = new RedisMixReplicator(file, configuration);
+ break;
+ default:
+ throw new UnsupportedOperationException(fileType.toString());
+ }
+ }
+
+ public RedisReplicator(InputStream in, FileType fileType, Configuration configuration) {
+ switch (fileType) {
+ case AOF:
+ this.replicator = new RedisAofReplicator(in, configuration);
+ break;
+ case RDB:
+ this.replicator = new RedisRdbReplicator(in, configuration);
+ break;
+ case MIXED:
+ this.replicator = new RedisMixReplicator(in, configuration);
+ break;
+ default:
+ throw new UnsupportedOperationException(fileType.toString());
+ }
+ }
+
+ public RedisReplicator(String host, int port, Configuration configuration) {
+ this.replicator = new RedisSocketReplicator(host, port, configuration);
+ }
+
+ public RedisReplicator(String uri) throws URISyntaxException, IOException {
+ Objects.requireNonNull(uri);
+ initialize(new RedisURI(uri));
+ }
+
+ public RedisReplicator(RedisURI uri) throws IOException {
+ initialize(uri);
+ }
+
+ private void initialize(RedisURI uri) throws IOException {
+ Objects.requireNonNull(uri);
+ Configuration configuration = Configuration.valueOf(uri);
+ if (uri.getFileType() != null) {
+ PeekableInputStream in = new PeekableInputStream(uri.toURL().openStream());
+ switch (uri.getFileType()) {
+ case AOF:
+ if (in.peek() == 'R') {
+ this.replicator = new RedisMixReplicator(in, configuration);
+ } else {
+ this.replicator = new RedisAofReplicator(in, configuration);
+ }
+ break;
+ case RDB:
+ this.replicator = new RedisRdbReplicator(in, configuration);
+ break;
+ case MIXED:
+ this.replicator = new RedisMixReplicator(in, configuration);
+ break;
+ default:
+ throw new UnsupportedOperationException(uri.getFileType().toString());
+ }
+ } else {
+ this.replicator = new RedisSocketReplicator(uri.getHost(), uri.getPort(), configuration);
+ }
+ }
+
+ @Override
+ public boolean addRdbListener(RdbListener listener) {
+ return replicator.addRdbListener(listener);
+ }
+
+ @Override
+ public boolean removeRdbListener(RdbListener listener) {
+ return replicator.removeRdbListener(listener);
+ }
+
+ @Override
+ public boolean addRawByteListener(RawByteListener listener) {
+ return replicator.addRawByteListener(listener);
+ }
+
+ @Override
+ public boolean removeRawByteListener(RawByteListener listener) {
+ return replicator.removeRawByteListener(listener);
+ }
+
+ @Override
+ public void builtInCommandParserRegister() {
+ replicator.builtInCommandParserRegister();
+ }
+
+ @Override
+ public CommandParser<? extends Command> getCommandParser(CommandName command) {
+ return replicator.getCommandParser(command);
+ }
+
+ @Override
+ public <T extends Command> void addCommandParser(CommandName command, CommandParser<T> parser) {
+ replicator.addCommandParser(command, parser);
+ }
+
+ @Override
+ public CommandParser<? extends Command> removeCommandParser(CommandName command) {
+ return replicator.removeCommandParser(command);
+ }
+
+ @Override
+ public ModuleParser<? extends Module> getModuleParser(String moduleName, int moduleVersion) {
+ return replicator.getModuleParser(moduleName, moduleVersion);
+ }
+
+ @Override
+ public <T extends Module> void addModuleParser(String moduleName, int moduleVersion, ModuleParser<T> parser) {
+ replicator.addModuleParser(moduleName, moduleVersion, parser);
+ }
+
+ @Override
+ public ModuleParser<? extends Module> removeModuleParser(String moduleName, int moduleVersion) {
+ return replicator.removeModuleParser(moduleName, moduleVersion);
+ }
+
+ @Override
+ public void setRdbVisitor(RdbVisitor rdbVisitor) {
+ replicator.setRdbVisitor(rdbVisitor);
+ }
+
+ @Override
+ public RdbVisitor getRdbVisitor() {
+ return replicator.getRdbVisitor();
+ }
+
+ @Override
+ public boolean addCommandListener(CommandListener listener) {
+ return replicator.addCommandListener(listener);
+ }
+
+ @Override
+ public boolean removeCommandListener(CommandListener listener) {
+ return replicator.removeCommandListener(listener);
+ }
+
+ @Override
+ public boolean addCloseListener(CloseListener listener) {
+ return replicator.addCloseListener(listener);
+ }
+
+ @Override
+ public boolean removeCloseListener(CloseListener listener) {
+ return replicator.removeCloseListener(listener);
+ }
+
+ @Override
+ public boolean addExceptionListener(ExceptionListener listener) {
+ return replicator.addExceptionListener(listener);
+ }
+
+ @Override
+ public boolean removeExceptionListener(ExceptionListener listener) {
+ return replicator.removeExceptionListener(listener);
+ }
+
+ @Override
+ public boolean verbose() {
+ return replicator.verbose();
+ }
+
+ @Override
+ public Status getStatus() {
+ return replicator.getStatus();
+ }
+
+ @Override
+ public Configuration getConfiguration() {
+ return replicator.getConfiguration();
+ }
+
+ @Override
+ public void open() throws IOException {
+ replicator.open();
+ }
+
+ @Override
+ public void close() throws IOException {
+ replicator.close();
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisSocketReplicator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisSocketReplicator.java
new file mode 100644
index 00000000..2e6d50a3
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisSocketReplicator.java
@@ -0,0 +1,447 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.IOException;
+import java.io.InputStream;
+import java.net.Socket;
+import java.util.Objects;
+import java.util.Timer;
+import java.util.TimerTask;
+import org.apache.rocketmq.redis.replicator.cmd.OffsetHandler;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.net.RedisSocketFactory;
+import org.apache.rocketmq.redis.replicator.cmd.BulkReplyHandler;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandName;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.ReplyParser;
+import org.apache.rocketmq.redis.replicator.io.AsyncBufferedInputStream;
+import org.apache.rocketmq.redis.replicator.io.RateLimitInputStream;
+import org.apache.rocketmq.redis.replicator.io.RedisOutputStream;
+import org.apache.rocketmq.redis.replicator.rdb.RdbParser;
+import org.apache.rocketmq.redis.replicator.util.Arrays;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.DOLLAR;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.STAR;
+import static org.apache.rocketmq.redis.replicator.Status.CONNECTED;
+import static org.apache.rocketmq.redis.replicator.Status.CONNECTING;
+import static org.apache.rocketmq.redis.replicator.Status.DISCONNECTED;
+import static org.apache.rocketmq.redis.replicator.Status.DISCONNECTING;
+
+public class RedisSocketReplicator extends AbstractReplicator {
+
+ protected static final Logger LOGGER = LoggerFactory.getLogger(RedisSocketReplicator.class);
+
+ protected final int port;
+ protected Timer heartbeat;
+ protected final String host;
+ protected volatile Socket socket;
+ protected volatile ReplyParser replyParser;
+ protected volatile RedisOutputStream outputStream;
+ protected final RedisSocketFactory socketFactory;
+
+ public RedisSocketReplicator(String host, int port, Configuration configuration) {
+ Objects.requireNonNull(host);
+ if (port <= 0 || port > 65535)
+ throw new IllegalArgumentException("illegal argument port: " + port);
+ Objects.requireNonNull(configuration);
+ this.host = host;
+ this.port = port;
+ this.configuration = configuration;
+ this.socketFactory = new RedisSocketFactory(configuration);
+ builtInCommandParserRegister();
+ if (configuration.isUseDefaultExceptionListener())
+ addExceptionListener(new DefaultExceptionListener());
+ }
+
+ /**
+ * PSYNC
+ *
+ * @throws IOException when read timeout or connect timeout
+ */
+ @Override
+ public void open() throws IOException {
+ try {
+ doOpen();
+ } finally {
+ doClose();
+ doCloseListener(this);
+ }
+ }
+
+ /**
+ * PSYNC
+ *
+ * @throws IOException when read timeout or connect timeout
+ */
+ protected void doOpen() throws IOException {
+ IOException exception = null;
+ for (int i = 0; i < configuration.getRetries() || configuration.getRetries() <= 0; i++) {
+ exception = null;
+ try {
+ establishConnection();
+ //reset retries
+ i = 0;
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("PSYNC " + configuration.getReplId() + " " + String.valueOf(configuration.getReplOffset()));
+ }
+ send("PSYNC".getBytes(), configuration.getReplId().getBytes(), String.valueOf(configuration.getReplOffset()).getBytes());
+ final String reply = new String((byte[]) reply(), UTF_8);
+
+ SyncMode syncMode = trySync(reply);
+ if (syncMode == SyncMode.PSYNC && getStatus() == CONNECTED) {
+ heartbeat();
+ } else if (syncMode == SyncMode.SYNC_LATER && getStatus() == CONNECTED) {
+ i = 0;
+ doClose();
+ try {
+ Thread.sleep(configuration.getRetryTimeInterval());
+ } catch (InterruptedException interrupt) {
+ Thread.currentThread().interrupt();
+ }
+ continue;
+ }
+ final long[] offset = new long[1];
+ while (getStatus() == CONNECTED) {
+ Object obj = replyParser.parse(new OffsetHandler() {
+ @Override
+ public void handle(long len) {
+ offset[0] = len;
+ }
+ });
+ //command
+ if (obj instanceof Object[]) {
+ if (configuration.isVerbose() && LOGGER.isDebugEnabled())
+ LOGGER.debug(Arrays.deepToString((Object[]) obj));
+ Object[] command = (Object[]) obj;
+ CommandName cmdName = CommandName.name(new String((byte[]) command[0], UTF_8));
+ final CommandParser<? extends Command> operations;
+ if ((operations = commands.get(cmdName)) == null) {
+ if (LOGGER.isWarnEnabled()) {
+ LOGGER.warn("command [" + cmdName + "] not register. raw command:[" + Arrays.deepToString(command) + "]");
+ }
+ continue;
+ }
+ Command parsedCommand = operations.parse(command);
+ this.submitEvent(parsedCommand);
+ } else {
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("redis reply:" + obj);
+ }
+ }
+ // add offset after event consumed. after that reset offset to 0L.
+ configuration.addOffset(offset[0]);
+ offset[0] = 0L;
+ }
+ //getStatus() != CONNECTED
+ exception = null;
+ break;
+ } catch (IOException | UncheckedIOException e) {
+ //close socket manual
+ if (getStatus() != CONNECTED) {
+ exception = null;
+ break;
+ }
+ if (e instanceof UncheckedIOException) {
+ exception = ((UncheckedIOException) e).getCause();
+ } else {
+ exception = (IOException) e;
+ }
+ LOGGER.error("[redis-replicator] socket error", exception);
+ doClose();
+ //retry psync in next loop.
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("reconnect to redis-server. retry times:" + (i + 1));
+ }
+ try {
+ Thread.sleep(configuration.getRetryTimeInterval());
+ } catch (InterruptedException interrupt) {
+ Thread.currentThread().interrupt();
+ }
+ }
+ }
+ if (exception != null) throw exception;
+ }
+
+ protected SyncMode trySync(final String reply) throws IOException {
+ LOGGER.info(reply);
+ if (reply.startsWith("FULLRESYNC")) {
+ //sync rdb dump file
+ parseDump(this);
+ //after parsed dump file,cache master run id and offset so that next psync.
+ String[] ary = reply.split(" ");
+ configuration.setReplId(ary[1]);
+ configuration.setReplOffset(Long.parseLong(ary[2]));
+ return SyncMode.PSYNC;
+ } else if (reply.startsWith("CONTINUE")) {
+ String[] ary = reply.split(" ");
+ //redis-4.0 compatible
+ String masterRunId = configuration.getReplId();
+ if (ary.length > 1 && masterRunId != null && !masterRunId.equals(ary[1]))
+ configuration.setReplId(ary[1]);
+ return SyncMode.PSYNC;
+ } else if (reply.startsWith("NOMASTERLINK") || reply.startsWith("LOADING")) {
+ return SyncMode.SYNC_LATER;
+ } else {
+ //server don't support psync
+ LOGGER.info("SYNC");
+ send("SYNC".getBytes());
+ parseDump(this);
+ return SyncMode.SYNC;
+ }
+ }
+
+ protected void parseDump(final AbstractReplicator replicator) throws IOException {
+ //sync dump
+ byte[] rawReply = reply(new BulkReplyHandler() {
+ @Override
+ public byte[] handle(long len, RedisInputStream in) throws IOException {
+ if (LOGGER.isInfoEnabled()) {
+ if (len != -1) {
+ LOGGER.info("RDB dump file size:" + len);
+ } else {
+ LOGGER.info("Disk-less replication.");
+ }
+ }
+ if (len != -1 && configuration.isDiscardRdbEvent()) {
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("discard " + len + " bytes");
+ }
+ in.skip(len);
+ } else {
+ RdbParser parser = new RdbParser(in, replicator);
+ parser.parse();
+ if (len == -1) in.skip(40, false); // skip 40 bytes delimiter when disk-less replication
+ }
+ return "OK".getBytes();
+ }
+ });
+ //sync command
+ String reply = new String(rawReply, UTF_8);
+ if ("OK".equals(reply))
+ return;
+ throw new IOException("SYNC failed. reason : [" + reply + "]");
+ }
+
+ protected void establishConnection() throws IOException {
+ connect();
+ if (configuration.getAuthPassword() != null)
+ auth(configuration.getAuthPassword());
+ sendPing();
+ sendSlavePort();
+ sendSlaveIp();
+ sendSlaveCapa("eof");
+ sendSlaveCapa("psync2");
+ }
+
+ protected void auth(String password) throws IOException {
+ if (password != null) {
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("AUTH " + password);
+ }
+ send("AUTH".getBytes(), password.getBytes());
+ final String reply = new String((byte[]) reply(), UTF_8);
+ LOGGER.info(reply);
+ if ("OK".equals(reply))
+ return;
+ if (reply.contains("no password")) {
+ LOGGER.warn("[AUTH " + password + "] failed. " + reply);
+ return;
+ }
+ throw new AssertionError("[AUTH " + password + "] failed. " + reply);
+ }
+ }
+
+ protected void sendPing() throws IOException {
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("PING");
+ }
+ send("PING".getBytes());
+ final String reply = new String((byte[]) reply(), UTF_8);
+ LOGGER.info(reply);
+ if ("PONG".equalsIgnoreCase(reply))
+ return;
+ if (reply.contains("NOAUTH"))
+ throw new AssertionError(reply);
+ if (reply.contains("operation not permitted"))
+ throw new AssertionError("-NOAUTH Authentication required.");
+ LOGGER.warn("[PING] failed. " + reply);
+ }
+
+ protected void sendSlavePort() throws IOException {
+ //REPLCONF listening-prot ${port}
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("REPLCONF listening-port " + socket.getLocalPort());
+ }
+ send("REPLCONF".getBytes(), "listening-port".getBytes(), String.valueOf(socket.getLocalPort()).getBytes());
+ final String reply = new String((byte[]) reply(), UTF_8);
+ LOGGER.info(reply);
+ if ("OK".equals(reply))
+ return;
+ if (LOGGER.isWarnEnabled()) {
+ LOGGER.warn("[REPLCONF listening-port " + socket.getLocalPort() + "] failed. " + reply);
+ }
+ }
+
+ protected void sendSlaveIp() throws IOException {
+ //REPLCONF ip-address ${address}
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("REPLCONF ip-address " + socket.getLocalAddress().getHostAddress());
+ }
+ send("REPLCONF".getBytes(), "ip-address".getBytes(), socket.getLocalAddress().getHostAddress().getBytes());
+ final String reply = new String((byte[]) reply(), UTF_8);
+ LOGGER.info(reply);
+ if ("OK".equals(reply))
+ return;
+ //redis 3.2+
+ if (LOGGER.isWarnEnabled()) {
+ LOGGER.warn("[REPLCONF ip-address " + socket.getLocalAddress().getHostAddress() + "] failed. " + reply);
+ }
+ }
+
+ protected void sendSlaveCapa(String cmd) throws IOException {
+ //REPLCONF capa eof
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("REPLCONF capa " + cmd);
+ }
+ send("REPLCONF".getBytes(), "capa".getBytes(), cmd.getBytes());
+ final String reply = new String((byte[]) reply(), UTF_8);
+ LOGGER.info(reply);
+ if ("OK".equals(reply))
+ return;
+ if (LOGGER.isWarnEnabled()) {
+ LOGGER.warn("[REPLCONF capa " + cmd + "] failed. " + reply);
+ }
+ }
+
+ protected synchronized void heartbeat() {
+ heartbeat = new Timer("heartbeat", true);
+ //bug fix. in this point closed by other thread. multi-thread issue
+ heartbeat.schedule(new TimerTask() {
+ @Override
+ public void run() {
+ try {
+ send("REPLCONF".getBytes(), "ACK".getBytes(), String.valueOf(configuration.getReplOffset()).getBytes());
+ } catch (IOException e) {
+ //NOP
+ }
+ }
+ }, configuration.getHeartBeatPeriod(), configuration.getHeartBeatPeriod());
+ LOGGER.info("heartbeat thread started.");
+ }
+
+ protected void send(byte[] command) throws IOException {
+ send(command, new byte[0][]);
+ }
+
+ protected void send(byte[] command, final byte[]... args) throws IOException {
+ outputStream.write(STAR);
+ outputStream.write(String.valueOf(args.length + 1).getBytes());
+ outputStream.writeCrLf();
+ outputStream.write(DOLLAR);
+ outputStream.write(String.valueOf(command.length).getBytes());
+ outputStream.writeCrLf();
+ outputStream.write(command);
+ outputStream.writeCrLf();
+ for (final byte[] arg : args) {
+ outputStream.write(DOLLAR);
+ outputStream.write(String.valueOf(arg.length).getBytes());
+ outputStream.writeCrLf();
+ outputStream.write(arg);
+ outputStream.writeCrLf();
+ }
+ outputStream.flush();
+ }
+
+ @SuppressWarnings("unchecked")
+ protected <T> T reply() throws IOException {
+ return (T) replyParser.parse();
+ }
+
+ @SuppressWarnings("unchecked")
+ protected <T> T reply(BulkReplyHandler handler) throws IOException {
+ return (T) replyParser.parse(handler);
+ }
+
+ protected void connect() throws IOException {
+ if (!connected.compareAndSet(DISCONNECTED, CONNECTING))
+ return;
+ try {
+ socket = socketFactory.createSocket(host, port, configuration.getConnectionTimeout());
+ outputStream = new RedisOutputStream(socket.getOutputStream());
+ InputStream inputStream = socket.getInputStream();
+ if (configuration.getAsyncCachedBytes() > 0) {
+ inputStream = new AsyncBufferedInputStream(inputStream, configuration.getAsyncCachedBytes());
+ }
+ if (configuration.getRateLimit() > 0) {
+ inputStream = new RateLimitInputStream(inputStream, configuration.getRateLimit());
+ }
+ this.inputStream = new RedisInputStream(inputStream, configuration.getBufferSize());
+ this.inputStream.setRawByteListeners(this.rawByteListeners);
+ replyParser = new ReplyParser(this.inputStream);
+ } finally {
+ connected.set(CONNECTED);
+ }
+ }
+
+ @Override
+ protected void doClose() throws IOException {
+ connected.compareAndSet(CONNECTED, DISCONNECTING);
+
+ try {
+ synchronized (this) {
+ if (heartbeat != null) {
+ heartbeat.cancel();
+ heartbeat = null;
+ LOGGER.info("heartbeat canceled.");
+ }
+ }
+
+ try {
+ if (inputStream != null) {
+ inputStream.setRawByteListeners(null);
+ inputStream.close();
+ }
+ } catch (IOException e) {
+ //NOP
+ }
+ try {
+ if (outputStream != null)
+ outputStream.close();
+ } catch (IOException e) {
+ //NOP
+ }
+ try {
+ if (socket != null && !socket.isClosed())
+ socket.close();
+ } catch (IOException e) {
+ //NOP
+ }
+ LOGGER.info("socket closed");
+ } finally {
+ connected.set(DISCONNECTED);
+ }
+ }
+
+ protected enum SyncMode { SYNC, PSYNC, SYNC_LATER }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisURI.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisURI.java
new file mode 100644
index 00000000..8a3253bb
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RedisURI.java
@@ -0,0 +1,289 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.IOException;
+import java.io.InvalidObjectException;
+import java.io.ObjectInputStream;
+import java.io.ObjectOutputStream;
+import java.io.Serializable;
+import java.net.MalformedURLException;
+import java.net.URI;
+import java.net.URISyntaxException;
+import java.net.URL;
+import java.nio.ByteBuffer;
+import java.nio.CharBuffer;
+import java.text.Normalizer;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Objects;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+
+public final class RedisURI implements Comparable<RedisURI>, Serializable {
+
+ private static final long serialVersionUID = 1L;
+
+ private final static char[] HEXDIGITS = {
+ '0', '1', '2', '3', '4', '5', '6', '7', '8', '9', 'A', 'B', 'C', 'D', 'E', 'F'
+ };
+
+ private String string;
+
+ private transient String host;
+ private transient String path;
+ private transient String query;
+ private transient int port = -1;
+ private transient String scheme;
+ private transient String userInfo;
+ private transient String fragment;
+ private transient String authority;
+ private transient FileType fileType;
+
+ private transient URI uri;
+ transient Map<String, String> parameters = new HashMap<>();
+
+ public RedisURI(String uri) throws URISyntaxException {
+ parse(uri);
+ this.string = this.uri.toString();
+ }
+
+ public int getPort() {
+ return port;
+ }
+
+ public String getHost() {
+ return host;
+ }
+
+ public String getPath() {
+ return path;
+ }
+
+ public String getQuery() {
+ return query;
+ }
+
+ public String getScheme() {
+ return scheme;
+ }
+
+ public String getUserInfo() {
+ return userInfo;
+ }
+
+ public String getFragment() {
+ return fragment;
+ }
+
+ public String getAuthority() {
+ return authority;
+ }
+
+ public FileType getFileType() {
+ return fileType;
+ }
+
+ @Override
+ public boolean equals(Object o) {
+ return o instanceof RedisURI && this.uri.equals(((RedisURI) o).uri);
+ }
+
+ @Override
+ public int hashCode() {
+ return this.uri.hashCode();
+ }
+
+ @Override
+ public int compareTo(RedisURI that) {
+ return this.uri.compareTo(that.uri);
+ }
+
+ public URL toURL() throws MalformedURLException {
+ Objects.requireNonNull(getFileType());
+ try {
+ return new URI("file", uri.getRawAuthority(), uri.getRawPath(), uri.getRawQuery(), uri.getRawFragment()).toURL();
+ } catch (URISyntaxException e) {
+ throw new MalformedURLException(e.getMessage());
+ }
+ }
+
+ @Override
+ public String toString() {
+ return this.uri.toString();
+ }
+
+ public String toASCIIString() {
+ return encode(this.uri.toString());
+ }
+
+ private void writeObject(ObjectOutputStream os) throws IOException {
+ os.defaultWriteObject();
+ }
+
+ private void readObject(ObjectInputStream is) throws ClassNotFoundException, IOException {
+ this.port = -1;
+ is.defaultReadObject();
+ try {
+ parse(this.string);
+ } catch (URISyntaxException x) {
+ IOException y = new InvalidObjectException("Invalid Redis URI");
+ y.initCause(x);
+ throw y;
+ }
+ }
+
+ private void parse(String uri) throws URISyntaxException {
+ this.uri = new URI(uri);
+ if (this.uri.getScheme() != null && this.uri.getScheme().equalsIgnoreCase("redis")) {
+ this.scheme = "redis";
+ } else {
+ throw new IllegalArgumentException("scheme must be [redis].");
+ }
+ this.host = this.uri.getHost();
+ this.path = this.uri.getPath();
+ this.query = this.uri.getQuery();
+ this.port = this.uri.getPort() == -1 ? 6379 : this.uri.getPort();
+ this.userInfo = this.uri.getUserInfo();
+ this.fragment = this.uri.getFragment();
+ this.authority = this.uri.getAuthority();
+ if (this.path != null && this.userInfo == null) {
+ int idx = this.path.lastIndexOf('.');
+ if (idx >= 0) {
+ String type = this.path.substring(idx + 1);
+ this.fileType = FileType.parse(type);
+ }
+ }
+
+ String rawQuery = this.uri.getRawQuery();
+ if (rawQuery == null)
+ return;
+
+ StringBuilder key = new StringBuilder();
+ StringBuilder value = new StringBuilder();
+ StringBuilder sb = key;
+ for (char c : rawQuery.toCharArray()) {
+ switch (c) {
+ case '&':
+ case ';':
+ if (key.length() > 0 && value.length() > 0) {
+ parameters.put(decode(key.toString()), decode(value.toString()));
+ }
+ key.setLength(0);
+ value.setLength(0);
+ sb = key;
+ break;
+ case '=':
+ sb = value;
+ break;
+ default:
+ sb.append(c);
+ }
+ }
+ if (key.length() > 0 && value.length() > 0) {
+ parameters.put(decode(key.toString()), decode(value.toString()));
+ }
+ }
+
+ private static String decode(String s) {
+ if (s == null)
+ return null;
+ int n = s.length();
+ if (n == 0)
+ return s;
+ if (s.indexOf('%') < 0)
+ return s;
+
+ StringBuilder sb = new StringBuilder(n);
+ ByteBuffer bb = ByteBuffer.allocate(n);
+
+ char c = s.charAt(0);
+
+ int i = 0;
+ while (i < n) {
+ if (c != '%') {
+ sb.append(c);
+ if (++i >= n)
+ break;
+ c = s.charAt(i);
+ continue;
+ }
+ bb.clear();
+ while (true) {
+ bb.put(decode(s.charAt(++i), s.charAt(++i)));
+ if (++i >= n)
+ break;
+ c = s.charAt(i);
+ if (c != '%')
+ break;
+ }
+ bb.flip();
+ CharBuffer cb = UTF_8.decode(bb);
+ sb.append(cb.toString());
+ }
+
+ return sb.toString();
+ }
+
+ private static int decode(char c) {
+ if ((c >= '0') && (c <= '9'))
+ return c - '0';
+ if ((c >= 'a') && (c <= 'f'))
+ return c - 'a' + 10;
+ if ((c >= 'A') && (c <= 'F'))
+ return c - 'A' + 10;
+ return -1;
+ }
+
+ private static byte decode(char c1, char c2) {
+ return (byte) (((decode(c1) & 0xF) << 4) | ((decode(c2) & 0xF) << 0));
+ }
+
+ private static String encode(String s) {
+ int n = s.length();
+ if (n == 0)
+ return s;
+
+ int i = 0;
+ while (true) {
+ if (s.charAt(i) >= '\u0080')
+ break;
+ if (++i >= n)
+ return s;
+ }
+
+ String ns = Normalizer.normalize(s, Normalizer.Form.NFC);
+ ByteBuffer bb = UTF_8.encode(CharBuffer.wrap(ns));
+
+ StringBuilder sb = new StringBuilder();
+ while (bb.hasRemaining()) {
+ int b = bb.get() & 0xFF;
+ if (b >= 0x80)
+ appendEscape(sb, (byte) b);
+ else
+ sb.append((char) b);
+ }
+ return sb.toString();
+ }
+
+ private static void appendEscape(StringBuilder sb, byte b) {
+ sb.append('%');
+ sb.append(HEXDIGITS[(b >> 4) & 0x0F]);
+ sb.append(HEXDIGITS[(b >> 0) & 0x0F]);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/Replicator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/Replicator.java
new file mode 100644
index 00000000..a4d9a143
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/Replicator.java
@@ -0,0 +1,70 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.Closeable;
+import java.io.IOException;
+import org.apache.rocketmq.redis.replicator.rdb.RdbVisitor;
+import org.apache.rocketmq.redis.replicator.rdb.module.ModuleParser;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandName;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.Module;
+
+public interface Replicator extends Closeable, ReplicatorListener {
+ /*
+ * Command
+ */
+ void builtInCommandParserRegister();
+
+ CommandParser<? extends Command> getCommandParser(CommandName command);
+
+ <T extends Command> void addCommandParser(CommandName command, CommandParser<T> parser);
+
+ CommandParser<? extends Command> removeCommandParser(CommandName command);
+
+ /*
+ * Module
+ */
+ ModuleParser<? extends Module> getModuleParser(String moduleName, int moduleVersion);
+
+ <T extends Module> void addModuleParser(String moduleName, int moduleVersion, ModuleParser<T> parser);
+
+ ModuleParser<? extends Module> removeModuleParser(String moduleName, int moduleVersion);
+
+ /*
+ * Rdb
+ */
+ void setRdbVisitor(RdbVisitor rdbVisitor);
+
+ RdbVisitor getRdbVisitor();
+
+ /*
+ *
+ */
+ boolean verbose();
+
+ Status getStatus();
+
+ /**
+ * @return configuration
+ */
+ Configuration getConfiguration();
+
+ void open() throws IOException;
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/ReplicatorListener.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/ReplicatorListener.java
new file mode 100644
index 00000000..400b30e6
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/ReplicatorListener.java
@@ -0,0 +1,59 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ *
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandListener;
+import org.apache.rocketmq.redis.replicator.io.RawByteListener;
+import org.apache.rocketmq.redis.replicator.rdb.RdbListener;
+
+public interface ReplicatorListener {
+ /*
+ * Rdb
+ */
+ boolean addRdbListener(RdbListener listener);
+
+ boolean removeRdbListener(RdbListener listener);
+ /*
+ * Raw byte
+ */
+ boolean addRawByteListener(RawByteListener listener);
+
+ boolean removeRawByteListener(RawByteListener listener);
+
+ /*
+ * Command
+ */
+ boolean addCommandListener(CommandListener listener);
+
+ boolean removeCommandListener(CommandListener listener);
+
+ /*
+ * Close
+ */
+ boolean addCloseListener(CloseListener listener);
+
+ boolean removeCloseListener(CloseListener listener);
+
+ /*
+ * Exception
+ */
+ boolean addExceptionListener(ExceptionListener listener);
+
+ boolean removeExceptionListener(ExceptionListener listener);
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/ReplicatorRuntimeException.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/ReplicatorRuntimeException.java
new file mode 100644
index 00000000..7f1780e0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/ReplicatorRuntimeException.java
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+public class ReplicatorRuntimeException extends RuntimeException {
+
+ public ReplicatorRuntimeException() {
+ super();
+ }
+
+ public ReplicatorRuntimeException(String message) {
+ super(message);
+ }
+
+ public ReplicatorRuntimeException(String message, Throwable cause) {
+ super(message, cause);
+ }
+
+ public ReplicatorRuntimeException(Throwable cause) {
+ super(cause);
+ }
+
+ protected ReplicatorRuntimeException(String message, Throwable cause, boolean enableSuppression,
+ boolean writableStackTrace) {
+ super(message, cause, enableSuppression, writableStackTrace);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RocketMQRedisReplicator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RocketMQRedisReplicator.java
new file mode 100644
index 00000000..25341dfa
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/RocketMQRedisReplicator.java
@@ -0,0 +1,239 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.IOException;
+import java.net.URISyntaxException;
+import java.util.Objects;
+import org.apache.curator.framework.CuratorFramework;
+import org.apache.curator.framework.recipes.leader.LeaderSelector;
+import org.apache.curator.framework.recipes.leader.LeaderSelectorListenerAdapter;
+import org.apache.curator.retry.ExponentialBackoffRetry;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandListener;
+import org.apache.rocketmq.redis.replicator.cmd.CommandName;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.conf.Configure;
+import org.apache.rocketmq.redis.replicator.io.RawByteListener;
+import org.apache.rocketmq.redis.replicator.producer.RocketMQProducer;
+import org.apache.rocketmq.redis.replicator.rdb.RdbListener;
+import org.apache.rocketmq.redis.replicator.rdb.RdbVisitor;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.Module;
+import org.apache.rocketmq.redis.replicator.rdb.module.ModuleParser;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import static org.apache.curator.framework.CuratorFrameworkFactory.newClient;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.CONFIG_PROP_ZK_ADDRESS;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.DEPLOY_MODEL;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.DEPLOY_MODEL_SINGLE;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.REDIS_URI;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.ROOT_DIR;
+
+public class RocketMQRedisReplicator extends AbstractReplicator {
+
+ private static final Logger LOGGER = LoggerFactory.getLogger(RocketMQRedisReplicator.class);
+
+ protected final RedisURI uri;
+ protected final Configure configure;
+ protected final Replicator replicator;
+
+ public RocketMQRedisReplicator(Configure configure) throws IOException, URISyntaxException {
+ Objects.requireNonNull(configure);
+ String uri = configure.getString(REDIS_URI);
+ this.configure = configure;
+ this.uri = new RedisURI(uri);
+ this.replicator = new RedisReplicator(this.uri);
+ }
+
+ @Override
+ public boolean addRdbListener(RdbListener listener) {
+ return replicator.addRdbListener(listener);
+ }
+
+ @Override
+ public boolean removeRdbListener(RdbListener listener) {
+ return replicator.removeRdbListener(listener);
+ }
+
+ @Override
+ public boolean addRawByteListener(RawByteListener listener) {
+ return replicator.addRawByteListener(listener);
+ }
+
+ @Override
+ public boolean removeRawByteListener(RawByteListener listener) {
+ return replicator.removeRawByteListener(listener);
+ }
+
+ @Override
+ public void builtInCommandParserRegister() {
+ replicator.builtInCommandParserRegister();
+ }
+
+ @Override
+ public CommandParser<? extends Command> getCommandParser(CommandName command) {
+ return replicator.getCommandParser(command);
+ }
+
+ @Override
+ public <T extends Command> void addCommandParser(CommandName command, CommandParser<T> parser) {
+ replicator.addCommandParser(command, parser);
+ }
+
+ @Override
+ public CommandParser<? extends Command> removeCommandParser(CommandName command) {
+ return replicator.removeCommandParser(command);
+ }
+
+ @Override
+ public ModuleParser<? extends Module> getModuleParser(String moduleName, int moduleVersion) {
+ return replicator.getModuleParser(moduleName, moduleVersion);
+ }
+
+ @Override
+ public <T extends Module> void addModuleParser(String moduleName, int moduleVersion, ModuleParser<T> parser) {
+ replicator.addModuleParser(moduleName, moduleVersion, parser);
+ }
+
+ @Override
+ public ModuleParser<? extends Module> removeModuleParser(String moduleName, int moduleVersion) {
+ return replicator.removeModuleParser(moduleName, moduleVersion);
+ }
+
+ @Override
+ public void setRdbVisitor(RdbVisitor rdbVisitor) {
+ replicator.setRdbVisitor(rdbVisitor);
+ }
+
+ @Override
+ public RdbVisitor getRdbVisitor() {
+ return replicator.getRdbVisitor();
+ }
+
+ @Override
+ public boolean addCommandListener(CommandListener listener) {
+ return replicator.addCommandListener(listener);
+ }
+
+ @Override
+ public boolean removeCommandListener(CommandListener listener) {
+ return replicator.removeCommandListener(listener);
+ }
+
+ @Override
+ public boolean addCloseListener(CloseListener listener) {
+ return replicator.addCloseListener(listener);
+ }
+
+ @Override
+ public boolean removeCloseListener(CloseListener listener) {
+ return replicator.removeCloseListener(listener);
+ }
+
+ @Override
+ public boolean addExceptionListener(ExceptionListener listener) {
+ return replicator.addExceptionListener(listener);
+ }
+
+ @Override
+ public boolean removeExceptionListener(ExceptionListener listener) {
+ return replicator.removeExceptionListener(listener);
+ }
+
+ @Override
+ public boolean verbose() {
+ return replicator.verbose();
+ }
+
+ @Override
+ public Configuration getConfiguration() {
+ return replicator.getConfiguration();
+ }
+
+ @Override
+ public void open() throws IOException {
+ if (this.replicator instanceof RedisSocketReplicator) {
+ boolean single = configure.getString(DEPLOY_MODEL).equals(DEPLOY_MODEL_SINGLE);
+ if (single) {
+ this.replicator.open();
+ } else {
+ String address = configure.getString(CONFIG_PROP_ZK_ADDRESS);
+ final CuratorFramework client = newClient(address, new ExponentialBackoffRetry(1000, 3));
+ client.start();
+
+ String path = ROOT_DIR + "/" + uri.getHost() + "-" + uri.getPort();
+ final LeaderSelector selector = new LeaderSelector(client, path, new LeaderSelectorListenerAdapter() {
+ @Override
+ public void takeLeadership(final CuratorFramework client) throws Exception {
+ RocketMQRedisReplicator.this.addCloseListener(new CloseListener() {
+ @Override
+ public void handle(Replicator replicator) {
+ client.close();
+ }
+ });
+ replicator.open();
+ }
+ });
+ selector.start();
+ }
+ } else {
+ this.replicator.open();
+ }
+ }
+
+ @Override
+ public void close() throws IOException {
+ replicator.close();
+ }
+
+ public static void main(String[] args) throws Exception {
+ Configure configure = new Configure();
+ Replicator replicator = new RocketMQRedisReplicator(configure);
+ final RocketMQProducer producer = new RocketMQProducer(configure);
+
+ replicator.addRdbListener(new RdbListener.Adaptor() {
+ @Override public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ try {
+ boolean success = producer.sendKeyValuePair(kv);
+ if (!success) {
+ LOGGER.error("Fail to send KeyValuePair[key={}]", kv.getKey());
+ }
+ } catch (Exception e) {
+ LOGGER.error(String.format("Fail to send KeyValuePair[key=%s]", kv.getKey()), e);
+ }
+ }
+ });
+
+ replicator.addCommandListener(new CommandListener() {
+ @Override public void handle(Replicator replicator, Command command) {
+ try {
+ boolean success = producer.sendCommand(command);
+ if (!success) {
+ LOGGER.error("Fail to send command[{}]", command);
+ }
+ } catch (Exception e) {
+ LOGGER.error(String.format("Fail to send command[%s]", command), e);
+ }
+ }
+ });
+
+ replicator.open();
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/Status.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/Status.java
new file mode 100644
index 00000000..08d88371
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/Status.java
@@ -0,0 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+public enum Status {
+ CONNECTING, CONNECTED, DISCONNECTING, DISCONNECTED
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/UncheckedIOException.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/UncheckedIOException.java
new file mode 100644
index 00000000..09385dc5
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/UncheckedIOException.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import java.io.IOException;
+import java.util.Objects;
+
+public class UncheckedIOException extends RuntimeException {
+ private static final long serialVersionUID = 1L;
+
+ public UncheckedIOException(String message, IOException cause) {
+ super(message, Objects.requireNonNull(cause));
+ }
+
+ public UncheckedIOException(IOException cause) {
+ super(Objects.requireNonNull(cause));
+ }
+
+ @Override
+ public IOException getCause() {
+ return (IOException) super.getCause();
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/BulkReplyHandler.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/BulkReplyHandler.java
new file mode 100644
index 00000000..bc9fa270
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/BulkReplyHandler.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd;
+
+import java.io.IOException;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+
+public interface BulkReplyHandler {
+ byte[] handle(long len, RedisInputStream in) throws IOException;
+
+ class SimpleBulkReplyHandler implements BulkReplyHandler {
+ @Override
+ public byte[] handle(long len, RedisInputStream in) throws IOException {
+ byte[] reply = len == 0 ? new byte[] {} : in.readBytes(len).first();
+ int c;
+ if ((c = in.read()) != '\r')
+ throw new AssertionError("expect '\\r' but :" + (char) c);
+ if ((c = in.read()) != '\n')
+ throw new AssertionError("expect '\\n' but :" + (char) c);
+ return reply;
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/Command.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/Command.java
new file mode 100644
index 00000000..5c76450c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/Command.java
@@ -0,0 +1,23 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd;
+
+import org.apache.rocketmq.redis.replicator.event.Event;
+
+public interface Command extends Event {
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/CommandListener.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/CommandListener.java
new file mode 100644
index 00000000..178fa0fe
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/CommandListener.java
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd;
+
+import org.apache.rocketmq.redis.replicator.Replicator;
+
+public interface CommandListener {
+ void handle(Replicator replicator, Command command);
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/CommandName.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/CommandName.java
new file mode 100644
index 00000000..571e972e
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/CommandName.java
@@ -0,0 +1,53 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd;
+
+public class CommandName {
+ public final String name;
+
+ private CommandName(String name) {
+ this.name = name;
+ }
+
+ public static CommandName name(String key) {
+ return new CommandName(key);
+ }
+
+ @Override
+ public boolean equals(Object o) {
+ if (this == o)
+ return true;
+ if (o == null || getClass() != o.getClass())
+ return false;
+
+ CommandName that = (CommandName) o;
+ return name.toUpperCase().equals(that.name.toUpperCase());
+ }
+
+ @Override
+ public int hashCode() {
+ return name.toUpperCase().hashCode();
+ }
+
+ @Override
+ public String toString() {
+ return "CommandName{" +
+ "name='" + name + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/CommandParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/CommandParser.java
new file mode 100644
index 00000000..8b232df6
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/CommandParser.java
@@ -0,0 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd;
+
+public interface CommandParser<T extends Command> {
+ T parse(Object[] command);
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/OffsetHandler.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/OffsetHandler.java
new file mode 100644
index 00000000..02308d85
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/OffsetHandler.java
@@ -0,0 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd;
+
+public interface OffsetHandler {
+ void handle(long len);
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/ReplyParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/ReplyParser.java
new file mode 100644
index 00000000..84678edc
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/ReplyParser.java
@@ -0,0 +1,167 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd;
+
+import java.io.IOException;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.util.ByteBuilder;
+
+import static org.apache.rocketmq.redis.replicator.RedisConstants.COLON;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.DOLLAR;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.MINUS;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.PLUS;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.STAR;
+
+public class ReplyParser {
+ private final RedisInputStream in;
+
+ public ReplyParser(RedisInputStream in) {
+ this.in = in;
+ }
+
+ public Object parse() throws IOException {
+ return parse(new BulkReplyHandler.SimpleBulkReplyHandler(), null);
+ }
+
+ public Object parse(OffsetHandler offsetHandler) throws IOException {
+ return parse(new BulkReplyHandler.SimpleBulkReplyHandler(), offsetHandler);
+ }
+
+ public Object parse(BulkReplyHandler handler, OffsetHandler offsetHandler) throws IOException {
+ in.mark();
+ Object rs = parse(handler);
+ long len = in.unmark();
+ if (offsetHandler != null)
+ offsetHandler.handle(len);
+ return rs;
+ }
+
+ /**
+ * @param handler bulk reply handler
+ * @return Object[] or byte[] or Long
+ * @throws IOException when read timeout
+ */
+ public Object parse(BulkReplyHandler handler) throws IOException {
+ while (true) {
+ int c = in.read();
+ switch (c) {
+ case DOLLAR:
+ //RESP Bulk Strings
+ ByteBuilder builder = ByteBuilder.allocate(128);
+ while (true) {
+ while ((c = in.read()) != '\r') {
+ builder.put((byte) c);
+ }
+ if ((c = in.read()) == '\n') {
+ break;
+ } else {
+ builder.put((byte) c);
+ }
+ }
+ String payload = builder.toString();
+ long len = -1;
+ // disk-less replication
+ // $EOF:<40 bytes delimiter>
+ if (!payload.startsWith("EOF:")) {
+ len = Long.parseLong(builder.toString());
+ // $-1\r\n. this is called null string.
+ // see http://redis.io/topics/protocol
+ if (len == -1) return null;
+ } else {
+ if (handler instanceof BulkReplyHandler.SimpleBulkReplyHandler) {
+ throw new AssertionError("Parse reply for disk-less replication can not use BulkReplyHandler.SimpleBulkReplyHandler.");
+ }
+ }
+ if (handler != null) return handler.handle(len, in);
+ throw new AssertionError("Callback is null");
+ case COLON:
+ // RESP Integers
+ builder = ByteBuilder.allocate(128);
+ while (true) {
+ while ((c = in.read()) != '\r') {
+ builder.put((byte) c);
+ }
+ if ((c = in.read()) == '\n') {
+ break;
+ } else {
+ builder.put((byte) c);
+ }
+ }
+ //as integer
+ return Long.parseLong(builder.toString());
+ case STAR:
+ // RESP Arrays
+ builder = ByteBuilder.allocate(128);
+ while (true) {
+ while ((c = in.read()) != '\r') {
+ builder.put((byte) c);
+ }
+ if ((c = in.read()) == '\n') {
+ break;
+ } else {
+ builder.put((byte) c);
+ }
+ }
+ len = Long.parseLong(builder.toString());
+ if (len == -1)
+ return null;
+ Object[] ary = new Object[(int) len];
+ for (int i = 0; i < len; i++) {
+ Object obj = parse(new BulkReplyHandler.SimpleBulkReplyHandler());
+ ary[i] = obj;
+ }
+ return ary;
+ case PLUS:
+ // RESP Simple Strings
+ builder = ByteBuilder.allocate(128);
+ while (true) {
+ while ((c = in.read()) != '\r') {
+ builder.put((byte) c);
+ }
+ if ((c = in.read()) == '\n') {
+ return builder.array();
+ } else {
+ builder.put((byte) c);
+ }
+ }
+ case MINUS:
+ // RESP Errors
+ builder = ByteBuilder.allocate(128);
+ while (true) {
+ while ((c = in.read()) != '\r') {
+ builder.put((byte) c);
+ }
+ if ((c = in.read()) == '\n') {
+ return builder.array();
+ } else {
+ builder.put((byte) c);
+ }
+ }
+ case '\n':
+ //skip +CONTINUE\r\n[\n]
+ //skip +FULLRESYNC 8de1787ba490483314a4d30f1c628bc5025eb761 2443808505[\n]$2443808505\r\nxxxxxxxxxxxxxxxx\r\n
+ //At this stage just a newline works as a PING in order to take the connection live
+ //bug fix
+ break;
+ default:
+ throw new AssertionError("expect [$,:,*,+,-] but: " + (char) c);
+
+ }
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/AggregateType.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/AggregateType.java
new file mode 100644
index 00000000..604b04ee
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/AggregateType.java
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+
+public enum AggregateType implements Serializable {
+ SUM, MIN, MAX
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/AppendCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/AppendCommand.java
new file mode 100644
index 00000000..d4d2ad39
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/AppendCommand.java
@@ -0,0 +1,82 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class AppendCommand implements Command {
+ private static final long serialVersionUID = 1L;
+ private String key;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawValue;
+
+ public AppendCommand() {
+ }
+
+ public AppendCommand(String key, String value) {
+ this(key, value, null, null);
+ }
+
+ public AppendCommand(String key, String value, byte[] rawKey, byte[] rawValue) {
+ this.key = key;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "AppendCommand{" +
+ "key='" + key + '\'' +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/BRPopLPushCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/BRPopLPushCommand.java
new file mode 100644
index 00000000..b5012193
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/BRPopLPushCommand.java
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class BRPopLPushCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String source;
+ private String destination;
+ private int timeout;
+ private byte[] rawSource;
+ private byte[] rawDestination;
+
+ public BRPopLPushCommand() {
+ }
+
+ public BRPopLPushCommand(String source, String destination, int timeout) {
+ this(source, destination, timeout, null, null);
+ }
+
+ public BRPopLPushCommand(String source, String destination, int timeout, byte[] rawSource, byte[] rawDestination) {
+ this.source = source;
+ this.destination = destination;
+ this.timeout = timeout;
+ this.rawSource = rawSource;
+ this.rawDestination = rawDestination;
+ }
+
+ public String getSource() {
+ return source;
+ }
+
+ public void setSource(String source) {
+ this.source = source;
+ }
+
+ public String getDestination() {
+ return destination;
+ }
+
+ public void setDestination(String destination) {
+ this.destination = destination;
+ }
+
+ public int getTimeout() {
+ return timeout;
+ }
+
+ public void setTimeout(int timeout) {
+ this.timeout = timeout;
+ }
+
+ public byte[] getRawSource() {
+ return rawSource;
+ }
+
+ public void setRawSource(byte[] rawSource) {
+ this.rawSource = rawSource;
+ }
+
+ public byte[] getRawDestination() {
+ return rawDestination;
+ }
+
+ public void setRawDestination(byte[] rawDestination) {
+ this.rawDestination = rawDestination;
+ }
+
+ @Override
+ public String toString() {
+ return "BRPopLPushCommand{" +
+ "source='" + source + '\'' +
+ ", destination='" + destination + '\'' +
+ ", timeout=" + timeout +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/BitFieldCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/BitFieldCommand.java
new file mode 100644
index 00000000..69745699
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/BitFieldCommand.java
@@ -0,0 +1,86 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.List;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class BitFieldCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private byte[] rawKey;
+ private List<Statement> statements;
+ private List<OverFlow> overFlows;
+
+ public BitFieldCommand() {
+ }
+
+ public BitFieldCommand(String key, List<Statement> statements, List<OverFlow> overFlows) {
+ this(key, statements, overFlows, null);
+ }
+
+ public BitFieldCommand(String key, List<Statement> statements, List<OverFlow> overFlows, byte[] rawKey) {
+ this.key = key;
+ this.rawKey = rawKey;
+ this.statements = statements;
+ this.overFlows = overFlows;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public List<Statement> getStatements() {
+ return statements;
+ }
+
+ public void setStatements(List<Statement> statements) {
+ this.statements = statements;
+ }
+
+ public List<OverFlow> getOverFlows() {
+ return overFlows;
+ }
+
+ public void setOverFlows(List<OverFlow> overFlows) {
+ this.overFlows = overFlows;
+ }
+
+ @Override
+ public String toString() {
+ return "BitFieldCommand{" +
+ "key='" + key + '\'' +
+ ", statements=" + statements +
+ ", overFlows=" + overFlows +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/BitOpCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/BitOpCommand.java
new file mode 100644
index 00000000..805264e4
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/BitOpCommand.java
@@ -0,0 +1,96 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class BitOpCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private Op op;
+ private String destkey;
+ private String[] keys;
+ private byte[] rawDestkey;
+ private byte[][] rawKeys;
+
+ public BitOpCommand() {
+ }
+
+ public BitOpCommand(Op op, String destkey, String[] keys) {
+ this(op, destkey, keys, null, null);
+ }
+
+ public BitOpCommand(Op op, String destkey, String[] keys, byte[] rawDestkey, byte[][] rawKeys) {
+ this.op = op;
+ this.destkey = destkey;
+ this.keys = keys;
+ this.rawDestkey = rawDestkey;
+ this.rawKeys = rawKeys;
+ }
+
+ public Op getOp() {
+ return op;
+ }
+
+ public void setOp(Op op) {
+ this.op = op;
+ }
+
+ public String getDestkey() {
+ return destkey;
+ }
+
+ public void setDestkey(String destkey) {
+ this.destkey = destkey;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public byte[] getRawDestkey() {
+ return rawDestkey;
+ }
+
+ public void setRawDestkey(byte[] rawDestkey) {
+ this.rawDestkey = rawDestkey;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ @Override
+ public String toString() {
+ return "BitOpCommand{" +
+ "op=" + op +
+ ", destkey='" + destkey + '\'' +
+ ", keys=" + Arrays.toString(keys) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/DecrByCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/DecrByCommand.java
new file mode 100644
index 00000000..75ede620
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/DecrByCommand.java
@@ -0,0 +1,74 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class DecrByCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long value;
+ private byte[] rawKey;
+
+ public DecrByCommand() {
+ }
+
+ public DecrByCommand(String key, long value) {
+ this(key, value, null);
+ }
+
+ public DecrByCommand(String key, long value, byte[] rawKey) {
+ this.key = key;
+ this.value = value;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getValue() {
+ return value;
+ }
+
+ public void setValue(long value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "DecrByCommand{" +
+ "key='" + key + '\'' +
+ ", value=" + value +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/DecrCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/DecrCommand.java
new file mode 100644
index 00000000..4ef33446
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/DecrCommand.java
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class DecrCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private byte[] rawKey;
+
+ public DecrCommand() {
+ }
+
+ public DecrCommand(String key) {
+ this(key, null);
+ }
+
+ public DecrCommand(String key, byte[] rawKey) {
+ this.key = key;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "DecrCommand{" +
+ "key='" + key + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/DelCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/DelCommand.java
new file mode 100644
index 00000000..c084f610
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/DelCommand.java
@@ -0,0 +1,64 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class DelCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String[] keys;
+ private byte[][] rawKeys;
+
+ public DelCommand() {
+ }
+
+ public DelCommand(String[] keys) {
+ this(keys, null);
+ }
+
+ public DelCommand(String[] keys, byte[][] rawKeys) {
+ this.keys = keys;
+ this.rawKeys = rawKeys;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ @Override
+ public String toString() {
+ return "DelCommand{" +
+ "keys=" + Arrays.toString(keys) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/EvalCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/EvalCommand.java
new file mode 100644
index 00000000..fb8a1408
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/EvalCommand.java
@@ -0,0 +1,118 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class EvalCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String script;
+ private int numkeys;
+ private String[] keys;
+ private String[] args;
+ private byte[] rawScript;
+ private byte[][] rawKeys;
+ private byte[][] rawArgs;
+
+ public EvalCommand() {
+ }
+
+ public EvalCommand(String script, int numkeys, String[] keys, String[] args) {
+ this(script, numkeys, keys, args, null, null, null);
+ }
+
+ public EvalCommand(String script, int numkeys, String[] keys, String[] args, byte[] rawScript, byte[][] rawKeys,
+ byte[][] rawArgs) {
+ this.script = script;
+ this.numkeys = numkeys;
+ this.keys = keys;
+ this.args = args;
+ this.rawScript = rawScript;
+ this.rawKeys = rawKeys;
+ this.rawArgs = rawArgs;
+ }
+
+ public String getScript() {
+ return script;
+ }
+
+ public void setScript(String script) {
+ this.script = script;
+ }
+
+ public int getNumkeys() {
+ return numkeys;
+ }
+
+ public void setNumkeys(int numkeys) {
+ this.numkeys = numkeys;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public String[] getArgs() {
+ return args;
+ }
+
+ public void setArgs(String[] args) {
+ this.args = args;
+ }
+
+ public byte[] getRawScript() {
+ return rawScript;
+ }
+
+ public void setRawScript(byte[] rawScript) {
+ this.rawScript = rawScript;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ public byte[][] getRawArgs() {
+ return rawArgs;
+ }
+
+ public void setRawArgs(byte[][] rawArgs) {
+ this.rawArgs = rawArgs;
+ }
+
+ @Override
+ public String toString() {
+ return "EvalCommand{" +
+ "script='" + script + '\'' +
+ ", numkeys=" + numkeys +
+ ", keys=" + Arrays.toString(keys) +
+ ", args=" + Arrays.toString(args) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExecCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExecCommand.java
new file mode 100644
index 00000000..9138318d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExecCommand.java
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ExecCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ public ExecCommand() {
+ }
+
+ @Override
+ public String toString() {
+ return "ExecCommand{}";
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExistType.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExistType.java
new file mode 100644
index 00000000..17160bc0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExistType.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+
+public enum ExistType implements Serializable {
+ /**
+ * not set
+ */
+ NONE,
+ /**
+ * Don't update already existing elements
+ */
+ NX,
+ /**
+ * Only update elements that already exist
+ */
+ XX
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExpireAtCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExpireAtCommand.java
new file mode 100644
index 00000000..da9b763b
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExpireAtCommand.java
@@ -0,0 +1,74 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ExpireAtCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long ex;
+ private byte[] rawKey;
+
+ public ExpireAtCommand() {
+ }
+
+ public ExpireAtCommand(String key, long ex) {
+ this(key, ex, null);
+ }
+
+ public ExpireAtCommand(String key, long ex, byte[] rawKey) {
+ this.key = key;
+ this.ex = ex;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getEx() {
+ return ex;
+ }
+
+ public void setEx(long ex) {
+ this.ex = ex;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "ExpireAtCommand{" +
+ "key='" + key + '\'' +
+ ", ex=" + ex +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExpireCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExpireCommand.java
new file mode 100644
index 00000000..887dd844
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ExpireCommand.java
@@ -0,0 +1,74 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ExpireCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private int ex;
+ private byte[] rawKey;
+
+ public ExpireCommand() {
+ }
+
+ public ExpireCommand(String key, int ex) {
+ this(key, ex, null);
+ }
+
+ public ExpireCommand(String key, int ex, byte[] rawKey) {
+ this.key = key;
+ this.ex = ex;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public int getEx() {
+ return ex;
+ }
+
+ public void setEx(int ex) {
+ this.ex = ex;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "ExpireCommand{" +
+ "key='" + key + '\'' +
+ ", ex=" + ex +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/FlushAllCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/FlushAllCommand.java
new file mode 100644
index 00000000..594631c1
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/FlushAllCommand.java
@@ -0,0 +1,53 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class FlushAllCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private Boolean isAsync;
+
+ public FlushAllCommand() {
+ }
+
+ public FlushAllCommand(final Boolean isAsync) {
+ this.isAsync = isAsync;
+ }
+
+ public Boolean isAsync() {
+ return isAsync;
+ }
+
+ public Boolean getAsync() {
+ return isAsync;
+ }
+
+ public void setAsync(Boolean async) {
+ isAsync = async;
+ }
+
+ @Override
+ public String toString() {
+ return "FlushAllCommand{" +
+ "isAsync=" + isAsync +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/FlushDBCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/FlushDBCommand.java
new file mode 100644
index 00000000..c255e170
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/FlushDBCommand.java
@@ -0,0 +1,53 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class FlushDBCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private Boolean isAsync;
+
+ public FlushDBCommand() {
+ }
+
+ public FlushDBCommand(final Boolean isAsync) {
+ this.isAsync = isAsync;
+ }
+
+ public Boolean isAsync() {
+ return isAsync;
+ }
+
+ public Boolean getAsync() {
+ return isAsync;
+ }
+
+ public void setAsync(Boolean async) {
+ isAsync = async;
+ }
+
+ @Override
+ public String toString() {
+ return "FlushDBCommand{" +
+ "isAsync=" + isAsync +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Geo.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Geo.java
new file mode 100644
index 00000000..f80644e2
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Geo.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+
+public class Geo implements Serializable {
+
+ private static final long serialVersionUID = 1L;
+
+ private String member;
+ private double longitude;
+ private double latitude;
+ private byte[] rawMember;
+
+ public Geo() {
+ }
+
+ public Geo(String member, double longitude, double latitude) {
+ this(member, longitude, latitude, null);
+ }
+
+ public Geo(String member, double longitude, double latitude, byte[] rawMember) {
+ this.member = member;
+ this.longitude = longitude;
+ this.latitude = latitude;
+ this.rawMember = rawMember;
+ }
+
+ public String getMember() {
+ return member;
+ }
+
+ public void setMember(String member) {
+ this.member = member;
+ }
+
+ public double getLongitude() {
+ return longitude;
+ }
+
+ public void setLongitude(double longitude) {
+ this.longitude = longitude;
+ }
+
+ public double getLatitude() {
+ return latitude;
+ }
+
+ public void setLatitude(double latitude) {
+ this.latitude = latitude;
+ }
+
+ public byte[] getRawMember() {
+ return rawMember;
+ }
+
+ public void setRawMember(byte[] rawMember) {
+ this.rawMember = rawMember;
+ }
+
+ @Override
+ public String toString() {
+ return "Geo{" +
+ "member='" + member + '\'' +
+ ", longitude=" + longitude +
+ ", latitude=" + latitude +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/GeoAddCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/GeoAddCommand.java
new file mode 100644
index 00000000..cf177f37
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/GeoAddCommand.java
@@ -0,0 +1,75 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class GeoAddCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private Geo[] geos;
+ private byte[] rawKey;
+
+ public GeoAddCommand() {
+ }
+
+ public GeoAddCommand(String key, Geo[] geos) {
+ this(key, geos, null);
+ }
+
+ public GeoAddCommand(String key, Geo[] geos, byte[] rawKey) {
+ this.key = key;
+ this.geos = geos;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public Geo[] getGeos() {
+ return geos;
+ }
+
+ public void setGeos(Geo[] geos) {
+ this.geos = geos;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "GeoAddCommand{" +
+ "key='" + key + '\'' +
+ ", geos=" + Arrays.toString(geos) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/GetSetCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/GetSetCommand.java
new file mode 100644
index 00000000..a1187e79
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/GetSetCommand.java
@@ -0,0 +1,84 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class GetSetCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawValue;
+
+ public GetSetCommand() {
+ }
+
+ public GetSetCommand(String key, String value) {
+ this(key, value, null, null);
+ }
+
+ public GetSetCommand(String key, String value, byte[] rawKey, byte[] rawValue) {
+ this.key = key;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "GetSetCommand{" +
+ "key='" + key + '\'' +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/GetTypeOffset.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/GetTypeOffset.java
new file mode 100644
index 00000000..723bd336
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/GetTypeOffset.java
@@ -0,0 +1,82 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+public class GetTypeOffset implements Statement {
+
+ private static final long serialVersionUID = 1L;
+
+ private String type;
+ private String offset;
+ private byte[] rawType;
+ private byte[] rawOffset;
+
+ public GetTypeOffset() {
+ }
+
+ public GetTypeOffset(String type, String offset) {
+ this(type, offset, null, null);
+ }
+
+ public GetTypeOffset(String type, String offset, byte[] rawType, byte[] rawOffset) {
+ this.type = type;
+ this.offset = offset;
+ this.rawType = rawType;
+ this.rawOffset = rawOffset;
+ }
+
+ public String getType() {
+ return type;
+ }
+
+ public void setType(String type) {
+ this.type = type;
+ }
+
+ public String getOffset() {
+ return offset;
+ }
+
+ public void setOffset(String offset) {
+ this.offset = offset;
+ }
+
+ public byte[] getRawType() {
+ return rawType;
+ }
+
+ public void setRawType(byte[] rawType) {
+ this.rawType = rawType;
+ }
+
+ public byte[] getRawOffset() {
+ return rawOffset;
+ }
+
+ public void setRawOffset(byte[] rawOffset) {
+ this.rawOffset = rawOffset;
+ }
+
+ @Override
+ public String toString() {
+ return "GetTypeOffset{" +
+ "type='" + type + '\'' +
+ ", offset=" + offset +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HDelCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HDelCommand.java
new file mode 100644
index 00000000..f748ce85
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HDelCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class HDelCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String fields[];
+ private byte[] rawKey;
+ private byte[][] rawFields;
+
+ public HDelCommand() {
+ }
+
+ public HDelCommand(String key, String[] fields) {
+ this(key, fields, null, null);
+ }
+
+ public HDelCommand(String key, String[] fields, byte[] rawKey, byte[][] rawFields) {
+ this.key = key;
+ this.fields = fields;
+ this.rawKey = rawKey;
+ this.rawFields = rawFields;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String[] getFields() {
+ return fields;
+ }
+
+ public void setFields(String[] fields) {
+ this.fields = fields;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[][] getRawFields() {
+ return rawFields;
+ }
+
+ public void setRawFields(byte[][] rawFields) {
+ this.rawFields = rawFields;
+ }
+
+ @Override
+ public String toString() {
+ return "HDelCommand{" +
+ "key='" + key + '\'' +
+ ", fields=" + Arrays.toString(fields) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HIncrByCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HIncrByCommand.java
new file mode 100644
index 00000000..588532ac
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HIncrByCommand.java
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class HIncrByCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String field;
+ private long increment;
+ private byte[] rawKey;
+ private byte[] rawField;
+
+ public HIncrByCommand() {
+ }
+
+ public HIncrByCommand(String key, String field, long increment) {
+ this(key, field, increment, null, null);
+ }
+
+ public HIncrByCommand(String key, String field, long increment, byte[] rawKey, byte[] rawField) {
+ this.key = key;
+ this.field = field;
+ this.increment = increment;
+ this.rawKey = rawKey;
+ this.rawField = rawField;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getField() {
+ return field;
+ }
+
+ public void setField(String field) {
+ this.field = field;
+ }
+
+ public long getIncrement() {
+ return increment;
+ }
+
+ public void setIncrement(long increment) {
+ this.increment = increment;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawField() {
+ return rawField;
+ }
+
+ public void setRawField(byte[] rawField) {
+ this.rawField = rawField;
+ }
+
+ @Override
+ public String toString() {
+ return "HIncrByCommand{" +
+ "key='" + key + '\'' +
+ ", field='" + field + '\'' +
+ ", increment='" + increment + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HMSetCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HMSetCommand.java
new file mode 100644
index 00000000..1f532189
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HMSetCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Map;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class HMSetCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private Map<String, String> fields;
+ private byte[] rawKey;
+ private Map<byte[], byte[]> rawFields;
+
+ public HMSetCommand() {
+ }
+
+ public HMSetCommand(String key, Map<String, String> fields) {
+ this(key, fields, null, null);
+ }
+
+ public HMSetCommand(String key, Map<String, String> fields, byte[] rawKey, Map<byte[], byte[]> rawFields) {
+ this.key = key;
+ this.fields = fields;
+ this.rawKey = rawKey;
+ this.rawFields = rawFields;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public Map<String, String> getFields() {
+ return fields;
+ }
+
+ public void setFields(Map<String, String> fields) {
+ this.fields = fields;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public Map<byte[], byte[]> getRawFields() {
+ return rawFields;
+ }
+
+ public void setRawFields(Map<byte[], byte[]> rawFields) {
+ this.rawFields = rawFields;
+ }
+
+ @Override
+ public String toString() {
+ return "HMSetCommand{" +
+ "key='" + key + '\'' +
+ ", fields=" + fields +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HSetCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HSetCommand.java
new file mode 100644
index 00000000..2c1a2e7f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HSetCommand.java
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class HSetCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String field;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawField;
+ private byte[] rawValue;
+
+ public HSetCommand() {
+ }
+
+ public HSetCommand(String key, String field, String value) {
+ this(key, field, value, null, null, null);
+ }
+
+ public HSetCommand(String key, String field, String value, byte[] rawKey, byte[] rawField, byte[] rawValue) {
+ this.key = key;
+ this.field = field;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawField = rawField;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getField() {
+ return field;
+ }
+
+ public void setField(String field) {
+ this.field = field;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawField() {
+ return rawField;
+ }
+
+ public void setRawField(byte[] rawField) {
+ this.rawField = rawField;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "HSetCommand{" +
+ "key='" + key + '\'' +
+ ", field='" + field + '\'' +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HSetNxCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HSetNxCommand.java
new file mode 100644
index 00000000..df8b01da
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/HSetNxCommand.java
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class HSetNxCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String field;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawField;
+ private byte[] rawValue;
+
+ public HSetNxCommand() {
+ }
+
+ public HSetNxCommand(String key, String field, String value) {
+ this(key, field, value, null, null, null);
+ }
+
+ public HSetNxCommand(String key, String field, String value, byte[] rawKey, byte[] rawField, byte[] rawValue) {
+ this.key = key;
+ this.field = field;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawField = rawField;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getField() {
+ return field;
+ }
+
+ public void setField(String field) {
+ this.field = field;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawField() {
+ return rawField;
+ }
+
+ public void setRawField(byte[] rawField) {
+ this.rawField = rawField;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "HSetNxCommand{" +
+ "key='" + key + '\'' +
+ ", field='" + field + '\'' +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/IncrByCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/IncrByCommand.java
new file mode 100644
index 00000000..631c6c8f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/IncrByCommand.java
@@ -0,0 +1,74 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class IncrByCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long value;
+ private byte[] rawKey;
+
+ public IncrByCommand() {
+ }
+
+ public IncrByCommand(String key, long value) {
+ this(key, value, null);
+ }
+
+ public IncrByCommand(String key, long value, byte[] rawKey) {
+ this.key = key;
+ this.value = value;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getValue() {
+ return value;
+ }
+
+ public void setValue(long value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "IncrByCommand{" +
+ "key='" + key + '\'' +
+ ", value=" + value +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/IncrByTypeOffsetIncrement.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/IncrByTypeOffsetIncrement.java
new file mode 100644
index 00000000..a0b7ef62
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/IncrByTypeOffsetIncrement.java
@@ -0,0 +1,93 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+public class IncrByTypeOffsetIncrement implements Statement {
+
+ private static final long serialVersionUID = 1L;
+
+ private String type;
+ private String offset;
+ private long increment;
+ private byte[] rawType;
+ private byte[] rawOffset;
+
+ public IncrByTypeOffsetIncrement() {
+ }
+
+ public IncrByTypeOffsetIncrement(String type, String offset, long increment) {
+ this(type, offset, increment, null, null);
+ }
+
+ public IncrByTypeOffsetIncrement(String type, String offset, long increment, byte[] rawType, byte[] rawOffset) {
+ this.type = type;
+ this.offset = offset;
+ this.increment = increment;
+ this.rawType = rawType;
+ this.rawOffset = rawOffset;
+ }
+
+ public String getType() {
+ return type;
+ }
+
+ public void setType(String type) {
+ this.type = type;
+ }
+
+ public String getOffset() {
+ return offset;
+ }
+
+ public void setOffset(String offset) {
+ this.offset = offset;
+ }
+
+ public long getIncrement() {
+ return increment;
+ }
+
+ public void setIncrement(long increment) {
+ this.increment = increment;
+ }
+
+ public byte[] getRawType() {
+ return rawType;
+ }
+
+ public void setRawType(byte[] rawType) {
+ this.rawType = rawType;
+ }
+
+ public byte[] getRawOffset() {
+ return rawOffset;
+ }
+
+ public void setRawOffset(byte[] rawOffset) {
+ this.rawOffset = rawOffset;
+ }
+
+ @Override
+ public String toString() {
+ return "IncrByTypeOffsetIncrement{" +
+ "type='" + type + '\'' +
+ ", offset='" + offset + '\'' +
+ ", increment=" + increment +
+ '}';
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/IncrCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/IncrCommand.java
new file mode 100644
index 00000000..e85c14e6
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/IncrCommand.java
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class IncrCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private byte[] rawKey;
+
+ public IncrCommand() {
+ }
+
+ public IncrCommand(String key) {
+ this(key, null);
+ }
+
+ public IncrCommand(String key, byte[] rawKey) {
+ this.key = key;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "IncrCommand{" +
+ "key='" + key + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LInsertCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LInsertCommand.java
new file mode 100644
index 00000000..ae91538d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LInsertCommand.java
@@ -0,0 +1,117 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class LInsertCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private LInsertType lInsertType;
+ private String pivot;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawPivot;
+ private byte[] rawValue;
+
+ public LInsertCommand() {
+ }
+
+ public LInsertCommand(String key, LInsertType lInsertType, String pivot, String value) {
+ this(key, lInsertType, pivot, value, null, null, null);
+ }
+
+ public LInsertCommand(String key, LInsertType lInsertType, String pivot, String value, byte[] rawKey,
+ byte[] rawPivot, byte[] rawValue) {
+ this.key = key;
+ this.lInsertType = lInsertType;
+ this.pivot = pivot;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawPivot = rawPivot;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public LInsertType getlInsertType() {
+ return lInsertType;
+ }
+
+ public void setlInsertType(LInsertType lInsertType) {
+ this.lInsertType = lInsertType;
+ }
+
+ public String getPivot() {
+ return pivot;
+ }
+
+ public void setPivot(String pivot) {
+ this.pivot = pivot;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawPivot() {
+ return rawPivot;
+ }
+
+ public void setRawPivot(byte[] rawPivot) {
+ this.rawPivot = rawPivot;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "LInsertCommand{" +
+ "key='" + key + '\'' +
+ ", lInsertType=" + lInsertType +
+ ", pivot='" + pivot + '\'' +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LInsertType.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LInsertType.java
new file mode 100644
index 00000000..4d1be797
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LInsertType.java
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+
+public enum LInsertType implements Serializable {
+ BEFORE, AFTER
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LPopCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LPopCommand.java
new file mode 100644
index 00000000..f52b8fae
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LPopCommand.java
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class LPopCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private byte[] rawKey;
+
+ public LPopCommand() {
+ }
+
+ public LPopCommand(String key) {
+ this(key, null);
+ }
+
+ public LPopCommand(String key, byte[] rawKey) {
+ this.key = key;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "LPopCommand{" +
+ "key='" + key + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LPushCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LPushCommand.java
new file mode 100644
index 00000000..aaadb473
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LPushCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class LPushCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String[] values;
+ private byte[] rawKey;
+ private byte[][] rawValues;
+
+ public LPushCommand() {
+ }
+
+ public LPushCommand(String key, String[] values) {
+ this(key, values, null, null);
+ }
+
+ public LPushCommand(String key, String[] values, byte[] rawKey, byte[][] rawValues) {
+ this.key = key;
+ this.values = values;
+ this.rawKey = rawKey;
+ this.rawValues = rawValues;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String[] getValues() {
+ return values;
+ }
+
+ public void setValues(String[] values) {
+ this.values = values;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[][] getRawValues() {
+ return rawValues;
+ }
+
+ public void setRawValues(byte[][] rawValues) {
+ this.rawValues = rawValues;
+ }
+
+ @Override
+ public String toString() {
+ return "LPushCommand{" +
+ "key='" + key + '\'' +
+ ", values=" + Arrays.toString(values) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LPushXCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LPushXCommand.java
new file mode 100644
index 00000000..56ae4481
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LPushXCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class LPushXCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String[] values;
+ private byte[] rawKey;
+ private byte[][] rawValues;
+
+ public LPushXCommand() {
+ }
+
+ public LPushXCommand(String key, String[] values) {
+ this(key, values, null, null);
+ }
+
+ public LPushXCommand(String key, String[] values, byte[] rawKey, byte[][] rawValues) {
+ this.key = key;
+ this.values = values;
+ this.rawKey = rawKey;
+ this.rawValues = rawValues;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String[] getValues() {
+ return values;
+ }
+
+ public void setValues(String[] values) {
+ this.values = values;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[][] getRawValues() {
+ return rawValues;
+ }
+
+ public void setRawValues(byte[][] rawValues) {
+ this.rawValues = rawValues;
+ }
+
+ @Override
+ public String toString() {
+ return "LPushXCommand{" +
+ "key='" + key + '\'' +
+ ", values='" + Arrays.toString(values) + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LRemCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LRemCommand.java
new file mode 100644
index 00000000..54596af8
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LRemCommand.java
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class LRemCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long index;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawValue;
+
+ public LRemCommand() {
+ }
+
+ public LRemCommand(String key, long index, String value) {
+ this(key, index, value, null, null);
+ }
+
+ public LRemCommand(String key, long index, String value, byte[] rawKey, byte[] rawValue) {
+ this.key = key;
+ this.index = index;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getIndex() {
+ return index;
+ }
+
+ public void setIndex(long index) {
+ this.index = index;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "LRemCommand{" +
+ "key='" + key + '\'' +
+ ", index=" + index +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LSetCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LSetCommand.java
new file mode 100644
index 00000000..e263cab3
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LSetCommand.java
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class LSetCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long index;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawValue;
+
+ public LSetCommand() {
+ }
+
+ public LSetCommand(String key, long index, String value) {
+ this(key, index, value, null, null);
+ }
+
+ public LSetCommand(String key, long index, String value, byte[] rawKey, byte[] rawValue) {
+ this.key = key;
+ this.index = index;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getIndex() {
+ return index;
+ }
+
+ public void setIndex(long index) {
+ this.index = index;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "LSetCommand{" +
+ "key='" + key + '\'' +
+ ", index=" + index +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LTrimCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LTrimCommand.java
new file mode 100644
index 00000000..2b0db67f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/LTrimCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class LTrimCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long start;
+ private long stop;
+ private byte[] rawKey;
+
+ public LTrimCommand() {
+ }
+
+ public LTrimCommand(String key, long start, long stop) {
+ this(key, start, stop, null);
+ }
+
+ public LTrimCommand(String key, long start, long stop, byte[] rawKey) {
+ this.key = key;
+ this.start = start;
+ this.stop = stop;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getStart() {
+ return start;
+ }
+
+ public void setStart(long start) {
+ this.start = start;
+ }
+
+ public long getStop() {
+ return stop;
+ }
+
+ public void setStop(long stop) {
+ this.stop = stop;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "LTrimCommand{" +
+ "key='" + key + '\'' +
+ ", start=" + start +
+ ", stop=" + stop +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Limit.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Limit.java
new file mode 100644
index 00000000..d3865ab1
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Limit.java
@@ -0,0 +1,60 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+
+public class Limit implements Serializable {
+
+ private static final long serialVersionUID = 1L;
+
+ private long offset;
+ private long count;
+
+ public Limit() {
+ }
+
+ public Limit(long offset, long count) {
+ this.offset = offset;
+ this.count = count;
+ }
+
+ public long getOffset() {
+ return offset;
+ }
+
+ public void setOffset(long offset) {
+ this.offset = offset;
+ }
+
+ public long getCount() {
+ return count;
+ }
+
+ public void setCount(long count) {
+ this.count = count;
+ }
+
+ @Override
+ public String toString() {
+ return "Limit{" +
+ "offset=" + offset +
+ ", count=" + count +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MSetCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MSetCommand.java
new file mode 100644
index 00000000..f49a59da
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MSetCommand.java
@@ -0,0 +1,64 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Map;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class MSetCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private Map<String, String> kv;
+ private Map<byte[], byte[]> rawKv;
+
+ public MSetCommand() {
+ }
+
+ public MSetCommand(Map<String, String> kv) {
+ this(kv, null);
+ }
+
+ public MSetCommand(Map<String, String> kv, Map<byte[], byte[]> rawKv) {
+ this.kv = kv;
+ this.rawKv = rawKv;
+ }
+
+ public Map<String, String> getKv() {
+ return kv;
+ }
+
+ public void setKv(Map<String, String> kv) {
+ this.kv = kv;
+ }
+
+ public Map<byte[], byte[]> getRawKv() {
+ return rawKv;
+ }
+
+ public void setRawKv(Map<byte[], byte[]> rawKv) {
+ this.rawKv = rawKv;
+ }
+
+ @Override
+ public String toString() {
+ return "MSetCommand{" +
+ "kv=" + kv +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MSetNxCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MSetNxCommand.java
new file mode 100644
index 00000000..a0fe6669
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MSetNxCommand.java
@@ -0,0 +1,64 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Map;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class MSetNxCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private Map<String, String> kv;
+ private Map<byte[], byte[]> rawKv;
+
+ public MSetNxCommand() {
+ }
+
+ public MSetNxCommand(Map<String, String> kv) {
+ this(kv, null);
+ }
+
+ public MSetNxCommand(Map<String, String> kv, Map<byte[], byte[]> rawKv) {
+ this.kv = kv;
+ this.rawKv = rawKv;
+ }
+
+ public Map<String, String> getKv() {
+ return kv;
+ }
+
+ public void setKv(Map<String, String> kv) {
+ this.kv = kv;
+ }
+
+ public Map<byte[], byte[]> getRawKv() {
+ return rawKv;
+ }
+
+ public void setRawKv(Map<byte[], byte[]> rawKv) {
+ this.rawKv = rawKv;
+ }
+
+ @Override
+ public String toString() {
+ return "MSetNxCommand{" +
+ "kv=" + kv +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MoveCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MoveCommand.java
new file mode 100644
index 00000000..2e3f584a
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MoveCommand.java
@@ -0,0 +1,74 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class MoveCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private int db;
+ private byte[] rawKey;
+
+ public MoveCommand() {
+ }
+
+ public MoveCommand(String key, int db) {
+ this(key, db, null);
+ }
+
+ public MoveCommand(String key, int db, byte[] rawKey) {
+ this.key = key;
+ this.db = db;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public int getDb() {
+ return db;
+ }
+
+ public void setDb(int db) {
+ this.db = db;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "MoveCommand{" +
+ "key='" + key + '\'' +
+ ", db=" + db +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MultiCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MultiCommand.java
new file mode 100644
index 00000000..39274c9b
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/MultiCommand.java
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class MultiCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ public MultiCommand() {
+ }
+
+ @Override
+ public String toString() {
+ return "MultiCommand{}";
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Op.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Op.java
new file mode 100644
index 00000000..bbb8772a
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Op.java
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+
+public enum Op implements Serializable {
+ AND, OR, XOR, NOT
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/OrderType.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/OrderType.java
new file mode 100644
index 00000000..560ea69d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/OrderType.java
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+
+public enum OrderType implements Serializable {
+ ASC, DESC, NONE
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/OverFlow.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/OverFlow.java
new file mode 100644
index 00000000..0baccf16
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/OverFlow.java
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+import java.util.List;
+
+public class OverFlow implements Serializable {
+
+ private static final long serialVersionUID = 1L;
+
+ private OverFlowType overFlowType;
+ private List<Statement> statements;
+
+ public OverFlow() {
+ }
+
+ public OverFlow(OverFlowType overFlowType, List<Statement> statements) {
+ this.overFlowType = overFlowType;
+ this.statements = statements;
+ }
+
+ public OverFlowType getOverFlowType() {
+ return overFlowType;
+ }
+
+ public void setOverFlowType(OverFlowType overFlowType) {
+ this.overFlowType = overFlowType;
+ }
+
+ public List<Statement> getStatements() {
+ return statements;
+ }
+
+ public void setStatements(List<Statement> statements) {
+ this.statements = statements;
+ }
+
+ @Override
+ public String toString() {
+ return "OverFlow{" +
+ "overFlowType=" + overFlowType +
+ ", statements=" + statements +
+ '}';
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/OverFlowType.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/OverFlowType.java
new file mode 100644
index 00000000..d1d96839
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/OverFlowType.java
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+
+public enum OverFlowType implements Serializable {
+ WRAP, SAT, FAIL
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PExpireAtCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PExpireAtCommand.java
new file mode 100644
index 00000000..2163a4d0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PExpireAtCommand.java
@@ -0,0 +1,74 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class PExpireAtCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long ex;
+ private byte[] rawKey;
+
+ public PExpireAtCommand() {
+ }
+
+ public PExpireAtCommand(String key, long ex) {
+ this(key, ex, null);
+ }
+
+ public PExpireAtCommand(String key, long ex, byte[] rawKey) {
+ this.key = key;
+ this.ex = ex;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getEx() {
+ return ex;
+ }
+
+ public void setEx(long ex) {
+ this.ex = ex;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "PExpireAtCommand{" +
+ "key='" + key + '\'' +
+ ", ex=" + ex +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PExpireCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PExpireCommand.java
new file mode 100644
index 00000000..f947428d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PExpireCommand.java
@@ -0,0 +1,74 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class PExpireCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long ex;
+ private byte[] rawKey;
+
+ public PExpireCommand() {
+ }
+
+ public PExpireCommand(String key, long ex) {
+ this(key, ex, null);
+ }
+
+ public PExpireCommand(String key, long ex, byte[] rawKey) {
+ this.key = key;
+ this.ex = ex;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getEx() {
+ return ex;
+ }
+
+ public void setEx(long ex) {
+ this.ex = ex;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "PExpireCommand{" +
+ "key='" + key + '\'' +
+ ", ex=" + ex +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PFAddCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PFAddCommand.java
new file mode 100644
index 00000000..608d0f86
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PFAddCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class PFAddCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String[] elements;
+ private byte[] rawKey;
+ private byte[][] rawElements;
+
+ public PFAddCommand() {
+ }
+
+ public PFAddCommand(String key, String[] elements) {
+ this(key, elements, null, null);
+ }
+
+ public PFAddCommand(String key, String[] elements, byte[] rawKey, byte[][] rawElements) {
+ this.key = key;
+ this.elements = elements;
+ this.rawKey = rawKey;
+ this.rawElements = rawElements;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String[] getElements() {
+ return elements;
+ }
+
+ public void setElements(String[] elements) {
+ this.elements = elements;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[][] getRawElements() {
+ return rawElements;
+ }
+
+ public void setRawElements(byte[][] rawElements) {
+ this.rawElements = rawElements;
+ }
+
+ @Override
+ public String toString() {
+ return "PFAddCommand{" +
+ "key='" + key + '\'' +
+ ", element=" + Arrays.toString(elements) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PFCountCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PFCountCommand.java
new file mode 100644
index 00000000..71deadf8
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PFCountCommand.java
@@ -0,0 +1,64 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class PFCountCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String[] keys;
+ private byte[][] rawKeys;
+
+ public PFCountCommand() {
+ }
+
+ public PFCountCommand(String[] keys) {
+ this(keys, null);
+ }
+
+ public PFCountCommand(String[] keys, byte[][] rawKeys) {
+ this.keys = keys;
+ this.rawKeys = rawKeys;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ @Override
+ public String toString() {
+ return "PFCountCommand{" +
+ "keys=" + Arrays.toString(keys) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PFMergeCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PFMergeCommand.java
new file mode 100644
index 00000000..4b11e6ac
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PFMergeCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class PFMergeCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String destkey;
+ private String[] sourcekeys;
+ private byte[] rawDestkey;
+ private byte[][] rawSourcekeys;
+
+ public PFMergeCommand() {
+ }
+
+ public PFMergeCommand(String destkey, String[] sourcekeys) {
+ this(destkey, sourcekeys, null, null);
+ }
+
+ public PFMergeCommand(String destkey, String[] sourcekeys, byte[] rawDestkey, byte[][] rawSourcekeys) {
+ this.destkey = destkey;
+ this.sourcekeys = sourcekeys;
+ this.rawDestkey = rawDestkey;
+ this.rawSourcekeys = rawSourcekeys;
+ }
+
+ public String getDestkey() {
+ return destkey;
+ }
+
+ public void setDestkey(String destkey) {
+ this.destkey = destkey;
+ }
+
+ public String[] getSourcekeys() {
+ return sourcekeys;
+ }
+
+ public void setSourcekeys(String[] sourcekeys) {
+ this.sourcekeys = sourcekeys;
+ }
+
+ public byte[] getRawDestkey() {
+ return rawDestkey;
+ }
+
+ public void setRawDestkey(byte[] rawDestkey) {
+ this.rawDestkey = rawDestkey;
+ }
+
+ public byte[][] getRawSourcekeys() {
+ return rawSourcekeys;
+ }
+
+ public void setRawSourcekeys(byte[][] rawSourcekeys) {
+ this.rawSourcekeys = rawSourcekeys;
+ }
+
+ @Override
+ public String toString() {
+ return "PFMergeCommand{" +
+ "destkey='" + destkey + '\'' +
+ ", sourcekey=" + Arrays.toString(sourcekeys) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PSetExCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PSetExCommand.java
new file mode 100644
index 00000000..95ee9d99
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PSetExCommand.java
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class PSetExCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long ex;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawValue;
+
+ public PSetExCommand() {
+ }
+
+ public PSetExCommand(String key, long ex, String value) {
+ this(key, ex, value, null, null);
+ }
+
+ public PSetExCommand(String key, long ex, String value, byte[] rawKey, byte[] rawValue) {
+ this.key = key;
+ this.ex = ex;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getEx() {
+ return ex;
+ }
+
+ public void setEx(long ex) {
+ this.ex = ex;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "PSetExCommand{" +
+ "key='" + key + '\'' +
+ ", ex=" + ex +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PersistCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PersistCommand.java
new file mode 100644
index 00000000..2fc12621
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PersistCommand.java
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class PersistCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private byte[] rawKey;
+
+ public PersistCommand() {
+ }
+
+ public PersistCommand(String key) {
+ this(key, null);
+ }
+
+ public PersistCommand(String key, byte[] rawKey) {
+ this.key = key;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "PersistCommand{" +
+ "key='" + key + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PingCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PingCommand.java
new file mode 100644
index 00000000..2fa929e0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PingCommand.java
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class PingCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String message;
+ private byte[] rawMessage;
+
+ public PingCommand() {
+ }
+
+ public PingCommand(String message) {
+ this(message, null);
+ }
+
+ public PingCommand(String message, byte[] rawMessage) {
+ this.message = message;
+ this.rawMessage = rawMessage;
+ }
+
+ public String getMessage() {
+ return message;
+ }
+
+ public void setMessage(String message) {
+ this.message = message;
+ }
+
+ public byte[] getRawMessage() {
+ return rawMessage;
+ }
+
+ public void setRawMessage(byte[] rawMessage) {
+ this.rawMessage = rawMessage;
+ }
+
+ @Override
+ public String toString() {
+ return "PingCommand{" +
+ "message='" + message + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PublishCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PublishCommand.java
new file mode 100644
index 00000000..ad216c8c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/PublishCommand.java
@@ -0,0 +1,84 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class PublishCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String channel;
+ private String message;
+ private byte[] rawChannel;
+ private byte[] rawMessage;
+
+ public PublishCommand() {
+ }
+
+ public PublishCommand(String channel, String message) {
+ this(channel, message, null, null);
+ }
+
+ public PublishCommand(String channel, String message, byte[] rawChannel, byte[] rawMessage) {
+ this.channel = channel;
+ this.message = message;
+ this.rawChannel = rawChannel;
+ this.rawMessage = rawMessage;
+ }
+
+ public String getChannel() {
+ return channel;
+ }
+
+ public void setChannel(String channel) {
+ this.channel = channel;
+ }
+
+ public String getMessage() {
+ return message;
+ }
+
+ public void setMessage(String message) {
+ this.message = message;
+ }
+
+ public byte[] getRawChannel() {
+ return rawChannel;
+ }
+
+ public void setRawChannel(byte[] rawChannel) {
+ this.rawChannel = rawChannel;
+ }
+
+ public byte[] getRawMessage() {
+ return rawMessage;
+ }
+
+ public void setRawMessage(byte[] rawMessage) {
+ this.rawMessage = rawMessage;
+ }
+
+ @Override
+ public String toString() {
+ return "PublishCommand{" +
+ "channel='" + channel + '\'' +
+ ", message='" + message + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPopCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPopCommand.java
new file mode 100644
index 00000000..5a7d28e3
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPopCommand.java
@@ -0,0 +1,63 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class RPopCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private byte[] rawKey;
+
+ public RPopCommand() {
+ }
+
+ public RPopCommand(String key) {
+ this(key, null);
+ }
+
+ public RPopCommand(String key, byte[] rawKey) {
+ this.key = key;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "RPopCommand{" +
+ "key='" + key + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPopLPushCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPopLPushCommand.java
new file mode 100644
index 00000000..2271faf3
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPopLPushCommand.java
@@ -0,0 +1,84 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class RPopLPushCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String source;
+ private String destination;
+ private byte[] rawSource;
+ private byte[] rawDestination;
+
+ public RPopLPushCommand() {
+ }
+
+ public RPopLPushCommand(String source, String destination) {
+ this(source, destination, null, null);
+ }
+
+ public RPopLPushCommand(String source, String destination, byte[] rawSource, byte[] rawDestination) {
+ this.source = source;
+ this.destination = destination;
+ this.rawSource = rawSource;
+ this.rawDestination = rawDestination;
+ }
+
+ public String getSource() {
+ return source;
+ }
+
+ public void setSource(String source) {
+ this.source = source;
+ }
+
+ public String getDestination() {
+ return destination;
+ }
+
+ public void setDestination(String destination) {
+ this.destination = destination;
+ }
+
+ public byte[] getRawSource() {
+ return rawSource;
+ }
+
+ public void setRawSource(byte[] rawSource) {
+ this.rawSource = rawSource;
+ }
+
+ public byte[] getRawDestination() {
+ return rawDestination;
+ }
+
+ public void setRawDestination(byte[] rawDestination) {
+ this.rawDestination = rawDestination;
+ }
+
+ @Override
+ public String toString() {
+ return "RPopLPushCommand{" +
+ "source='" + source + '\'' +
+ ", destination='" + destination + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPushCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPushCommand.java
new file mode 100644
index 00000000..9522693c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPushCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class RPushCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String[] values;
+ private byte[] rawKey;
+ private byte[][] rawValues;
+
+ public RPushCommand() {
+ }
+
+ public RPushCommand(String key, String[] values) {
+ this(key, values, null, null);
+ }
+
+ public RPushCommand(String key, String[] values, byte[] rawKey, byte[][] rawValues) {
+ this.key = key;
+ this.values = values;
+ this.rawKey = rawKey;
+ this.rawValues = rawValues;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String[] getValues() {
+ return values;
+ }
+
+ public void setValues(String[] values) {
+ this.values = values;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[][] getRawValues() {
+ return rawValues;
+ }
+
+ public void setRawValues(byte[][] rawValues) {
+ this.rawValues = rawValues;
+ }
+
+ @Override
+ public String toString() {
+ return "RPushCommand{" +
+ "key='" + key + '\'' +
+ ", values=" + Arrays.toString(values) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPushXCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPushXCommand.java
new file mode 100644
index 00000000..19b00907
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RPushXCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class RPushXCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String[] values;
+ private byte[] rawKey;
+ private byte[][] rawValues;
+
+ public RPushXCommand() {
+ }
+
+ public RPushXCommand(String key, String[] values) {
+ this(key, values, null, null);
+ }
+
+ public RPushXCommand(String key, String[] values, byte[] rawKey, byte[][] rawValues) {
+ this.key = key;
+ this.values = values;
+ this.rawKey = rawKey;
+ this.rawValues = rawValues;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String[] getValues() {
+ return values;
+ }
+
+ public void setValues(String[] values) {
+ this.values = values;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[][] getRawValues() {
+ return rawValues;
+ }
+
+ public void setRawValues(byte[][] rawValues) {
+ this.rawValues = rawValues;
+ }
+
+ @Override
+ public String toString() {
+ return "RPushXCommand{" +
+ "key='" + key + '\'' +
+ ", values=" + Arrays.toString(values) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RenameCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RenameCommand.java
new file mode 100644
index 00000000..35fe9882
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RenameCommand.java
@@ -0,0 +1,84 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class RenameCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String newKey;
+ private byte[] rawKey;
+ private byte[] rawNewKey;
+
+ public RenameCommand() {
+ }
+
+ public RenameCommand(String key, String newKey) {
+ this(key, newKey, null, null);
+ }
+
+ public RenameCommand(String key, String newKey, byte[] rawKey, byte[] rawNewKey) {
+ this.key = key;
+ this.newKey = newKey;
+ this.rawKey = rawKey;
+ this.rawNewKey = rawNewKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getNewKey() {
+ return newKey;
+ }
+
+ public void setNewKey(String newKey) {
+ this.newKey = newKey;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawNewKey() {
+ return rawNewKey;
+ }
+
+ public void setRawNewKey(byte[] rawNewKey) {
+ this.rawNewKey = rawNewKey;
+ }
+
+ @Override
+ public String toString() {
+ return "RenameCommand{" +
+ "key='" + key + '\'' +
+ ", newKey=" + newKey +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RenameNxCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RenameNxCommand.java
new file mode 100644
index 00000000..9b856f67
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RenameNxCommand.java
@@ -0,0 +1,84 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class RenameNxCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String newKey;
+ private byte[] rawKey;
+ private byte[] rawNewKey;
+
+ public RenameNxCommand() {
+ }
+
+ public RenameNxCommand(String key, String newKey) {
+ this(key, newKey, null, null);
+ }
+
+ public RenameNxCommand(String key, String newKey, byte[] rawKey, byte[] rawNewKey) {
+ this.key = key;
+ this.newKey = newKey;
+ this.rawKey = rawKey;
+ this.rawNewKey = rawNewKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getNewKey() {
+ return newKey;
+ }
+
+ public void setNewKey(String newKey) {
+ this.newKey = newKey;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawNewKey() {
+ return rawNewKey;
+ }
+
+ public void setRawNewKey(byte[] rawNewKey) {
+ this.rawNewKey = rawNewKey;
+ }
+
+ @Override
+ public String toString() {
+ return "RenameNxCommand{" +
+ "key='" + key + '\'' +
+ ", newKey=" + newKey +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RestoreCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RestoreCommand.java
new file mode 100644
index 00000000..d7b83171
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/RestoreCommand.java
@@ -0,0 +1,107 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class RestoreCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long ttl;
+ private String serializedValue;
+ private Boolean isReplace;
+ private byte[] rawKey;
+ private byte[] rawSerializedValue;
+
+ public RestoreCommand() {
+ }
+
+ public RestoreCommand(String key, long ttl, String serializedValue, Boolean isReplace) {
+ this(key, ttl, serializedValue, isReplace, null, null);
+ }
+
+ public RestoreCommand(String key, long ttl, String serializedValue, Boolean isReplace, byte[] rawKey,
+ byte[] rawSerializedValue) {
+ this.key = key;
+ this.ttl = ttl;
+ this.serializedValue = serializedValue;
+ this.isReplace = isReplace;
+ this.rawKey = rawKey;
+ this.rawSerializedValue = rawSerializedValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getTtl() {
+ return ttl;
+ }
+
+ public void setTtl(long ttl) {
+ this.ttl = ttl;
+ }
+
+ public String getSerializedValue() {
+ return serializedValue;
+ }
+
+ public void setSerializedValue(String serializedValue) {
+ this.serializedValue = serializedValue;
+ }
+
+ public Boolean getReplace() {
+ return isReplace;
+ }
+
+ public void setReplace(Boolean replace) {
+ isReplace = replace;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawSerializedValue() {
+ return rawSerializedValue;
+ }
+
+ public void setRawSerializedValue(byte[] rawSerializedValue) {
+ this.rawSerializedValue = rawSerializedValue;
+ }
+
+ @Override
+ public String toString() {
+ return "RestoreCommand{" +
+ "key='" + key + '\'' +
+ ", ttl=" + ttl +
+ ", serializedValue='" + serializedValue + '\'' +
+ ", isReplace=" + isReplace +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SAddCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SAddCommand.java
new file mode 100644
index 00000000..c83ce0f9
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SAddCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SAddCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String[] members;
+ private byte[] rawKey;
+ private byte[][] rawMembers;
+
+ public SAddCommand() {
+ }
+
+ public SAddCommand(String key, String[] members) {
+ this(key, members, null, null);
+ }
+
+ public SAddCommand(String key, String[] members, byte[] rawKey, byte[][] rawMembers) {
+ this.key = key;
+ this.members = members;
+ this.rawKey = rawKey;
+ this.rawMembers = rawMembers;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String[] getMembers() {
+ return members;
+ }
+
+ public void setMembers(String[] members) {
+ this.members = members;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[][] getRawMembers() {
+ return rawMembers;
+ }
+
+ public void setRawMembers(byte[][] rawMembers) {
+ this.rawMembers = rawMembers;
+ }
+
+ @Override
+ public String toString() {
+ return "SAddCommand{" +
+ "key='" + key + '\'' +
+ ", members=" + Arrays.toString(members) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SDiffStoreCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SDiffStoreCommand.java
new file mode 100644
index 00000000..54fdbee0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SDiffStoreCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SDiffStoreCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String destination;
+ private String[] keys;
+ private byte[] rawDestination;
+ private byte[][] rawKeys;
+
+ public SDiffStoreCommand() {
+ }
+
+ public SDiffStoreCommand(String destination, String[] keys) {
+ this(destination, keys, null, null);
+ }
+
+ public SDiffStoreCommand(String destination, String[] keys, byte[] rawDestination, byte[][] rawKeys) {
+ this.destination = destination;
+ this.keys = keys;
+ this.rawDestination = rawDestination;
+ this.rawKeys = rawKeys;
+ }
+
+ public String getDestination() {
+ return destination;
+ }
+
+ public void setDestination(String destination) {
+ this.destination = destination;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public byte[] getRawDestination() {
+ return rawDestination;
+ }
+
+ public void setRawDestination(byte[] rawDestination) {
+ this.rawDestination = rawDestination;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ @Override
+ public String toString() {
+ return "SDiffStoreCommand{" +
+ "destination='" + destination + '\'' +
+ ", key=" + Arrays.toString(keys) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SInterStoreCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SInterStoreCommand.java
new file mode 100644
index 00000000..1b038854
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SInterStoreCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SInterStoreCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String destination;
+ private String[] keys;
+ private byte[] rawDestination;
+ private byte[][] rawKeys;
+
+ public SInterStoreCommand() {
+ }
+
+ public SInterStoreCommand(String destination, String[] keys) {
+ this(destination, keys, null, null);
+ }
+
+ public SInterStoreCommand(String destination, String[] keys, byte[] rawDestination, byte[][] rawKeys) {
+ this.destination = destination;
+ this.keys = keys;
+ this.rawDestination = rawDestination;
+ this.rawKeys = rawKeys;
+ }
+
+ public String getDestination() {
+ return destination;
+ }
+
+ public void setDestination(String destination) {
+ this.destination = destination;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public byte[] getRawDestination() {
+ return rawDestination;
+ }
+
+ public void setRawDestination(byte[] rawDestination) {
+ this.rawDestination = rawDestination;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ @Override
+ public String toString() {
+ return "SInterStoreCommand{" +
+ "destination='" + destination + '\'' +
+ ", key=" + Arrays.toString(keys) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SMoveCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SMoveCommand.java
new file mode 100644
index 00000000..10cd4ea8
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SMoveCommand.java
@@ -0,0 +1,106 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SMoveCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String source;
+ private String destination;
+ private String member;
+ private byte[] rawSource;
+ private byte[] rawDestination;
+ private byte[] rawMember;
+
+ public SMoveCommand() {
+ }
+
+ public SMoveCommand(String source, String destination, String member) {
+ this(source, destination, member, null, null, null);
+ }
+
+ public SMoveCommand(String source, String destination, String member, byte[] rawSource, byte[] rawDestination,
+ byte[] rawMember) {
+ this.source = source;
+ this.destination = destination;
+ this.member = member;
+ this.rawSource = rawSource;
+ this.rawDestination = rawDestination;
+ this.rawMember = rawMember;
+ }
+
+ public String getSource() {
+ return source;
+ }
+
+ public void setSource(String source) {
+ this.source = source;
+ }
+
+ public String getDestination() {
+ return destination;
+ }
+
+ public void setDestination(String destination) {
+ this.destination = destination;
+ }
+
+ public String getMember() {
+ return member;
+ }
+
+ public void setMember(String member) {
+ this.member = member;
+ }
+
+ public byte[] getRawSource() {
+ return rawSource;
+ }
+
+ public void setRawSource(byte[] rawSource) {
+ this.rawSource = rawSource;
+ }
+
+ public byte[] getRawDestination() {
+ return rawDestination;
+ }
+
+ public void setRawDestination(byte[] rawDestination) {
+ this.rawDestination = rawDestination;
+ }
+
+ public byte[] getRawMember() {
+ return rawMember;
+ }
+
+ public void setRawMember(byte[] rawMember) {
+ this.rawMember = rawMember;
+ }
+
+ @Override
+ public String toString() {
+ return "SMoveCommand{" +
+ "source='" + source + '\'' +
+ ", destination='" + destination + '\'' +
+ ", member='" + member + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SRemCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SRemCommand.java
new file mode 100644
index 00000000..f1091599
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SRemCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SRemCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String[] members;
+ private byte[] rawKey;
+ private byte[][] rawMembers;
+
+ public SRemCommand() {
+ }
+
+ public SRemCommand(String key, String[] members) {
+ this(key, members, null, null);
+ }
+
+ public SRemCommand(String key, String[] members, byte[] rawKey, byte[][] rawMembers) {
+ this.key = key;
+ this.members = members;
+ this.rawKey = rawKey;
+ this.rawMembers = rawMembers;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String[] getMembers() {
+ return members;
+ }
+
+ public void setMembers(String[] members) {
+ this.members = members;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[][] getRawMembers() {
+ return rawMembers;
+ }
+
+ public void setRawMembers(byte[][] rawMembers) {
+ this.rawMembers = rawMembers;
+ }
+
+ @Override
+ public String toString() {
+ return "SRemCommand{" +
+ "key='" + key + '\'' +
+ ", members=" + Arrays.toString(members) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SUnionStoreCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SUnionStoreCommand.java
new file mode 100644
index 00000000..8cd412d7
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SUnionStoreCommand.java
@@ -0,0 +1,86 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SUnionStoreCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String destination;
+ private String[] keys;
+ private byte[] rawDestination;
+ private byte[][] rawKeys;
+
+ public SUnionStoreCommand() {
+ }
+
+ public SUnionStoreCommand(String destination, String[] keys) {
+ this(destination, keys, null, null);
+ }
+
+ public SUnionStoreCommand(String destination, String[] keys, byte[] rawDestination, byte[][] rawKeys) {
+ this.destination = destination;
+ this.keys = keys;
+ this.rawDestination = rawDestination;
+ this.rawKeys = rawKeys;
+ }
+
+ public String getDestination() {
+ return destination;
+ }
+
+ public void setDestination(String destination) {
+ this.destination = destination;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public byte[] getRawDestination() {
+ return rawDestination;
+ }
+
+ public void setRawDestination(byte[] rawDestination) {
+ this.rawDestination = rawDestination;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ @Override
+ public String toString() {
+ return "SUnionStoreCommand{" +
+ "destination='" + destination + '\'' +
+ ", key=" + Arrays.toString(keys) +
+ '}';
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ScriptCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ScriptCommand.java
new file mode 100644
index 00000000..f8efcb8b
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ScriptCommand.java
@@ -0,0 +1,26 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public abstract class ScriptCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ScriptFlushCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ScriptFlushCommand.java
new file mode 100644
index 00000000..83dd9713
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ScriptFlushCommand.java
@@ -0,0 +1,28 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+public class ScriptFlushCommand extends ScriptCommand {
+
+ private static final long serialVersionUID = 1L;
+
+ @Override
+ public String toString() {
+ return "ScriptFlushCommand{}";
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ScriptLoadCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ScriptLoadCommand.java
new file mode 100644
index 00000000..56dcb700
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ScriptLoadCommand.java
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+public class ScriptLoadCommand extends ScriptCommand {
+
+ private static final long serialVersionUID = 1L;
+
+ private String script;
+ private byte[] rawScript;
+
+ public ScriptLoadCommand() {
+ }
+
+ public ScriptLoadCommand(String script) {
+ this(script, null);
+ }
+
+ public ScriptLoadCommand(String script, byte[] rawScript) {
+ this.script = script;
+ this.rawScript = rawScript;
+ }
+
+ public String getScript() {
+ return script;
+ }
+
+ public void setScript(String script) {
+ this.script = script;
+ }
+
+ public byte[] getRawScript() {
+ return rawScript;
+ }
+
+ public void setRawScript(byte[] rawScript) {
+ this.rawScript = rawScript;
+ }
+
+ @Override
+ public String toString() {
+ return "ScriptLoadCommand{" +
+ "script='" + script + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SelectCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SelectCommand.java
new file mode 100644
index 00000000..f7a9a7fe
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SelectCommand.java
@@ -0,0 +1,49 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SelectCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private int index;
+
+ public SelectCommand() {
+ }
+
+ public SelectCommand(int index) {
+ this.index = index;
+ }
+
+ public int getIndex() {
+ return index;
+ }
+
+ public void setIndex(int index) {
+ this.index = index;
+ }
+
+ @Override
+ public String toString() {
+ return "SelectCommand{" +
+ "index='" + index + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetBitCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetBitCommand.java
new file mode 100644
index 00000000..36dff175
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetBitCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SetBitCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long offset;
+ private int value;
+ private byte[] rawKey;
+
+ public SetBitCommand() {
+ }
+
+ public SetBitCommand(String key, long offset, int value) {
+ this(key, offset, value, null);
+ }
+
+ public SetBitCommand(String key, long offset, int value, byte[] rawKey) {
+ this.key = key;
+ this.offset = offset;
+ this.value = value;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getOffset() {
+ return offset;
+ }
+
+ public void setOffset(long offset) {
+ this.offset = offset;
+ }
+
+ public int getValue() {
+ return value;
+ }
+
+ public void setValue(int value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "SetBitCommand{" +
+ "key='" + key + '\'' +
+ ", offset=" + offset +
+ ", value=" + value +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetCommand.java
new file mode 100644
index 00000000..ddc467c7
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetCommand.java
@@ -0,0 +1,118 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SetCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String value;
+ private Integer ex;
+ private Long px;
+ private ExistType existType;
+ private byte[] rawKey;
+ private byte[] rawValue;
+
+ public SetCommand() {
+ }
+
+ public SetCommand(String key, String value, Integer ex, Long px, ExistType existType) {
+ this(key, value, ex, px, existType, null, null);
+ }
+
+ public SetCommand(String key, String value, Integer ex, Long px, ExistType existType, byte[] rawKey,
+ byte[] rawValue) {
+ this.key = key;
+ this.value = value;
+ this.ex = ex;
+ this.px = px;
+ this.existType = existType;
+ this.rawKey = rawKey;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public Integer getEx() {
+ return ex;
+ }
+
+ public void setEx(Integer ex) {
+ this.ex = ex;
+ }
+
+ public Long getPx() {
+ return px;
+ }
+
+ public void setPx(Long px) {
+ this.px = px;
+ }
+
+ public ExistType getExistType() {
+ return existType;
+ }
+
+ public void setExistType(ExistType existType) {
+ this.existType = existType;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "SetCommand{" +
+ "name='" + key + '\'' +
+ ", value='" + value + '\'' +
+ ", ex=" + ex +
+ ", px=" + px +
+ ", existType=" + existType +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetExCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetExCommand.java
new file mode 100644
index 00000000..8a4b4b72
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetExCommand.java
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SetExCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private int ex;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawValue;
+
+ public SetExCommand() {
+ }
+
+ public SetExCommand(String key, int ex, String value) {
+ this(key, ex, value, null, null);
+ }
+
+ public SetExCommand(String key, int ex, String value, byte[] rawKey, byte[] rawValue) {
+ this.key = key;
+ this.ex = ex;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public int getEx() {
+ return ex;
+ }
+
+ public void setEx(int ex) {
+ this.ex = ex;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "SetExCommand{" +
+ "key='" + key + '\'' +
+ ", ex=" + ex +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetNxCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetNxCommand.java
new file mode 100644
index 00000000..50d2cbd2
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetNxCommand.java
@@ -0,0 +1,84 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SetNxCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawValue;
+
+ public SetNxCommand() {
+ }
+
+ public SetNxCommand(String key, String value) {
+ this(key, value, null, null);
+ }
+
+ public SetNxCommand(String key, String value, byte[] rawKey, byte[] rawValue) {
+ this.key = key;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "SetNxCommand{" +
+ "key='" + key + '\'' +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetRangeCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetRangeCommand.java
new file mode 100644
index 00000000..244615d3
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetRangeCommand.java
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SetRangeCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long index;
+ private String value;
+ private byte[] rawKey;
+ private byte[] rawValue;
+
+ public SetRangeCommand() {
+ }
+
+ public SetRangeCommand(String key, long index, String value) {
+ this(key, index, value, null, null);
+ }
+
+ public SetRangeCommand(String key, long index, String value, byte[] rawKey, byte[] rawValue) {
+ this.key = key;
+ this.index = index;
+ this.value = value;
+ this.rawKey = rawKey;
+ this.rawValue = rawValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getIndex() {
+ return index;
+ }
+
+ public void setIndex(long index) {
+ this.index = index;
+ }
+
+ public String getValue() {
+ return value;
+ }
+
+ public void setValue(String value) {
+ this.value = value;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+
+ @Override
+ public String toString() {
+ return "SetRangeCommand{" +
+ "key='" + key + '\'' +
+ ", index=" + index +
+ ", value='" + value + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetTypeOffsetValue.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetTypeOffsetValue.java
new file mode 100644
index 00000000..d811229d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SetTypeOffsetValue.java
@@ -0,0 +1,93 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+public class SetTypeOffsetValue implements Statement {
+
+ private static final long serialVersionUID = 1L;
+
+ private String type;
+ private String offset;
+ private long value;
+ private byte[] rawType;
+ private byte[] rawOffset;
+
+ public SetTypeOffsetValue() {
+ }
+
+ public SetTypeOffsetValue(String type, String offset, long value) {
+ this(type, offset, value, null, null);
+ }
+
+ public SetTypeOffsetValue(String type, String offset, long value, byte[] rawType, byte[] rawOffset) {
+ this.type = type;
+ this.offset = offset;
+ this.value = value;
+ this.rawType = rawType;
+ this.rawOffset = rawOffset;
+ }
+
+ public String getType() {
+ return type;
+ }
+
+ public void setType(String type) {
+ this.type = type;
+ }
+
+ public String getOffset() {
+ return offset;
+ }
+
+ public void setOffset(String offset) {
+ this.offset = offset;
+ }
+
+ public long getValue() {
+ return value;
+ }
+
+ public void setValue(long value) {
+ this.value = value;
+ }
+
+ public byte[] getRawType() {
+ return rawType;
+ }
+
+ public void setRawType(byte[] rawType) {
+ this.rawType = rawType;
+ }
+
+ public byte[] getRawOffset() {
+ return rawOffset;
+ }
+
+ public void setRawOffset(byte[] rawOffset) {
+ this.rawOffset = rawOffset;
+ }
+
+ @Override
+ public String toString() {
+ return "SetTypeOffsetValue{" +
+ "type='" + type + '\'' +
+ ", offset='" + offset + '\'' +
+ ", value=" + value +
+ '}';
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SortCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SortCommand.java
new file mode 100644
index 00000000..9f154601
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SortCommand.java
@@ -0,0 +1,166 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SortCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String byPattern;
+ private Limit limit;
+ private String[] getPatterns;
+ private OrderType order;
+ private Boolean alpha;
+ private String destination;
+ private byte[] rawKey;
+ private byte[] rawByPattern;
+ private byte[][] rawGetPatterns;
+ private byte[] rawDestination;
+
+ public SortCommand() {
+ }
+
+ public SortCommand(String key, String byPattern, Limit limit, String[] getPatterns, OrderType order, Boolean alpha,
+ String destination) {
+ this(key, byPattern, limit, getPatterns, order, alpha, destination, null, null, null, null);
+ }
+
+ public SortCommand(String key, String byPattern, Limit limit, String[] getPatterns, OrderType order, Boolean alpha,
+ String destination, byte[] rawKey, byte[] rawByPattern, byte[][] rawGetPatterns, byte[] rawDestination) {
+ this.key = key;
+ this.byPattern = byPattern;
+ this.limit = limit;
+ this.getPatterns = getPatterns;
+ this.order = order;
+ this.alpha = alpha;
+ this.destination = destination;
+ this.rawKey = rawKey;
+ this.rawByPattern = rawByPattern;
+ this.rawGetPatterns = rawGetPatterns;
+ this.rawDestination = rawDestination;
+ }
+
+ public static long getSerialVersionUID() {
+ return serialVersionUID;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getByPattern() {
+ return byPattern;
+ }
+
+ public void setByPattern(String byPattern) {
+ this.byPattern = byPattern;
+ }
+
+ public Limit getLimit() {
+ return limit;
+ }
+
+ public void setLimit(Limit limit) {
+ this.limit = limit;
+ }
+
+ public String[] getGetPatterns() {
+ return getPatterns;
+ }
+
+ public void setGetPatterns(String[] getPatterns) {
+ this.getPatterns = getPatterns;
+ }
+
+ public OrderType getOrder() {
+ return order;
+ }
+
+ public void setOrder(OrderType order) {
+ this.order = order;
+ }
+
+ public Boolean getAlpha() {
+ return alpha;
+ }
+
+ public void setAlpha(Boolean alpha) {
+ this.alpha = alpha;
+ }
+
+ public String getDestination() {
+ return destination;
+ }
+
+ public void setDestination(String destination) {
+ this.destination = destination;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawByPattern() {
+ return rawByPattern;
+ }
+
+ public void setRawByPattern(byte[] rawByPattern) {
+ this.rawByPattern = rawByPattern;
+ }
+
+ public byte[][] getRawGetPatterns() {
+ return rawGetPatterns;
+ }
+
+ public void setRawGetPatterns(byte[][] rawGetPatterns) {
+ this.rawGetPatterns = rawGetPatterns;
+ }
+
+ public byte[] getRawDestination() {
+ return rawDestination;
+ }
+
+ public void setRawDestination(byte[] rawDestination) {
+ this.rawDestination = rawDestination;
+ }
+
+ @Override
+ public String toString() {
+ return "SortCommand{" +
+ "key='" + key + '\'' +
+ ", byPattern='" + byPattern + '\'' +
+ ", limit=" + limit +
+ ", getPatterns=" + Arrays.toString(getPatterns) +
+ ", order=" + order +
+ ", alpha=" + alpha +
+ ", destination='" + destination + '\'' +
+ '}';
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Statement.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Statement.java
new file mode 100644
index 00000000..a6bafb70
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/Statement.java
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.io.Serializable;
+
+public interface Statement extends Serializable {
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SwapDBCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SwapDBCommand.java
new file mode 100644
index 00000000..2aebac35
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/SwapDBCommand.java
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class SwapDBCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private int source;
+ private int target;
+
+ public SwapDBCommand() {
+
+ }
+
+ public SwapDBCommand(int source, int target) {
+ this.source = source;
+ this.target = target;
+ }
+
+ public int getSource() {
+ return source;
+ }
+
+ public void setSource(int source) {
+ this.source = source;
+ }
+
+ public int getTarget() {
+ return target;
+ }
+
+ public void setTarget(int target) {
+ this.target = target;
+ }
+
+ @Override
+ public String toString() {
+ return "SwapDBCommand{" +
+ "source=" + source +
+ ", target=" + target +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/UnLinkCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/UnLinkCommand.java
new file mode 100644
index 00000000..4e445543
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/UnLinkCommand.java
@@ -0,0 +1,64 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class UnLinkCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String[] keys;
+ private byte[][] rawKeys;
+
+ public UnLinkCommand() {
+ }
+
+ public UnLinkCommand(String[] keys) {
+ this(keys, null);
+ }
+
+ public UnLinkCommand(String[] keys, byte[][] rawKeys) {
+ this.keys = keys;
+ this.rawKeys = rawKeys;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ @Override
+ public String toString() {
+ return "UnLinkCommand{" +
+ "keys=" + Arrays.toString(keys) +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZAddCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZAddCommand.java
new file mode 100644
index 00000000..46231b06
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZAddCommand.java
@@ -0,0 +1,115 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ZSetEntry;
+
+public class ZAddCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private ExistType existType;
+ private Boolean isCh;
+ private Boolean isIncr;
+ private ZSetEntry[] zSetEntries;
+ private byte[] rawKey;
+
+ public ZAddCommand() {
+ }
+
+ public ZAddCommand(String key, ExistType existType, Boolean isCh, Boolean isIncr, ZSetEntry[] zSetEntries) {
+ this(key, existType, isCh, isIncr, zSetEntries, null);
+ }
+
+ public ZAddCommand(String key, ExistType existType, Boolean isCh, Boolean isIncr, ZSetEntry[] zSetEntries,
+ byte[] rawKey) {
+ this.key = key;
+ this.existType = existType;
+ this.isCh = isCh;
+ this.isIncr = isIncr;
+ this.zSetEntries = zSetEntries;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public ExistType getExistType() {
+ return existType;
+ }
+
+ public void setExistType(ExistType existType) {
+ this.existType = existType;
+ }
+
+ public Boolean getCh() {
+ return isCh;
+ }
+
+ public void setCh(Boolean ch) {
+ isCh = ch;
+ }
+
+ public Boolean getIncr() {
+ return isIncr;
+ }
+
+ public void setIncr(Boolean incr) {
+ isIncr = incr;
+ }
+
+ public ZSetEntry[] getZSetEntries() {
+ return zSetEntries;
+ }
+
+ public ZSetEntry[] getzSetEntries() {
+ return zSetEntries;
+ }
+
+ public void setzSetEntries(ZSetEntry[] zSetEntries) {
+ this.zSetEntries = zSetEntries;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "ZAddCommand{" +
+ "key='" + key + '\'' +
+ ", existType=" + existType +
+ ", isCh=" + isCh +
+ ", isIncr=" + isIncr +
+ ", zSetEntries=" + Arrays.toString(zSetEntries) +
+ '}';
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZIncrByCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZIncrByCommand.java
new file mode 100644
index 00000000..81624ba8
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZIncrByCommand.java
@@ -0,0 +1,96 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ZIncrByCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private double increment;
+ private String member;
+ private byte[] rawKey;
+ private byte[] rawMember;
+
+ public ZIncrByCommand() {
+ }
+
+ public ZIncrByCommand(String key, double increment, String member) {
+ this(key, increment, member, null, null);
+ }
+
+ public ZIncrByCommand(String key, double increment, String member, byte[] rawKey, byte[] rawMember) {
+ this.key = key;
+ this.increment = increment;
+ this.member = member;
+ this.rawKey = rawKey;
+ this.rawMember = rawMember;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public double getIncrement() {
+ return increment;
+ }
+
+ public void setIncrement(double increment) {
+ this.increment = increment;
+ }
+
+ public String getMember() {
+ return member;
+ }
+
+ public void setMember(String member) {
+ this.member = member;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawMember() {
+ return rawMember;
+ }
+
+ public void setRawMember(byte[] rawMember) {
+ this.rawMember = rawMember;
+ }
+
+ @Override
+ public String toString() {
+ return "ZIncrByCommand{" +
+ "key='" + key + '\'' +
+ ", increment='" + increment + '\'' +
+ ", member='" + member + '\'' +
+ '}';
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZInterStoreCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZInterStoreCommand.java
new file mode 100644
index 00000000..f5a5154f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZInterStoreCommand.java
@@ -0,0 +1,121 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ZInterStoreCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String destination;
+ private int numkeys;
+ private String[] keys;
+ private double[] weights;
+ private AggregateType aggregateType;
+ private byte[] rawDestination;
+ private byte[][] rawKeys;
+
+ public ZInterStoreCommand() {
+ }
+
+ public ZInterStoreCommand(String destination, int numkeys, String[] keys, double[] weights,
+ AggregateType aggregateType) {
+ this(destination, numkeys, keys, weights, aggregateType, null, null);
+ }
+
+ public ZInterStoreCommand(String destination, int numkeys, String[] keys, double[] weights,
+ AggregateType aggregateType, byte[] rawDestination, byte[][] rawKeys) {
+ this.destination = destination;
+ this.numkeys = numkeys;
+ this.keys = keys;
+ this.weights = weights;
+ this.aggregateType = aggregateType;
+ this.rawDestination = rawDestination;
+ this.rawKeys = rawKeys;
+ }
+
+ public String getDestination() {
+ return destination;
+ }
+
+ public void setDestination(String destination) {
+ this.destination = destination;
+ }
+
+ public int getNumkeys() {
+ return numkeys;
+ }
+
+ public void setNumkeys(int numkeys) {
+ this.numkeys = numkeys;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public double[] getWeights() {
+ return weights;
+ }
+
+ public void setWeights(double[] weights) {
+ this.weights = weights;
+ }
+
+ public AggregateType getAggregateType() {
+ return aggregateType;
+ }
+
+ public void setAggregateType(AggregateType aggregateType) {
+ this.aggregateType = aggregateType;
+ }
+
+ public byte[] getRawDestination() {
+ return rawDestination;
+ }
+
+ public void setRawDestination(byte[] rawDestination) {
+ this.rawDestination = rawDestination;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ @Override
+ public String toString() {
+ return "ZInterStoreCommand{" +
+ "destination='" + destination + '\'' +
+ ", numkeys=" + numkeys +
+ ", keys=" + Arrays.toString(keys) +
+ ", weights=" + Arrays.toString(weights) +
+ ", aggregateType=" + aggregateType +
+ '}';
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemCommand.java
new file mode 100644
index 00000000..124a9e52
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemCommand.java
@@ -0,0 +1,86 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ZRemCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String[] members;
+ private byte[] rawKey;
+ private byte[][] rawMembers;
+
+ public ZRemCommand() {
+ }
+
+ public ZRemCommand(String key, String[] members) {
+ this(key, members, null, null);
+ }
+
+ public ZRemCommand(String key, String[] members, byte[] rawKey, byte[][] rawMembers) {
+ this.key = key;
+ this.members = members;
+ this.rawKey = rawKey;
+ this.rawMembers = rawMembers;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String[] getMembers() {
+ return members;
+ }
+
+ public void setMembers(String[] members) {
+ this.members = members;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[][] getRawMembers() {
+ return rawMembers;
+ }
+
+ public void setRawMembers(byte[][] rawMembers) {
+ this.rawMembers = rawMembers;
+ }
+
+ @Override
+ public String toString() {
+ return "ZRemCommand{" +
+ "key='" + key + '\'' +
+ ", members=" + Arrays.toString(members) +
+ '}';
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemRangeByLexCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemRangeByLexCommand.java
new file mode 100644
index 00000000..cfbeb418
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemRangeByLexCommand.java
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ZRemRangeByLexCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String min;
+ private String max;
+ private byte[] rawKey;
+ private byte[] rawMin;
+ private byte[] rawMax;
+
+ public ZRemRangeByLexCommand() {
+ }
+
+ public ZRemRangeByLexCommand(String key, String min, String max) {
+ this(key, min, max, null, null, null);
+ }
+
+ public ZRemRangeByLexCommand(String key, String min, String max, byte[] rawKey, byte[] rawMin, byte[] rawMax) {
+ this.key = key;
+ this.min = min;
+ this.max = max;
+ this.rawKey = rawKey;
+ this.rawMin = rawMin;
+ this.rawMax = rawMax;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getMin() {
+ return min;
+ }
+
+ public void setMin(String min) {
+ this.min = min;
+ }
+
+ public String getMax() {
+ return max;
+ }
+
+ public void setMax(String max) {
+ this.max = max;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawMin() {
+ return rawMin;
+ }
+
+ public void setRawMin(byte[] rawMin) {
+ this.rawMin = rawMin;
+ }
+
+ public byte[] getRawMax() {
+ return rawMax;
+ }
+
+ public void setRawMax(byte[] rawMax) {
+ this.rawMax = rawMax;
+ }
+
+ @Override
+ public String toString() {
+ return "ZRemRangeByLexCommand{" +
+ "key='" + key + '\'' +
+ ", min='" + min + '\'' +
+ ", max='" + max + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemRangeByRankCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemRangeByRankCommand.java
new file mode 100644
index 00000000..f4b0380d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemRangeByRankCommand.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ZRemRangeByRankCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private long start;
+ private long stop;
+ private byte[] rawKey;
+
+ public ZRemRangeByRankCommand() {
+ }
+
+ public ZRemRangeByRankCommand(String key, long start, long stop) {
+ this(key, start, stop, null);
+ }
+
+ public ZRemRangeByRankCommand(String key, long start, long stop, byte[] rawKey) {
+ this.key = key;
+ this.start = start;
+ this.stop = stop;
+ this.rawKey = rawKey;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public long getStart() {
+ return start;
+ }
+
+ public void setStart(long start) {
+ this.start = start;
+ }
+
+ public long getStop() {
+ return stop;
+ }
+
+ public void setStop(long stop) {
+ this.stop = stop;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ @Override
+ public String toString() {
+ return "ZRemRangeByRankCommand{" +
+ "key='" + key + '\'' +
+ ", start=" + start +
+ ", stop=" + stop +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemRangeByScoreCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemRangeByScoreCommand.java
new file mode 100644
index 00000000..76b35890
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZRemRangeByScoreCommand.java
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ZRemRangeByScoreCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String key;
+ private String min;
+ private String max;
+ private byte[] rawKey;
+ private byte[] rawMin;
+ private byte[] rawMax;
+
+ public ZRemRangeByScoreCommand() {
+ }
+
+ public ZRemRangeByScoreCommand(String key, String min, String max) {
+ this(key, min, max, null, null, null);
+ }
+
+ public ZRemRangeByScoreCommand(String key, String min, String max, byte[] rawKey, byte[] rawMin, byte[] rawMax) {
+ this.key = key;
+ this.min = min;
+ this.max = max;
+ this.rawKey = rawKey;
+ this.rawMin = rawMin;
+ this.rawMax = rawMax;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public String getMin() {
+ return min;
+ }
+
+ public void setMin(String min) {
+ this.min = min;
+ }
+
+ public String getMax() {
+ return max;
+ }
+
+ public void setMax(String max) {
+ this.max = max;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ public byte[] getRawMin() {
+ return rawMin;
+ }
+
+ public void setRawMin(byte[] rawMin) {
+ this.rawMin = rawMin;
+ }
+
+ public byte[] getRawMax() {
+ return rawMax;
+ }
+
+ public void setRawMax(byte[] rawMax) {
+ this.rawMax = rawMax;
+ }
+
+ @Override
+ public String toString() {
+ return "ZRemRangeByScoreCommand{" +
+ "key='" + key + '\'' +
+ ", min='" + min + '\'' +
+ ", max='" + max + '\'' +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZUnionStoreCommand.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZUnionStoreCommand.java
new file mode 100644
index 00000000..828557f7
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/impl/ZUnionStoreCommand.java
@@ -0,0 +1,121 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.impl;
+
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+
+public class ZUnionStoreCommand implements Command {
+
+ private static final long serialVersionUID = 1L;
+
+ private String destination;
+ private int numkeys;
+ private String[] keys;
+ private double[] weights;
+ private AggregateType aggregateType;
+ private byte[] rawDestination;
+ private byte[][] rawKeys;
+
+ public ZUnionStoreCommand() {
+ }
+
+ public ZUnionStoreCommand(String destination, int numkeys, String[] keys, double[] weights,
+ AggregateType aggregateType) {
+ this(destination, numkeys, keys, weights, aggregateType, null, null);
+ }
+
+ public ZUnionStoreCommand(String destination, int numkeys, String[] keys, double[] weights,
+ AggregateType aggregateType, byte[] rawDestination, byte[][] rawKeys) {
+ this.destination = destination;
+ this.numkeys = numkeys;
+ this.keys = keys;
+ this.weights = weights;
+ this.aggregateType = aggregateType;
+ this.rawDestination = rawDestination;
+ this.rawKeys = rawKeys;
+ }
+
+ public String getDestination() {
+ return destination;
+ }
+
+ public void setDestination(String destination) {
+ this.destination = destination;
+ }
+
+ public int getNumkeys() {
+ return numkeys;
+ }
+
+ public void setNumkeys(int numkeys) {
+ this.numkeys = numkeys;
+ }
+
+ public String[] getKeys() {
+ return keys;
+ }
+
+ public void setKeys(String[] keys) {
+ this.keys = keys;
+ }
+
+ public double[] getWeights() {
+ return weights;
+ }
+
+ public void setWeights(double[] weights) {
+ this.weights = weights;
+ }
+
+ public AggregateType getAggregateType() {
+ return aggregateType;
+ }
+
+ public void setAggregateType(AggregateType aggregateType) {
+ this.aggregateType = aggregateType;
+ }
+
+ public byte[] getRawDestination() {
+ return rawDestination;
+ }
+
+ public void setRawDestination(byte[] rawDestination) {
+ this.rawDestination = rawDestination;
+ }
+
+ public byte[][] getRawKeys() {
+ return rawKeys;
+ }
+
+ public void setRawKeys(byte[][] rawKeys) {
+ this.rawKeys = rawKeys;
+ }
+
+ @Override
+ public String toString() {
+ return "ZUnionStoreCommand{" +
+ "destination='" + destination + '\'' +
+ ", numkeys=" + numkeys +
+ ", keys=" + Arrays.toString(keys) +
+ ", weights=" + Arrays.toString(weights) +
+ ", aggregateType=" + aggregateType +
+ '}';
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/AppendParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/AppendParser.java
new file mode 100644
index 00000000..687de567
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/AppendParser.java
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.AppendCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class AppendParser implements CommandParser<AppendCommand> {
+
+ @Override
+ public AppendCommand parse(Object[] command) {
+ return new AppendCommand(objToString(command[1]), objToString(command[2]), objToBytes(command[1]), objToBytes(command[2]));
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/BRPopLPushParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/BRPopLPushParser.java
new file mode 100644
index 00000000..66a5d55d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/BRPopLPushParser.java
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.BRPopLPushCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class BRPopLPushParser implements CommandParser<BRPopLPushCommand> {
+ @Override
+ public BRPopLPushCommand parse(Object[] command) {
+ int idx = 1;
+ String source = objToString(command[idx]);
+ byte[] rawSource = objToBytes(command[idx]);
+ idx++;
+ String destination = objToString(command[idx]);
+ byte[] rawDestination = objToBytes(command[idx]);
+ idx++;
+ int timeout = new BigDecimal(objToString(command[idx++])).intValueExact();
+ return new BRPopLPushCommand(source, destination, timeout, rawSource, rawDestination);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitFieldParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitFieldParser.java
new file mode 100644
index 00000000..468ea825
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitFieldParser.java
@@ -0,0 +1,178 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import java.util.ArrayList;
+import java.util.List;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.BitFieldCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.GetTypeOffset;
+import org.apache.rocketmq.redis.replicator.cmd.impl.IncrByTypeOffsetIncrement;
+import org.apache.rocketmq.redis.replicator.cmd.impl.OverFlow;
+import org.apache.rocketmq.redis.replicator.cmd.impl.OverFlowType;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetTypeOffsetValue;
+import org.apache.rocketmq.redis.replicator.cmd.impl.Statement;
+
+public class BitFieldParser implements CommandParser<BitFieldCommand> {
+
+ @Override
+ public BitFieldCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ List<Statement> list = new ArrayList<>();
+ if (idx < command.length) {
+ String token;
+ do {
+ idx = parseStatement(idx, command, list);
+ if (idx >= command.length)
+ break;
+ token = CommandParsers.objToString(command[idx]);
+ }
+ while (token != null && (token.equalsIgnoreCase("GET") || token.equalsIgnoreCase("SET") || token.equalsIgnoreCase("INCRBY")));
+ }
+ List<OverFlow> overFlowList = null;
+ if (idx < command.length) {
+ overFlowList = new ArrayList<>();
+ do {
+ OverFlow overFlow = new OverFlow();
+ idx = parseOverFlow(idx, command, overFlow);
+ overFlowList.add(overFlow);
+ if (idx >= command.length)
+ break;
+ }
+ while ("OVERFLOW".equalsIgnoreCase(CommandParsers.objToString(command[idx])));
+ }
+
+ return new BitFieldCommand(key, list, overFlowList, rawKey);
+ }
+
+ private int parseOverFlow(int i, Object[] params, OverFlow overFlow) {
+ int idx = i;
+ accept(CommandParsers.objToString(params[idx++]), "OVERFLOW");
+ OverFlowType overFlowType;
+ String keyWord = CommandParsers.objToString(params[idx++]);
+ if ("WRAP".equalsIgnoreCase(keyWord)) {
+ overFlowType = OverFlowType.WRAP;
+ } else if ("SAT".equalsIgnoreCase(keyWord)) {
+ overFlowType = OverFlowType.SAT;
+ } else if ("FAIL".equalsIgnoreCase(keyWord)) {
+ overFlowType = OverFlowType.FAIL;
+ } else {
+ throw new AssertionError("parse [BITFIELD] command error." + keyWord);
+ }
+ List<Statement> list = new ArrayList<>();
+ if (idx < params.length) {
+ String token;
+ do {
+ idx = parseStatement(idx, params, list);
+ if (idx >= params.length)
+ break;
+ token = CommandParsers.objToString(params[idx]);
+ }
+ while (token != null && (token.equalsIgnoreCase("GET") || token.equalsIgnoreCase("SET") || token.equalsIgnoreCase("INCRBY")));
+ }
+ overFlow.setOverFlowType(overFlowType);
+ overFlow.setStatements(list);
+ return idx;
+ }
+
+ private int parseStatement(int i, Object[] params, List<Statement> list) {
+ int idx = i;
+ String keyWord = CommandParsers.objToString(params[idx++]);
+ Statement statement;
+ if ("GET".equalsIgnoreCase(keyWord)) {
+ GetTypeOffset getTypeOffset = new GetTypeOffset();
+ idx = parseGet(idx - 1, params, getTypeOffset);
+ statement = getTypeOffset;
+ } else if ("SET".equalsIgnoreCase(keyWord)) {
+ SetTypeOffsetValue setTypeOffsetValue = new SetTypeOffsetValue();
+ idx = parseSet(idx - 1, params, setTypeOffsetValue);
+ statement = setTypeOffsetValue;
+ } else if ("INCRBY".equalsIgnoreCase(keyWord)) {
+ IncrByTypeOffsetIncrement incrByTypeOffsetIncrement = new IncrByTypeOffsetIncrement();
+ idx = parseIncrBy(idx - 1, params, incrByTypeOffsetIncrement);
+ statement = incrByTypeOffsetIncrement;
+ } else {
+ return i;
+ }
+ list.add(statement);
+ return idx;
+ }
+
+ private int parseIncrBy(int i, Object[] params, IncrByTypeOffsetIncrement incrByTypeOffsetIncrement) {
+ int idx = i;
+ accept(CommandParsers.objToString(params[idx++]), "INCRBY");
+ String type = CommandParsers.objToString(params[idx]);
+ byte[] rawType = CommandParsers.objToBytes(params[idx]);
+ idx++;
+ String offset = CommandParsers.objToString(params[idx]);
+ byte[] rawOffset = CommandParsers.objToBytes(params[idx]);
+ idx++;
+ long increment = new BigDecimal(CommandParsers.objToString(params[idx++])).longValueExact();
+ incrByTypeOffsetIncrement.setType(type);
+ incrByTypeOffsetIncrement.setOffset(offset);
+ incrByTypeOffsetIncrement.setIncrement(increment);
+ incrByTypeOffsetIncrement.setRawType(rawType);
+ incrByTypeOffsetIncrement.setRawOffset(rawOffset);
+ return idx;
+ }
+
+ private int parseSet(int i, Object[] params, SetTypeOffsetValue setTypeOffsetValue) {
+ int idx = i;
+ accept(CommandParsers.objToString(params[idx++]), "SET");
+ String type = CommandParsers.objToString(params[idx]);
+ byte[] rawType = CommandParsers.objToBytes(params[idx]);
+ idx++;
+ String offset = CommandParsers.objToString(params[idx]);
+ byte[] rawOffset = CommandParsers.objToBytes(params[idx]);
+ idx++;
+ long value = new BigDecimal(CommandParsers.objToString(params[idx++])).longValueExact();
+ setTypeOffsetValue.setType(type);
+ setTypeOffsetValue.setOffset(offset);
+ setTypeOffsetValue.setValue(value);
+ setTypeOffsetValue.setRawType(rawType);
+ setTypeOffsetValue.setRawOffset(rawOffset);
+ return idx;
+ }
+
+ private int parseGet(int i, Object[] params, GetTypeOffset getTypeOffset) {
+ int idx = i;
+ accept(CommandParsers.objToString(params[idx++]), "GET");
+ String type = CommandParsers.objToString(params[idx]);
+ byte[] rawType = CommandParsers.objToBytes(params[idx]);
+ idx++;
+ String offset = CommandParsers.objToString(params[idx]);
+ byte[] rawOffset = CommandParsers.objToBytes(params[idx]);
+ idx++;
+ getTypeOffset.setType(type);
+ getTypeOffset.setOffset(offset);
+ getTypeOffset.setRawType(rawType);
+ getTypeOffset.setRawOffset(rawOffset);
+ return idx;
+ }
+
+ private void accept(String actual, String expect) {
+ if (actual.equalsIgnoreCase(expect))
+ return;
+ throw new AssertionError("expect " + expect + " but actual " + actual);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitOpParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitOpParser.java
new file mode 100644
index 00000000..6e599bf6
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitOpParser.java
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.Op;
+import org.apache.rocketmq.redis.replicator.cmd.impl.BitOpCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class BitOpParser implements CommandParser<BitOpCommand> {
+ @Override
+ public BitOpCommand parse(Object[] command) {
+ int idx = 1;
+ String strOp = objToString(command[idx++]);
+ Op op = Op.valueOf(strOp.toUpperCase());
+ String destKey = objToString(command[idx]);
+ byte[] rawDestKey = objToBytes(command[idx]);
+ idx++;
+ String[] keys = new String[command.length - 3];
+ byte[][] rawKeys = new byte[command.length - 3][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ keys[j] = objToString(command[i]);
+ rawKeys[j] = objToBytes(command[i]);
+ }
+ return new BitOpCommand(op, destKey, keys, rawDestKey, rawKeys);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/CommandParsers.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/CommandParsers.java
new file mode 100644
index 00000000..2cdec1e0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/CommandParsers.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+
+class CommandParsers {
+
+ public static String objToString(Object object) {
+ if (object == null)
+ return null;
+ byte[] bytes = (byte[]) object;
+ return new String(bytes, UTF_8);
+ }
+
+ public static byte[] objToBytes(Object object) {
+ return (byte[]) object;
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/DecrByParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/DecrByParser.java
new file mode 100644
index 00000000..d813a8b4
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/DecrByParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.DecrByCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class DecrByParser implements CommandParser<DecrByCommand> {
+
+ @Override
+ public DecrByCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ long value = new BigDecimal(objToString(command[idx++])).longValueExact();
+ return new DecrByCommand(key, value, rawKey);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/DecrParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/DecrParser.java
new file mode 100644
index 00000000..15b9470a
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/DecrParser.java
@@ -0,0 +1,34 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.DecrCommand;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class DecrParser implements CommandParser<DecrCommand> {
+ @Override
+ public DecrCommand parse(Object[] command) {
+ String key = objToString(command[1]);
+ byte[] rawKey = objToBytes(command[1]);
+ return new DecrCommand(key, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/DelParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/DelParser.java
new file mode 100644
index 00000000..b6f959d5
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/DelParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.DelCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class DelParser implements CommandParser<DelCommand> {
+ @Override
+ public DelCommand parse(Object[] command) {
+ int idx = 1;
+ String[] keys = new String[command.length - 1];
+ byte[][] rawKeys = new byte[command.length - 1][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ keys[j] = objToString(command[i]);
+ rawKeys[j] = objToBytes(command[i]);
+ }
+ return new DelCommand(keys, rawKeys);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/EvalParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/EvalParser.java
new file mode 100644
index 00000000..f07bf8ec
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/EvalParser.java
@@ -0,0 +1,58 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import java.util.ArrayList;
+import java.util.List;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.EvalCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class EvalParser implements CommandParser<EvalCommand> {
+ @Override
+ public EvalCommand parse(Object[] command) {
+ int idx = 1;
+ String script = objToString(command[idx]);
+ byte[] rawScript = objToBytes(command[idx]);
+ idx++;
+ int numkeys = new BigDecimal(objToString(command[idx++])).intValueExact();
+ String[] keys = new String[numkeys];
+ byte[][] rawKeys = new byte[numkeys][];
+ for (int i = 0; i < numkeys; i++) {
+ keys[i] = objToString(command[idx]);
+ rawKeys[i] = objToBytes(command[idx]);
+ idx++;
+ }
+ List<String> list = new ArrayList<>();
+ List<byte[]> rawList = new ArrayList<>();
+ while (idx < command.length) {
+ list.add(objToString(command[idx]));
+ rawList.add(objToBytes(command[idx]));
+ idx++;
+ }
+ String[] args = new String[list.size()];
+ byte[][] rawArgs = new byte[rawList.size()][];
+ list.toArray(args);
+ rawList.toArray(rawArgs);
+ return new EvalCommand(script, numkeys, keys, args, rawScript, rawKeys, rawArgs);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExecParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExecParser.java
new file mode 100644
index 00000000..738f32ed
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExecParser.java
@@ -0,0 +1,28 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExecCommand;
+
+public class ExecParser implements CommandParser<ExecCommand> {
+ @Override
+ public ExecCommand parse(Object[] command) {
+ return new ExecCommand();
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExpireAtParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExpireAtParser.java
new file mode 100644
index 00000000..edb9571c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExpireAtParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExpireAtCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class ExpireAtParser implements CommandParser<ExpireAtCommand> {
+ @Override
+ public ExpireAtCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ long ex = new BigDecimal(objToString(command[idx++])).longValueExact();
+ return new ExpireAtCommand(key, ex, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExpireParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExpireParser.java
new file mode 100644
index 00000000..69c27026
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExpireParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExpireCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class ExpireParser implements CommandParser<ExpireCommand> {
+ @Override
+ public ExpireCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ int ex = new BigDecimal(objToString(command[idx++])).intValueExact();
+ return new ExpireCommand(key, ex, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/FlushAllParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/FlushAllParser.java
new file mode 100644
index 00000000..8e4790a0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/FlushAllParser.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.FlushAllCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class FlushAllParser implements CommandParser<FlushAllCommand> {
+ @Override
+ public FlushAllCommand parse(Object[] command) {
+ Boolean isAsync = null;
+ if (command.length == 2 && "ASYNC".equalsIgnoreCase(objToString(command[1]))) {
+ isAsync = true;
+ }
+ return new FlushAllCommand(isAsync);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/FlushDBParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/FlushDBParser.java
new file mode 100644
index 00000000..761d237a
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/FlushDBParser.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.FlushDBCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class FlushDBParser implements CommandParser<FlushDBCommand> {
+ @Override
+ public FlushDBCommand parse(Object[] command) {
+ Boolean isAsync = null;
+ if (command.length == 2 && "ASYNC".equalsIgnoreCase(objToString(command[1]))) {
+ isAsync = true;
+ }
+ return new FlushDBCommand(isAsync);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/GeoAddParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/GeoAddParser.java
new file mode 100644
index 00000000..74263436
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/GeoAddParser.java
@@ -0,0 +1,50 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.util.ArrayList;
+import java.util.List;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.Geo;
+import org.apache.rocketmq.redis.replicator.cmd.impl.GeoAddCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class GeoAddParser implements CommandParser<GeoAddCommand> {
+ @Override
+ public GeoAddCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ List<Geo> list = new ArrayList<>();
+ while (idx < command.length) {
+ double longitude = Double.parseDouble(objToString(command[idx++]));
+ double latitude = Double.parseDouble(objToString(command[idx++]));
+ String member = objToString(command[idx]);
+ byte[] rawMember = objToBytes(command[idx]);
+ idx++;
+ list.add(new Geo(member, longitude, latitude, rawMember));
+ }
+ Geo[] geos = new Geo[list.size()];
+ list.toArray(geos);
+ return new GeoAddCommand(key, geos, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/GetSetParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/GetSetParser.java
new file mode 100644
index 00000000..ab80a2da
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/GetSetParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.GetSetCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class GetSetParser implements CommandParser<GetSetCommand> {
+ @Override
+ public GetSetCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String value = objToString(command[idx]);
+ byte[] rawValue = objToBytes(command[idx]);
+ idx++;
+ return new GetSetCommand(key, value, rawKey, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HDelParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HDelParser.java
new file mode 100644
index 00000000..03d152f8
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HDelParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.HDelCommand;
+
+public class HDelParser implements CommandParser<HDelCommand> {
+ @Override
+ public HDelCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String[] fields = new String[command.length - 2];
+ byte[][] rawFields = new byte[command.length - 2][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ fields[j] = CommandParsers.objToString(command[i]);
+ rawFields[j] = CommandParsers.objToBytes(command[i]);
+ }
+ return new HDelCommand(key, fields, rawKey, rawFields);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HIncrByParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HIncrByParser.java
new file mode 100644
index 00000000..def1b122
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HIncrByParser.java
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.HIncrByCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class HIncrByParser implements CommandParser<HIncrByCommand> {
+
+ @Override
+ public HIncrByCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String field = objToString(command[idx]);
+ byte[] rawField = objToBytes(command[idx]);
+ idx++;
+ long increment = new BigDecimal(objToString(command[idx++])).longValueExact();
+ return new HIncrByCommand(key, field, increment, rawKey, rawField);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HMSetParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HMSetParser.java
new file mode 100644
index 00000000..55e9a9a0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HMSetParser.java
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.util.LinkedHashMap;
+import java.util.Map;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.HMSetCommand;
+import org.apache.rocketmq.redis.replicator.util.ByteArrayMap;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class HMSetParser implements CommandParser<HMSetCommand> {
+
+ @Override
+ public HMSetCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ Map<String, String> fields = new LinkedHashMap<>();
+ ByteArrayMap<byte[]> rawFields = new ByteArrayMap<>();
+ while (idx < command.length) {
+ String field = objToString(command[idx]);
+ byte[] rawField = objToBytes(command[idx]);
+ idx++;
+ String value = idx == command.length ? null : objToString(command[idx]);
+ byte[] rawValue = idx == command.length ? null : objToBytes(command[idx]);
+ idx++;
+ fields.put(field, value);
+ rawFields.put(rawField, rawValue);
+ }
+ return new HMSetCommand(key, fields, rawKey, rawFields);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HSetNxParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HSetNxParser.java
new file mode 100644
index 00000000..d7f0394f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HSetNxParser.java
@@ -0,0 +1,43 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.HSetNxCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class HSetNxParser implements CommandParser<HSetNxCommand> {
+
+ @Override
+ public HSetNxCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String field = objToString(command[idx]);
+ byte[] rawField = objToBytes(command[idx]);
+ idx++;
+ String value = objToString(command[idx]);
+ byte[] rawValue = objToBytes(command[idx]);
+ idx++;
+ return new HSetNxCommand(key, field, value, rawKey, rawField, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HSetParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HSetParser.java
new file mode 100644
index 00000000..16db1555
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/HSetParser.java
@@ -0,0 +1,40 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.HSetCommand;
+
+public class HSetParser implements CommandParser<HSetCommand> {
+
+ @Override
+ public HSetCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String field = CommandParsers.objToString(command[idx]);
+ byte[] rawField = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String value = CommandParsers.objToString(command[idx]);
+ byte[] rawValue = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ return new HSetCommand(key, field, value, rawKey, rawField, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/IncrByParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/IncrByParser.java
new file mode 100644
index 00000000..8c3e77a3
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/IncrByParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.IncrByCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class IncrByParser implements CommandParser<IncrByCommand> {
+ @Override
+ public IncrByCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ long value = new BigDecimal(objToString(command[idx++])).longValueExact();
+ return new IncrByCommand(key, value, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/IncrParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/IncrParser.java
new file mode 100644
index 00000000..1066a60f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/IncrParser.java
@@ -0,0 +1,34 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.IncrCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class IncrParser implements CommandParser<IncrCommand> {
+ @Override
+ public IncrCommand parse(Object[] command) {
+ String key = objToString(command[1]);
+ byte[] rawKey = objToBytes(command[1]);
+ return new IncrCommand(key, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LInsertParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LInsertParser.java
new file mode 100644
index 00000000..ca2c4bef
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LInsertParser.java
@@ -0,0 +1,50 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LInsertCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LInsertType;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class LInsertParser implements CommandParser<LInsertCommand> {
+ @Override
+ public LInsertCommand parse(Object[] command) {
+ int idx = 1;
+ LInsertType lInsertType = null;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String keyWord = objToString(command[idx++]);
+ if ("BEFORE".equalsIgnoreCase(keyWord)) {
+ lInsertType = LInsertType.BEFORE;
+ } else if ("AFTER".equalsIgnoreCase(keyWord)) {
+ lInsertType = LInsertType.AFTER;
+ }
+ String pivot = objToString(command[idx]);
+ byte[] rawPivot = objToBytes(command[idx]);
+ idx++;
+ String value = objToString(command[idx]);
+ byte[] rawValue = objToBytes(command[idx]);
+ idx++;
+ return new LInsertCommand(key, lInsertType, pivot, value, rawKey, rawPivot, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LPopParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LPopParser.java
new file mode 100644
index 00000000..fef3bded
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LPopParser.java
@@ -0,0 +1,31 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LPopCommand;
+
+public class LPopParser implements CommandParser<LPopCommand> {
+ @Override
+ public LPopCommand parse(Object[] command) {
+ String key = CommandParsers.objToString(command[1]);
+ byte[] rawKey = CommandParsers.objToBytes(command[1]);
+ return new LPopCommand(key, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LPushParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LPushParser.java
new file mode 100644
index 00000000..0e44dc39
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LPushParser.java
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LPushCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class LPushParser implements CommandParser<LPushCommand> {
+
+ @Override
+ public LPushCommand parse(Object[] command) {
+ int idx = 1, newIdx = 0;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String[] values = new String[command.length - 2];
+ byte[][] rawValues = new byte[command.length - 2][];
+ while (idx < command.length) {
+ values[newIdx] = objToString(command[idx]);
+ rawValues[newIdx] = objToBytes(command[idx]);
+ newIdx++;
+ idx++;
+ }
+ return new LPushCommand(key, values, rawKey, rawValues);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LPushXParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LPushXParser.java
new file mode 100644
index 00000000..33b1e9dd
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LPushXParser.java
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LPushXCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class LPushXParser implements CommandParser<LPushXCommand> {
+
+ @Override
+ public LPushXCommand parse(Object[] command) {
+ int idx = 1, newIdx = 0;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String[] values = new String[command.length - 2];
+ byte[][] rawValues = new byte[command.length - 2][];
+ while (idx < command.length) {
+ values[newIdx] = objToString(command[idx]);
+ rawValues[newIdx] = objToBytes(command[idx]);
+ newIdx++;
+ idx++;
+ }
+ return new LPushXCommand(key, values, rawKey, rawValues);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LRemParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LRemParser.java
new file mode 100644
index 00000000..dc5b9539
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LRemParser.java
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LRemCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class LRemParser implements CommandParser<LRemCommand> {
+ @Override
+ public LRemCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ long index = new BigDecimal(objToString(command[idx++])).longValueExact();
+ String value = objToString(command[idx]);
+ byte[] rawValue = objToBytes(command[idx]);
+ idx++;
+ return new LRemCommand(key, index, value, rawKey, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LSetParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LSetParser.java
new file mode 100644
index 00000000..2358c7b7
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LSetParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LSetCommand;
+
+public class LSetParser implements CommandParser<LSetCommand> {
+ @Override
+ public LSetCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ long index = new BigDecimal(CommandParsers.objToString(command[idx++])).longValueExact();
+ String value = CommandParsers.objToString(command[idx]);
+ byte[] rawValue = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ return new LSetCommand(key, index, value, rawKey, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LTrimParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LTrimParser.java
new file mode 100644
index 00000000..366aced0
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/LTrimParser.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LTrimCommand;
+
+public class LTrimParser implements CommandParser<LTrimCommand> {
+ @Override
+ public LTrimCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ long start = new BigDecimal(CommandParsers.objToString(command[idx++])).longValueExact();
+ long stop = new BigDecimal(CommandParsers.objToString(command[idx++])).longValueExact();
+ return new LTrimCommand(key, start, stop, rawKey);
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MSetNxParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MSetNxParser.java
new file mode 100644
index 00000000..6ecb54c4
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MSetNxParser.java
@@ -0,0 +1,50 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.util.LinkedHashMap;
+import java.util.Map;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.util.ByteArrayMap;
+import org.apache.rocketmq.redis.replicator.cmd.impl.MSetNxCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class MSetNxParser implements CommandParser<MSetNxCommand> {
+ @Override
+ public MSetNxCommand parse(Object[] command) {
+ if (command.length == 1)
+ return new MSetNxCommand(null, null);
+ int idx = 1;
+ Map<String, String> kv = new LinkedHashMap<>();
+ ByteArrayMap<byte[]> rawKv = new ByteArrayMap<>();
+ while (idx < command.length) {
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String value = idx == command.length ? null : objToString(command[idx]);
+ byte[] rawValue = idx == command.length ? null : objToBytes(command[idx]);
+ idx++;
+ kv.put(key, value);
+ rawKv.put(rawKey, rawValue);
+ }
+ return new MSetNxCommand(kv, rawKv);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MSetParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MSetParser.java
new file mode 100644
index 00000000..235cd559
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MSetParser.java
@@ -0,0 +1,47 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.util.LinkedHashMap;
+import java.util.Map;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.MSetCommand;
+import org.apache.rocketmq.redis.replicator.util.ByteArrayMap;
+
+public class MSetParser implements CommandParser<MSetCommand> {
+ @Override
+ public MSetCommand parse(Object[] command) {
+ if (command.length == 1)
+ return new MSetCommand(null, null);
+ int idx = 1;
+ Map<String, String> kv = new LinkedHashMap<>();
+ ByteArrayMap<byte[]> rawKv = new ByteArrayMap<>();
+ while (idx < command.length) {
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String value = idx == command.length ? null : CommandParsers.objToString(command[idx]);
+ byte[] rawValue = idx == command.length ? null : CommandParsers.objToBytes(command[idx]);
+ idx++;
+ kv.put(key, value);
+ rawKv.put(rawKey, rawValue);
+ }
+ return new MSetCommand(kv, rawKv);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MoveParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MoveParser.java
new file mode 100644
index 00000000..bfa7c63f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MoveParser.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.MoveCommand;
+
+public class MoveParser implements CommandParser<MoveCommand> {
+ @Override
+ public MoveCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ int db = new BigDecimal(CommandParsers.objToString(command[idx++])).intValueExact();
+ return new MoveCommand(key, db, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MultiParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MultiParser.java
new file mode 100644
index 00000000..66a21798
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/MultiParser.java
@@ -0,0 +1,28 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.MultiCommand;
+
+public class MultiParser implements CommandParser<MultiCommand> {
+ @Override
+ public MultiCommand parse(Object[] command) {
+ return new MultiCommand();
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PExpireAtParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PExpireAtParser.java
new file mode 100644
index 00000000..5ab4401e
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PExpireAtParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PExpireAtCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class PExpireAtParser implements CommandParser<PExpireAtCommand> {
+ @Override
+ public PExpireAtCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ long ex = new BigDecimal(objToString(command[idx++])).longValueExact();
+ return new PExpireAtCommand(key, ex, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PExpireParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PExpireParser.java
new file mode 100644
index 00000000..ee7928f8
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PExpireParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PExpireCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class PExpireParser implements CommandParser<PExpireCommand> {
+ @Override
+ public PExpireCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ long ex = new BigDecimal(objToString(command[idx++])).longValueExact();
+ return new PExpireCommand(key, ex, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PFAddParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PFAddParser.java
new file mode 100644
index 00000000..b67320cd
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PFAddParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PFAddCommand;
+
+public class PFAddParser implements CommandParser<PFAddCommand> {
+ @Override
+ public PFAddCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String[] elements = new String[command.length - 2];
+ byte[][] rawElements = new byte[command.length - 2][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ elements[j] = CommandParsers.objToString(command[i]);
+ rawElements[j] = CommandParsers.objToBytes(command[i]);
+ }
+ return new PFAddCommand(key, elements, rawKey, rawElements);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PFCountParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PFCountParser.java
new file mode 100644
index 00000000..d1afbc66
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PFCountParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PFCountCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class PFCountParser implements CommandParser<PFCountCommand> {
+ @Override
+ public PFCountCommand parse(Object[] command) {
+ String[] keys = new String[command.length - 1];
+ byte[][] rawKeys = new byte[command.length - 1][];
+ for (int i = 1, j = 0; i < command.length; i++, j++) {
+ keys[j] = objToString(command[i]);
+ rawKeys[j] = objToBytes(command[i]);
+ }
+ return new PFCountCommand(keys, rawKeys);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PFMergeParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PFMergeParser.java
new file mode 100644
index 00000000..c70208ae
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PFMergeParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PFMergeCommand;
+
+public class PFMergeParser implements CommandParser<PFMergeCommand> {
+ @Override
+ public PFMergeCommand parse(Object[] command) {
+ int idx = 1;
+ String destkey = CommandParsers.objToString(command[idx]);
+ byte[] rawDestkey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String[] sourcekeys = new String[command.length - 2];
+ byte[][] rawSourcekeys = new byte[command.length - 2][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ sourcekeys[j] = CommandParsers.objToString(command[i]);
+ rawSourcekeys[j] = CommandParsers.objToBytes(command[i]);
+ }
+ return new PFMergeCommand(destkey, sourcekeys, rawDestkey, rawSourcekeys);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PSetExParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PSetExParser.java
new file mode 100644
index 00000000..6246b4e8
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PSetExParser.java
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PSetExCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class PSetExParser implements CommandParser<PSetExCommand> {
+ @Override
+ public PSetExCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ long ex = new BigDecimal(objToString(command[idx++])).longValueExact();
+ String value = objToString(command[idx]);
+ byte[] rawValue = objToBytes(command[idx]);
+ idx++;
+ return new PSetExCommand(key, ex, value, rawKey, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PersistParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PersistParser.java
new file mode 100644
index 00000000..933470b8
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PersistParser.java
@@ -0,0 +1,34 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PersistCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class PersistParser implements CommandParser<PersistCommand> {
+ @Override
+ public PersistCommand parse(Object[] command) {
+ String key = objToString(command[1]);
+ byte[] rawKey = objToBytes(command[1]);
+ return new PersistCommand(key, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PingParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PingParser.java
new file mode 100644
index 00000000..aa0bcc30
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PingParser.java
@@ -0,0 +1,34 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PingCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class PingParser implements CommandParser<PingCommand> {
+ @Override
+ public PingCommand parse(Object[] command) {
+ String message = command.length == 1 ? null : objToString(command[1]);
+ byte[] rawMessage = command.length == 1 ? null : objToBytes(command[1]);
+ return new PingCommand(message, rawMessage);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PublishParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PublishParser.java
new file mode 100644
index 00000000..665fa04f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/PublishParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PublishCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class PublishParser implements CommandParser<PublishCommand> {
+ @Override
+ public PublishCommand parse(Object[] command) {
+ int idx = 1;
+ String channel = objToString(command[idx]);
+ byte[] rawChannel = objToBytes(command[idx]);
+ idx++;
+ String message = objToString(command[idx]);
+ byte[] rawMessage = objToBytes(command[idx]);
+ idx++;
+ return new PublishCommand(channel, message, rawChannel, rawMessage);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPopLPushParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPopLPushParser.java
new file mode 100644
index 00000000..c753cf64
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPopLPushParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RPopLPushCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class RPopLPushParser implements CommandParser<RPopLPushCommand> {
+ @Override
+ public RPopLPushCommand parse(Object[] command) {
+ int idx = 1;
+ String source = objToString(command[idx]);
+ byte[] rawSource = objToBytes(command[idx]);
+ idx++;
+ String destination = objToString(command[idx]);
+ byte[] rawDestination = objToBytes(command[idx]);
+ idx++;
+ return new RPopLPushCommand(source, destination, rawSource, rawDestination);
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPopParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPopParser.java
new file mode 100644
index 00000000..7520bf3f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPopParser.java
@@ -0,0 +1,31 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RPopCommand;
+
+public class RPopParser implements CommandParser<RPopCommand> {
+ @Override
+ public RPopCommand parse(Object[] command) {
+ String key = CommandParsers.objToString(command[1]);
+ byte[] rawKey = CommandParsers.objToBytes(command[1]);
+ return new RPopCommand(key, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPushParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPushParser.java
new file mode 100644
index 00000000..e817996d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPushParser.java
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RPushCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class RPushParser implements CommandParser<RPushCommand> {
+
+ @Override
+ public RPushCommand parse(Object[] command) {
+ int idx = 1, newIdx = 0;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String[] values = new String[command.length - 2];
+ byte[][] rawValues = new byte[command.length - 2][];
+ while (idx < command.length) {
+ values[newIdx] = objToString(command[idx]);
+ rawValues[newIdx] = objToBytes(command[idx]);
+ newIdx++;
+ idx++;
+ }
+ return new RPushCommand(key, values, rawKey, rawValues);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPushXParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPushXParser.java
new file mode 100644
index 00000000..444394ad
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPushXParser.java
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RPushXCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class RPushXParser implements CommandParser<RPushXCommand> {
+
+ @Override
+ public RPushXCommand parse(Object[] command) {
+ int idx = 1, newIdx = 0;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String[] values = new String[command.length - 2];
+ byte[][] rawValues = new byte[command.length - 2][];
+ while (idx < command.length) {
+ values[newIdx] = objToString(command[idx]);
+ rawValues[newIdx] = objToBytes(command[idx]);
+ newIdx++;
+ idx++;
+ }
+ return new RPushXCommand(key, values, rawKey, rawValues);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RenameNxParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RenameNxParser.java
new file mode 100644
index 00000000..b56195d2
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RenameNxParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RenameNxCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class RenameNxParser implements CommandParser<RenameNxCommand> {
+ @Override
+ public RenameNxCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String newKey = objToString(command[idx]);
+ byte[] rawNewKey = objToBytes(command[idx]);
+ idx++;
+ return new RenameNxCommand(key, newKey, rawKey, rawNewKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RenameParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RenameParser.java
new file mode 100644
index 00000000..f3a60677
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RenameParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RenameCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class RenameParser implements CommandParser<RenameCommand> {
+ @Override
+ public RenameCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String newKey = objToString(command[idx]);
+ byte[] rawNewKey = objToBytes(command[idx]);
+ idx++;
+ return new RenameCommand(key, newKey, rawKey, rawNewKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RestoreParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RestoreParser.java
new file mode 100644
index 00000000..3a51c09a
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/RestoreParser.java
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RestoreCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class RestoreParser implements CommandParser<RestoreCommand> {
+ @Override
+ public RestoreCommand parse(Object[] command) {
+ int idx = 1;
+ Boolean isReplace = null;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ long ttl = new BigDecimal(objToString(command[idx++])).longValueExact();
+ String serializedValue = objToString(command[idx]);
+ byte[] rawSerializedValue = objToBytes(command[idx]);
+ idx++;
+ if (idx < command.length && (objToString(command[idx++])).equalsIgnoreCase("REPLACE")) {
+ isReplace = true;
+ }
+ return new RestoreCommand(key, ttl, serializedValue, isReplace, rawKey, rawSerializedValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SAddParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SAddParser.java
new file mode 100644
index 00000000..2fdfbe81
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SAddParser.java
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.SAddCommand;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SAddParser implements CommandParser<SAddCommand> {
+
+ @Override
+ public SAddCommand parse(Object[] command) {
+ int idx = 1, newIdx = 0;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String[] members = new String[command.length - 2];
+ byte[][] rawMembers = new byte[command.length - 2][];
+ while (idx < command.length) {
+ members[newIdx] = objToString(command[idx]);
+ rawMembers[newIdx] = objToBytes(command[idx]);
+ newIdx++;
+ idx++;
+ }
+ return new SAddCommand(key, members, rawKey, rawMembers);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SDiffStoreParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SDiffStoreParser.java
new file mode 100644
index 00000000..b932b5e9
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SDiffStoreParser.java
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SDiffStoreCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SDiffStoreParser implements CommandParser<SDiffStoreCommand> {
+ @Override
+ public SDiffStoreCommand parse(Object[] command) {
+ int idx = 1;
+ String destination = objToString(command[idx]);
+ byte[] rawDestination = objToBytes(command[idx]);
+ idx++;
+ String[] keys = new String[command.length - 2];
+ byte[][] rawKeys = new byte[command.length - 2][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ keys[j] = objToString(command[i]);
+ rawKeys[j] = objToBytes(command[i]);
+ }
+ return new SDiffStoreCommand(destination, keys, rawDestination, rawKeys);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SInterStoreParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SInterStoreParser.java
new file mode 100644
index 00000000..f6ffc23f
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SInterStoreParser.java
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SInterStoreCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SInterStoreParser implements CommandParser<SInterStoreCommand> {
+ @Override
+ public SInterStoreCommand parse(Object[] command) {
+ int idx = 1;
+ String destination = objToString(command[idx]);
+ byte[] rawDestination = objToBytes(command[idx]);
+ idx++;
+ String[] keys = new String[command.length - 2];
+ byte[][] rawKeys = new byte[command.length - 2][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ keys[j] = objToString(command[i]);
+ rawKeys[j] = objToBytes(command[i]);
+ }
+ return new SInterStoreCommand(destination, keys, rawDestination, rawKeys);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SMoveParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SMoveParser.java
new file mode 100644
index 00000000..b98f1047
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SMoveParser.java
@@ -0,0 +1,43 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SMoveCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SMoveParser implements CommandParser<SMoveCommand> {
+
+ @Override
+ public SMoveCommand parse(Object[] command) {
+ int idx = 1;
+ String source = objToString(command[idx]);
+ byte[] rawSource = objToBytes(command[idx]);
+ idx++;
+ String destination = objToString(command[idx]);
+ byte[] rawDestination = objToBytes(command[idx]);
+ idx++;
+ String member = objToString(command[idx]);
+ byte[] rawMember = objToBytes(command[idx]);
+ idx++;
+ return new SMoveCommand(source, destination, member, rawSource, rawDestination, rawMember);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SRemParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SRemParser.java
new file mode 100644
index 00000000..6677b8fc
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SRemParser.java
@@ -0,0 +1,43 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SRemCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SRemParser implements CommandParser<SRemCommand> {
+
+ @Override
+ public SRemCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ final String[] members = new String[command.length - 2];
+ final byte[][] rawMembers = new byte[command.length - 2][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ members[j] = objToString(command[i]);
+ rawMembers[j] = objToBytes(command[i]);
+ }
+ return new SRemCommand(key, members, rawKey, rawMembers);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SUnionStoreParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SUnionStoreParser.java
new file mode 100644
index 00000000..3ad9f91b
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SUnionStoreParser.java
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SUnionStoreCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SUnionStoreParser implements CommandParser<SUnionStoreCommand> {
+ @Override
+ public SUnionStoreCommand parse(Object[] command) {
+ int idx = 1;
+ String destination = objToString(command[idx]);
+ byte[] rawDestination = objToBytes(command[idx]);
+ idx++;
+ String[] keys = new String[command.length - 2];
+ byte[][] rawKeys = new byte[command.length - 2][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ keys[j] = objToString(command[i]);
+ rawKeys[j] = objToBytes(command[i]);
+ }
+ return new SUnionStoreCommand(destination, keys, rawDestination, rawKeys);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ScriptParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ScriptParser.java
new file mode 100644
index 00000000..49399bb1
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ScriptParser.java
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ScriptCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ScriptFlushCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ScriptLoadCommand;
+
+public class ScriptParser implements CommandParser<ScriptCommand> {
+ @Override
+ public ScriptCommand parse(Object[] command) {
+ int idx = 1;
+ String keyWord = CommandParsers.objToString(command[idx++]);
+ if ("LOAD".equalsIgnoreCase(keyWord)) {
+ String script = CommandParsers.objToString(command[idx]);
+ byte[] rawScript = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ return new ScriptLoadCommand(script, rawScript);
+ } else if ("FLUSH".equalsIgnoreCase(keyWord)) {
+ return new ScriptFlushCommand();
+ }
+ throw new AssertionError("SCRIPT " + keyWord);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SelectParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SelectParser.java
new file mode 100644
index 00000000..1d9bbde3
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SelectParser.java
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SelectCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SelectParser implements CommandParser<SelectCommand> {
+ @Override
+ public SelectCommand parse(Object[] command) {
+ int index = new BigDecimal(objToString(command[1])).intValueExact();
+ return new SelectCommand(index);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetBitParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetBitParser.java
new file mode 100644
index 00000000..db325f32
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetBitParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetBitCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SetBitParser implements CommandParser<SetBitCommand> {
+ @Override
+ public SetBitCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ long offset = new BigDecimal(objToString(command[idx++])).longValueExact();
+ int value = new BigDecimal(objToString(command[idx++])).intValueExact();
+ return new SetBitCommand(key, offset, value, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetExParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetExParser.java
new file mode 100644
index 00000000..b501fa8c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetExParser.java
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetExCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SetExParser implements CommandParser<SetExCommand> {
+ @Override
+ public SetExCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ int ex = new BigDecimal(objToString(command[idx++])).intValueExact();
+ String value = objToString(command[idx]);
+ byte[] rawValue = objToBytes(command[idx]);
+ idx++;
+ return new SetExCommand(key, ex, value, rawKey, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetNxParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetNxParser.java
new file mode 100644
index 00000000..276d4ec4
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetNxParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetNxCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SetNxParser implements CommandParser<SetNxCommand> {
+ @Override
+ public SetNxCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ String value = objToString(command[idx]);
+ byte[] rawValue = objToBytes(command[idx]);
+ idx++;
+ return new SetNxCommand(key, value, rawKey, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetParser.java
new file mode 100644
index 00000000..542dbe46
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetParser.java
@@ -0,0 +1,58 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExistType;
+
+public class SetParser implements CommandParser<SetCommand> {
+
+ @Override
+ public SetCommand parse(Object[] command) {
+ String key = CommandParsers.objToString(command[1]);
+ byte[] rawKey = CommandParsers.objToBytes(command[1]);
+ String value = CommandParsers.objToString(command[2]);
+ byte[] rawValue = CommandParsers.objToBytes(command[2]);
+ int idx = 3;
+ ExistType existType = ExistType.NONE;
+ Integer ex = null;
+ Long px = null;
+ boolean et = false, st = false;
+ while (idx < command.length) {
+ String param = CommandParsers.objToString(command[idx++]);
+ if (!et && "NX".equalsIgnoreCase(param)) {
+ existType = ExistType.NX;
+ et = true;
+ } else if (!et && "XX".equalsIgnoreCase(param)) {
+ existType = ExistType.XX;
+ et = true;
+ }
+
+ if (!st && "EX".equalsIgnoreCase(param)) {
+ ex = Integer.valueOf(CommandParsers.objToString(command[idx++]));
+ st = true;
+ } else if (!st && "PX".equalsIgnoreCase(param)) {
+ px = Long.valueOf(CommandParsers.objToString(command[idx++]));
+ st = true;
+ }
+ }
+ return new SetCommand(key, value, ex, px, existType, rawKey, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetRangeParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetRangeParser.java
new file mode 100644
index 00000000..285ed9fc
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetRangeParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetRangeCommand;
+
+public class SetRangeParser implements CommandParser<SetRangeCommand> {
+ @Override
+ public SetRangeCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ long index = new BigDecimal(CommandParsers.objToString(command[idx++])).longValueExact();
+ String value = CommandParsers.objToString(command[idx]);
+ byte[] rawValue = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ return new SetRangeCommand(key, index, value, rawKey, rawValue);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SortParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SortParser.java
new file mode 100644
index 00000000..20d3f9e3
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SortParser.java
@@ -0,0 +1,85 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import java.util.ArrayList;
+import java.util.List;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.Limit;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SortCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.impl.OrderType.ASC;
+import static org.apache.rocketmq.redis.replicator.cmd.impl.OrderType.DESC;
+import static org.apache.rocketmq.redis.replicator.cmd.impl.OrderType.NONE;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SortParser implements CommandParser<SortCommand> {
+ @Override
+ public SortCommand parse(Object[] command) {
+ int idx = 1;
+ SortCommand sort = new SortCommand();
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ sort.setKey(key);
+ sort.setRawKey(rawKey);
+ sort.setOrder(NONE);
+ List<String> getPatterns = new ArrayList<>();
+ List<byte[]> rawGetPatterns = new ArrayList<>();
+ while (idx < command.length) {
+ String param = objToString(command[idx]);
+ if ("ASC".equalsIgnoreCase(param)) {
+ sort.setOrder(ASC);
+ } else if ("DESC".equalsIgnoreCase(param)) {
+ sort.setOrder(DESC);
+ } else if ("ALPHA".equalsIgnoreCase(param)) {
+ sort.setAlpha(true);
+ } else if ("LIMIT".equalsIgnoreCase(param) && idx + 2 < command.length) {
+ idx++;
+ long offset = new BigDecimal(objToString(command[idx])).longValueExact();
+ idx++;
+ long count = new BigDecimal(objToString(command[idx])).longValueExact();
+ sort.setLimit(new Limit(offset, count));
+ } else if ("STORE".equalsIgnoreCase(param) && idx + 1 < command.length) {
+ idx++;
+ String destination = objToString(command[idx]);
+ byte[] rawDestination = objToBytes(command[idx]);
+ sort.setDestination(destination);
+ sort.setRawDestination(rawDestination);
+ } else if ("BY".equalsIgnoreCase(param) && idx + 1 < command.length) {
+ idx++;
+ String byPattern = objToString(command[idx]);
+ byte[] rawByPattern = objToBytes(command[idx]);
+ sort.setByPattern(byPattern);
+ sort.setRawByPattern(rawByPattern);
+ } else if ("GET".equalsIgnoreCase(param) && idx + 1 < command.length) {
+ idx++;
+ String getPattern = objToString(command[idx]);
+ byte[] rawGetPattern = objToBytes(command[idx]);
+ getPatterns.add(getPattern);
+ rawGetPatterns.add(rawGetPattern);
+ }
+ idx++;
+ }
+ sort.setGetPatterns(getPatterns.toArray(new String[getPatterns.size()]));
+ sort.setRawGetPatterns(rawGetPatterns.toArray(new byte[rawGetPatterns.size()][]));
+ return sort;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SwapDBParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SwapDBParser.java
new file mode 100644
index 00000000..ae0d21ca
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/SwapDBParser.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SwapDBCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class SwapDBParser implements CommandParser<SwapDBCommand> {
+
+ @Override
+ public SwapDBCommand parse(Object[] command) {
+ int idx = 1;
+ int source = new BigDecimal(objToString(command[idx++])).intValueExact();
+ int target = new BigDecimal(objToString(command[idx++])).intValueExact();
+ return new SwapDBCommand(source, target);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/UnLinkParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/UnLinkParser.java
new file mode 100644
index 00000000..168d54a5
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/UnLinkParser.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.UnLinkCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class UnLinkParser implements CommandParser<UnLinkCommand> {
+ @Override
+ public UnLinkCommand parse(Object[] command) {
+ int idx = 1;
+ String[] keys = new String[command.length - 1];
+ byte[][] rawKeys = new byte[command.length - 1][];
+ for (int i = idx, j = 0; i < command.length; i++, j++) {
+ keys[j] = objToString(command[i]);
+ rawKeys[j] = objToBytes(command[i]);
+ }
+ return new UnLinkCommand(keys, rawKeys);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZAddParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZAddParser.java
new file mode 100644
index 00000000..107359af
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZAddParser.java
@@ -0,0 +1,73 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.util.ArrayList;
+import java.util.List;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZAddCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExistType;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ZSetEntry;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class ZAddParser implements CommandParser<ZAddCommand> {
+
+ @Override
+ public ZAddCommand parse(Object[] command) {
+ int idx = 1;
+ Boolean isCh = null, isIncr = null;
+ ExistType existType = ExistType.NONE;
+ List<ZSetEntry> list = new ArrayList<>();
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ boolean et = false;
+ while (idx < command.length) {
+ String param = objToString(command[idx]);
+ if (!et && "NX".equalsIgnoreCase(param)) {
+ existType = ExistType.NX;
+ et = true;
+ idx++;
+ continue;
+ } else if (!et && "XX".equalsIgnoreCase(param)) {
+ existType = ExistType.XX;
+ et = true;
+ idx++;
+ continue;
+ }
+ if (isCh == null && "CH".equalsIgnoreCase(param)) {
+ isCh = true;
+ } else if (isIncr == null && "INCR".equalsIgnoreCase(param)) {
+ isIncr = true;
+ } else {
+ double score = Double.parseDouble(param);
+ idx++;
+ String member = objToString(command[idx]);
+ byte[] rawMember = objToBytes(command[idx]);
+ list.add(new ZSetEntry(member, score, rawMember));
+ }
+ idx++;
+ }
+ ZSetEntry[] zSetEntries = new ZSetEntry[list.size()];
+ list.toArray(zSetEntries);
+ return new ZAddCommand(key, existType, isCh, isIncr, zSetEntries, rawKey);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZIncrByParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZIncrByParser.java
new file mode 100644
index 00000000..403f640e
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZIncrByParser.java
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZIncrByCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class ZIncrByParser implements CommandParser<ZIncrByCommand> {
+
+ @Override
+ public ZIncrByCommand parse(Object[] command) {
+ int idx = 1;
+ String key = objToString(command[idx]);
+ byte[] rawKey = objToBytes(command[idx]);
+ idx++;
+ double increment = Double.parseDouble(objToString(command[idx++]));
+ String member = objToString(command[idx]);
+ byte[] rawMember = objToBytes(command[idx]);
+ idx++;
+ return new ZIncrByCommand(key, increment, member, rawKey, rawMember);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZInterStoreParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZInterStoreParser.java
new file mode 100644
index 00000000..108b3427
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZInterStoreParser.java
@@ -0,0 +1,69 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.AggregateType;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZInterStoreCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class ZInterStoreParser implements CommandParser<ZInterStoreCommand> {
+ @Override
+ public ZInterStoreCommand parse(Object[] command) {
+ int idx = 1;
+ AggregateType aggregateType = null;
+ String destination = objToString(command[idx]);
+ byte[] rawDestination = objToBytes(command[idx]);
+ idx++;
+ int numkeys = new BigDecimal(objToString(command[idx++])).intValueExact();
+ String[] keys = new String[numkeys];
+ byte[][] rawKeys = new byte[numkeys][];
+ for (int i = 0; i < numkeys; i++) {
+ keys[i] = objToString(command[idx]);
+ rawKeys[i] = objToBytes(command[idx]);
+ idx++;
+ }
+ double[] weights = null;
+ while (idx < command.length) {
+ String param = objToString(command[idx]);
+ if ("WEIGHTS".equalsIgnoreCase(param)) {
+ idx++;
+ weights = new double[numkeys];
+ for (int i = 0; i < numkeys; i++) {
+ weights[i] = Double.parseDouble(objToString(command[idx++]));
+ }
+ }
+ if ("AGGREGATE".equalsIgnoreCase(param)) {
+ idx++;
+ String next = objToString(command[idx++]);
+ if ("SUM".equalsIgnoreCase(next)) {
+ aggregateType = AggregateType.SUM;
+ } else if ("MIN".equalsIgnoreCase(next)) {
+ aggregateType = AggregateType.MIN;
+ } else if ("MAX".equalsIgnoreCase(next)) {
+ aggregateType = AggregateType.MAX;
+ }
+ }
+ }
+ return new ZInterStoreCommand(destination, numkeys, keys, weights, aggregateType, rawDestination, rawKeys);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemParser.java
new file mode 100644
index 00000000..8b0a1d8b
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemParser.java
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZRemCommand;
+
+public class ZRemParser implements CommandParser<ZRemCommand> {
+
+ @Override
+ public ZRemCommand parse(Object[] command) {
+ int idx = 1, newIdx = 0;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String[] members = new String[command.length - 2];
+ byte[][] rawMembers = new byte[command.length - 2][];
+ while (idx < command.length) {
+ members[newIdx] = CommandParsers.objToString(command[idx]);
+ rawMembers[newIdx] = CommandParsers.objToBytes(command[idx]);
+ newIdx++;
+ idx++;
+ }
+ return new ZRemCommand(key, members, rawKey, rawMembers);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemRangeByLexParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemRangeByLexParser.java
new file mode 100644
index 00000000..3cfaa12b
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemRangeByLexParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZRemRangeByLexCommand;
+
+public class ZRemRangeByLexParser implements CommandParser<ZRemRangeByLexCommand> {
+
+ @Override
+ public ZRemRangeByLexCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String min = CommandParsers.objToString(command[idx]);
+ byte[] rawMin = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String max = CommandParsers.objToString(command[idx]);
+ byte[] rawMax = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ return new ZRemRangeByLexCommand(key, min, max, rawKey, rawMin, rawMax);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemRangeByRankParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemRangeByRankParser.java
new file mode 100644
index 00000000..65469f94
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemRangeByRankParser.java
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZRemRangeByRankCommand;
+
+public class ZRemRangeByRankParser implements CommandParser<ZRemRangeByRankCommand> {
+
+ @Override
+ public ZRemRangeByRankCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ long start = new BigDecimal(CommandParsers.objToString(command[idx++])).longValueExact();
+ long stop = new BigDecimal(CommandParsers.objToString(command[idx++])).longValueExact();
+ return new ZRemRangeByRankCommand(key, start, stop, rawKey);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemRangeByScoreParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemRangeByScoreParser.java
new file mode 100644
index 00000000..e15635ea
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZRemRangeByScoreParser.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZRemRangeByScoreCommand;
+
+public class ZRemRangeByScoreParser implements CommandParser<ZRemRangeByScoreCommand> {
+
+ @Override
+ public ZRemRangeByScoreCommand parse(Object[] command) {
+ int idx = 1;
+ String key = CommandParsers.objToString(command[idx]);
+ byte[] rawKey = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String min = CommandParsers.objToString(command[idx]);
+ byte[] rawMin = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ String max = CommandParsers.objToString(command[idx]);
+ byte[] rawMax = CommandParsers.objToBytes(command[idx]);
+ idx++;
+ return new ZRemRangeByScoreCommand(key, min, max, rawKey, rawMin, rawMax);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZUnionStoreParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZUnionStoreParser.java
new file mode 100644
index 00000000..44c0cfaa
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZUnionStoreParser.java
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import java.math.BigDecimal;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.cmd.impl.AggregateType;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZUnionStoreCommand;
+
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToBytes;
+import static org.apache.rocketmq.redis.replicator.cmd.parser.CommandParsers.objToString;
+
+public class ZUnionStoreParser implements CommandParser<ZUnionStoreCommand> {
+ @Override
+ public ZUnionStoreCommand parse(Object[] command) {
+ int idx = 1;
+ AggregateType aggregateType = null;
+ String destination = objToString(command[idx]);
+ byte[] rawDestination = objToBytes(command[idx]);
+ idx++;
+ int numkeys = new BigDecimal(objToString(command[idx++])).intValueExact();
+ String[] keys = new String[numkeys];
+ byte[][] rawKeys = new byte[numkeys][];
+ for (int i = 0; i < numkeys; i++) {
+ keys[i] = objToString(command[idx]);
+ rawKeys[i] = objToBytes(command[idx]);
+ idx++;
+ }
+ double[] weights = null;
+ while (idx < command.length) {
+ String param = objToString(command[idx]);
+ if ("WEIGHTS".equalsIgnoreCase(param)) {
+ idx++;
+ weights = new double[numkeys];
+ for (int i = 0; i < numkeys; i++) {
+ weights[i] = Double.parseDouble(objToString(command[idx++]));
+ }
+ } else if ("AGGREGATE".equalsIgnoreCase(param)) {
+ idx++;
+ String next = objToString(command[idx++]);
+ if ("SUM".equalsIgnoreCase(next)) {
+ aggregateType = AggregateType.SUM;
+ } else if ("MIN".equalsIgnoreCase(next)) {
+ aggregateType = AggregateType.MIN;
+ } else if ("MAX".equalsIgnoreCase(next)) {
+ aggregateType = AggregateType.MAX;
+ }
+ }
+ }
+ return new ZUnionStoreCommand(destination, numkeys, keys, weights, aggregateType, rawDestination, rawKeys);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/conf/Configure.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/conf/Configure.java
new file mode 100644
index 00000000..58ce4e6c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/conf/Configure.java
@@ -0,0 +1,92 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.conf;
+
+import java.io.FileInputStream;
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.CONFIG_FILE;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.CONFIG_FILE_SYS_PROP_NAME;
+
+public class Configure {
+
+ private final Properties properties;
+
+ public Configure() {
+ this.properties = new Properties();
+ try {
+ String path = System.getProperty(CONFIG_FILE_SYS_PROP_NAME);
+ if (path != null && path.trim().length() != 0) {
+ properties.load(new FileInputStream(path));
+ } else {
+ path = CONFIG_FILE;
+ properties.load(Configure.class.getResourceAsStream(path));
+ }
+ } catch (IOException e) {
+ throw new ConfigureException(e);
+ }
+ }
+
+ public Configure(Properties properties) {
+ this();
+ this.properties.putAll(properties);
+ }
+
+ public String getString(String key) {
+ return getString(key, null, false);
+ }
+
+ public Integer getInt(String key) {
+ return getInt(key, null, false);
+ }
+
+ public Boolean getBool(String key) {
+ return getBool(key, null, false);
+ }
+
+ public String getString(String key, String value, boolean optional) {
+ String v = System.getProperty(key);
+ if (v == null && (v = properties.getProperty(key)) == null)
+ v = value;
+ if (v == null && !optional) {
+ throw new ConfigureException(String.format("Not found the config[key=%s]", key));
+ }
+ return v;
+ }
+
+ public Integer getInt(String key, Integer value, boolean optional) {
+ String v = getString(key, value == null ? null : value.toString(), optional);
+ try {
+ return Integer.parseInt(v);
+ } catch (NumberFormatException e) {
+ throw new ConfigureException(String.format("Invalid config[key=%s]", key));
+ }
+ }
+
+ public Boolean getBool(String key, Boolean value, boolean optional) {
+ String v = getString(key, value == null ? null : value.toString(), optional);
+ if (v == null)
+ return value;
+ if (v.equals("yes") || v.equals("true"))
+ return Boolean.TRUE;
+ if (v.equals("no") || v.equals("false"))
+ return Boolean.FALSE;
+ throw new ConfigureException(String.format("Invalid config[key=%s]", key));
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/conf/ConfigureException.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/conf/ConfigureException.java
new file mode 100644
index 00000000..6c372191
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/conf/ConfigureException.java
@@ -0,0 +1,39 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.conf;
+
+public class ConfigureException extends RuntimeException {
+ public ConfigureException() {
+ }
+
+ public ConfigureException(String message) {
+ super(message);
+ }
+
+ public ConfigureException(String message, Throwable cause) {
+ super(message, cause);
+ }
+
+ public ConfigureException(Throwable cause) {
+ super(cause);
+ }
+
+ public ConfigureException(String message, Throwable cause, boolean enableSuppression, boolean writableStackTrace) {
+ super(message, cause, enableSuppression, writableStackTrace);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/conf/ReplicatorConstants.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/conf/ReplicatorConstants.java
new file mode 100644
index 00000000..a92457e5
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/conf/ReplicatorConstants.java
@@ -0,0 +1,49 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.conf;
+
+public class ReplicatorConstants {
+
+ public static final String ROOT_DIR = "/redis-replicator";
+
+ public static final String CONFIG_FILE_SYS_PROP_NAME = "conf";
+
+ public static final String CONFIG_FILE = "/replicator.conf";
+
+ public static final String CONFIG_PROP_ZK_ADDRESS = "zookeeper.address";
+
+ public static final String REDIS_URI = "redis.uri";
+
+ public static final String ROCKETMQ_NAMESERVER_ADDRESS = "rocketmq.nameserver.address";
+
+ public static final String ROCKETMQ_PRODUCER_GROUP_NAME = "rocketmq.producer.groupname";
+
+ public static final String ROCKETMQ_PRODUCER_INSTANCE_NAME = "rocketmq.producer.instancename";
+
+ public static final String ROCKETMQ_DATA_TOPIC = "rocketmq.data.topic";
+
+ public static final String ORDER_MODEL = "order.model";
+
+ public static final String ORDER_MODEL_GLOBAL = "global";
+
+ public static final String DEPLOY_MODEL = "deploy.model";
+
+ public static final String DEPLOY_MODEL_CLUSTER = "cluster";
+
+ public static final String DEPLOY_MODEL_SINGLE = "single";
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/event/Event.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/event/Event.java
new file mode 100644
index 00000000..ca744949
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/event/Event.java
@@ -0,0 +1,23 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.event;
+
+import java.io.Serializable;
+
+public interface Event extends Serializable {
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/event/PostFullSyncEvent.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/event/PostFullSyncEvent.java
new file mode 100644
index 00000000..338568fb
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/event/PostFullSyncEvent.java
@@ -0,0 +1,30 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.event;
+
+public class PostFullSyncEvent implements Event {
+ private final long checksum;
+
+ public long getChecksum() {
+ return checksum;
+ }
+
+ public PostFullSyncEvent(final long checksum) {
+ this.checksum = checksum;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/event/PreFullSyncEvent.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/event/PreFullSyncEvent.java
new file mode 100644
index 00000000..f9bd53aa
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/event/PreFullSyncEvent.java
@@ -0,0 +1,21 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.event;
+
+public class PreFullSyncEvent implements Event {
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/AsyncBufferedInputStream.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/AsyncBufferedInputStream.java
new file mode 100644
index 00000000..1bf45fcb
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/AsyncBufferedInputStream.java
@@ -0,0 +1,244 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ * <p>
+ * http://www.apache.org/licenses/LICENSE-2.0
+ * <p>
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ *
+ * author Jingqi Xu
+ * author andyqzb
+ *
+ * modification: rename package. rename class.
+ */
+
+package org.apache.rocketmq.redis.replicator.io;
+
+import java.io.EOFException;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.concurrent.Executors;
+import java.util.concurrent.ThreadFactory;
+import java.util.concurrent.atomic.AtomicBoolean;
+import java.util.concurrent.locks.Condition;
+import java.util.concurrent.locks.ReentrantLock;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+public final class AsyncBufferedInputStream extends InputStream implements Runnable {
+
+ private static final Logger LOGGER = LoggerFactory.getLogger(AsyncBufferedInputStream.class);
+
+
+ private static final int DEFAULT_CAPACITY = 2 * 1024 * 1024;
+
+ private final Thread worker;
+ private final InputStream is;
+ private volatile IOException exception;
+ private final ByteRingBuffer ringBuffer;
+ private final ThreadFactory threadFactory;
+ private final ReentrantLock lock = new ReentrantLock(false);
+ private final AtomicBoolean closed = new AtomicBoolean(false);
+ private final Condition bufferNotFull = this.lock.newCondition();
+ private final Condition bufferNotEmpty = this.lock.newCondition();
+
+ public AsyncBufferedInputStream(InputStream is) {
+ this(is, DEFAULT_CAPACITY);
+ }
+
+ public AsyncBufferedInputStream(InputStream is, int size) {
+ this(is, size, Executors.defaultThreadFactory());
+ }
+
+ public AsyncBufferedInputStream(InputStream is, int size, ThreadFactory tf) {
+ this.is = is;
+ this.threadFactory = tf;
+ this.ringBuffer = new ByteRingBuffer(size);
+
+ this.worker = this.threadFactory.newThread(this);
+ this.worker.start();
+ }
+
+ public void run() {
+ try {
+ final byte[] buffer = new byte[512 * 1024];
+ while (!this.closed.get()) {
+ //
+ int r = this.is.read(buffer, 0, buffer.length);
+ if (r < 0)
+ throw new EOFException();
+
+ //
+ int offset = 0;
+ while (r > 0) {
+ final int w = write(buffer, offset, r);
+ r -= w;
+ offset += w;
+ }
+ }
+ } catch (IOException e) {
+ this.exception = e;
+ } catch (Exception e) {
+ LOGGER.error("failed to transfer data", e);
+ } finally {
+ if (!this.closed.get()) {
+ try {
+ close();
+ } catch (IOException e) {
+ LOGGER.error("failed to close is", e);
+ }
+ }
+ }
+ }
+
+ @Override
+ public int available() throws IOException {
+ return this.ringBuffer.size();
+ }
+
+ @Override
+ public void close() throws IOException {
+ if (!this.closed.compareAndSet(false, true))
+ return;
+
+ try {
+ this.is.close();
+ } finally {
+ this.lock.lock();
+ try {
+ this.bufferNotFull.signalAll();
+ this.bufferNotEmpty.signalAll();
+ } finally {
+ this.lock.unlock();
+ }
+ }
+ }
+
+ @Override
+ public int read() throws IOException {
+ this.lock.lock();
+ try {
+ while (this.ringBuffer.isEmpty()) {
+ if (this.exception != null)
+ throw this.exception;
+ this.bufferNotEmpty.awaitUninterruptibly();
+ if (this.closed.get())
+ throw new EOFException();
+ }
+
+ final int r = this.ringBuffer.read();
+ this.bufferNotFull.signal();
+ return r;
+ } finally {
+ this.lock.unlock();
+ }
+ }
+
+ @Override
+ public int read(byte b[], int off, int len) throws IOException {
+ this.lock.lock();
+ try {
+ while (this.ringBuffer.isEmpty()) {
+ if (this.exception != null)
+ throw this.exception;
+ this.bufferNotEmpty.awaitUninterruptibly();
+ if (this.closed.get())
+ throw new EOFException();
+ }
+
+ final int r = this.ringBuffer.read(b, off, len);
+ this.bufferNotFull.signal();
+ return r;
+ } finally {
+ this.lock.unlock();
+ }
+ }
+
+ public int write(byte b[], int off, int len) throws IOException {
+ this.lock.lock();
+ try {
+ while (this.ringBuffer.isFull()) {
+ this.bufferNotFull.awaitUninterruptibly();
+ if (this.closed.get())
+ throw new EOFException();
+ }
+
+ final int w = this.ringBuffer.write(b, off, len);
+ this.bufferNotEmpty.signal();
+ return w;
+ } finally {
+ this.lock.unlock();
+ }
+ }
+
+ private final class ByteRingBuffer {
+ private int size;
+ private int head; // Write
+ private int tail; // Read
+ private final byte[] buffer;
+
+ public ByteRingBuffer(int capacity) {
+ this.buffer = new byte[capacity];
+ }
+
+ public int size() {
+ return this.size;
+ }
+
+ public boolean isEmpty() {
+ return this.size == 0;
+ }
+
+ public boolean isFull() {
+ return this.size == this.buffer.length;
+ }
+
+ public int read() {
+ final int r = this.buffer[this.tail] & 0xFF;
+
+ this.tail = (this.tail + 1) % this.buffer.length;
+ this.size -= 1;
+ return r;
+ }
+
+ public int read(byte b[], int off, int len) {
+ final int r = Math.min(this.size, len);
+ if (this.head > this.tail) {
+ System.arraycopy(this.buffer, this.tail, b, off, r);
+ } else {
+ final int r1 = Math.min(this.buffer.length - this.tail, r);
+ System.arraycopy(this.buffer, this.tail, b, off, r1);
+ if (r1 < r)
+ System.arraycopy(this.buffer, 0, b, off + r1, r - r1);
+ }
+
+ this.tail = (this.tail + r) % this.buffer.length;
+ this.size -= r;
+ return r;
+ }
+
+ public int write(byte b[], int off, int len) {
+ final int w = Math.min(this.buffer.length - this.size, len);
+ if (this.head < this.tail) {
+ System.arraycopy(b, off, this.buffer, this.head, w);
+ } else {
+ final int w1 = Math.min(this.buffer.length - this.head, w);
+ System.arraycopy(b, off, this.buffer, this.head, w1);
+ if (w1 < w)
+ System.arraycopy(b, off + w1, this.buffer, 0, w - w1);
+ }
+
+ this.head = (this.head + w) % this.buffer.length;
+ this.size += w;
+ return w;
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/ByteArrayInputStream.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/ByteArrayInputStream.java
new file mode 100644
index 00000000..1448416d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/ByteArrayInputStream.java
@@ -0,0 +1,94 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.io;
+
+import java.io.IOException;
+import java.io.InputStream;
+import org.apache.rocketmq.redis.replicator.util.ByteArray;
+
+public class ByteArrayInputStream extends InputStream {
+
+ protected long pos;
+ protected long count;
+ protected long mark = 0;
+ protected ByteArray buf;
+
+ public ByteArrayInputStream(ByteArray buf) {
+ this.pos = 0;
+ this.buf = buf;
+ this.count = buf.length();
+ }
+
+ @Override
+ public int read() {
+ return (pos < count) ? (buf.get(pos++) & 0xff) : -1;
+ }
+
+ @Override
+ public int read(byte[] b, int off, int len) {
+ if (b == null) {
+ throw new NullPointerException();
+ } else if (off < 0 || len < 0 || len > b.length - off) {
+ throw new IndexOutOfBoundsException();
+ }
+
+ if (pos >= count)
+ return -1;
+ int avail = (int) (count - pos);
+ if (len > avail)
+ len = avail;
+ if (len <= 0)
+ return 0;
+ ByteArray.arraycopy(buf, pos, new ByteArray(b), off, len);
+ pos += len;
+ return len;
+ }
+
+ @Override
+ public long skip(long n) {
+ long k = count - pos;
+ if (n < k)
+ k = n < 0 ? 0 : n;
+ pos += k;
+ return k;
+ }
+
+ @Override
+ public int available() {
+ return (int) (this.count - this.pos);
+ }
+
+ @Override
+ public boolean markSupported() {
+ return true;
+ }
+
+ @Override
+ public void mark(int readAheadLimit) {
+ mark = pos;
+ }
+
+ @Override
+ public void reset() {
+ pos = mark;
+ }
+
+ @Override
+ public void close() throws IOException {
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/PeekableInputStream.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/PeekableInputStream.java
new file mode 100644
index 00000000..6a71cb38
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/PeekableInputStream.java
@@ -0,0 +1,88 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.io;
+
+import java.io.IOException;
+import java.io.InputStream;
+
+public class PeekableInputStream extends InputStream {
+
+ private int peek;
+ private InputStream in;
+ private boolean peeked;
+
+ public PeekableInputStream(InputStream in) {
+ this.in = in;
+ }
+
+ public int peek() throws IOException {
+ if (!this.peeked) {
+ this.peeked = true;
+ return this.peek = this.in.read();
+ }
+ return this.peek;
+ }
+
+ @Override
+ public int read() throws IOException {
+ if (!this.peeked)
+ return in.read();
+ this.peeked = false;
+ return this.peek;
+ }
+
+ @Override
+ public int read(byte[] b) throws IOException {
+ return read(b, 0, b.length);
+ }
+
+ @Override
+ public int read(byte[] b, int offset, int length) throws IOException {
+ if (length <= 0)
+ return 0;
+ if (!this.peeked)
+ return in.read(b, offset, length);
+ this.peeked = false;
+ if (this.peek < 0)
+ return this.peek;
+ int len = in.read(b, offset + 1, length - 1);
+ b[offset] = (byte) this.peek;
+ return len < 0 ? 1 : len + 1;
+ }
+
+ @Override
+ public long skip(long n) throws IOException {
+ if (n <= 0)
+ return 0;
+ if (!this.peeked)
+ return this.in.skip(n);
+ this.peeked = false;
+ return this.in.skip(n - 1) + 1;
+ }
+
+ @Override
+ public int available() throws IOException {
+ return (this.peeked ? 1 : 0) + this.in.available();
+ }
+
+ @Override
+ public void close() throws IOException {
+ this.in.close();
+ this.peeked = false;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RateLimitInputStream.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RateLimitInputStream.java
new file mode 100644
index 00000000..b32fc508
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RateLimitInputStream.java
@@ -0,0 +1,164 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.io;
+
+import java.io.IOException;
+import java.io.InputStream;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import static java.lang.System.currentTimeMillis;
+
+public class RateLimitInputStream extends InputStream {
+ private static final Logger LOGGER = LoggerFactory.getLogger(RateLimitInputStream.class);
+
+ private static final int DEFAULT_PERMITS = 100 * 1024 * 1000; // 97.65MB/sec
+
+ private final int permits;
+ private RateLimiter limiter;
+ private final InputStream in;
+
+ public RateLimitInputStream(InputStream in) {
+ this(in, DEFAULT_PERMITS);
+ }
+
+ public RateLimitInputStream(InputStream in, int permits) {
+ if (permits <= 1000)
+ permits = 1000;
+ else if (permits > 1000)
+ permits = permits / 1000 * 1000;
+ LOGGER.info("rate limit force set to " + permits);
+
+ this.in = in;
+ this.permits = permits;
+ this.limiter = new TokenBucketRateLimiter(this.permits);
+ }
+
+ @Override
+ public int read() throws IOException {
+ limiter.acquire(1);
+ return in.read();
+ }
+
+ @Override
+ public int read(byte[] b) throws IOException {
+ return read(b, 0, b.length);
+ }
+
+ @Override
+ public int read(byte[] b, int offset, int length) throws IOException {
+ int total = length, index = offset;
+ while (total > 0) {
+ int len = Math.min(permits, total);
+ limiter.acquire(len);
+ int r = in.read(b, index, len);
+ index += r;
+ total -= r;
+ if (r < 0)
+ return r;
+ if (r < len)
+ return length - total;
+ }
+ assert total == 0;
+ return length;
+ }
+
+ @Override
+ public long skip(long length) throws IOException {
+ long total = length;
+ while (total > 0) {
+ int skip = (int) Math.min(permits, total);
+ limiter.acquire(skip);
+ long r = in.skip(skip);
+ total -= r;
+ if (r < skip)
+ return length - total;
+ }
+ assert total == 0;
+ return length;
+ }
+
+ @Override
+ public int available() throws IOException {
+ return in.available();
+ }
+
+ @Override
+ public void close() throws IOException {
+ this.in.close();
+ }
+
+ private interface RateLimiter {
+ void acquire(long permits);
+ }
+
+ private class TokenBucketRateLimiter implements RateLimiter {
+
+ private long access;
+ private long borrow;
+ private long permits;
+ private final long size;
+ private final double sleep;
+
+ private TokenBucketRateLimiter(int permits) {
+ this.access = currentTimeMillis();
+ this.size = this.permits = permits;
+ this.sleep = 1 * this.size / 1000d;
+ }
+
+ @Override
+ public void acquire(long permits) {
+ try {
+ while (true) {
+ generate();
+ if (this.permits < permits) {
+ permits -= this.permits;
+ } else {
+ this.permits -= permits;
+ return;
+ }
+ double r = permits / sleep;
+ if (r < 1) {
+ this.borrow += permits;
+ while (this.borrow >= sleep) {
+ Thread.sleep(1);
+ this.borrow -= sleep;
+ }
+ return;
+ } else {
+ Thread.sleep((int) r);
+ }
+ }
+ } catch (InterruptedException e) {
+ Thread.currentThread().interrupt();
+ }
+ }
+
+ private long generate() {
+ long access = currentTimeMillis();
+ if (access <= this.access)
+ return 0L;
+ long p = (access - this.access) * size / 1000L;
+ this.permits += p;
+ if (this.permits > size)
+ this.permits = size;
+ this.access = access;
+ return p;
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RawByteListener.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RawByteListener.java
new file mode 100644
index 00000000..876bd4a8
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RawByteListener.java
@@ -0,0 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.io;
+
+public interface RawByteListener {
+ void handle(byte... rawBytes);
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RedisInputStream.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RedisInputStream.java
new file mode 100644
index 00000000..2f0742ed
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RedisInputStream.java
@@ -0,0 +1,261 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.io;
+
+import java.io.EOFException;
+import java.io.IOException;
+import java.io.InputStream;
+import java.nio.charset.Charset;
+import java.util.Arrays;
+import java.util.List;
+import org.apache.rocketmq.redis.replicator.util.ByteArray;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+
+public class RedisInputStream extends InputStream {
+ protected int head = 0;
+ protected int tail = 0;
+ protected long total = 0;
+ protected long markLen = 0;
+ protected final byte[] buf;
+ protected boolean mark = false;
+ protected final InputStream in;
+ protected List<RawByteListener> rawByteListeners;
+
+ public RedisInputStream(final InputStream in) {
+ this(in, 8192);
+ }
+
+ public RedisInputStream(final InputStream in, int len) {
+ this.in = in;
+ this.buf = new byte[len];
+ }
+
+ /**
+ * @param rawByteListeners raw byte listeners
+ */
+ public synchronized void setRawByteListeners(List<RawByteListener> rawByteListeners) {
+ this.rawByteListeners = rawByteListeners;
+ }
+
+ protected void notify(byte... bytes) {
+ if (rawByteListeners == null || rawByteListeners.isEmpty())
+ return;
+ for (RawByteListener listener : rawByteListeners) {
+ listener.handle(bytes);
+ }
+ }
+
+ public int head() {
+ return head;
+ }
+
+ public int tail() {
+ return tail;
+ }
+
+ public int bufSize() {
+ return buf.length;
+ }
+
+ public void mark() {
+ if (!mark) {
+ mark = true;
+ return;
+ }
+ throw new AssertionError("already marked");
+ }
+
+ public long unmark() {
+ if (mark) {
+ long rs = markLen;
+ markLen = 0;
+ mark = false;
+ return rs;
+ }
+ throw new AssertionError("must mark first");
+ }
+
+ public long total() {
+ return total;
+ }
+
+ public ByteArray readBytes(long len) throws IOException {
+ ByteArray bytes = new ByteArray(len);
+ this.read(bytes, 0, len);
+ if (mark)
+ markLen += len;
+ return bytes;
+ }
+
+ public int readInt(int len) throws IOException {
+ return readInt(len, true);
+ }
+
+ public long readLong(int len) throws IOException {
+ return readLong(len, true);
+ }
+
+ public int readInt(int length, boolean littleEndian) throws IOException {
+ int r = 0;
+ for (int i = 0; i < length; ++i) {
+ final int v = this.read();
+ if (littleEndian) {
+ r = r | (v << (i << 3));
+ } else {
+ r = (r << 8) | v;
+ }
+ }
+ int c = 4 - length << 3;
+ return r << c >> c;
+ }
+
+ public long readUInt(int length) throws IOException {
+ return readUInt(length, true);
+ }
+
+ public long readUInt(int length, boolean littleEndian) throws IOException {
+ return readInt(length, littleEndian) & 0xFFFFFFFFL;
+ }
+
+ public int readInt(byte[] bytes) {
+ return readInt(bytes, true);
+ }
+
+ public int readInt(byte[] bytes, boolean littleEndian) {
+ int r = 0;
+ int length = bytes.length;
+ for (int i = 0; i < length; ++i) {
+ final int v = bytes[i] & 0xff;
+ if (littleEndian) {
+ r = r | (v << (i << 3));
+ } else {
+ r = (r << 8) | v;
+ }
+ }
+ int c = 4 - length << 3;
+ return r << c >> c;
+ }
+
+ public long readLong(int length, boolean littleEndian) throws IOException {
+ long r = 0;
+ for (int i = 0; i < length; ++i) {
+ final long v = this.read();
+ if (littleEndian) {
+ r = r | (v << (i << 3));
+ } else {
+ r = (r << 8) | v;
+ }
+ }
+ return r;
+ }
+
+ public String readString(int len) throws IOException {
+ return readString(len, UTF_8);
+ }
+
+ public String readString(int len, Charset charset) throws IOException {
+ byte[] original = readBytes(len).first();
+ return new String(original, charset);
+ }
+
+ @Override
+ public int read() throws IOException {
+ if (head >= tail)
+ fill();
+ if (mark)
+ markLen += 1;
+ byte b = buf[head++];
+ notify(b);
+ return b & 0xff;
+ }
+
+ public long read(ByteArray bytes, long offset, long len) throws IOException {
+ long total = len;
+ long index = offset;
+ while (total > 0) {
+ int available = tail - head;
+ if (available >= total) {
+ ByteArray.arraycopy(new ByteArray(buf), head, bytes, index, total);
+ head += total;
+ break;
+ } else {
+ ByteArray.arraycopy(new ByteArray(buf), head, bytes, index, available);
+ index += available;
+ total -= available;
+ fill();
+ }
+ }
+ for (byte[] b : bytes) {
+ notify(b);
+ }
+ return len;
+ }
+
+ @Override
+ public int read(byte[] b) throws IOException {
+ return read(b, 0, b.length);
+ }
+
+ @Override
+ public int read(byte[] b, int off, int len) throws IOException {
+ return (int) read(new ByteArray(b), off, len);
+ }
+
+ @Override
+ public int available() throws IOException {
+ return tail - head + in.available();
+ }
+
+ public long skip(long len, boolean notify) throws IOException {
+ long total = len;
+ while (total > 0) {
+ int available = tail - head;
+ if (available >= total) {
+ if (notify)
+ notify(Arrays.copyOfRange(buf, head, head + (int) total));
+ head += total;
+ break;
+ } else {
+ if (notify)
+ notify(Arrays.copyOfRange(buf, head, tail));
+ total -= available;
+ fill();
+ }
+ }
+ return len;
+ }
+
+ @Override
+ public long skip(long len) throws IOException {
+ return skip(len, true);
+ }
+
+ @Override
+ public void close() throws IOException {
+ in.close();
+ }
+
+ protected void fill() throws IOException {
+ tail = in.read(buf, 0, buf.length);
+ if (tail == -1)
+ throw new EOFException("end of file or end of stream.");
+ total += tail;
+ head = 0;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RedisOutputStream.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RedisOutputStream.java
new file mode 100644
index 00000000..11d95de5
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/io/RedisOutputStream.java
@@ -0,0 +1,60 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.io;
+
+import java.io.BufferedOutputStream;
+import java.io.IOException;
+import java.io.OutputStream;
+
+public class RedisOutputStream extends OutputStream {
+ private final OutputStream out;
+
+ public RedisOutputStream(OutputStream out) {
+ this.out = new BufferedOutputStream(out);
+ }
+
+ @Override
+ public void write(int b) throws IOException {
+ out.write(b);
+ }
+
+ @Override
+ public void write(byte[] b) throws IOException {
+ out.write(b, 0, b.length);
+ }
+
+ @Override
+ public void write(byte[] b, int off, int len) throws IOException {
+ out.write(b, off, len);
+ }
+
+ public void writeCrLf() throws IOException {
+ out.write('\r');
+ out.write('\n');
+ }
+
+ @Override
+ public void flush() throws IOException {
+ out.flush();
+ }
+
+ @Override
+ public void close() throws IOException {
+ out.close();
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/net/RedisSocketFactory.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/net/RedisSocketFactory.java
new file mode 100644
index 00000000..8641fb75
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/net/RedisSocketFactory.java
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.net;
+
+import java.io.IOException;
+import java.net.InetAddress;
+import java.net.InetSocketAddress;
+import java.net.Socket;
+import java.net.SocketException;
+import javax.net.SocketFactory;
+import javax.net.ssl.SSLSocket;
+import org.apache.rocketmq.redis.replicator.Configuration;
+
+public class RedisSocketFactory extends SocketFactory {
+
+ protected final Configuration configuration;
+
+ public RedisSocketFactory(Configuration configuration) {
+ this.configuration = configuration;
+ }
+
+ @Override
+ public Socket createSocket(String host, int port) throws IOException {
+ if (configuration.isSsl()) {
+ return buildSsl(build(configuration.getSslSocketFactory().createSocket(host, port)), host);
+ } else {
+ return build(new Socket(host, port));
+ }
+ }
+
+ @Override
+ public Socket createSocket(String host, int port, InetAddress localAddr, int localPort) throws IOException {
+ if (configuration.isSsl()) {
+ return buildSsl(build(configuration.getSslSocketFactory().createSocket(host, port, localAddr, localPort)), host);
+ } else {
+ return build(new Socket(host, port, localAddr, localPort));
+ }
+ }
+
+ @Override
+ public Socket createSocket(InetAddress address, int port) throws IOException {
+ if (configuration.isSsl()) {
+ return buildSsl(build(configuration.getSslSocketFactory().createSocket(address, port)), address.getHostAddress());
+ } else {
+ return build(new Socket(address, port));
+ }
+ }
+
+ @Override
+ public Socket createSocket(InetAddress address, int port, InetAddress localAddr, int localPort) throws IOException {
+ if (configuration.isSsl()) {
+ return buildSsl(build(configuration.getSslSocketFactory().createSocket(address, port, localAddr, localPort)), address.getHostAddress());
+ } else {
+ return build(new Socket(address, port, localAddr, localPort));
+ }
+ }
+
+ public Socket createSocket(String host, int port, int timeout) throws IOException {
+ Socket socket = new Socket();
+ build(socket);
+ socket.connect(new InetSocketAddress(host, port), timeout);
+ if (configuration.isSsl()) {
+ socket = configuration.getSslSocketFactory().createSocket(socket, host, port, true);
+ return buildSsl(socket, host);
+ } else {
+ return socket;
+ }
+ }
+
+ private Socket build(Socket socket) throws SocketException {
+ socket.setReuseAddress(true);
+ socket.setKeepAlive(true);
+ socket.setTcpNoDelay(true);
+ socket.setSoLinger(true, 0);
+ if (configuration.getReadTimeout() > 0) {
+ socket.setSoTimeout(configuration.getReadTimeout());
+ }
+ if (configuration.getReceiveBufferSize() > 0) {
+ socket.setReceiveBufferSize(configuration.getReceiveBufferSize());
+ }
+ if (configuration.getSendBufferSize() > 0) {
+ socket.setSendBufferSize(configuration.getSendBufferSize());
+ }
+ return socket;
+ }
+
+ private Socket buildSsl(Socket socket, String host) throws SocketException {
+ if (configuration.getSslParameters() != null) {
+ ((SSLSocket) socket).setSSLParameters(configuration.getSslParameters());
+ }
+ if (configuration.getHostnameVerifier() != null && !configuration.getHostnameVerifier().verify(host, ((SSLSocket) socket).getSession())) {
+ throw new SocketException("the connection to " + host + " failed ssl/tls hostname verification.");
+ }
+ return socket;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/producer/RocketMQProducer.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/producer/RocketMQProducer.java
new file mode 100644
index 00000000..112e778e
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/producer/RocketMQProducer.java
@@ -0,0 +1,139 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.producer;
+
+import java.util.List;
+import java.util.Objects;
+import org.apache.rocketmq.client.exception.MQBrokerException;
+import org.apache.rocketmq.client.exception.MQClientException;
+import org.apache.rocketmq.client.producer.DefaultMQProducer;
+import org.apache.rocketmq.client.producer.MQProducer;
+import org.apache.rocketmq.client.producer.SendResult;
+import org.apache.rocketmq.client.producer.SendStatus;
+import org.apache.rocketmq.common.message.Message;
+import org.apache.rocketmq.common.message.MessageQueue;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.conf.Configure;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.remoting.exception.RemotingException;
+
+import static com.alibaba.fastjson.JSON.toJSONBytes;
+import static com.alibaba.fastjson.serializer.SerializerFeature.IgnoreNonFieldGetter;
+import static java.lang.String.valueOf;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.ORDER_MODEL;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.ORDER_MODEL_GLOBAL;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.ROCKETMQ_DATA_TOPIC;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.ROCKETMQ_NAMESERVER_ADDRESS;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.ROCKETMQ_PRODUCER_GROUP_NAME;
+import static org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants.ROCKETMQ_PRODUCER_INSTANCE_NAME;
+
+public class RocketMQProducer {
+
+ private String topic;
+ private boolean global;
+ private MQProducer producer;
+ private List<MessageQueue> messageQueues;
+
+ public RocketMQProducer(Configure configure) throws MQClientException {
+ Objects.requireNonNull(configure);
+ this.topic = configure.getString(ROCKETMQ_DATA_TOPIC);
+ this.global = configure.getString(ORDER_MODEL, ORDER_MODEL_GLOBAL, true).equals(ORDER_MODEL_GLOBAL);
+ DefaultMQProducer producer = new DefaultMQProducer();
+ producer.setNamesrvAddr(configure.getString(ROCKETMQ_NAMESERVER_ADDRESS));
+ producer.setProducerGroup(configure.getString(ROCKETMQ_PRODUCER_GROUP_NAME));
+ producer.setInstanceName(configure.getString(ROCKETMQ_PRODUCER_INSTANCE_NAME));
+ this.producer = producer;
+ this.producer.start();
+ this.messageQueues = this.producer.fetchPublishMessageQueues(this.topic);
+ }
+
+ /**
+ * Send rdb data which always is key-value pair. System command such as flushall won't be included.
+ * <p>
+ *
+ * @param kv rdb key value pair
+ * @return true if send success.
+ * @throws MQClientException MQClientException
+ * @throws RemotingException RemotingException
+ * @throws InterruptedException InterruptedException
+ * @throws MQBrokerException MQBrokerException
+ */
+ public boolean sendKeyValuePair(
+ KeyValuePair<?> kv) throws MQClientException, RemotingException, InterruptedException, MQBrokerException {
+ return global ? sendGlobalOrder(kv) : sendPartialOrder(kv);
+ }
+
+ /**
+ * Send realtime redis master command to RMQ. As the command may be a system command like 'flushall',
+ * which does't have key. So dispatch the command to different queue may cause unexpected issue.
+ * <p>
+ *
+ * @param command aof command
+ * @return true if send success
+ * @throws MQClientException MQClientException
+ * @throws RemotingException RemotingException
+ * @throws InterruptedException InterruptedException
+ * @throws MQBrokerException MQBrokerException
+ */
+ public boolean sendCommand(
+ Command command) throws InterruptedException, RemotingException, MQClientException, MQBrokerException {
+ Message msg = new Message(this.topic, toJSONBytes(command, IgnoreNonFieldGetter));
+ SendResult rs = this.producer.send(msg, this.messageQueues.get(0));
+ return rs.getSendStatus() == SendStatus.SEND_OK;
+ }
+
+ /**
+ * Send rdb data to a single queue to keep global order.
+ * <p>
+ *
+ * @param kv rdb key value pair
+ * @return true if send success
+ * @throws MQClientException MQClientException
+ * @throws RemotingException RemotingException
+ * @throws InterruptedException InterruptedException
+ * @throws MQBrokerException MQBrokerException
+ */
+ private boolean sendGlobalOrder(
+ KeyValuePair<?> kv) throws InterruptedException, RemotingException, MQClientException, MQBrokerException {
+ Message msg = new Message(this.topic, valueOf(kv.getDb().getDbNumber()), toJSONBytes(kv, IgnoreNonFieldGetter));
+
+ SendResult rs = this.producer.send(msg, this.messageQueues.get(0));
+ return rs.getSendStatus() == SendStatus.SEND_OK;
+ }
+
+ /**
+ * Rdb contents are always key-value pair, so we could dispatch identical key to one queue,
+ * to support consume concurrently and keep partial orderly.
+ * <p>
+ *
+ * @param kv rdb key value pair
+ * @return true if send success
+ * @throws MQClientException MQClientException
+ * @throws RemotingException RemotingException
+ * @throws InterruptedException InterruptedException
+ * @throws MQBrokerException MQBrokerException
+ */
+ private boolean sendPartialOrder(
+ KeyValuePair<?> kv) throws MQClientException, RemotingException, InterruptedException, MQBrokerException {
+ String key = kv.getKey();
+ int index = key.hashCode() % this.messageQueues.size();
+ Message msg = new Message(this.topic, valueOf(kv.getDb().getDbNumber()), toJSONBytes(kv));
+ SendResult rs = this.producer.send(msg, this.messageQueues.get(index));
+ return rs.getSendStatus() == SendStatus.SEND_OK;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/BaseRdbParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/BaseRdbParser.java
new file mode 100644
index 00000000..2bf20fc2
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/BaseRdbParser.java
@@ -0,0 +1,394 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import java.io.IOException;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.util.ByteArray;
+import org.apache.rocketmq.redis.replicator.util.Lzf;
+
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_14BITLEN;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_32BITLEN;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_64BITLEN;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_6BITLEN;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_ENCVAL;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_ENC_INT16;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_ENC_INT32;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_ENC_INT8;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_ENC_LZF;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_LOAD_ENC;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_LOAD_PLAIN;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.ZIP_INT_16B;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.ZIP_INT_24B;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.ZIP_INT_32B;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.ZIP_INT_64B;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.ZIP_INT_8B;
+
+public class BaseRdbParser {
+ protected final RedisInputStream in;
+
+ public BaseRdbParser(RedisInputStream in) {
+ this.in = in;
+ }
+
+ /**
+ * "expiry time in seconds". After that, expiry time is read as a 4 byte unsigned int
+ * <p>
+ *
+ * @return seconds
+ * @throws IOException when read timeout
+ */
+ public int rdbLoadTime() throws IOException {
+ return in.readInt(4);
+ }
+
+ /**
+ * "expiry time in ms". After that, expiry time is read as a 8 byte unsigned long
+ * <p>
+ *
+ * @return millisecond
+ * @throws IOException when read timeout
+ */
+ public long rdbLoadMillisecondTime() throws IOException {
+ return in.readLong(8);
+ }
+
+ /**
+ * read bytes 1 or 2 or 5 <p> 1. |00xxxxxx| remaining 6 bits represent the length <p> 2. |01xxxxxx|xxxxxxxx| the
+ * combined 14 bits represent the length <p> 3. |10xxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx| the remaining 6 bits
+ * are discarded.Additional 4 bytes represent the length(big endian in version6) <p> 4. |11xxxxxx| the remaining 6
+ * bits are read.and then the next object is encoded in a special format.so we set isencoded = true <p>
+ *
+ * @return tuple(len, isencoded)
+ * @throws IOException when read timeout
+ * @see #rdbLoadIntegerObject
+ * @see #rdbLoadLzfStringObject
+ */
+ public Len rdbLoadLen() throws IOException {
+ boolean isencoded = false;
+ int rawByte = in.read();
+ int type = (rawByte & 0xc0) >> 6;
+ long value;
+ if (type == RDB_ENCVAL) {
+ isencoded = true;
+ value = rawByte & 0x3f;
+ } else if (type == RDB_6BITLEN) {
+ value = rawByte & 0x3f;
+ } else if (type == RDB_14BITLEN) {
+ value = ((rawByte & 0x3F) << 8) | in.read();
+ } else if (rawByte == RDB_32BITLEN) {
+ value = in.readInt(4, false);
+ } else if (rawByte == RDB_64BITLEN) {
+ value = in.readLong(8, false);
+ } else {
+ throw new AssertionError("unexpected len-type:" + type);
+ }
+ return new Len(value, isencoded);
+ }
+
+ /**
+ * @param enctype 0,1,2
+ * @param flags RDB_LOAD_ENC: encoded string.RDB_LOAD_PLAIN | RDB_LOAD_NONE:raw bytes
+ * @return ByteArray rdb byte array object
+ * @throws IOException when read timeout
+ */
+ public ByteArray rdbLoadIntegerObject(int enctype, int flags) throws IOException {
+ boolean plain = (flags & RDB_LOAD_PLAIN) != 0;
+ boolean encode = (flags & RDB_LOAD_ENC) != 0;
+ byte[] value;
+ switch (enctype) {
+ case RDB_ENC_INT8:
+ value = in.readBytes(1).first();
+ break;
+ case RDB_ENC_INT16:
+ value = in.readBytes(2).first();
+ break;
+ case RDB_ENC_INT32:
+ value = in.readBytes(4).first();
+ break;
+ default:
+ value = new byte[] {0x00};
+ break;
+ }
+ if (plain) {
+ return new ByteArray(value);
+ } else if (encode) {
+ // createStringObjectFromLongLong(val);
+ return new ByteArray(String.valueOf(in.readInt(value)).getBytes());
+ } else {
+ // createObject(OBJ_STRING,sdsfromlonglong(val));
+ return new ByteArray(value);
+ }
+ }
+
+ /**
+ * |11xxxxxx| remaining 6bit is 3,then lzf compressed string follows
+ * <p>
+ * lzf format
+ * <p>
+ * |lzf flag|clen:1 or 2 or 5 bytes|len:1 or 2 or 5 bytes | lzf compressed bytes |
+ * <p>
+ * |11xxxxxx|xxxxxxxx|....|xxxxxxxx|xxxxxxxx|....|xxxxxxxx|xxxxxxxx|xxxxxxxx|............xxxxxxxx|
+ * <p>
+ *
+ * @param flags RDB_LOAD_ENC: encoded string.RDB_LOAD_PLAIN | RDB_LOAD_NONE:raw bytes
+ * @return ByteArray rdb byte array object
+ * @throws IOException when read timeout
+ * @see #rdbLoadLen
+ */
+ public ByteArray rdbLoadLzfStringObject(int flags) throws IOException {
+ boolean plain = (flags & RDB_LOAD_PLAIN) != 0;
+ boolean encode = (flags & RDB_LOAD_ENC) != 0;
+ long clen = rdbLoadLen().len;
+ long len = rdbLoadLen().len;
+ // if (plain || sds) {
+ // return val;
+ // } else {
+ // return createObject(OBJ_STRING,val);
+ // }
+ if (plain) {
+ return Lzf.decode(in.readBytes(clen), len);
+ } else if (encode) {
+ return Lzf.decode(in.readBytes(clen), len);
+ } else {
+ return Lzf.decode(in.readBytes(clen), len);
+ }
+ }
+
+ /**
+ * 1.|11xxxxxx|xxxxxxxx| remaining 6bit is 0, then an 8 bit integer follows
+ * <p>
+ * 2.|11xxxxxx|xxxxxxxx|xxxxxxxx| remaining 6bit is 1, then an 16 bit integer follows
+ * <p>
+ * 3.|11xxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx| remaining 6bit is 2, then an 32 bit integer follows
+ * <p>
+ * 4.|11xxxxxx| remaining 6bit is 3,then lzf compressed string follows
+ * <p>
+ *
+ * @param flags RDB_LOAD_ENC: encoded string.RDB_LOAD_PLAIN | RDB_LOAD_NONE:raw bytes
+ * @return ByteArray rdb byte array object
+ * @throws IOException when read timeout
+ * @see #rdbLoadIntegerObject
+ * @see #rdbLoadLzfStringObject
+ */
+ public ByteArray rdbGenericLoadStringObject(int flags) throws IOException {
+ boolean plain = (flags & RDB_LOAD_PLAIN) != 0;
+ boolean encode = (flags & RDB_LOAD_ENC) != 0;
+ Len lenObj = rdbLoadLen();
+ long len = (int) lenObj.len;
+ boolean isencoded = lenObj.isencoded;
+ if (isencoded) {
+ switch ((int) len) {
+ case RDB_ENC_INT8:
+ case RDB_ENC_INT16:
+ case RDB_ENC_INT32:
+ return rdbLoadIntegerObject((int) len, flags);
+ case RDB_ENC_LZF:
+ return rdbLoadLzfStringObject(flags);
+ default:
+ throw new AssertionError("unknown RdbParser encoding type:" + len);
+ }
+ }
+ if (plain) {
+ return in.readBytes(len);
+ } else if (encode) {
+ // createStringObject(NULL,len)
+ return in.readBytes(len);
+ } else {
+ // createRawStringObject(NULL,len);
+ return in.readBytes(len);
+ }
+ }
+
+ /**
+ * @return ByteArray rdb object with byte[]
+ * @throws IOException when read timeout
+ */
+ public ByteArray rdbLoadPlainStringObject() throws IOException {
+ return rdbGenericLoadStringObject(RDB_LOAD_PLAIN);
+ }
+
+ /**
+ * @return ByteArray rdb object with byte[]
+ * @throws IOException when read timeout
+ */
+ public ByteArray rdbLoadEncodedStringObject() throws IOException {
+ return rdbGenericLoadStringObject(RDB_LOAD_ENC);
+ }
+
+ public double rdbLoadDoubleValue() throws IOException {
+ int len = in.read();
+ switch (len) {
+ case 255:
+ return Double.NEGATIVE_INFINITY;
+ case 254:
+ return Double.POSITIVE_INFINITY;
+ case 253:
+ return Double.NaN;
+ default:
+ byte[] bytes = in.readBytes(len).first();
+ return Double.valueOf(new String(bytes));
+ }
+ }
+
+ public double rdbLoadBinaryDoubleValue() throws IOException {
+ return Double.longBitsToDouble(in.readLong(8));
+ }
+
+ /**
+ * @return single precision float
+ * @throws IOException io exception
+ */
+ public float rdbLoadBinaryFloatValue() throws IOException {
+ return Float.intBitsToFloat(in.readInt(4));
+ }
+
+ /**
+ * @see #rdbLoadLen
+ */
+ public static class Len {
+ public final long len;
+ public final boolean isencoded;
+
+ private Len(long len, boolean isencoded) {
+ this.len = len;
+ this.isencoded = isencoded;
+ }
+ }
+
+ public static class StringHelper {
+ private StringHelper() {
+ }
+
+ public static String str(RedisInputStream in, int len) throws IOException {
+ return in.readString(len);
+ }
+
+ public static byte[] bytes(RedisInputStream in, int len) throws IOException {
+ return in.readBytes(len).first();
+ }
+
+ public static long skip(RedisInputStream in, long len) throws IOException {
+ return in.skip(len);
+ }
+
+ /*
+ * length-prev-entry special-flag raw-bytes-of-entry
+ * length-prev-entry format
+ * |xxxxxxxx| if first byte value < 254. then 1 byte as prev len.
+ * |xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx| if first byte >=254 then next 4 byte as prev len.
+ * special-flag
+ * |00xxxxxx| remaining 6 bit as string len.
+ * |01xxxxxx|xxxxxxxx| combined 14 bit as string len.
+ * |10xxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx| next 4 byte as string len.
+ * |11111110|xxxxxxxx| next 1 byte as 8bit int
+ * |11000000|xxxxxxxx|xxxxxxxx| next 2 bytes as 16bit int
+ * |11110000|xxxxxxxx|xxxxxxxx|xxxxxxxx| next 3 bytes as 24bit int
+ * |11010000|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx| next 4 bytes as 32bit int
+ * |11100000|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx| next 8 bytes as 64bit long
+ * |11xxxxxx| next 6 bit value as int value
+ */
+ public static byte[] zipListEntry(RedisInputStream in) throws IOException {
+ int prevlen = in.read();
+ if (prevlen >= 254) {
+ prevlen = in.readInt(4);
+ }
+ int special = in.read();
+ switch (special >> 6) {
+ case 0:
+ int len = special & 0x3f;
+ return bytes(in, len);
+ case 1:
+ len = ((special & 0x3f) << 8) | in.read();
+ return bytes(in, len);
+ case 2:
+ //bigEndian
+ len = in.readInt(4, false);
+ return bytes(in, len);
+ default:
+ break;
+ }
+ switch (special) {
+ case ZIP_INT_8B:
+ return String.valueOf(in.readInt(1)).getBytes();
+ case ZIP_INT_16B:
+ return String.valueOf(in.readInt(2)).getBytes();
+ case ZIP_INT_24B:
+ return String.valueOf(in.readInt(3)).getBytes();
+ case ZIP_INT_32B:
+ return String.valueOf(in.readInt(4)).getBytes();
+ case ZIP_INT_64B:
+ return String.valueOf(in.readLong(8)).getBytes();
+ default:
+ //6BIT
+ return String.valueOf(special - 0xf1).getBytes();
+ }
+ }
+ }
+
+ public static class LenHelper {
+ private LenHelper() {
+ }
+
+ //zip hash
+ public static int zmlen(RedisInputStream in) throws IOException {
+ return in.read();
+ }
+
+ public static int free(RedisInputStream in) throws IOException {
+ return in.read();
+ }
+
+ public static int zmElementLen(RedisInputStream in) throws IOException {
+ int len = in.read();
+ if (len >= 0 && len <= 253) {
+ return len;
+ } else if (len == 254) {
+ return in.readInt(4, false);
+ } else {
+ return len;
+ }
+ }
+
+ //zip list
+ public static int zlbytes(RedisInputStream in) throws IOException {
+ return in.readInt(4);
+ }
+
+ public static int zlend(RedisInputStream in) throws IOException {
+ return in.read();
+ }
+
+ public static int zltail(RedisInputStream in) throws IOException {
+ return in.readInt(4);
+ }
+
+ public static int zllen(RedisInputStream in) throws IOException {
+ return in.readInt(2);
+ }
+
+ //int set
+ public static int encoding(RedisInputStream in) throws IOException {
+ return in.readInt(4);
+ }
+
+ public static long lenOfContent(RedisInputStream in) throws IOException {
+ return in.readUInt(4);
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/DefaultRdbVisitor.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/DefaultRdbVisitor.java
new file mode 100644
index 00000000..e8a5b012
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/DefaultRdbVisitor.java
@@ -0,0 +1,674 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import java.io.IOException;
+import java.util.ArrayList;
+import java.util.LinkedHashMap;
+import java.util.LinkedHashSet;
+import java.util.List;
+import java.util.Map;
+import java.util.NoSuchElementException;
+import java.util.Set;
+import org.apache.rocketmq.redis.replicator.RedisConstants;
+import org.apache.rocketmq.redis.replicator.Replicator;
+import org.apache.rocketmq.redis.replicator.event.Event;
+import org.apache.rocketmq.redis.replicator.io.ByteArrayInputStream;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.AuxField;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.DB;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ExpiredType;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueHash;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueList;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueModule;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueSet;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueString;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueZSet;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.Module;
+import org.apache.rocketmq.redis.replicator.rdb.module.ModuleParser;
+import org.apache.rocketmq.redis.replicator.util.ByteArray;
+import org.apache.rocketmq.redis.replicator.util.ByteArrayMap;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ZSetEntry;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import static java.lang.Integer.parseInt;
+import static java.lang.Long.parseLong;
+import static java.nio.charset.StandardCharsets.UTF_8;
+
+public class DefaultRdbVisitor extends RdbVisitor {
+
+ protected static final Logger LOGGER = LoggerFactory.getLogger(DefaultRdbVisitor.class);
+
+ protected final Replicator replicator;
+
+ public DefaultRdbVisitor(final Replicator replicator) {
+ this.replicator = replicator;
+ }
+
+ @Override
+ public String applyMagic(RedisInputStream in) throws IOException {
+ String magicString = BaseRdbParser.StringHelper.str(in, 5);//REDIS
+ if (!magicString.equals("REDIS")) {
+ throw new UnsupportedOperationException("can't read MAGIC STRING [REDIS] ,value:" + magicString);
+ }
+ return magicString;
+ }
+
+ @Override
+ public int applyVersion(RedisInputStream in) throws IOException {
+ int version = Integer.parseInt(BaseRdbParser.StringHelper.str(in, 4));
+ if (version < 2 || version > 8) {
+ throw new UnsupportedOperationException(String.valueOf("can't handle RDB format version " + version));
+ }
+ return version;
+ }
+
+ @Override
+ public int applyType(RedisInputStream in) throws IOException {
+ return in.read();
+ }
+
+ @Override
+ public DB applySelectDB(RedisInputStream in, int version) throws IOException {
+ /*
+ * ----------------------------
+ * FE $length-encoding # Previous db ends, next db starts. Database number read using length encoding.
+ * ----------------------------
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ long dbNumber = parser.rdbLoadLen().len;
+ return new DB(dbNumber);
+ }
+
+ @Override
+ public DB applyResizeDB(RedisInputStream in, DB db, int version) throws IOException {
+ BaseRdbParser parser = new BaseRdbParser(in);
+ long dbsize = parser.rdbLoadLen().len;
+ long expiresSize = parser.rdbLoadLen().len;
+ if (db != null)
+ db.setDbsize(dbsize);
+ if (db != null)
+ db.setExpires(expiresSize);
+ return db;
+ }
+
+ @Override
+ public long applyEof(RedisInputStream in, int version) throws IOException {
+ /*
+ * ----------------------------
+ * ... # Key value pairs for this database, additonal database
+ * FF ## End of RDB file indicator
+ * 8 byte checksum ## CRC 64 checksum of the entire file.
+ * ----------------------------
+ */
+ if (version >= 5)
+ return in.readLong(8);
+ return 0L;
+ }
+
+ @Override
+ public Event applyExpireTime(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * ----------------------------
+ * FD $unsigned int # FD indicates "expiry time in seconds". After that, expiry time is read as a 4 byte unsigned int
+ * $value-type # 1 byte flag indicating the type of value - set, map, sorted set etc.
+ * $string-encoded-name # The name, encoded as a redis string
+ * $encoded-value # The value. Encoding depends on $value-type
+ * ----------------------------
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ int expiredSec = parser.rdbLoadTime();
+ int valueType = applyType(in);
+ KeyValuePair<?> kv = rdbLoadObject(in, db, valueType, version);
+ kv.setExpiredType(ExpiredType.SECOND);
+ kv.setExpiredValue((long) expiredSec);
+ return kv;
+ }
+
+ @Override
+ public Event applyExpireTimeMs(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * ----------------------------
+ * FC $unsigned long # FC indicates "expiry time in ms". After that, expiry time is read as a 8 byte unsigned long
+ * $value-type # 1 byte flag indicating the type of value - set, map, sorted set etc.
+ * $string-encoded-name # The name, encoded as a redis string
+ * $encoded-value # The value. Encoding depends on $value-type
+ * ----------------------------
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ long expiredMs = parser.rdbLoadMillisecondTime();
+ int valueType = applyType(in);
+ KeyValuePair<?> kv = rdbLoadObject(in, db, valueType, version);
+ kv.setExpiredType(ExpiredType.MS);
+ kv.setExpiredValue(expiredMs);
+ return kv;
+ }
+
+ @Override
+ public Event applyAux(RedisInputStream in, int version) throws IOException {
+ BaseRdbParser parser = new BaseRdbParser(in);
+ String auxKey = new String(parser.rdbLoadEncodedStringObject().first(), UTF_8);
+ String auxValue = new String(parser.rdbLoadEncodedStringObject().first(), UTF_8);
+ if (!auxKey.startsWith("%")) {
+ if (LOGGER.isInfoEnabled()) {
+ LOGGER.info("RDB " + auxKey + ": " + auxValue);
+ }
+ if (auxKey.equals("repl-id"))
+ replicator.getConfiguration().setReplId(auxValue);
+ if (auxKey.equals("repl-offset"))
+ replicator.getConfiguration().setReplOffset(parseLong(auxValue));
+ if (auxKey.equals("repl-stream-db"))
+ replicator.getConfiguration().setReplStreamDB(parseInt(auxValue));
+ return new AuxField(auxKey, auxValue);
+ } else {
+ if (LOGGER.isWarnEnabled()) {
+ LOGGER.warn("unrecognized RDB AUX field: " + auxKey + ", value: " + auxValue);
+ }
+ return null;
+ }
+ }
+
+ @Override
+ public Event applyString(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <content> |
+ * | string contents |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueString o0 = new KeyStringValueString();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ byte[] val = parser.rdbLoadEncodedStringObject().first();
+ o0.setValueRdbType(RedisConstants.RDB_TYPE_STRING);
+ o0.setValue(new String(val, UTF_8));
+ o0.setRawValue(val);
+ o0.setDb(db);
+ o0.setKey(new String(key, UTF_8));
+ o0.setRawKey(key);
+ return o0;
+ }
+
+ @Override
+ public Event applyList(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> |
+ * | 1 or 5 bytes | string contents |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueList o1 = new KeyStringValueList();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ List<String> list = new ArrayList<>();
+ List<byte[]> rawList = new ArrayList<>();
+ for (int i = 0; i < len; i++) {
+ byte[] element = parser.rdbLoadEncodedStringObject().first();
+ list.add(new String(element, UTF_8));
+ rawList.add(element);
+ }
+ o1.setValueRdbType(RedisConstants.RDB_TYPE_LIST);
+ o1.setValue(list);
+ o1.setRawValue(rawList);
+ o1.setDb(db);
+ o1.setKey(new String(key, UTF_8));
+ o1.setRawKey(key);
+ return o1;
+ }
+
+ @Override
+ public Event applySet(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> |
+ * | 1 or 5 bytes | string contents |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueSet o2 = new KeyStringValueSet();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ Set<String> set = new LinkedHashSet<>();
+ Set<byte[]> rawSet = new LinkedHashSet<>();
+ for (int i = 0; i < len; i++) {
+ byte[] element = parser.rdbLoadEncodedStringObject().first();
+ set.add(new String(element, UTF_8));
+ rawSet.add(element);
+ }
+ o2.setValueRdbType(RedisConstants.RDB_TYPE_SET);
+ o2.setValue(set);
+ o2.setRawValue(rawSet);
+ o2.setDb(db);
+ o2.setKey(new String(key, UTF_8));
+ o2.setRawKey(key);
+ return o2;
+ }
+
+ @Override
+ public Event applyZSet(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> | <score> |
+ * | 1 or 5 bytes | string contents | double content |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueZSet o3 = new KeyStringValueZSet();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ Set<ZSetEntry> zset = new LinkedHashSet<>();
+ while (len > 0) {
+ byte[] element = parser.rdbLoadEncodedStringObject().first();
+ double score = parser.rdbLoadDoubleValue();
+ zset.add(new ZSetEntry(new String(element, UTF_8), score, element));
+ len--;
+ }
+ o3.setValueRdbType(RedisConstants.RDB_TYPE_ZSET);
+ o3.setValue(zset);
+ o3.setDb(db);
+ o3.setKey(new String(key, UTF_8));
+ o3.setRawKey(key);
+ return o3;
+ }
+
+ @Override
+ public Event applyZSet2(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> | <score> |
+ * | 1 or 5 bytes | string contents | binary double |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueZSet o5 = new KeyStringValueZSet();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ /* rdb version 8*/
+ long len = parser.rdbLoadLen().len;
+ Set<ZSetEntry> zset = new LinkedHashSet<>();
+ while (len > 0) {
+ byte[] element = parser.rdbLoadEncodedStringObject().first();
+ double score = parser.rdbLoadBinaryDoubleValue();
+ zset.add(new ZSetEntry(new String(element, UTF_8), score, element));
+ len--;
+ }
+ o5.setValueRdbType(RedisConstants.RDB_TYPE_ZSET_2);
+ o5.setValue(zset);
+ o5.setDb(db);
+ o5.setKey(new String(key, UTF_8));
+ o5.setRawKey(key);
+ return o5;
+ }
+
+ @Override
+ public Event applyHash(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> |
+ * | 1 or 5 bytes | string contents |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueHash o4 = new KeyStringValueHash();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ Map<String, String> map = new LinkedHashMap<>();
+ ByteArrayMap<byte[]> rawMap = new ByteArrayMap<>();
+ while (len > 0) {
+ byte[] field = parser.rdbLoadEncodedStringObject().first();
+ byte[] value = parser.rdbLoadEncodedStringObject().first();
+ map.put(new String(field, UTF_8), new String(value, UTF_8));
+ rawMap.put(field, value);
+ len--;
+ }
+ o4.setValueRdbType(RedisConstants.RDB_TYPE_HASH);
+ o4.setValue(map);
+ o4.setRawValue(rawMap);
+ o4.setDb(db);
+ o4.setKey(new String(key, UTF_8));
+ o4.setRawKey(key);
+ return o4;
+ }
+
+ @Override
+ public Event applyHashZipMap(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<zmlen> | <len> |"foo" | <len> | <free> | "bar" |<zmend> |
+ * | 1 byte | 1 or 5 byte | content |1 or 5 byte | 1 byte | content | 1 byte |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueHash o9 = new KeyStringValueHash();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+ Map<String, String> map = new LinkedHashMap<>();
+ ByteArrayMap<byte[]> rawMap = new ByteArrayMap<>();
+ BaseRdbParser.LenHelper.zmlen(stream); // zmlen
+ while (true) {
+ int zmEleLen = BaseRdbParser.LenHelper.zmElementLen(stream);
+ if (zmEleLen == 255) {
+ o9.setValueRdbType(RedisConstants.RDB_TYPE_HASH_ZIPMAP);
+ o9.setValue(map);
+ o9.setRawValue(rawMap);
+ o9.setDb(db);
+ o9.setKey(new String(key, UTF_8));
+ o9.setRawKey(key);
+ return o9;
+ }
+ byte[] field = BaseRdbParser.StringHelper.bytes(stream, zmEleLen);
+ zmEleLen = BaseRdbParser.LenHelper.zmElementLen(stream);
+ if (zmEleLen == 255) {
+ //value is null
+ map.put(new String(field, UTF_8), null);
+ rawMap.put(field, null);
+ o9.setValueRdbType(RedisConstants.RDB_TYPE_HASH_ZIPMAP);
+ o9.setValue(map);
+ o9.setRawValue(rawMap);
+ o9.setDb(db);
+ o9.setKey(new String(key, UTF_8));
+ o9.setRawKey(key);
+ return o9;
+ }
+ int free = BaseRdbParser.LenHelper.free(stream);
+ byte[] value = BaseRdbParser.StringHelper.bytes(stream, zmEleLen);
+ BaseRdbParser.StringHelper.skip(stream, free);
+ map.put(new String(field, UTF_8), new String(value, UTF_8));
+ rawMap.put(field, value);
+ }
+ }
+
+ @Override
+ public Event applyListZipList(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<zlbytes>| <zltail>| <zllen>| <entry> ...<entry> | <zlend>|
+ * | 4 bytes | 4 bytes | 2bytes | zipListEntry ... | 1byte |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueList o10 = new KeyStringValueList();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+
+ List<String> list = new ArrayList<>();
+ List<byte[]> rawList = new ArrayList<>();
+ BaseRdbParser.LenHelper.zlbytes(stream); // zlbytes
+ BaseRdbParser.LenHelper.zltail(stream); // zltail
+ int zllen = BaseRdbParser.LenHelper.zllen(stream);
+ for (int i = 0; i < zllen; i++) {
+ byte[] e = BaseRdbParser.StringHelper.zipListEntry(stream);
+ list.add(new String(e, UTF_8));
+ rawList.add(e);
+ }
+ int zlend = BaseRdbParser.LenHelper.zlend(stream);
+ if (zlend != 255) {
+ throw new AssertionError("zlend expect 255 but " + zlend);
+ }
+ o10.setValueRdbType(RedisConstants.RDB_TYPE_LIST_ZIPLIST);
+ o10.setValue(list);
+ o10.setRawValue(rawList);
+ o10.setDb(db);
+ o10.setKey(new String(key, UTF_8));
+ o10.setRawKey(key);
+ return o10;
+ }
+
+ @Override
+ public Event applySetIntSet(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<encoding>| <length-of-contents>| <contents> |
+ * | 4 bytes | 4 bytes | 2 bytes lement| 4 bytes element | 8 bytes element |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueSet o11 = new KeyStringValueSet();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+
+ Set<String> set = new LinkedHashSet<>();
+ Set<byte[]> rawSet = new LinkedHashSet<>();
+ int encoding = BaseRdbParser.LenHelper.encoding(stream);
+ long lenOfContent = BaseRdbParser.LenHelper.lenOfContent(stream);
+ for (long i = 0; i < lenOfContent; i++) {
+ switch (encoding) {
+ case 2:
+ String element = String.valueOf(stream.readInt(2));
+ set.add(element);
+ rawSet.add(element.getBytes());
+ break;
+ case 4:
+ element = String.valueOf(stream.readInt(4));
+ set.add(element);
+ rawSet.add(element.getBytes());
+ break;
+ case 8:
+ element = String.valueOf(stream.readLong(8));
+ set.add(element);
+ rawSet.add(element.getBytes());
+ break;
+ default:
+ throw new AssertionError("expect encoding [2,4,8] but:" + encoding);
+ }
+ }
+ o11.setValueRdbType(RedisConstants.RDB_TYPE_SET_INTSET);
+ o11.setValue(set);
+ o11.setRawValue(rawSet);
+ o11.setDb(db);
+ o11.setKey(new String(key, UTF_8));
+ o11.setRawKey(key);
+ return o11;
+ }
+
+ @Override
+ public Event applyZSetZipList(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<zlbytes>| <zltail>| <zllen>| <entry> ...<entry> | <zlend>|
+ * | 4 bytes | 4 bytes | 2bytes | zipListEntry ... | 1byte |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueZSet o12 = new KeyStringValueZSet();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+
+ Set<ZSetEntry> zset = new LinkedHashSet<>();
+ BaseRdbParser.LenHelper.zlbytes(stream); // zlbytes
+ BaseRdbParser.LenHelper.zltail(stream); // zltail
+ int zllen = BaseRdbParser.LenHelper.zllen(stream);
+ while (zllen > 0) {
+ byte[] element = BaseRdbParser.StringHelper.zipListEntry(stream);
+ zllen--;
+ double score = Double.valueOf(new String(BaseRdbParser.StringHelper.zipListEntry(stream), UTF_8));
+ zllen--;
+ zset.add(new ZSetEntry(new String(element, UTF_8), score, element));
+ }
+ int zlend = BaseRdbParser.LenHelper.zlend(stream);
+ if (zlend != 255) {
+ throw new AssertionError("zlend expect 255 but " + zlend);
+ }
+ o12.setValueRdbType(RedisConstants.RDB_TYPE_ZSET_ZIPLIST);
+ o12.setValue(zset);
+ o12.setDb(db);
+ o12.setKey(new String(key, UTF_8));
+ o12.setRawKey(key);
+ return o12;
+ }
+
+ @Override
+ public Event applyHashZipList(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<zlbytes>| <zltail>| <zllen>| <entry> ...<entry> | <zlend>|
+ * | 4 bytes | 4 bytes | 2bytes | zipListEntry ... | 1byte |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueHash o13 = new KeyStringValueHash();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+
+ Map<String, String> map = new LinkedHashMap<>();
+ ByteArrayMap<byte[]> rawMap = new ByteArrayMap<>();
+ BaseRdbParser.LenHelper.zlbytes(stream); // zlbytes
+ BaseRdbParser.LenHelper.zltail(stream); // zltail
+ int zllen = BaseRdbParser.LenHelper.zllen(stream);
+ while (zllen > 0) {
+ byte[] field = BaseRdbParser.StringHelper.zipListEntry(stream);
+ zllen--;
+ byte[] value = BaseRdbParser.StringHelper.zipListEntry(stream);
+ zllen--;
+ map.put(new String(field, UTF_8), new String(value, UTF_8));
+ rawMap.put(field, value);
+ }
+ int zlend = BaseRdbParser.LenHelper.zlend(stream);
+ if (zlend != 255) {
+ throw new AssertionError("zlend expect 255 but " + zlend);
+ }
+ o13.setValueRdbType(RedisConstants.RDB_TYPE_HASH_ZIPLIST);
+ o13.setValue(map);
+ o13.setRawValue(rawMap);
+ o13.setDb(db);
+ o13.setKey(new String(key, UTF_8));
+ o13.setRawKey(key);
+ return o13;
+ }
+
+ @Override
+ public Event applyListQuickList(RedisInputStream in, DB db, int version) throws IOException {
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueList o14 = new KeyStringValueList();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ List<String> list = new ArrayList<>();
+ List<byte[]> rawList = new ArrayList<>();
+ for (int i = 0; i < len; i++) {
+ ByteArray element = parser.rdbGenericLoadStringObject(RedisConstants.RDB_LOAD_NONE);
+ RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(element));
+
+ BaseRdbParser.LenHelper.zlbytes(stream); // zlbytes
+ BaseRdbParser.LenHelper.zltail(stream); // zltail
+ int zllen = BaseRdbParser.LenHelper.zllen(stream);
+ for (int j = 0; j < zllen; j++) {
+ byte[] e = BaseRdbParser.StringHelper.zipListEntry(stream);
+ list.add(new String(e, UTF_8));
+ rawList.add(e);
+ }
+ int zlend = BaseRdbParser.LenHelper.zlend(stream);
+ if (zlend != 255) {
+ throw new AssertionError("zlend expect 255 but " + zlend);
+ }
+ }
+ o14.setValueRdbType(RedisConstants.RDB_TYPE_LIST_QUICKLIST);
+ o14.setValue(list);
+ o14.setRawValue(rawList);
+ o14.setDb(db);
+ o14.setKey(new String(key, UTF_8));
+ o14.setRawKey(key);
+ return o14;
+ }
+
+ @Override
+ public Event applyModule(RedisInputStream in, DB db, int version) throws IOException {
+ //|6|6|6|6|6|6|6|6|6|10|
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueModule o6 = new KeyStringValueModule();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ char[] c = new char[9];
+ long moduleid = parser.rdbLoadLen().len;
+ for (int i = 0; i < c.length; i++) {
+ c[i] = RedisConstants.MODULE_SET[(int) (moduleid >>> (10 + (c.length - 1 - i) * 6) & 63)];
+ }
+ String moduleName = new String(c);
+ int moduleVersion = (int) (moduleid & 1023);
+ ModuleParser<? extends Module> moduleParser = lookupModuleParser(moduleName, moduleVersion);
+ if (moduleParser == null) {
+ throw new NoSuchElementException("module[" + moduleName + "," + moduleVersion + "] not exist.");
+ }
+ o6.setValueRdbType(RedisConstants.RDB_TYPE_MODULE);
+ o6.setValue(moduleParser.parse(in, 1));
+ o6.setDb(db);
+ o6.setKey(new String(key, UTF_8));
+ o6.setRawKey(key);
+ return o6;
+ }
+
+ @Override
+ public Event applyModule2(RedisInputStream in, DB db, int version) throws IOException {
+ //|6|6|6|6|6|6|6|6|6|10|
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueModule o7 = new KeyStringValueModule();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ char[] c = new char[9];
+ long moduleid = parser.rdbLoadLen().len;
+ for (int i = 0; i < c.length; i++) {
+ c[i] = RedisConstants.MODULE_SET[(int) (moduleid >>> (10 + (c.length - 1 - i) * 6) & 63)];
+ }
+ String moduleName = new String(c);
+ int moduleVersion = (int) (moduleid & 1023);
+ ModuleParser<? extends Module> moduleParser = lookupModuleParser(moduleName, moduleVersion);
+ if (moduleParser == null) {
+ throw new NoSuchElementException("module[" + moduleName + "," + moduleVersion + "] not exist.");
+ }
+ o7.setValueRdbType(RedisConstants.RDB_TYPE_MODULE_2);
+ o7.setValue(moduleParser.parse(in, 2));
+ o7.setDb(db);
+ o7.setKey(new String(key, UTF_8));
+ o7.setRawKey(key);
+
+ /* Module v2 serialization has an EOF mark at the end. */
+ long eof = parser.rdbLoadLen().len;
+ if (eof != RedisConstants.RDB_MODULE_OPCODE_EOF) {
+ throw new UnsupportedOperationException("The RDB file contains module data for the module '" + moduleName + "' that is not terminated by the proper module value EOF marker");
+ }
+ return o7;
+ }
+
+ protected ModuleParser<? extends Module> lookupModuleParser(String moduleName, int moduleVersion) {
+ return replicator.getModuleParser(moduleName, moduleVersion);
+ }
+
+ protected KeyValuePair<?> rdbLoadObject(RedisInputStream in, DB db, int valueType, int version) throws IOException {
+ /*
+ * ----------------------------
+ * $value-type # This name value pair doesn't have an expiry. $value_type guaranteed != to FD, FC, FE and FF
+ * $string-encoded-name
+ * $encoded-value
+ * ----------------------------
+ */
+ switch (valueType) {
+ case RedisConstants.RDB_TYPE_STRING:
+ return (KeyValuePair<?>) applyString(in, db, version);
+ case RedisConstants.RDB_TYPE_LIST:
+ return (KeyValuePair<?>) applyList(in, db, version);
+ case RedisConstants.RDB_TYPE_SET:
+ return (KeyValuePair<?>) applySet(in, db, version);
+ case RedisConstants.RDB_TYPE_ZSET:
+ return (KeyValuePair<?>) applyZSet(in, db, version);
+ case RedisConstants.RDB_TYPE_ZSET_2:
+ return (KeyValuePair<?>) applyZSet2(in, db, version);
+ case RedisConstants.RDB_TYPE_HASH:
+ return (KeyValuePair<?>) applyHash(in, db, version);
+ case RedisConstants.RDB_TYPE_HASH_ZIPMAP:
+ return (KeyValuePair<?>) applyHashZipMap(in, db, version);
+ case RedisConstants.RDB_TYPE_LIST_ZIPLIST:
+ return (KeyValuePair<?>) applyListZipList(in, db, version);
+ case RedisConstants.RDB_TYPE_SET_INTSET:
+ return (KeyValuePair<?>) applySetIntSet(in, db, version);
+ case RedisConstants.RDB_TYPE_ZSET_ZIPLIST:
+ return (KeyValuePair<?>) applyZSetZipList(in, db, version);
+ case RedisConstants.RDB_TYPE_HASH_ZIPLIST:
+ return (KeyValuePair<?>) applyHashZipList(in, db, version);
+ case RedisConstants.RDB_TYPE_LIST_QUICKLIST:
+ return (KeyValuePair<?>) applyListQuickList(in, db, version);
+ case RedisConstants.RDB_TYPE_MODULE:
+ return (KeyValuePair<?>) applyModule(in, db, version);
+ case RedisConstants.RDB_TYPE_MODULE_2:
+ return (KeyValuePair<?>) applyModule2(in, db, version);
+ default:
+ throw new AssertionError("unexpected value type:" + valueType);
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/RdbListener.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/RdbListener.java
new file mode 100644
index 00000000..1b992157
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/RdbListener.java
@@ -0,0 +1,50 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import org.apache.rocketmq.redis.replicator.Replicator;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.AuxField;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+public interface RdbListener {
+ void preFullSync(Replicator replicator);
+
+ void auxField(Replicator replicator, AuxField auxField);
+
+ void handle(Replicator replicator, KeyValuePair<?> kv);
+
+ void postFullSync(Replicator replicator, long checksum);
+
+ abstract class Adaptor implements RdbListener {
+
+ private static final Logger LOGGER = LoggerFactory.getLogger(Adaptor.class);
+
+ public void preFullSync(Replicator replicator) {
+ LOGGER.info("pre full sync");
+ }
+
+ public void auxField(Replicator replicator, AuxField auxField) {
+ }
+
+ public void postFullSync(Replicator replicator, long checksum) {
+ LOGGER.info("post full sync");
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/RdbParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/RdbParser.java
new file mode 100644
index 00000000..3bad6e7b
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/RdbParser.java
@@ -0,0 +1,179 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import java.io.IOException;
+import org.apache.rocketmq.redis.replicator.event.Event;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.DB;
+import org.apache.rocketmq.redis.replicator.AbstractReplicator;
+import org.apache.rocketmq.redis.replicator.event.PostFullSyncEvent;
+import org.apache.rocketmq.redis.replicator.event.PreFullSyncEvent;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_OPCODE_AUX;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_OPCODE_EOF;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_OPCODE_EXPIRETIME;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_OPCODE_EXPIRETIME_MS;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_OPCODE_RESIZEDB;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_OPCODE_SELECTDB;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_HASH;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_HASH_ZIPLIST;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_HASH_ZIPMAP;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_LIST;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_LIST_QUICKLIST;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_LIST_ZIPLIST;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_MODULE;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_MODULE_2;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_SET;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_SET_INTSET;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_STRING;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_ZSET;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_ZSET_2;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_ZSET_ZIPLIST;
+import static org.apache.rocketmq.redis.replicator.Status.CONNECTED;
+
+public class RdbParser {
+
+ protected final RedisInputStream in;
+ protected final RdbVisitor rdbVisitor;
+ protected final AbstractReplicator replicator;
+ protected static final Logger LOGGER = LoggerFactory.getLogger(RdbParser.class);
+
+ public RdbParser(RedisInputStream in, AbstractReplicator replicator) {
+ this.in = in;
+ this.replicator = replicator;
+ this.rdbVisitor = this.replicator.getRdbVisitor();
+ }
+
+ /**
+ * ----------------------------# RDB is a binary format. There are no new lines or spaces in the file. <p> 52 45 44
+ * 49 53 # Magic String "REDIS" <p> 30 30 30 33 # RDB Version Number in big endian. In
+ * this case, version = 0003 = 3 <p> ---------------------------- <p> FE 00 # FE = code that
+ * indicates database selector. db number = 00 <p> ----------------------------# Key-Value pair starts <p> FD
+ * $unsigned int # FD indicates "expiry time in seconds". After that, expiry time is read as a 4 byte
+ * unsigned int <p> $value-type # 1 byte flag indicating the type of value - set, map, sorted set
+ * etc. <p> $string-encoded-name # The name, encoded as a redis string <p> $encoded-value # The
+ * value. Encoding depends on $value-type <p> ---------------------------- <p> FC $unsigned long # FC
+ * indicates "expiry time in ms". After that, expiry time is read as a 8 byte unsigned long <p> $value-type
+ * # 1 byte flag indicating the type of value - set, map, sorted set etc. <p> $string-encoded-name #
+ * The name, encoded as a redis string <p> $encoded-value # The value. Encoding depends on $value-type
+ * <p> ---------------------------- <p> $value-type # This name value pair doesn't have an expiry.
+ * $value_type guaranteed != to FD, FC, FE and FF <p> $string-encoded-name <p> $encoded-value <p>
+ * ---------------------------- <p> FE $length-encoding # Previous db ends, next db starts. Database number
+ * read using length encoding. <p> ---------------------------- <p> ... # Key value pairs
+ * for this database, additonal database <p> FF ## End of RDB file indicator <p> 8 byte
+ * checksum ## CRC 64 checksum of the entire file. <p>
+ *
+ * @return read bytes
+ * @throws IOException when read timeout
+ */
+ public long parse() throws IOException {
+ /*
+ * ----------------------------
+ * 52 45 44 49 53 # Magic String "REDIS"
+ * 30 30 30 33 # RDB Version Number in big endian. In this case, version = 0003 = 3
+ * ----------------------------
+ */
+ this.replicator.submitEvent(new PreFullSyncEvent());
+ rdbVisitor.applyMagic(in);
+ int version = rdbVisitor.applyVersion(in);
+ DB db = null;
+ /*
+ * rdb
+ */
+ loop:
+ while (this.replicator.getStatus() == CONNECTED) {
+ int type = rdbVisitor.applyType(in);
+ Event event = null;
+ switch (type) {
+ case RDB_OPCODE_EXPIRETIME:
+ event = rdbVisitor.applyExpireTime(in, db, version);
+ break;
+ case RDB_OPCODE_EXPIRETIME_MS:
+ event = rdbVisitor.applyExpireTimeMs(in, db, version);
+ break;
+ case RDB_OPCODE_AUX:
+ event = rdbVisitor.applyAux(in, version);
+ break;
+ case RDB_OPCODE_RESIZEDB:
+ rdbVisitor.applyResizeDB(in, db, version);
+ break;
+ case RDB_OPCODE_SELECTDB:
+ db = rdbVisitor.applySelectDB(in, version);
+ break;
+ case RDB_OPCODE_EOF:
+ long checksum = rdbVisitor.applyEof(in, version);
+ this.replicator.submitEvent(new PostFullSyncEvent(checksum));
+ break loop;
+ case RDB_TYPE_STRING:
+ event = rdbVisitor.applyString(in, db, version);
+ break;
+ case RDB_TYPE_LIST:
+ event = rdbVisitor.applyList(in, db, version);
+ break;
+ case RDB_TYPE_SET:
+ event = rdbVisitor.applySet(in, db, version);
+ break;
+ case RDB_TYPE_ZSET:
+ event = rdbVisitor.applyZSet(in, db, version);
+ break;
+ case RDB_TYPE_ZSET_2:
+ event = rdbVisitor.applyZSet2(in, db, version);
+ break;
+ case RDB_TYPE_HASH:
+ event = rdbVisitor.applyHash(in, db, version);
+ break;
+ case RDB_TYPE_HASH_ZIPMAP:
+ event = rdbVisitor.applyHashZipMap(in, db, version);
+ break;
+ case RDB_TYPE_LIST_ZIPLIST:
+ event = rdbVisitor.applyListZipList(in, db, version);
+ break;
+ case RDB_TYPE_SET_INTSET:
+ event = rdbVisitor.applySetIntSet(in, db, version);
+ break;
+ case RDB_TYPE_ZSET_ZIPLIST:
+ event = rdbVisitor.applyZSetZipList(in, db, version);
+ break;
+ case RDB_TYPE_HASH_ZIPLIST:
+ event = rdbVisitor.applyHashZipList(in, db, version);
+ break;
+ case RDB_TYPE_LIST_QUICKLIST:
+ event = rdbVisitor.applyListQuickList(in, db, version);
+ break;
+ case RDB_TYPE_MODULE:
+ event = rdbVisitor.applyModule(in, db, version);
+ break;
+ case RDB_TYPE_MODULE_2:
+ event = rdbVisitor.applyModule2(in, db, version);
+ break;
+ default:
+ throw new AssertionError("unexpected value type:" + type + ", check your ModuleParser or ValueIterableRdbVisitor.");
+ }
+ if (event == null)
+ continue;
+ if (replicator.verbose())
+ LOGGER.info(event.toString());
+ this.replicator.submitEvent(event);
+ }
+ return in.total();
+ }
+}
+
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/RdbVisitor.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/RdbVisitor.java
new file mode 100644
index 00000000..2cfcdeed
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/RdbVisitor.java
@@ -0,0 +1,132 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import java.io.IOException;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.event.Event;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.DB;
+
+public abstract class RdbVisitor {
+ /*
+ * rdb prefix
+ */
+ public String applyMagic(RedisInputStream in) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public int applyVersion(RedisInputStream in) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public int applyType(RedisInputStream in) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ /*
+ * DB
+ */
+ public DB applySelectDB(RedisInputStream in, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public DB applyResizeDB(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ /*
+ * checksum
+ */
+ public long applyEof(RedisInputStream in, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ /*
+ * aux
+ */
+ public Event applyAux(RedisInputStream in, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ /*
+ * entity
+ */
+ public Event applyExpireTime(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyExpireTimeMs(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyString(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyList(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applySet(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyZSet(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyZSet2(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyHash(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyHashZipMap(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyListZipList(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applySetIntSet(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyZSetZipList(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyHashZipList(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyListQuickList(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyModule(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+
+ public Event applyModule2(RedisInputStream in, DB db, int version) throws IOException {
+ throw new UnsupportedOperationException("must implement this method.");
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/AuxField.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/AuxField.java
new file mode 100644
index 00000000..dc2d4c38
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/AuxField.java
@@ -0,0 +1,77 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import org.apache.rocketmq.redis.replicator.event.Event;
+
+public class AuxField implements Event {
+
+ private static final long serialVersionUID = 1L;
+
+ private String auxKey;
+ private String auxValue;
+
+ public AuxField() {
+ }
+
+ public AuxField(String auxKey, String auxValue) {
+ this.auxKey = auxKey;
+ this.auxValue = auxValue;
+ }
+
+ public String getAuxKey() {
+ return auxKey;
+ }
+
+ public String getAuxValue() {
+ return auxValue;
+ }
+
+ public void setAuxKey(String auxKey) {
+ this.auxKey = auxKey;
+ }
+
+ public void setAuxValue(String auxValue) {
+ this.auxValue = auxValue;
+ }
+
+ @Override
+ public String toString() {
+ return "AuxField{" +
+ "auxKey='" + auxKey + '\'' +
+ ", auxValue='" + auxValue + '\'' +
+ '}';
+ }
+
+ @Override
+ public boolean equals(Object o) {
+ if (this == o)
+ return true;
+ if (o == null || getClass() != o.getClass())
+ return false;
+
+ AuxField auxField = (AuxField) o;
+
+ return auxKey.equals(auxField.auxKey);
+ }
+
+ @Override
+ public int hashCode() {
+ return auxKey.hashCode();
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/DB.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/DB.java
new file mode 100644
index 00000000..e4da0806
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/DB.java
@@ -0,0 +1,77 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import java.io.Serializable;
+
+public class DB implements Serializable {
+
+ private static final long serialVersionUID = 1L;
+
+ private long dbNumber;
+ /* rdb version 7 */
+ private Long dbsize = null;
+ /* rdb version 7 */
+ private Long expires = null;
+
+ public DB() {
+ }
+
+ public DB(long dbNumber) {
+ this.dbNumber = dbNumber;
+ }
+
+ public DB(long dbNumber, long dbsize, long expires) {
+ this.dbNumber = dbNumber;
+ this.dbsize = dbsize;
+ this.expires = expires;
+ }
+
+ public long getDbNumber() {
+ return dbNumber;
+ }
+
+ public void setDbNumber(long dbNumber) {
+ this.dbNumber = dbNumber;
+ }
+
+ public Long getDbsize() {
+ return dbsize;
+ }
+
+ public void setDbsize(Long dbsize) {
+ this.dbsize = dbsize;
+ }
+
+ public Long getExpires() {
+ return expires;
+ }
+
+ public void setExpires(Long expires) {
+ this.expires = expires;
+ }
+
+ @Override
+ public String toString() {
+ return "DB{" +
+ "dbNumber=" + dbNumber +
+ ", dbsize=" + dbsize +
+ ", expires=" + expires +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/ExpiredType.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/ExpiredType.java
new file mode 100644
index 00000000..2057ab0b
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/ExpiredType.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import java.io.Serializable;
+
+public enum ExpiredType implements Serializable {
+ /**
+ * not set
+ */
+ NONE,
+ /**
+ * expired by seconds
+ */
+ SECOND,
+ /**
+ * expired by millisecond
+ */
+ MS
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueHash.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueHash.java
new file mode 100644
index 00000000..4c85ec65
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueHash.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import java.util.Map;
+
+public class KeyStringValueHash extends KeyValuePair<Map<String, String>> {
+
+ private static final long serialVersionUID = 1L;
+
+ protected Map<byte[], byte[]> rawValue;
+
+ public Map<byte[], byte[]> getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(Map<byte[], byte[]> rawValue) {
+ this.rawValue = rawValue;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueList.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueList.java
new file mode 100644
index 00000000..4e52b23c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueList.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import java.util.List;
+
+public class KeyStringValueList extends KeyValuePair<List<String>> {
+
+ private static final long serialVersionUID = 1L;
+
+ protected List<byte[]> rawValue;
+
+ public List<byte[]> getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(List<byte[]> rawValue) {
+ this.rawValue = rawValue;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueModule.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueModule.java
new file mode 100644
index 00000000..28cf4a1d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueModule.java
@@ -0,0 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+public class KeyStringValueModule extends KeyValuePair<Module> {
+ private static final long serialVersionUID = 1L;
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueSet.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueSet.java
new file mode 100644
index 00000000..64d971dd
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueSet.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import java.util.Set;
+
+public class KeyStringValueSet extends KeyValuePair<Set<String>> {
+
+ private static final long serialVersionUID = 1L;
+
+ protected Set<byte[]> rawValue;
+
+ public Set<byte[]> getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(Set<byte[]> rawValue) {
+ this.rawValue = rawValue;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueString.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueString.java
new file mode 100644
index 00000000..44f819df
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueString.java
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+public class KeyStringValueString extends KeyValuePair<String> {
+
+ private static final long serialVersionUID = 1L;
+
+ protected byte[] rawValue;
+
+ public byte[] getRawValue() {
+ return rawValue;
+ }
+
+ public void setRawValue(byte[] rawValue) {
+ this.rawValue = rawValue;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueZSet.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueZSet.java
new file mode 100644
index 00000000..b6dde42c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyStringValueZSet.java
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import java.util.Set;
+
+public class KeyStringValueZSet extends KeyValuePair<Set<ZSetEntry>> {
+ private static final long serialVersionUID = 1L;
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyValuePair.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyValuePair.java
new file mode 100644
index 00000000..9ae0eee1
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/KeyValuePair.java
@@ -0,0 +1,161 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import java.util.List;
+import java.util.Map;
+import java.util.Set;
+import org.apache.rocketmq.redis.replicator.event.Event;
+
+@SuppressWarnings("unchecked")
+public class KeyValuePair<T> implements Event {
+
+ private static final long serialVersionUID = 1L;
+
+ protected DB db;
+ protected int valueRdbType;
+ protected ExpiredType expiredType = ExpiredType.NONE;
+ protected Long expiredValue;
+ protected String key;
+ protected T value;
+ protected byte[] rawKey;
+
+ public int getValueRdbType() {
+ return valueRdbType;
+ }
+
+ public void setValueRdbType(int valueRdbType) {
+ this.valueRdbType = valueRdbType;
+ }
+
+ public ExpiredType getExpiredType() {
+ return expiredType;
+ }
+
+ public void setExpiredType(ExpiredType expiredType) {
+ this.expiredType = expiredType;
+ }
+
+ public Long getExpiredValue() {
+ return expiredValue;
+ }
+
+ public void setExpiredValue(Long expiredValue) {
+ this.expiredValue = expiredValue;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public void setKey(String key) {
+ this.key = key;
+ }
+
+ public T getValue() {
+ return value;
+ }
+
+ public void setValue(T value) {
+ this.value = value;
+ }
+
+ public DB getDb() {
+ return db;
+ }
+
+ public void setDb(DB db) {
+ this.db = db;
+ }
+
+ public byte[] getRawKey() {
+ return rawKey;
+ }
+
+ public void setRawKey(byte[] rawKey) {
+ this.rawKey = rawKey;
+ }
+
+ /**
+ * @return expiredValue as Integer
+ */
+ public Integer getExpiredSeconds() {
+ return expiredValue == null ? null : expiredValue.intValue();
+ }
+
+ /**
+ * @return expiredValue as Long
+ */
+ public Long getExpiredMs() {
+ return expiredValue;
+ }
+
+ /**
+ * @return RDB_TYPE_STRING
+ */
+ public String getValueAsString() {
+ return (String) value;
+ }
+
+ /**
+ * @return RDB_TYPE_HASH, RDB_TYPE_HASH_ZIPMAP, RDB_TYPE_HASH_ZIPLIST
+ */
+ public Map<String, String> getValueAsHash() {
+ return (Map<String, String>) value;
+ }
+
+ /**
+ * @return RDB_TYPE_SET, RDB_TYPE_SET_INTSET
+ */
+ public Set<String> getValueAsSet() {
+ return (Set<String>) value;
+ }
+
+ /**
+ * @return RDB_TYPE_ZSET, RDB_TYPE_ZSET_2, RDB_TYPE_ZSET_ZIPLIST
+ */
+ public Set<ZSetEntry> getValueAsZSet() {
+ return (Set<ZSetEntry>) value;
+ }
+
+ /**
+ * @return RDB_TYPE_LIST, RDB_TYPE_LIST_ZIPLIST, RDB_TYPE_LIST_QUICKLIST
+ */
+ public List<String> getValueAsStringList() {
+ return (List<String>) value;
+ }
+
+ /**
+ * @return RDB_TYPE_MODULE
+ */
+ public Module getValueAsModule() {
+ return (Module) value;
+ }
+
+ @Override
+ public String toString() {
+ return "KeyValuePair{" +
+ "db=" + db +
+ ", valueRdbType=" + valueRdbType +
+ ", expiredType=" + expiredType +
+ ", expiredValue=" + expiredValue +
+ ", key='" + key + '\'' +
+ ", value=" + value +
+ '}';
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/Module.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/Module.java
new file mode 100644
index 00000000..3420f546
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/Module.java
@@ -0,0 +1,23 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import java.io.Serializable;
+
+public interface Module extends Serializable {
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/ZSetEntry.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/ZSetEntry.java
new file mode 100644
index 00000000..d1eeebf9
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/datatype/ZSetEntry.java
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.datatype;
+
+import java.io.Serializable;
+
+public class ZSetEntry implements Serializable {
+
+ private static final long serialVersionUID = 1L;
+
+ private String element;
+ private double score;
+ private byte[] rawElement;
+
+ public ZSetEntry() {
+ }
+
+ public ZSetEntry(String element, double score) {
+ this(element, score, null);
+ }
+
+ public ZSetEntry(String element, double score, byte[] rawElement) {
+ this.element = element;
+ this.score = score;
+ this.rawElement = rawElement;
+ }
+
+ public String getElement() {
+ return element;
+ }
+
+ public double getScore() {
+ return score;
+ }
+
+ public void setElement(String element) {
+ this.element = element;
+ }
+
+ public void setScore(double score) {
+ this.score = score;
+ }
+
+ public byte[] getRawElement() {
+ return rawElement;
+ }
+
+ public void setRawElement(byte[] rawElement) {
+ this.rawElement = rawElement;
+ }
+
+ @Override
+ public String toString() {
+ return "[" + element + ", " + score + "]";
+ }
+
+ @Override
+ public boolean equals(Object o) {
+ if (this == o)
+ return true;
+ if (o == null || getClass() != o.getClass())
+ return false;
+
+ ZSetEntry zSetEntry = (ZSetEntry) o;
+
+ if (Double.compare(zSetEntry.score, score) != 0)
+ return false;
+ return element.equals(zSetEntry.element);
+ }
+
+ @Override
+ public int hashCode() {
+ int result;
+ long temp;
+ result = element.hashCode();
+ temp = Double.doubleToLongBits(score);
+ result = 31 * result + (int) (temp ^ (temp >>> 32));
+ return result;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/ValueIterableRdbVisitor.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/ValueIterableRdbVisitor.java
new file mode 100644
index 00000000..05fcf48c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/ValueIterableRdbVisitor.java
@@ -0,0 +1,573 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.iterable;
+
+import java.io.IOException;
+import java.util.AbstractMap;
+import java.util.Iterator;
+import java.util.Map;
+import org.apache.rocketmq.redis.replicator.Replicator;
+import org.apache.rocketmq.redis.replicator.UncheckedIOException;
+import org.apache.rocketmq.redis.replicator.event.Event;
+import org.apache.rocketmq.redis.replicator.io.ByteArrayInputStream;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.BaseRdbParser;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.DB;
+import org.apache.rocketmq.redis.replicator.rdb.iterable.datatype.KeyStringValueByteArrayIterator;
+import org.apache.rocketmq.redis.replicator.rdb.iterable.datatype.KeyStringValueZSetEntryIterator;
+import org.apache.rocketmq.redis.replicator.util.ByteArray;
+import org.apache.rocketmq.redis.replicator.rdb.DefaultRdbVisitor;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ZSetEntry;
+import org.apache.rocketmq.redis.replicator.rdb.iterable.datatype.KeyStringValueMapEntryIterator;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_LOAD_NONE;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_HASH;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_HASH_ZIPLIST;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_HASH_ZIPMAP;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_LIST;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_LIST_QUICKLIST;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_LIST_ZIPLIST;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_SET;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_SET_INTSET;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_ZSET;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_ZSET_2;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_TYPE_ZSET_ZIPLIST;
+
+public class ValueIterableRdbVisitor extends DefaultRdbVisitor {
+
+ public ValueIterableRdbVisitor(Replicator replicator) {
+ super(replicator);
+ }
+
+ @Override
+ public Event applyList(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> |
+ * | 1 or 5 bytes | string contents |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueByteArrayIterator o1 = new KeyStringValueByteArrayIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ o1.setValue(new Iter<byte[]>(len, parser) {
+ @Override
+ public boolean hasNext() {
+ return condition > 0;
+ }
+
+ @Override
+ public byte[] next() {
+ try {
+ byte[] element = parser.rdbLoadEncodedStringObject().first();
+ condition--;
+ return element;
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ });
+ o1.setValueRdbType(RDB_TYPE_LIST);
+ o1.setDb(db);
+ o1.setKey(new String(key, UTF_8));
+ o1.setRawKey(key);
+ return o1;
+ }
+
+ @Override
+ public Event applySet(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> |
+ * | 1 or 5 bytes | string contents |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueByteArrayIterator o2 = new KeyStringValueByteArrayIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ o2.setValue(new Iter<byte[]>(len, parser) {
+ @Override
+ public boolean hasNext() {
+ return condition > 0;
+ }
+
+ @Override
+ public byte[] next() {
+ try {
+ byte[] element = parser.rdbLoadEncodedStringObject().first();
+ condition--;
+ return element;
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ });
+ o2.setValueRdbType(RDB_TYPE_SET);
+ o2.setDb(db);
+ o2.setKey(new String(key, UTF_8));
+ o2.setRawKey(key);
+ return o2;
+ }
+
+ @Override
+ public Event applyZSet(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> | <score> |
+ * | 1 or 5 bytes | string contents | double content |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueZSetEntryIterator o3 = new KeyStringValueZSetEntryIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ o3.setValue(new Iter<ZSetEntry>(len, parser) {
+ @Override
+ public boolean hasNext() {
+ return condition > 0;
+ }
+
+ @Override
+ public ZSetEntry next() {
+ try {
+ byte[] element = parser.rdbLoadEncodedStringObject().first();
+ double score = parser.rdbLoadDoubleValue();
+ condition--;
+ return new ZSetEntry(new String(element, UTF_8), score, element);
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ });
+ o3.setValueRdbType(RDB_TYPE_ZSET);
+ o3.setDb(db);
+ o3.setKey(new String(key, UTF_8));
+ o3.setRawKey(key);
+ return o3;
+ }
+
+ @Override
+ public Event applyZSet2(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> | <score> |
+ * | 1 or 5 bytes | string contents | binary double |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueZSetEntryIterator o5 = new KeyStringValueZSetEntryIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ /* rdb version 8*/
+ long len = parser.rdbLoadLen().len;
+ o5.setValue(new Iter<ZSetEntry>(len, parser) {
+ @Override
+ public boolean hasNext() {
+ return condition > 0;
+ }
+
+ @Override
+ public ZSetEntry next() {
+ try {
+ byte[] element = parser.rdbLoadEncodedStringObject().first();
+ double score = parser.rdbLoadBinaryDoubleValue();
+ condition--;
+ return new ZSetEntry(new String(element, UTF_8), score, element);
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ });
+ o5.setValueRdbType(RDB_TYPE_ZSET_2);
+ o5.setDb(db);
+ o5.setKey(new String(key, UTF_8));
+ o5.setRawKey(key);
+ return o5;
+ }
+
+ @Override
+ public Event applyHash(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * | <len> | <content> |
+ * | 1 or 5 bytes | string contents |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueMapEntryIterator o4 = new KeyStringValueMapEntryIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ o4.setValue(new Iter<Map.Entry<byte[], byte[]>>(len, parser) {
+ @Override
+ public boolean hasNext() {
+ return condition > 0;
+ }
+
+ @Override
+ public Map.Entry<byte[], byte[]> next() {
+ try {
+ byte[] field = parser.rdbLoadEncodedStringObject().first();
+ byte[] value = parser.rdbLoadEncodedStringObject().first();
+ condition--;
+ return new AbstractMap.SimpleEntry<>(field, value);
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ });
+ o4.setValueRdbType(RDB_TYPE_HASH);
+ o4.setDb(db);
+ o4.setKey(new String(key, UTF_8));
+ o4.setRawKey(key);
+ return o4;
+ }
+
+ @Override
+ public Event applyHashZipMap(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<zmlen> | <len> |"foo" | <len> | <free> | "bar" |<zmend> |
+ * | 1 byte | 1 or 5 byte | content |1 or 5 byte | 1 byte | content | 1 byte |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueMapEntryIterator o9 = new KeyStringValueMapEntryIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+ BaseRdbParser.LenHelper.zmlen(stream); // zmlen
+ o9.setValue(new HashZipMapIter(stream));
+ o9.setValueRdbType(RDB_TYPE_HASH_ZIPMAP);
+ o9.setDb(db);
+ o9.setKey(new String(key, UTF_8));
+ o9.setRawKey(key);
+ return o9;
+ }
+
+ @Override
+ public Event applyListZipList(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<zlbytes>| <zltail>| <zllen>| <entry> ...<entry> | <zlend>|
+ * | 4 bytes | 4 bytes | 2bytes | zipListEntry ... | 1byte |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueByteArrayIterator o10 = new KeyStringValueByteArrayIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ final RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+
+ BaseRdbParser.LenHelper.zlbytes(stream); // zlbytes
+ BaseRdbParser.LenHelper.zltail(stream); // zltail
+ int zllen = BaseRdbParser.LenHelper.zllen(stream);
+ o10.setValue(new Iter<byte[]>(zllen, null) {
+ @Override
+ public boolean hasNext() {
+ if (condition > 0)
+ return true;
+ try {
+ int zlend = BaseRdbParser.LenHelper.zlend(stream);
+ if (zlend != 255) {
+ throw new AssertionError("zlend expect 255 but " + zlend);
+ }
+ return false;
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+
+ @Override
+ public byte[] next() {
+ try {
+ byte[] e = BaseRdbParser.StringHelper.zipListEntry(stream);
+ condition--;
+ return e;
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ });
+ o10.setValueRdbType(RDB_TYPE_LIST_ZIPLIST);
+ o10.setDb(db);
+ o10.setKey(new String(key, UTF_8));
+ o10.setRawKey(key);
+ return o10;
+ }
+
+ @Override
+ public Event applySetIntSet(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<encoding>| <length-of-contents>| <contents> |
+ * | 4 bytes | 4 bytes | 2 bytes lement| 4 bytes element | 8 bytes element |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueByteArrayIterator o11 = new KeyStringValueByteArrayIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ final RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+
+ final int encoding = BaseRdbParser.LenHelper.encoding(stream);
+ long lenOfContent = BaseRdbParser.LenHelper.lenOfContent(stream);
+ o11.setValue(new Iter<byte[]>(lenOfContent, null) {
+ @Override
+ public boolean hasNext() {
+ return condition > 0;
+ }
+
+ @Override
+ public byte[] next() {
+ try {
+ switch (encoding) {
+ case 2:
+ String element = String.valueOf(stream.readInt(2));
+ condition--;
+ return element.getBytes();
+ case 4:
+ element = String.valueOf(stream.readInt(4));
+ condition--;
+ return element.getBytes();
+ case 8:
+ element = String.valueOf(stream.readLong(8));
+ condition--;
+ return element.getBytes();
+ default:
+ throw new AssertionError("expect encoding [2,4,8] but:" + encoding);
+ }
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ });
+ o11.setValueRdbType(RDB_TYPE_SET_INTSET);
+ o11.setDb(db);
+ o11.setKey(new String(key, UTF_8));
+ o11.setRawKey(key);
+ return o11;
+ }
+
+ @Override
+ public Event applyZSetZipList(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<zlbytes>| <zltail>| <zllen>| <entry> ...<entry> | <zlend>|
+ * | 4 bytes | 4 bytes | 2bytes | zipListEntry ... | 1byte |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueZSetEntryIterator o12 = new KeyStringValueZSetEntryIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ final RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+
+ BaseRdbParser.LenHelper.zlbytes(stream); // zlbytes
+ BaseRdbParser.LenHelper.zltail(stream); // zltail
+ int zllen = BaseRdbParser.LenHelper.zllen(stream);
+ o12.setValue(new Iter<ZSetEntry>(zllen, null) {
+ @Override
+ public boolean hasNext() {
+ if (condition > 0)
+ return true;
+ try {
+ int zlend = BaseRdbParser.LenHelper.zlend(stream);
+ if (zlend != 255) {
+ throw new AssertionError("zlend expect 255 but " + zlend);
+ }
+ return false;
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+
+ @Override
+ public ZSetEntry next() {
+ try {
+ byte[] element = BaseRdbParser.StringHelper.zipListEntry(stream);
+ condition--;
+ double score = Double.valueOf(new String(BaseRdbParser.StringHelper.zipListEntry(stream), UTF_8));
+ condition--;
+ return new ZSetEntry(new String(element, UTF_8), score, element);
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ });
+ o12.setValueRdbType(RDB_TYPE_ZSET_ZIPLIST);
+ o12.setDb(db);
+ o12.setKey(new String(key, UTF_8));
+ o12.setRawKey(key);
+ return o12;
+ }
+
+ @Override
+ public Event applyHashZipList(RedisInputStream in, DB db, int version) throws IOException {
+ /*
+ * |<zlbytes>| <zltail>| <zllen>| <entry> ...<entry> | <zlend>|
+ * | 4 bytes | 4 bytes | 2bytes | zipListEntry ... | 1byte |
+ */
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueMapEntryIterator o13 = new KeyStringValueMapEntryIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ ByteArray aux = parser.rdbLoadPlainStringObject();
+ final RedisInputStream stream = new RedisInputStream(new ByteArrayInputStream(aux));
+
+ BaseRdbParser.LenHelper.zlbytes(stream); // zlbytes
+ BaseRdbParser.LenHelper.zltail(stream); // zltail
+ int zllen = BaseRdbParser.LenHelper.zllen(stream);
+ o13.setValue(new Iter<Map.Entry<byte[], byte[]>>(zllen, null) {
+ @Override
+ public boolean hasNext() {
+ if (condition > 0)
+ return true;
+ try {
+ int zlend = BaseRdbParser.LenHelper.zlend(stream);
+ if (zlend != 255) {
+ throw new AssertionError("zlend expect 255 but " + zlend);
+ }
+ return false;
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+
+ @Override
+ public Map.Entry<byte[], byte[]> next() {
+ try {
+ byte[] field = BaseRdbParser.StringHelper.zipListEntry(stream);
+ condition--;
+ byte[] value = BaseRdbParser.StringHelper.zipListEntry(stream);
+ condition--;
+ return new AbstractMap.SimpleEntry<>(field, value);
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ });
+ o13.setValueRdbType(RDB_TYPE_HASH_ZIPLIST);
+ o13.setDb(db);
+ o13.setKey(new String(key, UTF_8));
+ o13.setRawKey(key);
+ return o13;
+ }
+
+ @Override
+ public Event applyListQuickList(RedisInputStream in, DB db, int version) throws IOException {
+ BaseRdbParser parser = new BaseRdbParser(in);
+ KeyStringValueByteArrayIterator o14 = new KeyStringValueByteArrayIterator();
+ byte[] key = parser.rdbLoadEncodedStringObject().first();
+ long len = parser.rdbLoadLen().len;
+ o14.setValue(new QuickListIter(len, parser));
+ o14.setValueRdbType(RDB_TYPE_LIST_QUICKLIST);
+ o14.setDb(db);
+ o14.setKey(new String(key, UTF_8));
+ o14.setRawKey(key);
+ return o14;
+ }
+
+ private static abstract class Iter<T> implements Iterator<T> {
+
+ protected long condition;
+ protected final BaseRdbParser parser;
+
+ private Iter(long condition, BaseRdbParser parser) {
+ this.condition = condition;
+ this.parser = parser;
+ }
+
+ @Override
+ public void remove() {
+ throw new UnsupportedOperationException();
+ }
+ }
+
+ private static class HashZipMapIter extends Iter<Map.Entry<byte[], byte[]>> {
+
+ protected int zmEleLen;
+ protected final RedisInputStream stream;
+
+ private HashZipMapIter(RedisInputStream stream) {
+ super(0, null);
+ this.stream = stream;
+ }
+
+ @Override
+ public boolean hasNext() {
+ try {
+ return (this.zmEleLen = BaseRdbParser.LenHelper.zmElementLen(stream)) != 255;
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+
+ @Override
+ public Map.Entry<byte[], byte[]> next() {
+ try {
+ byte[] field = BaseRdbParser.StringHelper.bytes(stream, zmEleLen);
+ this.zmEleLen = BaseRdbParser.LenHelper.zmElementLen(stream);
+ if (this.zmEleLen == 255) {
+ return new AbstractMap.SimpleEntry<>(field, null);
+ }
+ int free = BaseRdbParser.LenHelper.free(stream);
+ byte[] value = BaseRdbParser.StringHelper.bytes(stream, zmEleLen);
+ BaseRdbParser.StringHelper.skip(stream, free);
+ return new AbstractMap.SimpleEntry<>(field, value);
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ }
+
+ private static class QuickListIter extends Iter<byte[]> {
+
+ protected int zllen = -1;
+ protected RedisInputStream stream;
+
+ private QuickListIter(long condition, BaseRdbParser parser) {
+ super(condition, parser);
+ }
+
+ @Override
+ public boolean hasNext() {
+ return zllen > 0 || condition > 0;
+ }
+
+ @Override
+ public byte[] next() {
+ try {
+ if (zllen == -1 && condition > 0) {
+ ByteArray element = parser.rdbGenericLoadStringObject(RDB_LOAD_NONE);
+ this.stream = new RedisInputStream(new ByteArrayInputStream(element));
+ BaseRdbParser.LenHelper.zlbytes(stream); // zlbytes
+ BaseRdbParser.LenHelper.zltail(stream); // zltail
+ this.zllen = BaseRdbParser.LenHelper.zllen(stream);
+ if (zllen == 0) {
+ int zlend = BaseRdbParser.LenHelper.zlend(stream);
+ if (zlend != 255) {
+ throw new AssertionError("zlend expect 255 but " + zlend);
+ }
+ zllen = -1;
+ condition--;
+ }
+ if (hasNext())
+ return next();
+ throw new IllegalStateException("end of iterator");
+ } else {
+ byte[] e = BaseRdbParser.StringHelper.zipListEntry(stream);
+ zllen--;
+ if (zllen == 0) {
+ int zlend = BaseRdbParser.LenHelper.zlend(stream);
+ if (zlend != 255) {
+ throw new AssertionError("zlend expect 255 but " + zlend);
+ }
+ zllen = -1;
+ condition--;
+ }
+ return e;
+ }
+ } catch (IOException e) {
+ throw new UncheckedIOException(e);
+ }
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/datatype/KeyStringValueByteArrayIterator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/datatype/KeyStringValueByteArrayIterator.java
new file mode 100644
index 00000000..c5517c07
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/datatype/KeyStringValueByteArrayIterator.java
@@ -0,0 +1,25 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.iterable.datatype;
+
+import java.util.Iterator;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+
+public class KeyStringValueByteArrayIterator extends KeyValuePair<Iterator<byte[]>> {
+ private static final long serialVersionUID = 1L;
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/datatype/KeyStringValueMapEntryIterator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/datatype/KeyStringValueMapEntryIterator.java
new file mode 100644
index 00000000..5737bb89
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/datatype/KeyStringValueMapEntryIterator.java
@@ -0,0 +1,26 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.iterable.datatype;
+
+import java.util.Iterator;
+import java.util.Map;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+
+public class KeyStringValueMapEntryIterator extends KeyValuePair<Iterator<Map.Entry<byte[], byte[]>>> {
+ private static final long serialVersionUID = 1L;
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/datatype/KeyStringValueZSetEntryIterator.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/datatype/KeyStringValueZSetEntryIterator.java
new file mode 100644
index 00000000..5878fe3d
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/iterable/datatype/KeyStringValueZSetEntryIterator.java
@@ -0,0 +1,26 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.iterable.datatype;
+
+import java.util.Iterator;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ZSetEntry;
+
+public class KeyStringValueZSetEntryIterator extends KeyValuePair<Iterator<ZSetEntry>> {
+ private static final long serialVersionUID = 1L;
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/module/DefaultRdbModuleParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/module/DefaultRdbModuleParser.java
new file mode 100644
index 00000000..d9c0a69c
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/module/DefaultRdbModuleParser.java
@@ -0,0 +1,135 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.module;
+
+import java.io.IOException;
+import java.math.BigInteger;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.BaseRdbParser;
+import org.apache.rocketmq.redis.replicator.util.ByteArray;
+import org.apache.rocketmq.redis.replicator.RedisConstants;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_MODULE_OPCODE_DOUBLE;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_MODULE_OPCODE_FLOAT;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_MODULE_OPCODE_STRING;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_MODULE_OPCODE_UINT;
+
+public class DefaultRdbModuleParser {
+ protected static final Logger LOGGER = LoggerFactory.getLogger(DefaultRdbModuleParser.class);
+
+ private final RedisInputStream in;
+ private final BaseRdbParser parser;
+
+ public DefaultRdbModuleParser(RedisInputStream in) {
+ this.in = in;
+ this.parser = new BaseRdbParser(in);
+ }
+
+ public RedisInputStream inputStream() {
+ return this.in;
+ }
+
+ /**
+ * @param version param version of {@link ModuleParser#parse(RedisInputStream, int)}
+ * @return signed long
+ * @throws IOException IOException
+ */
+ public long loadSigned(int version) throws IOException {
+ if (version == 2) {
+ long opcode = parser.rdbLoadLen().len;
+ if (opcode != RDB_MODULE_OPCODE_UINT)
+ throw new UnsupportedOperationException("Error loading signed or unsigned long from RDB.");
+ }
+ return parser.rdbLoadLen().len;
+ }
+
+ /**
+ * @param version param version of {@link ModuleParser#parse(RedisInputStream, int)}
+ * @return unsigned long
+ * @throws IOException IOException
+ */
+ public BigInteger loadUnsigned(int version) throws IOException {
+ byte[] ary = new byte[8];
+ long value = loadSigned(version);
+ for (int i = 0; i < 8; i++) {
+ ary[7 - i] = (byte) ((value >>> (i << 3)) & 0xFF);
+ }
+ return new BigInteger(1, ary);
+ }
+
+ /**
+ * @param version param version of {@link ModuleParser#parse(RedisInputStream, int)}
+ * @return string
+ * @throws IOException IOException
+ */
+ public String loadString(int version) throws IOException {
+ if (version == 2) {
+ long opcode = parser.rdbLoadLen().len;
+ if (opcode != RDB_MODULE_OPCODE_STRING)
+ throw new UnsupportedOperationException("Error loading string from RDB.");
+ }
+ ByteArray bytes = parser.rdbGenericLoadStringObject(RedisConstants.RDB_LOAD_NONE);
+ return new String(bytes.first(), UTF_8);
+ }
+
+ /**
+ * @param version param version of {@link ModuleParser#parse(RedisInputStream, int)}
+ * @return string buffer
+ * @throws IOException IOException
+ */
+ public byte[] loadStringBuffer(int version) throws IOException {
+ if (version == 2) {
+ long opcode = parser.rdbLoadLen().len;
+ if (opcode != RDB_MODULE_OPCODE_STRING)
+ throw new UnsupportedOperationException("Error loading string from RDB.");
+ }
+ ByteArray bytes = parser.rdbGenericLoadStringObject(RedisConstants.RDB_LOAD_PLAIN);
+ return bytes.first();
+ }
+
+ /**
+ * @param version param version of {@link ModuleParser#parse(RedisInputStream, int)}
+ * @return double
+ * @throws IOException IOException
+ */
+ public double loadDouble(int version) throws IOException {
+ if (version == 2) {
+ long opcode = parser.rdbLoadLen().len;
+ if (opcode != RDB_MODULE_OPCODE_DOUBLE)
+ throw new UnsupportedOperationException("Error loading double from RDB.");
+ }
+ return parser.rdbLoadBinaryDoubleValue();
+ }
+
+ /**
+ * @param version param version of {@link ModuleParser#parse(RedisInputStream, int)}
+ * @return single precision float
+ * @throws IOException io exception
+ */
+ public float loadFloat(int version) throws IOException {
+ if (version == 2) {
+ long opcode = parser.rdbLoadLen().len;
+ if (opcode != RDB_MODULE_OPCODE_FLOAT)
+ throw new UnsupportedOperationException("Error loading float from RDB.");
+ }
+ return parser.rdbLoadBinaryFloatValue();
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/module/ModuleKey.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/module/ModuleKey.java
new file mode 100644
index 00000000..c8cee813
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/module/ModuleKey.java
@@ -0,0 +1,69 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.module;
+
+public class ModuleKey {
+ private final String moduleName;
+ private final int moduleVersion;
+
+ private ModuleKey(String moduleName, int moduleVersion) {
+ this.moduleName = moduleName;
+ this.moduleVersion = moduleVersion;
+ }
+
+ public static ModuleKey key(String moduleName, int moduleVersion) {
+ return new ModuleKey(moduleName, moduleVersion);
+ }
+
+ public String getModuleName() {
+ return moduleName;
+ }
+
+ public int getModuleVersion() {
+ return moduleVersion;
+ }
+
+ @Override
+ public String toString() {
+ return "ModuleKey{" +
+ "moduleName='" + moduleName + '\'' +
+ ", moduleVersion=" + moduleVersion +
+ '}';
+ }
+
+ @Override
+ public boolean equals(Object o) {
+ if (this == o)
+ return true;
+ if (o == null || getClass() != o.getClass())
+ return false;
+
+ ModuleKey moduleKey = (ModuleKey) o;
+
+ if (moduleVersion != moduleKey.moduleVersion)
+ return false;
+ return moduleName.equals(moduleKey.moduleName);
+ }
+
+ @Override
+ public int hashCode() {
+ int result = moduleName.hashCode();
+ result = 31 * result + moduleVersion;
+ return result;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/module/ModuleParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/module/ModuleParser.java
new file mode 100644
index 00000000..e48f9362
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/module/ModuleParser.java
@@ -0,0 +1,27 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.module;
+
+import java.io.IOException;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.Module;
+
+public interface ModuleParser<T extends Module> {
+
+ T parse(RedisInputStream in, int version) throws IOException;
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/skip/SkipRdbParser.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/skip/SkipRdbParser.java
new file mode 100644
index 00000000..0bbd33c2
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/skip/SkipRdbParser.java
@@ -0,0 +1,115 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.skip;
+
+import java.io.IOException;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.BaseRdbParser;
+
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_ENC_INT16;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_ENC_INT32;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_ENC_INT8;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_ENC_LZF;
+
+public class SkipRdbParser {
+
+ protected final RedisInputStream in;
+
+ public SkipRdbParser(RedisInputStream in) {
+ this.in = in;
+ }
+
+ public void rdbLoadTime() throws IOException {
+ in.skip(4);
+ }
+
+ public void rdbLoadMillisecondTime() throws IOException {
+ in.skip(8);
+ }
+
+ public BaseRdbParser.Len rdbLoadLen() throws IOException {
+ return new BaseRdbParser(in).rdbLoadLen();
+ }
+
+ public void rdbLoadIntegerObject(int enctype) throws IOException {
+ switch (enctype) {
+ case RDB_ENC_INT8:
+ in.skip(1);
+ break;
+ case RDB_ENC_INT16:
+ in.skip(2);
+ break;
+ case RDB_ENC_INT32:
+ in.skip(4);
+ break;
+ default:
+ break;
+ }
+ }
+
+ public void rdbLoadLzfStringObject() throws IOException {
+ long clen = rdbLoadLen().len;
+ rdbLoadLen();
+ in.skip(clen);
+ }
+
+ public void rdbGenericLoadStringObject() throws IOException {
+ BaseRdbParser.Len lenObj = rdbLoadLen();
+ long len = (int) lenObj.len;
+ boolean isencoded = lenObj.isencoded;
+ if (isencoded) {
+ switch ((int) len) {
+ case RDB_ENC_INT8:
+ case RDB_ENC_INT16:
+ case RDB_ENC_INT32:
+ rdbLoadIntegerObject((int) len);
+ return;
+ case RDB_ENC_LZF:
+ rdbLoadLzfStringObject();
+ return;
+ default:
+ throw new AssertionError("unknown RdbParser encoding type:" + len);
+ }
+ }
+ in.skip(len);
+ }
+
+ public void rdbLoadPlainStringObject() throws IOException {
+ rdbGenericLoadStringObject();
+ }
+
+ public void rdbLoadEncodedStringObject() throws IOException {
+ rdbGenericLoadStringObject();
+ }
+
+ public void rdbLoadDoubleValue() throws IOException {
+ int len = in.read();
+ switch (len) {
+ case 255:
+ case 254:
+ case 253:
+ return;
+ default:
+ in.skip(len);
+ }
+ }
+
+ public void rdbLoadBinaryDoubleValue() throws IOException {
+ in.skip(8);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/skip/SkipRdbVisitor.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/skip/SkipRdbVisitor.java
new file mode 100644
index 00000000..84026893
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/rdb/skip/SkipRdbVisitor.java
@@ -0,0 +1,241 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb.skip;
+
+import java.io.IOException;
+import java.util.NoSuchElementException;
+import org.apache.rocketmq.redis.replicator.Replicator;
+import org.apache.rocketmq.redis.replicator.event.Event;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.DefaultRdbVisitor;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.DB;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.Module;
+import org.apache.rocketmq.redis.replicator.rdb.module.ModuleParser;
+
+import static org.apache.rocketmq.redis.replicator.RedisConstants.MODULE_SET;
+import static org.apache.rocketmq.redis.replicator.RedisConstants.RDB_MODULE_OPCODE_EOF;
+
+public class SkipRdbVisitor extends DefaultRdbVisitor {
+
+ public SkipRdbVisitor(Replicator replicator) {
+ super(replicator);
+ }
+
+ @Override
+ public DB applySelectDB(RedisInputStream in, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadLen();
+ return null;
+ }
+
+ @Override
+ public DB applyResizeDB(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadLen();
+ parser.rdbLoadLen();
+ return null;
+ }
+
+ @Override
+ public Event applyExpireTime(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadTime();
+ int valueType = applyType(in);
+ rdbLoadObject(in, db, valueType, version);
+ return null;
+ }
+
+ @Override
+ public Event applyExpireTimeMs(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadMillisecondTime();
+ int valueType = applyType(in);
+ rdbLoadObject(in, db, valueType, version);
+ return null;
+ }
+
+ @Override
+ public Event applyAux(RedisInputStream in, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadEncodedStringObject();
+ return null;
+ }
+
+ @Override
+ public Event applyString(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadEncodedStringObject();
+ return null;
+ }
+
+ @Override
+ public Event applyList(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ long len = parser.rdbLoadLen().len;
+ for (int i = 0; i < len; i++) {
+ parser.rdbLoadEncodedStringObject();
+ }
+ return null;
+ }
+
+ @Override
+ public Event applySet(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ long len = parser.rdbLoadLen().len;
+ for (int i = 0; i < len; i++) {
+ parser.rdbLoadEncodedStringObject();
+ }
+ return null;
+ }
+
+ @Override
+ public Event applyZSet(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ long len = parser.rdbLoadLen().len;
+ while (len > 0) {
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadDoubleValue();
+ len--;
+ }
+ return null;
+ }
+
+ @Override
+ public Event applyZSet2(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ long len = parser.rdbLoadLen().len;
+ while (len > 0) {
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadBinaryDoubleValue();
+ len--;
+ }
+ return null;
+ }
+
+ @Override
+ public Event applyHash(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ long len = parser.rdbLoadLen().len;
+ while (len > 0) {
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadEncodedStringObject();
+ len--;
+ }
+ return null;
+ }
+
+ @Override
+ public Event applyHashZipMap(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadPlainStringObject();
+ return null;
+ }
+
+ @Override
+ public Event applyListZipList(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadPlainStringObject();
+ return null;
+ }
+
+ @Override
+ public Event applySetIntSet(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadPlainStringObject();
+ return null;
+ }
+
+ @Override
+ public Event applyZSetZipList(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadPlainStringObject();
+ return null;
+ }
+
+ @Override
+ public Event applyHashZipList(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ parser.rdbLoadPlainStringObject();
+ return null;
+ }
+
+ @Override
+ public Event applyListQuickList(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ long len = parser.rdbLoadLen().len;
+ for (int i = 0; i < len; i++) {
+ parser.rdbGenericLoadStringObject();
+ }
+ return null;
+ }
+
+ @Override
+ public Event applyModule(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ char[] c = new char[9];
+ long moduleid = parser.rdbLoadLen().len;
+ for (int i = 0; i < c.length; i++) {
+ c[i] = MODULE_SET[(int) (moduleid >>> (10 + (c.length - 1 - i) * 6) & 63)];
+ }
+ String moduleName = new String(c);
+ int moduleVersion = (int) (moduleid & 1023);
+ ModuleParser<? extends Module> moduleParser = lookupModuleParser(moduleName, moduleVersion);
+ if (moduleParser == null) {
+ throw new NoSuchElementException("module[" + moduleName + "," + moduleVersion + "] not exist.");
+ }
+ moduleParser.parse(in, 1);
+ return null;
+ }
+
+ @Override
+ public Event applyModule2(RedisInputStream in, DB db, int version) throws IOException {
+ SkipRdbParser parser = new SkipRdbParser(in);
+ parser.rdbLoadEncodedStringObject();
+ char[] c = new char[9];
+ long moduleid = parser.rdbLoadLen().len;
+ for (int i = 0; i < c.length; i++) {
+ c[i] = MODULE_SET[(int) (moduleid >>> (10 + (c.length - 1 - i) * 6) & 63)];
+ }
+ String moduleName = new String(c);
+ int moduleVersion = (int) (moduleid & 1023);
+ ModuleParser<? extends Module> moduleParser = lookupModuleParser(moduleName, moduleVersion);
+ if (moduleParser == null) {
+ throw new NoSuchElementException("module[" + moduleName + "," + moduleVersion + "] not exist.");
+ }
+ moduleParser.parse(in, 2);
+ long eof = parser.rdbLoadLen().len;
+ if (eof != RDB_MODULE_OPCODE_EOF) {
+ throw new UnsupportedOperationException("The RDB file contains module data for the module '" + moduleName + "' that is not terminated by the proper module value EOF marker");
+ }
+ return null;
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/Arrays.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/Arrays.java
new file mode 100644
index 00000000..3e8d418a
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/Arrays.java
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+import java.util.HashSet;
+import java.util.Set;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+
+public class Arrays {
+
+ public static String deepToString(Object[] a) {
+ if (a == null)
+ return "null";
+ int bufLen = 20 * a.length;
+ if (a.length != 0 && bufLen <= 0)
+ bufLen = Integer.MAX_VALUE;
+ StringBuilder buf = new StringBuilder(bufLen);
+ deepToString(a, buf, new HashSet<Object[]>());
+ return buf.toString();
+ }
+
+ private static void deepToString(Object[] a, StringBuilder buf, Set<Object[]> dejaVu) {
+ if (a == null) {
+ buf.append("null");
+ return;
+ }
+ int iMax = a.length - 1;
+ if (iMax == -1) {
+ buf.append("[]");
+ return;
+ }
+
+ dejaVu.add(a);
+ buf.append('[');
+ for (int i = 0; true; i++) {
+ Object element = a[i];
+ if (element == null) {
+ buf.append("null");
+ } else {
+ Class<?> eClass = element.getClass();
+
+ if (eClass.isArray()) {
+ if (eClass == byte[].class)
+ buf.append(toString((byte[]) element));
+ else if (eClass == char[].class)
+ buf.append(toString((char[]) element));
+ else if (eClass == short[].class)
+ buf.append(java.util.Arrays.toString((short[]) element));
+ else if (eClass == int[].class)
+ buf.append(java.util.Arrays.toString((int[]) element));
+ else if (eClass == long[].class)
+ buf.append(java.util.Arrays.toString((long[]) element));
+ else if (eClass == float[].class)
+ buf.append(java.util.Arrays.toString((float[]) element));
+ else if (eClass == double[].class)
+ buf.append(java.util.Arrays.toString((double[]) element));
+ else if (eClass == boolean[].class)
+ buf.append(java.util.Arrays.toString((boolean[]) element));
+ else { // element is an array of object references
+ if (dejaVu.contains(element))
+ buf.append("[...]");
+ else
+ deepToString((Object[]) element, buf, dejaVu);
+ }
+ } else { // element is non-null and not an array
+ buf.append(element.toString());
+ }
+ }
+ if (i == iMax)
+ break;
+ buf.append(", ");
+ }
+ buf.append(']');
+ dejaVu.remove(a);
+ }
+
+ public static String toString(char[] a) {
+ if (a == null)
+ return "null";
+ int iMax = a.length - 1;
+ if (iMax == -1)
+ return "";
+ return new String(a);
+ }
+
+ private static String toString(byte[] a) {
+ if (a == null)
+ return "null";
+ int iMax = a.length - 1;
+ if (iMax == -1)
+ return "";
+ return new String(a, UTF_8);
+ }
+
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/ByteArray.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/ByteArray.java
new file mode 100644
index 00000000..c9c5c82a
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/ByteArray.java
@@ -0,0 +1,150 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+import java.util.Iterator;
+
+//@NonThreadSafe
+public class ByteArray implements Iterable<byte[]> {
+
+ protected static final int BITS = 30;
+ protected static final int MAGIC = 1 << BITS;
+ protected static final int MASK = MAGIC - 1;
+
+ public static final long MIN_VALUE = 0L;
+ public static final long MAX_VALUE = 2305843007066210304L; //(Integer.MAX_VALUE - 1) * MAGIC
+
+ protected final int cap;
+ protected final long length;
+ protected byte[] smallBytes;
+ protected byte[][] largeBytes;
+
+ public ByteArray(byte[] smallBytes) {
+ this(smallBytes, Integer.MAX_VALUE);
+ }
+
+ public ByteArray(long length) {
+ this(length, Integer.MAX_VALUE);
+ }
+
+ public ByteArray(byte[] smallBytes, int cap) {
+ this.cap = cap;
+ this.length = smallBytes.length;
+ this.smallBytes = smallBytes;
+ }
+
+ public ByteArray(long length, int cap) {
+ this.cap = cap;
+ this.length = length;
+ if (length > MAX_VALUE || length < 0) {
+ throw new IllegalArgumentException(String.valueOf(length));
+ } else if (length <= cap) {
+ this.smallBytes = new byte[(int) length];
+ } else {
+ final int x = (int) (length >> BITS);
+ final int y = (int) (length & MASK);
+ int len = x + 1;
+ largeBytes = new byte[len][];
+ for (int i = 0; i < x; i++) {
+ largeBytes[i] = new byte[MAGIC];
+ }
+ largeBytes[x] = new byte[y];
+ }
+ }
+
+ public void set(long idx, byte value) {
+ if (smallBytes != null) {
+ smallBytes[(int) idx] = value;
+ return;
+ }
+ int x = (int) (idx >> BITS);
+ int y = (int) (idx & MASK);
+ largeBytes[x][y] = value;
+ }
+
+ public byte get(long idx) {
+ if (smallBytes != null)
+ return smallBytes[(int) idx];
+ int x = (int) (idx >> BITS);
+ int y = (int) (idx & MASK);
+ return largeBytes[x][y];
+ }
+
+ public long length() {
+ return this.length;
+ }
+
+ public byte[] first() {
+ Iterator<byte[]> it = this.iterator();
+ return it.hasNext() ? it.next() : null;
+ }
+
+ @Override
+ public Iterator<byte[]> iterator() {
+ return new Iter();
+ }
+
+ public static void arraycopy(ByteArray src, long srcPos, ByteArray dest, long destPos, long length) {
+ if (srcPos + length > src.length || destPos + length > dest.length) {
+ throw new IndexOutOfBoundsException();
+ }
+ if (srcPos + length <= src.cap && destPos + length <= dest.cap) {
+ System.arraycopy(src.smallBytes, (int) srcPos, dest.smallBytes, (int) destPos, (int) length);
+ return;
+ }
+ while (length > 0) {
+ int x1 = (int) (srcPos >> BITS);
+ int y1 = (int) (srcPos & MASK);
+ int x2 = (int) (destPos >> BITS);
+ int y2 = (int) (destPos & MASK);
+ int min = Math.min(MAGIC - y1, MAGIC - y2);
+ if (length <= MAGIC)
+ min = Math.min(min, (int) length);
+ System.arraycopy(src.largeBytes[x1], y1, dest.largeBytes[x2], y2, min);
+ srcPos += min;
+ destPos += min;
+ length -= min;
+ }
+ assert length == 0;
+ }
+
+ protected class Iter implements Iterator<byte[]> {
+ protected int index = 0;
+
+ @Override
+ public boolean hasNext() {
+ if (smallBytes != null)
+ return index < 1;
+ return index < largeBytes.length;
+ }
+
+ @Override
+ public byte[] next() {
+ if (smallBytes != null) {
+ index++;
+ return smallBytes;
+ }
+ return largeBytes[index++];
+ }
+
+ @Override
+ public void remove() {
+ throw new UnsupportedOperationException();
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/ByteArrayMap.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/ByteArrayMap.java
new file mode 100644
index 00000000..9216b708
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/ByteArrayMap.java
@@ -0,0 +1,326 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+import java.io.Serializable;
+import java.util.AbstractSet;
+import java.util.Arrays;
+import java.util.Collection;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.LinkedHashMap;
+import java.util.Map;
+import java.util.Set;
+
+//@NonThreadSafe
+public class ByteArrayMap<V> implements Map<byte[], V>, Serializable {
+ private static final long serialVersionUID = 1L;
+
+ protected final Map<Key, V> map;
+
+ public ByteArrayMap(Map<? extends byte[], ? extends V> m) {
+ this(true, m);
+ }
+
+ public ByteArrayMap(boolean ordered, Map<? extends byte[], ? extends V> m) {
+ this(ordered, m == null ? 0 : m.size(), 0.75f);
+ putAll(m);
+ }
+
+ public ByteArrayMap() {
+ this(true);
+ }
+
+ public ByteArrayMap(boolean ordered) {
+ this(ordered, 16);
+ }
+
+ public ByteArrayMap(boolean ordered, int initialCapacity) {
+ this(ordered, initialCapacity, 0.75f);
+ }
+
+ public ByteArrayMap(boolean ordered, int initialCapacity, float loadFactor) {
+ if (ordered)
+ map = new LinkedHashMap<>(initialCapacity, loadFactor);
+ else
+ map = new HashMap<>(initialCapacity, loadFactor);
+ }
+
+ @Override
+ public int size() {
+ return map.size();
+ }
+
+ @Override
+ public boolean isEmpty() {
+ return map.isEmpty();
+ }
+
+ @Override
+ public boolean containsKey(Object key) {
+ if (key != null && !(key instanceof byte[]))
+ return false;
+ return map.containsKey(new Key((byte[]) key));
+ }
+
+ @Override
+ public boolean containsValue(Object value) {
+ return map.containsValue(value);
+ }
+
+ @Override
+ public V get(Object key) {
+ if (key != null && !(key instanceof byte[]))
+ return null;
+ return map.get(new Key((byte[]) key));
+ }
+
+ @Override
+ public V put(byte[] key, V value) {
+ return map.put(new Key(key), value);
+ }
+
+ @Override
+ public void putAll(Map<? extends byte[], ? extends V> m) {
+ if (m == null)
+ return;
+ for (Entry<? extends byte[], ? extends V> entry : m.entrySet()) {
+ put(entry.getKey(), entry.getValue());
+ }
+ }
+
+ @Override
+ public V remove(Object key) {
+ if (key != null && !(key instanceof byte[]))
+ return null;
+ return map.remove(new Key((byte[]) key));
+ }
+
+ @Override
+ public void clear() {
+ map.clear();
+ }
+
+ @Override
+ public Set<byte[]> keySet() {
+ return new KeySet();
+ }
+
+ @Override
+ public Collection<V> values() {
+ return map.values();
+ }
+
+ @Override
+ public Set<Entry<byte[], V>> entrySet() {
+ return new EntrySet();
+ }
+
+ private static final class Key implements Serializable {
+ private static final long serialVersionUID = 1L;
+
+ private final byte[] bytes;
+
+ private Key(byte[] bytes) {
+ this.bytes = bytes;
+ }
+
+ @Override
+ public boolean equals(Object o) {
+ if (this == o)
+ return true;
+ if (o == null || getClass() != o.getClass())
+ return false;
+ Key key = (Key) o;
+ return Arrays.equals(bytes, key.bytes);
+ }
+
+ @Override
+ public int hashCode() {
+ return Arrays.hashCode(bytes);
+ }
+ }
+
+ private final class EntrySet extends AbstractSet<Entry<byte[], V>> {
+
+ @Override
+ public final int size() {
+ return ByteArrayMap.this.size();
+ }
+
+ @Override
+ public final void clear() {
+ ByteArrayMap.this.clear();
+ }
+
+ @Override
+ public final Iterator<Entry<byte[], V>> iterator() {
+ return new EntryIterator();
+ }
+
+ @Override
+ public final boolean contains(Object o) {
+ if (!(o instanceof Map.Entry))
+ return false;
+ Entry<?, ?> e = (Entry<?, ?>) o;
+ Object obj = e.getKey();
+ if (obj != null && !(obj instanceof byte[]))
+ return false;
+ byte[] key = (byte[]) obj;
+ if (!ByteArrayMap.this.containsKey(key))
+ return false;
+ V v = ByteArrayMap.this.get(key);
+ return v != null ? v.equals(e.getValue()) : e.getValue() == v;
+ }
+
+ @Override
+ public final boolean remove(Object o) {
+ if (!(o instanceof Map.Entry))
+ return false;
+ Entry<?, ?> e = (Entry<?, ?>) o;
+ Object obj = e.getKey();
+ Object value = e.getValue();
+ if (obj != null && !(obj instanceof byte[]))
+ return false;
+ byte[] key = (byte[]) obj;
+ if (!ByteArrayMap.this.containsKey(key))
+ return false;
+ V v = ByteArrayMap.this.get(key);
+ if ((value == null && value == v) || (value != null && value.equals(v)))
+ return ByteArrayMap.this.remove(key) != null;
+ return false;
+ }
+ }
+
+ private final class KeySet extends AbstractSet<byte[]> {
+
+ @Override
+ public final int size() {
+ return ByteArrayMap.this.size();
+ }
+
+ @Override
+ public final void clear() {
+ ByteArrayMap.this.clear();
+ }
+
+ @Override
+ public final Iterator<byte[]> iterator() {
+ return new KeyIterator();
+ }
+
+ @Override
+ public final boolean contains(Object o) {
+ return ByteArrayMap.this.containsKey(o);
+ }
+
+ @Override
+ public final boolean remove(Object key) {
+ return ByteArrayMap.this.remove(key) != null;
+ }
+ }
+
+ private final class KeyIterator implements Iterator<byte[]> {
+
+ private final Iterator<Key> iterator = map.keySet().iterator();
+
+ @Override
+ public boolean hasNext() {
+ return iterator.hasNext();
+ }
+
+ @Override
+ public byte[] next() {
+ return iterator.next().bytes;
+ }
+
+ @Override
+ public void remove() {
+ iterator.remove();
+ }
+ }
+
+ private final class EntryIterator implements Iterator<Entry<byte[], V>> {
+
+ private final Iterator<Entry<Key, V>> iterator = map.entrySet().iterator();
+
+ @Override
+ public boolean hasNext() {
+ return iterator.hasNext();
+ }
+
+ @Override
+ public Entry<byte[], V> next() {
+ Entry<Key, V> v = iterator.next();
+ return new Node(v.getKey().bytes, v.getValue());
+ }
+
+ @Override
+ public void remove() {
+ iterator.remove();
+ }
+ }
+
+ private final class Node implements Entry<byte[], V> {
+
+ private V value;
+ private final byte[] bytes;
+
+ private Node(byte[] bytes, V value) {
+ this.bytes = bytes;
+ this.value = value;
+ }
+
+ @Override
+ public byte[] getKey() {
+ return bytes;
+ }
+
+ @Override
+ public V getValue() {
+ return this.value;
+ }
+
+ @Override
+ public V setValue(V value) {
+ V oldValue = this.value;
+ this.value = value;
+ return oldValue;
+ }
+
+ @Override
+ @SuppressWarnings("unchecked")
+ public boolean equals(Object o) {
+ if (this == o)
+ return true;
+ if (o == null || getClass() != o.getClass())
+ return false;
+ Node node = (Node) o;
+ if (value != null ? !value.equals(node.value) : node.value != null)
+ return false;
+ return Arrays.equals(bytes, node.bytes);
+ }
+
+ @Override
+ public int hashCode() {
+ int result = value != null ? value.hashCode() : 0;
+ result = 31 * result + Arrays.hashCode(bytes);
+ return result;
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/ByteBuilder.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/ByteBuilder.java
new file mode 100644
index 00000000..9ad7a1ae
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/ByteBuilder.java
@@ -0,0 +1,79 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+import java.nio.ByteBuffer;
+import java.util.ArrayList;
+import java.util.List;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+
+//@NonThreadSafe
+public class ByteBuilder {
+
+ private final ByteBuffer buffer;
+ private final List<byte[]> list = new ArrayList<>();
+ private int total = 0;
+
+ private ByteBuilder(int cap) {
+ this.buffer = ByteBuffer.allocate(cap);
+ }
+
+ public static ByteBuilder allocate(int cap) {
+ return new ByteBuilder(cap);
+ }
+
+ public void put(byte b) {
+ total++;
+ if (buffer.hasRemaining()) {
+ buffer.put(b);
+ } else {
+ byte[] temp = new byte[buffer.capacity()];
+ System.arraycopy(buffer.array(), 0, temp, 0, buffer.capacity());
+ list.add(temp);
+ buffer.clear();
+ buffer.put(b);
+ }
+ }
+
+ public int length() {
+ return total;
+ }
+
+ public byte[] array() {
+ int len = total, offset = 0;
+ byte[] ary = new byte[len];
+ if (len < buffer.capacity()) {
+ System.arraycopy(buffer.array(), 0, ary, offset, len);
+ return ary;
+ }
+ for (byte[] ba : list) {
+ System.arraycopy(ba, 0, ary, offset, ba.length);
+ offset += ba.length;
+ len -= ba.length;
+ }
+ if (len > 0)
+ System.arraycopy(buffer.array(), 0, ary, offset, len);
+ return ary;
+ }
+
+ @Override
+ public String toString() {
+ return new String(array(), UTF_8);
+ }
+}
diff --git a/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/Lzf.java b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/Lzf.java
new file mode 100644
index 00000000..82b7b1cd
--- /dev/null
+++ b/rocketmq-redis/src/main/java/org/apache/rocketmq/redis/replicator/util/Lzf.java
@@ -0,0 +1,256 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+/*
+ * Copyright 2009-2010 Ning, Inc.
+ *
+ * Licensed under the Apache License, Version 2.0 (the "License"); you may not
+ * use this file except in compliance with the License. You may obtain a copy of
+ * the License at http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,WITHOUT
+ * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
+ * License for the specific language governing permissions and limitations under
+ * the License.
+ *
+ * author Ning
+ * modification: support more than 2GB laf decompression
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+public class Lzf {
+
+ public static ByteArray decode(ByteArray bytes, long len) {
+ ByteArray out = new ByteArray(len);
+ decode(bytes, 0, out, 0, len);
+ return out;
+ }
+
+ private static void decode(ByteArray in, long inPos, ByteArray out, long outPos, long outEnd) {
+ do {
+ int ctrl = in.get(inPos++) & 255;
+ if (ctrl < 1 << 5) {
+ switch (ctrl) {
+ case 31:
+ out.set(outPos++, in.get(inPos++));
+ case 30:
+ out.set(outPos++, in.get(inPos++));
+ case 29:
+ out.set(outPos++, in.get(inPos++));
+ case 28:
+ out.set(outPos++, in.get(inPos++));
+ case 27:
+ out.set(outPos++, in.get(inPos++));
+ case 26:
+ out.set(outPos++, in.get(inPos++));
+ case 25:
+ out.set(outPos++, in.get(inPos++));
+ case 24:
+ out.set(outPos++, in.get(inPos++));
+ case 23:
+ out.set(outPos++, in.get(inPos++));
+ case 22:
+ out.set(outPos++, in.get(inPos++));
+ case 21:
+ out.set(outPos++, in.get(inPos++));
+ case 20:
+ out.set(outPos++, in.get(inPos++));
+ case 19:
+ out.set(outPos++, in.get(inPos++));
+ case 18:
+ out.set(outPos++, in.get(inPos++));
+ case 17:
+ out.set(outPos++, in.get(inPos++));
+ case 16:
+ out.set(outPos++, in.get(inPos++));
+ case 15:
+ out.set(outPos++, in.get(inPos++));
+ case 14:
+ out.set(outPos++, in.get(inPos++));
+ case 13:
+ out.set(outPos++, in.get(inPos++));
+ case 12:
+ out.set(outPos++, in.get(inPos++));
+ case 11:
+ out.set(outPos++, in.get(inPos++));
+ case 10:
+ out.set(outPos++, in.get(inPos++));
+ case 9:
+ out.set(outPos++, in.get(inPos++));
+ case 8:
+ out.set(outPos++, in.get(inPos++));
+ case 7:
+ out.set(outPos++, in.get(inPos++));
+ case 6:
+ out.set(outPos++, in.get(inPos++));
+ case 5:
+ out.set(outPos++, in.get(inPos++));
+ case 4:
+ out.set(outPos++, in.get(inPos++));
+ case 3:
+ out.set(outPos++, in.get(inPos++));
+ case 2:
+ out.set(outPos++, in.get(inPos++));
+ case 1:
+ out.set(outPos++, in.get(inPos++));
+ case 0:
+ out.set(outPos++, in.get(inPos++));
+ }
+ continue;
+ }
+
+ long len = ctrl >> 5;
+ ctrl = -((ctrl & 0x1f) << 8) - 1;
+ if (len < 7) {
+ ctrl -= in.get(inPos++) & 255;
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ switch ((int) len) {
+ case 6:
+ out.set(outPos, out.get(outPos++ + ctrl));
+ case 5:
+ out.set(outPos, out.get(outPos++ + ctrl));
+ case 4:
+ out.set(outPos, out.get(outPos++ + ctrl));
+ case 3:
+ out.set(outPos, out.get(outPos++ + ctrl));
+ case 2:
+ out.set(outPos, out.get(outPos++ + ctrl));
+ case 1:
+ out.set(outPos, out.get(outPos++ + ctrl));
+ }
+ continue;
+ }
+
+ len = in.get(inPos++) & 255;
+ ctrl -= in.get(inPos++) & 255;
+
+ if ((ctrl + len) < -9) {
+ len += 9;
+ if (len <= 32) {
+ long inPos1 = outPos + ctrl;
+ long outPos1 = outPos;
+ switch ((int) len - 1) {
+ case 31:
+ out.set(outPos1++, out.get(inPos1++));
+ case 30:
+ out.set(outPos1++, out.get(inPos1++));
+ case 29:
+ out.set(outPos1++, out.get(inPos1++));
+ case 28:
+ out.set(outPos1++, out.get(inPos1++));
+ case 27:
+ out.set(outPos1++, out.get(inPos1++));
+ case 26:
+ out.set(outPos1++, out.get(inPos1++));
+ case 25:
+ out.set(outPos1++, out.get(inPos1++));
+ case 24:
+ out.set(outPos1++, out.get(inPos1++));
+ case 23:
+ out.set(outPos1++, out.get(inPos1++));
+ case 22:
+ out.set(outPos1++, out.get(inPos1++));
+ case 21:
+ out.set(outPos1++, out.get(inPos1++));
+ case 20:
+ out.set(outPos1++, out.get(inPos1++));
+ case 19:
+ out.set(outPos1++, out.get(inPos1++));
+ case 18:
+ out.set(outPos1++, out.get(inPos1++));
+ case 17:
+ out.set(outPos1++, out.get(inPos1++));
+ case 16:
+ out.set(outPos1++, out.get(inPos1++));
+ case 15:
+ out.set(outPos1++, out.get(inPos1++));
+ case 14:
+ out.set(outPos1++, out.get(inPos1++));
+ case 13:
+ out.set(outPos1++, out.get(inPos1++));
+ case 12:
+ out.set(outPos1++, out.get(inPos1++));
+ case 11:
+ out.set(outPos1++, out.get(inPos1++));
+ case 10:
+ out.set(outPos1++, out.get(inPos1++));
+ case 9:
+ out.set(outPos1++, out.get(inPos1++));
+ case 8:
+ out.set(outPos1++, out.get(inPos1++));
+ case 7:
+ out.set(outPos1++, out.get(inPos1++));
+ case 6:
+ out.set(outPos1++, out.get(inPos1++));
+ case 5:
+ out.set(outPos1++, out.get(inPos1++));
+ case 4:
+ out.set(outPos1++, out.get(inPos1++));
+ case 3:
+ out.set(outPos1++, out.get(inPos1++));
+ case 2:
+ out.set(outPos1++, out.get(inPos1++));
+ case 1:
+ out.set(outPos1++, out.get(inPos1++));
+ case 0:
+ out.set(outPos1++, out.get(inPos1++));
+ }
+ } else {
+ ByteArray.arraycopy(out, outPos + ctrl, out, outPos, len);
+ }
+ outPos += len;
+ continue;
+ }
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+
+ len += outPos;
+ final long end = len - 3;
+ while (outPos < end) {
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ }
+ if (len - outPos == 3) {
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ } else if (len - outPos == 2) {
+ out.set(outPos, out.get(outPos++ + ctrl));
+ out.set(outPos, out.get(outPos++ + ctrl));
+ } else if (len - outPos == 1) {
+ out.set(outPos, out.get(outPos++ + ctrl));
+ }
+ }
+ while (outPos < outEnd);
+
+ if (outPos != outEnd) {
+ throw new AssertionError("corrupt data: overrun in decompress, input offset " + inPos + ", output offset " + outPos);
+ }
+ }
+}
diff --git a/rocketmq-redis/src/main/resources/logback.xml b/rocketmq-redis/src/main/resources/logback.xml
new file mode 100644
index 00000000..0271b8bc
--- /dev/null
+++ b/rocketmq-redis/src/main/resources/logback.xml
@@ -0,0 +1,52 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+ -->
+
+<configuration>
+ <appender name="DefaultConsoleAppender" class="ch.qos.logback.core.ConsoleAppender">
+ <encoder>
+ <pattern>%d{yyy-MM-dd HH:mm:ss,GMT+8} %p - %m%n</pattern>
+ <charset class="java.nio.charset.Charset">UTF-8</charset>
+ </encoder>
+ </appender>
+
+ <appender name="DefaultFileAppender"
+ class="ch.qos.logback.core.rolling.RollingFileAppender">
+ <file>./logs/rocketmq_redis.log</file>
+ <rollingPolicy class="ch.qos.logback.core.rolling.FixedWindowRollingPolicy">
+ <fileNamePattern>./logs/rocketmq_redis.%i.log
+ </fileNamePattern>
+ <minIndex>1</minIndex>
+ <maxIndex>10</maxIndex>
+ </rollingPolicy>
+ <triggeringPolicy
+ class="ch.qos.logback.core.rolling.SizeBasedTriggeringPolicy">
+ <maxFileSize>100MB</maxFileSize>
+ </triggeringPolicy>
+ <encoder>
+ <pattern>%d{yyy-MM-dd HH:mm:ss,GMT+8} %p - %m%n</pattern>
+ <charset class="java.nio.charset.Charset">UTF-8</charset>
+ </encoder>
+ </appender>
+
+ <root>
+ <level value="INFO"/>
+ <appender-ref ref="DefaultConsoleAppender"/>
+ <appender-ref ref="DefaultFileAppender"/>
+ </root>
+
+</configuration>
diff --git a/rocketmq-redis/src/main/resources/replicator.conf b/rocketmq-redis/src/main/resources/replicator.conf
new file mode 100644
index 00000000..ff208743
--- /dev/null
+++ b/rocketmq-redis/src/main/resources/replicator.conf
@@ -0,0 +1,52 @@
+# address of zookeeper, the format is: ip1:port,ip2:port,ip3:port
+zookeeper.address = 127.0.0.1:2181
+
+
+# the uri of redis master which replicate from
+# .e.g.
+# redis:///c:/path/to/appendonly.aof
+# redis:///c:/path/to/dump.rdb?verbose=yes
+# redis://host:port?ssl=yes&authPassword=yourredispassword
+# query parameters @see org.apache.rocketmq.redis.replicator.Configuration
+# connectionTimeout
+# readTimeout
+# receiveBufferSize
+# sendBufferSize
+# retries
+# retryTimeInterval
+# bufferSize
+# authPassword
+# discardRdbEvent
+# asyncCachedBytes
+# rateLimit
+# verbose
+# heartBeatPeriod
+# useDefaultExceptionListener
+# ssl
+# replId
+# replOffset
+redis.uri = redis://127.0.0.1:6379
+
+# the address of rocketmq nameserver, the format is: ip1:port;ip2:port
+rocketmq.nameserver.address = 127.0.0.1:9876
+
+# the group name of rocketmq procuder. Different application should use unique group name
+rocketmq.producer.groupname = redis_replicator_producer_group_name
+
+# the instance name of rocketmq procuder. Different application should use unique instance name
+rocketmq.producer.instancename = redis_replicator_producer_instance_name
+
+# the topic which redis replication data is sent to
+rocketmq.data.topic = redisdata
+
+# the model of data/commands order.
+# value includes:
+# "global" - sending all redis data/commands to a single queue of RMQ to guarantee global order
+# "partial" - sending RDB data to multi queue to consume concurrently, but sending commands in a single queue
+order.model = global
+
+# set deploy model.
+# value includes:
+# "single" - only one replicator server, which is suitable for develop or test
+# "cluster" - a cluster that use master-slave model to keep a server alive at any time
+deploy.model = single
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/BaseConf.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/BaseConf.java
new file mode 100644
index 00000000..2b910d74
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/BaseConf.java
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import org.apache.log4j.Logger;
+import org.apache.rocketmq.broker.BrokerController;
+import org.apache.rocketmq.namesrv.NamesrvController;
+import org.apache.rocketmq.test.client.rmq.RMQAsyncSendProducer;
+import org.apache.rocketmq.test.client.rmq.RMQNormalConsumer;
+import org.apache.rocketmq.test.client.rmq.RMQNormalProducer;
+import org.apache.rocketmq.test.clientinterface.AbstractMQConsumer;
+import org.apache.rocketmq.test.clientinterface.AbstractMQProducer;
+import org.apache.rocketmq.test.factory.ConsumerFactory;
+import org.apache.rocketmq.test.listener.AbstractListener;
+import org.apache.rocketmq.test.util.MQAdmin;
+import org.apache.rocketmq.test.util.MQRandomUtils;
+
+import java.util.ArrayList;
+import java.util.List;
+
+public class BaseConf {
+ protected static String nsAddr;
+ protected static String broker1Name;
+ protected static String broker2Name;
+ protected static String clusterName;
+ protected static int brokerNum;
+ protected static int waitTime = 5;
+ protected static int consumeTime = 1 * 60 * 1000;
+ protected static NamesrvController namesrvController;
+ protected static BrokerController brokerController1;
+ protected static BrokerController brokerController2;
+ protected static List<Object> mqClients = new ArrayList<Object>();
+ protected static boolean debug = false;
+ private static Logger log = Logger.getLogger(BaseConf.class);
+
+ static {
+ namesrvController = IntegrationTestBase.createAndStartNamesrv();
+ nsAddr = "127.0.0.1:" + namesrvController.getNettyServerConfig().getListenPort();
+ brokerController1 = IntegrationTestBase.createAndStartBroker(nsAddr);
+ brokerController2 = IntegrationTestBase.createAndStartBroker(nsAddr);
+ clusterName = brokerController1.getBrokerConfig().getBrokerClusterName();
+ broker1Name = brokerController1.getBrokerConfig().getBrokerName();
+ broker2Name = brokerController2.getBrokerConfig().getBrokerName();
+ brokerNum = 2;
+ }
+
+ public BaseConf() {
+
+ }
+
+ public static String initTopic() {
+ String topic = MQRandomUtils.getRandomTopic();
+ IntegrationTestBase.initTopic(topic, nsAddr, clusterName);
+
+ return topic;
+ }
+
+ public static String initConsumerGroup() {
+ String group = MQRandomUtils.getRandomConsumerGroup();
+ return initConsumerGroup(group);
+ }
+
+ public static String initConsumerGroup(String group) {
+ MQAdmin.createSub(nsAddr, clusterName, group);
+ return group;
+ }
+
+ public static RMQNormalProducer getProducer(String nsAddr, String topic) {
+ RMQNormalProducer producer = new RMQNormalProducer(nsAddr, topic);
+ if (debug) {
+ producer.setDebug();
+ }
+ mqClients.add(producer);
+ return producer;
+ }
+
+ public static RMQNormalProducer getProducer(String nsAddr, String topic, String producerGoup,
+ String instanceName) {
+ RMQNormalProducer producer = new RMQNormalProducer(nsAddr, topic, producerGoup,
+ instanceName);
+ if (debug) {
+ producer.setDebug();
+ }
+ mqClients.add(producer);
+ return producer;
+ }
+
+ public static RMQAsyncSendProducer getAsyncProducer(String nsAddr, String topic) {
+ RMQAsyncSendProducer producer = new RMQAsyncSendProducer(nsAddr, topic);
+ if (debug) {
+ producer.setDebug();
+ }
+ mqClients.add(producer);
+ return producer;
+ }
+
+ public static RMQNormalConsumer getConsumer(String nsAddr, String topic, String subExpression,
+ AbstractListener listner) {
+ String consumerGroup = initConsumerGroup();
+ return getConsumer(nsAddr, consumerGroup, topic, subExpression, listner);
+ }
+
+ public static RMQNormalConsumer getConsumer(String nsAddr, String consumerGroup, String topic,
+ String subExpression, AbstractListener listner) {
+ RMQNormalConsumer consumer = ConsumerFactory.getRMQNormalConsumer(nsAddr, consumerGroup,
+ topic, subExpression, listner);
+ if (debug) {
+ consumer.setDebug();
+ }
+ mqClients.add(consumer);
+ log.info(String.format("consumer[%s] start,topic[%s],subExpression[%s]", consumerGroup,
+ topic, subExpression));
+ return consumer;
+ }
+
+ public static void shutDown() {
+ try {
+ for (Object mqClient : mqClients) {
+ if (mqClient instanceof AbstractMQProducer) {
+ ((AbstractMQProducer) mqClient).shutdown();
+
+ } else {
+ ((AbstractMQConsumer) mqClient).shutdown();
+ }
+ }
+ } catch (Exception e) {
+ e.printStackTrace();
+ }
+
+ }
+}
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/CloseTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/CloseTest.java
new file mode 100644
index 00000000..6da3cc60
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/CloseTest.java
@@ -0,0 +1,163 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandListener;
+import org.apache.rocketmq.redis.replicator.rdb.RdbListener;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.junit.Test;
+
+import java.io.IOException;
+import java.util.concurrent.atomic.AtomicInteger;
+
+import static org.junit.Assert.assertEquals;
+
+public class CloseTest {
+ @Test
+ public void testRdbClose() throws IOException, InterruptedException {
+ Replicator r = new RedisReplicator(
+ CloseTest.class.getClassLoader().getResourceAsStream("dumpV7.rdb"), FileType.RDB,
+ Configuration.defaultSetting());
+ final AtomicInteger acc = new AtomicInteger(0);
+ r.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ acc.incrementAndGet();
+ if (acc.get() == 10) {
+ try {
+ replicator.close();
+ } catch (IOException e) {
+ e.printStackTrace();
+ }
+ }
+ }
+ });
+ r.addCloseListener(new CloseListener() {
+ @Override
+ public void handle(Replicator replicator) {
+ System.out.println("close testRdbClose");
+ }
+ });
+ r.open();
+ assertEquals(10, acc.get());
+ }
+
+ @Test
+ public void testAofClose() throws IOException {
+ Replicator r = new RedisReplicator(
+ CloseTest.class.getClassLoader().getResourceAsStream("appendonly5.aof"), FileType.AOF,
+ Configuration.defaultSetting());
+ final AtomicInteger acc = new AtomicInteger(0);
+ r.addCommandListener(new CommandListener() {
+ @Override
+ public void handle(Replicator replicator, Command command) {
+ acc.incrementAndGet();
+ if (acc.get() == 30) {
+ try {
+ replicator.close();
+ } catch (IOException e) {
+ e.printStackTrace();
+ }
+ }
+ }
+ });
+ r.addCloseListener(new CloseListener() {
+ @Override
+ public void handle(Replicator replicator) {
+ System.out.println("close testAofClose");
+ }
+ });
+ r.open();
+ assertEquals(30, acc.get());
+ }
+
+ @Test
+ public void testMixClose1() throws IOException {
+ Replicator replicator = new RedisReplicator(
+ CloseTest.class.getClassLoader().getResourceAsStream("appendonly4.aof"), FileType.MIXED,
+ Configuration.defaultSetting());
+ final AtomicInteger acc = new AtomicInteger(0);
+ final AtomicInteger acc1 = new AtomicInteger(0);
+ replicator.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ acc.incrementAndGet();
+ if (acc.get() == 100) {
+ try {
+ replicator.close();
+ } catch (IOException e) {
+ e.printStackTrace();
+ }
+ }
+ }
+ });
+ replicator.addCommandListener(new CommandListener() {
+ @Override
+ public void handle(Replicator replicator, Command command) {
+ acc1.incrementAndGet();
+ }
+ });
+ replicator.addCloseListener(new CloseListener() {
+ @Override
+ public void handle(Replicator replicator) {
+ System.out.println("close testMixClose1");
+ }
+ });
+ replicator.open();
+ assertEquals(100, acc.get());
+ assertEquals(0, acc1.get());
+ }
+
+ @Test
+ public void testMixClose2() throws IOException {
+ Replicator replicator = new RedisReplicator(
+ CloseTest.class.getClassLoader().getResourceAsStream("appendonly4.aof"), FileType.MIXED,
+ Configuration.defaultSetting());
+ final AtomicInteger acc = new AtomicInteger(0);
+ final AtomicInteger acc1 = new AtomicInteger(0);
+ replicator.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ acc.incrementAndGet();
+ }
+ });
+ replicator.addCommandListener(new CommandListener() {
+ @Override
+ public void handle(Replicator replicator, Command command) {
+ acc1.incrementAndGet();
+ if (acc1.get() == 100) {
+ try {
+ replicator.close();
+ } catch (IOException e) {
+ e.printStackTrace();
+ }
+ }
+ }
+ });
+ replicator.addCloseListener(new CloseListener() {
+ @Override
+ public void handle(Replicator replicator) {
+ System.out.println("close testMixClose1");
+ }
+ });
+ replicator.open();
+ assertEquals(244653, acc.get());
+ assertEquals(100, acc1.get());
+ }
+}
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/IntegrationTestBase.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/IntegrationTestBase.java
new file mode 100644
index 00000000..219bd1c7
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/IntegrationTestBase.java
@@ -0,0 +1,188 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import org.apache.rocketmq.broker.BrokerController;
+import org.apache.rocketmq.common.BrokerConfig;
+import org.apache.rocketmq.common.namesrv.NamesrvConfig;
+import org.apache.rocketmq.namesrv.NamesrvController;
+import org.apache.rocketmq.remoting.netty.NettyClientConfig;
+import org.apache.rocketmq.remoting.netty.NettyServerConfig;
+import org.apache.rocketmq.store.config.MessageStoreConfig;
+import org.apache.rocketmq.test.util.MQAdmin;
+import org.apache.rocketmq.test.util.TestUtils;
+import org.junit.Assert;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.io.File;
+import java.util.ArrayList;
+import java.util.List;
+import java.util.Random;
+import java.util.UUID;
+import java.util.concurrent.atomic.AtomicInteger;
+
+public class IntegrationTestBase {
+ public static Logger logger = LoggerFactory.getLogger(IntegrationTestBase.class);
+
+ protected static final String SEP = File.separator;
+ protected static final String BROKER_NAME_PREFIX = "TestBrokerName_";
+ protected static final AtomicInteger BROKER_INDEX = new AtomicInteger(0);
+ protected static final List<File> TMPE_FILES = new ArrayList<>();
+ protected static final List<BrokerController> BROKER_CONTROLLERS = new ArrayList<>();
+ protected static final List<NamesrvController> NAMESRV_CONTROLLERS = new ArrayList<>();
+ protected static int topicCreateTime = 30 * 1000;
+ protected static final int COMMIT_LOG_SIZE = 1024 * 1024 * 256;
+ protected static final int INDEX_NUM = 1000;
+
+ protected static Random random = new Random();
+
+ static {
+
+ Runtime.getRuntime().addShutdownHook(new Thread() {
+ @Override public void run() {
+ try {
+ for (BrokerController brokerController : BROKER_CONTROLLERS) {
+ if (brokerController != null) {
+ brokerController.shutdown();
+ }
+ }
+
+ // should destroy message store, otherwise could not delete the temp files.
+ for (BrokerController brokerController : BROKER_CONTROLLERS) {
+ if (brokerController != null) {
+ brokerController.getMessageStore().destroy();
+ }
+ }
+
+ for (NamesrvController namesrvController : NAMESRV_CONTROLLERS) {
+ if (namesrvController != null) {
+ namesrvController.shutdown();
+ }
+ }
+ for (File file : TMPE_FILES) {
+ deleteFile(file);
+ }
+ } catch (Exception e){
+ logger.error("Shutdown error", e);
+ }
+ }
+ });
+
+ }
+
+ private static String createBaseDir() {
+ String baseDir = System.getProperty("user.home") + SEP + "unitteststore-" + UUID.randomUUID();
+ final File file = new File(baseDir);
+ if (file.exists()) {
+ logger.info(String.format("[%s] has already existed, please back up and remove it for integration tests", baseDir));
+ System.exit(1);
+ }
+ TMPE_FILES.add(file);
+ return baseDir;
+ }
+
+ public static NamesrvController createAndStartNamesrv() {
+ String baseDir = createBaseDir();
+ NamesrvConfig namesrvConfig = new NamesrvConfig();
+ NettyServerConfig nameServerNettyServerConfig = new NettyServerConfig();
+ namesrvConfig.setKvConfigPath(baseDir + SEP + "namesrv" + SEP + "kvConfig.json");
+ namesrvConfig.setConfigStorePath(baseDir + SEP + "namesrv" + SEP + "namesrv.properties");
+
+ nameServerNettyServerConfig.setListenPort(9000 + random.nextInt(1000));
+ NamesrvController namesrvController = new NamesrvController(namesrvConfig, nameServerNettyServerConfig);
+ try {
+ Assert.assertTrue(namesrvController.initialize());
+ logger.info("Name Server Start:{}", nameServerNettyServerConfig.getListenPort());
+ namesrvController.start();
+ } catch (Exception e) {
+ logger.info("Name Server start failed");
+ System.exit(1);
+ }
+ NAMESRV_CONTROLLERS.add(namesrvController);
+ return namesrvController;
+
+ }
+
+ public static BrokerController createAndStartBroker(String nsAddr) {
+ String baseDir = createBaseDir();
+ BrokerConfig brokerConfig = new BrokerConfig();
+ NettyServerConfig nettyServerConfig = new NettyServerConfig();
+ NettyClientConfig nettyClientConfig = new NettyClientConfig();
+ MessageStoreConfig storeConfig = new MessageStoreConfig();
+ brokerConfig.setBrokerName(BROKER_NAME_PREFIX + BROKER_INDEX.getAndIncrement());
+ brokerConfig.setBrokerIP1("127.0.0.1");
+ brokerConfig.setNamesrvAddr(nsAddr);
+ brokerConfig.setEnablePropertyFilter(true);
+ storeConfig.setStorePathRootDir(baseDir);
+ storeConfig.setStorePathCommitLog(baseDir + SEP + "commitlog");
+ storeConfig.setHaListenPort(8000 + random.nextInt(1000));
+ storeConfig.setMapedFileSizeCommitLog(COMMIT_LOG_SIZE);
+ storeConfig.setMaxIndexNum(INDEX_NUM);
+ storeConfig.setMaxHashSlotNum(INDEX_NUM * 4);
+ nettyServerConfig.setListenPort(10000 + random.nextInt(1000));
+ BrokerController brokerController = new BrokerController(brokerConfig, nettyServerConfig, nettyClientConfig, storeConfig);
+ try {
+ Assert.assertTrue(brokerController.initialize());
+ logger.info("Broker Start name:{} addr:{}", brokerConfig.getBrokerName(), brokerController.getBrokerAddr());
+ brokerController.start();
+ } catch (Exception e) {
+ logger.info("Broker start failed");
+ System.exit(1);
+ }
+ BROKER_CONTROLLERS.add(brokerController);
+ return brokerController;
+ }
+
+ public static boolean initTopic(String topic, String nsAddr, String clusterName) {
+ long startTime = System.currentTimeMillis();
+ boolean createResult;
+
+ while (true) {
+ createResult = MQAdmin.createTopic(nsAddr, clusterName, topic, 8);
+ if (createResult) {
+ break;
+ } else if (System.currentTimeMillis() - startTime > topicCreateTime) {
+ Assert.fail(String.format("topic[%s] is created failed after:%d ms", topic,
+ System.currentTimeMillis() - startTime));
+ break;
+ } else {
+ TestUtils.waitForMoment(500);
+ continue;
+ }
+ }
+
+ return createResult;
+ }
+
+ public static void deleteFile(File file) {
+ if (!file.exists()) {
+ return;
+ }
+ if (file.isFile()) {
+ file.delete();
+ } else if (file.isDirectory()) {
+ File[] files = file.listFiles();
+ for (File file1 : files) {
+ deleteFile(file1);
+ }
+ file.delete();
+ }
+ }
+
+}
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/RocketMQRedisReplicatorTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/RocketMQRedisReplicatorTest.java
new file mode 100644
index 00000000..1a277e3e
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/RocketMQRedisReplicatorTest.java
@@ -0,0 +1,103 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator;
+
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandListener;
+import org.apache.rocketmq.redis.replicator.conf.Configure;
+import org.apache.rocketmq.redis.replicator.conf.ReplicatorConstants;
+import org.apache.rocketmq.redis.replicator.producer.RocketMQProducer;
+import org.apache.rocketmq.redis.replicator.rdb.RdbListener;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.junit.Before;
+import org.junit.Test;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.net.URI;
+import java.net.URISyntaxException;
+import java.net.URL;
+import java.util.Properties;
+import java.util.concurrent.atomic.AtomicInteger;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class RocketMQRedisReplicatorTest extends BaseConf {
+
+ protected static final Logger LOGGER = LoggerFactory.getLogger(RocketMQRedisReplicatorTest.class);
+
+ private static Properties properties = new Properties();
+ private String topic = null;
+
+ @Before
+ public void setUp() throws URISyntaxException {
+ topic = initTopic();
+ URL url = RocketMQRedisReplicatorTest.class.getClassLoader().getResource("dumpV7.rdb");
+ URI uri = url.toURI();
+ URI redisURI = new URI("redis", uri.getRawAuthority(), uri.getRawPath(), uri.getRawQuery(), uri.getRawFragment());
+ properties.setProperty("redis.uri", redisURI.toString());
+ properties.setProperty("rocketmq.nameserver.address", nsAddr);
+ properties.setProperty("rocketmq.producer.groupname", "redis_replicator_producer_group_name");
+ properties.setProperty("rocketmq.producer.instancename", "redis_replicator_producer_instance_name");
+ properties.setProperty("rocketmq.data.topic", topic);
+ }
+
+ @Test
+ public void open() throws Exception {
+ Configure configure = new Configure(properties);
+ Replicator replicator = new RocketMQRedisReplicator(configure);
+ final RocketMQProducer producer = new RocketMQProducer(configure);
+ final AtomicInteger test = new AtomicInteger();
+ replicator.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ try {
+ boolean success = producer.sendKeyValuePair(kv);
+ if (!success) {
+ LOGGER.error("Fail to send KeyValuePair[key={}]", kv.getKey());
+ } else {
+ test.incrementAndGet();
+ }
+ } catch (Exception e) {
+ LOGGER.error(String.format("Fail to send KeyValuePair[key=%s]", kv.getKey()), e);
+ }
+ }
+ });
+
+ replicator.addCommandListener(new CommandListener() {
+ @Override
+ public void handle(Replicator replicator, Command command) {
+ try {
+ boolean success = producer.sendCommand(command);
+ if (!success) {
+ LOGGER.error("Fail to send command[{}]", command);
+ } else {
+ test.incrementAndGet();
+ }
+ } catch (Exception e) {
+ LOGGER.error(String.format("Fail to send command[%s]", command), e);
+ }
+ }
+ });
+
+ replicator.open();
+ assertEquals(19, test.get());
+
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/ReplyParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/ReplyParserTest.java
new file mode 100644
index 00000000..241f7822
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/ReplyParserTest.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd;
+
+import java.io.ByteArrayInputStream;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+
+public class ReplyParserTest {
+
+ @Test
+ public void testParse() throws Exception {
+ {
+ RedisInputStream in = new RedisInputStream(new ByteArrayInputStream(":56789\r\n".getBytes()));
+ ReplyParser replyParser = new ReplyParser(in);
+ Long r = (Long) replyParser.parse(new BulkReplyHandler.SimpleBulkReplyHandler());
+ assertEquals(56789L, r.longValue());
+ }
+
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/AbstractParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/AbstractParserTest.java
new file mode 100644
index 00000000..e7cdb697
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/AbstractParserTest.java
@@ -0,0 +1,32 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+public class AbstractParserTest {
+
+ protected Object[] toObjectArray(Object[] raw) {
+ Object[] r = new Object[raw.length];
+ for (int i = 0; i < r.length; i++) {
+ if (raw[i] instanceof String)
+ r[i] = ((String) raw[i]).getBytes();
+ else
+ r[i] = raw[i];
+ }
+ return r;
+ }
+}
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/BRPopLPushParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/BRPopLPushParserTest.java
new file mode 100644
index 00000000..9bedab1c
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/BRPopLPushParserTest.java
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.BRPopLPushCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class BRPopLPushParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ BRPopLPushParser parser = new BRPopLPushParser();
+ BRPopLPushCommand cmd = parser.parse(toObjectArray(new Object[] {"brpoplpush", "source", "target", "100"}));
+ assertEquals("source", cmd.getSource());
+ assertEquals("target", cmd.getDestination());
+ assertEquals(100, cmd.getTimeout());
+ System.out.println(cmd);
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitFieldParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitFieldParserTest.java
new file mode 100644
index 00000000..e1cc33f5
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitFieldParserTest.java
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.BitFieldCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class BitFieldParserTest extends AbstractParserTest {
+
+ @Test
+ public void testParse() throws Exception {
+ {
+ BitFieldParser parser = new BitFieldParser();
+ BitFieldCommand command = parser.parse(
+ toObjectArray(new Object[] {"bitfield", "mykey", "overflow", "sat"}));
+ assertEquals("mykey", command.getKey());
+ assertEquals(0, command.getStatements().size());
+ assertEquals(1, command.getOverFlows().size());
+ System.out.println(command);
+ }
+
+ //
+ {
+ BitFieldParser parser = new BitFieldParser();
+ BitFieldCommand command = parser.parse(
+ toObjectArray(new Object[] {"bitfield", "mykey", "incrby", "i5", "100", "1", "overflow", "sat"}));
+ assertEquals("mykey", command.getKey());
+ assertEquals(1, command.getStatements().size());
+ assertEquals(1, command.getOverFlows().size());
+ System.out.println(command);
+ }
+
+ //
+ {
+ BitFieldParser parser = new BitFieldParser();
+ BitFieldCommand command = parser.parse(
+ toObjectArray(new Object[] {"bitfield", "mykey", "incrby", "i5", "100", "1", "set", "i8", "#0", "100", "overflow", "sat"}));
+ assertEquals("mykey", command.getKey());
+ assertEquals(2, command.getStatements().size());
+ assertEquals(1, command.getOverFlows().size());
+ System.out.println(command);
+ }
+
+ //
+ {
+ BitFieldParser parser = new BitFieldParser();
+ BitFieldCommand command = parser.parse(
+ toObjectArray(new Object[] {"bitfield", "mykey", "incrby", "i5", "100", "1", "set", "i8", "#0", "100", "overflow", "fail"}));
+ assertEquals("mykey", command.getKey());
+ assertEquals(2, command.getStatements().size());
+ assertEquals(1, command.getOverFlows().size());
+ System.out.println(command);
+ }
+
+ {
+ BitFieldParser parser = new BitFieldParser();
+ BitFieldCommand command = parser.parse(
+ toObjectArray(new Object[] {"bitfield", "mykey", "incrby", "i5", "100", "1", "set", "i8", "#0", "100", "overflow", "wrap", "incrby", "i5", "100", "1", "set", "i8", "#0", "100", "overflow", "wrap", "incrby", "i5", "100", "1", "set", "i8", "#0", "100", "overflow", "fail"}));
+ assertEquals("mykey", command.getKey());
+ assertEquals(2, command.getStatements().size());
+ assertEquals(3, command.getOverFlows().size());
+ assertEquals(2, command.getOverFlows().get(0).getStatements().size());
+ System.out.println(command);
+ }
+
+ {
+ BitFieldParser parser = new BitFieldParser();
+ BitFieldCommand command = parser.parse(
+ toObjectArray(new Object[] {"bitfield", "mykey", "incrby", "i5", "100", "1", "get", "i8", "10", "overflow", "wrap", "incrby", "i5", "100", "1", "set", "i8", "#0", "100", "overflow", "wrap", "incrby", "i5", "100", "1", "set", "i8", "#0", "100", "overflow", "fail"}));
+ assertEquals("mykey", command.getKey());
+ assertEquals(2, command.getStatements().size());
+ assertEquals(3, command.getOverFlows().size());
+ assertEquals(2, command.getOverFlows().get(0).getStatements().size());
+ System.out.println(command);
+ }
+
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitOpParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitOpParserTest.java
new file mode 100644
index 00000000..2716f1a3
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/BitOpParserTest.java
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.Op;
+import org.apache.rocketmq.redis.replicator.cmd.impl.BitOpCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class BitOpParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ BitOpParser parser = new BitOpParser();
+ BitOpCommand cmd = parser.parse(toObjectArray("bitop and des key1 key2".split(" ")));
+ assertEquals("des", cmd.getDestkey());
+ assertEquals(Op.AND, cmd.getOp());
+ assertEquals("key1", cmd.getKeys()[0]);
+ assertEquals("key2", cmd.getKeys()[1]);
+ System.out.println(cmd);
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/DecrByParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/DecrByParserTest.java
new file mode 100644
index 00000000..04961379
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/DecrByParserTest.java
@@ -0,0 +1,82 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.DecrByCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.DecrCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.HIncrByCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.IncrByCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.IncrCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZIncrByCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class DecrByParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ {
+ DecrByParser parser = new DecrByParser();
+ DecrByCommand cmd = parser.parse(toObjectArray("decrby key 5".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(5, cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ IncrByParser parser = new IncrByParser();
+ IncrByCommand cmd = parser.parse(toObjectArray("incrby key 5".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(5, cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ DecrParser parser = new DecrParser();
+ DecrCommand cmd = parser.parse(toObjectArray("decr key".split(" ")));
+ assertEquals("key", cmd.getKey());
+ System.out.println(cmd);
+ }
+
+ {
+ IncrParser parser = new IncrParser();
+ IncrCommand cmd = parser.parse(toObjectArray("incr key".split(" ")));
+ assertEquals("key", cmd.getKey());
+ System.out.println(cmd);
+ }
+
+ {
+ ZIncrByParser parser = new ZIncrByParser();
+ ZIncrByCommand cmd = parser.parse(toObjectArray("zincrby key 5 mem".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(5, cmd.getIncrement(), 0);
+ assertEquals("mem", cmd.getMember());
+ System.out.println(cmd);
+ }
+
+ {
+ HIncrByParser parser = new HIncrByParser();
+ HIncrByCommand cmd = parser.parse(toObjectArray("hincrby key mem 5".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(5, cmd.getIncrement());
+ assertEquals("mem", cmd.getField());
+ System.out.println(cmd);
+ }
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/DelParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/DelParserTest.java
new file mode 100644
index 00000000..cfcba404
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/DelParserTest.java
@@ -0,0 +1,83 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZRemCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.DelCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.HDelCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LRemCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SRemCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.UnLinkCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class DelParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ {
+ DelParser parser = new DelParser();
+ DelCommand cmd = parser.parse(toObjectArray("del key1 key2".split(" ")));
+ assertEquals("key1", cmd.getKeys()[0]);
+ assertEquals("key2", cmd.getKeys()[1]);
+ System.out.println(cmd);
+ UnLinkParser parser1 = new UnLinkParser();
+ UnLinkCommand cmd1 = parser1.parse(toObjectArray("unlink key1 key2".split(" ")));
+ assertEquals("key1", cmd1.getKeys()[0]);
+ assertEquals("key2", cmd1.getKeys()[1]);
+ System.out.println(cmd1);
+ }
+
+ {
+ HDelParser parser = new HDelParser();
+ HDelCommand cmd = parser.parse(toObjectArray("hdel key f1 f2".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("f1", cmd.getFields()[0]);
+ assertEquals("f2", cmd.getFields()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ LRemParser parser = new LRemParser();
+ LRemCommand cmd = parser.parse(toObjectArray("lrem key 1 val".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("val", cmd.getValue());
+ assertEquals(1, cmd.getIndex());
+ System.out.println(cmd);
+ }
+
+ {
+ SRemParser parser = new SRemParser();
+ SRemCommand cmd = parser.parse(toObjectArray("srem key m1 m2".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("m1", cmd.getMembers()[0]);
+ assertEquals("m2", cmd.getMembers()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ ZRemParser parser = new ZRemParser();
+ ZRemCommand cmd = parser.parse(toObjectArray("zrem key m1 m2".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("m1", cmd.getMembers()[0]);
+ assertEquals("m2", cmd.getMembers()[1]);
+ System.out.println(cmd);
+ }
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExpireParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExpireParserTest.java
new file mode 100644
index 00000000..dffc8596
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/ExpireParserTest.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExpireCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class ExpireParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ ExpireParser parser = new ExpireParser();
+ ExpireCommand cmd = parser.parse(toObjectArray("expire key 100".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(100, cmd.getEx());
+ System.out.println(cmd);
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/FlushAllParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/FlushAllParserTest.java
new file mode 100644
index 00000000..532b7b41
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/FlushAllParserTest.java
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.FlushDBCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.FlushAllCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class FlushAllParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ {
+ FlushAllParser parser = new FlushAllParser();
+ FlushAllCommand cmd = parser.parse(toObjectArray("flushall".split(" ")));
+ assertEquals(null, cmd.isAsync());
+
+ parser = new FlushAllParser();
+ cmd = parser.parse(toObjectArray("flushall async".split(" ")));
+ assertEquals(Boolean.TRUE, cmd.isAsync());
+ System.out.println(cmd);
+ }
+
+ {
+ FlushDBParser parser = new FlushDBParser();
+ FlushDBCommand cmd = parser.parse(toObjectArray("flushdb".split(" ")));
+ assertEquals(null, cmd.isAsync());
+
+ parser = new FlushDBParser();
+ cmd = parser.parse(toObjectArray("flushdb async".split(" ")));
+ assertEquals(Boolean.TRUE, cmd.isAsync());
+ System.out.println(cmd);
+ }
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/GeoAddParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/GeoAddParserTest.java
new file mode 100644
index 00000000..c50ef909
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/GeoAddParserTest.java
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.GeoAddCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class GeoAddParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ GeoAddParser parser = new GeoAddParser();
+ GeoAddCommand cmd = parser.parse(toObjectArray("GEOADD Sicily 13.361389 38.115556 Palermo 15.087269 37.502669 Catania".split(" ")));
+ assertEquals("Sicily", cmd.getKey());
+ assertEquals(13.361389, cmd.getGeos()[0].getLongitude(), 0.000001);
+ assertEquals(38.115556, cmd.getGeos()[0].getLatitude(), 0.000001);
+ assertEquals("Palermo", cmd.getGeos()[0].getMember());
+
+ assertEquals(15.087269, cmd.getGeos()[1].getLongitude(), 0.000001);
+ assertEquals(37.502669, cmd.getGeos()[1].getLatitude(), 0.000001);
+ assertEquals("Catania", cmd.getGeos()[1].getMember());
+ System.out.println(cmd);
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/HMSetParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/HMSetParserTest.java
new file mode 100644
index 00000000..d9710082
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/HMSetParserTest.java
@@ -0,0 +1,43 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.HMSetCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class HMSetParserTest extends AbstractParserTest {
+
+ @Test
+ public void testParse() throws Exception {
+ {
+ HMSetParser hmSetParser = new HMSetParser();
+ HMSetCommand command = hmSetParser.parse(toObjectArray(new Object[] {"hmset", "key", "field", "value"}));
+ assertEquals("key", command.getKey());
+ assertEquals(1, command.getFields().size());
+ }
+
+ {
+ HMSetParser hmSetParser = new HMSetParser();
+ HMSetCommand command = hmSetParser.parse(toObjectArray(new Object[] {"hmset", "key", "field", "value", "field1", "value1"}));
+ assertEquals("key", command.getKey());
+ assertEquals(2, command.getFields().size());
+ }
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/LInsertParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/LInsertParserTest.java
new file mode 100644
index 00000000..fb1d77d3
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/LInsertParserTest.java
@@ -0,0 +1,47 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import junit.framework.TestCase;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LInsertCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LInsertType;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class LInsertParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ LInsertParser parser = new LInsertParser();
+ LInsertCommand cmd = parser.parse(toObjectArray("LINSERT mylist BEFORE World There".split(" ")));
+ assertEquals("mylist", cmd.getKey());
+ TestCase.assertEquals(LInsertType.BEFORE, cmd.getlInsertType());
+ assertEquals("World", cmd.getPivot());
+ assertEquals("There", cmd.getValue());
+ System.out.println(cmd);
+
+ cmd = parser.parse(toObjectArray("LINSERT mylist AFTER World There".split(" ")));
+ assertEquals("mylist", cmd.getKey());
+ assertEquals(LInsertType.AFTER, cmd.getlInsertType());
+ assertEquals("World", cmd.getPivot());
+ assertEquals("There", cmd.getValue());
+
+ System.out.println(cmd);
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/LTrimParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/LTrimParserTest.java
new file mode 100644
index 00000000..03e9b5ff
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/LTrimParserTest.java
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.LTrimCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class LTrimParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ LTrimParser parser = new LTrimParser();
+ LTrimCommand cmd = parser.parse(toObjectArray("LTRIM mylist 0 99".split(" ")));
+ assertEquals("mylist", cmd.getKey());
+ assertEquals(0L, cmd.getStart());
+ assertEquals(99L, cmd.getStop());
+ System.out.println(cmd);
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/MSetNxParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/MSetNxParserTest.java
new file mode 100644
index 00000000..bb031325
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/MSetNxParserTest.java
@@ -0,0 +1,93 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.PFAddCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PFCountCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PFMergeCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PersistCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.MSetCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.MSetNxCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PSetExCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class MSetNxParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ {
+ MSetNxParser parser = new MSetNxParser();
+ MSetNxCommand cmd = parser.parse(toObjectArray("msetnx k1 v1 k2 v2".split(" ")));
+ assertEquals("v1", cmd.getKv().get("k1"));
+ assertEquals("v2", cmd.getKv().get("k2"));
+ System.out.println(cmd);
+ }
+
+ {
+ MSetParser parser = new MSetParser();
+ MSetCommand cmd = parser.parse(toObjectArray("mset k1 v1 k2 v2".split(" ")));
+ assertEquals("v1", cmd.getKv().get("k1"));
+ assertEquals("v2", cmd.getKv().get("k2"));
+ System.out.println(cmd);
+ }
+
+ {
+ PersistParser parser = new PersistParser();
+ PersistCommand cmd = parser.parse(toObjectArray("persist k1".split(" ")));
+ assertEquals("k1", cmd.getKey());
+ System.out.println(cmd);
+ }
+
+ {
+ PFAddParser parser = new PFAddParser();
+ PFAddCommand cmd = parser.parse(toObjectArray("pfadd k1 e1 e2".split(" ")));
+ assertEquals("k1", cmd.getKey());
+ assertEquals("e1", cmd.getElements()[0]);
+ assertEquals("e2", cmd.getElements()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ PFCountParser parser = new PFCountParser();
+ PFCountCommand cmd = parser.parse(toObjectArray("pfcount k1 k2".split(" ")));
+ assertEquals("k1", cmd.getKeys()[0]);
+ assertEquals("k2", cmd.getKeys()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ PFMergeParser parser = new PFMergeParser();
+ PFMergeCommand cmd = parser.parse(toObjectArray("pfmerge des k1 k2".split(" ")));
+ assertEquals("des", cmd.getDestkey());
+ assertEquals("k1", cmd.getSourcekeys()[0]);
+ assertEquals("k2", cmd.getSourcekeys()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ PSetExParser parser = new PSetExParser();
+ PSetExCommand cmd = parser.parse(toObjectArray("psetex key 5 val".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(5, cmd.getEx());
+ assertEquals("val", cmd.getValue());
+ System.out.println(cmd);
+ }
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/PingParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/PingParserTest.java
new file mode 100644
index 00000000..2f14cef3
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/PingParserTest.java
@@ -0,0 +1,301 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import junit.framework.TestCase;
+import org.apache.rocketmq.redis.replicator.cmd.impl.AggregateType;
+import org.apache.rocketmq.redis.replicator.cmd.impl.AppendCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.EvalCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExpireAtCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExpireCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.GetSetCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LSetCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.MoveCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PExpireAtCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PExpireCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PSetExCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.PingCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RenameCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RenameNxCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SAddCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SDiffStoreCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SInterStoreCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SUnionStoreCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ScriptFlushCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SelectCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetBitCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetNxCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZInterStoreCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZUnionStoreCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.HSetCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.HSetNxCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RestoreCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ScriptLoadCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetRangeCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class PingParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ {
+ PingParser parser = new PingParser();
+ PingCommand cmd = parser.parse(toObjectArray("ping msg".split(" ")));
+ assertEquals("msg", cmd.getMessage());
+ System.out.println(cmd);
+ }
+
+ {
+ MoveParser parser = new MoveParser();
+ MoveCommand cmd = parser.parse(toObjectArray("move key 2".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(2, cmd.getDb());
+ System.out.println(cmd);
+ }
+
+ {
+ SelectParser parser = new SelectParser();
+ SelectCommand cmd = parser.parse(toObjectArray("select 2".split(" ")));
+ assertEquals(2, cmd.getIndex());
+ System.out.println(cmd);
+ }
+
+ {
+ RenameParser parser = new RenameParser();
+ RenameCommand cmd = parser.parse(toObjectArray("rename key key1".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("key1", cmd.getNewKey());
+ System.out.println(cmd);
+ }
+
+ {
+ RenameNxParser parser = new RenameNxParser();
+ RenameNxCommand cmd = parser.parse(toObjectArray("renamenx key key1".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("key1", cmd.getNewKey());
+ System.out.println(cmd);
+ }
+
+ {
+ AppendParser parser = new AppendParser();
+ AppendCommand cmd = parser.parse(toObjectArray("append key val".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("val", cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ SetBitParser parser = new SetBitParser();
+ SetBitCommand cmd = parser.parse(toObjectArray("setbit key 10 0".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(10, cmd.getOffset());
+ assertEquals(0, cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ SetRangeParser parser = new SetRangeParser();
+ SetRangeCommand cmd = parser.parse(toObjectArray("setrange key 10 val".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(10, cmd.getIndex());
+ assertEquals("val", cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ GetSetParser parser = new GetSetParser();
+ GetSetCommand cmd = parser.parse(toObjectArray("getset key val".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("val", cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ HSetNxParser parser = new HSetNxParser();
+ HSetNxCommand cmd = parser.parse(toObjectArray("hsetnx key fie val".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("fie", cmd.getField());
+ assertEquals("val", cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ HSetParser parser = new HSetParser();
+ HSetCommand cmd = parser.parse(toObjectArray("hset key fie val".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("fie", cmd.getField());
+ assertEquals("val", cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ LSetParser parser = new LSetParser();
+ LSetCommand cmd = parser.parse(toObjectArray("lset key 1 val".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(1, cmd.getIndex());
+ assertEquals("val", cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ PSetExParser parser = new PSetExParser();
+ PSetExCommand cmd = parser.parse(toObjectArray("pset key 1 val".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(1, cmd.getEx());
+ assertEquals("val", cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ SAddParser parser = new SAddParser();
+ SAddCommand cmd = parser.parse(toObjectArray("sadd key v1 v2".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("v1", cmd.getMembers()[0]);
+ assertEquals("v2", cmd.getMembers()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ SetNxParser parser = new SetNxParser();
+ SetNxCommand cmd = parser.parse(toObjectArray("setnx key v1".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("v1", cmd.getValue());
+ System.out.println(cmd);
+ }
+
+ {
+ ExpireAtParser parser = new ExpireAtParser();
+ ExpireAtCommand cmd = parser.parse(toObjectArray("expireat key 5".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(5, cmd.getEx());
+ System.out.println(cmd);
+ }
+
+ {
+ ExpireParser parser = new ExpireParser();
+ ExpireCommand cmd = parser.parse(toObjectArray("expire key 5".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(5, cmd.getEx());
+ System.out.println(cmd);
+ }
+
+ {
+ PExpireAtParser parser = new PExpireAtParser();
+ PExpireAtCommand cmd = parser.parse(toObjectArray("pexpireat key 5".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(5, cmd.getEx());
+ System.out.println(cmd);
+ }
+
+ {
+ PExpireParser parser = new PExpireParser();
+ PExpireCommand cmd = parser.parse(toObjectArray("pexpire key 5".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(5, cmd.getEx());
+ System.out.println(cmd);
+ }
+
+ {
+ SDiffStoreParser parser = new SDiffStoreParser();
+ SDiffStoreCommand cmd = parser.parse(toObjectArray("sdiffstore des k1 k2".split(" ")));
+ assertEquals("des", cmd.getDestination());
+ assertEquals("k1", cmd.getKeys()[0]);
+ assertEquals("k2", cmd.getKeys()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ SInterStoreParser parser = new SInterStoreParser();
+ SInterStoreCommand cmd = parser.parse(toObjectArray("sinterstore des k1 k2".split(" ")));
+ assertEquals("des", cmd.getDestination());
+ assertEquals("k1", cmd.getKeys()[0]);
+ assertEquals("k2", cmd.getKeys()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ SUnionStoreParser parser = new SUnionStoreParser();
+ SUnionStoreCommand cmd = parser.parse(toObjectArray("sunionstore des k1 k2".split(" ")));
+ assertEquals("des", cmd.getDestination());
+ assertEquals("k1", cmd.getKeys()[0]);
+ assertEquals("k2", cmd.getKeys()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ ZInterStoreParser parser = new ZInterStoreParser();
+ ZInterStoreCommand cmd = parser.parse(toObjectArray("zinterstore des 2 k1 k2 WEIGHTS 2 3 AGGREGATE sum".split(" ")));
+ assertEquals("des", cmd.getDestination());
+ assertEquals(2, cmd.getNumkeys());
+ assertEquals("k1", cmd.getKeys()[0]);
+ assertEquals("k2", cmd.getKeys()[1]);
+ assertEquals(2, cmd.getWeights()[0], 0);
+ assertEquals(3, cmd.getWeights()[1], 0);
+ TestCase.assertEquals(AggregateType.SUM, cmd.getAggregateType());
+ System.out.println(cmd);
+ }
+
+ {
+ ZUnionStoreParser parser = new ZUnionStoreParser();
+ ZUnionStoreCommand cmd = parser.parse(toObjectArray("zunionstore des 2 k1 k2 WEIGHTS 2 3 AGGREGATE min".split(" ")));
+ assertEquals("des", cmd.getDestination());
+ assertEquals(2, cmd.getNumkeys());
+ assertEquals("k1", cmd.getKeys()[0]);
+ assertEquals("k2", cmd.getKeys()[1]);
+ assertEquals(2, cmd.getWeights()[0], 0);
+ assertEquals(3, cmd.getWeights()[1], 0);
+ assertEquals(AggregateType.MIN, cmd.getAggregateType());
+ System.out.println(cmd);
+ }
+
+ {
+ EvalParser parser = new EvalParser();
+ EvalCommand cmd = parser.parse(toObjectArray(new Object[] {"eval", "return redis.call('set',KEYS[1],'bar')", "1", "foo"}));
+ assertEquals("return redis.call('set',KEYS[1],'bar')", cmd.getScript());
+ assertEquals(1, cmd.getNumkeys());
+ assertEquals("foo", cmd.getKeys()[0]);
+ System.out.println(cmd);
+ }
+
+ {
+ ScriptParser parser = new ScriptParser();
+ ScriptLoadCommand cmd = (ScriptLoadCommand) parser.parse(toObjectArray(new Object[] {"script", "load", "return redis.call('set',KEYS[1],'bar')"}));
+ assertEquals("return redis.call('set',KEYS[1],'bar')", cmd.getScript());
+ System.out.println(cmd);
+ }
+
+ {
+ ScriptParser parser = new ScriptParser();
+ ScriptFlushCommand cmd = (ScriptFlushCommand) parser.parse(toObjectArray(new Object[] {"script", "flush"}));
+ System.out.println(cmd);
+ }
+
+ {
+ RestoreParser parser = new RestoreParser();
+ RestoreCommand cmd = parser.parse(toObjectArray(new Object[] {"restore", "mykey", "0", "\\n\\x17\\x17\\x00\\x00\\x00\\x12\\x00\\x00\\x00\\x03\\x00\\x00\\xc0\\x01\\x00\\x04\\xc0\\x02\\x00\\x04\\xc0\\x03\\x00\\xff\\x04\\x00u#<\\xc0;.\\xe9\\xdd"}));
+ assertEquals("\\n\\x17\\x17\\x00\\x00\\x00\\x12\\x00\\x00\\x00\\x03\\x00\\x00\\xc0\\x01\\x00\\x04\\xc0\\x02\\x00\\x04\\xc0\\x03\\x00\\xff\\x04\\x00u#<\\xc0;.\\xe9\\xdd", cmd.getSerializedValue());
+ assertEquals("mykey", cmd.getKey());
+ assertEquals(0L, cmd.getTtl());
+ assertEquals(null, cmd.getReplace());
+ System.out.println(cmd);
+ }
+
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/PublishParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/PublishParserTest.java
new file mode 100644
index 00000000..2d21f285
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/PublishParserTest.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.PublishCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class PublishParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ PublishParser parser = new PublishParser();
+ PublishCommand cmd = parser.parse(toObjectArray("publish channel msg".split(" ")));
+ assertEquals("channel", cmd.getChannel());
+ assertEquals("msg", cmd.getMessage());
+ System.out.println(cmd);
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPopLPushParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPopLPushParserTest.java
new file mode 100644
index 00000000..2e7bf6c4
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPopLPushParserTest.java
@@ -0,0 +1,35 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.RPopLPushCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class RPopLPushParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ RPopLPushParser parser = new RPopLPushParser();
+ RPopLPushCommand cmd = parser.parse(toObjectArray("RPOPLPUSH mylist myotherlist".split(" ")));
+ assertEquals("mylist", cmd.getSource());
+ assertEquals("myotherlist", cmd.getDestination());
+ System.out.println(cmd);
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPushParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPushParserTest.java
new file mode 100644
index 00000000..f470afe2
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/RPushParserTest.java
@@ -0,0 +1,84 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.LPopCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LPushCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RPopCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RPushCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.RPushXCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.LPushXCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class RPushParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ {
+ RPushParser parser = new RPushParser();
+ RPushCommand cmd = parser.parse(toObjectArray("rpush key v1 v2".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("v1", cmd.getValues()[0]);
+ assertEquals("v2", cmd.getValues()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ RPushXParser parser = new RPushXParser();
+ RPushXCommand cmd = parser.parse(toObjectArray("rpushx key v1 v2".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("v1", cmd.getValues()[0]);
+ assertEquals("v2", cmd.getValues()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ LPushParser parser = new LPushParser();
+ LPushCommand cmd = parser.parse(toObjectArray("lpush key v1 v2".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("v1", cmd.getValues()[0]);
+ assertEquals("v2", cmd.getValues()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ LPushXParser parser = new LPushXParser();
+ LPushXCommand cmd = parser.parse(toObjectArray("lpushx key v1 v2".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals("v1", cmd.getValues()[0]);
+ assertEquals("v2", cmd.getValues()[1]);
+ System.out.println(cmd);
+ }
+
+ {
+ LPopParser parser = new LPopParser();
+ LPopCommand cmd = parser.parse(toObjectArray("lpop key".split(" ")));
+ assertEquals("key", cmd.getKey());
+ System.out.println(cmd);
+ }
+
+ {
+ RPopParser parser = new RPopParser();
+ RPopCommand cmd = parser.parse(toObjectArray("rpop key".split(" ")));
+ assertEquals("key", cmd.getKey());
+ System.out.println(cmd);
+ }
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SMoveParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SMoveParserTest.java
new file mode 100644
index 00000000..ece34324
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SMoveParserTest.java
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.SMoveCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SwapDBCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class SMoveParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ SMoveParser parser = new SMoveParser();
+ SMoveCommand cmd = parser.parse(toObjectArray("smove src des field".split(" ")));
+ assertEquals("src", cmd.getSource());
+ assertEquals("des", cmd.getDestination());
+ assertEquals("field", cmd.getMember());
+ System.out.println(cmd);
+
+ {
+ SwapDBParser parser1 = new SwapDBParser();
+ SwapDBCommand cmd1 = parser1.parse(toObjectArray("swapdb 0 1".split(" ")));
+ assertEquals(0, cmd1.getSource());
+ assertEquals(1, cmd1.getTarget());
+ System.out.println(cmd1);
+ }
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetExParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetExParserTest.java
new file mode 100644
index 00000000..06b77392
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetExParserTest.java
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetExCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class SetExParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ SetExParser parser = new SetExParser();
+ SetExCommand cmd = parser.parse(toObjectArray("setex key 100 value".split(" ")));
+ assertEquals("key", cmd.getKey());
+ assertEquals(100, cmd.getEx());
+ assertEquals("value", cmd.getValue());
+ System.out.println(cmd);
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetParserTest.java
new file mode 100644
index 00000000..86b74972
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SetParserTest.java
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExistType;
+import org.apache.rocketmq.redis.replicator.cmd.impl.SetCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class SetParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ SetParser parser = new SetParser();
+ SetCommand cmd = parser.parse(toObjectArray("set a b ex 15 nx".split(" ")));
+ assertEquals("a", cmd.getKey());
+ assertEquals("b", cmd.getValue());
+ assertEquals(15, cmd.getEx().intValue());
+ assertEquals(ExistType.NX, cmd.getExistType());
+ System.out.println(cmd);
+
+ cmd = parser.parse(toObjectArray("set a b px 123 xx".split(" ")));
+ assertEquals("a", cmd.getKey());
+ assertEquals("b", cmd.getValue());
+ assertEquals(123L, cmd.getPx().longValue());
+ assertEquals(ExistType.XX, cmd.getExistType());
+ System.out.println(cmd);
+
+ cmd = parser.parse(toObjectArray("set a b xx px 123".split(" ")));
+ assertEquals("a", cmd.getKey());
+ assertEquals("b", cmd.getValue());
+ assertEquals(123L, cmd.getPx().longValue());
+ assertEquals(ExistType.XX, cmd.getExistType());
+ System.out.println(cmd);
+
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SortParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SortParserTest.java
new file mode 100644
index 00000000..79f3301e
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/SortParserTest.java
@@ -0,0 +1,103 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.SortCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+import static org.apache.rocketmq.redis.replicator.cmd.impl.OrderType.DESC;
+import static org.apache.rocketmq.redis.replicator.cmd.impl.OrderType.NONE;
+
+public class SortParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+
+ {
+ SortParser parser = new SortParser();
+ SortCommand cmd = parser.parse(toObjectArray("SORT mylist".split(" ")));
+ assertEquals("mylist", cmd.getKey());
+ assertEquals(NONE, cmd.getOrder());
+ assertEquals(0, cmd.getGetPatterns().length);
+ assertEquals(null, cmd.getAlpha());
+ System.out.println(cmd);
+ }
+
+ {
+ SortParser parser = new SortParser();
+ SortCommand cmd = parser.parse(toObjectArray("SORT mylist DESC".split(" ")));
+ assertEquals("mylist", cmd.getKey());
+ assertEquals(DESC, cmd.getOrder());
+ assertEquals(0, cmd.getGetPatterns().length);
+ assertEquals(null, cmd.getAlpha());
+ System.out.println(cmd);
+ }
+
+ {
+ SortParser parser = new SortParser();
+ SortCommand cmd = parser.parse(toObjectArray("SORT mylist ALPHA DESC".split(" ")));
+ assertEquals("mylist", cmd.getKey());
+ assertEquals(DESC, cmd.getOrder());
+ assertEquals(0, cmd.getGetPatterns().length);
+ assertEquals(true, cmd.getAlpha().booleanValue());
+ System.out.println(cmd);
+ }
+
+ {
+ SortParser parser = new SortParser();
+ SortCommand cmd = parser.parse(toObjectArray("SORT mylist ALPHA DESC limit 0 10".split(" ")));
+ assertEquals("mylist", cmd.getKey());
+ assertEquals(DESC, cmd.getOrder());
+ assertEquals(0, cmd.getGetPatterns().length);
+ assertEquals(true, cmd.getAlpha().booleanValue());
+ assertEquals(0L, cmd.getLimit().getOffset());
+ assertEquals(10L, cmd.getLimit().getCount());
+ System.out.println(cmd);
+ }
+
+ {
+ SortParser parser = new SortParser();
+ SortCommand cmd = parser.parse(toObjectArray("sort mylist alpha desc limit 0 10 by weight_*".split(" ")));
+ assertEquals("mylist", cmd.getKey());
+ assertEquals(DESC, cmd.getOrder());
+ assertEquals(0, cmd.getGetPatterns().length);
+ assertEquals(true, cmd.getAlpha().booleanValue());
+ assertEquals(0L, cmd.getLimit().getOffset());
+ assertEquals(10L, cmd.getLimit().getCount());
+ assertEquals("weight_*", cmd.getByPattern());
+ System.out.println(cmd);
+ }
+
+ {
+ SortParser parser = new SortParser();
+ SortCommand cmd = parser.parse(toObjectArray("sort mylist alpha desc limit 0 10 by weight_* get object_* get #".split(" ")));
+ assertEquals("mylist", cmd.getKey());
+ assertEquals(DESC, cmd.getOrder());
+ assertEquals(true, cmd.getAlpha().booleanValue());
+ assertEquals(0L, cmd.getLimit().getOffset());
+ assertEquals(10L, cmd.getLimit().getCount());
+ assertEquals("weight_*", cmd.getByPattern());
+ assertEquals(2, cmd.getGetPatterns().length);
+ assertEquals("object_*", cmd.getGetPatterns()[0]);
+ assertEquals("#", cmd.getGetPatterns()[1]);
+ System.out.println(cmd);
+ }
+
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZAddParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZAddParserTest.java
new file mode 100644
index 00000000..943df106
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/cmd/parser/ZAddParserTest.java
@@ -0,0 +1,98 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.cmd.parser;
+
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZRemRangeByLexCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZRemRangeByRankCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ExistType;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZAddCommand;
+import org.apache.rocketmq.redis.replicator.cmd.impl.ZRemRangeByScoreCommand;
+import org.junit.Test;
+
+import static junit.framework.TestCase.assertEquals;
+
+public class ZAddParserTest extends AbstractParserTest {
+ @Test
+ public void parse() throws Exception {
+ ZAddParser parser = new ZAddParser();
+ ZAddCommand cmd = parser.parse(toObjectArray("zadd abc nx ch incr 1 b".split(" ")));
+ assertEquals("abc", cmd.getKey());
+ assertEquals(ExistType.NX, cmd.getExistType());
+ assertEquals(Boolean.TRUE, cmd.getCh());
+ assertEquals(Boolean.TRUE, cmd.getIncr());
+ assertEquals(1, cmd.getZSetEntries()[0].getScore(), 0);
+ assertEquals("b", cmd.getZSetEntries()[0].getElement());
+ System.out.println(cmd);
+
+ cmd = parser.parse(toObjectArray("zadd abc 1 b".split(" ")));
+ assertEquals("abc", cmd.getKey());
+ assertEquals(ExistType.NONE, cmd.getExistType());
+ assertEquals(null, cmd.getCh());
+ assertEquals(null, cmd.getIncr());
+ assertEquals(1, cmd.getZSetEntries()[0].getScore(), 0);
+ assertEquals("b", cmd.getZSetEntries()[0].getElement());
+ System.out.println(cmd);
+
+ cmd = parser.parse(toObjectArray("zadd abc xx 1 b".split(" ")));
+ assertEquals("abc", cmd.getKey());
+ assertEquals(ExistType.XX, cmd.getExistType());
+ assertEquals(null, cmd.getCh());
+ assertEquals(null, cmd.getIncr());
+ assertEquals(1, cmd.getZSetEntries()[0].getScore(), 0);
+ assertEquals("b", cmd.getZSetEntries()[0].getElement());
+ System.out.println(cmd);
+
+ cmd = parser.parse(toObjectArray("zadd abc incr 1 b".split(" ")));
+ assertEquals("abc", cmd.getKey());
+ assertEquals(ExistType.NONE, cmd.getExistType());
+ assertEquals(null, cmd.getCh());
+ assertEquals(Boolean.TRUE, cmd.getIncr());
+ assertEquals(1, cmd.getZSetEntries()[0].getScore(), 0);
+ assertEquals("b", cmd.getZSetEntries()[0].getElement());
+ System.out.println(cmd);
+
+ {
+ ZRemRangeByLexParser parser1 = new ZRemRangeByLexParser();
+ ZRemRangeByLexCommand cmd1 = parser1.parse(toObjectArray("ZREMRANGEBYLEX myzset [alpha [omega".split(" ")));
+ assertEquals("myzset", cmd1.getKey());
+ assertEquals("[alpha", cmd1.getMin());
+ assertEquals("[omega", cmd1.getMax());
+ System.out.println(cmd1);
+ }
+
+ {
+ ZRemRangeByScoreParser parser1 = new ZRemRangeByScoreParser();
+ ZRemRangeByScoreCommand cmd1 = parser1.parse(toObjectArray("ZREMRANGEBYSCORE myzset -inf (2".split(" ")));
+ assertEquals("myzset", cmd1.getKey());
+ assertEquals("-inf", cmd1.getMin());
+ assertEquals("(2", cmd1.getMax());
+ System.out.println(cmd1);
+ }
+
+ {
+ ZRemRangeByRankParser parser1 = new ZRemRangeByRankParser();
+ ZRemRangeByRankCommand cmd1 = parser1.parse(toObjectArray("ZREMRANGEBYRANK myzset 0 1".split(" ")));
+ assertEquals("myzset", cmd1.getKey());
+ assertEquals(0L, cmd1.getStart());
+ assertEquals(1L, cmd1.getStop());
+ System.out.println(cmd1);
+ }
+
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/ModuleTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/ModuleTest.java
new file mode 100644
index 00000000..3532de14
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/ModuleTest.java
@@ -0,0 +1,152 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import java.io.IOException;
+import java.util.Arrays;
+import org.apache.rocketmq.redis.replicator.Configuration;
+import org.apache.rocketmq.redis.replicator.FileType;
+import org.apache.rocketmq.redis.replicator.RedisReplicator;
+import org.apache.rocketmq.redis.replicator.Replicator;
+import org.apache.rocketmq.redis.replicator.cmd.Command;
+import org.apache.rocketmq.redis.replicator.cmd.CommandListener;
+import org.apache.rocketmq.redis.replicator.cmd.CommandName;
+import org.apache.rocketmq.redis.replicator.cmd.CommandParser;
+import org.apache.rocketmq.redis.replicator.io.RedisInputStream;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueModule;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.module.ModuleParser;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.Module;
+import org.apache.rocketmq.redis.replicator.rdb.module.DefaultRdbModuleParser;
+import org.junit.Test;
+
+import static java.nio.charset.StandardCharsets.UTF_8;
+import static org.junit.Assert.assertEquals;
+
+public class ModuleTest {
+ @Test
+ public void testModule() throws IOException {
+ @SuppressWarnings("resource")
+ Replicator replicator = new RedisReplicator(ModuleTest.class.getClassLoader().getResourceAsStream("module.rdb"), FileType.RDB,
+ Configuration.defaultSetting());
+ replicator.addModuleParser("hellotype", 0, new HelloTypeModuleParser());
+ replicator.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ if (kv instanceof KeyStringValueModule) {
+ KeyStringValueModule ksvm = (KeyStringValueModule) kv;
+ System.out.println(kv);
+ assertEquals(12123123112L, ((HelloTypeModule) ksvm.getValue()).getValue()[0]);
+ }
+ }
+ });
+
+ replicator.open();
+
+ replicator = new RedisReplicator(ModuleTest.class.getClassLoader().getResourceAsStream("appendonly6.aof"), FileType.AOF,
+ Configuration.defaultSetting());
+ replicator.addCommandParser(CommandName.name("hellotype.insert"), new HelloTypeParser());
+
+ replicator.addCommandListener(new CommandListener() {
+ @Override
+ public void handle(Replicator replicator, Command command) {
+ if (command instanceof HelloTypeCommand) {
+ HelloTypeCommand htc = (HelloTypeCommand) command;
+ System.out.println(command);
+ assertEquals(12123123112L, htc.getValue());
+ }
+ }
+ });
+
+ replicator.open();
+ }
+
+ public static class HelloTypeModuleParser implements ModuleParser<HelloTypeModule> {
+
+ @Override
+ public HelloTypeModule parse(RedisInputStream in, int version) throws IOException {
+ DefaultRdbModuleParser parser = new DefaultRdbModuleParser(in);
+ int elements = parser.loadUnsigned(version).intValue();
+ long[] ary = new long[elements];
+ int i = 0;
+ while (elements-- > 0) {
+ ary[i++] = parser.loadSigned(version);
+ }
+ return new HelloTypeModule(ary);
+ }
+ }
+
+ public static class HelloTypeModule implements Module {
+
+ private static final long serialVersionUID = 1L;
+
+ private final long[] value;
+
+ public HelloTypeModule(long[] value) {
+ this.value = value;
+ }
+
+ public long[] getValue() {
+ return value;
+ }
+
+ @Override
+ public String toString() {
+ return "HelloTypeModule{" +
+ "value=" + Arrays.toString(value) +
+ '}';
+ }
+ }
+
+ public static class HelloTypeParser implements CommandParser<HelloTypeCommand> {
+ @Override
+ public HelloTypeCommand parse(Object[] command) {
+ String key = new String((byte[]) command[1], UTF_8);
+ long value = Long.parseLong(new String((byte[]) command[2], UTF_8));
+ return new HelloTypeCommand(key, value);
+ }
+ }
+
+ public static class HelloTypeCommand implements Command {
+ private static final long serialVersionUID = 1L;
+ private final String key;
+ private final long value;
+
+ public long getValue() {
+ return value;
+ }
+
+ public String getKey() {
+ return key;
+ }
+
+ public HelloTypeCommand(String key, long value) {
+ this.key = key;
+ this.value = value;
+ }
+
+ @Override
+ public String toString() {
+ return "HelloTypeCommand{" +
+ "key='" + key + '\'' +
+ ", value=" + value +
+ '}';
+ }
+
+ }
+}
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/RdbBinaryParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/RdbBinaryParserTest.java
new file mode 100644
index 00000000..cf8b9bb6
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/RdbBinaryParserTest.java
@@ -0,0 +1,256 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Date;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Map;
+import java.util.Set;
+import java.util.concurrent.ConcurrentHashMap;
+import org.apache.rocketmq.redis.replicator.Configuration;
+import org.apache.rocketmq.redis.replicator.FileType;
+import org.apache.rocketmq.redis.replicator.RedisReplicator;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueSet;
+import org.apache.rocketmq.redis.replicator.Replicator;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueHash;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueList;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueString;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ZSetEntry;
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+import static org.junit.Assert.fail;
+
+@SuppressWarnings("unchecked")
+public class RdbBinaryParserTest {
+
+ public static final byte[] b1 = new byte[] {-1};
+ public static final byte[] b2 = new byte[] {0, -1};
+ public static final byte[] b3 = new byte[] {0, 0, -1};
+ public static final byte[] b4 = new byte[] {0, 0, 0, -1};
+ public static final byte[] b5 = new byte[] {0, 0, 0, 0, -1};
+
+ @Test
+ public void testParse() throws Exception {
+ ConcurrentHashMap<String, KeyValuePair<?>> map = new ConcurrentHashMap<>();
+ String[] resources = new String[] {
+ "dictionary.rdb",
+ "easily_compressible_string_key.rdb", "empty_database.rdb",
+ "hash_as_ziplist.rdb", "integer_keys.rdb", "intset_16.rdb",
+ "intset_32.rdb", "intset_64.rdb", "keys_with_expiry.rdb",
+ "linkedlist.rdb", "multiple_databases.rdb",
+ "parser_filters.rdb", "rdb_version_5_with_checksum.rdb", "regular_set.rdb",
+ "regular_sorted_set.rdb", "sorted_set_as_ziplist.rdb", "uncompressible_string_keys.rdb",
+ "ziplist_that_compresses_easily.rdb", "ziplist_that_doesnt_compress.rdb",
+ "ziplist_with_integers.rdb", "zipmap_that_compresses_easily.rdb",
+ "zipmap_that_doesnt_compress.rdb", "zipmap_with_big_values.rdb"};
+ for (String resource : resources) {
+ template(resource, map);
+ }
+ //Thread.sleep(5000);
+
+ assertByteArray("zero".getBytes(), map.get("key_in_zeroth_database"));
+ assertByteArray("second".getBytes(), map.get("key_in_second_database"));
+
+ assertByteArray("Positive 8 bit integer".getBytes(), map.get("125"));
+ assertByteArray("Positive 16 bit integer".getBytes(), map.get("43947"));
+ assertByteArray("Positive 32 bit integer".getBytes(), map.get("183358245"));
+
+ assertByteArray("Negative 8 bit integer".getBytes(), map.get("-123"));
+ assertByteArray("Negative 16 bit integer".getBytes(), map.get("-29477"));
+ assertByteArray("Negative 32 bit integer".getBytes(), map.get("-183358245"));
+
+ assertByteArray(b1, map.get("b1"));
+ assertByteArray(b2, map.get("b2"));
+ assertByteArray(b3, map.get("b3"));
+ assertByteArray(b4, map.get("b4"));
+ assertByteArray(b5, map.get("b5"));
+
+ assertByteArray("Key that redis should compress easily".getBytes(), map.get("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"));
+
+ assertByteArray("2".getBytes(), map.get("zimap_doesnt_compress"), "MKD1G6");
+ assertByteArray("F7TI".getBytes(), map.get("zimap_doesnt_compress"), "YNNXK");
+
+ assertEquals(253, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("253bytes").length());
+ assertEquals(254, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("254bytes").length());
+ assertEquals(255, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("255bytes").length());
+ assertEquals(300, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("300bytes").length());
+ assertEquals(20000, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("20kbytes").length());
+
+ assertByteArray("aa".getBytes(), map.get("zipmap_compresses_easily"), "a");
+ assertByteArray("aaaa".getBytes(), map.get("zipmap_compresses_easily"), "aa");
+ assertByteArray("aaaaaaaaaaaaaa".getBytes(), map.get("zipmap_compresses_easily"), "aaaaa");
+
+ assertByteArray("T63SOS8DQJF0Q0VJEZ0D1IQFCYTIPSBOUIAI9SB0OV57MQR1FI".getBytes(), map.get("force_dictionary"), "ZMU5WEJDG7KU89AOG5LJT6K7HMNB3DEI43M6EYTJ83VRJ6XNXQ");
+ assertByteArray("6VULTCV52FXJ8MGVSFTZVAGK2JXZMGQ5F8OVJI0X6GEDDR27RZ".getBytes(), map.get("force_dictionary"), "UHS5ESW4HLK8XOGTM39IK1SJEUGVV9WOPK6JYA5QBZSJU84491");
+
+ assertByteArray("aaaaaa".getBytes(), map.get("ziplist_compresses_easily"), 0);
+ assertByteArray("aaaaaaaaaaaa".getBytes(), map.get("ziplist_compresses_easily"), 1);
+ assertByteArray("aaaaaaaaaaaaaaaaaa".getBytes(), map.get("ziplist_compresses_easily"), 2);
+ assertByteArray("aaaaaaaaaaaaaaaaaaaaaaaa".getBytes(), map.get("ziplist_compresses_easily"), 3);
+ assertByteArray("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaa".getBytes(), map.get("ziplist_compresses_easily"), 4);
+ assertByteArray("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa".getBytes(), map.get("ziplist_compresses_easily"), 5);
+
+ assertByteArray("aj2410".getBytes(), map.get("ziplist_doesnt_compress"), 0);
+ assertByteArray("cc953a17a8e096e76a44169ad3f9ac87c5f8248a403274416179aa9fbd852344".getBytes(), map.get("ziplist_doesnt_compress"), 1);
+
+ String[] numbers = new String[] {"0", "1", "2", "3", "4", "5", "6", "7", "8", "9", "10", "11", "12", "13", "-2", "25", "-61", "63", "16380", "-16000", "65535", "-65523", "4194304", "9223372036854775807"};
+ List<String> numlist = Arrays.asList(numbers);
+ assertContainsList(numlist, map.get("ziplist_with_integers"));
+
+ List<String> list = (ArrayList<String>) map.get("force_linkedlist").getValue();
+ assertEquals(1000, list.size());
+ assertByteArray("41PJSO2KRV6SK1WJ6936L06YQDPV68R5J2TAZO3YAR5IL5GUI8".getBytes(), map.get("force_linkedlist"), 0);
+ assertByteArray("E41JRQX2DB4P1AQZI86BAT7NHPBHPRIIHQKA4UXG94ELZZ7P3Y".getBytes(), map.get("force_linkedlist"), 1);
+
+ numlist = Arrays.asList("32766", "32765", "32764");
+ assertContains(numlist, map.get("intset_16"));
+
+ numlist = Arrays.asList("2147418110", "2147418109", "2147418108");
+ assertContains(numlist, map.get("intset_32"));
+
+ numlist = Arrays.asList("9223090557583032318", "9223090557583032317", "9223090557583032316");
+ assertContains(numlist, map.get("intset_64"));
+
+ numlist = Arrays.asList("alpha", "beta", "gamma", "delta", "phi", "kappa");
+ assertContains(numlist, map.get("regular_set"));
+
+ List<ZSetEntry> zset = new ArrayList<>(((Set<ZSetEntry>) map.get("sorted_set_as_ziplist").getValue()));
+
+ for (ZSetEntry entry : zset) {
+ if (entry.getElement().equals("8b6ba6718a786daefa69438148361901")) {
+ assertEquals(1d, entry.getScore(), 0.0001);
+ }
+ if (entry.getElement().equals("cb7a24bb7528f934b841b34c3a73e0c7")) {
+ assertEquals(2.37d, entry.getScore(), 0.0001);
+ }
+ if (entry.getElement().equals("523af537946b79c4f8369ed39ba78605")) {
+ assertEquals(3.423d, entry.getScore(), 0.0001);
+ }
+ }
+
+ assertByteArray("ssssssss".getBytes(), map.get("k1"));
+ assertByteArray("wwwwwwww".getBytes(), map.get("k3"));
+
+ assertEquals(true, map.containsKey("z1"));
+ assertEquals(true, map.containsKey("z2"));
+ assertEquals(true, map.containsKey("z3"));
+ assertEquals(true, map.containsKey("z4"));
+
+ assertEquals(0, map.get("key_in_zeroth_database").getDb().getDbNumber());
+ assertEquals(2, map.get("key_in_second_database").getDb().getDbNumber());
+
+ assertByteArray("efgh".getBytes(), map.get("abcd"));
+ assertByteArray("bar".getBytes(), map.get("foo"));
+ assertByteArray("baz".getBytes(), map.get("bar"));
+ assertByteArray("abcdef".getBytes(), map.get("abcdef"));
+ assertByteArray("thisisalongerstring.idontknowwhatitmeans".getBytes(), map.get("longerstring"));
+
+ assertEquals(new Date(1671963072573L), new Date(map.get("expires_ms_precision").getExpiredMs()));
+ }
+
+ public void assertByteArray(byte[] bytes, KeyValuePair<?> kv) {
+ if (kv instanceof KeyStringValueString) {
+ KeyStringValueString ksvs = (KeyStringValueString) kv;
+ assertEquals(true, Arrays.equals(bytes, ksvs.getRawValue()));
+ } else {
+ fail();
+ }
+ }
+
+ public void assertByteArray(byte[] bytes, KeyValuePair<?> kv, String field) {
+ if (kv instanceof KeyStringValueHash) {
+ KeyStringValueHash ksvh = (KeyStringValueHash) kv;
+ Map<byte[], byte[]> m = ksvh.getRawValue();
+ assertEquals(true, Arrays.equals(bytes, m.get(field.getBytes())));
+ } else {
+ fail();
+ }
+ }
+
+ public void assertByteArray(byte[] bytes, KeyValuePair<?> kv, int index) {
+ if (kv instanceof KeyStringValueList) {
+ KeyStringValueList ksvh = (KeyStringValueList) kv;
+ assertEquals(true, Arrays.equals(bytes, ksvh.getRawValue().get(index)));
+ } else {
+ fail();
+ }
+ }
+
+ public void assertContains(List<String> list, KeyValuePair<?> kv) {
+ List<String> source = new ArrayList<>(list.size());
+ for (String s : list) {
+ source.add(Arrays.toString(s.getBytes()));
+ }
+ if (kv instanceof KeyStringValueSet) {
+ KeyStringValueSet ksvh = (KeyStringValueSet) kv;
+ Set<byte[]> bytes = ksvh.getRawValue();
+ List<String> target = new ArrayList<>();
+ for (byte[] b : bytes) {
+ target.add(Arrays.toString(b));
+ }
+ for (String s : source) {
+ assertEquals(true, target.contains(s));
+ }
+ } else {
+ fail();
+ }
+ }
+
+ public void assertContainsList(List<String> list, KeyValuePair<?> kv) {
+ List<String> source = new ArrayList<>(list.size());
+ for (String s : list) {
+ source.add(Arrays.toString(s.getBytes()));
+ }
+ if (kv instanceof KeyStringValueList) {
+ KeyStringValueList ksvh = (KeyStringValueList) kv;
+ List<byte[]> bytes = ksvh.getRawValue();
+ List<String> target = new ArrayList<>();
+ for (byte[] b : bytes) {
+ target.add(Arrays.toString(b));
+ }
+ for (String s : source) {
+ assertEquals(true, target.contains(s));
+ }
+ } else {
+ fail();
+ }
+ }
+
+ public void template(String filename, final ConcurrentHashMap<String, KeyValuePair<?>> map) {
+ try {
+ @SuppressWarnings("resource")
+ Replicator replicator = new RedisReplicator(RdbBinaryParserTest.class.
+ getClassLoader().getResourceAsStream(filename)
+ , FileType.RDB, Configuration.defaultSetting());
+ replicator.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ map.put(kv.getKey(), kv);
+ }
+ });
+ replicator.open();
+ } catch (Exception e) {
+ fail();
+ }
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/RdbParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/RdbParserTest.java
new file mode 100644
index 00000000..0f01da05
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/RdbParserTest.java
@@ -0,0 +1,189 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Date;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Set;
+import java.util.concurrent.ConcurrentHashMap;
+import org.apache.rocketmq.redis.replicator.FileType;
+import org.apache.rocketmq.redis.replicator.Configuration;
+import org.apache.rocketmq.redis.replicator.RedisReplicator;
+import org.apache.rocketmq.redis.replicator.Replicator;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ZSetEntry;
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+import static org.junit.Assert.fail;
+
+@SuppressWarnings("unchecked")
+public class RdbParserTest {
+
+ @Test
+ public void testParse() throws Exception {
+ ConcurrentHashMap<String, KeyValuePair<?>> map = new ConcurrentHashMap<>();
+ String[] resources = new String[] {
+ "dictionary.rdb",
+ "easily_compressible_string_key.rdb", "empty_database.rdb",
+ "hash_as_ziplist.rdb", "integer_keys.rdb", "intset_16.rdb",
+ "intset_32.rdb", "intset_64.rdb", "keys_with_expiry.rdb",
+ "linkedlist.rdb", "multiple_databases.rdb",
+ "parser_filters.rdb", "rdb_version_5_with_checksum.rdb", "regular_set.rdb",
+ "regular_sorted_set.rdb", "sorted_set_as_ziplist.rdb", "uncompressible_string_keys.rdb",
+ "ziplist_that_compresses_easily.rdb", "ziplist_that_doesnt_compress.rdb",
+ "ziplist_with_integers.rdb", "zipmap_that_compresses_easily.rdb",
+ "zipmap_that_doesnt_compress.rdb", "zipmap_with_big_values.rdb"};
+ for (String resource : resources) {
+ template(resource, map);
+ }
+ //Thread.sleep(5000);
+
+ assertEquals("zero", map.get("key_in_zeroth_database").getValue());
+ assertEquals("second", map.get("key_in_second_database").getValue());
+
+ assertEquals("Positive 8 bit integer", map.get("125").getValue());
+ assertEquals("Positive 16 bit integer", map.get("43947").getValue());
+ assertEquals("Positive 32 bit integer", map.get("183358245").getValue());
+
+ assertEquals("Negative 8 bit integer", map.get("-123").getValue());
+ assertEquals("Negative 16 bit integer", map.get("-29477").getValue());
+ assertEquals("Negative 32 bit integer", map.get("-183358245").getValue());
+
+ assertEquals("Key that redis should compress easily", map.get("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa").getValue());
+
+ assertEquals("2", ((HashMap<String, String>) map.get("zimap_doesnt_compress").getValue()).get("MKD1G6"));
+ assertEquals("F7TI", ((HashMap<String, String>) map.get("zimap_doesnt_compress").getValue()).get("YNNXK"));
+
+ assertEquals(253, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("253bytes").length());
+ assertEquals(254, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("254bytes").length());
+ assertEquals(255, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("255bytes").length());
+ assertEquals(300, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("300bytes").length());
+ assertEquals(20000, ((HashMap<String, String>) map.get("zipmap_with_big_values").getValue()).get("20kbytes").length());
+
+ assertEquals("aa", ((HashMap<String, String>) map.get("zipmap_compresses_easily").getValue()).get("a"));
+ assertEquals("aaaa", ((HashMap<String, String>) map.get("zipmap_compresses_easily").getValue()).get("aa"));
+ assertEquals("aaaaaaaaaaaaaa", ((HashMap<String, String>) map.get("zipmap_compresses_easily").getValue()).get("aaaaa"));
+
+ assertEquals("T63SOS8DQJF0Q0VJEZ0D1IQFCYTIPSBOUIAI9SB0OV57MQR1FI", ((HashMap<String, String>) map.get("force_dictionary").getValue()).get("ZMU5WEJDG7KU89AOG5LJT6K7HMNB3DEI43M6EYTJ83VRJ6XNXQ"));
+ assertEquals("6VULTCV52FXJ8MGVSFTZVAGK2JXZMGQ5F8OVJI0X6GEDDR27RZ", ((HashMap<String, String>) map.get("force_dictionary").getValue()).get("UHS5ESW4HLK8XOGTM39IK1SJEUGVV9WOPK6JYA5QBZSJU84491"));
+
+ List<String> list = (ArrayList<String>) map.get("ziplist_compresses_easily").getValue();
+ assertEquals("aaaaaa", list.get(0));
+ assertEquals("aaaaaaaaaaaa", list.get(1));
+ assertEquals("aaaaaaaaaaaaaaaaaa", list.get(2));
+ assertEquals("aaaaaaaaaaaaaaaaaaaaaaaa", list.get(3));
+ assertEquals("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", list.get(4));
+ assertEquals("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", list.get(5));
+
+ list = (ArrayList<String>) map.get("ziplist_doesnt_compress").getValue();
+ assertEquals("aj2410", list.get(0));
+ assertEquals("cc953a17a8e096e76a44169ad3f9ac87c5f8248a403274416179aa9fbd852344", list.get(1));
+
+ String[] numbers = new String[] {"0", "1", "2", "3", "4", "5", "6", "7", "8", "9", "10", "11", "12", "13", "-2", "25", "-61", "63", "16380", "-16000", "65535", "-65523", "4194304", "9223372036854775807"};
+ List<String> numlist = Arrays.asList(numbers);
+
+ list = (ArrayList<String>) map.get("ziplist_with_integers").getValue();
+ for (String str : list) {
+ assertEquals(true, numlist.contains(str));
+ }
+
+ list = (ArrayList<String>) map.get("force_linkedlist").getValue();
+ assertEquals(1000, list.size());
+ assertEquals("41PJSO2KRV6SK1WJ6936L06YQDPV68R5J2TAZO3YAR5IL5GUI8", list.get(0));
+ assertEquals("E41JRQX2DB4P1AQZI86BAT7NHPBHPRIIHQKA4UXG94ELZZ7P3Y", list.get(1));
+
+ numlist = Arrays.asList("32766", "32765", "32764");
+ list = new ArrayList<>(((Set<String>) map.get("intset_16").getValue()));
+ for (String str : list) {
+ assertEquals(true, numlist.contains(str));
+ }
+
+ numlist = Arrays.asList("2147418110", "2147418109", "2147418108");
+ list = new ArrayList<>(((Set<String>) map.get("intset_32").getValue()));
+ for (String str : list) {
+ assertEquals(true, numlist.contains(str));
+ }
+
+ numlist = Arrays.asList("9223090557583032318", "9223090557583032317", "9223090557583032316");
+ list = new ArrayList<>(((Set<String>) map.get("intset_64").getValue()));
+ for (String str : list) {
+ assertEquals(true, numlist.contains(str));
+ }
+
+ numlist = Arrays.asList("alpha", "beta", "gamma", "delta", "phi", "kappa");
+ list = new ArrayList<>(((Set<String>) map.get("regular_set").getValue()));
+ for (String str : list) {
+ assertEquals(true, numlist.contains(str));
+ }
+
+ List<ZSetEntry> zset = new ArrayList<>(((Set<ZSetEntry>) map.get("sorted_set_as_ziplist").getValue()));
+
+ for (ZSetEntry entry : zset) {
+ if (entry.getElement().equals("8b6ba6718a786daefa69438148361901")) {
+ assertEquals(1d, entry.getScore(), 0.0001);
+ }
+ if (entry.getElement().equals("cb7a24bb7528f934b841b34c3a73e0c7")) {
+ assertEquals(2.37d, entry.getScore(), 0.0001);
+ }
+ if (entry.getElement().equals("523af537946b79c4f8369ed39ba78605")) {
+ assertEquals(3.423d, entry.getScore(), 0.0001);
+ }
+ }
+
+ assertEquals("ssssssss", map.get("k1").getValue());
+ assertEquals("wwwwwwww", map.get("k3").getValue());
+
+ assertEquals(true, map.containsKey("z1"));
+ assertEquals(true, map.containsKey("z2"));
+ assertEquals(true, map.containsKey("z3"));
+ assertEquals(true, map.containsKey("z4"));
+
+ assertEquals(0, map.get("key_in_zeroth_database").getDb().getDbNumber());
+ assertEquals(2, map.get("key_in_second_database").getDb().getDbNumber());
+
+ assertEquals("efgh", map.get("abcd").getValue());
+ assertEquals("bar", map.get("foo").getValue());
+ assertEquals("baz", map.get("bar").getValue());
+ assertEquals("abcdef", map.get("abcdef").getValue());
+ assertEquals("thisisalongerstring.idontknowwhatitmeans", map.get("longerstring").getValue());
+
+ assertEquals(new Date(1671963072573L), new Date(map.get("expires_ms_precision").getExpiredMs()));
+ }
+
+ @SuppressWarnings("resource")
+ public void template(String filename, final ConcurrentHashMap<String, KeyValuePair<?>> map) {
+ try {
+ Replicator replicator = new RedisReplicator(RdbParserTest.class.
+ getClassLoader().getResourceAsStream(filename)
+ , FileType.RDB, Configuration.defaultSetting());
+ replicator.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ map.put(kv.getKey(), kv);
+ }
+ });
+ replicator.open();
+ } catch (Exception e) {
+ fail();
+ }
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/RdbV8ParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/RdbV8ParserTest.java
new file mode 100644
index 00000000..a24d690f
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/RdbV8ParserTest.java
@@ -0,0 +1,71 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import java.util.ArrayList;
+import java.util.List;
+import java.util.Set;
+import java.util.concurrent.ConcurrentHashMap;
+import org.apache.rocketmq.redis.replicator.Configuration;
+import org.apache.rocketmq.redis.replicator.FileType;
+import org.apache.rocketmq.redis.replicator.RedisReplicator;
+import org.apache.rocketmq.redis.replicator.Replicator;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ZSetEntry;
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+import static org.junit.Assert.fail;
+
+@SuppressWarnings("unchecked")
+public class RdbV8ParserTest {
+ @Test
+ public void testParse() throws Exception {
+ ConcurrentHashMap<String, KeyValuePair<?>> map = new ConcurrentHashMap<>();
+ String[] resources = new String[] {"rdb_version_8_with_64b_length_and_scores.rdb", "non_ascii_values.rdb"};
+ for (String resource : resources) {
+ template(resource, map);
+ }
+ assertEquals("bar", map.get("foo").getValue());
+ List<ZSetEntry> zset = new ArrayList<>(((Set<ZSetEntry>) map.get("bigset").getValue()));
+ assertEquals(1000, zset.size());
+ for (ZSetEntry entry : zset) {
+ if (entry.getElement().equals("finalfield")) {
+ assertEquals(2.718d, entry.getScore(), 0.0001);
+ }
+ }
+ }
+
+ @SuppressWarnings("resource")
+ public void template(String filename, final ConcurrentHashMap<String, KeyValuePair<?>> map) {
+ try {
+ Replicator replicator = new RedisReplicator(RdbParserTest.class.
+ getClassLoader().getResourceAsStream(filename)
+ , FileType.RDB, Configuration.defaultSetting());
+ replicator.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ map.put(kv.getKey(), kv);
+ }
+ });
+ replicator.open();
+ } catch (Exception e) {
+ fail();
+ }
+ }
+}
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/ValueIterableRdbParserTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/ValueIterableRdbParserTest.java
new file mode 100644
index 00000000..d28785e1
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/rdb/ValueIterableRdbParserTest.java
@@ -0,0 +1,145 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.rdb;
+
+import java.util.Iterator;
+import java.util.Map;
+import java.util.concurrent.atomic.AtomicInteger;
+import org.apache.rocketmq.redis.replicator.Configuration;
+import org.apache.rocketmq.redis.replicator.FileType;
+import org.apache.rocketmq.redis.replicator.RedisReplicator;
+import org.apache.rocketmq.redis.replicator.Replicator;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueHash;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueList;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueSet;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyStringValueZSet;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.KeyValuePair;
+import org.apache.rocketmq.redis.replicator.rdb.iterable.datatype.KeyStringValueByteArrayIterator;
+import org.apache.rocketmq.redis.replicator.rdb.iterable.datatype.KeyStringValueZSetEntryIterator;
+import org.apache.rocketmq.redis.replicator.rdb.datatype.ZSetEntry;
+import org.apache.rocketmq.redis.replicator.rdb.iterable.ValueIterableRdbVisitor;
+import org.apache.rocketmq.redis.replicator.rdb.iterable.datatype.KeyStringValueMapEntryIterator;
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+import static org.junit.Assert.fail;
+
+public class ValueIterableRdbParserTest {
+
+ @Test
+ public void test() {
+ String[] resources = new String[] {
+ "dictionary.rdb",
+ "easily_compressible_string_key.rdb", "empty_database.rdb",
+ "hash_as_ziplist.rdb", "integer_keys.rdb", "intset_16.rdb",
+ "intset_32.rdb", "intset_64.rdb", "keys_with_expiry.rdb",
+ "linkedlist.rdb", "multiple_databases.rdb",
+ "parser_filters.rdb", "rdb_version_5_with_checksum.rdb", "regular_set.rdb",
+ "regular_sorted_set.rdb", "sorted_set_as_ziplist.rdb", "uncompressible_string_keys.rdb",
+ "ziplist_that_compresses_easily.rdb", "ziplist_that_doesnt_compress.rdb",
+ "ziplist_with_integers.rdb", "zipmap_that_compresses_easily.rdb",
+ "zipmap_that_doesnt_compress.rdb", "zipmap_with_big_values.rdb", "rdb_version_8_with_64b_length_and_scores.rdb", "non_ascii_values.rdb", "module.rdb"};
+ for (String f : resources) {
+ assertEquals(testFile(f), testFile1(f));
+ }
+ }
+
+ private int testFile(String fileName) {
+ final AtomicInteger acc = new AtomicInteger(0);
+ Replicator r = new RedisReplicator(ValueIterableRdbParserTest.class.getClassLoader().getResourceAsStream(fileName), FileType.RDB, Configuration.defaultSetting());
+ r.setRdbVisitor(new ValueIterableRdbVisitor(r));
+ r.addModuleParser("hellotype", 0, new ModuleTest.HelloTypeModuleParser());
+ r.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ if (kv instanceof KeyStringValueByteArrayIterator) {
+ KeyStringValueByteArrayIterator kv1 = (KeyStringValueByteArrayIterator) kv;
+ Iterator<byte[]> it = kv1.getValue();
+ while (it.hasNext()) {
+ it.next();
+ acc.incrementAndGet();
+ }
+ } else if (kv instanceof KeyStringValueMapEntryIterator) {
+ KeyStringValueMapEntryIterator kv1 = (KeyStringValueMapEntryIterator) kv;
+ Iterator<Map.Entry<byte[], byte[]>> it = kv1.getValue();
+ while (it.hasNext()) {
+ it.next();
+ acc.incrementAndGet();
+ }
+ } else if (kv instanceof KeyStringValueZSetEntryIterator) {
+ KeyStringValueZSetEntryIterator kv1 = (KeyStringValueZSetEntryIterator) kv;
+ Iterator<ZSetEntry> it = kv1.getValue();
+ while (it.hasNext()) {
+ it.next();
+ acc.incrementAndGet();
+ }
+ } else {
+ acc.incrementAndGet();
+ }
+ }
+ });
+ try {
+ r.open();
+ } catch (Exception e) {
+ fail();
+ }
+ return acc.get();
+ }
+
+ @SuppressWarnings("unused")
+ private int testFile1(String fileName) {
+ final AtomicInteger acc = new AtomicInteger(0);
+ @SuppressWarnings("resource")
+ Replicator r = new RedisReplicator(ValueIterableRdbParserTest.class.getClassLoader().getResourceAsStream(fileName), FileType.RDB, Configuration.defaultSetting());
+ r.addModuleParser("hellotype", 0, new ModuleTest.HelloTypeModuleParser());
+ r.addRdbListener(new RdbListener.Adaptor() {
+ @Override
+ public void handle(Replicator replicator, KeyValuePair<?> kv) {
+ if (kv instanceof KeyStringValueList) {
+ KeyStringValueList kv1 = (KeyStringValueList) kv;
+ for (String s : kv1.getValue()) {
+ acc.incrementAndGet();
+ }
+ } else if (kv instanceof KeyStringValueSet) {
+ KeyStringValueSet kv1 = (KeyStringValueSet) kv;
+ for (String s : kv1.getValue()) {
+ acc.incrementAndGet();
+ }
+ } else if (kv instanceof KeyStringValueHash) {
+ KeyStringValueHash kv1 = (KeyStringValueHash) kv;
+ for (Map.Entry<String, String> entry : kv1.getValue().entrySet()) {
+ acc.incrementAndGet();
+ }
+ } else if (kv instanceof KeyStringValueZSet) {
+ KeyStringValueZSet kv1 = (KeyStringValueZSet) kv;
+ for (ZSetEntry entry : kv1.getValue()) {
+ acc.incrementAndGet();
+ }
+ } else {
+ acc.incrementAndGet();
+ }
+ }
+ });
+ try {
+ r.open();
+ } catch (Exception e) {
+ fail();
+ }
+ return acc.get();
+ }
+}
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/ByteArrayMapTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/ByteArrayMapTest.java
new file mode 100644
index 00000000..d8032bd2
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/ByteArrayMapTest.java
@@ -0,0 +1,173 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.LinkedHashMap;
+import java.util.List;
+import java.util.Map;
+import java.util.Set;
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+
+public class ByteArrayMapTest {
+ @Test
+ public void test() {
+ Map<byte[], byte[]> m = new LinkedHashMap<>();
+ m.put(new byte[] {1, 2, 3}, new byte[] {4, 5, 6});
+ m.put(null, new byte[] {4});
+ m.put(new byte[] {4, 5, 6}, null);
+ ByteArrayMap<byte[]> bytes = new ByteArrayMap<>(m);
+ assertEquals(3, bytes.size());
+ assertEquals(true, Arrays.equals(new byte[] {4, 5, 6}, bytes.get(new byte[] {1, 2, 3})));
+ assertEquals(true, Arrays.equals(new byte[] {4}, bytes.get(null)));
+ assertEquals(null, bytes.get(new byte[] {4, 5, 6}));
+ assertEquals(false, bytes.isEmpty());
+ assertEquals(true, bytes.containsKey(new byte[] {1, 2, 3}));
+ assertEquals(true, bytes.containsKey(null));
+ assertEquals(false, bytes.containsKey(1));
+ assertEquals(false, bytes.containsValue(new byte[] {4, 5, 6}));
+ assertEquals(true, bytes.containsValue(null));
+
+ Set<byte[]> s = bytes.keySet();
+
+ Iterator<byte[]> it = s.iterator();
+ while (it.hasNext()) {
+ byte[] key = it.next();
+ assertEquals(true, s.contains(key));
+ assertEquals(true, bytes.containsKey(key));
+ }
+
+ for (byte[] b : bytes.keySet()) {
+ assertEquals(true, bytes.containsKey(b));
+ }
+
+ for (byte[] b : bytes.values()) {
+ assertEquals(true, bytes.containsValue(b));
+ }
+
+ for (Map.Entry<byte[], byte[]> entry : bytes.entrySet()) {
+ assertEquals(true, bytes.containsKey(entry.getKey()));
+ assertEquals(true, bytes.containsValue(entry.getValue()));
+ }
+
+ Set<Map.Entry<byte[], byte[]>> ss = bytes.entrySet();
+ Iterator<Map.Entry<byte[], byte[]>> itr = ss.iterator();
+ while (itr.hasNext()) {
+ Map.Entry<byte[], byte[]> entry = itr.next();
+ assertEquals(true, ss.contains(entry));
+ assertEquals(true, ss.contains(new TestEntry(entry.getKey(), entry.getValue())));
+ if (entry.getValue() != null) {
+ assertEquals(false, ss.contains(new TestEntry(entry.getKey(), Arrays.copyOf(entry.getValue(), entry.getValue().length))));
+ } else {
+ assertEquals(true, ss.contains(new TestEntry(entry.getKey(), null)));
+ }
+ assertEquals(true, bytes.containsKey(entry.getKey()));
+ assertEquals(true, bytes.containsValue(entry.getValue()));
+ }
+
+ bytes = new ByteArrayMap<>(null);
+ assertEquals(0, bytes.size());
+ assertEquals(true, bytes.isEmpty());
+
+ bytes = new ByteArrayMap<>(new HashMap<byte[], byte[]>());
+ assertEquals(0, bytes.size());
+ assertEquals(true, bytes.isEmpty());
+
+ bytes = new ByteArrayMap<>(m);
+ bytes.put(new byte[] {1, 2, 3}, new byte[] {4, 5, 6});
+ bytes.put(null, new byte[] {4});
+ bytes.put(new byte[] {4, 5, 6}, null);
+ s = bytes.keySet();
+ s.remove(new byte[] {1, 2, 3});
+ s.remove(null);
+ s.remove(new byte[] {4, 5, 6});
+ assertEquals(0, s.size());
+ assertEquals(0, bytes.size());
+
+ bytes = new ByteArrayMap<>(m);
+ bytes.put(new byte[] {1, 2, 3}, new byte[] {4, 5, 6});
+ bytes.put(null, new byte[] {4});
+ bytes.put(new byte[] {4, 5, 6}, null);
+ ss = bytes.entrySet();
+ List<Map.Entry<byte[], byte[]>> list = new ArrayList<>();
+ for (Map.Entry<byte[], byte[]> entry : ss) {
+ list.add(new TestEntry(entry.getKey(), entry.getValue()));
+ }
+ for (Map.Entry<byte[], byte[]> entry : list) {
+ ss.remove(entry);
+ }
+ assertEquals(0, ss.size());
+ assertEquals(0, bytes.size());
+
+ bytes = new ByteArrayMap<>(m);
+ bytes.put(new byte[] {1, 2, 3}, new byte[] {4, 5, 6});
+ bytes.put(null, new byte[] {4});
+ bytes.put(new byte[] {4, 5, 6}, null);
+ Iterator<byte[]> a = bytes.keySet().iterator();
+ while (a.hasNext()) {
+ a.next();
+ a.remove();
+ }
+ assertEquals(0, bytes.size());
+
+ bytes = new ByteArrayMap<>(m);
+ bytes.put(new byte[] {1, 2, 3}, new byte[] {4, 5, 6});
+ bytes.put(null, new byte[] {4});
+ bytes.put(new byte[] {4, 5, 6}, null);
+ Iterator<Map.Entry<byte[], byte[]>> aa = bytes.entrySet().iterator();
+ while (aa.hasNext()) {
+ aa.next();
+ aa.remove();
+ }
+ assertEquals(0, bytes.size());
+ }
+
+ private final class TestEntry implements Map.Entry<byte[], byte[]> {
+
+ private byte[] value;
+ private final byte[] key;
+
+ private TestEntry(byte[] key, byte[] value) {
+ this.key = key;
+ this.value = value;
+ }
+
+ @Override
+ public byte[] getKey() {
+ return this.key;
+ }
+
+ @Override
+ public byte[] getValue() {
+ return this.value;
+ }
+
+ @Override
+ public byte[] setValue(byte[] value) {
+ byte[] oldValue = this.value;
+ this.value = value;
+ return oldValue;
+ }
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/ByteArrayTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/ByteArrayTest.java
new file mode 100644
index 00000000..f35cdff6
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/ByteArrayTest.java
@@ -0,0 +1,70 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+import java.io.ByteArrayOutputStream;
+import java.io.IOException;
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+
+public class ByteArrayTest {
+ @Test
+ public void test() throws Exception {
+
+ String str = "sdajkl;jlqwjqejqweq89080c中jlxczksaouwq9823djadj";
+ ByteArray bytes = new ByteArray(str.getBytes().length, 10);
+ byte[] b1 = str.getBytes();
+ int i = 0;
+ for (byte b : b1) {
+ bytes.set(i, b);
+ assertEquals(b, bytes.get(i));
+ i++;
+ }
+ ByteArray bytes1 = new ByteArray(str.getBytes().length - 10, 10);
+ ByteArray.arraycopy(bytes, 10, bytes1, 0, bytes.length - 10);
+ assertEquals(str.substring(10), getString(bytes1));
+
+ str = "sdajk";
+ ByteArray bytes2 = new ByteArray(str.getBytes().length, 10);
+ b1 = str.getBytes();
+ i = 0;
+ for (byte b : b1) {
+ bytes2.set(i, b);
+ assertEquals(b, bytes2.get(i));
+ i++;
+ }
+ assertEquals(getString(bytes2), "sdajk");
+
+ ByteArray bytes3 = new ByteArray(bytes2.length() - 1, 10);
+ ByteArray.arraycopy(bytes2, 1, bytes3, 0, bytes2.length() - 1);
+ assertEquals(str.substring(1), getString(bytes3));
+ }
+
+ private String getString(ByteArray ary) {
+ ByteArrayOutputStream o = new ByteArrayOutputStream();
+ for (byte[] b : ary) {
+ try {
+ o.write(b);
+ } catch (IOException e) {
+ }
+ }
+ return new String(o.toByteArray());
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/ByteBuilderTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/ByteBuilderTest.java
new file mode 100644
index 00000000..6b838bec
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/ByteBuilderTest.java
@@ -0,0 +1,37 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+
+public class ByteBuilderTest {
+ @Test
+ public void put() throws Exception {
+ ByteBuilder bytes = ByteBuilder.allocate(20);
+ String test = "fjdsklafjsdklafjaklfdsjkfsdkjakjdkasjdkajdkajqwieuiqwueiqweqwieuqidasjkasjkajdkcnxzcnzxasjdksadasiuqwieuqwiejaskdajskcxnzcznczkxnasdjasjdjadqweiqwueidjdskdjaskdjskajdakjcncnzxknczxjkasdjaskdjqwieuqwiuakdakncxzkjsakdasjdiqwueijcnkdasjdiuewiqeqdijqdsahdiadiwqueqiwqidjaskdjaskdjqwjieuqfhhaksjduqiwehcaskdjasdaiqwewiqdhashdadashjqweyqwuh";
+ test.getBytes();
+ for (byte b : test.getBytes()) {
+ bytes.put(b);
+ }
+ String s = bytes.toString();
+ assertEquals(test, s);
+ assertEquals(test.getBytes().length, bytes.length());
+ }
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/CompressLZF.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/CompressLZF.java
new file mode 100644
index 00000000..d7212d4d
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/CompressLZF.java
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+public final class CompressLZF {
+
+ /**
+ * The number of entries in the hash table. The size is a trade-off between
+ * hash collisions (reduced compression) and speed (amount that fits in CPU
+ * cache).
+ */
+ private static final int HASH_SIZE = 1 << 14;
+
+ /**
+ * The maximum number of literals in a chunk (32).
+ */
+ private static final int MAX_LITERAL = 1 << 5;
+
+ /**
+ * The maximum offset allowed for a back-reference (8192).
+ */
+ private static final int MAX_OFF = 1 << 13;
+
+ /**
+ * The maximum back-reference length (264).
+ */
+ private static final int MAX_REF = (1 << 8) + (1 << 3);
+
+ /**
+ * Hash table for matching byte sequences (reused for performance).
+ */
+ private int[] cachedHashTable;
+
+ /**
+ * Return byte with lower 2 bytes being byte at index, then index+1.
+ */
+ private static int first(byte[] in, int inPos) {
+ return (in[inPos] << 8) | (in[inPos + 1] & 255);
+ }
+
+ /**
+ * Shift v 1 byte left, add value at index inPos+2.
+ */
+ private static int next(int v, byte[] in, int inPos) {
+ return (v << 8) | (in[inPos + 2] & 255);
+ }
+
+ /**
+ * Compute the address in the hash table.
+ */
+ private static int hash(int h) {
+ return ((h * 2777) >> 9) & (HASH_SIZE - 1);
+ }
+
+ public int compress(byte[] in, int inLen, byte[] out, int outPos) {
+ int inPos = 0;
+ if (cachedHashTable == null) {
+ cachedHashTable = new int[HASH_SIZE];
+ }
+ int[] hashTab = cachedHashTable;
+ int literals = 0;
+ outPos++;
+ int future = first(in, 0);
+ while (inPos < inLen - 4) {
+ byte p2 = in[inPos + 2];
+ // next
+ future = (future << 8) + (p2 & 255);
+ int off = hash(future);
+ int ref = hashTab[off];
+ hashTab[off] = inPos;
+ // if (ref < inPos
+ // && ref > 0
+ // && (off = inPos - ref - 1) < MAX_OFF
+ // && in[ref + 2] == p2
+ // && (((in[ref] & 255) << 8) | (in[ref + 1] & 255)) ==
+ // ((future >> 8) & 0xffff)) {
+ if (ref < inPos
+ && ref > 0
+ && (off = inPos - ref - 1) < MAX_OFF
+ && in[ref + 2] == p2
+ && in[ref + 1] == (byte) (future >> 8)
+ && in[ref] == (byte) (future >> 16)) {
+ // match
+ int maxLen = inLen - inPos - 2;
+ if (maxLen > MAX_REF) {
+ maxLen = MAX_REF;
+ }
+ if (literals == 0) {
+ // multiple back-references,
+ // so there is no literal run control byte
+ outPos--;
+ } else {
+ // set the control byte at the start of the literal run
+ // to store the number of literals
+ out[outPos - literals - 1] = (byte) (literals - 1);
+ literals = 0;
+ }
+ int len = 3;
+ while (len < maxLen && in[ref + len] == in[inPos + len]) {
+ len++;
+ }
+ len -= 2;
+ if (len < 7) {
+ out[outPos++] = (byte) ((off >> 8) + (len << 5));
+ } else {
+ out[outPos++] = (byte) ((off >> 8) + (7 << 5));
+ out[outPos++] = (byte) (len - 7);
+ }
+ out[outPos++] = (byte) off;
+ // move one byte forward to allow for a literal run control byte
+ outPos++;
+ inPos += len;
+ // rebuild the future, and store the last bytes to the hashtable.
+ // Storing hashes of the last bytes in back-reference improves
+ // the compression ratio and only reduces speed slightly.
+ future = first(in, inPos);
+ future = next(future, in, inPos);
+ hashTab[hash(future)] = inPos++;
+ future = next(future, in, inPos);
+ hashTab[hash(future)] = inPos++;
+ } else {
+ // copy one byte from input to output as part of literal
+ out[outPos++] = in[inPos++];
+ literals++;
+ // at the end of this literal chunk, write the length
+ // to the control byte and start a new chunk
+ if (literals == MAX_LITERAL) {
+ out[outPos - literals - 1] = (byte) (literals - 1);
+ literals = 0;
+ // move ahead one byte to allow for the
+ // literal run control byte
+ outPos++;
+ }
+ }
+ }
+ // write the remaining few bytes as literals
+ while (inPos < inLen) {
+ out[outPos++] = in[inPos++];
+ literals++;
+ if (literals == MAX_LITERAL) {
+ out[outPos - literals - 1] = (byte) (literals - 1);
+ literals = 0;
+ outPos++;
+ }
+ }
+ // writes the final literal run length to the control byte
+ out[outPos - literals - 1] = (byte) (literals - 1);
+ if (literals == 0) {
+ outPos--;
+ }
+ return outPos;
+ }
+}
diff --git a/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/LzfTest.java b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/LzfTest.java
new file mode 100644
index 00000000..bd8f469c
--- /dev/null
+++ b/rocketmq-redis/src/test/java/org/apache/rocketmq/redis/replicator/util/LzfTest.java
@@ -0,0 +1,70 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.rocketmq.redis.replicator.util;
+
+import java.io.InputStream;
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+
+public class LzfTest {
+ @Test
+ public void decode() throws Exception {
+ {
+ String str = "abcdsklafjslfjfd;sfdklafjlsafjslfjasl;fkjdsalfjasfjlas;dkfjalsvlasfkal;sj";
+ byte[] out = compress(str.getBytes());
+ ByteArray in = Lzf.decode(new ByteArray(out), str.getBytes().length);
+ assertEquals(new String(in.first()), str);
+ }
+
+ {
+ InputStream in = LzfTest.class.getClassLoader().getResourceAsStream("low-comp-120k.txt");
+ byte[] bytes = new byte[121444];
+ int len = in.read(bytes);
+ byte[] out = compress(bytes);
+ ByteArray bin = Lzf.decode(new ByteArray(out), len);
+ byte[] oin = bin.first();
+ for (int i = 0; i < len; i++) {
+ assertEquals(oin[i], bytes[i]);
+ }
+ }
+
+ {
+ InputStream in = LzfTest.class.getClassLoader().getResourceAsStream("appendonly6.aof");
+ byte[] bytes = new byte[3949];
+ int len = in.read(bytes);
+ byte[] out = compress(bytes);
+ ByteArray bin = Lzf.decode(new ByteArray(out), len);
+ byte[] oin = bin.first();
+ for (int i = 0; i < len; i++) {
+ assertEquals(oin[i], bytes[i]);
+ }
+ }
+
+ }
+
+ private byte[] compress(byte[] in) {
+ CompressLZF c = new CompressLZF();
+ byte[] compressed = new byte[in.length];
+ int idx = c.compress(in, in.length, compressed, 0);
+ byte[] out = new byte[idx];
+ System.arraycopy(compressed, 0, out, 0, out.length);
+ return out;
+ }
+
+}
\ No newline at end of file
diff --git a/rocketmq-redis/src/test/resources/LICENSE b/rocketmq-redis/src/test/resources/LICENSE
new file mode 100644
index 00000000..635f1bc3
--- /dev/null
+++ b/rocketmq-redis/src/test/resources/LICENSE
@@ -0,0 +1,21 @@
+The MIT License
+
+Copyright (c) 2012 Sripathi Krishnan
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in
+all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS"