You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by da...@apache.org on 2020/12/16 09:02:57 UTC
[camel-website] branch new37 created (now aef7398)
This is an automated email from the ASF dual-hosted git repository.
davsclaus pushed a change to branch new37
in repository https://gitbox.apache.org/repos/asf/camel-website.git.
at aef7398 Blog post with whats new in Camel 3.7
This branch includes the following new commits:
new 2c0d527 Blog whats new in Camel 3.7
new aef7398 Blog post with whats new in Camel 3.7
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
[camel-website] 02/02: Blog post with whats new in Camel 3.7
Posted by da...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
davsclaus pushed a commit to branch new37
in repository https://gitbox.apache.org/repos/asf/camel-website.git
commit aef7398815dfe27498d74164238db5623456b338
Author: Claus Ibsen <cl...@gmail.com>
AuthorDate: Wed Dec 16 10:02:40 2020 +0100
Blog post with whats new in Camel 3.7
---
.../2020/12/Camel37-Whatsnew/csimple-compiled.png | Bin 0 -> 15785 bytes
content/blog/2020/12/Camel37-Whatsnew/index.md | 136 ++++++++++++++++++---
.../simple-csimple-performance.png | Bin 0 -> 548212 bytes
3 files changed, 117 insertions(+), 19 deletions(-)
diff --git a/content/blog/2020/12/Camel37-Whatsnew/csimple-compiled.png b/content/blog/2020/12/Camel37-Whatsnew/csimple-compiled.png
new file mode 100644
index 0000000..d0346c2
Binary files /dev/null and b/content/blog/2020/12/Camel37-Whatsnew/csimple-compiled.png differ
diff --git a/content/blog/2020/12/Camel37-Whatsnew/index.md b/content/blog/2020/12/Camel37-Whatsnew/index.md
index c29c429..294f9c5 100644
--- a/content/blog/2020/12/Camel37-Whatsnew/index.md
+++ b/content/blog/2020/12/Camel37-Whatsnew/index.md
@@ -16,33 +16,68 @@ The next planned LTS release is 3.10 scheduled towards summer 2021.
This release introduces a set of new features and noticeable improvements that we will cover in this blog post.
+### Pre compiled languages
-### Spring Boot
+We are continued our avenue of making Camel faster and smaller.
+This time we focused on the built-in Simple scripting language.
-We have upgraded to the latest release at this time which is Spring Boot 2.4.0.
+First we added the [jOOR language](/components/latest/languages/joor-language.html). jOOR is a small Java tool
+for performing runtime compilation of Java source code in-memory. It has some limitations but generally works well for small
+scripting code (requires Java 11 onwards).
+
+Then we worked on compiled simple.
+
+### Compiled Simple
+
+The csimple language is parsed into regular Java source code and compiled together with all the other source code,
+or compiled once during bootstrap via jOOR.
+
+{{< image "csimple-compiled.png" "Compiled Simple Language" >}}
+
+In a nutshell where compiled simple excels over simple language is primary around dynamic OGNL method calls.
+
+For example profiling the following simple expression
+
+ <simple>${exchangeProperty.user.getName} != null && ${exchangeProperty.user.getAge} > 11</simple>
+
+with the equivalent csimple expression:
+
+ <csimple>${exchangeProperty.user} != null &&
+ ${exchangeProperty.user.getName()} != null &&
+ ${exchangeProperty.user.getAge()} > 11</csimple>
+
+yields a dramatic 100 times performance improvement in reduced cpu usage as shown in the screenshot:
-TODO: csimple (and jOOR)
-TODO: salesforce component fixes
-TODO: vertx kafka component
-TODO: optimize more core (direct and event notifier, avoid regexp, faster code)
-TODO: optimize simple (singleton, eager load resource, concat expressions)
-TODO: untangle reifier, model, processor
-TODO: lightweight mode
-TODO: optimize core - base converters in 2 classes, reduce memory overhead
-TODO: optimize routing engine - reduce object allocations
-TODO: reflection free
-TODO: 2 blog posts from davsclaus
-TODO: #autowired by type on component
+{{< image "simple-csimple-performance.png" "Simple vs Compiled Simple" >}}
+For more information about the compiled simple language and further break down of performance improvements
+then read [Claus blog post](http://www.davsclaus.com/2020/12/apache-camel-37-compiled-simple.html).
+We have provided two small examples that demonstrate csimple as pre compiled and as runtime compiled during bootstrap.
+You can find these two examples from the official Apache Camel examples repository at:
-### Language precompilation
+- [csimple pre compiled example](https://github.com/apache/camel-examples/tree/master/examples/camel-example-csimple)
+- [csimple runtime compiled example](https://github.com/apache/camel-examples/tree/master/examples/camel-example-csimple-joor)
-As mentioned in the optimization section we moved initialization of languages to an earlier phase.
-Camel now pre compile languages when its applicable, for example JSonPath, and XPath language.
-And speaking of pre-compiled languages then Camel 3.7 introduces the [jOOR language](/components/latest/languages/joor-language.html)
-to use runtime compile Java in the Camel DSL. A compiled simple language is also on the roadmap.
+### Optimized core
+
+We have continued the effort to optimize camel-core. This time a number of smaller improvements in various areas
+such as replacing regular expressions with regular Java code when regular expressions were overkill
+(regexp take up sizeable heap memory).
+
+The direct component has been enhanced to avoid synchronization when the producer calls the consumer.
+
+We also enhanced the internals of the event notifier separating startup/stop events from routing events,
+gaining a small performance improvement during routing.
+
+We also reduced the number of objects used during routing which reduced the memory usage.
+
+Another significant win was to bulk together all the type converters from the core, into two classes (source generated).
+This avoids registering individually each type converter into the type converter registry which saves 20kb of heap memory.
+
+If you are more curious about how we did these optimizations and with some performance numbers,
+then [Claus wrote a blog post](http://www.davsclaus.com/2020/11/apache-camel-37-more-camel-core.html).
### Optimized components startup
@@ -55,6 +90,69 @@ to an earlier phase during startup, that allows enhanced built time optimization
components then this work will progress over the next couple of Camel releases.
+### Separating Model and EIP processors
+
+In this release we untangled model, reifier and processors.
+
+This is a great achievement which allows us to take this even further with design time vs runtime.
+
+ Model -> Reifier -> Processor
+ (startup) (startup) (runtime)
+
+The model is the structure of the DSL which you can think of as _design time_ specifying your Camel routes.
+The model is executed once during startup and via the reifier (factory) the runtime EIP processors is cretated.
+After this work is done, the model is essentially not needed anymore.
+
+By separating this into different JARs (camel-core-model, camel-core-reifier, camel-core-processor) then we ensure
+they are separated and this allows us to better do built time optimizations and dead code elimination via Quarkus and GraalVM.
+
+This brings up to lightweight mode.
+
+
+### Lightweight mode
+
+We started an experiment earlier with a lightweight mode. With the separation of the model from the processors,
+then we have a great step forward, which allowed us to make the lightweight mode available for end users to turn on.
+
+In lightweight mode, Camel will after startup, then remove all references to the model, and other bits, that all together
+makes the JVM capable of garbage collecting all model objects and unload model classes. This reduced memory usage.
+
+However after startup, then its no longer possible to dynamic add new routes, so this mode is only intended for
+microservice/serverless architectures, with a _closed world_ environment.
+
+
+### Autowiring components
+
+The Camel components is now capable of autowiring by type. For example the AWS SQS components can automatic
+lookup in the registry if there is single instance of `SqsClient`, and then pre configure itself.
+
+We have marked up in the Camel documentation which component options supports this by showing *Autowired* in bold
+in the description.
+
+
+### Salesforce fixes
+
+Our recent Camel committer Jeremy Ross did great work to improve and fix bugs in the camel-salesforce component.
+We expect more to come from him.
+
+
+### VertX Kafka Component
+
+A new Kafka component has been developed that uses the Vert.X Kafka Java Client which allows us to use all of its features,
+and also its robustness and stability.
+
+The camel-vertx-kafka component is intended to be feature complete (or more feature complete) with the existing camel-kafka component.
+We will continue this work for the next couple of Camel releases.
+
+The existing camel-kafka component has a few issues reported, which we want to fix in the upcoming releases,
+and at the same time we can offer this new camel-kafka-component as an alternative and potential a better component in the future.
+
+
+### Spring Boot
+
+We have upgraded to the latest release at this time which is Spring Boot 2.4.0.
+
+
### New components
This release has a number of new components, data formats and languages:
diff --git a/content/blog/2020/12/Camel37-Whatsnew/simple-csimple-performance.png b/content/blog/2020/12/Camel37-Whatsnew/simple-csimple-performance.png
new file mode 100644
index 0000000..ae1b901
Binary files /dev/null and b/content/blog/2020/12/Camel37-Whatsnew/simple-csimple-performance.png differ
[camel-website] 01/02: Blog whats new in Camel 3.7
Posted by da...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
davsclaus pushed a commit to branch new37
in repository https://gitbox.apache.org/repos/asf/camel-website.git
commit 2c0d527c9ba091eb529303c14873e4e3b84c7ca2
Author: Claus Ibsen <cl...@gmail.com>
AuthorDate: Tue Dec 15 10:43:24 2020 +0100
Blog whats new in Camel 3.7
---
content/blog/2020/12/Camel37-Whatsnew/featured.png | Bin 0 -> 3975989 bytes
content/blog/2020/12/Camel37-Whatsnew/index.md | 88 +++++++++++++++++++++
2 files changed, 88 insertions(+)
diff --git a/content/blog/2020/12/Camel37-Whatsnew/featured.png b/content/blog/2020/12/Camel37-Whatsnew/featured.png
new file mode 100644
index 0000000..e5077f5
Binary files /dev/null and b/content/blog/2020/12/Camel37-Whatsnew/featured.png differ
diff --git a/content/blog/2020/12/Camel37-Whatsnew/index.md b/content/blog/2020/12/Camel37-Whatsnew/index.md
new file mode 100644
index 0000000..c29c429
--- /dev/null
+++ b/content/blog/2020/12/Camel37-Whatsnew/index.md
@@ -0,0 +1,88 @@
+---
+title: "Apache Camel 3.7 What's New"
+date: 2020-12-17
+authors: [davsclaus]
+categories: ["Releases"]
+preview: Details of what we have done in the Camel 3.7 release.
+---
+
+Apache Camel 3.7 LTS has just been released.
+
+This is a LTS release which means we will provide patch releases for one year.
+The next planned LTS release is 3.10 scheduled towards summer 2021.
+
+
+## So what's in this release?
+
+This release introduces a set of new features and noticeable improvements that we will cover in this blog post.
+
+
+### Spring Boot
+
+We have upgraded to the latest release at this time which is Spring Boot 2.4.0.
+
+TODO: csimple (and jOOR)
+TODO: salesforce component fixes
+TODO: vertx kafka component
+TODO: optimize more core (direct and event notifier, avoid regexp, faster code)
+TODO: optimize simple (singleton, eager load resource, concat expressions)
+TODO: untangle reifier, model, processor
+TODO: lightweight mode
+TODO: optimize core - base converters in 2 classes, reduce memory overhead
+TODO: optimize routing engine - reduce object allocations
+TODO: reflection free
+TODO: 2 blog posts from davsclaus
+TODO: #autowired by type on component
+
+
+
+### Language precompilation
+
+As mentioned in the optimization section we moved initialization of languages to an earlier phase.
+Camel now pre compile languages when its applicable, for example JSonPath, and XPath language.
+
+And speaking of pre-compiled languages then Camel 3.7 introduces the [jOOR language](/components/latest/languages/joor-language.html)
+to use runtime compile Java in the Camel DSL. A compiled simple language is also on the roadmap.
+
+
+### Optimized components startup
+
+The camel core has been optimized in Camel 3 to be small, slim, and fast on startup. This benefits Camel Quarkus which
+can do built time optimizations that take advantage of the optimized camel core.
+
+We have continued this effort in the Camel components where whenever possible initialization is moved ahead
+to an earlier phase during startup, that allows enhanced built time optimizations. As there are a lot of Camel
+components then this work will progress over the next couple of Camel releases.
+
+
+### New components
+
+This release has a number of new components, data formats and languages:
+
+- AtlasMap: Transforms the message using an AtlasMap transformation
+- Kubernetes Custom Resources: Perform operations on Kubernetes Custom Resources and get notified on Deployment changes
+- Vert.X Kafka: Sent and receive messages to/from an Apache Kafka broker using vert.x Kafka client
+- JSON JSON-B: Marshal POJOs to JSON and back using JSON-B
+- CSimple: Evaluate a compile simple expression language
+- DataSonnet: To use DataSonnet scripts in Camel expressions or predicates
+- jOOR: Evaluate a jOOR (Java compiled once at runtime) expression language
+
+
+## Upgrading
+
+Make sure to read the [upgrade guide](/manual/latest/camel-3x-upgrade-guide-3_7.html) if you
+are upgrading to this release from a previous Camel version.
+
+
+## More details
+
+The previous LTS release was Camel 3.4. We have blog posts for what's new in
+[Camel 3.5](https://camel.apache.org/blog/2020/10/Camel36-Whatsnew/) and
+[Camel 3.6](https://camel.apache.org/blog/2020/09/Camel35-Whatsnew/) you may want to read
+to cover all news between the two LTS releases.
+
+
+## Release Notes
+
+You can find more information about this release in the [release notes](/releases/release-3.7.0/),
+with a list of JIRA tickets resolved in the release.