You are viewing a plain text version of this content. The canonical link for it is here.
Posted to server-dev@james.apache.org by bt...@apache.org on 2019/10/15 03:10:53 UTC
[james-project] branch master updated (d0f4a63 -> c82deaa)
This is an automated email from the ASF dual-hosted git repository.
btellier pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/james-project.git.
from d0f4a63 MAILBOX-380 Bind CassandraEventsDeadLetters inside cassandra-guice
new 4c234aa Fix typo in cassandra-rabbitmq Dockerfile conf
new c9434d0 Rename instanciate to instantiate
new e29ce6b JAMES-2910 TikaModule should fallback to JsoupTextExtractor when disabled
new 927e500 JAMES-2910 Extract text from HTML upon ElasticSearch indexation
new b91c2e1 JAMES-2910 Tika should delegate text extraction to Jsoup
new fba29fa JAMES-2910 Jsoup should also handle all text mediaTypes
new cb8f588 JAMES-2910 Jsoup is more efficient handling inputStream
new 33ecf02 JAMES-2910 Use return early code style within JsoupTextExtractor
new 96c21ae JAMES-2910 TikaTextExtractorTest shouldn't assert strongly line breaks
new 06c1702 JAMES-2079 Indexing MimePart header is functionally not required
new fe6cf8b JAMES-2079 Remove all non-queried IndexableMessage fields
new a5974e6 JAMES-2078 Headers should indexed using nested objects
new 9aa3ef8 JAMES-2080 Explicitly specify attachment mapping in ElasticSearch
new d5038d3 JAMES-2080 Enable strict mapping for mailbox indexing
new 4707ca9 JAMES-2078 headerSearchShouldIncludeMessageWhenDifferentTypesOnAnIndexedField is fixed
new 68237a8 JAMES-2813 create a task for testing the serialization of additional information
new bab0ed5 JAMES-2813 add tests to validate that the additional informations are updated
new 6b473f8 JAMES-2813 add additional information in cassandra task execution details projection
new 35aeb01 JAMES-2813 handle additional information in event sourcing task manager
new 0a1a2bf JAMES-2813 add test to validate sequential execution in RabbitMQWorkqueue
new df998a9 JAMES-2813 serialize error message and exception in Failed event
new 0155645 JAMES-2813 handle additional information in event sourcing task manager
new a50aa20 JAMES-2813 add tests to validate that the additional informations are updated
new 214afec JAMES-2813 add javadoc to MemoryreferenceTask and MemoryReferenceWithCounterTask
new e569ee9 JAMES-2813 rename InitialisationOperation to InitializationOperation
new 56f3616 JAMES-2813 move DistributedTaskManagerModule to modules package
new bbcd66a JAMES-2813 Make it possible to define an InitilizationOperation without creating a new type
new 9731491 JAMES-2813 bind DistributedTaskManager first tasks for Webadmin serialization integration tests
new b4dac47 JAMES-2813 Serialization binding for DeleteMailsFromMailQueueTask
new dfe2cef JAMES-2813 Serialization binding for ReprocessingAllMailsTask
new a0c8a2a JAMES-2813 Serialization binding for ReprocessingOneMailTask
new 86e4891 JAMES-2813 Serialization binding for SingleMessageReindexingTask
new 7022676 JAMES-2813 Serialization binding for MessageIdReIndexingTask
new 51b1361 JAMES-2813 Serialization binding for UserReindexingTask
new 6b82bbb JAMES-2813 Serialization binding for DeletedMessagesVaultRestoreTask
new 52cab78 JAMES-2813 Serialization binding for DeletedMessagesVaultExportTask
new 3e1e93a JAMES-2813 Serialization binding for ErrorRecoveryIndexationTask
new 7ee5d5e JAMES-2813 Serialization binding for ClearMailQueueTask
new 505ace5 JAMES-2813 Serialization binding for BlobStoreVaultGarbageCollectionTask
new f2ceccc JAMES-2813 Serialization binding for ClearMailRepositoryTask
new ca4de2c JAMES-2813 Serialization binding for MailboxMergingTask
new f762816 JAMES-2813 Serialization binding for SingleMailboxReindexingTask
new 6c5f0fc JAMES-2813 Serialization binding for DeletedMessagesVaultDeleteTask
new 9557ef9 JAMES-2813 Split EventDeadLettersRedeliverTask into 3 tasks + serialization binding for theses tasks
new ec2cea0 JAMES-2813 plug Schedulers leaks
new 077bf85 JAMES-2886 Test route overriding behavior
new dfb481e JAMES-2886 guice.extension.module should be optional
new f5f2809 JAMES-2886 Swagger routes should be public
new da8d74a JAMES-2886 Allow a user to define custom routes
new a7ee2e5 JAMES-2886 Document extensions.routes in webadmin.properties
new 33ef204 JAMES-2886 Clear documentation for all guice extensions
new c82deaa JAMES-2813 Typo fixes for some javadoc of memory testing tasks
The 52 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../MigrationTaskAdditionalInformationsDTO.java | 5 +-
.../cassandra/migration/MigrationTaskDTO.java | 9 +-
.../migration/MigrationTaskSerializationTest.java | 4 +-
.../destination/conf/extensions.properties | 2 +-
.../destination/conf/webadmin.properties | 7 +-
.../destination/conf/extensions.properties | 2 +-
.../destination/conf/webadmin.properties | 7 +-
.../destination/conf/extensions.properties | 2 +-
.../destination/conf/webadmin.properties | 7 +-
.../destination/conf/extensions.properties | 2 +-
.../cassandra/destination/conf/webadmin.properties | 7 +-
.../destination/conf/extensions.properties | 2 +-
.../jpa/destination/conf/extensions.properties | 2 +-
.../memory/destination/conf/extensions.properties | 2 +-
.../memory/destination/conf/webadmin.properties | 8 +-
.../org/apache/james/mailbox/events/Group.java | 4 +-
mailbox/cassandra/README.txt | 2 +-
...MailboxMergingTaskAdditionalInformationDTO.java | 2 +-
.../cassandra/mail/task/MailboxMergingTaskDTO.java | 9 +-
.../mail/task/MailboxMergingTaskTest.java | 2 +-
.../elasticsearch/MailboxMappingFactory.java | 57 +++-
.../ElasticSearchListeningMessageSearchIndex.java | 1 +
.../elasticsearch/json/HeaderCollection.java | 106 ++++---
.../elasticsearch/json/IndexableMessage.java | 115 +++----
.../elasticsearch/json/JsonMessageConstants.java | 11 +-
.../json/MessageToElasticSearchJson.java | 2 -
.../james/mailbox/elasticsearch/json/MimePart.java | 28 +-
.../elasticsearch/query/CriterionConverter.java | 13 +-
.../ElasticSearchIntegrationTest.java | 2 -
.../elasticsearch/json/HeaderCollectionTest.java | 15 +-
.../elasticsearch/json/IndexableMessageTest.java | 34 +--
.../json/MessageToElasticSearchJsonTest.java | 52 ++--
.../src/test/resources/eml/htmlContent.txt | 26 ++
mailbox/memory/pom.xml | 5 -
.../BlobStoreVaultGarbageCollectionTaskDTO.java | 7 +-
...aultGarbageCollectionTaskSerializationTest.java | 2 +-
mailbox/store/pom.xml | 5 +
.../store/extractor}/JsoupTextExtractor.java | 38 ++-
.../store/extractor}/JsoupTextExtractorTest.java | 35 ++-
.../src/test/resources/documents/html.txt | 0
...ithNonIndexableAttachmentWithoutAttachment.json | 84 ++----
mailbox/store/src/test/resources/eml/htmlMail.json | 201 ++++++-------
mailbox/store/src/test/resources/eml/mail.json | 256 ++++++++--------
.../store/src/test/resources/eml/nonTextual.json | 67 +++--
.../src/test/resources/eml/pgpSignedMail.json | 266 ++++++++---------
.../src/test/resources/eml/recursiveMail.json | 196 ++++--------
.../eml/recursiveMailWithoutAttachments.json | 115 +++----
mailbox/store/src/test/resources/eml/spamMail.json | 233 ++++++---------
mailbox/tika/pom.xml | 4 +
.../james/mailbox/tika/TikaTextExtractor.java | 6 +
.../james/mailbox/tika/TikaTextExtractorTest.java | 65 ++--
.../mailbox/tools/copier/MailboxCopierTest.java | 56 ++--
.../tools/indexer/ErrorRecoveryIndexationTask.java | 2 +-
.../indexer/ErrorRecoveryIndexationTaskDTO.java | 5 +-
.../mailbox/tools/indexer/FullReindexingTask.java | 24 +-
.../tools/indexer/MessageIdReIndexingTask.java | 1 +
...geIdReindexingTaskAdditionalInformationDTO.java | 18 +-
.../tools/indexer/MessageIdReindexingTaskDTO.java | 7 +-
.../indexer/ReprocessingContextInformation.java | 10 +-
.../indexer/ReprocessingContextInformationDTO.java | 33 ++-
...lboxReindexingTaskAdditionalInformationDTO.java | 25 +-
.../indexer/SingleMailboxReindexingTaskDTO.java | 7 +-
...sageReindexingTaskAdditionalInformationDTO.java | 18 +-
.../indexer/SingleMessageReindexingTaskDTO.java | 7 +-
...UserReindexingTaskAdditionalInformationDTO.java | 25 +-
.../tools/indexer/UserReindexingTaskDTO.java | 7 +-
...rorRecoveryIndexationTaskSerializationTest.java | 11 +-
.../FullReindexingTaskSerializationTest.java | 12 +-
.../MessageIdReindexingTaskSerializationTest.java | 6 +-
...ngleMailboxReindexingTaskSerializationTest.java | 6 +-
...ngleMessageReindexingTaskSerializationTest.java | 6 +-
.../UserReindexingTaskSerializationTest.java | 6 +-
.../org/apache/james/CassandraJamesServerMain.java | 8 +-
.../modules/data/CassandraDomainListModule.java | 8 +-
.../data/CassandraRecipientRewriteTableModule.java | 6 +-
.../data/CassandraUsersRepositoryModule.java | 8 +-
.../mailbox/ElasticSearchMailboxModule.java | 6 +-
.../mailbox/ElasticSearchQuotaSearcherModule.java | 6 +-
.../james/modules/mailbox/TikaMailboxModule.java | 6 +-
.../modules/metrics/CassandraMetricsModule.java | 6 +-
.../CassandraMessageIdManagerInjectionTest.java | 6 +-
.../james/data/LdapUsersRepositoryModule.java | 8 +-
.../james/CassandraRabbitMQJamesServerMain.java | 10 +-
.../DistributedTaskManagerModule.java | 28 +-
.../james/modules/TaskSerializationModule.java | 330 +++++++++++++++++++++
.../modules/event/RabbitMQEventBusModule.java | 6 +-
...Operation.java => InitializationOperation.java} | 4 +-
.../utils/InitilizationOperationBuilder.java} | 42 ++-
.../server/ElasticSearchMetricReporterModule.java | 6 +-
.../apache/james/modules/CommonServicesModule.java | 2 -
.../james/modules/server/DNSServiceModule.java | 8 +-
.../modules/server/DropWizardMetricsModule.java | 10 +-
.../modules/server/GuiceMailRepositoryLoader.java | 2 +-
.../modules/server/MailStoreRepositoryModule.java | 8 +-
.../james/utils/GuiceProtocolHandlerLoader.java | 2 +-
.../james/utils/InitializationOperations.java | 22 +-
.../modules/InitializationOperationsTest.java | 14 +-
.../apache/james/utils/ExtensionConfiguration.java | 5 +-
.../org/apache/james/utils/GuiceGenericLoader.java | 12 +-
.../james/modules/server/JMXServerModule.java | 10 +-
.../james/modules/data/JPADomainListModule.java | 8 +-
.../data/JPARecipientRewriteTableModule.java | 6 +-
.../modules/data/JPAUsersRepositoryModule.java | 8 +-
.../java/org/apache/james/JPAJamesServerMain.java | 2 +
.../java/org/apache/james/JPAJamesServerMain.java | 4 +-
.../james/modules/mailbox/DefaultEventModule.java | 6 +-
.../modules/mailbox/MailboxListenerFactory.java | 2 +-
.../modules/mailbox/PreDeletionHookLoaderImpl.java | 2 +-
.../modules/server/CamelMailetContainerModule.java | 18 +-
.../org/apache/james/utils/GuiceMailetLoader.java | 2 +-
.../org/apache/james/utils/GuiceMatcherLoader.java | 2 +-
server/container/guice/memory-guice/pom.xml | 6 +
.../org/apache/james/MemoryJamesServerMain.java | 4 +-
.../james/modules/data/MemoryDataJmapModule.java | 2 +-
.../james/modules/data/MemoryDataModule.java | 16 +-
.../james/modules/mailbox/MemoryMailboxModule.java | 2 +-
.../org/apache/james/GuiceJamesServerTest.java | 8 +-
.../src/test/java/org/apache/james/MyRoute.java} | 17 +-
...rTest.java => WebAdminRoutesExtensionTest.java} | 39 ++-
.../james/modules/protocols/IMAPServerModule.java | 8 +-
.../modules/protocols/JMAPDraftServerModule.java | 8 +-
.../james/modules/protocols/LMTPServerModule.java | 8 +-
.../modules/protocols/ManageSieveServerModule.java | 8 +-
.../james/modules/protocols/POP3ServerModule.java | 8 +-
.../james/modules/protocols/SMTPServerModule.java | 8 +-
server/container/guice/protocols/webadmin/pom.xml | 4 +
.../modules/server/HealthCheckRoutesModule.java | 4 +-
.../james/modules/server/WebAdminServerModule.java | 42 ++-
...urcesMigrationTaskAdditionalInformationDTO.java | 8 +-
...pingsSourcesMigrationTaskSerializationTest.java | 3 +-
.../api/filtering/FilteringManagementContract.java | 22 +-
.../rrt/lib/AbstractRecipientRewriteTableTest.java | 2 +-
.../mailets/remote/delivery/DeliveryRunnable.java | 4 +-
.../integration/AuthorizedEndpointsTest.java | 9 +
...dminServerTaskSerializationIntegrationTest.java | 11 +-
.../CassandraMappingsSolveInconsistenciesTask.java | 7 +-
...sandraMappingsSolveInconsistenciesTaskTest.java | 2 +-
.../james/webadmin/WebAdminConfiguration.java | 31 +-
.../org/apache/james/webadmin/WebAdminServer.java | 34 ++-
.../apache/james/webadmin/WebAdminServerTest.java | 102 +++++++
.../org/apache/james/webadmin/WebAdminUtils.java | 19 +-
.../routes/DeletedMessagesVaultDeleteTask.java | 2 +-
...gesVaultDeleteTaskAdditionalInformationDTO.java | 18 +-
.../routes/DeletedMessagesVaultDeleteTaskDTO.java | 7 +-
.../routes/DeletedMessagesVaultExportTaskDTO.java | 7 +-
.../routes/DeletedMessagesVaultRestoreTaskDTO.java | 8 +-
...edMessagesVaultDeleteTaskSerializationTest.java | 4 +-
...edMessagesVaultExportTaskSerializationTest.java | 2 +-
...dMessagesVaultRestoreTaskSerializationTest.java | 2 +-
.../WebadminApiQuerySerializationContractTest.java | 2 +-
....java => EventDeadLettersRedeliverAllTask.java} | 58 +---
...va => EventDeadLettersRedeliverAllTaskDTO.java} | 21 +-
...ava => EventDeadLettersRedeliverGroupTask.java} | 62 ++--
... => EventDeadLettersRedeliverGroupTaskDTO.java} | 36 ++-
....java => EventDeadLettersRedeliverOneTask.java} | 64 ++--
...va => EventDeadLettersRedeliverOneTaskDTO.java} | 43 ++-
...LettersRedeliveryTaskAdditionalInformation.java | 60 ++++
...tersRedeliveryTaskAdditionalInformationDTO.java | 74 ++++-
.../webadmin/service/EventDeadLettersService.java | 6 +-
.../routes/EventDeadLettersRoutesTest.java | 10 +-
.../service/EventDeadLettersRedeliverTaskTest.java | 110 ++++---
...ClearMailQueueTaskAdditionalInformationDTO.java | 2 +-
.../webadmin/service/ClearMailQueueTaskDTO.java | 9 +-
.../service/DeleteMailsFromMailQueueTaskDTO.java | 6 +-
.../webadmin/service/ClearMailQueueTaskTest.java | 6 +-
.../service/DeleteMailsFromMailQueueTaskTest.java | 8 +-
.../webadmin/service/ClearMailRepositoryTask.java | 18 ++
...MailRepositoryTaskAdditionalInformationDTO.java | 2 +-
.../service/ClearMailRepositoryTaskDTO.java | 15 +-
.../service/ReprocessingAllMailsTaskDTO.java | 8 +-
...cessingOneMailTaskAdditionalInformationDTO.java | 2 +-
.../service/ReprocessingOneMailTaskDTO.java | 8 +-
.../service/ClearMailRepositoryTaskTest.java | 9 +-
.../service/ReprocessingAllMailsTaskTest.java | 6 +-
.../service/ReprocessingOneMailTaskTest.java | 6 +-
.../queue/rabbitmq/RabbitMQMailQueueFactory.java | 8 +-
.../apache/james/task/TaskExecutionDetails.scala | 35 +--
.../org/apache/james/task/MemoryReferenceTask.java | 6 +
.../james/task/MemoryReferenceWithCounterTask.java | 92 ++++++
.../org/apache/james/task/TaskManagerContract.java | 61 ++++
.../distributed/RabbitMQExclusiveConsumer.java | 6 +-
.../distributed/RabbitMQWorkQueue.java | 39 ++-
.../distributed/TasksSerializationModule.java | 37 ++-
.../CassandraTaskExecutionDetailsProjection.scala | 3 +-
...assandraTaskExecutionDetailsProjectionDAO.scala | 53 ++--
.../distributed/RabbitMQWorkQueueSupplier.scala | 3 +-
.../eventsourcing/distributed/TaskEventDTO.scala | 50 +++-
...andraTaskExecutionDetailsProjectionDAOTest.java | 4 +-
...assandraTaskExecutionDetailsProjectionTest.java | 9 +-
.../distributed/DistributedTaskManagerTest.java | 14 +-
.../RabbitMQTerminationSubscriberTest.java | 4 +-
.../distributed/RabbitMQWorkQueueTest.java | 31 +-
.../distributed/TaskEventsSerializationTest.java | 26 +-
.../JsonTaskAdditionalInformationsSerializer.java | 3 +-
.../james/server/task/json/JsonTaskSerializer.java | 3 +-
...nceWithCounterTaskAdditionalInformationDTO.java | 40 +--
...java => MemoryReferenceWithCounterTaskDTO.java} | 8 +-
...va => MemoryReferenceWithCounterTaskStore.java} | 12 +-
.../server/task/json/dto/TestTaskDTOModules.java | 12 +-
.../org/apache/james/task/MemoryTaskManager.java | 21 +-
.../apache/james/task/SerialTaskManagerWorker.java | 20 +-
.../org/apache/james/task/TaskManagerWorker.java | 13 +-
.../james/task/eventsourcing/CommandHandlers.scala | 6 +-
.../eventsourcing/EventSourcingTaskManager.scala | 4 +-
.../apache/james/task/eventsourcing/Events.scala | 17 +-
.../james/task/eventsourcing/TaskAggregate.scala | 13 +-
.../james/task/eventsourcing/TaskCommand.scala | 43 +--
.../TaskExecutionDetailsProjection.scala | 7 +-
.../task/eventsourcing/WorkerStatusListener.scala | 23 +-
.../james/task/SerialTaskManagerWorkerTest.java | 9 +-
.../TerminationSubscriberContract.java | 8 +-
.../james/task/TaskExecutionDetailsFixture.scala | 12 +-
src/site/xdoc/server/config-webadmin.xml | 3 +
src/site/xdoc/server/dev-extend-mailet.xml | 96 +++---
src/site/xdoc/server/dev-extend.xml | 55 ++++
215 files changed, 3056 insertions(+), 2075 deletions(-)
create mode 100644 mailbox/elasticsearch/src/test/resources/eml/htmlContent.txt
rename mailbox/{memory/src/main/java/org/apache/james/mailbox/inmemory => store/src/main/java/org/apache/james/mailbox/store/extractor}/JsoupTextExtractor.java (60%)
rename mailbox/{memory/src/test/java/org/apache/james/mailbox/inmemory => store/src/test/java/org/apache/james/mailbox/store/extractor}/JsoupTextExtractorTest.java (58%)
rename mailbox/{memory => store}/src/test/resources/documents/html.txt (100%)
rename server/container/guice/cassandra-rabbitmq-guice/src/main/java/org/apache/james/{ => modules}/DistributedTaskManagerModule.java (65%)
create mode 100644 server/container/guice/cassandra-rabbitmq-guice/src/main/java/org/apache/james/modules/TaskSerializationModule.java
rename server/container/guice/configuration/src/main/java/org/apache/james/utils/{InitialisationOperation.java => InitializationOperation.java} (93%)
copy server/container/guice/{guice-common/src/main/java/org/apache/james/utils/Startables.java => configuration/src/main/java/org/apache/james/utils/InitilizationOperationBuilder.java} (59%)
copy server/container/guice/{jpa-guice/src/test/java/org/apache/james/JPAJamesServerWithSqlValidationTest.java => memory-guice/src/test/java/org/apache/james/MyRoute.java} (76%)
copy server/container/guice/memory-guice/src/test/java/org/apache/james/{DefaultMemoryJamesServerTest.java => WebAdminRoutesExtensionTest.java} (61%)
copy server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTask.java => EventDeadLettersRedeliverAllTask.java} (59%)
copy server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTaskDTO.java => EventDeadLettersRedeliverAllTaskDTO.java} (72%)
copy server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTask.java => EventDeadLettersRedeliverGroupTask.java} (61%)
copy server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTaskDTO.java => EventDeadLettersRedeliverGroupTaskDTO.java} (57%)
rename server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTask.java => EventDeadLettersRedeliverOneTask.java} (64%)
rename server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTaskDTO.java => EventDeadLettersRedeliverOneTaskDTO.java} (51%)
create mode 100644 server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/EventDeadLettersRedeliveryTaskAdditionalInformation.java
create mode 100644 server/task/task-api/src/test/java/org/apache/james/task/MemoryReferenceWithCounterTask.java
copy backends-common/cassandra/src/main/java/org/apache/james/backends/cassandra/migration/MigrationTaskAdditionalInformationsDTO.java => server/task/task-json/src/test/java/org/apache/james/server/task/json/dto/MemoryReferenceWithCounterTaskAdditionalInformationDTO.java (54%)
copy server/task/task-json/src/test/java/org/apache/james/server/task/json/dto/{MemoryReferenceTaskDTO.java => MemoryReferenceWithCounterTaskDTO.java} (85%)
copy server/task/task-json/src/test/java/org/apache/james/server/task/json/dto/{MemoryReferenceTaskStore.java => MemoryReferenceWithCounterTaskStore.java} (82%)
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org