You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Qi (JIRA)" <ji...@apache.org> on 2015/05/13 05:23:01 UTC
[jira] [Updated] (CAMEL-8769) AWS S3 copy request delete the
source file under bucket root
[ https://issues.apache.org/jira/browse/CAMEL-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Qi updated CAMEL-8769:
----------------------
Summary: AWS S3 copy request delete the source file under bucket root (was: copy request delete the source file under bucket root)
> AWS S3 copy request delete the source file under bucket root
> -------------------------------------------------------------
>
> Key: CAMEL-8769
> URL: https://issues.apache.org/jira/browse/CAMEL-8769
> Project: Camel
> Issue Type: Bug
> Components: camel-aws
> Affects Versions: 2.14.2
> Environment: Windows 7 64 bit, JDK7
> Reporter: Qi
>
> java API CopyObjectRequest delete the source file sometimes:
> case 1. copy from /xxx-workspaces/temp/bbb.txt0 to anywhere
> works properly. after copy, the source file bbb.txt0 still there.
> case 2. copy from /xxx-workspaces/bbb.txt0 to anywhere
> unexpected behaviour! After copy, the source file bbb.txt0 got deleted! CopyObjectRequest is the only request I submitted. but I can see there's "DELETE" request from the log. Also there is lots of "GET" requests to retrieve the log.
> Tested with pure CopyObjectRequest by using aws Java Client API directly, It works fine and no extra "DELETE" and "GET" submitted.
> Code to do the Copy:
> public class CamelS3SaverRouteBuilder extends RouteBuilder {
> ....
> @Override
> public void configure()
> throws Exception {
> ProfileCredentialsProvider awsCredentials = new ProfileCredentialsProvider(AWS_PROFILE_CONFIG_NAME,
> WORKSPACE_BUCKET_NAME);
>
> AmazonS3 client = new AmazonS3Client(awsCredentials);
>
> // Copying object
> CopyObjectRequest copyObjRequest = new CopyObjectRequest(
> srcBucket.bucketName, srcBucket.bucketKey,
> destBucket.bucketName, destBucket.bucketKey);
> client.copyObject(copyObjRequest);
>
> JndiRegistry registry = (JndiRegistry) (
> (PropertyPlaceholderDelegateRegistry)getContext().getRegistry()).getRegistry();
> registry.bind("client", client);
>
> // lets shutdown faster in case of in-flight messages stack up
> getContext().getShutdownStrategy().setTimeout(10);
> onException(Exception.class)
> .handled(true).maximumRedeliveries(3)
> .to("log:error processing message");
>
> from("aws-s3://" + srcBucket.bucketName + "?amazonS3Client=#client®ion=us-east-1")
> .setExchangePattern(ExchangePattern.InOnly)
> .process(new Processor() {
> @Override
> public void process(Exchange exchange) throws Exception {
> /* trashing whatever message after having processed it */
> exchange.getIn().setBody(null);
>
> // stop Camel by signalling to the latch
> latch.countDown();
> }
> })
> .log("Finished file transfer between S3!");
>
> }
> ....
> }
> LOG when deletion happens:
> 13:24:41.257 [ CamelS3SaverRouteBuilder] srcBucket bucketName = xxx-test (0ms)
> 13:24:41.259 [ CamelS3SaverRouteBuilder] srcBucket bucketKey = bbb.txt0 (2ms)
> 13:24:41.259 [ CamelS3SaverRouteBuilder] destBucket bucketName = xxx-workspaces (0ms)
> 13:24:41.259 [ CamelS3SaverRouteBuilder] destBucket bucketKey = user-null/temp/import/999/raw-data/bbb.txt0 (0ms)
> 13:24:41.265 [...camel.main.MainSupport] Apache Camel 2.14.1 starting (6ms)
> 13:24:41.532 [..mpl.DefaultCamelContext] Adding routes from builder: Routes: [] (267ms)
> 13:24:41.533 [..mpl.DefaultCamelContext] Using ComponentResolver: org.apache.camel.impl.DefaultComponentResolver@2c8d23f9 to resolve component with name: properties (1ms)
> 13:24:41.544 [..efaultComponentResolver] Found component: properties in registry: null (11ms)
> 13:24:41.548 [..efaultComponentResolver] Found component: properties via type: org.apache.camel.component.properties.PropertiesComponent via: META-INF/services/org/apache/camel/component/properties (4ms)
> 13:24:42.645 [ com.amazonaws.request] Sending Request: PUT https://xxx-workspaces.s3.amazonaws.com /user-null/temp/import/999/raw-data/bbb.txt0 Headers: (x-amz-copy-source: /xxx-test/bbb.txt0, Content-Length: 0, User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (1097ms)
> 13:24:43.496 [ org.apache.http.wire] >> "PUT /user-null/temp/import/999/raw-data/bbb.txt0 HTTP/1.1[\r][\n]" (851ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Host: xxx-workspaces.s3.amazonaws.com[\r][\n]" (2ms)
> 13:24:43.498 [ org.apache.http.wire] >> "x-amz-copy-source: /xxx-test/bbb.txt0[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:EvEC4VlkWvkf6KDQUMGFG0ImgtA=[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:42 GMT[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Content-Length: 0[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:43.575 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (77ms)
> 13:24:43.581 [ org.apache.http.wire] << "x-amz-id-2: 0U2iXSNdG48eOJChLNe5pOwSWF1aykCkejluv9A4DUH0k4ktmmc9xHgtWdeDvx5Emot7fiyemyg=[\r][\n]" (6ms)
> 13:24:43.582 [ org.apache.http.wire] << "x-amz-request-id: CFC6F4E833716E1C[\r][\n]" (1ms)
> 13:24:43.582 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:18 GMT[\r][\n]" (0ms)
> 13:24:43.582 [ org.apache.http.wire] << "Content-Type: application/xml[\r][\n]" (0ms)
> 13:24:43.582 [ org.apache.http.wire] << "Content-Length: 234[\r][\n]" (0ms)
> 13:24:43.582 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:43.583 [ org.apache.http.wire] << "[\r][\n]" (1ms)
> 13:24:43.605 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (22ms)
> 13:24:43.714 [ org.apache.http.wire] << "<?xml version="1.0" encoding="UTF-8"?>[\n]" (109ms)
> 13:24:43.715 [ org.apache.http.wire] << "<CopyObjectResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><LastModified>2015-05-08T17:25:18.000Z</LastModified><ETag>"9e9ee72bd937cf7b6d7242c64f9214bd"</ETag></CopyObjectResult>" (1ms)
> 13:24:43.723 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: CFC6F4E833716E1C (8ms)
> 13:24:43.761 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) is starting (38ms)
> 13:24:43.761 [..mpl.DefaultCamelContext] Using ClassResolver=org.apache.camel.impl.DefaultClassResolver@60e028e1, PackageScanClassResolver=org.apache.camel.impl.DefaultPackageScanClassResolver@1c9bfd77, ApplicationContextClassLoader=sun.misc.Launcher$AppClassLoader@1667a232 (0ms)
> 13:24:43.762 [..nagedManagementStrategy] JMX is enabled (1ms)
> 13:24:43.763 [...DefaultManagementAgent] Starting JMX agent on server: com.sun.jmx.mbeanserver.JmxMBeanServer@11507b87 (1ms)
> 13:24:43.827 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=context,name="camel-1" (64ms)
> 13:24:43.827 [..rt.TimerListenerManager] Added TimerListener: org.apache.camel.management.mbean.ManagedCamelContext@4efa1bec (0ms)
> 13:24:43.827 [..gementLifecycleStrategy] Registering 1 pre registered services (0ms)
> 13:24:43.831 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="properties" (4ms)
> 13:24:43.865 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultTypeConverter (34ms)
> 13:24:43.877 [..tionTypeConverterLoader] Found 3 packages with 15 @Converter classes to load (12ms)
> 13:24:43.929 [..tionTypeConverterLoader] Loading file META-INF/services/org/apache/camel/TypeConverter to retrieve list of packages, from url: jar:file:/C:/src/qi/xxx/main/webapp/WEB-INF/lib/camel-core-2.14.1.jar!/META-INF/services/org/apache/camel/TypeConverter (52ms)
> 13:24:43.930 [..tionTypeConverterLoader] No additional package names found in classpath for annotated type converters. (1ms)
> 13:24:43.931 [..er.DefaultTypeConverter] Loaded 178 type converters (1ms)
> 13:24:43.939 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=EndpointRegistry (8ms)
> 13:24:43.942 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultExecutorServiceManager (3ms)
> 13:24:43.944 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=SharedProducerServicePool (2ms)
> 13:24:43.945 [..aredProducerServicePool] Starting service pool: org.apache.camel.impl.SharedProducerServicePool@7075cca9 (1ms)
> 13:24:43.947 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultInflightRepository (2ms)
> 13:24:43.950 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultShutdownStrategy (3ms)
> 13:24:43.953 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultPackageScanClassResolver (3ms)
> 13:24:43.961 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultRestRegistry (8ms)
> 13:24:43.965 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=eventnotifiers,name=EventNotifier(0x7bab0b6c) (4ms)
> 13:24:43.970 [..mpl.DefaultCamelContext] Using ComponentResolver: org.apache.camel.impl.DefaultComponentResolver@2c8d23f9 to resolve component with name: aws-s3 (5ms)
> 13:24:43.970 [..efaultComponentResolver] Found component: aws-s3 in registry: null (0ms)
> 13:24:43.972 [..efaultComponentResolver] Found component: aws-s3 via type: org.apache.camel.component.aws.s3.S3Component via: META-INF/services/org/apache/camel/component/aws-s3 (2ms)
> 13:24:43.975 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="aws-s3" (3ms)
> 13:24:43.978 [..l.impl.DefaultComponent] Creating endpoint uri=[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1], path=[xxx-test] (3ms)
> 13:24:43.982 [..il.IntrospectionSupport] Configured property: amazonS3Client on bean: org.apache.camel.component.aws.s3.S3Configuration@550661b8 with value: com.amazonaws.services.s3.AmazonS3Client@15f9a2a4 (4ms)
> 13:24:43.982 [..il.IntrospectionSupport] Configured property: region on bean: org.apache.camel.component.aws.s3.S3Configuration@550661b8 with value: us-east-1 (0ms)
> 13:24:43.989 [..mpl.DefaultCamelContext] aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1 converted to endpoint: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] by component: org.apache.camel.component.aws.s3.S3Component@1d2d2db8 (7ms)
> 13:24:43.993 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=endpoints,name="aws-s3://xxx-test\?amazonS3Client=%23client®ion=us-east-1" (4ms)
> 13:24:43.994 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com / Parameters: (max-keys: 0, ) Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (1ms)
> 13:24:44.390 [ org.apache.http.wire] >> "GET /?max-keys=0 HTTP/1.1[\r][\n]" (396ms)
> 13:24:44.390 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:44.391 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:0a5FG38433Kj9wO2lFfByO4/UR8=[\r][\n]" (1ms)
> 13:24:44.391 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:43 GMT[\r][\n]" (0ms)
> 13:24:44.391 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:44.391 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:44.391 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:44.392 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (1ms)
> 13:24:44.392 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (64ms)
> 13:24:44.456 [ org.apache.http.wire] << "x-amz-id-2: 30pFcCgf7i7WAGPirV1uBiSF8fWhAO66W5dkbvTmXbCRtC45ZlGscQnBds47pAKlZ0t9zRZgVyY=[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "x-amz-request-id: 0F9F8EB13565C850[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:18 GMT[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "Content-Type: application/xml[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "Transfer-Encoding: chunked[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:44.458 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (2ms)
> 13:24:44.460 [ org.apache.http.wire] << "ed[\r][\n]" (2ms)
> 13:24:44.461 [ org.apache.http.wire] << "<?xml version="1.0" encoding="UTF-8"?>[\n]" (1ms)
> 13:24:44.461 [ org.apache.http.wire] << "<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>xxx-test</Name><Prefix></Prefix><Marker></Marker><MaxKeys>0</MaxKeys><IsTruncated>false</IsTruncated></ListBucketResult>" (0ms)
> 13:24:44.461 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:44.461 [ org.apache.http.wire] << "0[\r][\n]" (0ms)
> 13:24:44.461 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:44.462 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: 0F9F8EB13565C850 (1ms)
> 13:24:44.492 [..mpl.DefaultCamelContext] Using ComponentResolver: org.apache.camel.impl.DefaultComponentResolver@2c8d23f9 to resolve component with name: log (30ms)
> 13:24:44.492 [..efaultComponentResolver] Found component: log in registry: null (0ms)
> 13:24:44.494 [..efaultComponentResolver] Found component: log via type: org.apache.camel.component.log.LogComponent via: META-INF/services/org/apache/camel/component/log (2ms)
> 13:24:44.499 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="log" (5ms)
> 13:24:44.500 [..l.impl.DefaultComponent] Creating endpoint uri=[log://error%20processing%20message], path=[error processing message] (1ms)
> 13:24:44.504 [..mpl.DefaultCamelContext] log://error%20processing%20message converted to endpoint: Endpoint[log://error%20processing%20message] by component: org.apache.camel.component.log.LogComponent@460bfa3c (4ms)
> 13:24:44.509 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=endpoints,name="log://error%20processing%20message" (5ms)
> 13:24:44.517 [..erceptor.DefaultChannel] Initialize channel for target: 'To[log:error processing message]' (8ms)
> 13:24:44.528 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=tracer,name=BacklogTracer (11ms)
> 13:24:44.539 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=tracer,name=BacklogDebugger (11ms)
> 13:24:44.545 [..erceptor.DefaultChannel] Initialize channel for target: 'setExchangePattern[pattern: InOnly]' (6ms)
> 13:24:44.561 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=errorhandlers,name="DefaultErrorHandlerBuilder(ref:CamelDefaultErrorHandlerBuilder)" (16ms)
> 13:24:44.574 [..mel.model.LogDefinition] The LogName is null. Falling back to create logger by using the route id route1. (13ms)
> 13:24:44.575 [..erceptor.DefaultChannel] Initialize channel for target: 'Log[Starting file transfer between S3...]' (1ms)
> 13:24:44.577 [..erceptor.DefaultChannel] Initialize channel for target: 'process[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]' (2ms)
> 13:24:44.579 [..mel.model.LogDefinition] The LogName is null. Falling back to create logger by using the route id route1. (2ms)
> 13:24:44.579 [..erceptor.DefaultChannel] Initialize channel for target: 'Log[Finished file transfer between S3!]' (0ms)
> 13:24:44.586 [..mpl.DefaultCamelContext] AllowUseOriginalMessage is enabled. If access to the original message is not needed, then its recommended to turn this option off as it may improve performance. (7ms)
> 13:24:44.586 [..mpl.DefaultCamelContext] StreamCaching is not in use. If using streams then its recommended to enable stream caching. See more details at http://camel.apache.org/stream-caching.html (0ms)
> 13:24:44.587 [..mpl.DefaultCamelContext] Warming up route id: route1 having autoStartup=true (1ms)
> 13:24:44.587 [..camel.impl.RouteService] Starting services on route: route1 (0ms)
> 13:24:44.592 [..camel.impl.RouteService] Starting child service on route: route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]] (5ms)
> 13:24:44.598 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=producers,name=LogProducer(0x89b2158) (6ms)
> 13:24:44.598 [..mponent.log.LogProducer] Starting producer: Producer[log://error%20processing%20message] (0ms)
> 13:24:44.599 [..amel.impl.ProducerCache] Adding to producer cache with key: Endpoint[log://error%20processing%20message] for producer: Producer[log://error%20processing%20message] (1ms)
> 13:24:44.599 [..sor.DefaultErrorHandler] Redelivery enabled: true on error handler: DefaultErrorHandler[Instrumentation:setExchangePattern[SetExchangePattern[InOnly]]] (0ms)
> 13:24:44.610 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=threadpools,name="ErrorHandlerRedeliveryThreadPool" (11ms)
> 13:24:44.610 [..tExecutorServiceManager] Created new ScheduledThreadPool for source: ErrorHandlerRedeliveryThreadPool with name: ErrorHandlerRedeliveryTask. -> org.apache.camel.util.concurrent.SizedScheduledExecutorService@4e67f43b[ErrorHandlerRedeliveryTask] (0ms)
> 13:24:44.610 [..sor.DefaultErrorHandler] Redelivery enabled: true on error handler: DefaultErrorHandler[Instrumentation:log[Log(route1)[Starting file transfer between S3...]]] (0ms)
> 13:24:44.610 [..sor.DefaultErrorHandler] Redelivery enabled: true on error handler: DefaultErrorHandler[Instrumentation:process[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]]] (0ms)
> 13:24:44.610 [..sor.DefaultErrorHandler] Redelivery enabled: true on error handler: DefaultErrorHandler[Instrumentation:log[Log(route1)[Finished file transfer between S3!]]] (0ms)
> 13:24:44.610 [..camel.impl.RouteService] Starting child service on route: route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]] (0ms)
> 13:24:44.610 [..camel.impl.RouteService] Starting child service on route: route1 -> SetExchangePattern[InOnly] (0ms)
> 13:24:44.622 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="setExchangePattern1" (12ms)
> 13:24:44.622 [..camel.impl.RouteService] Starting child service on route: route1 -> Channel[SetExchangePattern[InOnly]] (0ms)
> 13:24:44.622 [..camel.impl.RouteService] Starting child service on route: route1 -> Log(route1)[Starting file transfer between S3...] (0ms)
> 13:24:44.626 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="log1" (4ms)
> 13:24:44.627 [..camel.impl.RouteService] Starting child service on route: route1 -> Channel[Log(route1)[Starting file transfer between S3...]] (1ms)
> 13:24:44.627 [..camel.impl.RouteService] Starting child service on route: route1 -> DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e] (0ms)
> 13:24:44.631 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="process1" (4ms)
> 13:24:44.631 [..camel.impl.RouteService] Starting child service on route: route1 -> Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]] (0ms)
> 13:24:44.631 [..camel.impl.RouteService] Starting child service on route: route1 -> Log(route1)[Finished file transfer between S3!] (0ms)
> 13:24:44.635 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="log2" (4ms)
> 13:24:44.635 [..camel.impl.RouteService] Starting child service on route: route1 -> Channel[Log(route1)[Finished file transfer between S3!]] (0ms)
> 13:24:44.648 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=routes,name="route1" (13ms)
> 13:24:44.648 [..rt.TimerListenerManager] Added TimerListener: org.apache.camel.management.mbean.ManagedSuspendableRoute@60bb132e (0ms)
> 13:24:44.648 [..mpl.DefaultCamelContext] Route: route1 >>> EventDrivenConsumerRoute[Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]]] (0ms)
> 13:24:44.649 [..mpl.DefaultCamelContext] Starting consumer (order: 1000) on route: route1 (1ms)
> 13:24:44.655 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=consumers,name=S3Consumer(0x218a968b) (6ms)
> 13:24:44.655 [..onent.aws.s3.S3Consumer] Starting consumer: S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: initialDelay on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: 1000 (4ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: timeUnit on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: MILLISECONDS (0ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: scheduledExecutorService on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: null (0ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: useFixedDelay on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: true (0ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: delay on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: 500 (0ms)
> 13:24:44.661 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=threadpools,name="S3Consumer(0x218a968b)" (2ms)
> 13:24:44.662 [..tExecutorServiceManager] Created new ScheduledThreadPool for source: S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] with name: aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1. -> org.apache.camel.util.concurrent.SizedScheduledExecutorService@1174d546[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (1ms)
> 13:24:44.662 [..edPollConsumerScheduler] Scheduling poll (fixed delay) with initialDelay: 1000, delay: 500 (milliseconds) for: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
> 13:24:44.666 [..mpl.DefaultCamelContext] Route: route1 started and consuming from: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (4ms)
> 13:24:44.666 [..gementLifecycleStrategy] Load performance statistics disabled (0ms)
> 13:24:44.666 [..mpl.DefaultCamelContext] Total 1 routes, of which 1 is started. (0ms)
> 13:24:44.668 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) started in 0.905 seconds (2ms)
> 13:24:45.665 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com / Parameters: (max-keys: 10, ) Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (997ms)
> 13:24:45.669 [ org.apache.http.wire] >> "GET /?max-keys=10 HTTP/1.1[\r][\n]" (4ms)
> 13:24:45.669 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:+RL93PYc7l7fbSL1wCIBzmi547g=[\r][\n]" (1ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:45 GMT[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:45.906 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (236ms)
> 13:24:45.907 [ org.apache.http.wire] << "x-amz-id-2: Gq/0uubPkJRiyi6Am5iuUmxZn6w/1b7JzF58u5GqHtY7UwfMxT289+GakyeTmLKh0/Ov1UNrnyE=[\r][\n]" (1ms)
> 13:24:45.907 [ org.apache.http.wire] << "x-amz-request-id: FA7EB44DD92B1343[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:20 GMT[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "Content-Type: application/xml[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "Transfer-Encoding: chunked[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:45.907 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (0ms)
> 13:24:45.909 [ org.apache.http.wire] << "512[\r][\n]" (2ms)
> 13:24:45.909 [ org.apache.http.wire] << "<?xml version="1.0" encoding="UTF-8"?>[\n]" (0ms)
> 13:24:45.909 [ org.apache.http.wire] << "<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>xxx-test</Name><Prefix></Prefix><Marker></Marker><MaxKeys>10</MaxKeys><IsTruncated>false</IsTruncated><Contents><Key>abc12.txt</Key><LastModified>2015-05-07T20:36:02.000Z</LastModified><ETag>"3f376a7d147c8c2e0d28d0da97d70999"</ETag><Size>2733677708</Size><Owner><ID>52a027bcc58ec546c69a154a6668993008ca81ad219aa22f4480667b7dccad90</ID><DisplayName>cscdigitalmarketing-billing</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>bbb.txt0</Key><LastModified>2015-05-08T17:25:08.000Z</LastModified><ETag>"9e9ee72bd937cf7b6d7242c64f9214bd"</ETag><Size>10</Size><Owner><ID>52a027bcc58ec546c69a154a6668993008ca81ad219aa22f4480667b7dccad90</ID><DisplayName>cscdigitalmarketing-billing</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>test/2015/abc12.txt</Key><LastModified>2015-05-07T19:53:40.000Z</LastModified><ETag>"3f376a7d147c8c2e0d28d0da97d70999"</ETag><Size>2733677708</Size><Owner><ID>52a027bcc58ec546c69a154a6668993008ca81ad219aa22f4480667b7dccad90</ID><DisplayName>cscdigitalmarketing-billing</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents></ListBucketResult>" (0ms)
> 13:24:45.909 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:45.910 [ org.apache.http.wire] << "0[\r][\n]" (1ms)
> 13:24:45.910 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:45.916 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: FA7EB44DD92B1343 (6ms)
> 13:24:45.918 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com /abc12.txt Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (2ms)
> 13:24:45.920 [ org.apache.http.wire] >> "GET /abc12.txt HTTP/1.1[\r][\n]" (2ms)
> 13:24:45.920 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:45.920 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:GBtozfcK1psdSlgyP9MlwIIxZHA=[\r][\n]" (0ms)
> 13:24:45.920 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:45 GMT[\r][\n]" (0ms)
> 13:24:45.920 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:45.920 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:45.921 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (1ms)
> 13:24:45.921 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:45.921 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:46.058 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (137ms)
> 13:24:46.058 [ org.apache.http.wire] << "x-amz-id-2: wRPHWaZ38MDI9slzGQPSVMxMqOUCrkzCGqXmXxnR0981lp72DdwnlG31lP6Hg+zS3V90vdvkGrQ=[\r][\n]" (0ms)
> 13:24:46.059 [ org.apache.http.wire] << "x-amz-request-id: 9183346338F941B7[\r][\n]" (1ms)
> 13:24:46.059 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:20 GMT[\r][\n]" (0ms)
> 13:24:46.059 [ org.apache.http.wire] << "x-amz-meta-gid: 1001[\r][\n]" (0ms)
> 13:24:46.059 [ org.apache.http.wire] << "x-amz-meta-mtime: 1431028974[\r][\n]" (0ms)
> 13:24:46.060 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]" (1ms)
> 13:24:46.060 [ org.apache.http.wire] << "x-amz-meta-uid: 1001[\r][\n]" (0ms)
> 13:24:46.060 [ org.apache.http.wire] << "x-amz-meta-mode: 33204[\r][\n]" (0ms)
> 13:24:46.060 [ org.apache.http.wire] << "Last-Modified: Thu, 07 May 2015 20:36:02 GMT[\r][\n]" (0ms)
> 13:24:46.060 [ org.apache.http.wire] << "ETag: "3f376a7d147c8c2e0d28d0da97d70999"[\r][\n]" (0ms)
> 13:24:46.061 [ org.apache.http.wire] << "Accept-Ranges: bytes[\r][\n]" (1ms)
> 13:24:46.061 [ org.apache.http.wire] << "Content-Type: text/plain[\r][\n]" (0ms)
> 13:24:46.061 [ org.apache.http.wire] << "Content-Length: 2733677708[\r][\n]" (0ms)
> 13:24:46.061 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:46.061 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:46.062 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
> 13:24:46.086 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: 9183346338F941B7 (24ms)
> 13:24:46.092 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com /bbb.txt0 Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (6ms)
> 13:24:46.370 [ org.apache.http.wire] >> "GET /bbb.txt0 HTTP/1.1[\r][\n]" (278ms)
> 13:24:46.370 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:241o6egyQEetCin2uT/Yd/SaaT0=[\r][\n]" (1ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:46 GMT[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:46.372 [ org.apache.http.wire] >> "[\r][\n]" (1ms)
> 13:24:46.447 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (75ms)
> 13:24:46.448 [ org.apache.http.wire] << "x-amz-id-2: LuxT43ah+N02FkH38qAPPEEOu/2wFnc7kroRXLoJV/zyp1UW24Dtw5hahvgAgwgxGa0dQYpy5EY=[\r][\n]" (1ms)
> 13:24:46.448 [ org.apache.http.wire] << "x-amz-request-id: 5782AC9143E67431[\r][\n]" (0ms)
> 13:24:46.448 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:20 GMT[\r][\n]" (0ms)
> 13:24:46.448 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]" (0ms)
> 13:24:46.448 [ org.apache.http.wire] << "Last-Modified: Fri, 08 May 2015 17:25:08 GMT[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "ETag: "9e9ee72bd937cf7b6d7242c64f9214bd"[\r][\n]" (1ms)
> 13:24:46.449 [ org.apache.http.wire] << "Accept-Ranges: bytes[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "Content-Type: text/plain[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "Content-Length: 10[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:46.450 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
> 13:24:46.451 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: 5782AC9143E67431 (1ms)
> 13:24:46.451 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com /test/2015/abc12.txt Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (0ms)
> 13:24:46.695 [ org.apache.http.wire] >> "GET /test/2015/abc12.txt HTTP/1.1[\r][\n]" (244ms)
> 13:24:46.695 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:46.695 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:Y3S5FBOh6Sx+DIu4hmma762kzmE=[\r][\n]" (0ms)
> 13:24:46.695 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:46 GMT[\r][\n]" (0ms)
> 13:24:46.695 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:46.696 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (1ms)
> 13:24:46.696 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:46.696 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:46.696 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:46.896 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (200ms)
> 13:24:46.896 [ org.apache.http.wire] << "x-amz-id-2: WElpbJnvgDm2sKYpUTdGaN5NCGFFdCj6nE4PsOxhU7opXOoZcRgCv91q/dtzL3Y0RgtXv4h51Sg=[\r][\n]" (0ms)
> 13:24:46.896 [ org.apache.http.wire] << "x-amz-request-id: 618C9C6B8F2E187B[\r][\n]" (0ms)
> 13:24:46.896 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:21 GMT[\r][\n]" (0ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-gid: 1001[\r][\n]" (1ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-mtime: 1431028232[\r][\n]" (0ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]" (0ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-uid: 1001[\r][\n]" (0ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-mode: 33204[\r][\n]" (0ms)
> 13:24:46.898 [ org.apache.http.wire] << "Last-Modified: Thu, 07 May 2015 19:53:40 GMT[\r][\n]" (1ms)
> 13:24:46.898 [ org.apache.http.wire] << "ETag: "3f376a7d147c8c2e0d28d0da97d70999"[\r][\n]" (0ms)
> 13:24:46.898 [ org.apache.http.wire] << "Accept-Ranges: bytes[\r][\n]" (0ms)
> 13:24:46.898 [ org.apache.http.wire] << "Content-Type: text/plain[\r][\n]" (0ms)
> 13:24:46.898 [ org.apache.http.wire] << "Content-Length: 2733677708[\r][\n]" (0ms)
> 13:24:46.899 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (1ms)
> 13:24:46.899 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:46.900 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
> 13:24:46.901 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: 618C9C6B8F2E187B (1ms)
> 13:24:46.928 [ route1] Starting file transfer between S3... (27ms)
> 13:24:46.928 [..amelS3SaverRouteBuilder] Processing... (0ms)
> 13:24:46.928 [...camel.main.MainSupport] Apache Camel 2.14.1 stopping (0ms)
> 13:24:46.928 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) is shutting down (0ms)
> 13:24:46.929 [ route1] Finished file transfer between S3! (1ms)
> 13:24:46.929 [..DefaultShutdownStrategy] Starting to graceful shutdown 1 routes (timeout 10 seconds) (0ms)
> 13:24:46.929 [ com.amazonaws.request] Sending Request: DELETE https://xxx-test.s3.amazonaws.com /abc12.txt Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (0ms)
> 13:24:46.932 [..tExecutorServiceManager] Created new ThreadPool for source: org.apache.camel.impl.DefaultShutdownStrategy@20ad3a7a with name: ShutdownTask. -> org.apache.camel.util.concurrent.RejectableThreadPoolExecutor@3c443007[Running, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0][ShutdownTask] (3ms)
> 13:24:46.935 [..DefaultShutdownStrategy] There are 1 routes to shutdown (3ms)
> 13:24:46.937 [..DefaultShutdownStrategy] Route: route1 suspended and shutdown deferred, was consuming from: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (2ms)
> 13:24:46.937 [..DefaultShutdownStrategy] Waiting as there are still 1 inflight and pending exchanges to complete, timeout in 10 seconds. (0ms)
> 13:24:47.190 [ org.apache.http.wire] >> "DELETE /abc12.txt HTTP/1.1[\r][\n]" (253ms)
> 13:24:47.190 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:47.190 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:FAeigwZab6FKtgvT9+KWTFYZSbM=[\r][\n]" (0ms)
> 13:24:47.190 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:46 GMT[\r][\n]" (0ms)
> 13:24:47.190 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:47.191 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (1ms)
> 13:24:47.191 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:47.191 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:47.191 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:47.279 [ org.apache.http.wire] << "HTTP/1.1 204 No Content[\r][\n]" (88ms)
> 13:24:47.279 [ org.apache.http.wire] << "x-amz-id-2: xbTWOgHJWqro7cjTekdIwriz3jKVWp+2nVloj+SNqqtQXRiVDtmzy6OhOXMe4/xst4/P/rPwavw=[\r][\n]" (0ms)
> 13:24:47.279 [ org.apache.http.wire] << "x-amz-request-id: F6AD4E2E785E0AEA[\r][\n]" (0ms)
> 13:24:47.279 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:21 GMT[\r][\n]" (0ms)
> 13:24:47.280 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]" (1ms)
> 13:24:47.280 [ org.apache.http.wire] << "x-amz-delete-marker: true[\r][\n]" (0ms)
> 13:24:47.280 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:47.280 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:47.281 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
> 13:24:47.281 [ com.amazonaws.request] Received successful response: 204, AWS Request ID: F6AD4E2E785E0AEA (0ms)
> 13:24:47.937 [..DefaultShutdownStrategy] Route: route1 preparing to shutdown complete. (656ms)
> 13:24:47.937 [..edPollConsumerScheduler] This consumer is stopping, so cancelling scheduled task: java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2486bd80 (0ms)
> 13:24:47.937 [..onent.aws.s3.S3Consumer] Stopping consumer: S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
> 13:24:47.938 [..aredProducerServicePool] Stopping service pool: org.apache.camel.impl.SharedProducerServicePool@7075cca9 (1ms)
> 13:24:47.938 [..mponent.log.LogProducer] Stopping producer: Producer[log://error%20processing%20message] (0ms)
> 13:24:47.938 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=producers,name=LogProducer(0x89b2158) (0ms)
> 13:24:47.939 [..DefaultShutdownStrategy] Route: route1 shutdown complete, was consuming from: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (1ms)
> 13:24:47.939 [..DefaultShutdownStrategy] Graceful shutdown of 1 routes completed in 1 seconds (0ms)
> 13:24:47.940 [..rt.TimerListenerManager] Removed TimerListener: org.apache.camel.management.mbean.ManagedSuspendableRoute@60bb132e (1ms)
> 13:24:47.940 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=routes,name="route1" (0ms)
> 13:24:47.940 [..camel.impl.RouteService] Stopping services on route: route1 (0ms)
> 13:24:47.940 [..camel.impl.RouteService] Shutting down child service on route: route1 -> S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
> 13:24:47.940 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=consumers,name=S3Consumer(0x218a968b) (0ms)
> 13:24:47.941 [..tExecutorServiceManager] Forcing shutdown of ExecutorService: org.apache.camel.util.concurrent.SizedScheduledExecutorService@1174d546[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (1ms)
> 13:24:47.941 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=threadpools,name="S3Consumer(0x218a968b)" (0ms)
> 13:24:47.941 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]] (1ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> SetExchangePattern[InOnly] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Channel[SetExchangePattern[InOnly]] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Log(route1)[Starting file transfer between S3...] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Channel[Log(route1)[Starting file transfer between S3...]] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Log(route1)[Finished file transfer between S3!] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Channel[Log(route1)[Finished file transfer between S3!]] (0ms)
> 13:24:47.943 [..camel.impl.RouteService] Shutting down services on route: route1 (1ms)
> 13:24:47.943 [..tExecutorServiceManager] Forcing shutdown of ExecutorService: org.apache.camel.util.concurrent.SizedScheduledExecutorService@4e67f43b[ErrorHandlerRedeliveryTask] (0ms)
> 13:24:47.944 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=threadpools,name="ErrorHandlerRedeliveryThreadPool" (1ms)
> 13:24:47.944 [..rt.TimerListenerManager] Removed TimerListener: org.apache.camel.management.mbean.ManagedCamelContext@a03313c (0ms)
> 13:24:47.944 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=context,name="camel-1" (0ms)
> 13:24:47.945 [..tExecutorServiceManager] Forcing shutdown of ExecutorService: org.apache.camel.util.concurrent.RejectableThreadPoolExecutor@3c443007[Running, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 1][ShutdownTask] (1ms)
> 13:24:47.945 [..faultInflightRepository] Shutting down with no inflight exchanges. (0ms)
> 13:24:47.946 [...camel.util.EventHelper] Ignoring notifying event Stopped CamelContext: camel-1. The EventNotifier has not been started yet: org.apache.camel.impl.DefaultRuntimeEndpointRegistry@7bab0b6c (1ms)
> 13:24:47.946 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultTypeConverter (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=eventnotifiers,name=EventNotifier(0x7bab0b6c) (1ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=SharedProducerServicePool (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="setExchangePattern1" (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="aws-s3" (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultRestRegistry (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=EndpointRegistry (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="log1" (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultPackageScanClassResolver (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=errorhandlers,name="DefaultErrorHandlerBuilder(ref:CamelDefaultErrorHandlerBuilder)" (1ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="process1" (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=endpoints,name="log://error%20processing%20message" (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=tracer,name=BacklogTracer (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="properties" (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="log" (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=tracer,name=BacklogDebugger (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="log2" (0ms)
> 13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultInflightRepository (1ms)
> 13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=endpoints,name="aws-s3://xxx-test\?amazonS3Client=%23client®ion=us-east-1" (0ms)
> 13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultShutdownStrategy (0ms)
> 13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultExecutorServiceManager (0ms)
> 13:24:47.949 [..il.IntrospectionSupport] Clearing cache[size=42, hits=57, misses=46, evicted=0] (0ms)
> 13:24:47.954 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) uptime 4.193 seconds (5ms)
> 13:24:47.955 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) is shutdown in 1.026 seconds (1ms)
> 13:24:47.956 [..pport$HangupInterceptor] Received hang up - stopping the main instance. (1ms)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)