You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Willem Jiang (JIRA)" <ji...@apache.org> on 2015/05/15 04:28:01 UTC
[jira] [Commented] (CAMEL-8769) AWS S3 copy request delete the
source file under bucket root
[ https://issues.apache.org/jira/browse/CAMEL-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544802#comment-14544802 ]
Willem Jiang commented on CAMEL-8769:
-------------------------------------
If you take a look at the [camel-aws-s3|https://camel.apache.org/aws-s3.html] document, you can find the default option value of "deleteAfterRead" is true.
It means that camel alway delete the file when it finish the processing the S3 file. If you don't delete the file you may hit another issue CAMEL-8431 which should be addressed in Camel 2.14.3.
>From the log message there still a inflight message there, I think it could explain that why the file /xxx-workspaces/bbb.txt0 is not deleted yet.
BTW, please use email to discuss this kind of issue first, if it's an issue of Camel we can create a JIRA then.
> AWS S3 copy request delete the source file under bucket root
> -------------------------------------------------------------
>
> Key: CAMEL-8769
> URL: https://issues.apache.org/jira/browse/CAMEL-8769
> Project: Camel
> Issue Type: Bug
> Components: camel-aws
> Affects Versions: 2.14.2
> Environment: Windows 7 64 bit, JDK7
> Reporter: Qi
> Assignee: Willem Jiang
>
> java API CopyObjectRequest delete the source file sometimes:
> case 1. copy from /xxx-workspaces/temp/bbb.txt0 to anywhere
> works properly. after copy, the source file bbb.txt0 still there.
> case 2. copy from /xxx-workspaces/bbb.txt0 to anywhere
> unexpected behaviour! After copy, the source file bbb.txt0 got deleted! CopyObjectRequest is the only request I submitted. but I can see there's "DELETE" request from the log. Also there is lots of "GET" requests to retrieve the log.
> Tested with pure CopyObjectRequest by using aws Java Client API directly, It works fine and no extra "DELETE" and "GET" submitted.
> Code to do the Copy:
> {code:java}
> public class CamelS3SaverRouteBuilder extends RouteBuilder {
> ....
> @Override
> public void configure()
> throws Exception {
> ProfileCredentialsProvider awsCredentials = new ProfileCredentialsProvider(AWS_PROFILE_CONFIG_NAME,
> WORKSPACE_BUCKET_NAME);
>
> AmazonS3 client = new AmazonS3Client(awsCredentials);
>
> // Copying object
> CopyObjectRequest copyObjRequest = new CopyObjectRequest(
> srcBucket.bucketName, srcBucket.bucketKey,
> destBucket.bucketName, destBucket.bucketKey);
> client.copyObject(copyObjRequest);
>
> JndiRegistry registry = (JndiRegistry) (
> (PropertyPlaceholderDelegateRegistry)getContext().getRegistry()).getRegistry();
> registry.bind("client", client);
>
> // lets shutdown faster in case of in-flight messages stack up
> getContext().getShutdownStrategy().setTimeout(10);
> onException(Exception.class)
> .handled(true).maximumRedeliveries(3)
> .to("log:error processing message");
>
> from("aws-s3://" + srcBucket.bucketName + "?amazonS3Client=#client®ion=us-east-1")
> .setExchangePattern(ExchangePattern.InOnly)
> .process(new Processor() {
> @Override
> public void process(Exchange exchange) throws Exception {
> /* trashing whatever message after having processed it */
> exchange.getIn().setBody(null);
>
> // stop Camel by signalling to the latch
> latch.countDown();
> }
> })
> .log("Finished file transfer between S3!");
>
> }
> ....
> }
> {code}
> LOG when deletion happens:
> {panel}
> 13:24:41.257 [ CamelS3SaverRouteBuilder] srcBucket bucketName = xxx-test (0ms)
> 13:24:41.259 [ CamelS3SaverRouteBuilder] srcBucket bucketKey = bbb.txt0 (2ms)
> 13:24:41.259 [ CamelS3SaverRouteBuilder] destBucket bucketName = xxx-workspaces (0ms)
> 13:24:41.259 [ CamelS3SaverRouteBuilder] destBucket bucketKey = user-null/temp/import/999/raw-data/bbb.txt0 (0ms)
> 13:24:41.265 [...camel.main.MainSupport] Apache Camel 2.14.1 starting (6ms)
> 13:24:41.532 [..mpl.DefaultCamelContext] Adding routes from builder: Routes: [] (267ms)
> 13:24:41.533 [..mpl.DefaultCamelContext] Using ComponentResolver: org.apache.camel.impl.DefaultComponentResolver@2c8d23f9 to resolve component with name: properties (1ms)
> 13:24:41.544 [..efaultComponentResolver] Found component: properties in registry: null (11ms)
> 13:24:41.548 [..efaultComponentResolver] Found component: properties via type: org.apache.camel.component.properties.PropertiesComponent via: META-INF/services/org/apache/camel/component/properties (4ms)
> 13:24:42.645 [ com.amazonaws.request] Sending Request: PUT https://xxx-workspaces.s3.amazonaws.com /user-null/temp/import/999/raw-data/bbb.txt0 Headers: (x-amz-copy-source: /xxx-test/bbb.txt0, Content-Length: 0, User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (1097ms)
> 13:24:43.496 [ org.apache.http.wire] >> "PUT /user-null/temp/import/999/raw-data/bbb.txt0 HTTP/1.1[\r][\n]" (851ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Host: xxx-workspaces.s3.amazonaws.com[\r][\n]" (2ms)
> 13:24:43.498 [ org.apache.http.wire] >> "x-amz-copy-source: /xxx-test/bbb.txt0[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:EvEC4VlkWvkf6KDQUMGFG0ImgtA=[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:42 GMT[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Content-Length: 0[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:43.498 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:43.575 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (77ms)
> 13:24:43.581 [ org.apache.http.wire] << "x-amz-id-2: 0U2iXSNdG48eOJChLNe5pOwSWF1aykCkejluv9A4DUH0k4ktmmc9xHgtWdeDvx5Emot7fiyemyg=[\r][\n]" (6ms)
> 13:24:43.582 [ org.apache.http.wire] << "x-amz-request-id: CFC6F4E833716E1C[\r][\n]" (1ms)
> 13:24:43.582 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:18 GMT[\r][\n]" (0ms)
> 13:24:43.582 [ org.apache.http.wire] << "Content-Type: application/xml[\r][\n]" (0ms)
> 13:24:43.582 [ org.apache.http.wire] << "Content-Length: 234[\r][\n]" (0ms)
> 13:24:43.582 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:43.583 [ org.apache.http.wire] << "[\r][\n]" (1ms)
> 13:24:43.605 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (22ms)
> 13:24:43.714 [ org.apache.http.wire] << "<?xml version="1.0" encoding="UTF-8"?>[\n]" (109ms)
> 13:24:43.715 [ org.apache.http.wire] << "<CopyObjectResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><LastModified>2015-05-08T17:25:18.000Z</LastModified><ETag>"9e9ee72bd937cf7b6d7242c64f9214bd"</ETag></CopyObjectResult>" (1ms)
> 13:24:43.723 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: CFC6F4E833716E1C (8ms)
> 13:24:43.761 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) is starting (38ms)
> 13:24:43.761 [..mpl.DefaultCamelContext] Using ClassResolver=org.apache.camel.impl.DefaultClassResolver@60e028e1, PackageScanClassResolver=org.apache.camel.impl.DefaultPackageScanClassResolver@1c9bfd77, ApplicationContextClassLoader=sun.misc.Launcher$AppClassLoader@1667a232 (0ms)
> 13:24:43.762 [..nagedManagementStrategy] JMX is enabled (1ms)
> 13:24:43.763 [...DefaultManagementAgent] Starting JMX agent on server: com.sun.jmx.mbeanserver.JmxMBeanServer@11507b87 (1ms)
> 13:24:43.827 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=context,name="camel-1" (64ms)
> 13:24:43.827 [..rt.TimerListenerManager] Added TimerListener: org.apache.camel.management.mbean.ManagedCamelContext@4efa1bec (0ms)
> 13:24:43.827 [..gementLifecycleStrategy] Registering 1 pre registered services (0ms)
> 13:24:43.831 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="properties" (4ms)
> 13:24:43.865 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultTypeConverter (34ms)
> 13:24:43.877 [..tionTypeConverterLoader] Found 3 packages with 15 @Converter classes to load (12ms)
> 13:24:43.929 [..tionTypeConverterLoader] Loading file META-INF/services/org/apache/camel/TypeConverter to retrieve list of packages, from url: jar:file:/C:/src/qi/xxx/main/webapp/WEB-INF/lib/camel-core-2.14.1.jar!/META-INF/services/org/apache/camel/TypeConverter (52ms)
> 13:24:43.930 [..tionTypeConverterLoader] No additional package names found in classpath for annotated type converters. (1ms)
> 13:24:43.931 [..er.DefaultTypeConverter] Loaded 178 type converters (1ms)
> 13:24:43.939 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=EndpointRegistry (8ms)
> 13:24:43.942 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultExecutorServiceManager (3ms)
> 13:24:43.944 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=SharedProducerServicePool (2ms)
> 13:24:43.945 [..aredProducerServicePool] Starting service pool: org.apache.camel.impl.SharedProducerServicePool@7075cca9 (1ms)
> 13:24:43.947 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultInflightRepository (2ms)
> 13:24:43.950 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultShutdownStrategy (3ms)
> 13:24:43.953 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultPackageScanClassResolver (3ms)
> 13:24:43.961 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultRestRegistry (8ms)
> 13:24:43.965 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=eventnotifiers,name=EventNotifier(0x7bab0b6c) (4ms)
> 13:24:43.970 [..mpl.DefaultCamelContext] Using ComponentResolver: org.apache.camel.impl.DefaultComponentResolver@2c8d23f9 to resolve component with name: aws-s3 (5ms)
> 13:24:43.970 [..efaultComponentResolver] Found component: aws-s3 in registry: null (0ms)
> 13:24:43.972 [..efaultComponentResolver] Found component: aws-s3 via type: org.apache.camel.component.aws.s3.S3Component via: META-INF/services/org/apache/camel/component/aws-s3 (2ms)
> 13:24:43.975 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="aws-s3" (3ms)
> 13:24:43.978 [..l.impl.DefaultComponent] Creating endpoint uri=[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1], path=[xxx-test] (3ms)
> 13:24:43.982 [..il.IntrospectionSupport] Configured property: amazonS3Client on bean: org.apache.camel.component.aws.s3.S3Configuration@550661b8 with value: com.amazonaws.services.s3.AmazonS3Client@15f9a2a4 (4ms)
> 13:24:43.982 [..il.IntrospectionSupport] Configured property: region on bean: org.apache.camel.component.aws.s3.S3Configuration@550661b8 with value: us-east-1 (0ms)
> 13:24:43.989 [..mpl.DefaultCamelContext] aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1 converted to endpoint: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] by component: org.apache.camel.component.aws.s3.S3Component@1d2d2db8 (7ms)
> 13:24:43.993 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=endpoints,name="aws-s3://xxx-test\?amazonS3Client=%23client®ion=us-east-1" (4ms)
> 13:24:43.994 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com / Parameters: (max-keys: 0, ) Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (1ms)
> 13:24:44.390 [ org.apache.http.wire] >> "GET /?max-keys=0 HTTP/1.1[\r][\n]" (396ms)
> 13:24:44.390 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:44.391 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:0a5FG38433Kj9wO2lFfByO4/UR8=[\r][\n]" (1ms)
> 13:24:44.391 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:43 GMT[\r][\n]" (0ms)
> 13:24:44.391 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:44.391 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:44.391 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:44.392 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (1ms)
> 13:24:44.392 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (64ms)
> 13:24:44.456 [ org.apache.http.wire] << "x-amz-id-2: 30pFcCgf7i7WAGPirV1uBiSF8fWhAO66W5dkbvTmXbCRtC45ZlGscQnBds47pAKlZ0t9zRZgVyY=[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "x-amz-request-id: 0F9F8EB13565C850[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:18 GMT[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "Content-Type: application/xml[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "Transfer-Encoding: chunked[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:44.456 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:44.458 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (2ms)
> 13:24:44.460 [ org.apache.http.wire] << "ed[\r][\n]" (2ms)
> 13:24:44.461 [ org.apache.http.wire] << "<?xml version="1.0" encoding="UTF-8"?>[\n]" (1ms)
> 13:24:44.461 [ org.apache.http.wire] << "<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>xxx-test</Name><Prefix></Prefix><Marker></Marker><MaxKeys>0</MaxKeys><IsTruncated>false</IsTruncated></ListBucketResult>" (0ms)
> 13:24:44.461 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:44.461 [ org.apache.http.wire] << "0[\r][\n]" (0ms)
> 13:24:44.461 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:44.462 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: 0F9F8EB13565C850 (1ms)
> 13:24:44.492 [..mpl.DefaultCamelContext] Using ComponentResolver: org.apache.camel.impl.DefaultComponentResolver@2c8d23f9 to resolve component with name: log (30ms)
> 13:24:44.492 [..efaultComponentResolver] Found component: log in registry: null (0ms)
> 13:24:44.494 [..efaultComponentResolver] Found component: log via type: org.apache.camel.component.log.LogComponent via: META-INF/services/org/apache/camel/component/log (2ms)
> 13:24:44.499 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="log" (5ms)
> 13:24:44.500 [..l.impl.DefaultComponent] Creating endpoint uri=[log://error%20processing%20message], path=[error processing message] (1ms)
> 13:24:44.504 [..mpl.DefaultCamelContext] log://error%20processing%20message converted to endpoint: Endpoint[log://error%20processing%20message] by component: org.apache.camel.component.log.LogComponent@460bfa3c (4ms)
> 13:24:44.509 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=endpoints,name="log://error%20processing%20message" (5ms)
> 13:24:44.517 [..erceptor.DefaultChannel] Initialize channel for target: 'To[log:error processing message]' (8ms)
> 13:24:44.528 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=tracer,name=BacklogTracer (11ms)
> 13:24:44.539 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=tracer,name=BacklogDebugger (11ms)
> 13:24:44.545 [..erceptor.DefaultChannel] Initialize channel for target: 'setExchangePattern[pattern: InOnly]' (6ms)
> 13:24:44.561 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=errorhandlers,name="DefaultErrorHandlerBuilder(ref:CamelDefaultErrorHandlerBuilder)" (16ms)
> 13:24:44.574 [..mel.model.LogDefinition] The LogName is null. Falling back to create logger by using the route id route1. (13ms)
> 13:24:44.575 [..erceptor.DefaultChannel] Initialize channel for target: 'Log[Starting file transfer between S3...]' (1ms)
> 13:24:44.577 [..erceptor.DefaultChannel] Initialize channel for target: 'process[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]' (2ms)
> 13:24:44.579 [..mel.model.LogDefinition] The LogName is null. Falling back to create logger by using the route id route1. (2ms)
> 13:24:44.579 [..erceptor.DefaultChannel] Initialize channel for target: 'Log[Finished file transfer between S3!]' (0ms)
> 13:24:44.586 [..mpl.DefaultCamelContext] AllowUseOriginalMessage is enabled. If access to the original message is not needed, then its recommended to turn this option off as it may improve performance. (7ms)
> 13:24:44.586 [..mpl.DefaultCamelContext] StreamCaching is not in use. If using streams then its recommended to enable stream caching. See more details at http://camel.apache.org/stream-caching.html (0ms)
> 13:24:44.587 [..mpl.DefaultCamelContext] Warming up route id: route1 having autoStartup=true (1ms)
> 13:24:44.587 [..camel.impl.RouteService] Starting services on route: route1 (0ms)
> 13:24:44.592 [..camel.impl.RouteService] Starting child service on route: route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]] (5ms)
> 13:24:44.598 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=producers,name=LogProducer(0x89b2158) (6ms)
> 13:24:44.598 [..mponent.log.LogProducer] Starting producer: Producer[log://error%20processing%20message] (0ms)
> 13:24:44.599 [..amel.impl.ProducerCache] Adding to producer cache with key: Endpoint[log://error%20processing%20message] for producer: Producer[log://error%20processing%20message] (1ms)
> 13:24:44.599 [..sor.DefaultErrorHandler] Redelivery enabled: true on error handler: DefaultErrorHandler[Instrumentation:setExchangePattern[SetExchangePattern[InOnly]]] (0ms)
> 13:24:44.610 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=threadpools,name="ErrorHandlerRedeliveryThreadPool" (11ms)
> 13:24:44.610 [..tExecutorServiceManager] Created new ScheduledThreadPool for source: ErrorHandlerRedeliveryThreadPool with name: ErrorHandlerRedeliveryTask. -> org.apache.camel.util.concurrent.SizedScheduledExecutorService@4e67f43b[ErrorHandlerRedeliveryTask] (0ms)
> 13:24:44.610 [..sor.DefaultErrorHandler] Redelivery enabled: true on error handler: DefaultErrorHandler[Instrumentation:log[Log(route1)[Starting file transfer between S3...]]] (0ms)
> 13:24:44.610 [..sor.DefaultErrorHandler] Redelivery enabled: true on error handler: DefaultErrorHandler[Instrumentation:process[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]]] (0ms)
> 13:24:44.610 [..sor.DefaultErrorHandler] Redelivery enabled: true on error handler: DefaultErrorHandler[Instrumentation:log[Log(route1)[Finished file transfer between S3!]]] (0ms)
> 13:24:44.610 [..camel.impl.RouteService] Starting child service on route: route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]] (0ms)
> 13:24:44.610 [..camel.impl.RouteService] Starting child service on route: route1 -> SetExchangePattern[InOnly] (0ms)
> 13:24:44.622 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="setExchangePattern1" (12ms)
> 13:24:44.622 [..camel.impl.RouteService] Starting child service on route: route1 -> Channel[SetExchangePattern[InOnly]] (0ms)
> 13:24:44.622 [..camel.impl.RouteService] Starting child service on route: route1 -> Log(route1)[Starting file transfer between S3...] (0ms)
> 13:24:44.626 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="log1" (4ms)
> 13:24:44.627 [..camel.impl.RouteService] Starting child service on route: route1 -> Channel[Log(route1)[Starting file transfer between S3...]] (1ms)
> 13:24:44.627 [..camel.impl.RouteService] Starting child service on route: route1 -> DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e] (0ms)
> 13:24:44.631 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="process1" (4ms)
> 13:24:44.631 [..camel.impl.RouteService] Starting child service on route: route1 -> Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]] (0ms)
> 13:24:44.631 [..camel.impl.RouteService] Starting child service on route: route1 -> Log(route1)[Finished file transfer between S3!] (0ms)
> 13:24:44.635 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="log2" (4ms)
> 13:24:44.635 [..camel.impl.RouteService] Starting child service on route: route1 -> Channel[Log(route1)[Finished file transfer between S3!]] (0ms)
> 13:24:44.648 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=routes,name="route1" (13ms)
> 13:24:44.648 [..rt.TimerListenerManager] Added TimerListener: org.apache.camel.management.mbean.ManagedSuspendableRoute@60bb132e (0ms)
> 13:24:44.648 [..mpl.DefaultCamelContext] Route: route1 >>> EventDrivenConsumerRoute[Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]]] (0ms)
> 13:24:44.649 [..mpl.DefaultCamelContext] Starting consumer (order: 1000) on route: route1 (1ms)
> 13:24:44.655 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=consumers,name=S3Consumer(0x218a968b) (6ms)
> 13:24:44.655 [..onent.aws.s3.S3Consumer] Starting consumer: S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: initialDelay on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: 1000 (4ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: timeUnit on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: MILLISECONDS (0ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: scheduledExecutorService on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: null (0ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: useFixedDelay on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: true (0ms)
> 13:24:44.659 [..il.IntrospectionSupport] Configured property: delay on bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with value: 500 (0ms)
> 13:24:44.661 [...DefaultManagementAgent] Registered MBean with ObjectName: org.apache.camel:context=camel-1,type=threadpools,name="S3Consumer(0x218a968b)" (2ms)
> 13:24:44.662 [..tExecutorServiceManager] Created new ScheduledThreadPool for source: S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] with name: aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1. -> org.apache.camel.util.concurrent.SizedScheduledExecutorService@1174d546[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (1ms)
> 13:24:44.662 [..edPollConsumerScheduler] Scheduling poll (fixed delay) with initialDelay: 1000, delay: 500 (milliseconds) for: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
> 13:24:44.666 [..mpl.DefaultCamelContext] Route: route1 started and consuming from: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (4ms)
> 13:24:44.666 [..gementLifecycleStrategy] Load performance statistics disabled (0ms)
> 13:24:44.666 [..mpl.DefaultCamelContext] Total 1 routes, of which 1 is started. (0ms)
> 13:24:44.668 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) started in 0.905 seconds (2ms)
> 13:24:45.665 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com / Parameters: (max-keys: 10, ) Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (997ms)
> 13:24:45.669 [ org.apache.http.wire] >> "GET /?max-keys=10 HTTP/1.1[\r][\n]" (4ms)
> 13:24:45.669 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:+RL93PYc7l7fbSL1wCIBzmi547g=[\r][\n]" (1ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:45 GMT[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:45.670 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:45.906 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (236ms)
> 13:24:45.907 [ org.apache.http.wire] << "x-amz-id-2: Gq/0uubPkJRiyi6Am5iuUmxZn6w/1b7JzF58u5GqHtY7UwfMxT289+GakyeTmLKh0/Ov1UNrnyE=[\r][\n]" (1ms)
> 13:24:45.907 [ org.apache.http.wire] << "x-amz-request-id: FA7EB44DD92B1343[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:20 GMT[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "Content-Type: application/xml[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "Transfer-Encoding: chunked[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:45.907 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:45.907 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (0ms)
> 13:24:45.909 [ org.apache.http.wire] << "512[\r][\n]" (2ms)
> 13:24:45.909 [ org.apache.http.wire] << "<?xml version="1.0" encoding="UTF-8"?>[\n]" (0ms)
> 13:24:45.909 [ org.apache.http.wire] << "<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>xxx-test</Name><Prefix></Prefix><Marker></Marker><MaxKeys>10</MaxKeys><IsTruncated>false</IsTruncated><Contents><Key>abc12.txt</Key><LastModified>2015-05-07T20:36:02.000Z</LastModified><ETag>"3f376a7d147c8c2e0d28d0da97d70999"</ETag><Size>2733677708</Size><Owner><ID>52a027bcc58ec546c69a154a6668993008ca81ad219aa22f4480667b7dccad90</ID><DisplayName>cscdigitalmarketing-billing</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>bbb.txt0</Key><LastModified>2015-05-08T17:25:08.000Z</LastModified><ETag>"9e9ee72bd937cf7b6d7242c64f9214bd"</ETag><Size>10</Size><Owner><ID>52a027bcc58ec546c69a154a6668993008ca81ad219aa22f4480667b7dccad90</ID><DisplayName>cscdigitalmarketing-billing</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>test/2015/abc12.txt</Key><LastModified>2015-05-07T19:53:40.000Z</LastModified><ETag>"3f376a7d147c8c2e0d28d0da97d70999"</ETag><Size>2733677708</Size><Owner><ID>52a027bcc58ec546c69a154a6668993008ca81ad219aa22f4480667b7dccad90</ID><DisplayName>cscdigitalmarketing-billing</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents></ListBucketResult>" (0ms)
> 13:24:45.909 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:45.910 [ org.apache.http.wire] << "0[\r][\n]" (1ms)
> 13:24:45.910 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:45.916 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: FA7EB44DD92B1343 (6ms)
> 13:24:45.918 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com /abc12.txt Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (2ms)
> 13:24:45.920 [ org.apache.http.wire] >> "GET /abc12.txt HTTP/1.1[\r][\n]" (2ms)
> 13:24:45.920 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:45.920 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:GBtozfcK1psdSlgyP9MlwIIxZHA=[\r][\n]" (0ms)
> 13:24:45.920 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:45 GMT[\r][\n]" (0ms)
> 13:24:45.920 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:45.920 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:45.921 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (1ms)
> 13:24:45.921 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:45.921 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:46.058 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (137ms)
> 13:24:46.058 [ org.apache.http.wire] << "x-amz-id-2: wRPHWaZ38MDI9slzGQPSVMxMqOUCrkzCGqXmXxnR0981lp72DdwnlG31lP6Hg+zS3V90vdvkGrQ=[\r][\n]" (0ms)
> 13:24:46.059 [ org.apache.http.wire] << "x-amz-request-id: 9183346338F941B7[\r][\n]" (1ms)
> 13:24:46.059 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:20 GMT[\r][\n]" (0ms)
> 13:24:46.059 [ org.apache.http.wire] << "x-amz-meta-gid: 1001[\r][\n]" (0ms)
> 13:24:46.059 [ org.apache.http.wire] << "x-amz-meta-mtime: 1431028974[\r][\n]" (0ms)
> 13:24:46.060 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]" (1ms)
> 13:24:46.060 [ org.apache.http.wire] << "x-amz-meta-uid: 1001[\r][\n]" (0ms)
> 13:24:46.060 [ org.apache.http.wire] << "x-amz-meta-mode: 33204[\r][\n]" (0ms)
> 13:24:46.060 [ org.apache.http.wire] << "Last-Modified: Thu, 07 May 2015 20:36:02 GMT[\r][\n]" (0ms)
> 13:24:46.060 [ org.apache.http.wire] << "ETag: "3f376a7d147c8c2e0d28d0da97d70999"[\r][\n]" (0ms)
> 13:24:46.061 [ org.apache.http.wire] << "Accept-Ranges: bytes[\r][\n]" (1ms)
> 13:24:46.061 [ org.apache.http.wire] << "Content-Type: text/plain[\r][\n]" (0ms)
> 13:24:46.061 [ org.apache.http.wire] << "Content-Length: 2733677708[\r][\n]" (0ms)
> 13:24:46.061 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:46.061 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:46.062 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
> 13:24:46.086 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: 9183346338F941B7 (24ms)
> 13:24:46.092 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com /bbb.txt0 Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (6ms)
> 13:24:46.370 [ org.apache.http.wire] >> "GET /bbb.txt0 HTTP/1.1[\r][\n]" (278ms)
> 13:24:46.370 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:241o6egyQEetCin2uT/Yd/SaaT0=[\r][\n]" (1ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:46 GMT[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:46.371 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:46.372 [ org.apache.http.wire] >> "[\r][\n]" (1ms)
> 13:24:46.447 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (75ms)
> 13:24:46.448 [ org.apache.http.wire] << "x-amz-id-2: LuxT43ah+N02FkH38qAPPEEOu/2wFnc7kroRXLoJV/zyp1UW24Dtw5hahvgAgwgxGa0dQYpy5EY=[\r][\n]" (1ms)
> 13:24:46.448 [ org.apache.http.wire] << "x-amz-request-id: 5782AC9143E67431[\r][\n]" (0ms)
> 13:24:46.448 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:20 GMT[\r][\n]" (0ms)
> 13:24:46.448 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]" (0ms)
> 13:24:46.448 [ org.apache.http.wire] << "Last-Modified: Fri, 08 May 2015 17:25:08 GMT[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "ETag: "9e9ee72bd937cf7b6d7242c64f9214bd"[\r][\n]" (1ms)
> 13:24:46.449 [ org.apache.http.wire] << "Accept-Ranges: bytes[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "Content-Type: text/plain[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "Content-Length: 10[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:46.449 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:46.450 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
> 13:24:46.451 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: 5782AC9143E67431 (1ms)
> 13:24:46.451 [ com.amazonaws.request] Sending Request: GET https://xxx-test.s3.amazonaws.com /test/2015/abc12.txt Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (0ms)
> 13:24:46.695 [ org.apache.http.wire] >> "GET /test/2015/abc12.txt HTTP/1.1[\r][\n]" (244ms)
> 13:24:46.695 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:46.695 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:Y3S5FBOh6Sx+DIu4hmma762kzmE=[\r][\n]" (0ms)
> 13:24:46.695 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:46 GMT[\r][\n]" (0ms)
> 13:24:46.695 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:46.696 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (1ms)
> 13:24:46.696 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:46.696 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:46.696 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:46.896 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (200ms)
> 13:24:46.896 [ org.apache.http.wire] << "x-amz-id-2: WElpbJnvgDm2sKYpUTdGaN5NCGFFdCj6nE4PsOxhU7opXOoZcRgCv91q/dtzL3Y0RgtXv4h51Sg=[\r][\n]" (0ms)
> 13:24:46.896 [ org.apache.http.wire] << "x-amz-request-id: 618C9C6B8F2E187B[\r][\n]" (0ms)
> 13:24:46.896 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:21 GMT[\r][\n]" (0ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-gid: 1001[\r][\n]" (1ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-mtime: 1431028232[\r][\n]" (0ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]" (0ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-uid: 1001[\r][\n]" (0ms)
> 13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-mode: 33204[\r][\n]" (0ms)
> 13:24:46.898 [ org.apache.http.wire] << "Last-Modified: Thu, 07 May 2015 19:53:40 GMT[\r][\n]" (1ms)
> 13:24:46.898 [ org.apache.http.wire] << "ETag: "3f376a7d147c8c2e0d28d0da97d70999"[\r][\n]" (0ms)
> 13:24:46.898 [ org.apache.http.wire] << "Accept-Ranges: bytes[\r][\n]" (0ms)
> 13:24:46.898 [ org.apache.http.wire] << "Content-Type: text/plain[\r][\n]" (0ms)
> 13:24:46.898 [ org.apache.http.wire] << "Content-Length: 2733677708[\r][\n]" (0ms)
> 13:24:46.899 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (1ms)
> 13:24:46.899 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:46.900 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
> 13:24:46.901 [ com.amazonaws.request] Received successful response: 200, AWS Request ID: 618C9C6B8F2E187B (1ms)
> 13:24:46.928 [ route1] Starting file transfer between S3... (27ms)
> 13:24:46.928 [..amelS3SaverRouteBuilder] Processing... (0ms)
> 13:24:46.928 [...camel.main.MainSupport] Apache Camel 2.14.1 stopping (0ms)
> 13:24:46.928 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) is shutting down (0ms)
> 13:24:46.929 [ route1] Finished file transfer between S3! (1ms)
> 13:24:46.929 [..DefaultShutdownStrategy] Starting to graceful shutdown 1 routes (timeout 10 seconds) (0ms)
> 13:24:46.929 [ com.amazonaws.request] Sending Request: DELETE https://xxx-test.s3.amazonaws.com /abc12.txt Headers: (User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (0ms)
> 13:24:46.932 [..tExecutorServiceManager] Created new ThreadPool for source: org.apache.camel.impl.DefaultShutdownStrategy@20ad3a7a with name: ShutdownTask. -> org.apache.camel.util.concurrent.RejectableThreadPoolExecutor@3c443007[Running, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0][ShutdownTask] (3ms)
> 13:24:46.935 [..DefaultShutdownStrategy] There are 1 routes to shutdown (3ms)
> 13:24:46.937 [..DefaultShutdownStrategy] Route: route1 suspended and shutdown deferred, was consuming from: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (2ms)
> 13:24:46.937 [..DefaultShutdownStrategy] Waiting as there are still 1 inflight and pending exchanges to complete, timeout in 10 seconds. (0ms)
> 13:24:47.190 [ org.apache.http.wire] >> "DELETE /abc12.txt HTTP/1.1[\r][\n]" (253ms)
> 13:24:47.190 [ org.apache.http.wire] >> "Host: xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
> 13:24:47.190 [ org.apache.http.wire] >> "Authorization: AWS AKIAJIY6B67JBFCXLL5A:FAeigwZab6FKtgvT9+KWTFYZSbM=[\r][\n]" (0ms)
> 13:24:47.190 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:46 GMT[\r][\n]" (0ms)
> 13:24:47.190 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]" (0ms)
> 13:24:47.191 [ org.apache.http.wire] >> "Content-Type: application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (1ms)
> 13:24:47.191 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]" (0ms)
> 13:24:47.191 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]" (0ms)
> 13:24:47.191 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
> 13:24:47.279 [ org.apache.http.wire] << "HTTP/1.1 204 No Content[\r][\n]" (88ms)
> 13:24:47.279 [ org.apache.http.wire] << "x-amz-id-2: xbTWOgHJWqro7cjTekdIwriz3jKVWp+2nVloj+SNqqtQXRiVDtmzy6OhOXMe4/xst4/P/rPwavw=[\r][\n]" (0ms)
> 13:24:47.279 [ org.apache.http.wire] << "x-amz-request-id: F6AD4E2E785E0AEA[\r][\n]" (0ms)
> 13:24:47.279 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:21 GMT[\r][\n]" (0ms)
> 13:24:47.280 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]" (1ms)
> 13:24:47.280 [ org.apache.http.wire] << "x-amz-delete-marker: true[\r][\n]" (0ms)
> 13:24:47.280 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
> 13:24:47.280 [ org.apache.http.wire] << "[\r][\n]" (0ms)
> 13:24:47.281 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
> 13:24:47.281 [ com.amazonaws.request] Received successful response: 204, AWS Request ID: F6AD4E2E785E0AEA (0ms)
> 13:24:47.937 [..DefaultShutdownStrategy] Route: route1 preparing to shutdown complete. (656ms)
> 13:24:47.937 [..edPollConsumerScheduler] This consumer is stopping, so cancelling scheduled task: java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2486bd80 (0ms)
> 13:24:47.937 [..onent.aws.s3.S3Consumer] Stopping consumer: S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
> 13:24:47.938 [..aredProducerServicePool] Stopping service pool: org.apache.camel.impl.SharedProducerServicePool@7075cca9 (1ms)
> 13:24:47.938 [..mponent.log.LogProducer] Stopping producer: Producer[log://error%20processing%20message] (0ms)
> 13:24:47.938 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=producers,name=LogProducer(0x89b2158) (0ms)
> 13:24:47.939 [..DefaultShutdownStrategy] Route: route1 shutdown complete, was consuming from: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (1ms)
> 13:24:47.939 [..DefaultShutdownStrategy] Graceful shutdown of 1 routes completed in 1 seconds (0ms)
> 13:24:47.940 [..rt.TimerListenerManager] Removed TimerListener: org.apache.camel.management.mbean.ManagedSuspendableRoute@60bb132e (1ms)
> 13:24:47.940 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=routes,name="route1" (0ms)
> 13:24:47.940 [..camel.impl.RouteService] Stopping services on route: route1 (0ms)
> 13:24:47.940 [..camel.impl.RouteService] Shutting down child service on route: route1 -> S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
> 13:24:47.940 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=consumers,name=S3Consumer(0x218a968b) (0ms)
> 13:24:47.941 [..tExecutorServiceManager] Forcing shutdown of ExecutorService: org.apache.camel.util.concurrent.SizedScheduledExecutorService@1174d546[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (1ms)
> 13:24:47.941 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=threadpools,name="S3Consumer(0x218a968b)" (0ms)
> 13:24:47.941 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting file transfer between S3...]], Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]], Channel[Log(route1)[Finished file transfer between S3!]]]] (1ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> SetExchangePattern[InOnly] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Channel[SetExchangePattern[InOnly]] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Log(route1)[Starting file transfer between S3...] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Channel[Log(route1)[Starting file transfer between S3...]] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Log(route1)[Finished file transfer between S3!] (0ms)
> 13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route: route1 -> Channel[Log(route1)[Finished file transfer between S3!]] (0ms)
> 13:24:47.943 [..camel.impl.RouteService] Shutting down services on route: route1 (1ms)
> 13:24:47.943 [..tExecutorServiceManager] Forcing shutdown of ExecutorService: org.apache.camel.util.concurrent.SizedScheduledExecutorService@4e67f43b[ErrorHandlerRedeliveryTask] (0ms)
> 13:24:47.944 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=threadpools,name="ErrorHandlerRedeliveryThreadPool" (1ms)
> 13:24:47.944 [..rt.TimerListenerManager] Removed TimerListener: org.apache.camel.management.mbean.ManagedCamelContext@a03313c (0ms)
> 13:24:47.944 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=context,name="camel-1" (0ms)
> 13:24:47.945 [..tExecutorServiceManager] Forcing shutdown of ExecutorService: org.apache.camel.util.concurrent.RejectableThreadPoolExecutor@3c443007[Running, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 1][ShutdownTask] (1ms)
> 13:24:47.945 [..faultInflightRepository] Shutting down with no inflight exchanges. (0ms)
> 13:24:47.946 [...camel.util.EventHelper] Ignoring notifying event Stopped CamelContext: camel-1. The EventNotifier has not been started yet: org.apache.camel.impl.DefaultRuntimeEndpointRegistry@7bab0b6c (1ms)
> 13:24:47.946 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultTypeConverter (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=eventnotifiers,name=EventNotifier(0x7bab0b6c) (1ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=SharedProducerServicePool (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="setExchangePattern1" (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="aws-s3" (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultRestRegistry (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=EndpointRegistry (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="log1" (0ms)
> 13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultPackageScanClassResolver (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=errorhandlers,name="DefaultErrorHandlerBuilder(ref:CamelDefaultErrorHandlerBuilder)" (1ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="process1" (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=endpoints,name="log://error%20processing%20message" (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=tracer,name=BacklogTracer (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="properties" (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=components,name="log" (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=tracer,name=BacklogDebugger (0ms)
> 13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=processors,name="log2" (0ms)
> 13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultInflightRepository (1ms)
> 13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=endpoints,name="aws-s3://xxx-test\?amazonS3Client=%23client®ion=us-east-1" (0ms)
> 13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultShutdownStrategy (0ms)
> 13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName: org.apache.camel:context=camel-1,type=services,name=DefaultExecutorServiceManager (0ms)
> 13:24:47.949 [..il.IntrospectionSupport] Clearing cache[size=42, hits=57, misses=46, evicted=0] (0ms)
> 13:24:47.954 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) uptime 4.193 seconds (5ms)
> 13:24:47.955 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext: camel-1) is shutdown in 1.026 seconds (1ms)
> 13:24:47.956 [..pport$HangupInterceptor] Received hang up - stopping the main instance. (1ms)
> {panel}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)