You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/12/17 04:54:22 UTC
[GitHub] [pulsar] kwenZh opened a new issue #13375: broker offload use s3 driver, java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`
kwenZh opened a new issue #13375:
URL: https://github.com/apache/pulsar/issues/13375
in pulsar 2.8.1 version, use offload, broker err log:
```
java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`.
```
and this broker config about offload:
```
managedLedgerOffloadDriver=S3
managedLedgerOffloadServiceEndpoint=https://xxx
offloadersDirectory=./offloaders
```
and work dir offloaders has nar :
ll offloaders/
total 149912
-rw-r--r-- 1 root root 85993675 Dec 17 09:36 tiered-storage-file-system-2.8.1.nar
-rw-r--r-- 1 root root 67514044 Dec 17 09:36 tiered-storage-jcloud-2.8.1.nar
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] ericsyh commented on issue #13375: broker offload use s3 driver, java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`
Posted by GitBox <gi...@apache.org>.
ericsyh commented on issue #13375:
URL: https://github.com/apache/pulsar/issues/13375#issuecomment-997384505
> > Have you tried using this name `aws-s3`? @kwenZh
>
> because， we are using a storage based on the S3 protocol， not aws , so i need set my private storage url
Use `s3ManagedLedgerOffloadServiceEndpoint` to set as your pricate storage url, the value should be `http://<storage-url>:port`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] tuteng commented on issue #13375: broker offload use s3 driver, java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`
Posted by GitBox <gi...@apache.org>.
tuteng commented on issue #13375:
URL: https://github.com/apache/pulsar/issues/13375#issuecomment-996553334
Have you tried using this name `aws-s3`? @kwenZh
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] kwenZh commented on issue #13375: broker offload use s3 driver, java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`
Posted by GitBox <gi...@apache.org>.
kwenZh commented on issue #13375:
URL: https://github.com/apache/pulsar/issues/13375#issuecomment-997662414
> > managedLedgerOffloadServiceEndpoint
> > broker.conf it also set
> > s3ManagedLedgerOffloadServiceEndpoint=http://host:12001
> > but it still connect https://s3.amazonaws.com
broker log：
15:20:47.294 [offloader-OrderedScheduler-0-0] ERROR org.jclouds.http.handlers.BackoffLimitedRetryHandler - Cannot retry after server error, command has exceeded retry limit 100: [method=org.jclouds.aws.s3.AWSS3Client.public abstract jClient.getBucketLocation(java.lang.String)[pulsar-offload], request=GET https://s3.amazonaws.com/pulsar-offload?location HTTP/1.1]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] kwenZh commented on issue #13375: broker offload use s3 driver, java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`
Posted by GitBox <gi...@apache.org>.
kwenZh commented on issue #13375:
URL: https://github.com/apache/pulsar/issues/13375#issuecomment-997643514
org.apache.bookkeeper.mledger.offload.jcloud.impl.BlobStoreManagedLedgerOffloader - Constructor offload driver: aws-s3, host: http://host:12001, container: pulsar-offload, region
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] kwenZh commented on issue #13375: broker offload use s3 driver, java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`
Posted by GitBox <gi...@apache.org>.
kwenZh commented on issue #13375:
URL: https://github.com/apache/pulsar/issues/13375#issuecomment-997642778
> managedLedgerOffloadServiceEndpoint
broker.conf it also set
s3ManagedLedgerOffloadServiceEndpoint=http://host:12001
but it still connect https://s3.amazonaws.com
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] kwenZh commented on issue #13375: broker offload use s3 driver, java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`
Posted by GitBox <gi...@apache.org>.
kwenZh commented on issue #13375:
URL: https://github.com/apache/pulsar/issues/13375#issuecomment-996555429
> Have you tried using this name `aws-s3`? @kwenZh
aws-s3 driver is ok, but the other error log is :
org.jclouds.http.handlers.BackoffLimitedRetryHandler - Cannot retry after server error, command has exceeded retry limit 100: [method=org.jclouds.aws.s3.AWSS3Client.public abstract java.lang.String org.jclouds.s3.S3Client.getBucketLocation(java.lang.String)[pulsar-offload], request=GET https://s3.amazonaws.com/pulsar-offload?location HTTP/1.1]
i want use my setting url , not https://s3.amazonaws.com/pulsar-offload, how to set it ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] kwenZh commented on issue #13375: broker offload use s3 driver, java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`
Posted by GitBox <gi...@apache.org>.
kwenZh commented on issue #13375:
URL: https://github.com/apache/pulsar/issues/13375#issuecomment-996558101
> Have you tried using this name `aws-s3`? @kwenZh
because， we are using a storage based on the S3 protocol， not aws , so i need set my private storage url
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] github-actions[bot] commented on issue #13375: broker offload use s3 driver, java.io.IOException: No offloader found for driver 'S3'. Please make sure you dropped the offloader nar packages under `${PULSAR_HOME}/offloaders`
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #13375:
URL: https://github.com/apache/pulsar/issues/13375#issuecomment-1051438621
The issue had no activity for 30 days, mark with Stale label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org