You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Nicolas Filotto (Jira)" <ji...@apache.org> on 2022/12/12 16:05:00 UTC
[jira] [Commented] (CAMEL-18660) Kinesis tests fail due to an API rate limit exceeded
[ https://issues.apache.org/jira/browse/CAMEL-18660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646188#comment-17646188 ]
Nicolas Filotto commented on CAMEL-18660:
-----------------------------------------
The corresponding PR https://github.com/apache/camel/pull/8884
> Kinesis tests fail due to an API rate limit exceeded
> -----------------------------------------------------
>
> Key: CAMEL-18660
> URL: https://issues.apache.org/jira/browse/CAMEL-18660
> Project: Camel
> Issue Type: Task
> Components: build system
> Reporter: Nicolas Filotto
> Assignee: Nicolas Filotto
> Priority: Minor
>
> The test Kinesis2ConsumerHealthCustomClientTest systematically fails on Jenkins. After a deeper investigation, it is actually due to an API rate limit exceeded
> The corresponding stack trace:
> {noformat}
> Error starting infrastructure: Could not get list of releases from https://api.github.com/repos/etspaceman/kinesis-mock/releases/tags/0.2.5: {"message":"API rate limit exceeded for 67.195.81.161. (But here's the good news: Authenticated requests get a higher rate limit. Check out the documentation for more details.)","documentation_url":"https://docs.github.com/rest/overview/resources-in-the-rest-api#rate-limiting"}
> Traceback (most recent call last):
> File "/opt/code/localstack/localstack/services/infra.py", line 420, in start_infra
> thread = do_start_infra(asynchronous, apis, is_in_docker)
> File "/opt/code/localstack/localstack/services/infra.py", line 516, in do_start_infra
> prepare_installation()
> File "/opt/code/localstack/localstack/utils/bootstrap.py", line 77, in wrapped
> return f(*args, **kwargs)
> File "/opt/code/localstack/localstack/services/infra.py", line 470, in prepare_installation
> install.install_components(apis)
> File "/opt/code/localstack/localstack/services/install.py", line 411, in install_components
> parallelize(install_component, names)
> File "/opt/code/localstack/localstack/utils/threads.py", line 135, in parallelize
> return pool.map(func, arr)
> File "/usr/local/lib/python3.10/multiprocessing/pool.py", line 367, in map
> return self._map_async(func, iterable, mapstar, chunksize).get()
> File "/usr/local/lib/python3.10/multiprocessing/pool.py", line 774, in get
> raise self._value
> File "/usr/local/lib/python3.10/multiprocessing/pool.py", line 125, in worker
> result = (True, func(*args, **kwds))
> File "/usr/local/lib/python3.10/multiprocessing/pool.py", line 48, in mapstar
> return list(map(*args))
> File "/opt/code/localstack/localstack/services/install.py", line 407, in install_component
> installer()
> File "/opt/code/localstack/localstack/packages/api.py", line 182, in install
> self.get_installer(version).install(target)
> File "/opt/code/localstack/localstack/packages/api.py", line 83, in install
> raise e
> File "/opt/code/localstack/localstack/packages/api.py", line 74, in install
> if not self.is_installed():
> File "/opt/code/localstack/localstack/packages/api.py", line 93, in is_installed
> return self.get_installed_dir() is not None
> File "/opt/code/localstack/localstack/packages/api.py", line 103, in get_installed_dir
> if directory and os.path.exists(self._get_install_marker_path(directory)):
> File "/opt/code/localstack/localstack/packages/core.py", line 172, in _get_install_marker_path
> url = self._get_download_url()
> File "/opt/code/localstack/localstack/packages/core.py", line 208, in _get_download_url
> raise PackageException(
> localstack.packages.api.PackageException: Could not get list of releases from https://api.github.com/repos/etspaceman/kinesis-mock/releases/tags/0.2.5: {"message":"API rate limit exceeded for 67.195.81.161. (But here's the good news: Authenticated requests get a higher rate limit. Check out the documentation for more details.)","documentation_url":"https://docs.github.com/rest/overview/resources-in-the-rest-api#rate-limiting"}
> {noformat}
> It appears that it is [a known issue|https://github.com/localstack/localstack/issues/7103] and it is due to the fact that the docker image localstack 1.2.0 doesn't contain kinesis-mock thus anytime it uses the localstack image, it tries to automatically install it by downloading it from GitHub which causes the rate limit issue.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)