You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "morelgeorge (via GitHub)" <gi...@apache.org> on 2026/01/15 09:56:54 UTC
[I] apache-airflow-providers-microsoft-azure Request URL issue [airflow]
morelgeorge opened a new issue, #60573:
URL: https://github.com/apache/airflow/issues/60573
### Apache Airflow Provider(s)
microsoft-azure
### Versions of Apache Airflow Providers
- apache-airflow-providers-microsoft-azure 12.10.1
- apache-airflow-providers-http 5.4.0
- apache-airflow-providers-common-io 1.6.4
### Apache Airflow version
3.1.3
### Operating System
Rhel 9.6
### Deployment
Virtualenv installation
### Deployment details
_No response_
### What happened
I need help with an [apache-airflow-providers-microsoft-azure Power BI Operator](https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/stable/operators/powerbi.html) operator. I want to get the list of Power BI workspaces under Service Principal account.
We are unable to run this operator due to an error below:
[2026-01-14 08:39:18] INFO - trigger example_powerbi_dataset_list_v2/manual__2026-01-14T07:39:14+00:00/get_powerbi_workspace_list/-1/1 (ID 50) starting loc=triggerer_job_runner.py:1110 [2026-01-14 08:39:18] INFO - Executing url 'myorg/groups' as 'GET' source=airflow.task.hooks.airflow.providers.microsoft.azure.hooks.powerbi.PowerBIHook loc=msgraph.py:499 [2026-01-14 08:39:18] INFO - trigger completed name=example_powerbi_dataset_list_v2/manual__2026-01-14T07:39:14+00:00/get_powerbi_workspace_list/-1/1 (ID 50) loc=triggerer_job_runner.py:1134 [2026-01-14 08:39:19] ERROR - Trigger example_powerbi_dataset_list_v2/manual__2026-01-14T07:39:14+00:00/get_powerbi_workspace_list/-1/1 (ID 50) exited with error Request URL is missing an 'http://' or 'https://' protocol. loc=triggerer_job_runner.py:1007
Based on this log message it is using standard API request 'myorg/groups' but the error is saying that 'Request URL is missing an 'http://' or 'https://' protocol'. We are using standard Power BI Airflow connection where the Client ID, Secret ID and Tenant ID are filled. No other options are set.
The issue persists also for other Power BI available tasks.
### What you think should happen instead
The code should execute whole Power BI URL API path. Instead of short version 'myorg/groups' should run 'https://api.powerbi.com/v1.0/myorg/groups'. Otherwise the error appears.
### How to reproduce
You can try to run an [example code](https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.10.1/_modules/tests/system/microsoft/azure/example_powerbi_workspace_list.html)
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] apache-airflow-providers-microsoft-azure Request URL issue [airflow]
Posted by "dthauvin (via GitHub)" <gi...@apache.org>.
dthauvin commented on issue #60573:
URL: https://github.com/apache/airflow/issues/60573#issuecomment-3876266766
Hello
do you thing my error below could be related to this issue ?
i'am using :
Airflow2.11
apache-airflow-providers-microsoft-azure 12.10.2
microsoft-kiota-authentication-azure 1.9.8
```
[2026-02-09, 20:37:01 UTC] {baseoperator.py:1810} ERROR - Trigger failed:
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/jobs/triggerer_job_runner.py", line 558, in cleanup_finished_triggers
result = details["task"].result()
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/jobs/triggerer_job_runner.py", line 630, in run_trigger
async for event in trigger.run():
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/microsoft/azure/triggers/powerbi.py", line 149, in run
dataset_refresh_id = await self.hook.trigger_dataset_refresh(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/powerbi.py", line 205, in trigger_dataset_refresh
response = await self.run(
^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/msgraph.py", line 501, in run
response = await self.send_request(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/msgraph.py", line 581, in send_request
return await conn.send_no_response_content_async(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/kiota_http/httpx_request_adapter.py", line 381, in send_no_response_content_async
response = await self.get_http_response_message(request_info, parent_span)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/kiota_http/httpx_request_adapter.py", line 593, in get_http_response_message
await self._authentication_provider.authenticate_request(
File "/home/airflow/.local/lib/python3.12/site-packages/kiota_abstractions/authentication/base_bearer_token_authentication_provider.py", line 50, in authenticate_request
token = await self.access_token_provider.get_authorization_token(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/kiota_authentication_azure/azure_identity_access_token_provider.py", line 84, in get_authorization_token
raise exc
kiota_authentication_azure._exceptions.HTTPError: Only https is supported
[2026-02-09, 20:37:01 UTC] {taskinstance.py:3336} ERROR - Task failed with exception
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/taskinstance.py", line 776, in _execute_task
result = _execute_callable(context=context, **execute_callable_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/taskinstance.py", line 742, in _execute_callable
return ExecutionCallableRunner(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/utils/operator_helpers.py", line 252, in run
return self.func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/baseoperator.py", line 1811, in resume_execution
raise TaskDeferralError(next_kwargs.get("error", "Unknown"))
airflow.exceptions.TaskDeferralError: Trigger failure
```
i'am using the PowerBIDatasetRefreshOperator
```
refreshpbi_full_task = PowerBIDatasetRefreshOperator(
task_id="refreshpbi_full_task",
dataset_id=config.powerbi.get("XX").get("dataset_id"),
group_id=config.powerbi.get("XX").get("group_id"),
conn_id=config.powerbi.get("XX").get("conn_id"),
timeout=3600 * 8,
check_interval=300,
request_body={
"type": "Full",
"commitMode": "transactional",
"timeout": "04:00:00",
"objects": [],
"maxParallelism": 32,
"retryCount": 1,
"applyRefreshPolicy": False,
},
)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] apache-airflow-providers-microsoft-azure Request URL issue [airflow]
Posted by "suii2210 (via GitHub)" <gi...@apache.org>.
suii2210 commented on issue #60573:
URL: https://github.com/apache/airflow/issues/60573#issuecomment-3879434762
> Hello [@suii2210](https://github.com/suii2210)
>
> do you think my error below could be related to this issue ? i'am using :
>
> Airflow2.11 apache-airflow-providers-microsoft-azure 12.10.2 microsoft-kiota-authentication-azure 1.9.8
>
> ```
> [2026-02-09, 20:37:01 UTC] {baseoperator.py:1810} ERROR - Trigger failed:
> Traceback (most recent call last):
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/jobs/triggerer_job_runner.py", line 558, in cleanup_finished_triggers
> result = details["task"].result()
> ^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/jobs/triggerer_job_runner.py", line 630, in run_trigger
> async for event in trigger.run():
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/microsoft/azure/triggers/powerbi.py", line 149, in run
> dataset_refresh_id = await self.hook.trigger_dataset_refresh(
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/powerbi.py", line 205, in trigger_dataset_refresh
> response = await self.run(
> ^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/msgraph.py", line 501, in run
> response = await self.send_request(
> ^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/msgraph.py", line 581, in send_request
> return await conn.send_no_response_content_async(
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/kiota_http/httpx_request_adapter.py", line 381, in send_no_response_content_async
> response = await self.get_http_response_message(request_info, parent_span)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/kiota_http/httpx_request_adapter.py", line 593, in get_http_response_message
> await self._authentication_provider.authenticate_request(
> File "/home/airflow/.local/lib/python3.12/site-packages/kiota_abstractions/authentication/base_bearer_token_authentication_provider.py", line 50, in authenticate_request
> token = await self.access_token_provider.get_authorization_token(
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/kiota_authentication_azure/azure_identity_access_token_provider.py", line 84, in get_authorization_token
> raise exc
> kiota_authentication_azure._exceptions.HTTPError: Only https is supported
> [2026-02-09, 20:37:01 UTC] {taskinstance.py:3336} ERROR - Task failed with exception
> Traceback (most recent call last):
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/taskinstance.py", line 776, in _execute_task
> result = _execute_callable(context=context, **execute_callable_kwargs)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/taskinstance.py", line 742, in _execute_callable
> return ExecutionCallableRunner(
> ^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/utils/operator_helpers.py", line 252, in run
> return self.func(*args, **kwargs)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/baseoperator.py", line 1811, in resume_execution
> raise TaskDeferralError(next_kwargs.get("error", "Unknown"))
> airflow.exceptions.TaskDeferralError: Trigger failure
> ```
>
> i'am using the PowerBIDatasetRefreshOperator
>
> ```
> refreshpbi_full_task = PowerBIDatasetRefreshOperator(
> task_id="refreshpbi_full_task",
> dataset_id=config.powerbi.get("XX").get("dataset_id"),
> group_id=config.powerbi.get("XX").get("group_id"),
> conn_id=config.powerbi.get("XX").get("conn_id"),
> timeout=3600 * 8,
> check_interval=300,
> request_body={
> "type": "Full",
> "commitMode": "transactional",
> "timeout": "04:00:00",
> "objects": [],
> "maxParallelism": 32,
> "retryCount": 1,
> "applyRefreshPolicy": False,
> },
> )
> ```
not fully but partially yes .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] apache-airflow-providers-microsoft-azure Request URL issue [airflow]
Posted by "morelgeorge (via GitHub)" <gi...@apache.org>.
morelgeorge commented on issue #60573:
URL: https://github.com/apache/airflow/issues/60573#issuecomment-3908949819
I am closing this issue. It has been solving in this PR - https://github.com/apache/airflow/pull/61103
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] apache-airflow-providers-microsoft-azure Request URL issue [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #60573:
URL: https://github.com/apache/airflow/issues/60573#issuecomment-3753858147
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] apache-airflow-providers-microsoft-azure Request URL issue [airflow]
Posted by "morelgeorge (via GitHub)" <gi...@apache.org>.
morelgeorge closed issue #60573: apache-airflow-providers-microsoft-azure Request URL issue
URL: https://github.com/apache/airflow/issues/60573
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] apache-airflow-providers-microsoft-azure Request URL issue [airflow]
Posted by "suii2210 (via GitHub)" <gi...@apache.org>.
suii2210 commented on issue #60573:
URL: https://github.com/apache/airflow/issues/60573#issuecomment-3762970872
Hello, I wanna work on this issue .
From the logs, PowerBIHook is issuing requests to a relative path (myorg/groups), which causes requests to fail due to the missing scheme. The hook should build the full Power BI REST URL (e.g. https://api.powerbi.com/v1.0/myorg/groups) before making the request.
Happy to submit a PR to fix this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org