You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "gitrenliping (via GitHub)" <gi...@apache.org> on 2023/10/24 07:04:39 UTC
[I] 非admin账号在资源中心上传文件,工作流定义Spark类型任务主程序包无法引用 [dolphinscheduler]
gitrenliping opened a new issue, #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
非admin账号在资源中心上传文件,工作流定义Spark类型任务主程序包无法引用
且元数据表中没有插入记录,api-server也没有报错
### What you expected to happen
上传资源接口异常,导致没有在元数据中插入记录
### How to reproduce
上传文件,并创建spark类型任务
### Anything else
1
### Version
3.2.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1780440905
> ## I have a similar issue to the current Issue in 3.2.x.
> In a same Spark Task, folders can be displayed in the "Resources dropdown list". but folders cannot be displayed in the "main package", "main package" list just displayed files in the root directory
> 在3.2.0中我有一个和当前Issue相似的问题,在同一个Spark Task中,Resources下拉列表中可以显示文件夹,但main package中不能显示文件夹,只能显示根目录中的文件。
Can you provide some screenshot about it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1780587083
I've tested branch 3.2.0-release, and do not reproduce this bug, here's my resource list.
<img width="516" alt="image" src="https://github.com/apache/dolphinscheduler/assets/45198818/19ff67ba-42de-43e9-ab29-3af9ae6448df">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "jfifth (via GitHub)" <gi...@apache.org>.
jfifth commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1780369852
> > ## I have a similar issue to the current Issue in 3.2.x.
> > In a same Spark Task, folders can be displayed in the "Resources dropdown list". but folders cannot be displayed in the "main package", "main package" list just displayed files in the root directory
> > 在3.2.0中我有一个和当前Issue相似的问题,在同一个Spark Task中,Resources下拉列表中可以显示文件夹,但main package中不能显示文件夹,只能显示根目录中的文件。
>
> 看下你的元数据表t_ds_resources中有记录吗
t_ds_resources表中是空的,没有任何记录
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "gitrenliping (via GitHub)" <gi...@apache.org>.
gitrenliping commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1784604165
> > @Radeity The administrator does not have this problem. You can try creating a regular user
> >   
>
> According to your screenshot, it seems like you can select the main jar uploaded by user `dolphinscheduler`?
yes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1780439339
Hi @jfifth @gitrenliping , table `t_ds_resources` is deprecated in 3.2.x, we do not maintain these metadata in database.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1786369316
> ‘dolphinscheduler’ users create spark tasks, and the main program package can only reference files in the root directory, not files in the folder
Thanks, I'll fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1784661226
> yes
So what's your problem?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1776641932
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced.
And no records are inserted into the metadata table, and the api-server does not report an error.
### What you expected to happen
The upload resource interface is abnormal, resulting in no records being inserted into the metadata.
### How to reproduce
Upload files and create spark type tasks
### Anything else
1
### Version
3.2.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "gitrenliping (via GitHub)" <gi...@apache.org>.
gitrenliping commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1784576744
> I've tested branch 3.2.0-release, and do not reproduce this bug, here's my resource list.
>
> <img alt="image" width="516" src="https://user-images.githubusercontent.com/45198818/278251736-19ff67ba-42de-43e9-ab29-3af9ae6448df.png">
@Radeity The administrator does not have this problem. You can try creating a regular user



--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "gitrenliping (via GitHub)" <gi...@apache.org>.
gitrenliping commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1780464278
@Radeity


--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "gitrenliping (via GitHub)" <gi...@apache.org>.
gitrenliping commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1780491584
spark任务的主程序包,职能引用根目录下的jar包,不能应用文件夹下的jar包吗?图如下:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1778505616
In 3.2.x, we don't insert any new record when uploading resource into resource center, which meta data do you mean?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "jfifth (via GitHub)" <gi...@apache.org>.
jfifth commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1778644674
I have a similar issue to the current Issue in 3.2.x.
In the a Spark Task, folders can be displayed in the "Resources dropdown list". but folders cannot be displayed in the "main package", "main package" list just displayed files in the root directory
--------------------------------------------------------------
在3.2.0中我有一个和当前Issue相似的问题,在同一个Spark Task中,Resources下拉列表中可以显示文件夹,但main package中不能显示文件夹,只能显示根目录中的文件。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity closed issue #15072: When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced.
URL: https://github.com/apache/dolphinscheduler/issues/15072
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "gitrenliping (via GitHub)" <gi...@apache.org>.
gitrenliping closed issue #15072: When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced.
URL: https://github.com/apache/dolphinscheduler/issues/15072
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1784583409
> @Radeity The administrator does not have this problem. You can try creating a regular user
>
>   
According to your screenshot, it seems like you can select the main jar uploaded by user `dolphinscheduler`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "gitrenliping (via GitHub)" <gi...@apache.org>.
gitrenliping commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1784670486
> dolphinscheduler
> > yes
>
> So what's your problem?
‘dolphinscheduler’ users create spark tasks, and the main program package can only reference files in the root directory, not files in the folder
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "gitrenliping (via GitHub)" <gi...@apache.org>.
gitrenliping commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1780364305
> ## I have a similar issue to the current Issue in 3.2.x.
> In a same Spark Task, folders can be displayed in the "Resources dropdown list". but folders cannot be displayed in the "main package", "main package" list just displayed files in the root directory
> 在3.2.0中我有一个和当前Issue相似的问题,在同一个Spark Task中,Resources下拉列表中可以显示文件夹,但main package中不能显示文件夹,只能显示根目录中的文件。
看下你的元数据表t_ds_resources中有记录吗
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "gitrenliping (via GitHub)" <gi...@apache.org>.
gitrenliping commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1780363520
> In 3.2.x, we don't insert any new record when uploading resource into resource center, which meta data do you mean?
In 3.2. x, after uploading the file in the resource center, the metadata table t_ Ds_ Resources did not insert any records
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] When a non-admin account uploads files in the resource center, the workflow definition Spark type task main package cannot be referenced. [dolphinscheduler]
Posted by "jfifth (via GitHub)" <gi...@apache.org>.
jfifth commented on issue #15072:
URL: https://github.com/apache/dolphinscheduler/issues/15072#issuecomment-1780612996
> > ## I have a similar issue to the current Issue in 3.2.x.
> > In a same Spark Task, folders can be displayed in the "Resources dropdown list". but folders cannot be displayed in the "main package", "main package" list just displayed files in the root directory
> > 在3.2.0中我有一个和当前Issue相似的问题,在同一个Spark Task中,Resources下拉列表中可以显示文件夹,但main package中不能显示文件夹,只能显示根目录中的文件。
>
> Can you provide some screenshot about it?
Resources:

Main Package in Spark Task:

Resources in same Spark Task as “Main Package”

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org