You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/11/02 10:00:15 UTC
[GitHub] [dolphinscheduler-website] Narcasserun opened a new pull request #500: add datasource spi design doc (#6071)
Narcasserun opened a new pull request #500:
URL: https://github.com/apache/dolphinscheduler-website/pull/500
- add datasource spi design doc
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler-website] zhongjiajie commented on pull request #500: add datasource spi design doc (#6071)
Posted by GitBox <gi...@apache.org>.
zhongjiajie commented on pull request #500:
URL: https://github.com/apache/dolphinscheduler-website/pull/500#issuecomment-992035505
@Narcasserun Is this PR good to go or not?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler-website] Narcasserun removed a comment on pull request #500: add datasource spi design doc (#6071)
Posted by GitBox <gi...@apache.org>.
Narcasserun removed a comment on pull request #500:
URL: https://github.com/apache/dolphinscheduler-website/pull/500#issuecomment-992081513
> @Narcasserun Is this PR good to go or not?
> @Narcasserun Is this PR good to go or not?
go go go
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler-website] CalvinKirs commented on a change in pull request #500: add datasource spi design doc (#6071)
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on a change in pull request #500:
URL: https://github.com/apache/dolphinscheduler-website/pull/500#discussion_r759117105
##########
File path: development/en-us/backend/spi/datasource.md
##########
@@ -0,0 +1,46 @@
+## DolphinScheduler Datasource SPI main design
+
+#### How do I use data sources?
+
+The data source center supports PostgreSQL, hive / impala, spark, Clickhouse and sqlserver data sources by default.
+
+If MySQL and Oracle data sources are used, the corresponding driver package needs to be placed in the plug-in installation directory
+
+#### How to use development environment?
+
+Note: **${VERSION}** needs to be manually modified according to the current version.
+
+First you need to execute the `mvn -U install -Dmaven.test.skip=true` to install the plugin for generating the plugin JAR of the registry. The directory is: dolphinscheduler-dist/target/dolphinscheduler-dist-${VERSION}/lib/plugin/task (The version number will follow the change of the main version number)
+
+Executing this command will generate all plugins provided by default for all modules.
+
+Next, configure the plugin directory in (dolphinscheduler-server/src/main/resources/worker.properties)
+
+```
+datasource.plugin.dir =./dolphinscheduler-dist/target/dolphinscheduler-dist-${VERSION}/lib/plugin/datasource
+```
+
+The following configurations can be used for local development debugging, for example:
+
+```
+maven.local.repository=/Users/localRepository
+datasource.plugin.binding=./dolphinscheduler-datasource-plugin/dolphinscheduler-datasource-sqlserver/pom.xml
+```
+
Review comment:
I look you change plugin load method,This document is no longer applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler-website] Narcasserun commented on pull request #500: add datasource spi design doc (#6071)
Posted by GitBox <gi...@apache.org>.
Narcasserun commented on pull request #500:
URL: https://github.com/apache/dolphinscheduler-website/pull/500#issuecomment-992081513
> @Narcasserun Is this PR good to go or not?
> @Narcasserun Is this PR good to go or not?
go go go
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler-website] Narcasserun commented on pull request #500: add datasource spi design doc (#6071)
Posted by GitBox <gi...@apache.org>.
Narcasserun commented on pull request #500:
URL: https://github.com/apache/dolphinscheduler-website/pull/500#issuecomment-992081590
> @Narcasserun Is this PR good to go or not?
go go go
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler-website] zhongjiajie commented on pull request #500: add datasource spi design doc (#6071)
Posted by GitBox <gi...@apache.org>.
zhongjiajie commented on pull request #500:
URL: https://github.com/apache/dolphinscheduler-website/pull/500#issuecomment-972460962
@Narcasserun Does this PR ready to go now?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler-website] CalvinKirs merged pull request #500: add datasource spi design doc (#6071)
Posted by GitBox <gi...@apache.org>.
CalvinKirs merged pull request #500:
URL: https://github.com/apache/dolphinscheduler-website/pull/500
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org