You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/08/08 17:52:54 UTC
[GitHub] [dolphinscheduler] robert-guangzhou opened a new pull request #5963: [Feature-5742][server/UI ] Implement PG support of sqoop
robert-guangzhou opened a new pull request #5963:
URL: https://github.com/apache/dolphinscheduler/pull/5963
<!--Thanks very much for contributing to Apache DolphinScheduler. Please review https://dolphinscheduler.apache.org/en-us/community/development/pull-request.html before opening a pull request.-->
## Purpose of the pull request
add common jdbc support of sqoop task.
<!--(For example: This pull request adds checkstyle plugin).-->
## Brief change log
modify:
1. mysql target/source of sqoop
2. sqoop.vue
to support common jdbc .
<!--*(for example:)*
- *Add maven-checkstyle-plugin to root pom.xml*
-->
## Verify this pull request
some data like follow data will saved in table t_ds_task_definition.
{"jobType":"TEMPLATE","localParams":[],"jobName":"mks_inst_active_from_hive","hadoopCustomParams":[],"sqoopAdvancedParams":[],"concurrency":1,"modelType":"export","sourceType":"HIVE","targetType":"JDBC","targetParams":"{\"targetType\":\"POSTGRESQL\",\"targetDatasource\":3,\"targetTable\":\"mks_inst_active_from_hive\",\"targetColumns\":\"\",\"fieldsTerminated\":\"\",\"linesTerminated\":\"\",\"preQuery\":\"\",\"isUpdate\":false,\"targetUpdateKey\":\"\",\"targetUpdateMode\":\"allowinsert\"}","sourceParams":"{\"hiveDatabase\":\"default\",\"hiveTable\":\"mks_inst_active\",\"hivePartitionKey\":\"\",\"hivePartitionValue\":\"\"}","conditionResult":"{\"successNode\":[\"\"],\"failedNode\":[\"\"]}","dependence":"{}"}
{"jobType":"TEMPLATE","localParams":[],"jobName":"mks_inst_active_from_hive","hadoopCustomParams":[],"sqoopAdvancedParams":[],"concurrency":1,"modelType":"import","sourceType":"JDBC","targetType":"HIVE","targetParams":"{\"hiveDatabase\":\"default\",\"hiveTable\":\"mks_inst_active_from_hive\",\"createHiveTable\":false,\"dropDelimiter\":false,\"hiveOverWrite\":true,\"replaceDelimiter\":\"\",\"hivePartitionKey\":\"\",\"hivePartitionValue\":\"\"}","sourceParams":"{\"srcType\":\"POSTGRESQL\",\"srcDatasource\":3,\"srcTable\":\"mks_inst_active\",\"srcQueryType\":\"0\",\"srcQuerySql\":\"\",\"srcColumnType\":\"0\",\"srcColumns\":\"\",\"srcConditionList\":[],\"mapColumnHive\":[],\"mapColumnJava\":[]}","conditionResult":"{\"successNode\":[\"\"],\"failedNode\":[\"\"]}","dependence":"{}"}
the ui was test in window 10 with follow setting:
npm ls|findstr vue
| | `-- vue@2.6.14
| | `-- vue@2.6.14 deduped
+-- @riophae/vue-treeselect@0.4.0
| +-- babel-helper-vue-jsx-merge-props@2.0.3 deduped
+-- babel-helper-vue-jsx-merge-props@2.0.3
+-- babel-plugin-transform-vue-jsx@3.7.0
| +-- babel-helper-vue-jsx-merge-props@2.0.3 deduped
+-- eslint-plugin-vue@7.15.1
| `-- vue-eslint-parser@7.10.0
+-- UNMET DEPENDENCY vue@2.5.17
+-- vue-loader@15.9.8
| +-- @vue/component-compiler-utils@3.2.2
| | `-- vue-template-es2015-compiler@1.9.1
| +-- vue-hot-reload-api@2.3.4
| `-- vue-style-loader@4.1.3 deduped
+-- vue-router@3.5.2
+-- vue-style-loader@4.1.3
+-- vue-template-compiler@2.6.14
+-- vuex@3.6.2
+-- vuex-router-sync@5.0.0
npm ERR! missing: vue@2.5.17, required by dolphinscheduler-ui-frontend@1.0.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] closed pull request #5963: [Feature-5742][server/UI ] Implement PG support of sqoop
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed pull request #5963:
URL: https://github.com/apache/dolphinscheduler/pull/5963
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on pull request #5963: [Feature-5742][server/UI ] Implement PG support of sqoop
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #5963:
URL: https://github.com/apache/dolphinscheduler/pull/5963#issuecomment-1001261167
This pull request has been automatically marked as stale because it has not had recent activity for 120 days. It will be closed in 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] CalvinKirs commented on pull request #5963: [Feature-5742][server/UI ] Implement PG support of sqoop
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on pull request #5963:
URL: https://github.com/apache/dolphinscheduler/pull/5963#issuecomment-900887835
hi, what problem did you encounter? Need my help?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] CalvinKirs commented on pull request #5963: [Feature-5742][server/UI ] Implement PG support of sqoop
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on pull request #5963:
URL: https://github.com/apache/dolphinscheduler/pull/5963#issuecomment-900887835
hi, what problem did you encounter? Need my help?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] zhuangchong commented on pull request #5963: [Feature-5742][server/UI ] Implement PG support of sqoop
Posted by GitBox <gi...@apache.org>.
zhuangchong commented on pull request #5963:
URL: https://github.com/apache/dolphinscheduler/pull/5963#issuecomment-899237838
Please resolve the check exception.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on pull request #5963: [Feature-5742][server/UI ] Implement PG support of sqoop
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #5963:
URL: https://github.com/apache/dolphinscheduler/pull/5963#issuecomment-1004440482
This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encouraged to continue work on this pull request.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org