You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@streampipes.apache.org by GitBox <gi...@apache.org> on 2023/02/07 09:02:41 UTC
[GitHub] [streampipes] eckological created a discussion: Microsoft SQL datasink
GitHub user eckological created a discussion: Microsoft SQL datasink
A Microsoft SQL datasink would be very helpful :)
GitHub link: https://github.com/apache/streampipes/discussions/1236
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] bossenti added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user bossenti added a comment to the discussion: Microsoft SQL datasink
@eckological have you any features in mind that such a sink should definitely provide?
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-4943081
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] bossenti added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user bossenti added a comment to the discussion: Microsoft SQL datasink
That's a valid point.
My intention was just to carve out all the technical stuff from the feature request discussion to a dedicated one.
Looks like you already spent a lot of conceptual work on our JDBC setup 👍🏼
So we are probably talking about harmonizing and refactoring our JDBC sinks or are you more about documenting the status quo?
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5023309
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] eckological added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user eckological added a comment to the discussion: Microsoft SQL datasink
Maybe some way to use stored procedures in case you want to do something more fancy than "just insert into a table"?
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-4993188
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] bossenti added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user bossenti added a comment to the discussion: Microsoft SQL datasink
Thanks for creating the discussion 🙏🏼
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5025354
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] bossenti added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user bossenti added a comment to the discussion: Microsoft SQL datasink
For an initial version the first version sounds realistic
For the second one I cannot really access how much effort this would mean.
So I would suggest to create an issue for the sink with the feature set described in the first comment.
Would you be interested in contribution here @eckological? 🙂
Please don't feel obliged, just curious if you are interested in
Of course we would provide some mentoring in case
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5012902
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] bossenti added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user bossenti added a comment to the discussion: Microsoft SQL datasink
@eckological
Ok, then we will create an issue for this sink. Hopefully, we can work on it soon 🙂
Interesting, then our brand-new python library might be interesting for you which we will release the first time with our upcoming version `0.91.0` 💫
Stay tuned!
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5024267
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] eckological added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user eckological added a comment to the discussion: Microsoft SQL datasink
I have played around with the idea for a couple of weeks and i am intrigued. However, i'm not proficient in Java. I have some experience with Python and C#.
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5024147
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] flomickl added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user flomickl added a comment to the discussion: Microsoft SQL datasink
@bossenti
I think we should do both ^^
The summarized conclusion for the Microsoft SQL here.
In general, we should discuss and document the JDBC database drivers and types.
My plan is to create a postgis sink soon anyway and maybe other db sinks. So, a good moment I think
Ages Ago I started this section https://cwiki.apache.org/confluence/x/Qg54CQ
before you have rewritten the JDBC stuff :)
We should update and fill the blank spots.
What do you think?
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5023167
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] flomickl edited a comment on the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user flomickl edited a comment on the discussion: Microsoft SQL datasink
Can Microsoft SQL connect via jdbc driver?
Does Micrsofot SQL have different data types than already implemented here
https://github.com/apache/streampipes/blob/dev/streampipes-extensions/streampipes-sinks-databases-jvm/src/main/java/org/apache/streampipes/sinks/databases/jvm/jdbcclient/model/DbDataTypes.java
and handled here https://github.com/apache/streampipes/blob/dev/streampipes-extensions/streampipes-sinks-databases-jvm/src/main/java/org/apache/streampipes/sinks/databases/jvm/jdbcclient/model/DbDataTypeFactory.java
?
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5000703
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] flomickl added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user flomickl added a comment to the discussion: Microsoft SQL datasink
Does Micrsofot SQL have different data types than already implemented here
https://github.com/apache/streampipes/blob/dev/streampipes-extensions/streampipes-sinks-databases-jvm/src/main/java/org/apache/streampipes/sinks/databases/jvm/jdbcclient/model/DbDataTypes.java
and handled here https://github.com/apache/streampipes/blob/dev/streampipes-extensions/streampipes-sinks-databases-jvm/src/main/java/org/apache/streampipes/sinks/databases/jvm/jdbcclient/model/DbDataTypeFactory.java
?
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5000703
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] eckological edited a comment on the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user eckological edited a comment on the discussion: Microsoft SQL datasink
@bossenti I have played around with the idea for a couple of weeks and i am intrigued. However, i'm not proficient in Java. I have some experience with Python and C#.
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5024147
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] tenthe added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user tenthe added a comment to the discussion: Microsoft SQL datasink
Hey @eckological,
thanks a lot for the suggestion.
I think that is a great idea and my suggestion would be to direclty transfer this discussion to an issue and mark it as a `good first issue`
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-4897557
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] eckological added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user eckological added a comment to the discussion: Microsoft SQL datasink
Sorry, nothing except the obvious, Hostname, port, database name, table name, credentials, SSL
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-4992952
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] flomickl added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user flomickl added a comment to the discussion: Microsoft SQL datasink
I am uncertain if we are talking about harmonizing and refactoring our JDBC
This was way before you did https://github.com/apache/streampipes/issues/512
So let's have a look. But we should discuss this in a separate discussion here #1313
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5025340
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] flomickl added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user flomickl added a comment to the discussion: Microsoft SQL datasink
I also added a general discussion about sinks structure #1314
I think for the Microsoft SQL sink implementation, the outcome of the 1 class method and type is relevant :)
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5025420
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] bossenti added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user bossenti added a comment to the discussion: Microsoft SQL datasink
These are indeed important aspects @flomickl ❗
I would propose to sort them out during working on the implementation of the issue or in a dedicated dev-discussion beforehand.
Would you agree? 🙂
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5012917
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] bossenti added a comment to the discussion: Microsoft SQL datasink
Posted by GitBox <gi...@apache.org>.
GitHub user bossenti added a comment to the discussion: Microsoft SQL datasink
issue is created https://github.com/apache/streampipes/issues/1348
GitHub link: https://github.com/apache/streampipes/discussions/1236#discussioncomment-5101812
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org