You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ofbiz.apache.org by "Oleg Kozyrev Jr." <o....@mail.ru> on 2006/12/04 07:38:40 UTC
Datawarehouse implementation
Hello, all
My partner Kirill Kuznetsov and I were working last year on the integration
of Data Warehouse module. Finally we reached following results:
1. ETL processes described in XML, executed in Ofbiz and realized via
Octopus, which transform and transfer data from some JDBC source to Ofbiz
SQL database.
2. OLAP tool which makes it possible to process MDX queries & OLAP
Operations (sorting, filters, drilldowns, and so on) in Ofbiz interface.
3. Ofbiz Interfaces including some nice diagrams (implemented as applets
using JFreeChart).
In addition we have some working examples (data models + star schemas, e.g.
Healthcare data model)
Certainly it's not a ready result, and this year new students of our
university will probably continue our efforts making it more functional &
easy to use (it's planned to finish old functionalities, add new math tools
like regressions, etc.)
Still it would be great if you took a look at out project (it is
downloadable at sourceforge.net), or if it is interesting we could make
online access (demos to our working version). The most interesting question
for us is if it can be after some modifications be included into Ofbiz
Source Code.
There was also an issue in the old Jira (jira.ofbiz.org) called "Ofbiz
Datawarehouse component" (617 as far as i remember).
Best Regards,
Kirill Kuzntetsov & Oleg Kozyrev
--
View this message in context: http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426
Sent from the OFBiz - Dev mailing list archive at Nabble.com.
Re: Datawarehouse implementation
Posted by "Oleg Kozyrev Jr." <o....@mail.ru>.
Jacopo,
We were using Octopus (http://forge.objectweb.org/projects/octopus/). It's
made under LGPL. So, it can be used in the same way as Shark.
Also we have used Mondrian (http://sourceforge.net/projects/mondrian/). It's
made under CPL and as far as I understand it's ok.
OLAP part is using JFreeChart and it is aldo LGPL. Also we are using only
css files from JPivot and, certainly, we can easily make our own and have
nothing in common with JPivot. OLAP is fully made on OFBiz Widgets.
Well, I hope, that licence stuff is ok.
Oleg.
Jacopo Cappellato wrote:
>
> Oleg,
>
> this is interesting and I'll have a look at it, thanks.
> About including the new component into OFBiz, the first (but not the
> only one) thing we should consider is the license issue: we can only
> include in our svn tree jar files, xsd schemas and code compatible with
> the licenses listed here:
>
> http://docs.ofbiz.org/display/OFBADMIN/Libraries+Included+in+OFBiz
>
> Jacopo
>
> PS: the direct link to Oleg's project in Sourceforge.net is:
>
> http://sourceforge.net/projects/datawarehouse/
>
>
> Oleg Kozyrev Jr. wrote:
>> Hello, all
>>
>> My partner Kirill Kuznetsov and I were working last year on the
>> integration
>> of Data Warehouse module. Finally we reached following results:
>> 1. ETL processes described in XML, executed in Ofbiz and realized via
>> Octopus, which transform and transfer data from some JDBC source to Ofbiz
>> SQL database.
>> 2. OLAP tool which makes it possible to process MDX queries & OLAP
>> Operations (sorting, filters, drilldowns, and so on) in Ofbiz interface.
>> 3. Ofbiz Interfaces including some nice diagrams (implemented as applets
>> using JFreeChart).
>> In addition we have some working examples (data models + star schemas,
>> e.g.
>> Healthcare data model)
>>
>> Certainly it's not a ready result, and this year new students of our
>> university will probably continue our efforts making it more functional
>> &
>> easy to use (it's planned to finish old functionalities, add new math
>> tools
>> like regressions, etc.)
>>
>> Still it would be great if you took a look at out project (it is
>> downloadable at sourceforge.net), or if it is interesting we could make
>> online access (demos to our working version). The most interesting
>> question
>> for us is if it can be after some modifications be included into Ofbiz
>> Source Code.
>>
>> There was also an issue in the old Jira (jira.ofbiz.org) called "Ofbiz
>> Datawarehouse component" (617 as far as i remember).
>>
>> Best Regards,
>> Kirill Kuzntetsov & Oleg Kozyrev
>
>
>
>
--
View this message in context: http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671884
Sent from the OFBiz - Dev mailing list archive at Nabble.com.
Re: Datawarehouse implementation
Posted by Jacopo Cappellato <ti...@sastau.it>.
Oleg,
this is interesting and I'll have a look at it, thanks.
About including the new component into OFBiz, the first (but not the
only one) thing we should consider is the license issue: we can only
include in our svn tree jar files, xsd schemas and code compatible with
the licenses listed here:
http://docs.ofbiz.org/display/OFBADMIN/Libraries+Included+in+OFBiz
Jacopo
PS: the direct link to Oleg's project in Sourceforge.net is:
http://sourceforge.net/projects/datawarehouse/
Oleg Kozyrev Jr. wrote:
> Hello, all
>
> My partner Kirill Kuznetsov and I were working last year on the integration
> of Data Warehouse module. Finally we reached following results:
> 1. ETL processes described in XML, executed in Ofbiz and realized via
> Octopus, which transform and transfer data from some JDBC source to Ofbiz
> SQL database.
> 2. OLAP tool which makes it possible to process MDX queries & OLAP
> Operations (sorting, filters, drilldowns, and so on) in Ofbiz interface.
> 3. Ofbiz Interfaces including some nice diagrams (implemented as applets
> using JFreeChart).
> In addition we have some working examples (data models + star schemas, e.g.
> Healthcare data model)
>
> Certainly it's not a ready result, and this year new students of our
> university will probably continue our efforts making it more functional &
> easy to use (it's planned to finish old functionalities, add new math tools
> like regressions, etc.)
>
> Still it would be great if you took a look at out project (it is
> downloadable at sourceforge.net), or if it is interesting we could make
> online access (demos to our working version). The most interesting question
> for us is if it can be after some modifications be included into Ofbiz
> Source Code.
>
> There was also an issue in the old Jira (jira.ofbiz.org) called "Ofbiz
> Datawarehouse component" (617 as far as i remember).
>
> Best Regards,
> Kirill Kuzntetsov & Oleg Kozyrev
Re: Datawarehouse implementation
Posted by Chris Howe <cj...@yahoo.com>.
Hey Si,
What have you done so far with the openI stuff? I'm
thinking if some of Oleg's stuff were incorporated it
would be fairly short work to have openI utilize the
delegator for the connection info and then benefit
from the openI's analysis generation but keep it
templated through screens and such.
I'd be very interested in seeing what y'all have come
up with so far. Everything I've done so far with it
has predominately been using it along side ofbiz with
the integration steps just giving the benefit of not
having to have an additional tomcat instance running
on another port.
--- Si Chen <si...@opensourcestrategies.com> wrote:
> Hi everybody -
>
> We have been experimenting with openi, olap, and
> mondrian with ofbiz
> ourselves, thanks to Chris's documentation, and have
> had some
> success. We're now able to generate some cubes for
> ofbiz.
>
> Do you want to take a look at what we've done? Do
> you have some code
> samples that you're willing to post/share somewhere
> online, so we can
> coordinate?
>
> Longer term, I do agree with David -- it might not
> be ideal for OFBiz
> per se to have so much reliance on LGPL libraries.
>
>
Re: Datawarehouse implementation
Posted by Si Chen <si...@opensourcestrategies.com>.
Hi everybody -
We have been experimenting with openi, olap, and mondrian with ofbiz
ourselves, thanks to Chris's documentation, and have had some
success. We're now able to generate some cubes for ofbiz.
Do you want to take a look at what we've done? Do you have some code
samples that you're willing to post/share somewhere online, so we can
coordinate?
Longer term, I do agree with David -- it might not be ideal for OFBiz
per se to have so much reliance on LGPL libraries.
On Dec 4, 2006, at 8:45 AM, David E Jones wrote:
>
> Oleg,
>
> It's great to see that you guys have made progress on this.
> Reporting, data warehousing and data analysis have been problems
> with OFBiz for a while.
>
> Depending on licensing it may be a good goal to get this into the
> main OFBiz code base, but if it is working okay as a separate
> project then it can be an add-on for people to use on top of OFBiz
> without worrying so much about licensing issues (ie you can
> continue to include LGPL licensed libraries, etc). I should make it
> clear that I'm just thinking out loud about this and while it would
> be cool to have this stuff in OFBiz itself, it certainly isn't
> required in order to be of use to OFBiz users, and hopefully to
> allow some community/interesting building around it.
>
> The one concern I would have as a separate project or even using
> LGPL libraries is having a large library of OFBiz application
> specific ETL artifacts, and reports based on the warehouse
> database. If that is the direction this is going it would be a lot
> easier to maintain those along with the applications and data model
> and such of OFBiz. If the goal for now is just to produce a tool
> set along with examples, it's not such a big deal.
>
> -David
>
>
> On Dec 3, 2006, at 11:38 PM, Oleg Kozyrev Jr. wrote:
>
>> Hello, all
>>
>> My partner Kirill Kuznetsov and I were working last year on the
>> integration
>> of Data Warehouse module. Finally we reached following results:
>> 1. ETL processes described in XML, executed in Ofbiz and realized via
>> Octopus, which transform and transfer data from some JDBC source
>> to Ofbiz
>> SQL database.
>> 2. OLAP tool which makes it possible to process MDX queries & OLAP
>> Operations (sorting, filters, drilldowns, and so on) in Ofbiz
>> interface.
>> 3. Ofbiz Interfaces including some nice diagrams (implemented as
>> applets
>> using JFreeChart).
>> In addition we have some working examples (data models + star
>> schemas, e.g.
>> Healthcare data model)
>>
>> Certainly it's not a ready result, and this year new students of our
>> university will probably continue our efforts making it more
>> functional &
>> easy to use (it's planned to finish old functionalities, add new
>> math tools
>> like regressions, etc.)
>>
>> Still it would be great if you took a look at out project (it is
>> downloadable at sourceforge.net), or if it is interesting we could
>> make
>> online access (demos to our working version). The most interesting
>> question
>> for us is if it can be after some modifications be included into
>> Ofbiz
>> Source Code.
>>
>> There was also an issue in the old Jira (jira.ofbiz.org) called
>> "Ofbiz
>> Datawarehouse component" (617 as far as i remember).
>>
>> Best Regards,
>> Kirill Kuzntetsov & Oleg Kozyrev
>> --
>> View this message in context: http://www.nabble.com/Datawarehouse-
>> implementation-tf2749621.html#a7671426
>> Sent from the OFBiz - Dev mailing list archive at Nabble.com.
>>
Best Regards,
Si
sichen@opensourcestrategies.com
Re: Datawarehouse implementation
Posted by David E Jones <jo...@undersunconsulting.com>.
Oleg,
It's great to see that you guys have made progress on this.
Reporting, data warehousing and data analysis have been problems with
OFBiz for a while.
Depending on licensing it may be a good goal to get this into the
main OFBiz code base, but if it is working okay as a separate project
then it can be an add-on for people to use on top of OFBiz without
worrying so much about licensing issues (ie you can continue to
include LGPL licensed libraries, etc). I should make it clear that
I'm just thinking out loud about this and while it would be cool to
have this stuff in OFBiz itself, it certainly isn't required in order
to be of use to OFBiz users, and hopefully to allow some community/
interesting building around it.
The one concern I would have as a separate project or even using LGPL
libraries is having a large library of OFBiz application specific ETL
artifacts, and reports based on the warehouse database. If that is
the direction this is going it would be a lot easier to maintain
those along with the applications and data model and such of OFBiz.
If the goal for now is just to produce a tool set along with
examples, it's not such a big deal.
-David
On Dec 3, 2006, at 11:38 PM, Oleg Kozyrev Jr. wrote:
> Hello, all
>
> My partner Kirill Kuznetsov and I were working last year on the
> integration
> of Data Warehouse module. Finally we reached following results:
> 1. ETL processes described in XML, executed in Ofbiz and realized via
> Octopus, which transform and transfer data from some JDBC source to
> Ofbiz
> SQL database.
> 2. OLAP tool which makes it possible to process MDX queries & OLAP
> Operations (sorting, filters, drilldowns, and so on) in Ofbiz
> interface.
> 3. Ofbiz Interfaces including some nice diagrams (implemented as
> applets
> using JFreeChart).
> In addition we have some working examples (data models + star
> schemas, e.g.
> Healthcare data model)
>
> Certainly it's not a ready result, and this year new students of our
> university will probably continue our efforts making it more
> functional &
> easy to use (it's planned to finish old functionalities, add new
> math tools
> like regressions, etc.)
>
> Still it would be great if you took a look at out project (it is
> downloadable at sourceforge.net), or if it is interesting we could
> make
> online access (demos to our working version). The most interesting
> question
> for us is if it can be after some modifications be included into
> Ofbiz
> Source Code.
>
> There was also an issue in the old Jira (jira.ofbiz.org) called
> "Ofbiz
> Datawarehouse component" (617 as far as i remember).
>
> Best Regards,
> Kirill Kuzntetsov & Oleg Kozyrev
> --
> View this message in context: http://www.nabble.com/Datawarehouse-
> implementation-tf2749621.html#a7671426
> Sent from the OFBiz - Dev mailing list archive at Nabble.com.
>
Re: Datawarehouse implementation
Posted by Kirill Kuznetsov <ki...@mail.ru>.
Hi, Chris
Thank you for useful comments & inspiring ideas. We plan to build server in
the nearest time where it will be possible to see how it works. Certainly we
(or our followers) will also work on bugs you have noticed (and hopefully
will notice further). So we will post here when the server is ready.
Thanks
Kirill Kuznetsov
cjhowe wrote:
>
> In addition, requires updating web.xml and
> controller.xml to utilize the current
> org.ofbiz.webapp.control.LoginEventListener
> instead of the securityext stuff.
>
> After getting the webapp loaded successfully, I was
> not able to successfully run a query despite having
> the foodmart database installed on a mysql server and
> changing the settings to correspond to it. The java
> methods used need to implement try/catch statements to
> narrow down the problem, otherwise you just get
> generic service failure messages.
>
> Oleg,
>
> There are quite a few unlicensed source files in your
> repository, are you releasing these under the apache
> license as well or are these source files in
> collaboration with another project (The debug
> statements make reference to mondrian.properties
> whereas the file in your distribution is
> dwh-mondrian.properties suggesting that at least part
> of the java source files - ie QueryTag.java - are
> derivative of files from another project - most likely
> mondrian and AFAIK thereby not able to be released
> under an Apache license)
>
> I would very much like to help make this something
> that can eventually be worked in to Apache Ofbiz, but
> need to fully understand the licensing limitations so
> that I know if a solution needs to actually become a
> part of Apache Ofbiz or simply run inside it as a
> supplemental work.
>
> Last week I wrote up a simple guide on how to get
> openI to run inside ofbiz (at least to use embedded
> tomcat), but would very much prefer your solution as
> it moves down the milestone path to already utilize
> controller.xml, the screen widgets the login tools,
> etc. I look forward to working on this.
>
>
> --- Chris Howe <cj...@yahoo.com> wrote:
>
>> Couple small details about the build.xml file. For
>> those who want to try it out...
>>
>> Line 40 correct with your deployment's location of
>> ofbizhome
>>
>> Line 47-49 /base should now be /framework/base
>>
>>
>>
>> --- "Oleg Kozyrev Jr." <o....@mail.ru> wrote:
>>
>> >
>> > Frankly speaking, now we were using FoodMart,
>> > because it contains much more
>> > data when the OFBiz from SVN. And that's why it's
>> > better for testing.
>> >
>> > But, we have ETL based on Octopus and we have
>> > managed to build another model
>> > from OFBiz database. Unfortunatelly, it is using
>> SQL
>> > terms, but not OFBiz
>> > Entities. As I alredy said next year new students
>> > are going to work on this.
>> > They will probably extend ETL functionality to
>> work
>> > more with OFBiz
>> > Entities. It's better for modelling to my mind.
>> >
>> > Still the project is in pretty early stage, but we
>> > hope that it will under
>> > extensive development in future.
>> >
>> >
>> > cjhowe wrote:
>> > >
>> > > Hello Oleg,
>> > >
>> > > I was just doing a quick browse of your project
>> (
>> > > http://sourceforge.net/projects/datawarehouse/ )
>> > and
>> > > noticed that you still had the FoodMart cube.
>> > Have
>> > > you created a cube based on OFBiz yet or were
>> you
>> > just
>> > > testing the request/response capabilities?
>> > Thanks!
>> > >
>> > >
>> > > --- "Oleg Kozyrev Jr." <o....@mail.ru>
>> > wrote:
>> > >
>> > >>
>> > >> Hello, all
>> > >>
>> > >> My partner Kirill Kuznetsov and I were working
>> > last
>> > >> year on the integration
>> > >> of Data Warehouse module. Finally we reached
>> > >> following results:
>> > >> 1. ETL processes described in XML, executed in
>> > Ofbiz
>> > >> and realized via
>> > >> Octopus, which transform and transfer data from
>> > some
>> > >> JDBC source to Ofbiz
>> > >> SQL database.
>> > >> 2. OLAP tool which makes it possible to process
>> > MDX
>> > >> queries & OLAP
>> > >> Operations (sorting, filters, drilldowns, and
>> so
>> > on)
>> > >> in Ofbiz interface.
>> > >> 3. Ofbiz Interfaces including some nice
>> diagrams
>> > >> (implemented as applets
>> > >> using JFreeChart).
>> > >> In addition we have some working examples (data
>> > >> models + star schemas, e.g.
>> > >> Healthcare data model)
>> > >>
>> > >> Certainly it's not a ready result, and this
>> year
>> > new
>> > >> students of our
>> > >> university will probably continue our efforts
>> > making
>> > >> it more functional &
>> > >> easy to use (it's planned to finish old
>> > >> functionalities, add new math tools
>> > >> like regressions, etc.)
>> > >>
>> > >> Still it would be great if you took a look at
>> out
>> > >> project (it is
>> > >> downloadable at sourceforge.net), or if it is
>> > >> interesting we could make
>> > >> online access (demos to our working version).
>> The
>> > >> most interesting question
>> > >> for us is if it can be after some
>> modifications
>> > be
>> > >> included into Ofbiz
>> > >> Source Code.
>> > >>
>> > >> There was also an issue in the old Jira
>> > >> (jira.ofbiz.org) called "Ofbiz
>> > >> Datawarehouse component" (617 as far as i
>> > remember).
>> > >>
>> > >> Best Regards,
>> > >> Kirill Kuzntetsov & Oleg Kozyrev
>> > >> --
>> > >> View this message in context:
>> > >>
>> > >
>> >
>>
> http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426
>> > >> Sent from the OFBiz - Dev mailing list archive
>> at
>> > >> Nabble.com.
>> > >>
>> > >>
>> > >
>> > >
>> > >
>> >
>> > --
>> > View this message in context:
>> >
>>
> http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671789
>> > Sent from the OFBiz - Dev mailing list archive at
>> > Nabble.com.
>> >
>> >
>>
>>
>
>
>
--
View this message in context: http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7734323
Sent from the OFBiz - Dev mailing list archive at Nabble.com.
Re: Datawarehouse implementation
Posted by Chris Howe <cj...@yahoo.com>.
In addition, requires updating web.xml and
controller.xml to utilize the current
org.ofbiz.webapp.control.LoginEventListener
instead of the securityext stuff.
After getting the webapp loaded successfully, I was
not able to successfully run a query despite having
the foodmart database installed on a mysql server and
changing the settings to correspond to it. The java
methods used need to implement try/catch statements to
narrow down the problem, otherwise you just get
generic service failure messages.
Oleg,
There are quite a few unlicensed source files in your
repository, are you releasing these under the apache
license as well or are these source files in
collaboration with another project (The debug
statements make reference to mondrian.properties
whereas the file in your distribution is
dwh-mondrian.properties suggesting that at least part
of the java source files - ie QueryTag.java - are
derivative of files from another project - most likely
mondrian and AFAIK thereby not able to be released
under an Apache license)
I would very much like to help make this something
that can eventually be worked in to Apache Ofbiz, but
need to fully understand the licensing limitations so
that I know if a solution needs to actually become a
part of Apache Ofbiz or simply run inside it as a
supplemental work.
Last week I wrote up a simple guide on how to get
openI to run inside ofbiz (at least to use embedded
tomcat), but would very much prefer your solution as
it moves down the milestone path to already utilize
controller.xml, the screen widgets the login tools,
etc. I look forward to working on this.
--- Chris Howe <cj...@yahoo.com> wrote:
> Couple small details about the build.xml file. For
> those who want to try it out...
>
> Line 40 correct with your deployment's location of
> ofbizhome
>
> Line 47-49 /base should now be /framework/base
>
>
>
> --- "Oleg Kozyrev Jr." <o....@mail.ru> wrote:
>
> >
> > Frankly speaking, now we were using FoodMart,
> > because it contains much more
> > data when the OFBiz from SVN. And that's why it's
> > better for testing.
> >
> > But, we have ETL based on Octopus and we have
> > managed to build another model
> > from OFBiz database. Unfortunatelly, it is using
> SQL
> > terms, but not OFBiz
> > Entities. As I alredy said next year new students
> > are going to work on this.
> > They will probably extend ETL functionality to
> work
> > more with OFBiz
> > Entities. It's better for modelling to my mind.
> >
> > Still the project is in pretty early stage, but we
> > hope that it will under
> > extensive development in future.
> >
> >
> > cjhowe wrote:
> > >
> > > Hello Oleg,
> > >
> > > I was just doing a quick browse of your project
> (
> > > http://sourceforge.net/projects/datawarehouse/ )
> > and
> > > noticed that you still had the FoodMart cube.
> > Have
> > > you created a cube based on OFBiz yet or were
> you
> > just
> > > testing the request/response capabilities?
> > Thanks!
> > >
> > >
> > > --- "Oleg Kozyrev Jr." <o....@mail.ru>
> > wrote:
> > >
> > >>
> > >> Hello, all
> > >>
> > >> My partner Kirill Kuznetsov and I were working
> > last
> > >> year on the integration
> > >> of Data Warehouse module. Finally we reached
> > >> following results:
> > >> 1. ETL processes described in XML, executed in
> > Ofbiz
> > >> and realized via
> > >> Octopus, which transform and transfer data from
> > some
> > >> JDBC source to Ofbiz
> > >> SQL database.
> > >> 2. OLAP tool which makes it possible to process
> > MDX
> > >> queries & OLAP
> > >> Operations (sorting, filters, drilldowns, and
> so
> > on)
> > >> in Ofbiz interface.
> > >> 3. Ofbiz Interfaces including some nice
> diagrams
> > >> (implemented as applets
> > >> using JFreeChart).
> > >> In addition we have some working examples (data
> > >> models + star schemas, e.g.
> > >> Healthcare data model)
> > >>
> > >> Certainly it's not a ready result, and this
> year
> > new
> > >> students of our
> > >> university will probably continue our efforts
> > making
> > >> it more functional &
> > >> easy to use (it's planned to finish old
> > >> functionalities, add new math tools
> > >> like regressions, etc.)
> > >>
> > >> Still it would be great if you took a look at
> out
> > >> project (it is
> > >> downloadable at sourceforge.net), or if it is
> > >> interesting we could make
> > >> online access (demos to our working version).
> The
> > >> most interesting question
> > >> for us is if it can be after some
> modifications
> > be
> > >> included into Ofbiz
> > >> Source Code.
> > >>
> > >> There was also an issue in the old Jira
> > >> (jira.ofbiz.org) called "Ofbiz
> > >> Datawarehouse component" (617 as far as i
> > remember).
> > >>
> > >> Best Regards,
> > >> Kirill Kuzntetsov & Oleg Kozyrev
> > >> --
> > >> View this message in context:
> > >>
> > >
> >
>
http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426
> > >> Sent from the OFBiz - Dev mailing list archive
> at
> > >> Nabble.com.
> > >>
> > >>
> > >
> > >
> > >
> >
> > --
> > View this message in context:
> >
>
http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671789
> > Sent from the OFBiz - Dev mailing list archive at
> > Nabble.com.
> >
> >
>
>
Re: Datawarehouse implementation
Posted by Chris Howe <cj...@yahoo.com>.
Couple small details about the build.xml file. For
those who want to try it out...
Line 40 correct with your deployment's location of
ofbizhome
Line 47-49 /base should now be /framework/base
--- "Oleg Kozyrev Jr." <o....@mail.ru> wrote:
>
> Frankly speaking, now we were using FoodMart,
> because it contains much more
> data when the OFBiz from SVN. And that's why it's
> better for testing.
>
> But, we have ETL based on Octopus and we have
> managed to build another model
> from OFBiz database. Unfortunatelly, it is using SQL
> terms, but not OFBiz
> Entities. As I alredy said next year new students
> are going to work on this.
> They will probably extend ETL functionality to work
> more with OFBiz
> Entities. It's better for modelling to my mind.
>
> Still the project is in pretty early stage, but we
> hope that it will under
> extensive development in future.
>
>
> cjhowe wrote:
> >
> > Hello Oleg,
> >
> > I was just doing a quick browse of your project (
> > http://sourceforge.net/projects/datawarehouse/ )
> and
> > noticed that you still had the FoodMart cube.
> Have
> > you created a cube based on OFBiz yet or were you
> just
> > testing the request/response capabilities?
> Thanks!
> >
> >
> > --- "Oleg Kozyrev Jr." <o....@mail.ru>
> wrote:
> >
> >>
> >> Hello, all
> >>
> >> My partner Kirill Kuznetsov and I were working
> last
> >> year on the integration
> >> of Data Warehouse module. Finally we reached
> >> following results:
> >> 1. ETL processes described in XML, executed in
> Ofbiz
> >> and realized via
> >> Octopus, which transform and transfer data from
> some
> >> JDBC source to Ofbiz
> >> SQL database.
> >> 2. OLAP tool which makes it possible to process
> MDX
> >> queries & OLAP
> >> Operations (sorting, filters, drilldowns, and so
> on)
> >> in Ofbiz interface.
> >> 3. Ofbiz Interfaces including some nice diagrams
> >> (implemented as applets
> >> using JFreeChart).
> >> In addition we have some working examples (data
> >> models + star schemas, e.g.
> >> Healthcare data model)
> >>
> >> Certainly it's not a ready result, and this year
> new
> >> students of our
> >> university will probably continue our efforts
> making
> >> it more functional &
> >> easy to use (it's planned to finish old
> >> functionalities, add new math tools
> >> like regressions, etc.)
> >>
> >> Still it would be great if you took a look at out
> >> project (it is
> >> downloadable at sourceforge.net), or if it is
> >> interesting we could make
> >> online access (demos to our working version). The
> >> most interesting question
> >> for us is if it can be after some modifications
> be
> >> included into Ofbiz
> >> Source Code.
> >>
> >> There was also an issue in the old Jira
> >> (jira.ofbiz.org) called "Ofbiz
> >> Datawarehouse component" (617 as far as i
> remember).
> >>
> >> Best Regards,
> >> Kirill Kuzntetsov & Oleg Kozyrev
> >> --
> >> View this message in context:
> >>
> >
>
http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426
> >> Sent from the OFBiz - Dev mailing list archive at
> >> Nabble.com.
> >>
> >>
> >
> >
> >
>
> --
> View this message in context:
>
http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671789
> Sent from the OFBiz - Dev mailing list archive at
> Nabble.com.
>
>
Re: Datawarehouse implementation
Posted by "Oleg Kozyrev Jr." <o....@mail.ru>.
Frankly speaking, now we were using FoodMart, because it contains much more
data when the OFBiz from SVN. And that's why it's better for testing.
But, we have ETL based on Octopus and we have managed to build another model
from OFBiz database. Unfortunatelly, it is using SQL terms, but not OFBiz
Entities. As I alredy said next year new students are going to work on this.
They will probably extend ETL functionality to work more with OFBiz
Entities. It's better for modelling to my mind.
Still the project is in pretty early stage, but we hope that it will under
extensive development in future.
cjhowe wrote:
>
> Hello Oleg,
>
> I was just doing a quick browse of your project (
> http://sourceforge.net/projects/datawarehouse/ ) and
> noticed that you still had the FoodMart cube. Have
> you created a cube based on OFBiz yet or were you just
> testing the request/response capabilities? Thanks!
>
>
> --- "Oleg Kozyrev Jr." <o....@mail.ru> wrote:
>
>>
>> Hello, all
>>
>> My partner Kirill Kuznetsov and I were working last
>> year on the integration
>> of Data Warehouse module. Finally we reached
>> following results:
>> 1. ETL processes described in XML, executed in Ofbiz
>> and realized via
>> Octopus, which transform and transfer data from some
>> JDBC source to Ofbiz
>> SQL database.
>> 2. OLAP tool which makes it possible to process MDX
>> queries & OLAP
>> Operations (sorting, filters, drilldowns, and so on)
>> in Ofbiz interface.
>> 3. Ofbiz Interfaces including some nice diagrams
>> (implemented as applets
>> using JFreeChart).
>> In addition we have some working examples (data
>> models + star schemas, e.g.
>> Healthcare data model)
>>
>> Certainly it's not a ready result, and this year new
>> students of our
>> university will probably continue our efforts making
>> it more functional &
>> easy to use (it's planned to finish old
>> functionalities, add new math tools
>> like regressions, etc.)
>>
>> Still it would be great if you took a look at out
>> project (it is
>> downloadable at sourceforge.net), or if it is
>> interesting we could make
>> online access (demos to our working version). The
>> most interesting question
>> for us is if it can be after some modifications be
>> included into Ofbiz
>> Source Code.
>>
>> There was also an issue in the old Jira
>> (jira.ofbiz.org) called "Ofbiz
>> Datawarehouse component" (617 as far as i remember).
>>
>> Best Regards,
>> Kirill Kuzntetsov & Oleg Kozyrev
>> --
>> View this message in context:
>>
> http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426
>> Sent from the OFBiz - Dev mailing list archive at
>> Nabble.com.
>>
>>
>
>
>
--
View this message in context: http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671789
Sent from the OFBiz - Dev mailing list archive at Nabble.com.
Re: Datawarehouse implementation
Posted by Chris Howe <cj...@yahoo.com>.
Hello Oleg,
I was just doing a quick browse of your project (
http://sourceforge.net/projects/datawarehouse/ ) and
noticed that you still had the FoodMart cube. Have
you created a cube based on OFBiz yet or were you just
testing the request/response capabilities? Thanks!
--- "Oleg Kozyrev Jr." <o....@mail.ru> wrote:
>
> Hello, all
>
> My partner Kirill Kuznetsov and I were working last
> year on the integration
> of Data Warehouse module. Finally we reached
> following results:
> 1. ETL processes described in XML, executed in Ofbiz
> and realized via
> Octopus, which transform and transfer data from some
> JDBC source to Ofbiz
> SQL database.
> 2. OLAP tool which makes it possible to process MDX
> queries & OLAP
> Operations (sorting, filters, drilldowns, and so on)
> in Ofbiz interface.
> 3. Ofbiz Interfaces including some nice diagrams
> (implemented as applets
> using JFreeChart).
> In addition we have some working examples (data
> models + star schemas, e.g.
> Healthcare data model)
>
> Certainly it's not a ready result, and this year new
> students of our
> university will probably continue our efforts making
> it more functional &
> easy to use (it's planned to finish old
> functionalities, add new math tools
> like regressions, etc.)
>
> Still it would be great if you took a look at out
> project (it is
> downloadable at sourceforge.net), or if it is
> interesting we could make
> online access (demos to our working version). The
> most interesting question
> for us is if it can be after some modifications be
> included into Ofbiz
> Source Code.
>
> There was also an issue in the old Jira
> (jira.ofbiz.org) called "Ofbiz
> Datawarehouse component" (617 as far as i remember).
>
> Best Regards,
> Kirill Kuzntetsov & Oleg Kozyrev
> --
> View this message in context:
>
http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426
> Sent from the OFBiz - Dev mailing list archive at
> Nabble.com.
>
>