You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@fineract.apache.org by Nayan Ambali <na...@gmail.com> on 2016/07/06 02:04:12 UTC
[Voting] Does bulk import feature (a.k.a. Data Import Tool) should be
part of core platform
Dear Mifos and Fineract users,
Should 'Data Import Tool' be integrated into core platform instead of
maintaining it as separate product? if yes then please upvote.
if you want know more about 'Data Import Tool', please visit
https://github.com/openMF/DataImportTool
Thanks and Regards,
Nayan Ambali
+91 9591996042
skype: nayangambali
Re: [Voting] Does bulk import feature (a.k.a. Data Import Tool) should
be part of core platform
Posted by MexinaM Daniel <me...@singo.co.tz>.
Hi all
+1
It will be good for it to be integrated to the Mifos.
On 07/06/2016 05:04 AM, Nayan Ambali wrote:
> Dear Mifos and Fineract users,
>
> Should 'Data Import Tool' be integrated into core platform instead of
> maintaining it as separate product? if yes then please upvote.
>
> if you want know more about 'Data Import Tool', please visit
> https://github.com/openMF/DataImportTool
>
>
> Thanks and Regards,
> Nayan Ambali
> +91 9591996042 <tel:%2B91%209591996042>
> skype: nayangambali
Re: [Voting] Does bulk import feature (a.k.a. Data Import Tool)
should be part of core platform
Posted by Sander van der Heyden <sa...@musoni.eu>.
Firm +1 from this side as well!
Over time we've made various changes and bugfixes to the older version of
the import tool, which can be found in this fork:
https://github.com/Musoni/DataImportTool. Feel free to let me know if you
want us to send any PR's for this.
I think it would also be good to think a bit about some of the more
'quirky' things in the import tool, such as the lack of some form of
progress bar, and the issues that when a browser or user connection time
out that there is no way to get the re-upload files. I would therefore
suggest to store the files in S3/Local after processing so the user can
fetch back using a processing ID or some form of history. Similar things
can be done for checking progress as well, where the API consumer will get
back a resource ID and that can be used to query for status.
S
Sander van der Heyden
CTO Musoni Services
Mobile (NL): +31 (0)6 14239505
Skype: s.vdheyden
Website: musonisystem.com
Follow us on Twitter! <https://twitter.com/musonimfi>
Postal address: Hillegomstraat 12-14, office 0.09, 1058 LS, Amsterdam,
The Netherlands
On Wed, Jul 6, 2016 at 4:04 AM, Nayan Ambali <na...@gmail.com> wrote:
> Dear Mifos and Fineract users,
>
> Should 'Data Import Tool' be integrated into core platform instead of
> maintaining it as separate product? if yes then please upvote.
>
> if you want know more about 'Data Import Tool', please visit
> https://github.com/openMF/DataImportTool
>
>
> Thanks and Regards,
> Nayan Ambali
> +91 9591996042
> skype: nayangambali
>
Re: [Voting] Does bulk import feature (a.k.a. Data Import Tool)
should be part of core platform
Posted by Ashok <as...@confluxtechnologies.com>.
+1
It make sense to integrate and keep up to date with platform version.
On Wed, 6 Jul 2016 at 7:34 AM, Nayan Ambali <na...@gmail.com> wrote:
> Dear Mifos and Fineract users,
>
> Should 'Data Import Tool' be integrated into core platform instead of
> maintaining it as separate product? if yes then please upvote.
>
> if you want know more about 'Data Import Tool', please visit
> https://github.com/openMF/DataImportTool
>
>
> Thanks and Regards,
> Nayan Ambali
> +91 9591996042
> skype: nayangambali
>
--
Regards,
Ashok
Sent from mobile device
RE: [Mifos-users] [Voting] Does bulk import feature (a.k.a. Data
Import Tool) should be part of core platform
Posted by ayuk etta <et...@gmail.com>.
+1 from this end also
On 6 Jul 2016 12:00, "Skyburg Systems" <in...@skyburgsystems.org> wrote:
> +1
>
>
>
> *From:* Nayan Ambali [mailto:nayan.ambali@gmail.com]
> *Sent:* July 06, 2016 4:04 AM
> *To:* A good place to start for users or folks new to Mifos.;
> user@fineract.incubator.apache.org; Abidkhan; Krishnamurthy; ayuk etta;
> ippezrobert@gmail.com; Maek Twain; srinivasarao Yedida; Daniel Carlson;
> jubha mayala; nfo@skyburgsystems.org; anurag@theupscale.in;
> teddhy.bamba@virtual-reflex.com
> *Cc:* Avik Ganguly
> *Subject:* [Mifos-users] [Voting] Does bulk import feature (a.k.a. Data
> Import Tool) should be part of core platform
>
>
>
> Dear Mifos and Fineract users,
>
> Should 'Data Import Tool' be integrated into core platform instead of
> maintaining it as separate product? if yes then please upvote.
>
> if you want know more about 'Data Import Tool', please visit
> https://github.com/openMF/DataImportTool
>
>
>
> Thanks and Regards,
> Nayan Ambali
>
> +91 9591996042
>
> skype: nayangambali
>
Re: [Mifos-users] [Voting] Does bulk import feature (a.k.a. Data
Import Tool) should be part of core platform
Posted by Nayan Ambali <na...@gmail.com>.
Yes Sander, test cases are ignored, I will try get them green :) mean while
you can send the PR.
On Fri, Jul 22, 2016, 1:42 PM Sander van der Heyden <
sandervanderheyden@musonisystem.com> wrote:
> Hi Nayan,
>
> I was looking to merge some of our work, but found out that the current
> dev and master branch is not building as result of various findBugs and PMD
> issues which seem to have been there for very long. To what extent have
> these already been addressed? Or is everyone just ignoring them and
> uncommenting when building?
>
> S
>
>
>
> Sander van der Heyden
>
> CTO Musoni Services
>
>
>
>
> Mobile (NL): +31 (0)6 14239505
> Skype: s.vdheyden
> Website: musonisystem.com
> Follow us on Twitter! <https://twitter.com/musonimfi>
> Postal address: Hillegomstraat 12-14, office 0.09, 1058 LS, Amsterdam,
> The Netherlands
>
> On 21 July 2016 at 07:35, Nayan Ambali <na...@gmail.com> wrote:
>
>> Thanks Sander, I was under the impression that it is POI limitation :)
>> and also please send the PR for the bug fix done by Musoni.
>>
>>
>> Thanks and Regards,
>> Nayan Ambali
>> +91 9591996042
>> skype: nayangambali
>>
>> On Thu, Jul 21, 2016 at 10:59 AM, Sander van der Heyden <
>> sandervanderheyden@musonisystem.com> wrote:
>>
>>> Hi Nayan,
>>>
>>> The 4000 limitation is very easy to circumvent by removing the color
>>> coding done on the status column. The issue is that the excel class creates
>>> a new style for every marked up cell, instead of re-using the same one
>>> again. This causes a limitation in the number of styles that can be used in
>>> a single document. Removing the styling on the status column fixes that and
>>> since we've imported files of 20.000 clients and up to 10.000 loans using
>>> it. It just takes some time ;-)
>>>
>>> Sander
>>>
>>>
>>>
>>> Sander van der Heyden
>>>
>>> CTO Musoni Services
>>>
>>>
>>>
>>>
>>> Mobile (NL): +31 (0)6 14239505
>>> Skype: s.vdheyden
>>> Website: musonisystem.com
>>> Follow us on Twitter! <https://twitter.com/musonimfi>
>>> Postal address: Hillegomstraat 12-14, office 0.09, 1058 LS, Amsterdam,
>>> The Netherlands
>>>
>>> On 21 July 2016 at 06:22, Nayan Ambali <na...@gmail.com> wrote:
>>>
>>>> Sander,
>>>>
>>>> Thanks for the feedback on usability, also we can think of office level
>>>> import, at present import tool get the lookup data at org level and import
>>>> template does not work if org has more than 4 thousand clients
>>>>
>>>> And please please send the bug fix done at Musoni to openmf repo,
>>>> looking forward for the PR.
>>>>
>>>>
>>>>
>>>>
>>>> Thanks and Regards,
>>>> Nayan Ambali
>>>> +91 9591996042
>>>> skype: nayangambali
>>>>
>>>> On Wed, Jul 6, 2016 at 11:08 AM, Sander van der Heyden <
>>>> sandervanderheyden@musoni.eu> wrote:
>>>>
>>>>> Firm +1 from this side as well!
>>>>>
>>>>> Over time we've made various changes and bugfixes to the older version
>>>>> of the import tool, which can be found in this fork:
>>>>> https://github.com/Musoni/DataImportTool. Feel free to let me know if
>>>>> you want us to send any PR's for this.
>>>>>
>>>>> I think it would also be good to think a bit about some of the more
>>>>> 'quirky' things in the import tool, such as the lack of some form of
>>>>> progress bar, and the issues that when a browser or user connection time
>>>>> out that there is no way to get the re-upload files. I would therefore
>>>>> suggest to store the files in S3/Local after processing so the user can
>>>>> fetch back using a processing ID or some form of history. Similar things
>>>>> can be done for checking progress as well, where the API consumer will get
>>>>> back a resource ID and that can be used to query for status.
>>>>>
>>>>> S
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Sander van der Heyden
>>>>>
>>>>> CTO Musoni Services
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Mobile (NL): +31 (0)6 14239505
>>>>> Skype: s.vdheyden
>>>>> Website: musonisystem.com
>>>>> Follow us on Twitter! <https://twitter.com/musonimfi>
>>>>> Postal address: Hillegomstraat 12-14, office 0.09, 1058 LS, Amsterdam,
>>>>> The Netherlands
>>>>>
>>>>> On Wed, Jul 6, 2016 at 4:06 AM, Dayna Harp <dh...@mifos.org> wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> *Dayna Harp*
>>>>>> Director Strategic Initiatives, The Mifos Initiative
>>>>>> dharp@mifos.org <ed...@mifos.org> | Skype: harpcreek | Mobile: 011
>>>>>> +501.628.9686
>>>>>>
>>>>>> *Ending Poverty One Line of Code at a Time | *http://mifos.org
>>>>>> <http://facebook.com/mifos>
>>>>>>
>>>>>>
>>>>>> <http://facebook.com/mifos>
>>>>>>
>>>>>>
>>>>>>
>>>>>> <http://www.twitter.com/mifos>
>>>>>>
>>>>>>
>>>>>> On Jul 5, 2016, at 8:04 PM, Nayan Ambali <na...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>> Dear Mifos and Fineract users,
>>>>>>
>>>>>> Should 'Data Import Tool' be integrated into core platform instead of
>>>>>> maintaining it as separate product? if yes then please upvote.
>>>>>>
>>>>>> if you want know more about 'Data Import Tool', please visit
>>>>>> https://github.com/openMF/DataImportTool
>>>>>>
>>>>>>
>>>>>> Thanks and Regards,
>>>>>> Nayan Ambali
>>>>>> +91 9591996042
>>>>>> skype: nayangambali
>>>>>>
>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in
>>>>>> San
>>>>>> Francisco, CA to explore cutting-edge tech and listen to tech
>>>>>> luminaries
>>>>>> present their vision of the future. This family event has something
>>>>>> for
>>>>>> everyone, including kids. Get more information and register today.
>>>>>> http://sdm.link/attshape
>>>>>> _______________________________________________
>>>>>> Mifos-users mailing list
>>>>>> Mifos-users@lists.sourceforge.net
>>>>>> https://lists.sourceforge.net/lists/listinfo/mifos-users
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: [Mifos-users] [Voting] Does bulk import feature (a.k.a. Data
Import Tool) should be part of core platform
Posted by Nayan Ambali <na...@gmail.com>.
Thanks Sander, I was under the impression that it is POI limitation :) and
also please send the PR for the bug fix done by Musoni.
Thanks and Regards,
Nayan Ambali
+91 9591996042
skype: nayangambali
On Thu, Jul 21, 2016 at 10:59 AM, Sander van der Heyden <
sandervanderheyden@musonisystem.com> wrote:
> Hi Nayan,
>
> The 4000 limitation is very easy to circumvent by removing the color
> coding done on the status column. The issue is that the excel class creates
> a new style for every marked up cell, instead of re-using the same one
> again. This causes a limitation in the number of styles that can be used in
> a single document. Removing the styling on the status column fixes that and
> since we've imported files of 20.000 clients and up to 10.000 loans using
> it. It just takes some time ;-)
>
> Sander
>
>
>
> Sander van der Heyden
>
> CTO Musoni Services
>
>
>
>
> Mobile (NL): +31 (0)6 14239505
> Skype: s.vdheyden
> Website: musonisystem.com
> Follow us on Twitter! <https://twitter.com/musonimfi>
> Postal address: Hillegomstraat 12-14, office 0.09, 1058 LS, Amsterdam,
> The Netherlands
>
> On 21 July 2016 at 06:22, Nayan Ambali <na...@gmail.com> wrote:
>
>> Sander,
>>
>> Thanks for the feedback on usability, also we can think of office level
>> import, at present import tool get the lookup data at org level and import
>> template does not work if org has more than 4 thousand clients
>>
>> And please please send the bug fix done at Musoni to openmf repo, looking
>> forward for the PR.
>>
>>
>>
>>
>> Thanks and Regards,
>> Nayan Ambali
>> +91 9591996042
>> skype: nayangambali
>>
>> On Wed, Jul 6, 2016 at 11:08 AM, Sander van der Heyden <
>> sandervanderheyden@musoni.eu> wrote:
>>
>>> Firm +1 from this side as well!
>>>
>>> Over time we've made various changes and bugfixes to the older version
>>> of the import tool, which can be found in this fork:
>>> https://github.com/Musoni/DataImportTool. Feel free to let me know if
>>> you want us to send any PR's for this.
>>>
>>> I think it would also be good to think a bit about some of the more
>>> 'quirky' things in the import tool, such as the lack of some form of
>>> progress bar, and the issues that when a browser or user connection time
>>> out that there is no way to get the re-upload files. I would therefore
>>> suggest to store the files in S3/Local after processing so the user can
>>> fetch back using a processing ID or some form of history. Similar things
>>> can be done for checking progress as well, where the API consumer will get
>>> back a resource ID and that can be used to query for status.
>>>
>>> S
>>>
>>>
>>>
>>>
>>> Sander van der Heyden
>>>
>>> CTO Musoni Services
>>>
>>>
>>>
>>>
>>> Mobile (NL): +31 (0)6 14239505
>>> Skype: s.vdheyden
>>> Website: musonisystem.com
>>> Follow us on Twitter! <https://twitter.com/musonimfi>
>>> Postal address: Hillegomstraat 12-14, office 0.09, 1058 LS, Amsterdam,
>>> The Netherlands
>>>
>>> On Wed, Jul 6, 2016 at 4:06 AM, Dayna Harp <dh...@mifos.org> wrote:
>>>
>>>> +1
>>>>
>>>> *Dayna Harp*
>>>> Director Strategic Initiatives, The Mifos Initiative
>>>> dharp@mifos.org <ed...@mifos.org> | Skype: harpcreek | Mobile: 011
>>>> +501.628.9686
>>>>
>>>> *Ending Poverty One Line of Code at a Time | *http://mifos.org
>>>> <http://facebook.com/mifos>
>>>>
>>>>
>>>> <http://facebook.com/mifos>
>>>>
>>>>
>>>>
>>>> <http://www.twitter.com/mifos>
>>>>
>>>>
>>>> On Jul 5, 2016, at 8:04 PM, Nayan Ambali <na...@gmail.com>
>>>> wrote:
>>>>
>>>> Dear Mifos and Fineract users,
>>>>
>>>> Should 'Data Import Tool' be integrated into core platform instead of
>>>> maintaining it as separate product? if yes then please upvote.
>>>>
>>>> if you want know more about 'Data Import Tool', please visit
>>>> https://github.com/openMF/DataImportTool
>>>>
>>>>
>>>> Thanks and Regards,
>>>> Nayan Ambali
>>>> +91 9591996042
>>>> skype: nayangambali
>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
>>>> Francisco, CA to explore cutting-edge tech and listen to tech luminaries
>>>> present their vision of the future. This family event has something for
>>>> everyone, including kids. Get more information and register today.
>>>> http://sdm.link/attshape
>>>> _______________________________________________
>>>> Mifos-users mailing list
>>>> Mifos-users@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/mifos-users
>>>>
>>>>
>>>
>>
>
Re: [Mifos-users] [Voting] Does bulk import feature (a.k.a. Data
Import Tool) should be part of core platform
Posted by Nayan Ambali <na...@gmail.com>.
Sander,
Thanks for the feedback on usability, also we can think of office level
import, at present import tool get the lookup data at org level and import
template does not work if org has more than 4 thousand clients
And please please send the bug fix done at Musoni to openmf repo, looking
forward for the PR.
Thanks and Regards,
Nayan Ambali
+91 9591996042
skype: nayangambali
On Wed, Jul 6, 2016 at 11:08 AM, Sander van der Heyden <
sandervanderheyden@musoni.eu> wrote:
> Firm +1 from this side as well!
>
> Over time we've made various changes and bugfixes to the older version of
> the import tool, which can be found in this fork:
> https://github.com/Musoni/DataImportTool. Feel free to let me know if you
> want us to send any PR's for this.
>
> I think it would also be good to think a bit about some of the more
> 'quirky' things in the import tool, such as the lack of some form of
> progress bar, and the issues that when a browser or user connection time
> out that there is no way to get the re-upload files. I would therefore
> suggest to store the files in S3/Local after processing so the user can
> fetch back using a processing ID or some form of history. Similar things
> can be done for checking progress as well, where the API consumer will get
> back a resource ID and that can be used to query for status.
>
> S
>
>
>
>
> Sander van der Heyden
>
> CTO Musoni Services
>
>
>
>
> Mobile (NL): +31 (0)6 14239505
> Skype: s.vdheyden
> Website: musonisystem.com
> Follow us on Twitter! <https://twitter.com/musonimfi>
> Postal address: Hillegomstraat 12-14, office 0.09, 1058 LS, Amsterdam,
> The Netherlands
>
> On Wed, Jul 6, 2016 at 4:06 AM, Dayna Harp <dh...@mifos.org> wrote:
>
>> +1
>>
>> *Dayna Harp*
>> Director Strategic Initiatives, The Mifos Initiative
>> dharp@mifos.org <ed...@mifos.org> | Skype: harpcreek | Mobile: 011
>> +501.628.9686
>>
>> *Ending Poverty One Line of Code at a Time | *http://mifos.org
>> <http://facebook.com/mifos>
>>
>>
>> <http://facebook.com/mifos>
>>
>>
>>
>> <http://www.twitter.com/mifos>
>>
>>
>> On Jul 5, 2016, at 8:04 PM, Nayan Ambali <na...@gmail.com> wrote:
>>
>> Dear Mifos and Fineract users,
>>
>> Should 'Data Import Tool' be integrated into core platform instead of
>> maintaining it as separate product? if yes then please upvote.
>>
>> if you want know more about 'Data Import Tool', please visit
>> https://github.com/openMF/DataImportTool
>>
>>
>> Thanks and Regards,
>> Nayan Ambali
>> +91 9591996042
>> skype: nayangambali
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
>> Francisco, CA to explore cutting-edge tech and listen to tech luminaries
>> present their vision of the future. This family event has something for
>> everyone, including kids. Get more information and register today.
>> http://sdm.link/attshape
>> _______________________________________________
>> Mifos-users mailing list
>> Mifos-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/mifos-users
>>
>>
>
Re: [Mifos-users] [Voting] Does bulk import feature (a.k.a. Data
Import Tool) should be part of core platform
Posted by Sander van der Heyden <sa...@musoni.eu>.
Firm +1 from this side as well!
Over time we've made various changes and bugfixes to the older version of
the import tool, which can be found in this fork:
https://github.com/Musoni/DataImportTool. Feel free to let me know if you
want us to send any PR's for this.
I think it would also be good to think a bit about some of the more
'quirky' things in the import tool, such as the lack of some form of
progress bar, and the issues that when a browser or user connection time
out that there is no way to get the re-upload files. I would therefore
suggest to store the files in S3/Local after processing so the user can
fetch back using a processing ID or some form of history. Similar things
can be done for checking progress as well, where the API consumer will get
back a resource ID and that can be used to query for status.
S
Sander van der Heyden
CTO Musoni Services
Mobile (NL): +31 (0)6 14239505
Skype: s.vdheyden
Website: musonisystem.com
Follow us on Twitter! <https://twitter.com/musonimfi>
Postal address: Hillegomstraat 12-14, office 0.09, 1058 LS, Amsterdam,
The Netherlands
On Wed, Jul 6, 2016 at 4:06 AM, Dayna Harp <dh...@mifos.org> wrote:
> +1
>
> *Dayna Harp*
> Director Strategic Initiatives, The Mifos Initiative
> dharp@mifos.org <ed...@mifos.org> | Skype: harpcreek | Mobile: 011
> +501.628.9686
>
> *Ending Poverty One Line of Code at a Time | *http://mifos.org
> <http://facebook.com/mifos>
>
>
> <http://facebook.com/mifos>
>
>
>
> <http://www.twitter.com/mifos>
>
>
> On Jul 5, 2016, at 8:04 PM, Nayan Ambali <na...@gmail.com> wrote:
>
> Dear Mifos and Fineract users,
>
> Should 'Data Import Tool' be integrated into core platform instead of
> maintaining it as separate product? if yes then please upvote.
>
> if you want know more about 'Data Import Tool', please visit
> https://github.com/openMF/DataImportTool
>
>
> Thanks and Regards,
> Nayan Ambali
> +91 9591996042
> skype: nayangambali
>
>
>
> ------------------------------------------------------------------------------
> Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
> Francisco, CA to explore cutting-edge tech and listen to tech luminaries
> present their vision of the future. This family event has something for
> everyone, including kids. Get more information and register today.
> http://sdm.link/attshape
> _______________________________________________
> Mifos-users mailing list
> Mifos-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/mifos-users
>
>