Excel reporting in trunk!

Hi Lars,
Today the team has discussed and found that there is problem in importing excel function. We also have the solution to fix it. But it need to be approved by you, so that we will work and commit it. Please find enclosed the blue print has been created below and give us suggestion.

https://blueprints.launchpad.net/dhis2/+spec/import-data-from-excel-file-to-dhis

···

Thuy
HISP Vietnam
+84902079126

Hi Thuy,

as far as I understand from the blueprint it seems this function will be pretty different from the existing import code… So rather than squeezing that code into the importexport module I suggest you simply put it inside the excel reporting service for now. The user can then deal with excel reporting and importing in the same module (the excel reporting web module). Is that okay with you?

Lars

···

2009/10/21 Thuy Nguyen thuy.hispvietnam@gmail.com

Hi Lars,
Today the team has discussed and found that there is problem in importing excel function. We also have the solution to fix it. But it need to be approved by you, so that we will work and commit it. Please find enclosed the blue print has been created below and give us suggestion.

https://blueprints.launchpad.net/dhis2/+spec/import-data-from-excel-file-to-dhis

In a bit longer perspective it would be great if we could include a mainstream excel import as part of the import service. We’ve discussed this before. There is a great need for this and we already have a blueprint if I remember correctly. The idea was to have predefined (generated by DHIS) excel sheets with metadata that could easily be imported into DHIS. Preview and other import functionality is needed here in the same way as with DXF import. Hopefully efforts and local modules from India and Vietnam can merge into this over time.

Ola

···

2009/10/21 Lars Helge Øverland larshelge@gmail.com

2009/10/21 Thuy Nguyen thuy.hispvietnam@gmail.com

Hi Lars,
Today the team has discussed and found that there is problem in importing excel function. We also have the solution to fix it. But it need to be approved by you, so that we will work and commit it. Please find enclosed the blue print has been created below and give us suggestion.

https://blueprints.launchpad.net/dhis2/+spec/import-data-from-excel-file-to-dhis

Hi Thuy,

as far as I understand from the blueprint it seems this function will be pretty different from the existing import code… So rather than squeezing that code into the importexport module I suggest you simply put it inside the excel reporting service for now. The user can then deal with excel reporting and importing in the same module (the excel reporting web module). Is that okay with you?

Lars


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Hi Ola

Jørn sent some excel sheets from Gambia which I have been looking at importing. My strategy is to convert to xlsx (for which purpose I needed to borrow my wife’s computer 'cos I don’t have excel).

Then we have the excel data as an xml stream (actually a few streams) which I translate to dxf and import in the normal way as dxf. Much as I did with the IMR MDG indicators. In principle any input source which is xml based, including sdmx, dhis1.4 etc can all be treated the same way and thus take advantage of shared functionality of dxf import eg. preview.

Hoping to be able to demo all this in Geneva. Currently there are a few dependencies which need to be lined up. With all the amazing work Lars has been doing on the dimension model there’s quite a bit of resulttng work we need to do on dxf to catch up on the improved model.

I’ll do one of the Gambia sheets using the existing dxf and existing model as a proff of concept.

Regards
Bob

···

2009/10/21 Ola Hodne Titlestad olatitle@gmail.com

In a bit longer perspective it would be great if we could include a mainstream excel import as part of the import service. We’ve discussed this before. There is a great need for this and we already have a blueprint if I remember correctly. The idea was to have predefined (generated by DHIS) excel sheets with metadata that could easily be imported into DHIS. Preview and other import functionality is needed here in the same way as with DXF import. Hopefully efforts and local modules from India and Vietnam can merge into this over time.

Ola

2009/10/21 Lars Helge Øverland larshelge@gmail.com

2009/10/21 Thuy Nguyen thuy.hispvietnam@gmail.com

Hi Lars,
Today the team has discussed and found that there is problem in importing excel function. We also have the solution to fix it. But it need to be approved by you, so that we will work and commit it. Please find enclosed the blue print has been created below and give us suggestion.

https://blueprints.launchpad.net/dhis2/+spec/import-data-from-excel-file-to-dhis

Hi Thuy,

as far as I understand from the blueprint it seems this function will be pretty different from the existing import code… So rather than squeezing that code into the importexport module I suggest you simply put it inside the excel reporting service for now. The user can then deal with excel reporting and importing in the same module (the excel reporting web module). Is that okay with you?

Lars


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Yes we have a student group working on that right now.

If anyone’s interested this year’s groups are:

F09-01 Catchment Population generation
F09-02 Spring-based internationalization solution

F09-03 Import of organisation units and hierarchy from Shapefiles
F09-04 Objective data set completeness
F09-05 Upgrade security solution to Spring Security
F09-06 Import of metadata from Excel

Lars

···

2009/10/21 Ola Hodne Titlestad olatitle@gmail.com

In a bit longer perspective it would be great if we could include a mainstream excel import as part of the import service. We’ve discussed this before. There is a great need for this and we already have a blueprint if I remember correctly. The idea was to have predefined (generated by DHIS) excel sheets with metadata that could easily be imported into DHIS. Preview and other import functionality is needed here in the same way as with DXF import. Hopefully efforts and local modules from India and Vietnam can merge into this over time.

Ola

Anyway Bob’s approach will be more flexible as we probably will face lots of exotic excel sheets. Will be exiting to see how the xproc/pipeline design works out and what possibilities it entails…

Hi anh Tri,
Generating report (excel report) is very slow. And Tran already test the time of all stages. She said that almost time was on writing excel file in temperature folder in server. Could it be loaded and writen in client’s computer? Because if there are many users generate reports at same time, the server would take a lot of time to write a lot of excel files into the temp folder. If load and writting in client computer reduces the time of generating report?

I have just test with the small excel file, and it still take lot of time.

···

Thuy
HISP Vietnam
+84902079126

Hi anh Tri,
Generating report (excel report) is very slow. And Tran already test the time of all stages. She said that almost time was on writing excel file in temperature folder in server.

We must find solution (reduce excel template file size) . I think this is best.

Could it be loaded and writen in client's computer?

This is a server side model, all interactions are based on the request
and respone. When users export report.The client side will send a
request to the server and the server will process the request (copy
excel template to the temp directory, write data inside ) then
response to the client as stream (excel file )

Because if there are many users generate reports at same time, the
server would take a lot of time to write a lot of excel files into the
temp folder. If load and writting in client computer reduces the time
of generating report?
If there are many users to generate report at the same time, That is
not affected so much to system. All requests will be processed
simultaneously and each user will use a private session

···

2009/10/23 Thuy Nguyen <thuy.hispvietnam@gmail.com>

I have just test with the small excel file, and it still take lot of time.

--
--
Thuy
HISP Vietnam
+84902079126