some testing of data mart export

Forwarding mail from Andris Bjornson of Inveneo, who have done some tests
on their low-energy computers. Just thought more people would be
interested in the results..

Andris, what's the data load of these exports?

untitled-[2] (8.07 KB)

···

---------------------------- Original Message ----------------------------
Subject: Re: Connecting Inveneo/HISP
From: "andris@inveneo.org" <abjornson@inveneo.org>
Date: Wed, April 15, 2009 19:41
To: johansa@ifi.uio.no
Cc: "Eric Blantz" <eric@inveneo.org>
         jbraa@ifi.uio.no
         "Mark Summer" <mark.summer@inveneo.org>
         "Bob Marsh" <bob.marsh@inveneo.org>
--------------------------------------------------------------------------

Hi Johan,

Yup I have DHIS2 up and running on two boxes we're comparing performance on:
a 1.2GHz, 512MB RAM system, and a dual core Intel Atom 1.6GHz, 2GB RAM
system.

Your suggestion to use the data mart export made for a very helpful
test...thanks! We were actually surprised to see a relatively small
performance difference between the two. My initial tests use:

export all data elements, all indicators, for the entire Sierra Leone
organizational unit for the months of June 2008, July 2008, and August 2008.
(I plan to scale up and use more dates later...but it's difficult since I
can't automate the timing I have to use a stopwatch and keep an eye on the
window to make sure I stop the clock when it finishes.)

This takes approximately 6m20s on the single core system, and 5m on the dual
core. Does this sound reasonable? We had perhaps expected a greater bump
in performance from the more powerful hardware.

Thanks again for your help,

Andris

On Wed, Apr 15, 2009 at 2:05 AM, <johansa@ifi.uio.no> wrote:

Thanks Andris,
I've forwarded all the info to the right people.

btw, did you manage to get latest DHIS2 up and running on your machines,
and with the latest Sierra Leone database?

Johan

> Hi Johan:
>
> The following hardware will be used for the demonstration setup:
>
> 20W Yingli Solar panel:
> panel size 610mm x 291mm
> 2.3kg
> mounting holes: (see attached YL20W.pdf for mount hole locations marked
> 'A'...dimensions in mm)
> holes are rectangular, approx 7mm x 10mm
>
> SolarMax Charge Controller + Battery
> Approx 205mm x 190mm x 390mm
> Approx 6.5kg
>
> Server
> No larger than 240mm x 240mm x 80mm
> (let me know if you need mounting info)
>
> Inveneo Computing Station
> Standard 15" LCD with rear mounted computer unit, attached keyboard and
> mouse
> 350mm x 350mm x 180mm
> Base is 180mm circular diameter
>
> Asus
> eeeTop<
http://usa.asus.com/products.aspx?l1=24&l2=169&l3=0&l4=0&model=2290&modelmenu=2
>
> PC with integrated widescreen 15.6" touchscreen, attached keyboard
> 405mm x 330mm x 90mm
> requires rectangular area 405mm x 160mm table space if using attached
> stand
> (See pages 18-19 of attached E4251_Eee_Top_ET16_Series_HW.pdf for
mounting
> info if required)
>
> 5 port network swich
> 200mm x 120mm x 30mm
>
> Hope this helps, let me know if you need more info.
>
> Thanks,
>
> Andris Bjornson
>
>
> On Tue, Apr 14, 2009 at 1:25 PM, Eric Blantz <eric@inveneo.org> wrote:
>
>> Johan: We have a very small panel (perhaps 20w) that we prefer for
>> these
>> sort of demos along with a demonstration battery/charge controller. As
>> for
>> Hardware, our computing station takes very little desktop space, as the
>> computer is integrated with the monitor. The server is similarly quite
>> small, especially if standing upright.
>>
>> Andris: can you please locate and provide specific dimensions for all?
>> I
>> won't be in until Thursday.
>>
>> Cheers,
>>
>> ----------------------------------------
>> Eric Blantz
>> Sr. Director
>> Inveneo (www.inveneo.org)
>> email: eric.blantz@inveneo.org
>> tel: 415-901-1969 x1275
>> cell: 415-847-1232
>> AIM/Yahoo/Skype: eblantz
>> fax: 415-449-6073
>> ...............................................................
>>
>> Watch Inveneo in action on CNN
>> Home - Inveneo
>>
>> Subscribe to the Inveneo news feed
>> Home - Inveneo
>>
>>
>>
>>
>>
>> On Apr 14, 2009, at 1:17 PM, johansa@ifi.uio.no wrote:
>>
>> Eric and Andris,
>>>
>>> the design firm that is preparing our stand wonders about the
>>> dimensions
>>> of any hardware, especially the solar panel. Can you please provide
>>> this?
>>>
>>> Regards,
>>> Johan
>>>
>>> Johan: I'd like to introduce you to Andris, who is one of Inveneo's
>>>> lead engineers. He'll be working with us to prepare the demo for the
>>>> May conference and to do the testing we discussed. Please connect
>>>> with Andris directly as soon as you've located the correct build/
>>>> database for us to work with.
>>>>
>>>> Cheers,
>>>>
>>>> ----------------------------------------
>>>> Eric Blantz
>>>> Sr. Director
>>>> Inveneo (www.inveneo.org)
>>>> email: eric.blantz@inveneo.org
>>>> tel: 415-901-1969 x1275
>>>> cell: 415-847-1232
>>>> AIM/Yahoo/Skype: eblantz
>>>> fax: 415-449-6073
>>>> ...............................................................
>>>>
>>>> Watch Inveneo in action on CNN
>>>> Home - Inveneo
>>>>
>>>> Subscribe to the Inveneo news feed
>>>> Home - Inveneo
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>
>
> --
> ................................................................
> andris bjornson
> inveneo
> project engineer
>
> office: +1.415.901.1969x 1215
> skype: andris.bjornson
> yahoo: a_bjornson1
> AIM: andris@inveneo.org
> gTalk: abjornson@inveneo.org
> ................................................................
>

--
................................................................
andris bjornson
inveneo
project engineer

office: +1.415.901.1969x 1215
skype: andris.bjornson
yahoo: a_bjornson1
AIM: andris@inveneo.org
gTalk: abjornson@inveneo.org
................................................................

Hi all

Sorry to be jumping in on this discussion (the genesis of which I know
nothing!) but it got me thinking that we should consider developing a
couple of uniform performance tests like this one for comparison
purposes.

This would require that we make use of a "standard" sample data set.
Were you guys using your own data or the sanitized sample data from
South Africa?

If we use the same data we can start benchmarking and publishing up on
the wiki. This kind of information would be really useful for
programmers optimizing stuff but also for implementors getting some
idea if their configuration is producing reasonable performance.

Does anybody know how representative is the existing sample data ie.
would it form a good basis for testing?

What are the real bottleneck processes to benchmark:
1. startup/initial login time
2. datamart export
3. ....

We can use selenium to automate some of the processes and timing,

Regards
Bob

PS. just re-read and noticed that you are using the SL orgunit.

···

2009/4/21 <johansa@ifi.uio.no>:

Forwarding mail from Andris Bjornson of Inveneo, who have done some tests
on their low-energy computers. Just thought more people would be
interested in the results..

Andris, what's the data load of these exports?

---------------------------- Original Message ----------------------------
Subject: Re: Connecting Inveneo/HISP
From: "andris@inveneo.org" <abjornson@inveneo.org>
Date: Wed, April 15, 2009 19:41
To: johansa@ifi.uio.no
Cc: "Eric Blantz" <eric@inveneo.org>
jbraa@ifi.uio.no
"Mark Summer" <mark.summer@inveneo.org>
"Bob Marsh" <bob.marsh@inveneo.org>
--------------------------------------------------------------------------

Hi Johan,

Yup I have DHIS2 up and running on two boxes we're comparing performance on:
a 1.2GHz, 512MB RAM system, and a dual core Intel Atom 1.6GHz, 2GB RAM
system.

Your suggestion to use the data mart export made for a very helpful
test...thanks! We were actually surprised to see a relatively small
performance difference between the two. My initial tests use:

export all data elements, all indicators, for the entire Sierra Leone
organizational unit for the months of June 2008, July 2008, and August 2008.
(I plan to scale up and use more dates later...but it's difficult since I
can't automate the timing I have to use a stopwatch and keep an eye on the
window to make sure I stop the clock when it finishes.)

This takes approximately 6m20s on the single core system, and 5m on the dual
core. Does this sound reasonable? We had perhaps expected a greater bump
in performance from the more powerful hardware.

Thanks again for your help,

Andris

On Wed, Apr 15, 2009 at 2:05 AM, <johansa@ifi.uio.no> wrote:

Thanks Andris,
I've forwarded all the info to the right people.

btw, did you manage to get latest DHIS2 up and running on your machines,
and with the latest Sierra Leone database?

Johan

> Hi Johan:
>
> The following hardware will be used for the demonstration setup:
>
> 20W Yingli Solar panel:
> panel size 610mm x 291mm
> 2.3kg
> mounting holes: (see attached YL20W.pdf for mount hole locations marked
> 'A'...dimensions in mm)
> holes are rectangular, approx 7mm x 10mm
>
> SolarMax Charge Controller + Battery
> Approx 205mm x 190mm x 390mm
> Approx 6.5kg
>
> Server
> No larger than 240mm x 240mm x 80mm
> (let me know if you need mounting info)
>
> Inveneo Computing Station
> Standard 15" LCD with rear mounted computer unit, attached keyboard and
> mouse
> 350mm x 350mm x 180mm
> Base is 180mm circular diameter
>
> Asus
> eeeTop<
http://usa.asus.com/products.aspx?l1=24&l2=169&l3=0&l4=0&model=2290&modelmenu=2
>
> PC with integrated widescreen 15.6" touchscreen, attached keyboard
> 405mm x 330mm x 90mm
> requires rectangular area 405mm x 160mm table space if using attached
> stand
> (See pages 18-19 of attached E4251_Eee_Top_ET16_Series_HW.pdf for
mounting
> info if required)
>
> 5 port network swich
> 200mm x 120mm x 30mm
>
> Hope this helps, let me know if you need more info.
>
> Thanks,
>
> Andris Bjornson
>
>
> On Tue, Apr 14, 2009 at 1:25 PM, Eric Blantz <eric@inveneo.org> wrote:
>
>> Johan: We have a very small panel (perhaps 20w) that we prefer for
>> these
>> sort of demos along with a demonstration battery/charge controller. As
>> for
>> Hardware, our computing station takes very little desktop space, as the
>> computer is integrated with the monitor. The server is similarly quite
>> small, especially if standing upright.
>>
>> Andris: can you please locate and provide specific dimensions for all?
>> I
>> won't be in until Thursday.
>>
>> Cheers,
>>
>> ----------------------------------------
>> Eric Blantz
>> Sr. Director
>> Inveneo (www.inveneo.org)
>> email: eric.blantz@inveneo.org
>> tel: 415-901-1969 x1275
>> cell: 415-847-1232
>> AIM/Yahoo/Skype: eblantz
>> fax: 415-449-6073
>> ...............................................................
>>
>> Watch Inveneo in action on CNN
>> Home - Inveneo
>>
>> Subscribe to the Inveneo news feed
>> Home - Inveneo
>>
>>
>>
>>
>>
>> On Apr 14, 2009, at 1:17 PM, johansa@ifi.uio.no wrote:
>>
>> Eric and Andris,
>>>
>>> the design firm that is preparing our stand wonders about the
>>> dimensions
>>> of any hardware, especially the solar panel. Can you please provide
>>> this?
>>>
>>> Regards,
>>> Johan
>>>
>>> Johan: I'd like to introduce you to Andris, who is one of Inveneo's
>>>> lead engineers. He'll be working with us to prepare the demo for the
>>>> May conference and to do the testing we discussed. Please connect
>>>> with Andris directly as soon as you've located the correct build/
>>>> database for us to work with.
>>>>
>>>> Cheers,
>>>>
>>>> ----------------------------------------
>>>> Eric Blantz
>>>> Sr. Director
>>>> Inveneo (www.inveneo.org)
>>>> email: eric.blantz@inveneo.org
>>>> tel: 415-901-1969 x1275
>>>> cell: 415-847-1232
>>>> AIM/Yahoo/Skype: eblantz
>>>> fax: 415-449-6073
>>>> ...............................................................
>>>>
>>>> Watch Inveneo in action on CNN
>>>> Home - Inveneo
>>>>
>>>> Subscribe to the Inveneo news feed
>>>> Home - Inveneo
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>
>
> --
> ................................................................
> andris bjornson
> inveneo
> project engineer
>
> office: +1.415.901.1969x 1215
> skype: andris.bjornson
> yahoo: a_bjornson1
> AIM: andris@inveneo.org
> gTalk: abjornson@inveneo.org
> ................................................................
>

--
................................................................
andris bjornson
inveneo
project engineer

office: +1.415.901.1969x 1215
skype: andris.bjornson
yahoo: a_bjornson1
AIM: andris@inveneo.org
gTalk: abjornson@inveneo.org
................................................................

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help : https://help.launchpad.net/ListHelp

Hi Johan,

Yup I have DHIS2 up and running on two boxes we’re comparing performance on:

a 1.2GHz, 512MB RAM system, and a dual core Intel Atom 1.6GHz, 2GB RAM

system.

Your suggestion to use the data mart export made for a very helpful

test…thanks! We were actually surprised to see a relatively small

performance difference between the two. My initial tests use:

export all data elements, all indicators, for the entire Sierra Leone

organizational unit for the months of June 2008, July 2008, and August 2008.

(I plan to scale up and use more dates later…but it’s difficult since I

can’t automate the timing I have to use a stopwatch and keep an eye on the

window to make sure I stop the clock when it finishes.)

Hi, just a note: The datamart process logs how much time it takes (see the eg Tomcat log for something like " Datamart process completed in …")

···

This takes approximately 6m20s on the single core system, and 5m on the dual

core. Does this sound reasonable? We had perhaps expected a greater bump

in performance from the more powerful hardware.

Thanks again for your help,

Andris

On Wed, Apr 15, 2009 at 2:05 AM, johansa@ifi.uio.no wrote:

Thanks Andris,

I’ve forwarded all the info to the right people.

btw, did you manage to get latest DHIS2 up and running on your machines,

and with the latest Sierra Leone database?

Johan

Hi Johan:

The following hardware will be used for the demonstration setup:

20W Yingli Solar panel:

panel size 610mm x 291mm

2.3kg

mounting holes: (see attached YL20W.pdf for mount hole locations marked

‘A’…dimensions in mm)

holes are rectangular, approx 7mm x 10mm

SolarMax Charge Controller + Battery

Approx 205mm x 190mm x 390mm

Approx 6.5kg

Server

No larger than 240mm x 240mm x 80mm

(let me know if you need mounting info)

Inveneo Computing Station

Standard 15" LCD with rear mounted computer unit, attached keyboard and

mouse

350mm x 350mm x 180mm

Base is 180mm circular diameter

Asus

eeeTop<

http://usa.asus.com/products.aspx?l1=24&l2=169&l3=0&l4=0&model=2290&modelmenu=2

PC with integrated widescreen 15.6" touchscreen, attached keyboard

405mm x 330mm x 90mm

requires rectangular area 405mm x 160mm table space if using attached

stand

(See pages 18-19 of attached E4251_Eee_Top_ET16_Series_HW.pdf for

mounting

info if required)

5 port network swich

200mm x 120mm x 30mm

Hope this helps, let me know if you need more info.

Thanks,

Andris Bjornson

On Tue, Apr 14, 2009 at 1:25 PM, Eric Blantz eric@inveneo.org wrote:

Johan: We have a very small panel (perhaps 20w) that we prefer for

these

sort of demos along with a demonstration battery/charge controller. As

for

Hardware, our computing station takes very little desktop space, as the

computer is integrated with the monitor. The server is similarly quite

small, especially if standing upright.

Andris: can you please locate and provide specific dimensions for all?

I

won’t be in until Thursday.

Cheers,


Eric Blantz

Sr. Director

Inveneo (www.inveneo.org)

email: eric.blantz@inveneo.org

tel: 415-901-1969 x1275

cell: 415-847-1232

AIM/Yahoo/Skype: eblantz

fax: 415-449-6073

Watch Inveneo in action on CNN

http://www.inveneo.org/?q=CNNPrincipalVoices

Subscribe to the Inveneo news feed

http://www.inveneo.org/?q=blog/feed

On Apr 14, 2009, at 1:17 PM, johansa@ifi.uio.no wrote:

Eric and Andris,

the design firm that is preparing our stand wonders about the

dimensions

of any hardware, especially the solar panel. Can you please provide

this?

Regards,

Johan

Johan: I’d like to introduce you to Andris, who is one of Inveneo’s

lead engineers. He’ll be working with us to prepare the demo for the

May conference and to do the testing we discussed. Please connect

with Andris directly as soon as you’ve located the correct build/

database for us to work with.

Cheers,


Eric Blantz

Sr. Director

Inveneo (www.inveneo.org)

email: eric.blantz@inveneo.org

tel: 415-901-1969 x1275

cell: 415-847-1232

AIM/Yahoo/Skype: eblantz

fax: 415-449-6073

Watch Inveneo in action on CNN

http://www.inveneo.org/?q=CNNPrincipalVoices

Subscribe to the Inveneo news feed

http://www.inveneo.org/?q=blog/feed

andris bjornson

inveneo

project engineer

office: +1.415.901.1969x 1215

skype: andris.bjornson

yahoo: a_bjornson1

AIM: andris@inveneo.org

gTalk: abjornson@inveneo.org

andris bjornson

inveneo

project engineer

office: +1.415.901.1969x 1215

skype: andris.bjornson

yahoo: a_bjornson1

AIM: andris@inveneo.org

gTalk: abjornson@inveneo.org


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp