Problems with detailed metadata export..

Not really sure what is going on, but here is the stack dump. Maybe it will help.

And some more info below.

top - 21:26:40 up 477 days, 16:20, 2 users, load average: 2.99, 2.05, 1.03

Tasks: 171 total, 1 running, 170 sleeping, 0 stopped, 0 zombie

Cpu(s): 38.3%us, 0.0%sy, 0.0%ni, 61.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.1%st

Mem: 16433100k total, 15416512k used, 1016588k free, 86276k buffers

Swap: 262140k total, 18872k used, 243268k free, 12412748k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND

28091 dhis 20 0 11.8g 2.1g 13m S 307 13.2 29:39.99 java

Regards,

Jason

stack3.txt (55.5 KB)

···

On Wed, Jan 21, 2015 at 7:42 PM, Bob Jolliffe bobjolliffe@gmail.com wrote:

If it is running for 15 minutes then almost certainly it is stuck in some kind of loop. Find the pid of the running jvm and also the owner of the java process. Then run:

sudo -u jstack > jstack.txt

That might give an idea of what the threads are up to …

On 21 January 2015 at 18:26, Morten Olav Hansen mortenoh@gmail.com wrote:

18k is not really that much… is it giving you any kind of errors? given the SL demo db… we can easily export much more objects that that…


Morten

On Thu, Jan 22, 2015 at 12:42 AM, Bob Jolliffe bobjolliffe@gmail.com wrote:

Can you try and get a jstack dump while it is busy chomping cpu. That will probably indicate where in the code it is spinning. There was a problem earlier with a weakness in the paging code but should have been fixed by that build.


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

On 21 January 2015 at 15:00, Jason Pickering jason.p.pickering@gmail.com wrote:

In one DHIS2 instance, we have a rather large number of data elements, more than 18,000. During the detailed metadata export, a request is made to “api/dataElements.json?paging=false&links=false”. This throws the CPU of the server through the roof, with the operation taking many minutes (has been running for 15 minutes now with no response).There are no errors in the logs or the browser. Build revision is not known, but it is 2.17 from from 2015-01-17 02:03.

Any idea what might be going on here?

Regards,

Jason

Jason P. Pickering
email: jason.p.pickering@gmail.com
tel:+46764147049


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Jason P. Pickering
email: jason.p.pickering@gmail.com
tel:+46764147049