Analytics tables export

Hello,

When performing Analytics tables update export it takes too long

Is there is any way to make easier or less in time

Regards,

Not sure, but maybe it will be easier to judge if you can provide some more details about your server setup (ram), db size, as well as the log/screenshot which will show what parts of the process take how long?

···

On Sep 8, 2015 9:08 AM, “Nami Ghadri” nami_ghadri@hotmail.com wrote:

Hello,

When performing Analytics tables update export it takes too long

Is there is any way to make easier or less in time

Regards,


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

I have 32 g ram I think nothing related to it but I have a lot of category combos

I also have log: that says : ERROR : relation “analytics table” analytics_2015 does not exists

Regards,

···

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 10:20 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

Not sure, but maybe it will be easier to judge if you can provide some more details about your server setup (ram), db size, as well as the log/screenshot which will show what parts of the process take how long?

On Sep 8, 2015 9:08 AM, “Nami Ghadri” nami_ghadri@hotmail.com wrote:

Hello,

When performing Analytics tables update export it takes too long

Is there is any way to make easier or less in time

Regards,


Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

That should be a clear indicator something is going wrong. Please share the whole log (at least all the relevant parts).

···

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

I have 32 g ram I think nothing related to it but I have a lot of category combos

I also have log: that says : ERROR : relation “analytics table” analytics_2015 does not exists

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 10:20 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

Not sure, but maybe it will be easier to judge if you can provide some more details about your server setup (ram), db size, as well as the log/screenshot which will show what parts of the process take how long?

On Sep 8, 2015 9:08 AM, “Nami Ghadri” nami_ghadri@hotmail.com wrote:

Hello,

When performing Analytics tables update export it takes too long

Is there is any way to make easier or less in time

Regards,


Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp


Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org

Where could I find the such log and copy it in order to send it

Regards,

···

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 11:05 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

That should be a clear indicator something is going wrong. Please share the whole log (at least all the relevant parts).

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

I have 32 g ram I think nothing related to it but I have a lot of category combos

I also have log: that says : ERROR : relation “analytics table” analytics_2015 does not exists

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 10:20 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

Not sure, but maybe it will be easier to judge if you can provide some more details about your server setup (ram), db size, as well as the log/screenshot which will show what parts of the process take how long?

On Sep 8, 2015 9:08 AM, “Nami Ghadri” nami_ghadri@hotmail.com wrote:

Hello,

When performing Analytics tables update export it takes too long

Is there is any way to make easier or less in time

Regards,


Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org

In the tomcat directory on the server there is a folder called logs, I think. Others on the list can guide further, about to take off on a long flight here :wink:

···

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

Where could I find the such log and copy it in order to send it

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 11:05 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

That should be a clear indicator something is going wrong. Please share the whole log (at least all the relevant parts).

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

I have 32 g ram I think nothing related to it but I have a lot of category combos

I also have log: that says : ERROR : relation “analytics table” analytics_2015 does not exists

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 10:20 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

Not sure, but maybe it will be easier to judge if you can provide some more details about your server setup (ram), db size, as well as the log/screenshot which will show what parts of the process take how long?

On Sep 8, 2015 9:08 AM, “Nami Ghadri” nami_ghadri@hotmail.com wrote:

Hello,

When performing Analytics tables update export it takes too long

Is there is any way to make easier or less in time

Regards,


Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org


Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org

Ok I will try to find it

Thanks very much

···

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 11:16 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

In the tomcat directory on the server there is a folder called logs, I think. Others on the list can guide further, about to take off on a long flight here :wink:

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

Where could I find the such log and copy it in order to send it

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 11:05 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

That should be a clear indicator something is going wrong. Please share the whole log (at least all the relevant parts).

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

I have 32 g ram I think nothing related to it but I have a lot of category combos

I also have log: that says : ERROR : relation “analytics table” analytics_2015 does not exists

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 10:20 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

Not sure, but maybe it will be easier to judge if you can provide some more details about your server setup (ram), db size, as well as the log/screenshot which will show what parts of the process take how long?

On Sep 8, 2015 9:08 AM, “Nami Ghadri” nami_ghadri@hotmail.com wrote:

Hello,

When performing Analytics tables update export it takes too long

Is there is any way to make easier or less in time

Regards,


Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org

Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org

I did record this

org.postgresql.util.PSQLException: error: relation "analytics_2015"donse not exist postion: 54

at org.postgresql.code.v3.queryexeutor[mp].receiveerrorresponse(queryexecutor[mp].java:2198)

at org.postgresql.code.v3.queryexeutor[mp].processresult(queryexecutor[mp.java:1927)

at org.postgresql.code.v3.queryexeutor[mp].execute(queryexecutor[mp].java:255)

at org.postgresql.jdbc2.abstractjdbc2$statement.execute(abstractjdbc2$statement.java:561)

I hope it could help analyzing

Regards and thanks in advance

···

From: Nami Ghadri [mailto:nami_ghadri@hotmail.com]
Sent: Tuesday, September 8, 2015 11:25 AM
To: ‘Knut Staring’
Cc: ‘DHIS 2 Users list’
Subject: RE: [Dhis2-users] Analytics tables export

Ok I will try to find it

Thanks very much

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 11:16 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

In the tomcat directory on the server there is a folder called logs, I think. Others on the list can guide further, about to take off on a long flight here :wink:

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

Where could I find the such log and copy it in order to send it

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 11:05 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

That should be a clear indicator something is going wrong. Please share the whole log (at least all the relevant parts).

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

I have 32 g ram I think nothing related to it but I have a lot of category combos

I also have log: that says : ERROR : relation “analytics table” analytics_2015 does not exists

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 10:20 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

Not sure, but maybe it will be easier to judge if you can provide some more details about your server setup (ram), db size, as well as the log/screenshot which will show what parts of the process take how long?

On Sep 8, 2015 9:08 AM, “Nami Ghadri” nami_ghadri@hotmail.com wrote:

Hello,

When performing Analytics tables update export it takes too long

Is there is any way to make easier or less in time

Regards,


Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org

Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org

I have also this witch is more detailed

  ... 13 more

INFO 2015-09-08 12:06:44,598 Query failed, likely because the requested analytics table does not exist (Jdb

nalyticsManager.java [SimpleAsyncTaskExecutor-82])

g.springframework.jdbc.BadSqlGrammarException: StatementCallback; bad SQL grammar [select “de”,“co”,"monthly

sum(value) as value from analytics_2015 where “de” in (‘wL9lPXukk5T’, ‘n0QyQyjthPd’, ‘NAzZCRwhM6y’, 'oogevT

LqJ’) and “monthly” in (‘201501’, ‘201502’, ‘201503’, ‘201504’, ‘201505’, ‘201506’, ‘201507’, ‘201508’, '201

9’) and ( “uidlevel1” in (‘Z8WFmqm0AvD’) ) group by “de”,“co”,“monthly”]; nested exception is org.postgresql

til.PSQLException: ERROR: relation “analytics_2015” does not exist

Position: 54

  at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.doTranslate(SQLErrorCodeSQLExce

ionTranslator.java:231)

  at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackS

ExceptionTranslator.java:73)

  at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:416)

  at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:471)

  at org.springframework.jdbc.core.JdbcTemplate.queryForRowSet(JdbcTemplate.java:526)

  at org.hisp.dhis.analytics.data.JdbcAnalyticsManager.getKeyValueMap(JdbcAnalyticsManager.java:397)

  at org.hisp.dhis.analytics.data.JdbcAnalyticsManager.getAggregatedDataValues(JdbcAnalyticsManager.java
  at sun.reflect.GeneratedMethodAccessor1100.invoke(Unknown Source)

  at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

  at java.lang.reflect.Method.invoke(Unknown Source)

  at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvoca

on.java:190)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.jav
  at org.springframework.aop.interceptor.AsyncExecutionInterceptor$1.call(AsyncExecutionInterceptor.java
  at java.util.concurrent.FutureTask.run(Unknown Source)

  at java.lang.Thread.run(Unknown Source)

used by: org.postgresql.util.PSQLException: ERROR: relation “analytics_2015” does not exist

Position: 54

  at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2198)

  at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1927)

  at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255)

  at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:561)

  at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:405)

  at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:285)

  at com.mchange.v2.c3p0.impl.NewProxyStatement.executeQuery(NewProxyStatement.java:35)

  at org.springframework.jdbc.core.JdbcTemplate$1QueryStatementCallback.doInStatement(JdbcTemplate.java:
  at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:405)

  ... 13 more

INFO 2015-09-08 12:19:15,326 Login success for user: ‘Abd’, ip: ‘192.168.1.101’ (DefaultUserAuditService.ja

[http-apr-8080-exec-10])

···

From: Nami Ghadri [mailto:nami_ghadri@hotmail.com]
Sent: Tuesday, September 8, 2015 12:17 PM
To: ‘Knut Staring’
Cc: ‘DHIS 2 Users list’
Subject: RE: [Dhis2-users] Analytics tables export

I did record this

org.postgresql.util.PSQLException: error: relation "analytics_2015"donse not exist postion: 54

at org.postgresql.code.v3.queryexeutor[mp].receiveerrorresponse(queryexecutor[mp].java:2198)

at org.postgresql.code.v3.queryexeutor[mp].processresult(queryexecutor[mp.java:1927)

at org.postgresql.code.v3.queryexeutor[mp].execute(queryexecutor[mp].java:255)

at org.postgresql.jdbc2.abstractjdbc2$statement.execute(abstractjdbc2$statement.java:561)

I hope it could help analyzing

Regards and thanks in advance

From: Nami Ghadri [mailto:nami_ghadri@hotmail.com]
Sent: Tuesday, September 8, 2015 11:25 AM
To: ‘Knut Staring’
Cc: ‘DHIS 2 Users list’
Subject: RE: [Dhis2-users] Analytics tables export

Ok I will try to find it

Thanks very much

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 11:16 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

In the tomcat directory on the server there is a folder called logs, I think. Others on the list can guide further, about to take off on a long flight here :wink:

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

Where could I find the such log and copy it in order to send it

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 11:05 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

That should be a clear indicator something is going wrong. Please share the whole log (at least all the relevant parts).

On Tuesday, September 8, 2015, Nami Ghadri nami_ghadri@hotmail.com wrote:

I have 32 g ram I think nothing related to it but I have a lot of category combos

I also have log: that says : ERROR : relation “analytics table” analytics_2015 does not exists

Regards,

From: Knut Staring [mailto:knutst@gmail.com]
Sent: Tuesday, September 8, 2015 10:20 AM
To: Nami Ghadri
Cc: DHIS 2 Users list
Subject: Re: [Dhis2-users] Analytics tables export

Not sure, but maybe it will be easier to judge if you can provide some more details about your server setup (ram), db size, as well as the log/screenshot which will show what parts of the process take how long?

On Sep 8, 2015 9:08 AM, “Nami Ghadri” nami_ghadri@hotmail.com wrote:

Hello,

When performing Analytics tables update export it takes too long

Is there is any way to make easier or less in time

Regards,


Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org

Knut Staring

Dept. of Informatics, University of Oslo

Norway: +4791880522

Skype: knutstar

http://dhis2.org