After Database Restore, Analytics table empty

After I restored a database, analytics table is no longer being populated even if after running Analytics, rebooting server, running analytics again. I have checked in physical datavalue table and the data is there. No error in Catalina logs.

Any pointers??

···


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.

I am running DHIS2.20 on Ubuntu LTS 14.04 with Tomcat 7

···

On Friday, 6 November 2015, Moses Marimo marimo@ict.co.zw wrote:

After I restored a database, analytics table is no longer being populated even if after running Analytics, rebooting server, running analytics again. I have checked in physical datavalue table and the data is there. No error in Catalina logs.

Any pointers??


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.

Hi Moses,

can you please share the tomcat log output during analytics table generation.

regards,

Lars

···

On Fri, Nov 6, 2015 at 4:31 PM, Moses Marimo marimo@ict.co.zw wrote:

I am running DHIS2.20 on Ubuntu LTS 14.04 with Tomcat 7

On Friday, 6 November 2015, Moses Marimo marimo@ict.co.zw wrote:

After I restored a database, analytics table is no longer being populated even if after running Analytics, rebooting server, running analytics again. I have checked in physical datavalue table and the data is there. No error in Catalina logs.

Any pointers??


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org

* INFO 2015-11-09 10:38:24,708 Indicator group set table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,717 Create organisation unit group set table SQL: CREATE TABLE _organisationunitgroupsetstructure ( organisationunitid INTEGER NOT NULL, organisationunitname VARCHAR (250), "Location" VARCHAR (250), "NDAElbuYMNM" CHARACTER(11), "Ownership" VARCHAR (250), "Y2vBvfxaIcS" CHARACTER(11), "Type" VARCHAR (250), "fguPo20Ggjj" CHARACTER(11), PRIMARY KEY ( organisationunitid ) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,719 Populate organisation unit group set structure SQL: insert into _organisationunitgroupsetstructure select ou.organisationunitid as organisationunitid, [ou.name](http://ou.name) as organisationunitname, (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Location", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "NDAElbuYMNM", (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Ownership", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Y2vBvfxaIcS", (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Type", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "fguPo20Ggjj" from organisationunit ou (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,921 Organisation unit group set table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,926 Create category structure table SQL: CREATE TABLE _categorystructure ( categoryoptioncomboid INTEGER NOT NULL, categoryoptioncomboname VARCHAR (250), PRIMARY KEY ( categoryoptioncomboid ) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,928 Populate category structure SQL: insert into _categorystructure select coc.categoryoptioncomboid as cocid, con.categoryoptioncomboname as cocname from categoryoptioncombo coc inner join _categoryoptioncomboname con on coc.categoryoptioncomboid = con.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,930 Category table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:27,657 Create data element structure SQL: CREATE TABLE _dataelementstructure ( dataelementid INTEGER NOT NULL PRIMARY KEY, dataelementuid CHARACTER(11), dataelementname VARCHAR(250), datasetid INTEGER, datasetuid CHARACTER(11), datasetname VARCHAR(250), datasetapprovallevel INTEGER, periodtypeid INTEGER, periodtypename VARCHAR(250) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,651 Data element table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,714 Create period structure SQL: CREATE TABLE _periodstructure (periodid INTEGER NOT NULL PRIMARY KEY, iso VARCHAR(15) NOT NULL, daysno INTEGER NOT NULL, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,750 Date period table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,759 Create date period structure SQL: CREATE TABLE _dateperiodstructure (dateperiod DATE NOT NULL PRIMARY KEY, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,029 Period table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,030 Create data element category option combo SQL: CREATE TABLE _dataelementcategoryoptioncombo (dataelementid INTEGER NOT NULL, dataelementuid VARCHAR(11) NOT NULL, categoryoptioncomboid INTEGER NOT NULL, categoryoptioncombouid VARCHAR(11) NOT NULL) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,032 Insert data element category option combo SQL: insert into _dataelementcategoryoptioncombo (dataelementid, dataelementuid, categoryoptioncomboid, categoryoptioncombouid) select de.dataelementid as dataelementid, de.uid as dataelementuid, coc.categoryoptioncomboid as categoryoptioncomboid, coc.uid as categoryoptioncombouid from dataelement de join categorycombos_optioncombos cc on de.categorycomboid = cc.categorycomboid join categoryoptioncombo coc on cc.categoryoptioncomboid = coc.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,053 Create data element category option combo index SQL: CREATE INDEX dataelement_categoryoptioncombo ON _dataelementcategoryoptioncombo (dataelementuid, categoryoptioncombouid) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,133 Data element category option combo table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,143 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:37 CAT 2015, message: Updating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,144 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,145 Approval enabled: false (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,145 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,156 Table update start: analytics, processes: 3, partitions: [analytics_2013, analytics_2014, analytics_2015], last years: null, earliest: null: 00:00:10.012 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,157 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,158 Performed pre-create table work: 00:00:10.013 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,158 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,165 Creating table: analytics_temp_2013, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,176 Creating table: analytics_temp_2014, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,184 Creating table: analytics_temp_2015, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,186 Created analytics tables: 00:00:10.042 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,187 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:40:29,977 Populated analytics_temp_2013, int: 102.79 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:33,045 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:36,108 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:39,159 Populated analytics_temp_2013, trueOnly: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:55,434 Populated analytics_temp_2013, string: 16.27 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:41:09,059 Populated analytics_temp_2014, int: 141.87 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:12,113 Populated analytics_temp_2014, bool: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:15,134 Populated analytics_temp_2014, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:18,163 Populated analytics_temp_2014, trueOnly: 3.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:34,466 Populated analytics_temp_2014, string: 16.30 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:38,998 Populated analytics_temp_2015, int: 171.80 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:42,023 Populated analytics_temp_2015, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:45,019 Populated analytics_temp_2015, bool: 2.99 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:48,024 Populated analytics_temp_2015, trueOnly: 3.00 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:42:04,402 Populated analytics_temp_2015, string: 16.37 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:42:04,403 Populated analytics tables: 00:03:27.258 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,403 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,405 Applied aggregation levels: 00:03:27.260 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,405 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,406 No of analytics table indexes: 84 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,245 Created indexes: 00:08:33.100 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,245 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,246 Vacuumed tables: 00:08:33.102 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,246 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 Partition tables: [analytics_2013, analytics_2014, analytics_2015], last years: null: 00:08:33.989 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 Table update done: analytics: 00:08:33.989 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,134 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Updating completeness table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,135 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,136 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,166 Table update start: analytics_completeness, processes: 3, partitions: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null, earliest: null: 00:00:00.030 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 Performed pre-create table work: 00:00:00.031 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,170 Creating table: analytics_completeness_temp_2013, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,173 Creating table: analytics_completeness_temp_2014, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,177 Creating table: analytics_completeness_temp_2015, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 Created analytics tables: 00:00:00.043 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,198 Populated analytics_completeness_temp_2013: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-308]) * INFO 2015-11-09 10:47:11,287 Populated analytics_completeness_temp_2015: 0.10 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-309]) * INFO 2015-11-09 10:47:11,304 Populated analytics_completeness_temp_2014: 0.12 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-307]) * INFO 2015-11-09 10:47:11,304 Populated analytics tables: 00:00:00.168 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,304 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,305 Applied aggregation levels: 00:00:00.169 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,306 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,306 No of analytics table indexes: 60 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,132 Created indexes: 00:00:02.996 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,132 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,133 Vacuumed tables: 00:00:02.997 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 Partition tables: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null: 00:00:03.051 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 Table update done: analytics_completeness: 00:00:03.051 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating completeness target table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,188 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 Table update start: analytics_completenesstarget, processes: 3, partitions: [analytics_completenesstarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,192 Creating table: analytics_completenesstarget_temp, columns: 9 (JdbcCompletenessTargetTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 Created analytics tables: 00:00:00.004 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,225 Populated analytics_completenesstarget_temp: 0.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-316]) * INFO 2015-11-09 10:47:14,226 Populated analytics tables: 00:00:00.037 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,226 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,227 Applied aggregation levels: 00:00:00.038 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,227 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,228 No of analytics table indexes: 9 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,673 Created indexes: 00:00:00.484 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,673 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,674 Vacuumed tables: 00:00:00.485 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,674 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,687 Partition tables: [analytics_completenesstarget], last years: null: 00:00:00.499 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 Table update done: analytics_completenesstarget: 00:00:00.499 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating organisation unit target table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,689 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,689 Table update start: analytics_orgunittarget, processes: 3, partitions: [analytics_orgunittarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,692 Creating table: analytics_orgunittarget_temp, columns: 6 (JdbcOrgUnitTargetTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 Created analytics tables: 00:00:00.003 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,705 Populated analytics_orgunittarget_temp: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-323]) * INFO 2015-11-09 10:47:14,706 Populated analytics tables: 00:00:00.016 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,706 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 Applied aggregation levels: 00:00:00.017 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 No of analytics table indexes: 6 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,809 Created indexes: 00:00:00.120 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,809 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,810 Vacuumed tables: 00:00:00.121 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,811 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 Partition tables: [analytics_orgunittarget], last years: null: 00:00:00.131 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 Table update done: analytics_orgunittarget: 00:00:00.131 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating event analytics table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,822 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,822 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: No events exist, not updating event analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,823 Analytics tables updated: 00:08:54.947 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,823 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Analytics tables updated: 00:08:54.947] (InMemoryNotifier.java [taskScheduler-5])
···

On Sat, Nov 7, 2015 at 10:54 AM, Lars Helge Øverland larshelge@gmail.com wrote:

Hi Moses,

can you please share the tomcat log output during analytics table generation.

regards,

Lars

On Fri, Nov 6, 2015 at 4:31 PM, Moses Marimo marimo@ict.co.zw wrote:

I am running DHIS2.20 on Ubuntu LTS 14.04 with Tomcat 7

On Friday, 6 November 2015, Moses Marimo marimo@ict.co.zw wrote:

After I restored a database, analytics table is no longer being populated even if after running Analytics, rebooting server, running analytics again. I have checked in physical datavalue table and the data is there. No error in Catalina logs.

Any pointers??


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org

ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.

Hi Lars,

I have seen where the problem was. Apparently, there is a scheduled script that backs up the database. At some point, the size of the backup file dropped from 2.3GB to 270MB. So, I was restoring this smaller file while was definitely an incomplete file. I had to go back one week to get a “healthy” looking backup file and it worked. So, there problem was not with the DHIS2 software.

Now, my currently problem is, why would a Postgresql backup file suddenly fail that way, from 2.3GB to 270MB. I have tried to manually backup the database and still same small backup file. The space on the server is about 80% free space. I am using a pg_dump to backup the database on Ubuntu 14.04 LTS.

···

On Mon, Nov 9, 2015 at 11:07 AM, Moses Marimo marimo@ict.co.zw wrote:

* INFO 2015-11-09 10:38:24,708 Indicator group set table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,717 Create organisation unit group set table SQL: CREATE TABLE _organisationunitgroupsetstructure ( organisationunitid INTEGER NOT NULL, organisationunitname VARCHAR (250), "Location" VARCHAR (250), "NDAElbuYMNM" CHARACTER(11), "Ownership" VARCHAR (250), "Y2vBvfxaIcS" CHARACTER(11), "Type" VARCHAR (250), "fguPo20Ggjj" CHARACTER(11), PRIMARY KEY ( organisationunitid ) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,719 Populate organisation unit group set structure SQL: insert into _organisationunitgroupsetstructure select ou.organisationunitid as organisationunitid, [ou.name](http://ou.name) as organisationunitname, (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Location", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "NDAElbuYMNM", (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Ownership", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Y2vBvfxaIcS", (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Type", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "fguPo20Ggjj" from organisationunit ou (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,921 Organisation unit group set table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,926 Create category structure table SQL: CREATE TABLE _categorystructure ( categoryoptioncomboid INTEGER NOT NULL, categoryoptioncomboname VARCHAR (250), PRIMARY KEY ( categoryoptioncomboid ) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,928 Populate category structure SQL: insert into _categorystructure select coc.categoryoptioncomboid as cocid, con.categoryoptioncomboname as cocname from categoryoptioncombo coc inner join _categoryoptioncomboname con on coc.categoryoptioncomboid = con.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,930 Category table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:27,657 Create data element structure SQL: CREATE TABLE _dataelementstructure ( dataelementid INTEGER NOT NULL PRIMARY KEY, dataelementuid CHARACTER(11), dataelementname VARCHAR(250), datasetid INTEGER, datasetuid CHARACTER(11), datasetname VARCHAR(250), datasetapprovallevel INTEGER, periodtypeid INTEGER, periodtypename VARCHAR(250) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,651 Data element table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,714 Create period structure SQL: CREATE TABLE _periodstructure (periodid INTEGER NOT NULL PRIMARY KEY, iso VARCHAR(15) NOT NULL, daysno INTEGER NOT NULL, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,750 Date period table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,759 Create date period structure SQL: CREATE TABLE _dateperiodstructure (dateperiod DATE NOT NULL PRIMARY KEY, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,029 Period table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,030 Create data element category option combo SQL: CREATE TABLE _dataelementcategoryoptioncombo (dataelementid INTEGER NOT NULL, dataelementuid VARCHAR(11) NOT NULL, categoryoptioncomboid INTEGER NOT NULL, categoryoptioncombouid VARCHAR(11) NOT NULL) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,032 Insert data element category option combo SQL: insert into _dataelementcategoryoptioncombo (dataelementid, dataelementuid, categoryoptioncomboid, categoryoptioncombouid) select de.dataelementid as dataelementid, de.uid as dataelementuid, coc.categoryoptioncomboid as categoryoptioncomboid, coc.uid as categoryoptioncombouid from dataelement de join categorycombos_optioncombos cc on de.categorycomboid = cc.categorycomboid join categoryoptioncombo coc on cc.categoryoptioncomboid = coc.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,053 Create data element category option combo index SQL: CREATE INDEX dataelement_categoryoptioncombo ON _dataelementcategoryoptioncombo (dataelementuid, categoryoptioncombouid) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,133 Data element category option combo table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,143 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:37 CAT 2015, message: Updating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,144 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,145 Approval enabled: false (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,145 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,156 Table update start: analytics, processes: 3, partitions: [analytics_2013, analytics_2014, analytics_2015], last years: null, earliest: null: 00:00:10.012 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,157 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,158 Performed pre-create table work: 00:00:10.013 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,158 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,165 Creating table: analytics_temp_2013, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,176 Creating table: analytics_temp_2014, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,184 Creating table: analytics_temp_2015, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,186 Created analytics tables: 00:00:10.042 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,187 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:40:29,977 Populated analytics_temp_2013, int: 102.79 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:33,045 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:36,108 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:39,159 Populated analytics_temp_2013, trueOnly: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:55,434 Populated analytics_temp_2013, string: 16.27 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:41:09,059 Populated analytics_temp_2014, int: 141.87 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:12,113 Populated analytics_temp_2014, bool: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:15,134 Populated analytics_temp_2014, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:18,163 Populated analytics_temp_2014, trueOnly: 3.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:34,466 Populated analytics_temp_2014, string: 16.30 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:38,998 Populated analytics_temp_2015, int: 171.80 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:42,023 Populated analytics_temp_2015, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:45,019 Populated analytics_temp_2015, bool: 2.99 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:48,024 Populated analytics_temp_2015, trueOnly: 3.00 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:42:04,402 Populated analytics_temp_2015, string: 16.37 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:42:04,403 Populated analytics tables: 00:03:27.258 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,403 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,405 Applied aggregation levels: 00:03:27.260 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,405 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,406 No of analytics table indexes: 84 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,245 Created indexes: 00:08:33.100 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,245 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,246 Vacuumed tables: 00:08:33.102 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,246 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 Partition tables: [analytics_2013, analytics_2014, analytics_2015], last years: null: 00:08:33.989 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 Table update done: analytics: 00:08:33.989 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,134 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Updating completeness table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,135 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,136 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,166 Table update start: analytics_completeness, processes: 3, partitions: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null, earliest: null: 00:00:00.030 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 Performed pre-create table work: 00:00:00.031 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,170 Creating table: analytics_completeness_temp_2013, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,173 Creating table: analytics_completeness_temp_2014, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,177 Creating table: analytics_completeness_temp_2015, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 Created analytics tables: 00:00:00.043 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,198 Populated analytics_completeness_temp_2013: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-308]) * INFO 2015-11-09 10:47:11,287 Populated analytics_completeness_temp_2015: 0.10 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-309]) * INFO 2015-11-09 10:47:11,304 Populated analytics_completeness_temp_2014: 0.12 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-307]) * INFO 2015-11-09 10:47:11,304 Populated analytics tables: 00:00:00.168 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,304 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,305 Applied aggregation levels: 00:00:00.169 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,306 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,306 No of analytics table indexes: 60 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,132 Created indexes: 00:00:02.996 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,132 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,133 Vacuumed tables: 00:00:02.997 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 Partition tables: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null: 00:00:03.051 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 Table update done: analytics_completeness: 00:00:03.051 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating completeness target table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,188 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 Table update start: analytics_completenesstarget, processes: 3, partitions: [analytics_completenesstarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,192 Creating table: analytics_completenesstarget_temp, columns: 9 (JdbcCompletenessTargetTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 Created analytics tables: 00:00:00.004 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,225 Populated analytics_completenesstarget_temp: 0.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-316]) * INFO 2015-11-09 10:47:14,226 Populated analytics tables: 00:00:00.037 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,226 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,227 Applied aggregation levels: 00:00:00.038 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,227 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,228 No of analytics table indexes: 9 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,673 Created indexes: 00:00:00.484 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,673 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,674 Vacuumed tables: 00:00:00.485 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,674 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,687 Partition tables: [analytics_completenesstarget], last years: null: 00:00:00.499 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 Table update done: analytics_completenesstarget: 00:00:00.499 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating organisation unit target table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,689 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,689 Table update start: analytics_orgunittarget, processes: 3, partitions: [analytics_orgunittarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,692 Creating table: analytics_orgunittarget_temp, columns: 6 (JdbcOrgUnitTargetTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 Created analytics tables: 00:00:00.003 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,705 Populated analytics_orgunittarget_temp: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-323]) * INFO 2015-11-09 10:47:14,706 Populated analytics tables: 00:00:00.016 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,706 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 Applied aggregation levels: 00:00:00.017 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 No of analytics table indexes: 6 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,809 Created indexes: 00:00:00.120 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,809 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,810 Vacuumed tables: 00:00:00.121 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,811 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 Partition tables: [analytics_orgunittarget], last years: null: 00:00:00.131 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 Table update done: analytics_orgunittarget: 00:00:00.131 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating event analytics table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,822 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,822 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: No events exist, not updating event analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,823 Analytics tables updated: 00:08:54.947 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,823 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Analytics tables updated: 00:08:54.947] (InMemoryNotifier.java [taskScheduler-5])

On Sat, Nov 7, 2015 at 10:54 AM, Lars Helge Øverland larshelge@gmail.com wrote:

Hi Moses,

can you please share the tomcat log output during analytics table generation.

regards,

Lars


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.

On Fri, Nov 6, 2015 at 4:31 PM, Moses Marimo marimo@ict.co.zw wrote:

I am running DHIS2.20 on Ubuntu LTS 14.04 with Tomcat 7

On Friday, 6 November 2015, Moses Marimo marimo@ict.co.zw wrote:

After I restored a database, analytics table is no longer being populated even if after running Analytics, rebooting server, running analytics again. I have checked in physical datavalue table and the data is there. No error in Catalina logs.

Any pointers??


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org

ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.

Sounds like an out of disk space issue. Perhaps verify that you have enough space on the partition you are storing the files on.

···

On Tue, Nov 10, 2015 at 1:33 PM, Moses Marimo marimo@ict.co.zw wrote:

Hi Lars,

I have seen where the problem was. Apparently, there is a scheduled script that backs up the database. At some point, the size of the backup file dropped from 2.3GB to 270MB. So, I was restoring this smaller file while was definitely an incomplete file. I had to go back one week to get a “healthy” looking backup file and it worked. So, there problem was not with the DHIS2 software.

Now, my currently problem is, why would a Postgresql backup file suddenly fail that way, from 2.3GB to 270MB. I have tried to manually backup the database and still same small backup file. The space on the server is about 80% free space. I am using a pg_dump to backup the database on Ubuntu 14.04 LTS.

On Mon, Nov 9, 2015 at 11:07 AM, Moses Marimo marimo@ict.co.zw wrote:

* INFO 2015-11-09 10:38:24,708 Indicator group set table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,717 Create organisation unit group set table SQL: CREATE TABLE _organisationunitgroupsetstructure ( organisationunitid INTEGER NOT NULL, organisationunitname VARCHAR (250), "Location" VARCHAR (250), "NDAElbuYMNM" CHARACTER(11), "Ownership" VARCHAR (250), "Y2vBvfxaIcS" CHARACTER(11), "Type" VARCHAR (250), "fguPo20Ggjj" CHARACTER(11), PRIMARY KEY ( organisationunitid ) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,719 Populate organisation unit group set structure SQL: insert into _organisationunitgroupsetstructure select ou.organisationunitid as organisationunitid, [ou.name](http://ou.name) as organisationunitname, (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Location", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "NDAElbuYMNM", (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Ownership", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Y2vBvfxaIcS", (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Type", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "fguPo20Ggjj" from organisationunit ou (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,921 Organisation unit group set table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,926 Create category structure table SQL: CREATE TABLE _categorystructure ( categoryoptioncomboid INTEGER NOT NULL, categoryoptioncomboname VARCHAR (250), PRIMARY KEY ( categoryoptioncomboid ) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,928 Populate category structure SQL: insert into _categorystructure select coc.categoryoptioncomboid as cocid, con.categoryoptioncomboname as cocname from categoryoptioncombo coc inner join _categoryoptioncomboname con on coc.categoryoptioncomboid = con.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,930 Category table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:27,657 Create data element structure SQL: CREATE TABLE _dataelementstructure ( dataelementid INTEGER NOT NULL PRIMARY KEY, dataelementuid CHARACTER(11), dataelementname VARCHAR(250), datasetid INTEGER, datasetuid CHARACTER(11), datasetname VARCHAR(250), datasetapprovallevel INTEGER, periodtypeid INTEGER, periodtypename VARCHAR(250) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,651 Data element table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,714 Create period structure SQL: CREATE TABLE _periodstructure (periodid INTEGER NOT NULL PRIMARY KEY, iso VARCHAR(15) NOT NULL, daysno INTEGER NOT NULL, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,750 Date period table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,759 Create date period structure SQL: CREATE TABLE _dateperiodstructure (dateperiod DATE NOT NULL PRIMARY KEY, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,029 Period table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,030 Create data element category option combo SQL: CREATE TABLE _dataelementcategoryoptioncombo (dataelementid INTEGER NOT NULL, dataelementuid VARCHAR(11) NOT NULL, categoryoptioncomboid INTEGER NOT NULL, categoryoptioncombouid VARCHAR(11) NOT NULL) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,032 Insert data element category option combo SQL: insert into _dataelementcategoryoptioncombo (dataelementid, dataelementuid, categoryoptioncomboid, categoryoptioncombouid) select de.dataelementid as dataelementid, de.uid as dataelementuid, coc.categoryoptioncomboid as categoryoptioncomboid, coc.uid as categoryoptioncombouid from dataelement de join categorycombos_optioncombos cc on de.categorycomboid = cc.categorycomboid join categoryoptioncombo coc on cc.categoryoptioncomboid = coc.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,053 Create data element category option combo index SQL: CREATE INDEX dataelement_categoryoptioncombo ON _dataelementcategoryoptioncombo (dataelementuid, categoryoptioncombouid) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,133 Data element category option combo table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,143 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:37 CAT 2015, message: Updating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,144 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,145 Approval enabled: false (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,145 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,156 Table update start: analytics, processes: 3, partitions: [analytics_2013, analytics_2014, analytics_2015], last years: null, earliest: null: 00:00:10.012 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,157 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,158 Performed pre-create table work: 00:00:10.013 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,158 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,165 Creating table: analytics_temp_2013, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,176 Creating table: analytics_temp_2014, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,184 Creating table: analytics_temp_2015, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,186 Created analytics tables: 00:00:10.042 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,187 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:40:29,977 Populated analytics_temp_2013, int: 102.79 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:33,045 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:36,108 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:39,159 Populated analytics_temp_2013, trueOnly: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:55,434 Populated analytics_temp_2013, string: 16.27 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:41:09,059 Populated analytics_temp_2014, int: 141.87 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:12,113 Populated analytics_temp_2014, bool: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:15,134 Populated analytics_temp_2014, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:18,163 Populated analytics_temp_2014, trueOnly: 3.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:34,466 Populated analytics_temp_2014, string: 16.30 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:38,998 Populated analytics_temp_2015, int: 171.80 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:42,023 Populated analytics_temp_2015, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:45,019 Populated analytics_temp_2015, bool: 2.99 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:48,024 Populated analytics_temp_2015, trueOnly: 3.00 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:42:04,402 Populated analytics_temp_2015, string: 16.37 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:42:04,403 Populated analytics tables: 00:03:27.258 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,403 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,405 Applied aggregation levels: 00:03:27.260 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,405 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,406 No of analytics table indexes: 84 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,245 Created indexes: 00:08:33.100 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,245 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,246 Vacuumed tables: 00:08:33.102 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,246 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 Partition tables: [analytics_2013, analytics_2014, analytics_2015], last years: null: 00:08:33.989 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 Table update done: analytics: 00:08:33.989 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,134 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Updating completeness table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,135 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,136 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,166 Table update start: analytics_completeness, processes: 3, partitions: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null, earliest: null: 00:00:00.030 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 Performed pre-create table work: 00:00:00.031 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,170 Creating table: analytics_completeness_temp_2013, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,173 Creating table: analytics_completeness_temp_2014, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,177 Creating table: analytics_completeness_temp_2015, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 Created analytics tables: 00:00:00.043 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,198 Populated analytics_completeness_temp_2013: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-308]) * INFO 2015-11-09 10:47:11,287 Populated analytics_completeness_temp_2015: 0.10 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-309]) * INFO 2015-11-09 10:47:11,304 Populated analytics_completeness_temp_2014: 0.12 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-307]) * INFO 2015-11-09 10:47:11,304 Populated analytics tables: 00:00:00.168 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,304 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,305 Applied aggregation levels: 00:00:00.169 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,306 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,306 No of analytics table indexes: 60 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,132 Created indexes: 00:00:02.996 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,132 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,133 Vacuumed tables: 00:00:02.997 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 Partition tables: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null: 00:00:03.051 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 Table update done: analytics_completeness: 00:00:03.051 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating completeness target table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,188 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 Table update start: analytics_completenesstarget, processes: 3, partitions: [analytics_completenesstarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,192 Creating table: analytics_completenesstarget_temp, columns: 9 (JdbcCompletenessTargetTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 Created analytics tables: 00:00:00.004 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,225 Populated analytics_completenesstarget_temp: 0.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-316]) * INFO 2015-11-09 10:47:14,226 Populated analytics tables: 00:00:00.037 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,226 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,227 Applied aggregation levels: 00:00:00.038 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,227 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,228 No of analytics table indexes: 9 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,673 Created indexes: 00:00:00.484 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,673 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,674 Vacuumed tables: 00:00:00.485 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,674 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,687 Partition tables: [analytics_completenesstarget], last years: null: 00:00:00.499 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 Table update done: analytics_completenesstarget: 00:00:00.499 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating organisation unit target table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,689 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,689 Table update start: analytics_orgunittarget, processes: 3, partitions: [analytics_orgunittarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,692 Creating table: analytics_orgunittarget_temp, columns: 6 (JdbcOrgUnitTargetTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 Created analytics tables: 00:00:00.003 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,705 Populated analytics_orgunittarget_temp: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-323]) * INFO 2015-11-09 10:47:14,706 Populated analytics tables: 00:00:00.016 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,706 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 Applied aggregation levels: 00:00:00.017 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 No of analytics table indexes: 6 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,809 Created indexes: 00:00:00.120 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,809 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,810 Vacuumed tables: 00:00:00.121 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,811 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 Partition tables: [analytics_orgunittarget], last years: null: 00:00:00.131 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 Table update done: analytics_orgunittarget: 00:00:00.131 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating event analytics table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,822 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,822 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: No events exist, not updating event analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,823 Analytics tables updated: 00:08:54.947 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,823 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Analytics tables updated: 00:08:54.947] (InMemoryNotifier.java [taskScheduler-5])


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.

On Sat, Nov 7, 2015 at 10:54 AM, Lars Helge Øverland larshelge@gmail.com wrote:

Hi Moses,

can you please share the tomcat log output during analytics table generation.

regards,

Lars


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.

On Fri, Nov 6, 2015 at 4:31 PM, Moses Marimo marimo@ict.co.zw wrote:

I am running DHIS2.20 on Ubuntu LTS 14.04 with Tomcat 7

On Friday, 6 November 2015, Moses Marimo marimo@ict.co.zw wrote:

After I restored a database, analytics table is no longer being populated even if after running Analytics, rebooting server, running analytics again. I have checked in physical datavalue table and the data is there. No error in Catalina logs.

Any pointers??


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org

Dear Moses

Please check the disk space available as Lars suggested and also check the physical memory used and virtual memory used during analytic operation.

The possible reason of backup size difference is one with analytic and data-mart tables and the other one without these tables or blank. The log you share in your mail doesn’t content any error log which does not lead to a solution. Can you please share the tomcat log file for that specif time period after when the backup is small.

Regards

Hannan Khan

HISP Bangladesh

···

On Tue, Nov 10, 2015 at 7:58 PM, Lars Helge Øverland larshelge@gmail.com wrote:

Sounds like an out of disk space issue. Perhaps verify that you have enough space on the partition you are storing the files on.


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

On Tue, Nov 10, 2015 at 1:33 PM, Moses Marimo marimo@ict.co.zw wrote:

Hi Lars,

I have seen where the problem was. Apparently, there is a scheduled script that backs up the database. At some point, the size of the backup file dropped from 2.3GB to 270MB. So, I was restoring this smaller file while was definitely an incomplete file. I had to go back one week to get a “healthy” looking backup file and it worked. So, there problem was not with the DHIS2 software.

Now, my currently problem is, why would a Postgresql backup file suddenly fail that way, from 2.3GB to 270MB. I have tried to manually backup the database and still same small backup file. The space on the server is about 80% free space. I am using a pg_dump to backup the database on Ubuntu 14.04 LTS.


Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org

On Mon, Nov 9, 2015 at 11:07 AM, Moses Marimo marimo@ict.co.zw wrote:

* INFO 2015-11-09 10:38:24,708 Indicator group set table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,717 Create organisation unit group set table SQL: CREATE TABLE _organisationunitgroupsetstructure ( organisationunitid INTEGER NOT NULL, organisationunitname VARCHAR (250), "Location" VARCHAR (250), "NDAElbuYMNM" CHARACTER(11), "Ownership" VARCHAR (250), "Y2vBvfxaIcS" CHARACTER(11), "Type" VARCHAR (250), "fguPo20Ggjj" CHARACTER(11), PRIMARY KEY ( organisationunitid ) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,719 Populate organisation unit group set structure SQL: insert into _organisationunitgroupsetstructure select ou.organisationunitid as organisationunitid, [ou.name](http://ou.name) as organisationunitname, (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Location", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "NDAElbuYMNM", (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Ownership", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Y2vBvfxaIcS", (select [oug.name](http://oug.name) from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Type", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "fguPo20Ggjj" from organisationunit ou (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,921 Organisation unit group set table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,926 Create category structure table SQL: CREATE TABLE _categorystructure ( categoryoptioncomboid INTEGER NOT NULL, categoryoptioncomboname VARCHAR (250), PRIMARY KEY ( categoryoptioncomboid ) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,928 Populate category structure SQL: insert into _categorystructure select coc.categoryoptioncomboid as cocid, con.categoryoptioncomboname as cocname from categoryoptioncombo coc inner join _categoryoptioncomboname con on coc.categoryoptioncomboid = con.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:24,930 Category table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:27,657 Create data element structure SQL: CREATE TABLE _dataelementstructure ( dataelementid INTEGER NOT NULL PRIMARY KEY, dataelementuid CHARACTER(11), dataelementname VARCHAR(250), datasetid INTEGER, datasetuid CHARACTER(11), datasetname VARCHAR(250), datasetapprovallevel INTEGER, periodtypeid INTEGER, periodtypename VARCHAR(250) ) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,651 Data element table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,714 Create period structure SQL: CREATE TABLE _periodstructure (periodid INTEGER NOT NULL PRIMARY KEY, iso VARCHAR(15) NOT NULL, daysno INTEGER NOT NULL, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,750 Date period table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:32,759 Create date period structure SQL: CREATE TABLE _dateperiodstructure (dateperiod DATE NOT NULL PRIMARY KEY, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,029 Period table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,030 Create data element category option combo SQL: CREATE TABLE _dataelementcategoryoptioncombo (dataelementid INTEGER NOT NULL, dataelementuid VARCHAR(11) NOT NULL, categoryoptioncomboid INTEGER NOT NULL, categoryoptioncombouid VARCHAR(11) NOT NULL) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,032 Insert data element category option combo SQL: insert into _dataelementcategoryoptioncombo (dataelementid, dataelementuid, categoryoptioncomboid, categoryoptioncombouid) select de.dataelementid as dataelementid, de.uid as dataelementuid, coc.categoryoptioncomboid as categoryoptioncomboid, coc.uid as categoryoptioncombouid from dataelement de join categorycombos_optioncombos cc on de.categorycomboid = cc.categorycomboid join categoryoptioncombo coc on cc.categoryoptioncomboid = coc.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,053 Create data element category option combo index SQL: CREATE INDEX dataelement_categoryoptioncombo ON _dataelementcategoryoptioncombo (dataelementuid, categoryoptioncombouid) (JdbcResourceTableStore.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,133 Data element category option combo table generated (DefaultResourceTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,143 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:37 CAT 2015, message: Updating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,144 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,145 Approval enabled: false (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:37,145 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,156 Table update start: analytics, processes: 3, partitions: [analytics_2013, analytics_2014, analytics_2015], last years: null, earliest: null: 00:00:10.012 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,157 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,158 Performed pre-create table work: 00:00:10.013 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,158 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,165 Creating table: analytics_temp_2013, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,176 Creating table: analytics_temp_2014, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,184 Creating table: analytics_temp_2015, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,186 Created analytics tables: 00:00:10.042 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:38:47,187 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:40:29,977 Populated analytics_temp_2013, int: 102.79 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:33,045 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:36,108 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:39,159 Populated analytics_temp_2013, trueOnly: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:40:55,434 Populated analytics_temp_2013, string: 16.27 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298]) * INFO 2015-11-09 10:41:09,059 Populated analytics_temp_2014, int: 141.87 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:12,113 Populated analytics_temp_2014, bool: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:15,134 Populated analytics_temp_2014, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:18,163 Populated analytics_temp_2014, trueOnly: 3.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:34,466 Populated analytics_temp_2014, string: 16.30 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300]) * INFO 2015-11-09 10:41:38,998 Populated analytics_temp_2015, int: 171.80 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:42,023 Populated analytics_temp_2015, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:45,019 Populated analytics_temp_2015, bool: 2.99 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:41:48,024 Populated analytics_temp_2015, trueOnly: 3.00 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:42:04,402 Populated analytics_temp_2015, string: 16.37 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299]) * INFO 2015-11-09 10:42:04,403 Populated analytics tables: 00:03:27.258 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,403 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,405 Applied aggregation levels: 00:03:27.260 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,405 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:42:04,406 No of analytics table indexes: 84 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,245 Created indexes: 00:08:33.100 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,245 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,246 Vacuumed tables: 00:08:33.102 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:10,246 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 Partition tables: [analytics_2013, analytics_2014, analytics_2015], last years: null: 00:08:33.989 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 Table update done: analytics: 00:08:33.989 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,134 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Updating completeness table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,135 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,136 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,166 Table update start: analytics_completeness, processes: 3, partitions: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null, earliest: null: 00:00:00.030 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 Performed pre-create table work: 00:00:00.031 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,170 Creating table: analytics_completeness_temp_2013, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,173 Creating table: analytics_completeness_temp_2014, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,177 Creating table: analytics_completeness_temp_2015, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 Created analytics tables: 00:00:00.043 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,179 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,198 Populated analytics_completeness_temp_2013: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-308]) * INFO 2015-11-09 10:47:11,287 Populated analytics_completeness_temp_2015: 0.10 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-309]) * INFO 2015-11-09 10:47:11,304 Populated analytics_completeness_temp_2014: 0.12 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-307]) * INFO 2015-11-09 10:47:11,304 Populated analytics tables: 00:00:00.168 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,304 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,305 Applied aggregation levels: 00:00:00.169 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,306 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:11,306 No of analytics table indexes: 60 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,132 Created indexes: 00:00:02.996 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,132 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,133 Vacuumed tables: 00:00:02.997 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 Partition tables: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null: 00:00:03.051 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 Table update done: analytics_completeness: 00:00:03.051 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating completeness target table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,188 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 Table update start: analytics_completenesstarget, processes: 3, partitions: [analytics_completenesstarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,192 Creating table: analytics_completenesstarget_temp, columns: 9 (JdbcCompletenessTargetTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 Created analytics tables: 00:00:00.004 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,193 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,225 Populated analytics_completenesstarget_temp: 0.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-316]) * INFO 2015-11-09 10:47:14,226 Populated analytics tables: 00:00:00.037 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,226 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,227 Applied aggregation levels: 00:00:00.038 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,227 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,228 No of analytics table indexes: 9 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,673 Created indexes: 00:00:00.484 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,673 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,674 Vacuumed tables: 00:00:00.485 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,674 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,687 Partition tables: [analytics_completenesstarget], last years: null: 00:00:00.499 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 Table update done: analytics_completenesstarget: 00:00:00.499 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating organisation unit target table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,689 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,689 Table update start: analytics_orgunittarget, processes: 3, partitions: [analytics_orgunittarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,692 Creating table: analytics_orgunittarget_temp, columns: 6 (JdbcOrgUnitTargetTableManager.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 Created analytics tables: 00:00:00.003 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,693 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,705 Populated analytics_orgunittarget_temp: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-323]) * INFO 2015-11-09 10:47:14,706 Populated analytics tables: 00:00:00.016 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,706 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 Applied aggregation levels: 00:00:00.017 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,707 No of analytics table indexes: 6 (DefaultAnalyticsTableService.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,809 Created indexes: 00:00:00.120 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,809 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,810 Vacuumed tables: 00:00:00.121 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,811 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 Partition tables: [analytics_orgunittarget], last years: null: 00:00:00.131 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 Table update done: analytics_orgunittarget: 00:00:00.131 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating event analytics table] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,822 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,822 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: No events exist, not updating event analytics tables] (InMemoryNotifier.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,823 Analytics tables updated: 00:08:54.947 (Clock.java [taskScheduler-5]) * INFO 2015-11-09 10:47:14,823 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Analytics tables updated: 00:08:54.947] (InMemoryNotifier.java [taskScheduler-5])


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.

On Sat, Nov 7, 2015 at 10:54 AM, Lars Helge Øverland larshelge@gmail.com wrote:

Hi Moses,

can you please share the tomcat log output during analytics table generation.

regards,

Lars


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.

On Fri, Nov 6, 2015 at 4:31 PM, Moses Marimo marimo@ict.co.zw wrote:

I am running DHIS2.20 on Ubuntu LTS 14.04 with Tomcat 7

On Friday, 6 November 2015, Moses Marimo marimo@ict.co.zw wrote:

After I restored a database, analytics table is no longer being populated even if after running Analytics, rebooting server, running analytics again. I have checked in physical datavalue table and the data is there. No error in Catalina logs.

Any pointers??


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


ICT Warehouse (Pvt) Ltd - “The Stockist of e-nnovation”
7 Chelmsford Belgravia, Harare
Tel: +263-8644-102349
Cell: +263-772-268353
Website: www.ict.co.zw

Innovative solutions in Web Design and E-Commerce, Software Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT Solutions and Consultancy.


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org