Incorrect Data Element Categories pulled in Pivot Tale

DHIS version 2.19

Build 19144

We have an urgent issue which needs correction as soon as possible (we have a reporting deadline of Monday, 11 January.):

We are collecting data via a Data Set/Data Entry screen for data elements which are categorized by 2 genders and 8 age groups. Three of the age categorizations for both genders are collecting the data via the data entry screen properly but are showing up as blanks when included in a pivot table. (The other 5 age groups for both genders are reporting properly in the same pivot table.)

In looking at the data on the backend and querying the category option combinations, resource tables and analytics tables I see that there are multiple instances of many of the gender/age group categories. (For example, there are 4 (Female, 0-1 years) category option combos.) The data set and data entry screen are collecting the data properly but a no-longer used version of the category option combo is being pulled into the analytics table/pivot table for 3 of the 8 age groupings.

There is no error in the log when running Analytics.

The Data Set Report appears to display the proper data per the data entry screen (i.e., it does not mimic the incomplete Pivot Table report.)

Is there a way to realign the category options so that what is used in the data entry screen is what flows through to the analytics table? Or is there a later build that corrects this problem?

Thank you.

···

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132

I just ran a Data Integrity check in the Data Maintenance app and see that this issue is violating the following:

Category option combos not in data element category combo in data entry form

···

On Fri, Jan 8, 2016 at 12:39 AM, Laura E. Lincks laura.lincks@icap.columbia.edu wrote:

DHIS version 2.19

Build 19144

We have an urgent issue which needs correction as soon as possible (we have a reporting deadline of Monday, 11 January.):

We are collecting data via a Data Set/Data Entry screen for data elements which are categorized by 2 genders and 8 age groups. Three of the age categorizations for both genders are collecting the data via the data entry screen properly but are showing up as blanks when included in a pivot table. (The other 5 age groups for both genders are reporting properly in the same pivot table.)

In looking at the data on the backend and querying the category option combinations, resource tables and analytics tables I see that there are multiple instances of many of the gender/age group categories. (For example, there are 4 (Female, 0-1 years) category option combos.) The data set and data entry screen are collecting the data properly but a no-longer used version of the category option combo is being pulled into the analytics table/pivot table for 3 of the 8 age groupings.

There is no error in the log when running Analytics.

The Data Set Report appears to display the proper data per the data entry screen (i.e., it does not mimic the incomplete Pivot Table report.)

Is there a way to realign the category options so that what is used in the data entry screen is what flows through to the analytics table? Or is there a later build that corrects this problem?

Thank you.

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132

You may try Update category option combinations from Apps → Data Administration → Maintenance

Please have the backup before doing this or try it in local machine first.

···

On Fri, Jan 8, 2016 at 11:09 AM, Laura E. Lincks laura.lincks@icap.columbia.edu wrote:

DHIS version 2.19

Build 19144

We have an urgent issue which needs correction as soon as possible (we have a reporting deadline of Monday, 11 January.):

We are collecting data via a Data Set/Data Entry screen for data elements which are categorized by 2 genders and 8 age groups. Three of the age categorizations for both genders are collecting the data via the data entry screen properly but are showing up as blanks when included in a pivot table. (The other 5 age groups for both genders are reporting properly in the same pivot table.)

In looking at the data on the backend and querying the category option combinations, resource tables and analytics tables I see that there are multiple instances of many of the gender/age group categories. (For example, there are 4 (Female, 0-1 years) category option combos.) The data set and data entry screen are collecting the data properly but a no-longer used version of the category option combo is being pulled into the analytics table/pivot table for 3 of the 8 age groupings.

There is no error in the log when running Analytics.

The Data Set Report appears to display the proper data per the data entry screen (i.e., it does not mimic the incomplete Pivot Table report.)

Is there a way to realign the category options so that what is used in the data entry screen is what flows through to the analytics table? Or is there a later build that corrects this problem?

Thank you.

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Regards,
Bharath Kumar. Ch

Thanks, Bharath. I did try that. It didn’t change anything.

···

On Fri, Jan 8, 2016 at 12:55 AM, Bharath chbharathk@gmail.com wrote:

You may try Update category option combinations from Apps → Data Administration → Maintenance

Please have the backup before doing this or try it in local machine first.

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132

On Fri, Jan 8, 2016 at 11:09 AM, Laura E. Lincks laura.lincks@icap.columbia.edu wrote:

DHIS version 2.19

Build 19144

We have an urgent issue which needs correction as soon as possible (we have a reporting deadline of Monday, 11 January.):

We are collecting data via a Data Set/Data Entry screen for data elements which are categorized by 2 genders and 8 age groups. Three of the age categorizations for both genders are collecting the data via the data entry screen properly but are showing up as blanks when included in a pivot table. (The other 5 age groups for both genders are reporting properly in the same pivot table.)

In looking at the data on the backend and querying the category option combinations, resource tables and analytics tables I see that there are multiple instances of many of the gender/age group categories. (For example, there are 4 (Female, 0-1 years) category option combos.) The data set and data entry screen are collecting the data properly but a no-longer used version of the category option combo is being pulled into the analytics table/pivot table for 3 of the 8 age groupings.

There is no error in the log when running Analytics.

The Data Set Report appears to display the proper data per the data entry screen (i.e., it does not mimic the incomplete Pivot Table report.)

Is there a way to realign the category options so that what is used in the data entry screen is what flows through to the analytics table? Or is there a later build that corrects this problem?

Thank you.

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Regards,
Bharath Kumar. Ch

Hi Laura,

sounds like it is a mismatch between the category combo you are using for those data elements and the category option combos which exist in the custom data entry forms.

A problem sometimes is that one changes the category combo (adding categories, removing options, etc) but does not update the custom data entry forms - the forms are not automatically updated since the UIDs are coded into the HTML forms themselves.

This will require some manual work with the db. I suggest that you look at the Web API for the category combos to see which option combos are part of it, e.g.:

https://play.dhis2.org/demo/api/categoryCombos/m2jTvAj5kkm.json

Then you should probably map the data values from the old option combos to the new ones.

Note that it is a bit hard to diagnose this without looking at the db itself.

best regards,

Lars

···

On Fri, Jan 8, 2016 at 7:01 AM, Laura E. Lincks laura.lincks@icap.columbia.edu wrote:

Thanks, Bharath. I did try that. It didn’t change anything.

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132

On Fri, Jan 8, 2016 at 12:55 AM, Bharath chbharathk@gmail.com wrote:

You may try Update category option combinations from Apps → Data Administration → Maintenance

Please have the backup before doing this or try it in local machine first.

On Fri, Jan 8, 2016 at 11:09 AM, Laura E. Lincks laura.lincks@icap.columbia.edu wrote:

DHIS version 2.19

Build 19144

We have an urgent issue which needs correction as soon as possible (we have a reporting deadline of Monday, 11 January.):

We are collecting data via a Data Set/Data Entry screen for data elements which are categorized by 2 genders and 8 age groups. Three of the age categorizations for both genders are collecting the data via the data entry screen properly but are showing up as blanks when included in a pivot table. (The other 5 age groups for both genders are reporting properly in the same pivot table.)

In looking at the data on the backend and querying the category option combinations, resource tables and analytics tables I see that there are multiple instances of many of the gender/age group categories. (For example, there are 4 (Female, 0-1 years) category option combos.) The data set and data entry screen are collecting the data properly but a no-longer used version of the category option combo is being pulled into the analytics table/pivot table for 3 of the 8 age groupings.

There is no error in the log when running Analytics.

The Data Set Report appears to display the proper data per the data entry screen (i.e., it does not mimic the incomplete Pivot Table report.)

Is there a way to realign the category options so that what is used in the data entry screen is what flows through to the analytics table? Or is there a later build that corrects this problem?

Thank you.

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Regards,
Bharath Kumar. Ch

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org