Event Analytics Data Mismatch

Hello everyone,
We are currently running DHIS2 2.39.1.2

We created a survey in DHIS2 using an event program. The users used the Capture app to collect the data. Most of the fields are drop-down menus created using option sets. We are done with data collection and now cleaning.
On Monday 24th July, we noticed that there appeared to be some crosslinking/mismatch of the data in the columns using both the line listing app and the event reports app


Figure 1

We have cleared the analytics table several times over the past few days and regenerated it but it is still the same.

image
The image above is from the record where it shows a strongly disagree.

Here is a screenshot of the data entry form for that section

Last weekend we tried to upgrade to the latest version of 2.39 but it’s been having errors. A rollback was done using a backed-up version of the database.

Could anybody please provide us some insight into what could be going on and how to fix it?

Thank you.

Ifeanyi

@dhis2-analytics @dhis2-backend

2 Likes

Hi @ifeanyiokoye

Thanks for reporting this. We need to understand several things here. First, if the information is stored correctly but only during the display of these tables the mismatch starts to occur or not? To check for this, it might be easier to check the API, could you please open the Network tab (F12 → Network) and then display the table. See the network request that’s being sent to retrieve the info for the table, it will probably be in JSON, do you see the mismatch in the API as well?

If you don’t see a mismatch in the API request then this might be a bug in the app, but if you see a mismatch then we need to check again during the data entry.

Second, to check that the issue is not during the data entry, go to the capture app and enter the data, but before submitting the data please open the network tab again then submit the data. Check for the request where the data is being sent. Do you see a mismatch there?

If there is no mismatch during the data entry and when checking the API then it might be from the app.

What version of the app are you using? Additionally, to be sure if there isn’t something else, during the generation of analytics, do you see any errors in the Catalina.out log?

I hope these tips help us figure out what’s the real issue and find a solution. Thank you!

Please what version of the Data Capture app are you using? Is the mismatch in the Data Visuzalizer?

Thank you @Gassim. This is duly noted and we will get back to you.

1 Like

Hi @ifeanyiokoye

I hope you’ve found my response above helpful. Were you able to find more information or solve the issue? Please share an update if you have.

Thank you!

@Gassim Yes I did. However, I needed the expertise of some of my colleagues to perform some of the tests and they are currently not available.

Here is the interesting thing: we upgraded a test instance to 2.40 and we restored the database to it.

I tried to pull the survey data from the Line listing app and got the same mismatched data. However, I am able to pull the correctly formatted data using the event reports app. There are a few challenges with using the event reports app though:

  1. I can’t pull all the data elements (70+) at once. I have to pull data elements in batches. Even with that, I cannot pull more than a certain number of data elements too.

  1. The CSV download only pulls the first 100 records (I thought this had been fixed) but the XLS version pulls everything.
  2. This option does not work either
    image

Whenever I try to use it, I get the error in the console: