DHIS2 2.37 - Cannot see data in Data Visualizer

[nuttapol]

@Gassim

You might want to clear the browser cache first by using the Browser Cache Cleaner app, and it is necessary that the user you are using has the “Data output and analytic” authority to that OU. Please check the user’s settings in the user app.

I finish this steps.

@Gassim

If you still can’t see the data, please take a screenshot if there’s an error. Open your browser’s developer tools F12 → Select Network tab → if there is a red text, click on it → Screenshot .

Buy I cannot see any error, it show nothing in Data Visualizer app when I select data elements, OU and periods.

Thanks.

[Norah_Stoops]

Hi,
This may not be the case, but remember that data only appears in the visualizer/elsewhere AFTER the analytics table is run, and that is usually at midnight each evening.
You cannot see data in reports or visualizer immediately.
Norah

[nuttapol]

Hi,

May I review my steps, I can see the ’ 2022-02-16 10:32:26 Process failed: Exception during execution’ at the end of execution, where to check what is the error.

In Data Entry app, I select OU, Data Set, Period and enter some data, click Complete

Click here to see error log

In Data Administration app, click Analytics tables update, uncheck all ‘Skip*’ checkboxes, click ‘Start export’

2022-02-16 10:32:19 Analytics table update process started
2022-02-16 10:32:19 Updating resource tables
2022-02-16 10:32:26 Updating tables: DATA_VALUE
2022-02-16 10:32:26 Performing pre-create table work
2022-02-16 10:32:26 Dropping temp tables
2022-02-16 10:32:26 Creating analytics tables
2022-02-16 10:32:26 Populating analytics tables
2022-02-16 10:32:26 Process failed: Exception during execution

Thank you very much.

[Gassim (AL-Gassim Sharaf Addin)]

Thanks @Norah_Stoops!

@nuttapol, would you please take a screenshot of the error log that appear in the Network tab. Before clicking on the button ‘Start Export’ open your browser’s developer tools’ (F12 → Click on Network → For every red line, click on it and then take a screenshot.) We might also even need the Catalina.out log (without the sensitive info) to understand the issue.

Thank you!

[nuttapol]

Thanks @Norah_Stoops!

Hi @Gassim,

I can see this error attached:

Catalina.out log is located in tomcat\logs folder, filename is catalina-yyyy-mm-dd.log, is that correct?

Thank you.

[Gassim (AL-Gassim Sharaf Addin)]

Hi
@nuttapol , yes for that issue we need the Catalina.out log, thanks!

@nuttapol

Catalina.out log is located in tomcat\logs folder, filename is catalina-yyyy-mm-dd.log, is that correct?

From Installation docs:

To monitor the behavior of Tomcat the log is the primary source of information. The log can be viewed with the following command:
tail -f tomcat-dhis/logs/catalina.out

It is the file with the extension .out

You’re welcome! (:

[nuttapol]

Hi @Gassim,

Please kindly find part of the catalina.out yesterday (2022-02-17)

catalina.out.2022-02-17.doc (143.7 KB)

It shown about user expiry date and sql grammar error.

Please advise.

Thank you!

[Gassim (AL-Gassim Sharaf Addin)]

Hi @nuttapol,

Thank you for sharing this info! For the SQL error, it has to do with this bug: DHIS2-12210 | Large continuous analytics temporary tables fill the disk space OR this one: DHIS2-12277 | DHIS2 Can’t finish the analytic in version 2.37.1

What release of version dhis2 2.37 are you using? You might be required to update to the latest release

DHIS2 Can't finish the analytic in version 2.37.1

It is a bug. It most likely affects all versions, but only when data element aggregation levels are present. See: [TECH-899] - Jira. The fix is on the way, PR will be ready today. There is no relation to [DHIS2-12210] - Jira

For now, it might help if you have access to the database to drop the table causing this issue and then run analytics tables again:
DROP TABLE analytics_temp_2021;

[nuttapol]

Hi @Gassim

I test in another computer, DHIS2 version 2.36.6, enter some data.

Note: 2564 and 2565 displayed as year in Thai (I don’t know why not display 2021 and 2022) but in database is 2021 and 2022.

Data Administration > Analytics tables management, click START EXPORT, looks like no error.

When I open the Pivot Table, select data, period (last 12 months), and organization unit, I see no data.

Could I have your advice please if I do something wrong or need any additional action.

Thank you very much.

[Gassim (AL-Gassim Sharaf Addin)]

@nuttapol

pic-1849×771 56.3 KB

Thanks for sharing this! For this one would you like to create a jira bug issue in jira.dhis2.org? (I can create one on your behalf if you want.)

@nuttapol

When I open the Pivot Table, select data, period (last 12 months), and organization unit, I see no data.

Okay, thanks! Are you able to see any error in the Network tab after you click Update? Please open the Network tab then click update and if you see any error there, please take a screenshot.

Thank you again!

[Gassim (AL-Gassim Sharaf Addin)]

@nuttapol

Created a Jira Issue for this one: DHIS2-12701 | In Thai calendar: Period not showing properly

@nuttapol

When I open the Pivot Table, select data, period (last 12 months), and organization unit, I see no data.

It would help a lot if you take a screenshot of the Network tab after you click Update. Thank you!

@Gassim

Open your browser’s developer tools F12 → Select Network tab → if there is a red text, click on it → Screenshot

[nuttapol]

Hi @Gassim

Please kindly find attached Network tab screenshot after click Update.

Thank you!

[Gassim (AL-Gassim Sharaf Addin)]

It’s interesting you can’t see any update, could you make sure of the following two settings:

1. The user you are using has ’ Data output and analytic organisation units’ approved for the OUs you are selecting (User Management app)
2. The metadata has sharing settings is at least ‘can view data’ for the user

@Gassim

drop the table causing this issue and then run analytics tables again:
DROP TABLE analytics_temp_2021;

I also want to ask if you tried this because you had an error in your Catalina.out log because of the analytics_temp_2021.

Thank you (:

[Gustarv (Gustav Nkya)]

@Gassim

tail -f tomcat-dhis/logs/catalina.out

Dear All,
i would like to know if the problem was solved by dropping tables on the database or what exactly was the solution to the problem of data not showing up on the event reports since i am facing that problem now and i dont know how to get rid of it.

form the catalina.out the error present itself if you want to see it i can provide screenshots.
i hope i will get help thanks.

[lismail (Layla Ismail)]

Hello,

I’d like to add that we’re also having a similar issue in 2.37.9; none of our event data is pulling through into event reports. I’ve checked the developer tools and it looks like this:

Can anyone help?!
Thanks
Layla

[Gassim (AL-Gassim Sharaf Addin)]

Thanks @Gustarv and @lismail!

Sorry the solution has not been shared but you can help with finding the solution for your case as well! Please check the Catalina.out log and share it (without any sensitive info). If you have an error with analytics_temp then it’s probably a good idea to drop that table. In the case above, it was analytics_temp_2021.

@Gassim

1. The user you are using has ’ Data output and analytic organisation units’ approved for the OUs you are selecting (User Management app)
2. The metadata has sharing settings is at least ‘can view data’ for the user

@Gassim

drop the table causing this issue and then run analytics tables again:
DROP TABLE analytics_temp_2021;

I also want to ask if you tried this because you had an error in your Catalina.out log because of the analytics_temp_2021.

Please test the suggestions and then clear the server cache (Data Administration → Maintenance → Clear Application cache, Reload apps) and the browser cache (Browser Cache Cleaner app) then best to test in incognito mode (or Guest mode).

If you still see an issue, it will help to check the Network tab as in the screenshot share by @lismail above but make sure open tab is Network not Elements. After the tab is open, select Update and then take a screenshot.

Looking forward to your responses.

Thank you!

[lismail (Layla Ismail)]

Thank you @Gassim - I’ve checked user and sharing settings, cleared all the caches and tried again- see the screenshot below:

I can’t figure this out! All seems to be working ok in our production server, it’s only our training server (which was recently upgraded to 2.37.9) that seems to have this issue…

Thanks again
Layla

[Gassim (AL-Gassim Sharaf Addin)]

Please what’s the undefined.json request (could you click on it and check the Headers, requests, and
response?)

It could help please if you share the full Catalina.out log (without sensitive info) if you find any errors there too.

Thanks!

[lismail (Layla Ismail)]

hi, I hope this is what you meant for the ‘undefined’:

• Headers:
  

• Request headers:

1. authority:
   train.wanda.aidsalliance.org
2. :method:
   GET
3. :path:
   /api/29/dataStatistics/favorites/undefined.json?_dc=1674470398734
4. :scheme:
   https
5. accept:
   6./*
6. accept-encoding:
   gzip, deflate, br
7. accept-language:
   en-US,en;q=0.9
8. cookie:
   JSESSIONID=C549611355C302BCE23FFC3747435D3D
9. referer:
   Frontline AIDS
10. sec-ch-ua:
    “Not_A Brand”;v=“99”, “Google Chrome”;v=“109”, “Chromium”;v=“109”
11. sec-ch-ua-mobile:
    ?0
12. sec-ch-ua-platform:
    “Windows”
13. sec-fetch-dest:
    empty
14. sec-fetch-mode:
    cors
15. sec-fetch-site:
    same-origin
16. user-agent:
    Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36
17. x-requested-with:
    XMLHttpRequest

• Response headers:

1. content-length:
   11
2. content-type:
   application/json;charset=UTF-8
3. date:
   Mon, 23 Jan 2023 10:39:58 GMT
4. etag:
   “0c51f55abefe4d61bbb60057418aedf72”
5. server:
   nginx
6. strict-transport-security:
   max-age=31536000 ; includeSubDomains
7. strict-transport-security:
   max-age=31536000; includeSubdomains;
8. x-content-type-options:
   nosniff
9. x-frame-options:
   SAMEORIGIN
10. x-frame-options:
    DENY
11. x-xss-protection:
    1; mode=block

• Response:
  
  
  
  Note: there now seem to be a couple of errors at the bottom relating to cookies…

I’m afraid I don’t know how to share the full Catalina.out log (unfortunately I’m not a developer!) but if it’s easy to walk me through how to do it then I’ll give it a shot

Thanks
Layla