Data Loss

Support - Assistance technique
1

Dear All,
We are having a serious issues on our online server in Sierra Leone.
Data are normally entered but during analysis these data normally got
missing. This had been an issue i had raised before but the situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

···

--
Regards,

Gerald

2

I think it is the same problem I faced previously and I would like to share my experience. What I found was that the aggregation level of each data element was higher the organization unit level of data entry. So we chose the lowest organization unit level at " aggregation level of each data element", then the data appeared in analysis.

···

On Fri, Aug 21, 2015 at 3:03 AM, gerald thomas gerald17006@gmail.com wrote:

Dear All,

We are having a serious issues on our online server in Sierra Leone.

Data are normally entered but during analysis these data normally got

missing. This had been an issue i had raised before but the situation

is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra

Leone and any help will be appreciated till we overcome this

situation.

Please help us!!!

–

Regards,

Gerald

Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

–

Dr. Lwin Lwin Aung

Health Information Division

Department of Public Health

Office No.(47), Nay Pyi Taw

3

Hi Gerald,
Please ensure that the check box “hide unapproved data in analytics” under system settngs>>approval settings is not checked.

rgds

David

···

2015-08-20 23:33 GMT+03:00 gerald thomas gerald17006@gmail.com:

Dear All,

We are having a serious issues on our online server in Sierra Leone.

Data are normally entered but during analysis these data normally got

missing. This had been an issue i had raised before but the situation

is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra

Leone and any help will be appreciated till we overcome this

situation.

Please help us!!!

–

Regards,

Gerald

Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

4

Dear all,

Our data analysis was configured to run automatically at night but I will try to do it manually and see whether I am having the same problem.

In reality, immediately they enter data for HF1 information and go to HF2; when they complete HF2 and check HF1 again their information will be missing.

Regards,

Gerald

···

2015-08-20 23:33 GMT+03:00 gerald thomas gerald17006@gmail.com:

Dear All,

We are having a serious issues on our online server in Sierra Leone.

Data are normally entered but during analysis these data normally got

missing. This had been an issue i had raised before but the situation

is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra

Leone and any help will be appreciated till we overcome this

situation.

Please help us!!!

–

Regards,

Gerald

Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

5

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate

···

----------+--------------+------------+------------
  1121694 | 6 | 2016-01-01 | 2016-12-31
  2058605 | 3 | 2015-11-01 | 2015-11-30
  2058606 | 3 | 2015-12-01 | 2015-12-31
  2058607 | 3 | 2015-10-01 | 2015-10-31
  2058611 | 1 | 2015-01-16 | 2015-01-16
  2058619 | 1 | 2015-01-26 | 2015-01-26
  2058631 | 1 | 2015-01-29 | 2015-01-29
  2058632 | 3 | 2015-09-01 | 2015-09-30
  2058656 | 3 | 2015-02-01 | 2015-02-28
  2058727 | 3 | 2015-06-01 | 2015-06-30
  2058806 | 3 | 2015-07-01 | 2015-07-31
  2058811 | 2 | 2015-03-02 | 2015-03-08
  2058812 | 3 | 2015-03-01 | 2015-03-31
  2058814 | 3 | 2015-05-01 | 2015-05-31
  2065151 | 6 | 2020-01-01 | 2020-12-31
  2072304 | 3 | 2015-04-01 | 2015-04-30
  2109802 | 4 | 2015-04-01 | 2015-06-30
  2115342 | 3 | 2015-08-01 | 2015-08-31
  2122928 | 292091 | 2015-03-01 | 2015-04-30
  2129098 | 2 | 2015-05-25 | 2015-05-31
  2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out there help me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear All,
We are having a serious issues on our online server in Sierra Leone.
Data are normally entered but during analysis these data normally got
missing. This had been an issue i had raised before but the situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

6

Hello Gerald
Are you using custom forms for data entry?

JM

···

El 22/08/2015, a las 15:37, gerald thomas gerald17006@gmail.com escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > ‘2015-01-01’;
periodid | periodtypeid | startdate | enddate
----------±-------------±-----------±-----------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out there help me.
Please !!!

On 8/20/15, gerald thomas gerald17006@gmail.com wrote:

Dear All,
We are having a serious issues on our online server in Sierra Leone.
Data are normally entered but during analysis these data normally got
missing. This had been an issue i had raised before but the situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!

–
Regards,

Gerald

–
Regards,

Gerald

Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

7

Juan,

Thanks for your response but we are not using custom forms for data entry.

Regards,

Gerald

···

On Aug 23, 2015 4:29 PM, “Juan Manuel Alcantara Acosta” jmalcantara1@gmail.com wrote:

Hello Gerald
Are you using custom forms for data entry?

JM

El 22/08/2015, a las 15:37, gerald thomas gerald17006@gmail.com escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > ‘2015-01-01’;
periodid | periodtypeid | startdate | enddate
----------±-------------±-----------±-----------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out there help me.
Please !!!

On 8/20/15, gerald thomas gerald17006@gmail.com wrote:

Dear All,
We are having a serious issues on our online server in Sierra Leone.
Data are normally entered but during analysis these data normally got
missing. This had been an issue i had raised before but the situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!

–
Regards,

Gerald

–
Regards,

Gerald

Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

8

Hi Gerald,

Are you sure that the user permissions for the capturing role are correct? Do you have the same problem with data loss if you capture with superuser role with ALL permissions allocated?

Elmarie

···

On 23 Aug 2015 6:36 PM, “gerald thomas” gerald17006@gmail.com wrote:

Juan,

Thanks for your response but we are not using custom forms for data entry.

Regards,

Gerald

On Aug 23, 2015 4:29 PM, “Juan Manuel Alcantara Acosta” jmalcantara1@gmail.com wrote:

Hello Gerald
Are you using custom forms for data entry?

JM

El 22/08/2015, a las 15:37, gerald thomas gerald17006@gmail.com escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > ‘2015-01-01’;
periodid | periodtypeid | startdate | enddate
----------±-------------±-----------±-----------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out there help me.
Please !!!

On 8/20/15, gerald thomas gerald17006@gmail.com wrote:

Dear All,
We are having a serious issues on our online server in Sierra Leone.
Data are normally entered but during analysis these data normally got
missing. This had been an issue i had raised before but the situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!

–
Regards,

Gerald

–
Regards,

Gerald

Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

This message and any attachments are subject to a disclaimer published at http://www.hisp.org/policies.html#comms_disclaimer. Please read the disclaimer before opening any attachment or taking any other action in terms of this electronic transmission. If you cannot access the disclaimer, kindly send an email to disclaimer@hisp.org and a copy will be provided to you. By replying to this e-mail or opening any attachment you agree to be bound by the provisions of the disclaimer.

9

Hi Gerald,
Could you please just clarify what exactly your question is?

  1. You have provided a list from you period table. When data is captured or imported into DHIS2 and a period does not exist, then an entry is created in the period table. The period table does not contain data, only periods associated with data that has been captured. Are you concerned because periods exist with future dates?

  2. The data is stored in the datavalue table if you are capturing aggregated data. You mention data loss? Has data been captured and you have verified that the data actually is stored in the datavalue table and then afterwards the data disappears when you do analysis? Or does it appear as if the data is physically captured but then never gets stored in the datavalue table?

  3. The periodtypeid of 292091 is really odd - is it a custom period that you inserted into the period table yourself?

I would suggest (based on the limited knowledge of what is going on at your site) that you follow the whole process and verify each step: Verify the data is captured correctly and completely and saved. Then verify that that specific piece of data exists in the datavalue table with the right dataelement, period and org unit. If the data gets lost between the data entry and the datavalue table, then there is a problem with the completion of the data capture transaction. If data does land up in the datavalue table, but subsequently disappears, then there might be a batch job running that “cleans out” your datavalue table, but that is most unlikely. If you can’t see your data on the reporting side even though the data exists in the datavalue table, then the issue is with the reporting side where you need to specify the correct dataelements, periods and org units to see the data.

And this is as much input as I can give with the information you have provided.

Regards

Regards

Ant Snyman

This message and any attachments are subject to a disclaimer published at http://www.hisp.org/policies.html#comms_disclaimer. Please read the disclaimer before opening any attachment or taking any other action in terms of this electronic transmission. If you cannot access the disclaimer, kindly send an email to disclaimer@hisp.org and a copy will be provided to you. By replying to this e-mail or opening any attachment you agree to be bound by the provisions of the disclaimer.

image

···

On 23 August 2015 at 18:36, gerald thomas gerald17006@gmail.com wrote:

Juan,

Thanks for your response but we are not using custom forms for data entry.

Regards,

Gerald

On Aug 23, 2015 4:29 PM, “Juan Manuel Alcantara Acosta” jmalcantara1@gmail.com wrote:

Hello Gerald
Are you using custom forms for data entry?

JM

El 22/08/2015, a las 15:37, gerald thomas gerald17006@gmail.com escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > ‘2015-01-01’;
periodid | periodtypeid | startdate | enddate
----------±-------------±-----------±-----------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out there help me.
Please !!!

On 8/20/15, gerald thomas gerald17006@gmail.com wrote:

Dear All,
We are having a serious issues on our online server in Sierra Leone.
Data are normally entered but during analysis these data normally got
missing. This had been an issue i had raised before but the situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!

–
Regards,

Gerald

–
Regards,

Gerald

Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : https://help.launchpad.net/ListHelp

Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

–

Ant Snyman

Cell: 0824910449

Landline: 028 2713242

Health Information Systems Program - SA

10

Dear All,
Thanks for all your responses.
Please find the attached forms in excel which will make my explanation
much easier.
Data loss normally occur on HF1 & HF8 and it is on a particular
sections of these forms.
The said sections of these forms had been highlighted in yellow.

Once data had been entered and submitted by clicking "complete"; If
analysis is done after or the next day those highlighted sections will
remain blank.

Ant,
1. Before i was worried about those future dates but with your
explanation i am not too worried. But is there anyway we can stop it.
2. I am sure i had explained much better my scenario above and if you
have any further question i will be ready to answer and give you
update.

3. For this question i am not sure we have any custom period and i
can't really explain this "periodtypeid of 292091"

4. With reference to batch process, we only have data analytic which
runs at a certain period at night.

Thanks in advance for your usual cooperation.

blank hmis forms.xls (141 KB)

···

On 8/23/15, Ant Snyman <ant@hisp.org> wrote:

Hi Gerald,
Could you please just clarify what exactly your question is?
1. You have provided a list from you period table. When data is captured or
imported into DHIS2 and a period does not exist, then an entry is created
in the period table. The period table does not contain data, only periods
associated with data that has been captured. Are you concerned because
periods exist with future dates?
2. The data is stored in the datavalue table if you are capturing
aggregated data. You mention data loss? Has data been captured and you have
verified that the data actually is stored in the datavalue table and then
afterwards the data disappears when you do analysis? Or does it appear as
if the data is physically captured but then never gets stored in the
datavalue table?
3. The periodtypeid of 292091 is really odd - is it a custom period that
you inserted into the period table yourself?

I would suggest (based on the limited knowledge of what is going on at your
site) that you follow the whole process and verify each step: Verify the
data is captured correctly and completely and saved. Then verify that that
specific piece of data exists in the datavalue table with the right
dataelement, period and org unit. If the data gets lost between the data
entry and the datavalue table, then there is a problem with the completion
of the data capture transaction. If data does land up in the datavalue
table, but subsequently disappears, then there might be a batch job running
that "cleans out" your datavalue table, but that is most unlikely. If you
can't see your data on the reporting side even though the data exists in
the datavalue table, then the issue is with the reporting side where you
need to specify the correct dataelements, periods and org units to see the
data.

And this is as much input as I can give with the information you have
provided.

Regards

Regards
Ant Snyman

On 23 August 2015 at 18:36, gerald thomas <gerald17006@gmail.com> wrote:

Juan,
Thanks for your response but we are not using custom forms for data
entry.

Regards,
Gerald
On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta" < >> jmalcantara1@gmail.com> wrote:

Hello Gerald
Are you using custom forms for data entry?
JM
El 22/08/2015, a las 15:37, gerald thomas <gerald17006@gmail.com> >>> escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out there help
me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear All,
We are having a serious issues on our online server in Sierra Leone.
Data are normally entered but during analysis these data normally got
missing. This had been an issue i had raised before but the situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

--

*Ant Snyman*

*Cell: 0824910449*

*Landline: 028 2713242*

Health Information Systems Program - SA

--

*This message and any attachments are subject to a disclaimer published at
Home - HISP-SA
<Home - HISP-SA. Please read the
disclaimer before opening any attachment or taking any other action in
terms of this electronic transmission. If you cannot access the
disclaimer, kindly send an email to disclaimer@hisp.org
<disclaimer@hisp.org> and a copy will be provided to you. By replying to
this e-mail or opening any attachment you agree to be bound by the
provisions of the disclaimer.*

--
Regards,

Gerald

11

Hi Gerald,
Did you recently edit the affected data elements? Can you view the data in the data entry screen?

If yes - can you also check sharing settings on these data elements?

···

On Sun, Aug 23, 2015 at 9:10 PM, gerald thomas gerald17006@gmail.com wrote:

Dear All,

Thanks for all your responses.

Please find the attached forms in excel which will make my explanation

much easier.

Data loss normally occur on HF1 & HF8 and it is on a particular

sections of these forms.

The said sections of these forms had been highlighted in yellow.

Once data had been entered and submitted by clicking “complete”; If

analysis is done after or the next day those highlighted sections will

remain blank.

Ant,

  1. Before i was worried about those future dates but with your

explanation i am not too worried. But is there anyway we can stop it.

  1. I am sure i had explained much better my scenario above and if you

have any further question i will be ready to answer and give you

update.

  1. For this question i am not sure we have any custom period and i

can’t really explain this “periodtypeid of 292091”

  1. With reference to batch process, we only have data analytic which

runs at a certain period at night.

Thanks in advance for your usual cooperation.

On 8/23/15, Ant Snyman ant@hisp.org wrote:

Hi Gerald,

Could you please just clarify what exactly your question is?

  1. You have provided a list from you period table. When data is captured or

imported into DHIS2 and a period does not exist, then an entry is created

in the period table. The period table does not contain data, only periods

associated with data that has been captured. Are you concerned because

periods exist with future dates?

  1. The data is stored in the datavalue table if you are capturing

aggregated data. You mention data loss? Has data been captured and you have

verified that the data actually is stored in the datavalue table and then

afterwards the data disappears when you do analysis? Or does it appear as

if the data is physically captured but then never gets stored in the

datavalue table?

  1. The periodtypeid of 292091 is really odd - is it a custom period that

you inserted into the period table yourself?

I would suggest (based on the limited knowledge of what is going on at your

site) that you follow the whole process and verify each step: Verify the

data is captured correctly and completely and saved. Then verify that that

specific piece of data exists in the datavalue table with the right

dataelement, period and org unit. If the data gets lost between the data

entry and the datavalue table, then there is a problem with the completion

of the data capture transaction. If data does land up in the datavalue

table, but subsequently disappears, then there might be a batch job running

that “cleans out” your datavalue table, but that is most unlikely. If you

can’t see your data on the reporting side even though the data exists in

the datavalue table, then the issue is with the reporting side where you

need to specify the correct dataelements, periods and org units to see the

data.

And this is as much input as I can give with the information you have

provided.

Regards

Regards

Ant Snyman

On 23 August 2015 at 18:36, gerald thomas gerald17006@gmail.com wrote:

Juan,

Thanks for your response but we are not using custom forms for data

entry.

Regards,

Gerald

On Aug 23, 2015 4:29 PM, “Juan Manuel Alcantara Acosta” <

jmalcantara1@gmail.com> wrote:

Hello Gerald

Are you using custom forms for data entry?

JM

El 22/08/2015, a las 15:37, gerald thomas gerald17006@gmail.com

escribió:

Dear dhis2-users,

If someone cannot help me; can anyone explain why am i having data for

October, November, December 2015 on my database?

dhis=# select * from period where startdate > ‘2015-01-01’;

periodid | periodtypeid | startdate | enddate

----------±-------------±-----------±-----------

1121694 | 6 | 2016-01-01 | 2016-12-31

2058605 | 3 | 2015-11-01 | 2015-11-30

2058606 | 3 | 2015-12-01 | 2015-12-31

2058607 | 3 | 2015-10-01 | 2015-10-31

2058611 | 1 | 2015-01-16 | 2015-01-16

2058619 | 1 | 2015-01-26 | 2015-01-26

2058631 | 1 | 2015-01-29 | 2015-01-29

2058632 | 3 | 2015-09-01 | 2015-09-30

2058656 | 3 | 2015-02-01 | 2015-02-28

2058727 | 3 | 2015-06-01 | 2015-06-30

2058806 | 3 | 2015-07-01 | 2015-07-31

2058811 | 2 | 2015-03-02 | 2015-03-08

2058812 | 3 | 2015-03-01 | 2015-03-31

2058814 | 3 | 2015-05-01 | 2015-05-31

2065151 | 6 | 2020-01-01 | 2020-12-31

2072304 | 3 | 2015-04-01 | 2015-04-30

2109802 | 4 | 2015-04-01 | 2015-06-30

2115342 | 3 | 2015-08-01 | 2015-08-31

2122928 | 292091 | 2015-03-01 | 2015-04-30

2129098 | 2 | 2015-05-25 | 2015-05-31

2129099 | 1 | 2015-12-31 | 2015-12-31

Please we need to fix this issue of data loss; can anyone out there help

me.

Please !!!

On 8/20/15, gerald thomas gerald17006@gmail.com wrote:

Dear All,

We are having a serious issues on our online server in Sierra Leone.

Data are normally entered but during analysis these data normally got

missing. This had been an issue i had raised before but the situation

is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra

Leone and any help will be appreciated till we overcome this

situation.

Please help us!!!

–

Regards,

Gerald

–

Regards,

Gerald

Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

–

Ant Snyman

Cell: 0824910449

Landline: 028 2713242

Health Information Systems Program - SA

–

*This message and any attachments are subject to a disclaimer published at

http://www.hisp.org/policies.html#comms_disclaimer

<http://www.hisp.org/policies.html#comms_disclaimer>. Please read the

disclaimer before opening any attachment or taking any other action in

terms of this electronic transmission. If you cannot access the

disclaimer, kindly send an email to disclaimer@hisp.org

disclaimer@hisp.org and a copy will be provided to you. By replying to

this e-mail or opening any attachment you agree to be bound by the

provisions of the disclaimer.*

–

Regards,

Gerald

Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

12

Dear Juan,
Under Maintenance column i am seeing the following:

Clear analytics tables

Clear data mart

Rebuild data mart index

Clear zero values

Clear data set completeness

Prune periods

Remove expired invitations

Drop SQL views

Create SQL views

Update category option combinations

What should I check for the performance maintenance before doing the
query again?

···

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
No!!! This is the holistic data from that query. Previously i only had
the first part of the result. Do you want me to rebuild tables and run
query again?

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Hello Gerald
This looks much different than the fist one you sent me and it's still
missing a lot of names, did you rebuild resource tables?
JM

El 24/08/2015, a las 05:44, gerald thomas <gerald17006@gmail.com> >> escribió:

Dear Juan,
Thanks for your responses.
Sorry i am only responding now but please find the attached category
combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Sorry, I got distracted and hit send before completing the message.

You should limit the query to show the values of the specific data
elements
that are giving you trouble, you'll need the uid of each of the data
element., In case you don't know how to get that information, you can
use
the api (your_server_URL/api/dataElements?paging=false) or look at the
information if each data element in data element management selecting
"show
details" from the contextual menu that appears when clocking on the
name
of
each data element. Then add to the query the list of UIDs just before
the
semicolon.

WHERE de.uid IN
('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')

Please excuse me if you already know all of these things, since I don't
have
a way to know how much you know about the system and postgres queries I
rather be detailed on what you have to do than leave you guessing.

In addition to running maintenance to update category option
combinations
you should re-generate resource tables, you'll find that in "Data
Administration" too.

Regards,
JM

El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta >>>> <jmalcantara1@gmail.com> escribió:

Hi Gerald
I see you are missing a few category option combo names, you should
run
the maintenance to "Update category option combinations", you'll find
this
in "Data Administration" -> "maintenance"
I also don't see the option combinations of the data elements you
highlighted in the excel you sent to the list. Which category
combination
are you using with those data elements? Run the query again after
doing
the maintenance.

<15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs

About the out of memory error, I recommend that you use pgAdmin3 and
try
to run the query again. You should limit the query to show you the
data

El 23/08/2015, a las 15:39, gerald thomas <gerald17006@gmail.com> >>>>> escribió:

Dear Juan,
For the datavalues query; i am getting "Out of memory" as result.
Please find the attached result for the combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>> wrote:

Hello Gerald
Does data disappear only from data elements that use the default
category
combination?
Since you are querying your database directly, I'm sending you here
a
couple
of queries you can use to verify the existing values of the database
and
the
category combinations. Check if you have more than one default
option
combination.

Regards,
JM

El 23/08/2015, a las 11:36, gerald thomas <gerald17006@gmail.com> >>>>>>> escribió:

Juan,
Thanks for your response but we are not using custom forms for data
entry.

Regards,
Gerald

On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta" >>>>>>>> <jmalcantara1@gmail.com> wrote:
Hello Gerald
Are you using custom forms for data entry?
JM
El 22/08/2015, a las 15:37, gerald thomas <gerald17006@gmail.com> >>>>>>>> escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data
for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out
there
help
me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear All,
We are having a serious issues on our online server in Sierra
Leone.
Data are normally entered but during analysis these data normally
got
missing. This had been an issue i had raised before but the
situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for
Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

--
Regards,

Gerald
<Combo_Query result.txt>

--
Regards,

Gerald
<categoryoptioncombon.txt>

--
Regards,

Gerald

--
Regards,

Gerald

13

Dear Juan,
Under Maintenance column i am seeing the following:

Clear analytics tables

Clear data mart

Rebuild data mart index

Clear zero values

Clear data set completeness

Prune periods

Remove expired invitations

Drop SQL views

Create SQL views

Update category option combinations

What should I check for the performance maintenance before doing the
query again?

Dear Juan,
No!!! This is the holistic data from that query. Previously i only had
the first part of the result. Do you want me to rebuild tables and run
query again?

Hello Gerald
This looks much different than the fist one you sent me and it's still
missing a lot of names, did you rebuild resource tables?
JM

Dear Juan,
Thanks for your responses.
Sorry i am only responding now but please find the attached category
combo query.

Sorry, I got distracted and hit send before completing the message.

You should limit the query to show the values of the specific data
elements
that are giving you trouble, you'll need the uid of each of the data
element., In case you don't know how to get that information, you can
use
the api (your_server_URL/api/dataElements?paging=false) or look at the
information if each data element in data element management selecting
"show
details" from the contextual menu that appears when clocking on the
name
of
each data element. Then add to the query the list of UIDs just before
the
semicolon.

WHERE de.uid IN
('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')

Please excuse me if you already know all of these things, since I don't
have
a way to know how much you know about the system and postgres queries I
rather be detailed on what you have to do than leave you guessing.

In addition to running maintenance to update category option
combinations
you should re-generate resource tables, you'll find that in "Data
Administration" too.

Regards,
JM

Hi Gerald
I see you are missing a few category option combo names, you should
run
the maintenance to "Update category option combinations", you'll find
this
in "Data Administration" -> "maintenance"
I also don't see the option combinations of the data elements you
highlighted in the excel you sent to the list. Which category
combination
are you using with those data elements? Run the query again after
doing
the maintenance.

<15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs

About the out of memory error, I recommend that you use pgAdmin3 and
try
to run the query again. You should limit the query to show you the
data

Dear Juan,
For the datavalues query; i am getting "Out of memory" as result.
Please find the attached result for the combo query.

Hello Gerald
Does data disappear only from data elements that use the default
category
combination?
Since you are querying your database directly, I'm sending you here
a
couple
of queries you can use to verify the existing values of the database
and
the
category combinations. Check if you have more than one default
option
combination.

Regards,
JM

Juan,
Thanks for your response but we are not using custom forms for data
entry.

Regards,
Gerald

Hello Gerald
Are you using custom forms for data entry?
JM

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data
for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out
there
help
me.
Please !!!!!!!!!!!!!!!

Dear All,
We are having a serious issues on our online server in Sierra
Leone.
Data are normally entered but during analysis these data normally
got
missing. This had been an issue i had raised before but the
situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for
Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

--
Regards,

Gerald
<Combo_Query result.txt>

--
Regards,

Gerald
<categoryoptioncombon.txt>

--
Regards,

Gerald

--
Regards,

Gerald

···

El 24/08/2015, a las 08:00, gerald thomas <gerald17006@gmail.com> escribió:

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

El 24/08/2015, a las 05:44, gerald thomas <gerald17006@gmail.com> >>> escribió:

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta >>>>> <jmalcantara1@gmail.com> escribió:

El 23/08/2015, a las 15:39, gerald thomas <gerald17006@gmail.com> >>>>>> escribió:

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>>> wrote:

El 23/08/2015, a las 11:36, gerald thomas <gerald17006@gmail.com> >>>>>>>> escribió:

On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta" >>>>>>>>> <jmalcantara1@gmail.com> wrote:
El 22/08/2015, a las 15:37, gerald thomas <gerald17006@gmail.com> >>>>>>>>> escribió:

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

14

Select "Update category option combinations" and click on "perform maintenance". After that finished select from the menu of the left "Resource Table" and click on "Generate tables".
Regards,
JM

···

El 24/08/2015, a las 08:00, gerald thomas <gerald17006@gmail.com> escribió:

Dear Juan,
Under Maintenance column i am seeing the following:

Clear analytics tables

Clear data mart

Rebuild data mart index

Clear zero values

Clear data set completeness

Prune periods

Remove expired invitations

Drop SQL views

Create SQL views

Update category option combinations

What should I check for the performance maintenance before doing the
query again?

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
No!!! This is the holistic data from that query. Previously i only had
the first part of the result. Do you want me to rebuild tables and run
query again?

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Hello Gerald
This looks much different than the fist one you sent me and it's still
missing a lot of names, did you rebuild resource tables?
JM

El 24/08/2015, a las 05:44, gerald thomas <gerald17006@gmail.com> >>> escribió:

Dear Juan,
Thanks for your responses.
Sorry i am only responding now but please find the attached category
combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Sorry, I got distracted and hit send before completing the message.

You should limit the query to show the values of the specific data
elements
that are giving you trouble, you'll need the uid of each of the data
element., In case you don't know how to get that information, you can
use
the api (your_server_URL/api/dataElements?paging=false) or look at the
information if each data element in data element management selecting
"show
details" from the contextual menu that appears when clocking on the
name
of
each data element. Then add to the query the list of UIDs just before
the
semicolon.

WHERE de.uid IN
('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')

Please excuse me if you already know all of these things, since I don't
have
a way to know how much you know about the system and postgres queries I
rather be detailed on what you have to do than leave you guessing.

In addition to running maintenance to update category option
combinations
you should re-generate resource tables, you'll find that in "Data
Administration" too.

Regards,
JM

El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta >>>>> <jmalcantara1@gmail.com> escribió:

Hi Gerald
I see you are missing a few category option combo names, you should
run
the maintenance to "Update category option combinations", you'll find
this
in "Data Administration" -> "maintenance"
I also don't see the option combinations of the data elements you
highlighted in the excel you sent to the list. Which category
combination
are you using with those data elements? Run the query again after
doing
the maintenance.

<15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs

About the out of memory error, I recommend that you use pgAdmin3 and
try
to run the query again. You should limit the query to show you the
data

El 23/08/2015, a las 15:39, gerald thomas <gerald17006@gmail.com> >>>>>> escribió:

Dear Juan,
For the datavalues query; i am getting "Out of memory" as result.
Please find the attached result for the combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>>> wrote:

Hello Gerald
Does data disappear only from data elements that use the default
category
combination?
Since you are querying your database directly, I'm sending you here
a
couple
of queries you can use to verify the existing values of the database
and
the
category combinations. Check if you have more than one default
option
combination.

Regards,
JM

El 23/08/2015, a las 11:36, gerald thomas <gerald17006@gmail.com> >>>>>>>> escribió:

Juan,
Thanks for your response but we are not using custom forms for data
entry.

Regards,
Gerald

On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta" >>>>>>>>> <jmalcantara1@gmail.com> wrote:
Hello Gerald
Are you using custom forms for data entry?
JM
El 22/08/2015, a las 15:37, gerald thomas <gerald17006@gmail.com> >>>>>>>>> escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data
for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out
there
help
me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear All,
We are having a serious issues on our online server in Sierra
Leone.
Data are normally entered but during analysis these data normally
got
missing. This had been an issue i had raised before but the
situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for
Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

--
Regards,

Gerald
<Combo_Query result.txt>

--
Regards,

Gerald
<categoryoptioncombon.txt>

--
Regards,

Gerald

--
Regards,

Gerald

15

Dear Juan,
Noted!!! It is now generating resource table and i will keep you
posted once it had been completed

···

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Select "Update category option combinations" and click on "perform
maintenance". After that finished select from the menu of the left "Resource
Table" and click on "Generate tables".
Regards,
JM

El 24/08/2015, a las 08:00, gerald thomas <gerald17006@gmail.com> escribió:

Dear Juan,
Under Maintenance column i am seeing the following:

Clear analytics tables

Clear data mart

Rebuild data mart index

Clear zero values

Clear data set completeness

Prune periods

Remove expired invitations

Drop SQL views

Create SQL views

Update category option combinations

What should I check for the performance maintenance before doing the
query again?

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
No!!! This is the holistic data from that query. Previously i only had
the first part of the result. Do you want me to rebuild tables and run
query again?

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Hello Gerald
This looks much different than the fist one you sent me and it's still
missing a lot of names, did you rebuild resource tables?
JM

El 24/08/2015, a las 05:44, gerald thomas <gerald17006@gmail.com> >>>> escribió:

Dear Juan,
Thanks for your responses.
Sorry i am only responding now but please find the attached category
combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>> wrote:

Sorry, I got distracted and hit send before completing the message.

You should limit the query to show the values of the specific data
elements
that are giving you trouble, you'll need the uid of each of the data
element., In case you don't know how to get that information, you can
use
the api (your_server_URL/api/dataElements?paging=false) or look at
the
information if each data element in data element management selecting
"show
details" from the contextual menu that appears when clocking on the
name
of
each data element. Then add to the query the list of UIDs just before
the
semicolon.

WHERE de.uid IN
('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')

Please excuse me if you already know all of these things, since I
don't
have
a way to know how much you know about the system and postgres queries
I
rather be detailed on what you have to do than leave you guessing.

In addition to running maintenance to update category option
combinations
you should re-generate resource tables, you'll find that in "Data
Administration" too.

Regards,
JM

El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta >>>>>> <jmalcantara1@gmail.com> escribió:

Hi Gerald
I see you are missing a few category option combo names, you should
run
the maintenance to "Update category option combinations", you'll
find
this
in "Data Administration" -> "maintenance"
I also don't see the option combinations of the data elements you
highlighted in the excel you sent to the list. Which category
combination
are you using with those data elements? Run the query again after
doing
the maintenance.

<15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs

About the out of memory error, I recommend that you use pgAdmin3 and
try
to run the query again. You should limit the query to show you the
data

El 23/08/2015, a las 15:39, gerald thomas <gerald17006@gmail.com> >>>>>>> escribió:

Dear Juan,
For the datavalues query; i am getting "Out of memory" as result.
Please find the attached result for the combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>>>> wrote:

Hello Gerald
Does data disappear only from data elements that use the default
category
combination?
Since you are querying your database directly, I'm sending you
here
a
couple
of queries you can use to verify the existing values of the
database
and
the
category combinations. Check if you have more than one default
option
combination.

Regards,
JM

El 23/08/2015, a las 11:36, gerald thomas <gerald17006@gmail.com> >>>>>>>>> escribió:

Juan,
Thanks for your response but we are not using custom forms for
data
entry.

Regards,
Gerald

On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta" >>>>>>>>>> <jmalcantara1@gmail.com> wrote:
Hello Gerald
Are you using custom forms for data entry?
JM
El 22/08/2015, a las 15:37, gerald thomas <gerald17006@gmail.com> >>>>>>>>>> escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having
data
for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out
there
help
me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear All,
We are having a serious issues on our online server in Sierra
Leone.
Data are normally entered but during analysis these data
normally
got
missing. This had been an issue i had raised before but the
situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for
Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

--
Regards,

Gerald
<Combo_Query result.txt>

--
Regards,

Gerald
<categoryoptioncombon.txt>

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald

16

Dear Juan,
Please find the attached updated combo query.

New_categoryoptioncombon.txt (49.7 KB)

···

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
Noted!!! It is now generating resource table and i will keep you
posted once it had been completed

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Select "Update category option combinations" and click on "perform
maintenance". After that finished select from the menu of the left
"Resource
Table" and click on "Generate tables".
Regards,
JM

El 24/08/2015, a las 08:00, gerald thomas <gerald17006@gmail.com> >> escribió:

Dear Juan,
Under Maintenance column i am seeing the following:

Clear analytics tables

Clear data mart

Rebuild data mart index

Clear zero values

Clear data set completeness

Prune periods

Remove expired invitations

Drop SQL views

Create SQL views

Update category option combinations

What should I check for the performance maintenance before doing the
query again?

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
No!!! This is the holistic data from that query. Previously i only had
the first part of the result. Do you want me to rebuild tables and run
query again?

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>> wrote:

Hello Gerald
This looks much different than the fist one you sent me and it's still
missing a lot of names, did you rebuild resource tables?
JM

El 24/08/2015, a las 05:44, gerald thomas <gerald17006@gmail.com> >>>>> escribió:

Dear Juan,
Thanks for your responses.
Sorry i am only responding now but please find the attached category
combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>> wrote:

Sorry, I got distracted and hit send before completing the message.

You should limit the query to show the values of the specific data
elements
that are giving you trouble, you'll need the uid of each of the data
element., In case you don't know how to get that information, you
can
use
the api (your_server_URL/api/dataElements?paging=false) or look at
the
information if each data element in data element management
selecting
"show
details" from the contextual menu that appears when clocking on the
name
of
each data element. Then add to the query the list of UIDs just
before
the
semicolon.

WHERE de.uid IN
('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')

Please excuse me if you already know all of these things, since I
don't
have
a way to know how much you know about the system and postgres
queries
I
rather be detailed on what you have to do than leave you guessing.

In addition to running maintenance to update category option
combinations
you should re-generate resource tables, you'll find that in "Data
Administration" too.

Regards,
JM

El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta >>>>>>> <jmalcantara1@gmail.com> escribió:

Hi Gerald
I see you are missing a few category option combo names, you should
run
the maintenance to "Update category option combinations", you'll
find
this
in "Data Administration" -> "maintenance"
I also don't see the option combinations of the data elements you
highlighted in the excel you sent to the list. Which category
combination
are you using with those data elements? Run the query again after
doing
the maintenance.

<15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs

About the out of memory error, I recommend that you use pgAdmin3
and
try
to run the query again. You should limit the query to show you the
data

El 23/08/2015, a las 15:39, gerald thomas <gerald17006@gmail.com> >>>>>>>> escribió:

Dear Juan,
For the datavalues query; i am getting "Out of memory" as result.
Please find the attached result for the combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>>>>> wrote:

Hello Gerald
Does data disappear only from data elements that use the default
category
combination?
Since you are querying your database directly, I'm sending you
here
a
couple
of queries you can use to verify the existing values of the
database
and
the
category combinations. Check if you have more than one default
option
combination.

Regards,
JM

El 23/08/2015, a las 11:36, gerald thomas <gerald17006@gmail.com> >>>>>>>>>> escribió:

Juan,
Thanks for your response but we are not using custom forms for
data
entry.

Regards,
Gerald

On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta" >>>>>>>>>>> <jmalcantara1@gmail.com> wrote:
Hello Gerald
Are you using custom forms for data entry?
JM
El 22/08/2015, a las 15:37, gerald thomas >>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>> escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having
data
for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out
there
help
me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear All,
We are having a serious issues on our online server in Sierra
Leone.
Data are normally entered but during analysis these data
normally
got
missing. This had been an issue i had raised before but the
situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for
Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

--
Regards,

Gerald
<Combo_Query result.txt>

--
Regards,

Gerald
<categoryoptioncombon.txt>

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald

17

Hello Gerald
What was the result of the datavalue query?
You should also check the sharing settings of the data elements that are giving you trouble.
JM

···

El 24/08/2015, a las 08:43, gerald thomas <gerald17006@gmail.com> escribió:

Dear Juan,
Please find the attached updated combo query.

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
Noted!!! It is now generating resource table and i will keep you
posted once it had been completed

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Select "Update category option combinations" and click on "perform
maintenance". After that finished select from the menu of the left
"Resource
Table" and click on "Generate tables".
Regards,
JM

El 24/08/2015, a las 08:00, gerald thomas <gerald17006@gmail.com> >>> escribió:

Dear Juan,
Under Maintenance column i am seeing the following:

Clear analytics tables

Clear data mart

Rebuild data mart index

Clear zero values

Clear data set completeness

Prune periods

Remove expired invitations

Drop SQL views

Create SQL views

Update category option combinations

What should I check for the performance maintenance before doing the
query again?

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
No!!! This is the holistic data from that query. Previously i only had
the first part of the result. Do you want me to rebuild tables and run
query again?

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>> wrote:

Hello Gerald
This looks much different than the fist one you sent me and it's still
missing a lot of names, did you rebuild resource tables?
JM

El 24/08/2015, a las 05:44, gerald thomas <gerald17006@gmail.com> >>>>>> escribió:

Dear Juan,
Thanks for your responses.
Sorry i am only responding now but please find the attached category
combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>>> wrote:

Sorry, I got distracted and hit send before completing the message.

You should limit the query to show the values of the specific data
elements
that are giving you trouble, you'll need the uid of each of the data
element., In case you don't know how to get that information, you
can
use
the api (your_server_URL/api/dataElements?paging=false) or look at
the
information if each data element in data element management
selecting
"show
details" from the contextual menu that appears when clocking on the
name
of
each data element. Then add to the query the list of UIDs just
before
the
semicolon.

WHERE de.uid IN
('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')

Please excuse me if you already know all of these things, since I
don't
have
a way to know how much you know about the system and postgres
queries
I
rather be detailed on what you have to do than leave you guessing.

In addition to running maintenance to update category option
combinations
you should re-generate resource tables, you'll find that in "Data
Administration" too.

Regards,
JM

El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta >>>>>>>> <jmalcantara1@gmail.com> escribió:

Hi Gerald
I see you are missing a few category option combo names, you should
run
the maintenance to "Update category option combinations", you'll
find
this
in "Data Administration" -> "maintenance"
I also don't see the option combinations of the data elements you
highlighted in the excel you sent to the list. Which category
combination
are you using with those data elements? Run the query again after
doing
the maintenance.

<15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs

About the out of memory error, I recommend that you use pgAdmin3
and
try
to run the query again. You should limit the query to show you the
data

El 23/08/2015, a las 15:39, gerald thomas <gerald17006@gmail.com> >>>>>>>>> escribió:

Dear Juan,
For the datavalues query; i am getting "Out of memory" as result.
Please find the attached result for the combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>>>>>> wrote:

Hello Gerald
Does data disappear only from data elements that use the default
category
combination?
Since you are querying your database directly, I'm sending you
here
a
couple
of queries you can use to verify the existing values of the
database
and
the
category combinations. Check if you have more than one default
option
combination.

Regards,
JM

El 23/08/2015, a las 11:36, gerald thomas <gerald17006@gmail.com> >>>>>>>>>>> escribió:

Juan,
Thanks for your response but we are not using custom forms for
data
entry.

Regards,
Gerald

On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta" >>>>>>>>>>>> <jmalcantara1@gmail.com> wrote:
Hello Gerald
Are you using custom forms for data entry?
JM
El 22/08/2015, a las 15:37, gerald thomas >>>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>>> escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having
data
for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out
there
help
me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear All,
We are having a serious issues on our online server in Sierra
Leone.
Data are normally entered but during analysis these data
normally
got
missing. This had been an issue i had raised before but the
situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for
Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

--
Regards,

Gerald
<Combo_Query result.txt>

--
Regards,

Gerald
<categoryoptioncombon.txt>

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald
<New_categoryoptioncombon.txt>

18

Dear Juan,
I am still having issues with datavalue query. Please can you help me
by checking the query again.
It is still giving

···

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Hello Gerald
What was the result of the datavalue query?
You should also check the sharing settings of the data elements that are
giving you trouble.
JM
El 24/08/2015, a las 08:43, gerald thomas <gerald17006@gmail.com> escribió:

Dear Juan,
Please find the attached updated combo query.

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
Noted!!! It is now generating resource table and i will keep you
posted once it had been completed

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Select "Update category option combinations" and click on "perform
maintenance". After that finished select from the menu of the left
"Resource
Table" and click on "Generate tables".
Regards,
JM

El 24/08/2015, a las 08:00, gerald thomas <gerald17006@gmail.com> >>>> escribió:

Dear Juan,
Under Maintenance column i am seeing the following:

Clear analytics tables

Clear data mart

Rebuild data mart index

Clear zero values

Clear data set completeness

Prune periods

Remove expired invitations

Drop SQL views

Create SQL views

Update category option combinations

What should I check for the performance maintenance before doing the
query again?

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
No!!! This is the holistic data from that query. Previously i only
had
the first part of the result. Do you want me to rebuild tables and
run
query again?

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>> wrote:

Hello Gerald
This looks much different than the fist one you sent me and it's
still
missing a lot of names, did you rebuild resource tables?
JM

El 24/08/2015, a las 05:44, gerald thomas <gerald17006@gmail.com> >>>>>>> escribió:

Dear Juan,
Thanks for your responses.
Sorry i am only responding now but please find the attached
category
combo query.

On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>>>> wrote:

Sorry, I got distracted and hit send before completing the
message.

You should limit the query to show the values of the specific data
elements
that are giving you trouble, you'll need the uid of each of the
data
element., In case you don't know how to get that information, you
can
use
the api (your_server_URL/api/dataElements?paging=false) or look at
the
information if each data element in data element management
selecting
"show
details" from the contextual menu that appears when clocking on
the
name
of
each data element. Then add to the query the list of UIDs just
before
the
semicolon.

WHERE de.uid IN
('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')

Please excuse me if you already know all of these things, since I
don't
have
a way to know how much you know about the system and postgres
queries
I
rather be detailed on what you have to do than leave you guessing.

In addition to running maintenance to update category option
combinations
you should re-generate resource tables, you'll find that in "Data
Administration" too.

Regards,
JM

El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta >>>>>>>>> <jmalcantara1@gmail.com> escribió:

Hi Gerald
I see you are missing a few category option combo names, you
should
run
the maintenance to "Update category option combinations", you'll
find
this
in "Data Administration" -> "maintenance"
I also don't see the option combinations of the data elements you
highlighted in the excel you sent to the list. Which category
combination
are you using with those data elements? Run the query again after
doing
the maintenance.

<15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs

About the out of memory error, I recommend that you use pgAdmin3
and
try
to run the query again. You should limit the query to show you
the
data

El 23/08/2015, a las 15:39, gerald thomas <gerald17006@gmail.com> >>>>>>>>>> escribió:

Dear Juan,
For the datavalues query; i am getting "Out of memory" as
result.
Please find the attached result for the combo query.

On 8/23/15, Juan Manuel Alcantara Acosta >>>>>>>>>>> <jmalcantara1@gmail.com> >>>>>>>>>>> wrote:

Hello Gerald
Does data disappear only from data elements that use the
default
category
combination?
Since you are querying your database directly, I'm sending you
here
a
couple
of queries you can use to verify the existing values of the
database
and
the
category combinations. Check if you have more than one default
option
combination.

Regards,
JM

El 23/08/2015, a las 11:36, gerald thomas >>>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>>> escribió:

Juan,
Thanks for your response but we are not using custom forms for
data
entry.

Regards,
Gerald

On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta" >>>>>>>>>>>>> <jmalcantara1@gmail.com> wrote:
Hello Gerald
Are you using custom forms for data entry?
JM
El 22/08/2015, a las 15:37, gerald thomas >>>>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>>>> escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having
data
for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out
there
help
me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear All,
We are having a serious issues on our online server in
Sierra
Leone.
Data are normally entered but during analysis these data
normally
got
missing. This had been an issue i had raised before but the
situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix
for
Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

--
Regards,

Gerald
<Combo_Query result.txt>

--
Regards,

Gerald
<categoryoptioncombon.txt>

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald
<New_categoryoptioncombon.txt>

--
Regards,

Gerald

19

Dear Juan,
Please find the attached file showing dataelement and UIDs. I had
already excluded the 17 dataelement which giving these issues.
Furthermore i will like to bring to your notices that issue only occur
on a particular districts (Kailahun, Kenema, Koinadugu, Western Area).

I am currently running the dataelement query and i will update you
first thing in the morning

dataelement;.txt (813 KB)

···

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Hi Gerald
I can see the UIDs in the file you sent me. Look for the following strings:

SW3YgUOEbWh
ZUFq86FDx2d
eTutFs33XIs
HautHb3QIiN
fJXh2KAO50U
RuF2y6PRNFx
jpxNWRzDYCW
OYlcECL1USm
ReCEa4ZIji8
t4ds6TNqajx

Those are the UIDs.

You can use port forwarding with putty to use pgAdmin, look at step 7 of the
following instructions:
https://intranet.cs.hku.hk/csintranet/contents/technical/howto/putty-portforward.jsp

If you have a standard configuration, the port you have to forward is 5432
and then you can connect to the database with pgAdmin to localhost and the
same port.

JM

El 24/08/2015, a las 12:34, gerald thomas <gerald17006@gmail.com> escribió:

Dear Juan,
Kindly note i am access the server through ssh by putty and I am doing
psql to database.
Please find the attached file containing some of the dataelement
within the database. As i said before there is no UID for them.

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
I did but it took me to *****api/resource. Tried to edit URL and use
****api/dataelement nothing comes up.

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> wrote:

Hi Gerald
Yes, you can use the following query.
SELECT * FROM dataelement;

That will return all the existing data elements. It's very strange to
see
data elements without UID, this happens only when you inject the data
elements into the database and the UIDs are created when you restart
the
system. Did you try to use the API?

JM

El 24/08/2015, a las 11:27, gerald thomas <gerald17006@gmail.com> >>>> escribió:

Dear Juan,
i can't find the UID as per your directions. I thought it was
automatically generated but it seem not to be the case.
Is there any query to verify the UID of these dataelements

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
My server version Linux dhis 3.13.0-30-generic #55-Ubuntu SMP Fri Jul
4 21:40:53 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux

DHIS2 version
Version:
  2.18
Build revision:
Build date:
  2015-04-04 09:34
And it is on the cloud.

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>> wrote:

Sure, here's the query. Don't forget to replace the list of UIDs
with
the
corresponding text from your data elements.

SELECT COUNT(*) FROM datavalue WHERE dataelemendid IN (SELECT
dataelementid
FROM dataelement WHERE uid IN
('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10',);

Can you tell me more about your server setup?

JM

El 24/08/2015, a las 10:04, gerald thomas <gerald17006@gmail.com> >>>>>>> escribió:

Please can you send it again

Regards,
Gerald

On Aug 24, 2015 3:01 PM, "Juan Manuel Alcantara Acosta" >>>>>>>> <jmalcantara1@gmail.com> wrote:
Is this happening too with the last query I sent you?
JM
El 24/08/2015, a las 09:54, gerald thomas <gerald17006@gmail.com> >>>>>>>> escribió:

Dear Juan,
I am still having issues with datavalue query. Please can you help
me
by checking the query again.
It is still showing "Out of memory"

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
I am still having issues with datavalue query. Please can you
help
me
by checking the query again.
It is still giving

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@gmail.com> >>>>>>>>>> wrote:

Hello Gerald
What was the result of the datavalue query?
You should also check the sharing settings of the data elements
that
are
giving you trouble.
JM
El 24/08/2015, a las 08:43, gerald thomas >>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>> escribió:

Dear Juan,
Please find the attached updated combo query.

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
Noted!!! It is now generating resource table and i will keep
you
posted once it had been completed

On 8/24/15, Juan Manuel Alcantara Acosta >>>>>>>>>>>>> <jmalcantara1@gmail.com> >>>>>>>>>>>>> wrote:

Select "Update category option combinations" and click on
"perform
maintenance". After that finished select from the menu of the
left
"Resource
Table" and click on "Generate tables".
Regards,
JM

El 24/08/2015, a las 08:00, gerald thomas >>>>>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>>>>> escribió:

Dear Juan,
Under Maintenance column i am seeing the following:

Clear analytics tables

Clear data mart

Rebuild data mart index

Clear zero values

Clear data set completeness

Prune periods

Remove expired invitations

Drop SQL views

Create SQL views

Update category option combinations

What should I check for the performance maintenance before
doing
the
query again?

On 8/24/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear Juan,
No!!! This is the holistic data from that query. Previously
i
only
had
the first part of the result. Do you want me to rebuild
tables
and
run
query again?

On 8/24/15, Juan Manuel Alcantara Acosta >>>>>>>>>>>>>>>> <jmalcantara1@gmail.com> >>>>>>>>>>>>>>>> wrote:

Hello Gerald
This looks much different than the fist one you sent me
and
it's
still
missing a lot of names, did you rebuild resource tables?
JM

El 24/08/2015, a las 05:44, gerald thomas >>>>>>>>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>>>>>>>> escribió:

Dear Juan,
Thanks for your responses.
Sorry i am only responding now but please find the
attached
category
combo query.

On 8/23/15, Juan Manuel Alcantara Acosta >>>>>>>>>>>>>>>>>> <jmalcantara1@gmail.com> >>>>>>>>>>>>>>>>>> wrote:

Sorry, I got distracted and hit send before completing
the
message.

You should limit the query to show the values of the
specific
data
elements
that are giving you trouble, you'll need the uid of each
of
the
data
element., In case you don't know how to get that
information,
you
can
use
the api (your_server_URL/api/dataElements?paging=false)
or
look
at
the
information if each data element in data element
management
selecting
"show
details" from the contextual menu that appears when
clocking
on
the
name
of
each data element. Then add to the query the list of
UIDs
just
before
the
semicolon.

WHERE de.uid IN
('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')

Please excuse me if you already know all of these
things,
since I
don't
have
a way to know how much you know about the system and
postgres
queries
I
rather be detailed on what you have to do than leave you
guessing.

In addition to running maintenance to update category
option
combinations
you should re-generate resource tables, you'll find that
in
"Data
Administration" too.

Regards,
JM

El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta >>>>>>>>>>>>>>>>>>> <jmalcantara1@gmail.com> escribió:

Hi Gerald
I see you are missing a few category option combo
names,
you
should
run
the maintenance to "Update category option
combinations",
you'll
find
this
in "Data Administration" -> "maintenance"
I also don't see the option combinations of the data
elements
you
highlighted in the excel you sent to the list. Which
category
combination
are you using with those data elements? Run the query
again
after
doing
the maintenance.

<15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs

About the out of memory error, I recommend that you use
pgAdmin3
and
try
to run the query again. You should limit the query to
show
you
the
data

El 23/08/2015, a las 15:39, gerald thomas >>>>>>>>>>>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>>>>>>>>>>> escribió:

Dear Juan,
For the datavalues query; i am getting "Out of memory"
as
result.
Please find the attached result for the combo query.

On 8/23/15, Juan Manuel Alcantara Acosta >>>>>>>>>>>>>>>>>>>>> <jmalcantara1@gmail.com> >>>>>>>>>>>>>>>>>>>>> wrote:

Hello Gerald
Does data disappear only from data elements that use
the
default
category
combination?
Since you are querying your database directly, I'm
sending
you
here
a
couple
of queries you can use to verify the existing values
of
the
database
and
the
category combinations. Check if you have more than
one
default
option
combination.

Regards,
JM

El 23/08/2015, a las 11:36, gerald thomas >>>>>>>>>>>>>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>>>>>>>>>>>>> escribió:

Juan,
Thanks for your response but we are not using custom
forms
for
data
entry.

Regards,
Gerald

On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara >>>>>>>>>>>>>>>>>>>>>>> Acosta" >>>>>>>>>>>>>>>>>>>>>>> <jmalcantara1@gmail.com> wrote:
Hello Gerald
Are you using custom forms for data entry?
JM
El 22/08/2015, a las 15:37, gerald thomas >>>>>>>>>>>>>>>>>>>>>>> <gerald17006@gmail.com> >>>>>>>>>>>>>>>>>>>>>>> escribió:

Dear dhis2-users,
If someone cannot help me; can anyone explain why
am
i
having
data
for
October, November, December 2015 on my database?

dhis=# select * from period where startdate >
'2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
1121694 | 6 | 2016-01-01 | 2016-12-31
2058605 | 3 | 2015-11-01 | 2015-11-30
2058606 | 3 | 2015-12-01 | 2015-12-31
2058607 | 3 | 2015-10-01 | 2015-10-31
2058611 | 1 | 2015-01-16 | 2015-01-16
2058619 | 1 | 2015-01-26 | 2015-01-26
2058631 | 1 | 2015-01-29 | 2015-01-29
2058632 | 3 | 2015-09-01 | 2015-09-30
2058656 | 3 | 2015-02-01 | 2015-02-28
2058727 | 3 | 2015-06-01 | 2015-06-30
2058806 | 3 | 2015-07-01 | 2015-07-31
2058811 | 2 | 2015-03-02 | 2015-03-08
2058812 | 3 | 2015-03-01 | 2015-03-31
2058814 | 3 | 2015-05-01 | 2015-05-31
2065151 | 6 | 2020-01-01 | 2020-12-31
2072304 | 3 | 2015-04-01 | 2015-04-30
2109802 | 4 | 2015-04-01 | 2015-06-30
2115342 | 3 | 2015-08-01 | 2015-08-31
2122928 | 292091 | 2015-03-01 | 2015-04-30
2129098 | 2 | 2015-05-25 | 2015-05-31
2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can
anyone
out
there
help
me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> >>>>>>>>>>>>>>>>>>>>>>>> wrote:

Dear All,
We are having a serious issues on our online
server
in
Sierra
Leone.
Data are normally entered but during analysis
these
data
normally
got
missing. This had been an issue i had raised
before
but
the
situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need
to
fix
for
Sierra
Leone and any help will be appreciated till we
overcome
this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help

--
Regards,

Gerald
<Combo_Query result.txt>

--
Regards,

Gerald
<categoryoptioncombon.txt>

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald
<New_categoryoptioncombon.txt>

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald

--
Regards,

Gerald
<dataelement;.txt>

--
Regards,

Gerald

20

Hi Gerald

Did you check that there is not data missing for Oct, Nov, Dec 2014
for the same districts? I think we had a suspicion some time back
that there was maybe a problem with the client PC date settings. So
they thought they were entering for Oct 2014 but in fact it was Oct
2015. Hence it didn't appear in analytics and you ended up with
future data in your database.

Bob

···

On 22 August 2015 at 21:37, gerald thomas <gerald17006@gmail.com> wrote:

Dear dhis2-users,
If someone cannot help me; can anyone explain why am i having data for
October, November, December 2015 on my database?

dhis=# select * from period where startdate > '2015-01-01';
periodid | periodtypeid | startdate | enddate
----------+--------------+------------+------------
  1121694 | 6 | 2016-01-01 | 2016-12-31
  2058605 | 3 | 2015-11-01 | 2015-11-30
  2058606 | 3 | 2015-12-01 | 2015-12-31
  2058607 | 3 | 2015-10-01 | 2015-10-31
  2058611 | 1 | 2015-01-16 | 2015-01-16
  2058619 | 1 | 2015-01-26 | 2015-01-26
  2058631 | 1 | 2015-01-29 | 2015-01-29
  2058632 | 3 | 2015-09-01 | 2015-09-30
  2058656 | 3 | 2015-02-01 | 2015-02-28
  2058727 | 3 | 2015-06-01 | 2015-06-30
  2058806 | 3 | 2015-07-01 | 2015-07-31
  2058811 | 2 | 2015-03-02 | 2015-03-08
  2058812 | 3 | 2015-03-01 | 2015-03-31
  2058814 | 3 | 2015-05-01 | 2015-05-31
  2065151 | 6 | 2020-01-01 | 2020-12-31
  2072304 | 3 | 2015-04-01 | 2015-04-30
  2109802 | 4 | 2015-04-01 | 2015-06-30
  2115342 | 3 | 2015-08-01 | 2015-08-31
  2122928 | 292091 | 2015-03-01 | 2015-04-30
  2129098 | 2 | 2015-05-25 | 2015-05-31
  2129099 | 1 | 2015-12-31 | 2015-12-31
Please we need to fix this issue of data loss; can anyone out there help me.
Please !!!!!!!!!!!!!!!

On 8/20/15, gerald thomas <gerald17006@gmail.com> wrote:

Dear All,
We are having a serious issues on our online server in Sierra Leone.
Data are normally entered but during analysis these data normally got
missing. This had been an issue i had raised before but the situation
is still the same and it is even worst now.

Please this is an urgent technical problem we need to fix for Sierra
Leone and any help will be appreciated till we overcome this
situation.

Please help us!!!!!

--
Regards,

Gerald

--
Regards,

Gerald

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-users
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-users
More help : ListHelp - Launchpad Help