Data Synchronization of data values and comments not consistent.

Hi,

We have two instances of DHIS2 running on version - 2.21 and revision - 21021.

Both instances have same metadata (through metadata import-export).

The data entry is done from one instance and synced to the other through data synchronisation.

While entering values for a data element, we also saved a comment along with it. But, after data sync, either only the value is synced or the comment is synced, or rarely both. And we have not been able to observe any consistent pattern through our attempts.

The logs do not show any error. They just say - “Synchronisation successful” and “Import done”. Is this a bug?

A sample of data values (retrieved using APIs) are as follows. Even though, every data value entered has a comment with it, either just the value or the associated comment is shown.

{

“dataValues”: [

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W53”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:10:28.378+0000”,

“lastUpdated”: “2016-02-08T12:10:40.346+0000”,

“comment”: “This is for W53”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W52”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:11:04.000+0000”,

“lastUpdated”: “2016-02-08T12:13:21.000+0000”,

“comment”: “yipppieeeeee”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2016W1”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“value”: “1111”,

“storedBy”: “admin”,

“created”: “2016-02-08T11:50:58.000+0000”,

“lastUpdated”: “2016-02-08T11:50:58.000+0000”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2016W4”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:08:19.000+0000”,

“lastUpdated”: “2016-02-08T12:09:31.000+0000”,

“comment”: “New comment”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W50”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“value”: “10”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:18:18.000+0000”,

“lastUpdated”: “2016-02-08T12:18:29.000+0000”,

“followUp”: false

},

Could you please look into this and offer suggestions.

Thanks & Regards,

···

Archana Chillala
Application Developer
Email
archanac@thoughtworks.com
Telephone
+91 9100960533
ThoughtWorks

Hi Archana,

I had a look and I think I found the error. It was in fact not related to data sync, rather a serious bug with the data entry module, which caused data values to be cleared out when entering comments. I have fixed this now in trunk, 2.22 and 2.21.

Could you please try again with latest version now?

regards,

Lars

···

On Tue, Feb 9, 2016 at 5:51 AM, Archana Chillala archanac@thoughtworks.com wrote:

Hi,

We have two instances of DHIS2 running on version - 2.21 and revision - 21021.

Both instances have same metadata (through metadata import-export).

The data entry is done from one instance and synced to the other through data synchronisation.

While entering values for a data element, we also saved a comment along with it. But, after data sync, either only the value is synced or the comment is synced, or rarely both. And we have not been able to observe any consistent pattern through our attempts.

The logs do not show any error. They just say - “Synchronisation successful” and “Import done”. Is this a bug?

A sample of data values (retrieved using APIs) are as follows. Even though, every data value entered has a comment with it, either just the value or the associated comment is shown.

{

“dataValues”: [

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W53”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:10:28.378+0000”,

“lastUpdated”: “2016-02-08T12:10:40.346+0000”,

“comment”: “This is for W53”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W52”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:11:04.000+0000”,

“lastUpdated”: “2016-02-08T12:13:21.000+0000”,

“comment”: “yipppieeeeee”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2016W1”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“value”: “1111”,

“storedBy”: “admin”,

“created”: “2016-02-08T11:50:58.000+0000”,

“lastUpdated”: “2016-02-08T11:50:58.000+0000”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2016W4”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:08:19.000+0000”,

“lastUpdated”: “2016-02-08T12:09:31.000+0000”,

“comment”: “New comment”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W50”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“value”: “10”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:18:18.000+0000”,

“lastUpdated”: “2016-02-08T12:18:29.000+0000”,

“followUp”: false

},

Could you please look into this and offer suggestions.

Thanks & Regards,

Archana Chillala
Application Developer
Email
archanac@thoughtworks.com
Telephone
+91 9100960533
ThoughtWorks


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org

Thanks, Lars. It works!

···

On Wed, Feb 10, 2016 at 10:41 PM, Lars Helge Øverland lars@dhis2.org wrote:

Hi Archana,

I had a look and I think I found the error. It was in fact not related to data sync, rather a serious bug with the data entry module, which caused data values to be cleared out when entering comments. I have fixed this now in trunk, 2.22 and 2.21.

Could you please try again with latest version now?

regards,

Lars

Archana Chillala
Application Developer
Email
archanac@thoughtworks.com
Telephone
+91 9100960533
ThoughtWorks

On Tue, Feb 9, 2016 at 5:51 AM, Archana Chillala archanac@thoughtworks.com wrote:

Hi,

We have two instances of DHIS2 running on version - 2.21 and revision - 21021.

Both instances have same metadata (through metadata import-export).

The data entry is done from one instance and synced to the other through data synchronisation.

While entering values for a data element, we also saved a comment along with it. But, after data sync, either only the value is synced or the comment is synced, or rarely both. And we have not been able to observe any consistent pattern through our attempts.

The logs do not show any error. They just say - “Synchronisation successful” and “Import done”. Is this a bug?

A sample of data values (retrieved using APIs) are as follows. Even though, every data value entered has a comment with it, either just the value or the associated comment is shown.

{

“dataValues”: [

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W53”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:10:28.378+0000”,

“lastUpdated”: “2016-02-08T12:10:40.346+0000”,

“comment”: “This is for W53”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W52”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:11:04.000+0000”,

“lastUpdated”: “2016-02-08T12:13:21.000+0000”,

“comment”: “yipppieeeeee”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2016W1”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“value”: “1111”,

“storedBy”: “admin”,

“created”: “2016-02-08T11:50:58.000+0000”,

“lastUpdated”: “2016-02-08T11:50:58.000+0000”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2016W4”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:08:19.000+0000”,

“lastUpdated”: “2016-02-08T12:09:31.000+0000”,

“comment”: “New comment”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W50”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“value”: “10”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:18:18.000+0000”,

“lastUpdated”: “2016-02-08T12:18:29.000+0000”,

“followUp”: false

},

Could you please look into this and offer suggestions.

Thanks & Regards,

Archana Chillala
Application Developer
Email
archanac@thoughtworks.com
Telephone
+91 9100960533
ThoughtWorks


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org

Thanks - sounds good.

···

On Sun, Feb 14, 2016 at 9:10 PM, Archana Chillala archanac@thoughtworks.com wrote:

Thanks, Lars. It works!

Archana Chillala
Application Developer
Email
archanac@thoughtworks.com
Telephone
+91 9100960533
ThoughtWorks

On Wed, Feb 10, 2016 at 10:41 PM, Lars Helge Øverland lars@dhis2.org wrote:

Hi Archana,

I had a look and I think I found the error. It was in fact not related to data sync, rather a serious bug with the data entry module, which caused data values to be cleared out when entering comments. I have fixed this now in trunk, 2.22 and 2.21.

Could you please try again with latest version now?

regards,

Lars

On Tue, Feb 9, 2016 at 5:51 AM, Archana Chillala archanac@thoughtworks.com wrote:

Hi,

We have two instances of DHIS2 running on version - 2.21 and revision - 21021.

Both instances have same metadata (through metadata import-export).

The data entry is done from one instance and synced to the other through data synchronisation.

While entering values for a data element, we also saved a comment along with it. But, after data sync, either only the value is synced or the comment is synced, or rarely both. And we have not been able to observe any consistent pattern through our attempts.

The logs do not show any error. They just say - “Synchronisation successful” and “Import done”. Is this a bug?

A sample of data values (retrieved using APIs) are as follows. Even though, every data value entered has a comment with it, either just the value or the associated comment is shown.

{

“dataValues”: [

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W53”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:10:28.378+0000”,

“lastUpdated”: “2016-02-08T12:10:40.346+0000”,

“comment”: “This is for W53”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W52”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:11:04.000+0000”,

“lastUpdated”: “2016-02-08T12:13:21.000+0000”,

“comment”: “yipppieeeeee”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2016W1”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“value”: “1111”,

“storedBy”: “admin”,

“created”: “2016-02-08T11:50:58.000+0000”,

“lastUpdated”: “2016-02-08T11:50:58.000+0000”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2016W4”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:08:19.000+0000”,

“lastUpdated”: “2016-02-08T12:09:31.000+0000”,

“comment”: “New comment”,

“followUp”: false

},

{

“dataElement”: “WrYuYughmib”,

“period”: “2015W50”,

“orgUnit”: “USe0FXuT2hD”,

“categoryOptionCombo”: “UQZ2avpTT3r”,

“attributeOptionCombo”: “UQZ2avpTT3r”,

“value”: “10”,

“storedBy”: “admin”,

“created”: “2016-02-08T12:18:18.000+0000”,

“lastUpdated”: “2016-02-08T12:18:29.000+0000”,

“followUp”: false

},

Could you please look into this and offer suggestions.

Thanks & Regards,

Archana Chillala
Application Developer
Email
archanac@thoughtworks.com
Telephone
+91 9100960533
ThoughtWorks


Mailing list: https://launchpad.net/~dhis2-users

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-users

More help : https://help.launchpad.net/ListHelp

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org

Lars Helge Øverland

Lead developer, DHIS 2

University of Oslo

Skype: larshelgeoverland

http://www.dhis2.org