Bugs in DHIS new importer.

- Sharing settings will sync only if you change any metadata of that
particular element along with change in sharing settings.

I'm not able to replicate this, was able to download objects, and change
sharing settings (without changing anything else on the object), could you
tell me more about the object you have been testing? could be specific to a
particular type maybe

- When we create Custom attributes and make them mandatory and assign to a
data set (for example) and sync them to local instance, we get a run time
exception stating that attribute for dataset not given any value. This is
because even if it is mandatory we are not changing the dataset to set the
value to attribute.

You mean you are making a metadata attribute as mandatory, but not
providing a attribute value for it? that should fail of course, but what
kind of run time exeption do you get? It should have been caught by the
import validation routines

- Data set - when updated with a data approval workflow - does not sync to

local. Everything syncs and association is not syncing

We do not support any data approval types at this point (at least nothing
has been done to try and support them, it's untested)

- when we updated the existing program with adding combination of

categories and synched.

This should be fixed now

- while updating attributes in the program with registration.

* ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique
constraint ""programtrackedentityattribute_unique_key""
  Detail: Key (programid, trackedentityattributeid)=(255, 240) already
exists. (SqlExceptionHelper.java [taskScheduler-6])
* ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import
the metadata. could not execute statement (MetadataImportHandler.java
[taskScheduler-6])
org.hibernate.exception.ConstraintViolationException: could not execute
statement at
org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error
on Edit Program Stage page. Press cancel and exception is thrown. Analytics
Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at
least similar issues)

- Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event

Chart, Validation Rule
Metadata Sync failed for the above metadata With the below runtime
exception.
--- Exception occurred while trying to import the metadata. object
references an unsaved transient instance - save the transient instance
before flushing: org.hisp.dhis.dataelement.DataElement
(MetadataSyncTask.java [taskScheduler-9])

This should be fixed

- Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

- When deleted a legend at HQ and synced to local. The legend at Local also

is deleted on UI (exists in DB). Also, legend is getting duplicated with a
different UID in DB.

Will look into it

- Metadata Filter (Import-Export --> Metadata Detailed Export)
modification to properties like name, description is successfully synced
but the selection is not synced, the payload also have the details of the
updated data when synced.

Not sure how much time we should spend on this, the metadata filter
functionality should be replaced in future releases (it's not very stable,
and has not been updated to support new types etc)

- custom forms are synced properly when created, but while Updation of

custom form not reflecting on UI. However, payload has the full information
of updates.

Will look into it, is the issue present for both data set and program
stages?

···

--
Morten

--
Thanks & Regards,
Nalinikanth M
Quality Analyst
Email nalinim@thoughtworks.com
Telephone +91 9052234588 <+91+9052234588>
[image: ThoughtWorks]
<Thoughtworks: A leading technology consultancy | Thoughtworks;

- Sharing settings will sync only if you change any metadata of that

particular element along with change in sharing settings.

I'm not able to replicate this, was able to download objects, and change
sharing settings (without changing anything else on the object), could you
tell me more about the object you have been testing? could be specific to a
particular type maybe

@vanyas: will check again.

- When we create Custom attributes and make them mandatory and assign to
a data set (for example) and sync them to local instance, we get a run time
exception stating that attribute for dataset not given any value. This is
because even if it is mandatory we are not changing the dataset to set the
value to attribute.

You mean you are making a metadata attribute as mandatory, but not
providing a attribute value for it? that should fail of course, but what
kind of run time exeption do you get? It should have been caught by the
import validation routines

@vanyas: Yes this was caught during the validation phase itself. The point
here would be to catch such issues during configuring metadata itself. The
use case was: We created some data set at HQ, synced to local. Then we
created a custom attribute for data set and made it mandatory. Then when
this version (with custom attribute info) syncs to local, we get this
validation issues with the importer. Any general guideline for such cases.

- Data set - when updated with a data approval workflow - does not sync to

local. Everything syncs and association is not syncing

We do not support any data approval types at this point (at least nothing
has been done to try and support them, it's untested)

@vanyas: Whats the plan for this in that case? If its part of metadata this
association should get synced.

- when we updated the existing program with adding combination of

categories and synched.

This should be fixed now

- while updating attributes in the program with registration.

* ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates
unique constraint ""programtrackedentityattribute_unique_key""
  Detail: Key (programid, trackedentityattributeid)=(255, 240) already
exists. (SqlExceptionHelper.java [taskScheduler-6])
* ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import
the metadata. could not execute statement (MetadataImportHandler.java
[taskScheduler-6])
org.hibernate.exception.ConstraintViolationException: could not execute
statement at
org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error
on Edit Program Stage page. Press cancel and exception is thrown. Analytics
Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this
(at least similar issues)

@vanyas : Thanks. Sure will check.

- Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event

Chart, Validation Rule
Metadata Sync failed for the above metadata With the below runtime
exception.
--- Exception occurred while trying to import the metadata. object
references an unsaved transient instance - save the transient instance
before flushing: org.hisp.dhis.dataelement.DataElement
(MetadataSyncTask.java [taskScheduler-9])

This should be fixed

- Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

- When deleted a legend at HQ and synced to local. The legend at Local

also is deleted on UI (exists in DB). Also, legend is getting duplicated
with a different UID in DB.

Will look into it

- Metadata Filter (Import-Export --> Metadata Detailed Export)
modification to properties like name, description is successfully synced
but the selection is not synced, the payload also have the details of the
updated data when synced.

Not sure how much time we should spend on this, the metadata filter
functionality should be replaced in future releases (it's not very stable,
and has not been updated to support new types etc)

- custom forms are synced properly when created, but while Updation of

custom form not reflecting on UI. However, payload has the full information
of updates.

Will look into it, is the issue present for both data set and program
stages?

@vanya: This was tested with data sets only.

···

On Tue, Jun 28, 2016 at 2:05 PM, Morten Olav Hansen <morten@dhis2.org> wrote:

--
Morten

--
Thanks & Regards,
Nalinikanth M
Quality Analyst
Email nalinim@thoughtworks.com
Telephone +91 9052234588 <+91+9052234588>
[image: ThoughtWorks]
<Thoughtworks: A leading technology consultancy | Thoughtworks;

--
With Regards
ThoughtWorks Technologies
Hyderabad

--Stay Hungry Stay Foolish!!

@vanyas: Yes this was caught during the validation phase itself. The point
here would be to catch such issues during configuring metadata itself. The
use case was: We created some data set at HQ, synced to local. Then we
created a custom attribute for data set and made it mandatory. Then when
this version (with custom attribute info) syncs to local, we get this
validation issues with the importer. Any general guideline for such cases.

I don't disagree on that, but it's not really related to the importer. Not
sure we have any guidelines for that, in general you would never actually
change an attribute like that I think (I wouldn't mind it being blocked),
of course.. people make mistakes.. and we don't really want to block edits
either..

We do not support any data approval types at this point (at least nothing

has been done to try and support them, it's untested)

@vanyas: Whats the plan for this in that case? If its part of metadata
this association should get synced.

We have a blueprint for adding support for this:
https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It's currently set to 2.25, but nobody is assigned..

···

--
Morten

- when we updated the existing program with adding combination of

categories and synched.

This should be fixed now

- while updating attributes in the program with registration.

* ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates
unique constraint ""programtrackedentityattribute_unique_key""
  Detail: Key (programid, trackedentityattributeid)=(255, 240) already
exists. (SqlExceptionHelper.java [taskScheduler-6])
* ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to
import the metadata. could not execute statement
(MetadataImportHandler.java [taskScheduler-6])
org.hibernate.exception.ConstraintViolationException: could not execute
statement at
org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error
on Edit Program Stage page. Press cancel and exception is thrown. Analytics
Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this
(at least similar issues)

@vanyas : Thanks. Sure will check.

- Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event

Chart, Validation Rule
Metadata Sync failed for the above metadata With the below runtime
exception.
--- Exception occurred while trying to import the metadata. object
references an unsaved transient instance - save the transient instance
before flushing: org.hisp.dhis.dataelement.DataElement
(MetadataSyncTask.java [taskScheduler-9])

This should be fixed

- Admin user when added to dashboard item is not syncing with metadat

sync.

Will look into it

- When deleted a legend at HQ and synced to local. The legend at Local

also is deleted on UI (exists in DB). Also, legend is getting duplicated
with a different UID in DB.

Will look into it

- Metadata Filter (Import-Export --> Metadata Detailed Export)
modification to properties like name, description is successfully synced
but the selection is not synced, the payload also have the details of the
updated data when synced.

Not sure how much time we should spend on this, the metadata filter
functionality should be replaced in future releases (it's not very stable,
and has not been updated to support new types etc)

- custom forms are synced properly when created, but while Updation of

custom form not reflecting on UI. However, payload has the full information
of updates.

Will look into it, is the issue present for both data set and program
stages?

@vanya: This was tested with data sets only.

--
Morten

--
Thanks & Regards,
Nalinikanth M
Quality Analyst
Email nalinim@thoughtworks.com
Telephone +91 9052234588 <+91+9052234588>
[image: ThoughtWorks]
<Thoughtworks: A leading technology consultancy | Thoughtworks;

--
With Regards
ThoughtWorks Technologies
Hyderabad

--Stay Hungry Stay Foolish!!

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

stacktrace.txt (13.4 KB)

···

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

···

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Thanks Morten. Keep me up please.

Best regards!

···

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

···

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Great! Thanks Morten.

···

2016-07-28 10:44 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Hi Sergio

Please try again with latest 2.24

···

On Thu, Jul 28, 2016 at 10:56 AM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Great! Thanks Morten.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 10:44 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Hi,

I have just tested it again with Build revision: 23527 and now it works perfectly.

Thanks Morten.

Regards!

···

2016-07-28 13:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Please try again with latest 2.24

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 10:56 AM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Great! Thanks Morten.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 10:44 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Hello again,

I’ve testing the fix and I encountered some troubles. The previous error appears again.

When I tried to import 1 event chart the importer seemed to work fine. I tried 2 and It worked too. Finally I tried 238, and this is what I got:

{

“httpStatus”: “Internal Server Error”,

“httpStatusCode”: 500,

“status”: “ERROR”,

“message”: “object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.program.ProgramIndicator”

}

I tried 9 and It worked.

I tried 20 and It crashed again. After this try I was not able to import a single one any more.

I attach the stacktrace of every try I made. The payload I used is the same as before but with a list of event charts instead of only one.

Regards!

stacktrace2.txt (253 KB)

···

2016-07-28 13:51 GMT+02:00 Sergio Valenzuela sergio.valenzuela@ehas.org:

Hi,

I have just tested it again with Build revision: 23527 and now it works perfectly.

Thanks Morten.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Please try again with latest 2.24

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 10:56 AM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Great! Thanks Morten.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 10:44 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Hm ok, seems to be a different error (ProgramIndicator this time), I will have a look tomorrow and fix it

···

On Thu, Jul 28, 2016 at 4:07 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello again,

I’ve testing the fix and I encountered some troubles. The previous error appears again.

When I tried to import 1 event chart the importer seemed to work fine. I tried 2 and It worked too. Finally I tried 238, and this is what I got:

{

“httpStatus”: “Internal Server Error”,

“httpStatusCode”: 500,

“status”: “ERROR”,

“message”: “object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.program.ProgramIndicator”

}

I tried 9 and It worked.

I tried 20 and It crashed again. After this try I was not able to import a single one any more.

I attach the stacktrace of every try I made. The payload I used is the same as before but with a list of event charts instead of only one.

Regards!

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:51 GMT+02:00 Sergio Valenzuela sergio.valenzuela@ehas.org:

Hi,

I have just tested it again with Build revision: 23527 and now it works perfectly.

Thanks Morten.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Please try again with latest 2.24

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 10:56 AM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Great! Thanks Morten.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 10:44 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Ok. Thanks a lot.

···

2016-07-28 16:19 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hm ok, seems to be a different error (ProgramIndicator this time), I will have a look tomorrow and fix it

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 4:07 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello again,

I’ve testing the fix and I encountered some troubles. The previous error appears again.

When I tried to import 1 event chart the importer seemed to work fine. I tried 2 and It worked too. Finally I tried 238, and this is what I got:

{

“httpStatus”: “Internal Server Error”,

“httpStatusCode”: 500,

“status”: “ERROR”,

“message”: “object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.program.ProgramIndicator”

}

I tried 9 and It worked.

I tried 20 and It crashed again. After this try I was not able to import a single one any more.

I attach the stacktrace of every try I made. The payload I used is the same as before but with a list of event charts instead of only one.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:51 GMT+02:00 Sergio Valenzuela sergio.valenzuela@ehas.org:

Hi,

I have just tested it again with Build revision: 23527 and now it works perfectly.

Thanks Morten.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Please try again with latest 2.24

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 10:56 AM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Great! Thanks Morten.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 10:44 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Hi Sergio

Can you again try with latest 2.24?

···

On Thu, Jul 28, 2016 at 4:20 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Ok. Thanks a lot.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 16:19 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hm ok, seems to be a different error (ProgramIndicator this time), I will have a look tomorrow and fix it

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 4:07 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello again,

I’ve testing the fix and I encountered some troubles. The previous error appears again.

When I tried to import 1 event chart the importer seemed to work fine. I tried 2 and It worked too. Finally I tried 238, and this is what I got:

{

“httpStatus”: “Internal Server Error”,

“httpStatusCode”: 500,

“status”: “ERROR”,

“message”: “object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.program.ProgramIndicator”

}

I tried 9 and It worked.

I tried 20 and It crashed again. After this try I was not able to import a single one any more.

I attach the stacktrace of every try I made. The payload I used is the same as before but with a list of event charts instead of only one.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:51 GMT+02:00 Sergio Valenzuela sergio.valenzuela@ehas.org:

Hi,

I have just tested it again with Build revision: 23527 and now it works perfectly.

Thanks Morten.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Please try again with latest 2.24

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 10:56 AM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Great! Thanks Morten.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 10:44 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

Hi Morten,

I’ve just tried with eventCharts and eventReports (25x and 23x of each type at once) and it works fine.

Thanks for your support.

Regards!

···

2016-07-29 11:06 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Can you again try with latest 2.24?

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 4:20 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Ok. Thanks a lot.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 16:19 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hm ok, seems to be a different error (ProgramIndicator this time), I will have a look tomorrow and fix it

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 4:07 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello again,

I’ve testing the fix and I encountered some troubles. The previous error appears again.

When I tried to import 1 event chart the importer seemed to work fine. I tried 2 and It worked too. Finally I tried 238, and this is what I got:

{

“httpStatus”: “Internal Server Error”,

“httpStatusCode”: 500,

“status”: “ERROR”,

“message”: “object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.program.ProgramIndicator”

}

I tried 9 and It worked.

I tried 20 and It crashed again. After this try I was not able to import a single one any more.

I attach the stacktrace of every try I made. The payload I used is the same as before but with a list of event charts instead of only one.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:51 GMT+02:00 Sergio Valenzuela sergio.valenzuela@ehas.org:

Hi,

I have just tested it again with Build revision: 23527 and now it works perfectly.

Thanks Morten.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Please try again with latest 2.24

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 10:56 AM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Great! Thanks Morten.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 10:44 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

That’s great :slight_smile: let me know if you see any other issues

···

On Fri, Jul 29, 2016 at 11:26 AM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hi Morten,

I’ve just tried with eventCharts and eventReports (25x and 23x of each type at once) and it works fine.

Thanks for your support.

Regards!

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-29 11:06 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Can you again try with latest 2.24?

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 4:20 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Ok. Thanks a lot.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 16:19 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hm ok, seems to be a different error (ProgramIndicator this time), I will have a look tomorrow and fix it

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 4:07 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello again,

I’ve testing the fix and I encountered some troubles. The previous error appears again.

When I tried to import 1 event chart the importer seemed to work fine. I tried 2 and It worked too. Finally I tried 238, and this is what I got:

{

“httpStatus”: “Internal Server Error”,

“httpStatusCode”: 500,

“status”: “ERROR”,

“message”: “object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.program.ProgramIndicator”

}

I tried 9 and It worked.

I tried 20 and It crashed again. After this try I was not able to import a single one any more.

I attach the stacktrace of every try I made. The payload I used is the same as before but with a list of event charts instead of only one.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:51 GMT+02:00 Sergio Valenzuela sergio.valenzuela@ehas.org:

Hi,

I have just tested it again with Build revision: 23527 and now it works perfectly.

Thanks Morten.

Regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 13:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Please try again with latest 2.24

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Thu, Jul 28, 2016 at 10:56 AM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Great! Thanks Morten.

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-28 10:44 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

I could reproduce your error, will try and have a fix ready today and backport to 2.24.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Thanks Morten. Keep me up please.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-07-27 16:28 GMT+02:00 Morten Olav Hansen morten@dhis2.org:

Hi Sergio

Not sure exactly what is wrong there, but will try and reproduce and fix tomorrow.

Morten Olav Hansen

Senior Engineer, DHIS 2

University of Oslo

http://www.dhis2.org

On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela sergio.valenzuela@ehas.org wrote:

Hello devs,

I’m getting the “Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])” error when using the new exporter/importer (/api/24/metadata). I’m exporting event charts and event reports from one DHIS2 instance to another (same version same build: 2.24 and 23522). Metadata is the same in both instances.

Full stack trace attached.

URL: http://localhost:8080/api/24/metadata

Example eventCharts Payload:

{

“date”: “2016-07-27T12:54:31.851+0000”,

“eventCharts”: [

{

“lastUpdated”: “2016-07-26T15:57:08.779+0000”,

“id”: “uM4KpocRONz”,

“created”: “2016-07-26T15:57:08.779+0000”,

“name”: “Acurenam: Mortalidad total: Nº de muertes”,

“showData”: true,

“publicAccess”: “rw------”,

“userOrganisationUnitChildren”: false,

“type”: “LINE”,

“hideEmptyRows”: false,

“userOrganisationUnit”: false,

“hideNaData”: false,

“completedOnly”: false,

“sortOrder”: 0,

“collapseDataDimensions”: false,

“userOrganisationUnitGrandChildren”: false,

“hideSubtitle”: false,

“outputType”: “EVENT”,

“title”: “Número de muertes”,

“hideLegend”: false,

“externalAccess”: false,

“hideTitle”: false,

“regression”: false,

“program”: {

“id”: “yBICFtJAYFR”

},

“relativePeriods”: {

“thisYear”: false,

“quartersLastYear”: false,

“last52Weeks”: false,

“thisWeek”: false,

“lastMonth”: false,

“monthsThisYear”: false,

“last2SixMonths”: false,

“thisQuarter”: false,

“last12Months”: false,

“last5FinancialYears”: false,

“thisSixMonth”: false,

“lastQuarter”: false,

“thisFinancialYear”: false,

“last4Weeks”: false,

“last3Months”: false,

“thisMonth”: false,

“last5Years”: false,

“last6BiMonths”: false,

“lastFinancialYear”: false,

“last6Months”: false,

“quartersThisYear”: false,

“monthsLastYear”: false,

“lastWeek”: false,

“thisBimonth”: false,

“lastBimonth”: false,

“lastSixMonth”: false,

“lastYear”: false,

“last12Weeks”: true,

“last4Quarters”: false

},

“programStage”: {

“id”: “PgGkk7ELhw7”

},

“user”: {

“id”: “mGMEUNgjTYA”

},

“attributeDimensions”: ,

“translations”: ,

“filterDimensions”: [

“ou”

],

“organisationUnitGroups”: ,

“itemOrganisationUnitGroups”: ,

“userGroupAccesses”: ,

“programIndicatorDimensions”: ,

“columnDimensions”: [

“RFGJRT5bFaC”

],

“organisationUnitLevels”: ,

“dataElementDimensions”: [

{

“filter”: “IN:O28”,

“dataElement”: {

“id”: “RFGJRT5bFaC”

}

}

],

“periods”: ,

“organisationUnits”: [

{

“id”: “JnEJ2mR2WlB”

}

],

“rowDimensions”: [

“pe”

]

}

]

}

Hope you can help me out with this.

Best regards!

Sergio Valenzuela
Fundación EHAS
Telemedicina para países en desarrollo -www.ehas.org

E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040 Madrid - España

Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62

2016-06-29 5:18 GMT+02:00 Morten Olav Hansen morten@dhis2.org:


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

I don’t disagree on that, but it’s not really related to the importer. Not sure we have any guidelines for that, in general you would never actually change an attribute like that I think (I wouldn’t mind it being blocked), of course… people make mistakes… and we don’t really want to block edits either…

We have a blueprint for adding support for this:

https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval

It’s currently set to 2.25, but nobody is assigned…

Morten

@vanyas: Yes this was caught during the validation phase itself. The point here would be to catch such issues during configuring metadata itself. The use case was: We created some data set at HQ, synced to local. Then we created a custom attribute for data set and made it mandatory. Then when this version (with custom attribute info) syncs to local, we get this validation issues with the importer. Any general guideline for such cases.

@vanyas: Whats the plan for this in that case? If its part of metadata this association should get synced.

We do not support any data approval types at this point (at least nothing has been done to try and support them, it’s untested)

@vanyas : Thanks. Sure will check.

@vanya: This was tested with data sets only.

With Regards
ThoughtWorks Technologies

Hyderabad

–Stay Hungry Stay Foolish!!

  • when we updated the existing program with adding combination of categories and synched.

This should be fixed now

  • while updating attributes in the program with registration.
  • ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates unique constraint ““programtrackedentityattribute_unique_key””

Detail: Key (programid, trackedentityattributeid)=(255, 240) already exists. (SqlExceptionHelper.java [taskScheduler-6])

  • ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to import the metadata. could not execute statement (MetadataImportHandler.java [taskScheduler-6])

org.hibernate.exception.ConstraintViolationException: could not execute statement at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error on Edit Program Stage page. Press cancel and exception is thrown. Analytics Export Error. Process failed. null.

Please try again, I have done several fixes related to issues like this (at least similar issues)

  • Charts, pivot tables, Report Table/ Pivot Table, Event Report, Event Chart, Validation Rule

Metadata Sync failed for the above metadata With the below runtime exception.

— Exception occurred while trying to import the metadata. object references an unsaved transient instance - save the transient instance before flushing: org.hisp.dhis.dataelement.DataElement (MetadataSyncTask.java [taskScheduler-9])

This should be fixed

  • Admin user when added to dashboard item is not syncing with metadat sync.

Will look into it

  • When deleted a legend at HQ and synced to local. The legend at Local also is deleted on UI (exists in DB). Also, legend is getting duplicated with a different UID in DB.

Will look into it

  • Metadata Filter (Import-Export → Metadata Detailed Export)

modification to properties like name, description is successfully synced but the selection is not synced, the payload also have the details of the updated data when synced.

Not sure how much time we should spend on this, the metadata filter functionality should be replaced in future releases (it’s not very stable, and has not been updated to support new types etc)

  • custom forms are synced properly when created, but while Updation of custom form not reflecting on UI. However, payload has the full information of updates.

Will look into it, is the issue present for both data set and program stages?

Morten


Thanks & Regards,

Nalinikanth M

Quality Analyst

Email
nalinim@thoughtworks.com
Telephone
+91 9052234588
ThoughtWorks

I’m trying to upload TEI enrollments on dAtaZ and I’m getting this error:
Skipping line 2:The import process failed: org.hibernate.exception.ConstraintViolationException: could not execute statement

Please assist