Data Import does not allow a combination of identifier types in 2.22

Version:2.22
Build revision:21927

​​

​We are testing an import of data which we have routinely done in 2.20. We are importing a csv file with the following columns:

​​

dataelement
period
​​

orgunit
​​

categoryoptioncombo
​​

attributeoptioncombo value

attributeoptioncombo is blank


dataelement and

categoryoptioncombo contain UIDs

orgunit contains Code

In 2.20 we were able to set the Data element ID scheme and the Org unit ID scheme to what we wanted without issue. In 2.22 we have the same options on the front end but when attempting to import a csv file with dataelement scheme set to UID and orgunit scheme set to Code, the import fails. If I take the same data file and convert the orgunits to the appropriate UID and then import, it succeeds.

It appears that the option exists in 2.22 but is ignored when performing the import. Is this intentional? Perhaps it was corrected in a later build?

Thanks in advance.

···

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132

Asking if anyone has experienced this problem one more time…

···

On Wed, Apr 20, 2016 at 5:15 PM, Laura E. Lincks laura.lincks@icap.columbia.edu wrote:

Version:2.22
Build revision:21927

​​

​We are testing an import of data which we have routinely done in 2.20. We are importing a csv file with the following columns:

​​

dataelement
period
​​

orgunit
​​

categoryoptioncombo
​​

attributeoptioncombo value

attributeoptioncombo is blank


dataelement and

categoryoptioncombo contain UIDs

orgunit contains Code

In 2.20 we were able to set the Data element ID scheme and the Org unit ID scheme to what we wanted without issue. In 2.22 we have the same options on the front end but when attempting to import a csv file with dataelement scheme set to UID and orgunit scheme set to Code, the import fails. If I take the same data file and convert the orgunits to the appropriate UID and then import, it succeeds.

It appears that the option exists in 2.22 but is ignored when performing the import. Is this intentional? Perhaps it was corrected in a later build?

Thanks in advance.

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132

Exactly same problem in Burundi. Was fine in 2.21, not working in 2.22. Haven’t tested yet in 2.23.

GIJSBERT OOMS

EXPERT D4D - Digitalisation for Development

BELGIAN DEVELOPMENT AGENCY

RUE HAUTE 147

1000 BRUSSELS

T +32 (0)2 505 38 44

F +32 (0)2 502 98 62

WWW.BTCCTB.ORG

Save paper! Think before you print

···

Van: “Laura E. Lincks” laura.lincks@icap.columbia.edu

Aan: DHIS Users dhis2-users@lists.launchpad.net, DHIS 2 Developers list dhis2-devs@lists.launchpad.net

Datum: 23/06/2016 21:00

Onderwerp: Re: [Dhis2-users] Data Import does not allow a combination of identifier types in 2.22

Verzonden door: “Dhis2-users” dhis2-users-bounces+gijsbert.ooms=btcctb.org@lists.launchpad.net


Asking if anyone has experienced this problem one more time…

Laura E. Lincks

Database Manager/Developer

ICAP - Columbia University

Mailman School of Public Health

60 Haven Ave, Floor B1

New York, NY 10032

Tel: 212 304 7132

On Wed, Apr 20, 2016 at 5:15 PM, Laura E. Lincks laura.lincks@icap.columbia.edu wrote:

Version:2.22

Build revision:21927

​​

​We are testing an import of data which we have routinely done in 2.20. We are importing a csv file with the following columns:

​​dataelement

period ​​

orgunit ​​categoryoptioncombo ​​attributeoptioncombo value

​attributeoptioncombo is blank

​​​dataelement and ​categoryoptioncombo contain UIDs

orgunit contains Code

In 2.20 we were able to set the Data element ID scheme and the Org unit ID scheme to what we wanted without issue. In 2.22 we have the same options on the front end but when attempting to import a csv file with dataelement scheme set to UID and orgunit scheme set to Code, the import fails. If I take the same data file and convert the orgunits to the appropriate UID and then import, it succeeds.

It appears that the option exists in 2.22 but is ignored when performing the import. Is this intentional? Perhaps it was corrected in a later build?

Thanks in advance.

Laura E. Lincks

Database Manager/Developer

ICAP - Columbia University

Mailman School of Public Health

60 Haven Ave, Floor B1

New York, NY 10032

Tel: 212 304 7132

`_______________________________________________

Mailing list: [https://launchpad.net/~dhis2-users](https://launchpad.net/~dhis2-users)

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : [https://launchpad.net/~dhis2-users](https://launchpad.net/~dhis2-users)

More help : [https://help.launchpad.net/ListHelp](https://help.launchpad.net/ListHelp)

`

​​

​​

Version:2.23
​ ​

Build revision:22965

To follow up with this, in looking at the log, the following appears when importing a small CSV data file with UIDs for Data Elements and Codes for the Org Unit.

  • INFO 2016-06-29 19:11:16,540 ImportOptions{ID Schemes=IdSchemes{idScheme=IdScheme{identifiableProperty=null, attribute=null}, dataElementIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, categoryOptionComboIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, categoryOptionIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, orgUnitIdScheme=IdScheme{identifiableProperty=CODE, attribute=null}, programIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, programStageIdScheme=IdScheme{identifiableProperty=UID, attribute=null}}, Dry run=false, Preheat cache=false, Async=false, Import strategy=NEW_AND_UPDATES, Skip existing check=false, Sharing=false, Strict periods=false, Strict category option combos=false, Strict attr option combos=false, Strict org units=false, Require category option combo=false, Require attribute option combo=false} (ImportDataValueAction.java [http-bio-443-exec-18])

  • INFO 2016-06-29 19:11:16,543 Starting data value import, options: ImportOptions{ID Schemes=IdSchemes{idScheme=IdScheme{identifiableProperty=null, attribute=null}, dataElementIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, categoryOptionComboIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, categoryOptionIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, orgUnitIdScheme=IdScheme{identifiableProperty=CODE, attribute=null}, programIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, programStageIdScheme=IdScheme{identifiableProperty=UID, attribute=null}}, Dry run=false, Preheat cache=false, Async=false, Import strategy=NEW_AND_UPDATES, Skip existing check=false, Sharing=false, Strict periods=false, Strict category option combos=false, Strict attr option combos=false, Strict org units=false, Require category option combo=false, Require attribute option combo=false}: 00:00:00.000 (Clock.java [taskScheduler-5])

  • INFO 2016-06-29 19:11:16,544 [Level: INFO, category: DATAVALUE_IMPORT, time: Wed Jun 29 19:11:16 UTC 2016, message: Process started] (InMemoryNotifier.java [taskScheduler-5])

  • INFO 2016-06-29 19:11:16,544 Import options: ImportOptions{ID Schemes=IdSchemes{idScheme=IdScheme{identifiableProperty=null, attribute=null}, dataElementIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, categoryOptionComboIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, categoryOptionIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, orgUnitIdScheme=IdScheme{identifiableProperty=CODE, attribute=null}, programIdScheme=IdScheme{identifiableProperty=UID, attribute=null}, programStageIdScheme=IdScheme{identifiableProperty=UID, attribute=null}}, Dry run=false, Preheat cache=false, Async=false, Import strategy=NEW_AND_UPDATES, Skip existing check=false, Sharing=false, Strict periods=false, Strict category option combos=false, Strict attr option combos=false, Strict org units=false, Require category option combo=false, Require attribute option combo=false} (DefaultDataValueSetService.java [taskScheduler-5])

  • INFO 2016-06-29 19:11:16,544 Data value set scheme: IdScheme{identifiableProperty=null, attribute=null}, data element scheme: IdScheme{identifiableProperty=null, attribute=null}, org unit scheme: IdScheme{identifiableProperty=null, attribute=null} (DefaultDataValueSetService.java [taskScheduler-5])

  • INFO 2016-06-29 19:11:16,544 Scheme: IdScheme{identifiableProperty=null, attribute=null}, data element scheme: IdScheme{identifiableProperty=null, attribute=null}, org unit scheme: IdScheme{identifiableProperty=null, attribute=null} (DefaultDataValueSetService.java [taskScheduler-5])

  • INFO 2016-06-29 19:11:16,701 Validated outer meta-data: 00:00:00.157 (Clock.java [taskScheduler-5])

  • INFO 2016-06-29 19:11:16,701 [Level: INFO, category: DATAVALUE_IMPORT, time: Wed Jun 29 19:11:16 UTC 2016, message: Importing data values] (InMemoryNotifier.java [taskScheduler-5])

* INFO 2016-06-29 19:11:38,989 Org unit cache heated after cache miss threshold reached (DefaultDataValueSetService.java [taskScheduler-5])

No message is returned to the front end. The processing box lingers with the progress bar rotating (although nothing is happening on the backend or in the log at this point.)

image

···

On Wed, Jun 29, 2016 at 12:20 PM, Gijsbert OOMS gijsbert.ooms@btcctb.org wrote:

Exactly same problem in Burundi. Was fine in 2.21, not working in 2.22. Haven’t tested yet in 2.23.

GIJSBERT OOMS

EXPERT D4D - Digitalisation for Development

BELGIAN DEVELOPMENT AGENCY

RUE HAUTE 147

1000 BRUSSELS

T +32 (0)2 505 38 44

F +32 (0)2 502 98 62

WWW.BTCCTB.ORG

Save paper! Think before you print

Van: “Laura E. Lincks” laura.lincks@icap.columbia.edu

Aan: DHIS Users dhis2-users@lists.launchpad.net, DHIS 2 Developers list dhis2-devs@lists.launchpad.net

Datum: 23/06/2016 21:00

Onderwerp: Re: [Dhis2-users] Data Import does not allow a combination of identifier types in 2.22

Verzonden door: “Dhis2-users” dhis2-users-bounces+gijsbert.ooms=btcctb.org@lists.launchpad.net


Asking if anyone has experienced this problem one more time…

Laura E. Lincks

Database Manager/Developer

ICAP - Columbia University

Mailman School of Public Health

60 Haven Ave, Floor B1

New York, NY 10032

Tel: 212 304 7132

On Wed, Apr 20, 2016 at 5:15 PM, Laura E. Lincks laura.lincks@icap.columbia.edu wrote:

Version:2.22

Build revision:21927

​​

​We are testing an import of data which we have routinely done in 2.20. We are importing a csv file with the following columns:

​​dataelement

period ​​

orgunit ​​categoryoptioncombo ​​attributeoptioncombo value

​attributeoptioncombo is blank

​​​dataelement and ​categoryoptioncombo contain UIDs

orgunit contains Code

In 2.20 we were able to set the Data element ID scheme and the Org unit ID scheme to what we wanted without issue. In 2.22 we have the same options on the front end but when attempting to import a csv file with dataelement scheme set to UID and orgunit scheme set to Code, the import fails. If I take the same data file and convert the orgunits to the appropriate UID and then import, it succeeds.

It appears that the option exists in 2.22 but is ignored when performing the import. Is this intentional? Perhaps it was corrected in a later build?

Thanks in advance.

Laura E. Lincks

Database Manager/Developer

ICAP - Columbia University

Mailman School of Public Health

60 Haven Ave, Floor B1

New York, NY 10032

Tel: 212 304 7132

`_______________________________________________

Mailing list: [https://launchpad.net/~dhis2-users](https://launchpad.net/~dhis2-users)

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : [https://launchpad.net/~dhis2-users](https://launchpad.net/~dhis2-users)

More help : [https://help.launchpad.net/ListHelp](https://help.launchpad.net/ListHelp)

`

Laura E. Lincks
Database Manager/Developer
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032
Tel: 212 304 7132

Any update on this? When trying to import a csv and using “code” ID scheme for organisation unit, nothing gets imported ("Organisation unit not found or not accessible ")

This worked fine up to version 2.21. I just tested with the same csv-file every later version up to 2.25 and it seems broken in all of them.

GIJSBERT OOMS

EXPERT D4D - Digitalisation for Development

BELGIAN DEVELOPMENT AGENCY

RUE HAUTE 147

1000 BRUSSELS

T +32 (0)2 505 38 44

F +32 (0)2 502 98 62

WWW.BTCCTB.ORG

Save paper! Think before you print

···

Van: Gijsbert OOMS gijsbert.ooms@btcctb.org

Aan: “Laura E. Lincks” laura.lincks@icap.columbia.edu

Cc: DHIS Users dhis2-users@lists.launchpad.net, DHIS 2 Developers list dhis2-devs@lists.launchpad.net

Datum: 29/06/2016 18:51

Onderwerp: [Dhis2-users] Betr: Re: Data Import does not allow a combination of identifier types in 2.22

Verzonden door: “Dhis2-users” dhis2-users-bounces+gijsbert.ooms=btcctb.org@lists.launchpad.net


Exactly same problem in Burundi. Was fine in 2.21, not working in 2.22. Haven’t tested yet in 2.23.

GIJSBERT OOMS

EXPERT D4D - Digitalisation for Development

BELGIAN DEVELOPMENT AGENCY

RUE HAUTE 147

1000 BRUSSELS

T +32 (0)2 505 38 44

F +32 (0)2 502 98 62

WWW.BTCCTB.ORG

Save paper! Think before you print

Van: “Laura E. Lincks” laura.lincks@icap.columbia.edu

Aan: DHIS Users dhis2-users@lists.launchpad.net, DHIS 2 Developers list dhis2-devs@lists.launchpad.net

Datum: 23/06/2016 21:00

Onderwerp: Re: [Dhis2-users] Data Import does not allow a combination of identifier types in 2.22

Verzonden door: “Dhis2-users” dhis2-users-bounces+gijsbert.ooms=btcctb.org@lists.launchpad.net


Asking if anyone has experienced this problem one more time…
Laura E. Lincks

Database Manager/Developer

ICAP - Columbia University

Mailman School of Public Health

60 Haven Ave, Floor B1

New York, NY 10032

Tel: 212 304 7132

On Wed, Apr 20, 2016 at 5:15 PM, Laura E. Lincks laura.lincks@icap.columbia.edu wrote:

Version:2.22

Build revision:21927

​​

​We are testing an import of data which we have routinely done in 2.20. We are importing a csv file with the following columns:

​​dataelement

period ​​

orgunit ​​categoryoptioncombo ​​attributeoptioncombo value

​attributeoptioncombo is blank

​​​dataelement and ​categoryoptioncombo contain UIDs

orgunit contains Code

In 2.20 we were able to set the Data element ID scheme and the Org unit ID scheme to what we wanted without issue. In 2.22 we have the same options on the front end but when attempting to import a csv file with dataelement scheme set to UID and orgunit scheme set to Code, the import fails. If I take the same data file and convert the orgunits to the appropriate UID and then import, it succeeds.

It appears that the option exists in 2.22 but is ignored when performing the import. Is this intentional? Perhaps it was corrected in a later build?

Thanks in advance.

Laura E. Lincks

Database Manager/Developer

ICAP - Columbia University

Mailman School of Public Health

60 Haven Ave, Floor B1

New York, NY 10032

Tel: 212 304 7132

`_______________________________________________

Mailing list: [https://launchpad.net/~dhis2-users](https://launchpad.net/~dhis2-users)

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : [https://launchpad.net/~dhis2-users](https://launchpad.net/~dhis2-users)

More help : [https://help.launchpad.net/ListHelp](https://help.launchpad.net/ListHelp)_______________________________________________

Mailing list: [https://launchpad.net/~dhis2-users](https://launchpad.net/~dhis2-users)

Post to : dhis2-users@lists.launchpad.net

Unsubscribe : [https://launchpad.net/~dhis2-users](https://launchpad.net/~dhis2-users)

More help : [https://help.launchpad.net/ListHelp](https://help.launchpad.net/ListHelp)

`