Merging two separate DHIS2 setups

Support - Assistance technique
1

What could be the best possible way to merge two separate DHIS2 set-ups into one system.

I have two separate setups with different Tracker capture programs implemented on them, with the same postgres version (Veision 10.7) and on DHIS2 2.30. I want to merge the two applications. I tried using metadata import/export but on import i get the following message on the Logger-view console:

2019-03-05 21:44:04
INFO - Metadata import
Initiated metadataImport
44:15
(admin) Import:Start
44:36
(admin) Import:Done took 20.75 seconds
44:37
Created: 0, Updated: 0, Deleted: 0, Ignored: 782, Total: 782

I also get the following of my logs:

* INFO  2019-03-05 21:49:36,686 Skipping unknown property 'system'. (DefaultRenderService.java [http-bio-9000-exec-10])
* INFO  2019-03-05 21:49:37,050 (admin) Import:Start (DefaultMetadataImportService.java [taskScheduler-20])
* INFO  2019-03-05 21:49:37,057 [Level: INFO, category: METADATA_IMPORT, time: Tue Mar 05 21:49:37 CAT 2019, message: (admin) Import:Start] (InMemoryNotifier.java [taskScheduler-20])
* INFO  2019-03-05 21:49:42,554 (admin) Import:Preheat[REFERENCE] took 5.48 seconds (DefaultPreheatService.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,277 Validation of 'Credentials expiry alert' failed. (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,288 [ErrorReport{message=Failed to add/update job configuration - Another job of the same job type is already scheduled with this cron expression, errorCode=E7000, mainKlass=class org.hisp.dhis.scheduling.JobConfiguration, errorKlass=null, value=null}, ErrorReport{message=Failed to validate job runtime - `EMAIL gateway configuration does not exist`, errorCode=E7010, mainKlass=class org.hisp.dhis.credentials.CredentialsExpiryAlertJob, errorKlass=null, value=null}] (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,447 Validation of 'Dataset notification' failed. (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,447 [ErrorReport{message=Failed to add/update job configuration - Another job of the same job type is already scheduled with this cron expression, errorCode=E7000, mainKlass=class org.hisp.dhis.scheduling.JobConfiguration, errorKlass=null, value=null}] (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,548 Validation of 'Data statistics' failed. (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,549 [ErrorReport{message=Failed to add/update job configuration - Another job of the same job type is already scheduled with this cron expression, errorCode=E7000, mainKlass=class org.hisp.dhis.scheduling.JobConfiguration, errorKlass=null, value=null}] (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,732 Validation of 'File resource clean up' failed. (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,732 [ErrorReport{message=Failed to add/update job configuration - Another job of the same job type is already scheduled with this cron expression, errorCode=E7000, mainKlass=class org.hisp.dhis.scheduling.JobConfiguration, errorKlass=null, value=null}] (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,866 Validation of 'Kafka Tracker Consume' failed. (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:43,866 [ErrorReport{message=Failed to add/update job configuration - Trying to add job with continuous exection while there already is a job with continuous exectution of the same job type., errorCode=E7001, mainKlass=class org.hisp.dhis.scheduling.JobConfiguration, errorKlass=null, value=null}] (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:44,012 Validation of 'Remove expired reserved values' failed. (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:44,012 [ErrorReport{message=Failed to add/update job configuration - Another job of the same job type is already scheduled with this cron expression, errorCode=E7000, mainKlass=class org.hisp.dhis.scheduling.JobConfiguration, errorKlass=null, value=null}] (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:44,104 Validation of 'Validation result notification' failed. (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:44,105 [ErrorReport{message=Failed to add/update job configuration - Another job of the same job type is already scheduled with this cron expression, errorCode=E7000, mainKlass=class org.hisp.dhis.scheduling.JobConfiguration, errorKlass=null, value=null}] (JobConfigurationObjectBundleHook.java [taskScheduler-20])
* INFO  2019-03-05 21:49:44,260 (admin) Import:Validation took 1.38 seconds (DefaultObjectBundleValidationService.java [taskScheduler-20])
* INFO  2019-03-05 21:49:44,297 (admin) Import:Done took 7.25 seconds (DefaultMetadataImportService.java [taskScheduler-20])
* INFO  2019-03-05 21:49:44,298 [Level: INFO, category: METADATA_IMPORT, time: Tue Mar 05 21:49:44 CAT 2019, message: (admin) Import:Done took 7.25 seconds] (InMemoryNotifier.java [taskScheduler-20])

kindly assist.

2 Likes
2

Any one to suggest a solution to the above please?

2 Likes
3

@Emma_Kassy - might you have some insight on this? I have never tried this before.

Best,
James.

2 Likes
4

Hello @baps, do you want to merge the two into a new instance or you want to merge into one of them? Either way i’d use the WebAPI for this. You’re able to create editable JSON payloads that you can reconfigure/edit to mitigate conflicts while importing.

3 Likes
5

@paleu256 Either way. I want to have them under one instance. Either into a new instance or merging one to the other. As long as there are merged. How do you do it with WebAPI?

2 Likes
6

Hey there @baps,
When importing a metadata file that contains a new program into an instance where the program does not already exist, the program and all its dependencies must be included in the metadata file you are importing.

I would start by making a program dependency export in one of the instances, this produces such a file:

18
181918×726 64.4 KB

This metadata file should contain most of the data needed by the program. Your org unit structure might be different in the instance where you import the file, and if so, the program will not be connected to any org units after import. You must also set up sharing for the program after import to allow users to see it.

Markus

3 Likes
7

Dear @Markus, I tried the metadata export with dependencies for several tracker programs both yesterday and today and it kept failing and showed these errors in the logger:

image
Not sure what to do next.
Both instances are on the latest build of 2.33.1.

I also tried to see if I could do add a job to do the metadata synchronization between the two instances but when I click on add job, I get this error:
image

@phil @dhis2-tracker @dhis2-platform

Thanks for your help.

8

Hi there @ifeanyiokoye,
could you retrieve the full log entry from the server for this point in time, so we can see what failed in the underlying application?

9

Thanks @Markus and @phil.
Will post the logs as soon as I have them.

10

Dear @Markus,
Please find the logs attached as requested.
Feb 01 Logs.docx (26.4 KB) Jan 31 Logs.docx (44.1 KB)

Thank you for your help

11

Hello Everyone,
We would really appreciate some help with this.
Thank you

12

Dear @ifeanyiokoye,
It seems likely that the issue you are facing relates to a system bug. It would be great if you can create a bug report in jira.dhis2.org, and upload your metadata file as well as general steps to reproduce.

Best regards,
Markus

13

Dear @Markus,
I have done this as requested. Please see the issue here
https://jira.dhis2.org/browse/DHIS2-8342
Thank you

@dhis2-platform @dhis2-backend

14

Nice catch @ifeanyiokoye.

1 Like
15

Hi @ifeanyiokoye,

Can you give @dhis2-test-qa some more information/steps to reproduce in the linked issue? Looks like it is currently in “NEEDS INFO”.

Thanks,
Karoline