Would like to know how you are handling in-general integrations where delta data needs to be updated to datasets.
For example: let’s say we have an education management information system openEMIS, that record attendance daily, and we want to summarize it and load to dhis2 to an Attendance Agg dataset daily, it may also happen that some of their attendances they may edit after few days if some corrections needed
What’s the strategy you use for delta data loading? or do you load all data say last 7 days?
Would like to know your thoughts and reccomendations.