Executing [Schedule automated aggregation] only working for [Last month]

Hi Devs

We’ve noticed our Aggregation-Queries are only loading values for the last month regardless of the selected time frame.

Is there a known bug or known cause for this problem? Perhaps its a data-quality issue (we’re still refining our data quality kinks, i.e. there may be programstageinstance.executiondate dates that violate expected values, e.g. date value “0013-02-13” and “0022-02-06” is present). Is this the likely cause? We cannot aggregate data before 24 Jan 2015…

Greg

···

Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

Hi Greg,

okay, we will look into this.

regards,

Lars

···

On Wed, Feb 25, 2015 at 11:26 PM, Greg Rowles <greg.rowles@gmail.com> wrote:

Hi Devs

We've noticed our Aggregation-Queries are only loading values for the last
month regardless of the selected time frame.

Is there a known bug or known cause for this problem? Perhaps its a
data-quality issue (we're still refining our data quality kinks, i.e. there
may be programstageinstance.executiondate dates that violate expected
values, e.g. date value "0013-02-13" and "0022-02-06" is present). Is
this the likely cause? We cannot aggregate data before 24 Jan 2015...

Greg

--
*Health Information Systems Program - South Africa*
*- - - - - - - **- - - - - - - **- - - - - - - **- - - - - - - **- - - -
- *
Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

Hi Greg,

Can you give me more information about snapshots, your formulas, your event cases, what the Task strategy is selected in Schedule automated aggregation … ?

Best regards,

Tran Chau

···

On Thu, Feb 26, 2015 at 5:26 AM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs

We’ve noticed our Aggregation-Queries are only loading values for the last month regardless of the selected time frame.

Is there a known bug or known cause for this problem? Perhaps its a data-quality issue (we’re still refining our data quality kinks, i.e. there may be programstageinstance.executiondate dates that violate expected values, e.g. date value “0013-02-13” and “0022-02-06” is present). Is this the likely cause? We cannot aggregate data before 24 Jan 2015…

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Hi Tran

The schedule was changed from “12 months” to “6 months” but we are testing aggregation outcomes using the “Execute” command (most of the time it just hangs with “504 (Gateway Time-out)” and we also noticed the same for “Manual Aggregation”, preview & save options). Our basic formulas use [Visited selected program stage] criteria while we have a set using more complex DateDiff() formulas. We know we have tracker data starting in Aug-2014 up till a few minutes ago:

image

Complex Query:

image

Basic Query:

image

I hope this is what you were asking for…?

Best,

Greg

···

On Thu, Feb 26, 2015 at 3:05 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Hi Greg,

Can you give me more information about snapshots, your formulas, your event cases, what the Task strategy is selected in Schedule automated aggregation … ?

Best regards,

Tran Chau

On Thu, Feb 26, 2015 at 5:26 AM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs

We’ve noticed our Aggregation-Queries are only loading values for the last month regardless of the selected time frame.

Is there a known bug or known cause for this problem? Perhaps its a data-quality issue (we’re still refining our data quality kinks, i.e. there may be programstageinstance.executiondate dates that violate expected values, e.g. date value “0013-02-13” and “0022-02-06” is present). Is this the likely cause? We cannot aggregate data before 24 Jan 2015…

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

Thank Greg,

I tried creating a formula as your simple formula and chose the Task strategy as 6 months, the data is generated and saved ok for 6 months in my side. Please see the attachment snapshots.

I guess maybe data in your database got some issues.

Besides, when Task strategy is changedd from “12 months” to “6 months”, we have to click Stop button and Start button before clicking on Execute button. If not, the system will run with the old Task strategy which we did set when we start Schedule automated aggregation before.

Best regards,

Tran Chau

image

image

image

image

···

On Thu, Feb 26, 2015 at 10:31 PM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Tran

The schedule was changed from “12 months” to “6 months” but we are testing aggregation outcomes using the “Execute” command (most of the time it just hangs with “504 (Gateway Time-out)” and we also noticed the same for “Manual Aggregation”, preview & save options). Our basic formulas use [Visited selected program stage] criteria while we have a set using more complex DateDiff() formulas. We know we have tracker data starting in Aug-2014 up till a few minutes ago:

Complex Query:

Basic Query:

I hope this is what you were asking for…?

Best,

Greg

On Thu, Feb 26, 2015 at 3:05 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Hi Greg,

Can you give me more information about snapshots, your formulas, your event cases, what the Task strategy is selected in Schedule automated aggregation … ?

Best regards,

Tran Chau


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Thu, Feb 26, 2015 at 5:26 AM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs

We’ve noticed our Aggregation-Queries are only loading values for the last month regardless of the selected time frame.

Is there a known bug or known cause for this problem? Perhaps its a data-quality issue (we’re still refining our data quality kinks, i.e. there may be programstageinstance.executiondate dates that violate expected values, e.g. date value “0013-02-13” and “0022-02-06” is present). Is this the likely cause? We cannot aggregate data before 24 Jan 2015…

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Thank you Tran

We’ll start testing ASAP… when we figure it out - we’ll explain…

Best,

Greg

image

image

image

···

On Fri, Feb 27, 2015 at 1:35 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Thank Greg,

I tried creating a formula as your simple formula and chose the Task strategy as 6 months, the data is generated and saved ok for 6 months in my side. Please see the attachment snapshots.

I guess maybe data in your database got some issues.

Besides, when Task strategy is changedd from “12 months” to “6 months”, we have to click Stop button and Start button before clicking on Execute button. If not, the system will run with the old Task strategy which we did set when we start Schedule automated aggregation before.

Best regards,

Tran Chau

On Thu, Feb 26, 2015 at 10:31 PM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Tran

The schedule was changed from “12 months” to “6 months” but we are testing aggregation outcomes using the “Execute” command (most of the time it just hangs with “504 (Gateway Time-out)” and we also noticed the same for “Manual Aggregation”, preview & save options). Our basic formulas use [Visited selected program stage] criteria while we have a set using more complex DateDiff() formulas. We know we have tracker data starting in Aug-2014 up till a few minutes ago:

Complex Query:

Basic Query:

I hope this is what you were asking for…?

Best,

Greg

On Thu, Feb 26, 2015 at 3:05 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Hi Greg,

Can you give me more information about snapshots, your formulas, your event cases, what the Task strategy is selected in Schedule automated aggregation … ?

Best regards,

Tran Chau


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Thu, Feb 26, 2015 at 5:26 AM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs

We’ve noticed our Aggregation-Queries are only loading values for the last month regardless of the selected time frame.

Is there a known bug or known cause for this problem? Perhaps its a data-quality issue (we’re still refining our data quality kinks, i.e. there may be programstageinstance.executiondate dates that violate expected values, e.g. date value “0013-02-13” and “0022-02-06” is present). Is this the likely cause? We cannot aggregate data before 24 Jan 2015…

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

Hi Devs/Tran

Does any of the following make sense to you? Aggregations still fail but I have better error info:

image

FYI - I cannot locate the Aggregation Query Builder “J16EIqxFAau”. It’s not in the current list (I check each one’s details and none have that id). Here is a different screenshot (each aggregate_query_builder error references the same “J16EIqxFAau” id:

image

Any suggestions?

Regards,

Greg

image

image

image

···

On Fri, Feb 27, 2015 at 3:28 PM, Greg Rowles greg.rowles@gmail.com wrote:

Thank you Tran

We’ll start testing ASAP… when we figure it out - we’ll explain…

Best,

Greg

On Fri, Feb 27, 2015 at 1:35 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Thank Greg,

I tried creating a formula as your simple formula and chose the Task strategy as 6 months, the data is generated and saved ok for 6 months in my side. Please see the attachment snapshots.

I guess maybe data in your database got some issues.

Besides, when Task strategy is changedd from “12 months” to “6 months”, we have to click Stop button and Start button before clicking on Execute button. If not, the system will run with the old Task strategy which we did set when we start Schedule automated aggregation before.

Best regards,

Tran Chau


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Thu, Feb 26, 2015 at 10:31 PM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Tran

The schedule was changed from “12 months” to “6 months” but we are testing aggregation outcomes using the “Execute” command (most of the time it just hangs with “504 (Gateway Time-out)” and we also noticed the same for “Manual Aggregation”, preview & save options). Our basic formulas use [Visited selected program stage] criteria while we have a set using more complex DateDiff() formulas. We know we have tracker data starting in Aug-2014 up till a few minutes ago:

Complex Query:

Basic Query:

I hope this is what you were asking for…?

Best,

Greg

On Thu, Feb 26, 2015 at 3:05 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Hi Greg,

Can you give me more information about snapshots, your formulas, your event cases, what the Task strategy is selected in Schedule automated aggregation … ?

Best regards,

Tran Chau


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Thu, Feb 26, 2015 at 5:26 AM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs

We’ve noticed our Aggregation-Queries are only loading values for the last month regardless of the selected time frame.

Is there a known bug or known cause for this problem? Perhaps its a data-quality issue (we’re still refining our data quality kinks, i.e. there may be programstageinstance.executiondate dates that violate expected values, e.g. date value “0013-02-13” and “0022-02-06” is present). Is this the likely cause? We cannot aggregate data before 24 Jan 2015…

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

Hi Devs/Tran

I stumbled across this page somehow but I cannot locate an object with uid value “WFQCq1dDkd1”. How do I dig in further?

image

image

image

image

image

image

···

On Sun, Mar 1, 2015 at 8:09 PM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs/Tran

Does any of the following make sense to you? Aggregations still fail but I have better error info:

FYI - I cannot locate the Aggregation Query Builder “J16EIqxFAau”. It’s not in the current list (I check each one’s details and none have that id). Here is a different screenshot (each aggregate_query_builder error references the same “J16EIqxFAau” id:

Any suggestions?

Regards,

Greg

On Fri, Feb 27, 2015 at 3:28 PM, Greg Rowles greg.rowles@gmail.com wrote:

Thank you Tran

We’ll start testing ASAP… when we figure it out - we’ll explain…

Best,

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Fri, Feb 27, 2015 at 1:35 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Thank Greg,

I tried creating a formula as your simple formula and chose the Task strategy as 6 months, the data is generated and saved ok for 6 months in my side. Please see the attachment snapshots.

I guess maybe data in your database got some issues.

Besides, when Task strategy is changedd from “12 months” to “6 months”, we have to click Stop button and Start button before clicking on Execute button. If not, the system will run with the old Task strategy which we did set when we start Schedule automated aggregation before.

Best regards,

Tran Chau


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Thu, Feb 26, 2015 at 10:31 PM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Tran

The schedule was changed from “12 months” to “6 months” but we are testing aggregation outcomes using the “Execute” command (most of the time it just hangs with “504 (Gateway Time-out)” and we also noticed the same for “Manual Aggregation”, preview & save options). Our basic formulas use [Visited selected program stage] criteria while we have a set using more complex DateDiff() formulas. We know we have tracker data starting in Aug-2014 up till a few minutes ago:

Complex Query:

Basic Query:

I hope this is what you were asking for…?

Best,

Greg

On Thu, Feb 26, 2015 at 3:05 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Hi Greg,

Can you give me more information about snapshots, your formulas, your event cases, what the Task strategy is selected in Schedule automated aggregation … ?

Best regards,

Tran Chau


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Thu, Feb 26, 2015 at 5:26 AM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs

We’ve noticed our Aggregation-Queries are only loading values for the last month regardless of the selected time frame.

Is there a known bug or known cause for this problem? Perhaps its a data-quality issue (we’re still refining our data quality kinks, i.e. there may be programstageinstance.executiondate dates that violate expected values, e.g. date value “0013-02-13” and “0022-02-06” is present). Is this the likely cause? We cannot aggregate data before 24 Jan 2015…

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

Hi Greg,

The uid J16EIqxFAau, which we saw in http://localhost:8080/dhis/api/system/tasks/AGGREGATE_QUERY_BUILDER?lastId=J16EIqxFAau, is not the uid of any aggregate query builder defined.

It is a notification uid which is used as information of execute progress.

Best regards,

Tran Chau.

image

image

image

image

image

image

···

On Mon, Mar 2, 2015 at 2:36 PM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs/Tran

I stumbled across this page somehow but I cannot locate an object with uid value “WFQCq1dDkd1”. How do I dig in further?

On Sun, Mar 1, 2015 at 8:09 PM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs/Tran

Does any of the following make sense to you? Aggregations still fail but I have better error info:

FYI - I cannot locate the Aggregation Query Builder “J16EIqxFAau”. It’s not in the current list (I check each one’s details and none have that id). Here is a different screenshot (each aggregate_query_builder error references the same “J16EIqxFAau” id:

Any suggestions?

Regards,

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Fri, Feb 27, 2015 at 3:28 PM, Greg Rowles greg.rowles@gmail.com wrote:

Thank you Tran

We’ll start testing ASAP… when we figure it out - we’ll explain…

Best,

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Fri, Feb 27, 2015 at 1:35 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Thank Greg,

I tried creating a formula as your simple formula and chose the Task strategy as 6 months, the data is generated and saved ok for 6 months in my side. Please see the attachment snapshots.

I guess maybe data in your database got some issues.

Besides, when Task strategy is changedd from “12 months” to “6 months”, we have to click Stop button and Start button before clicking on Execute button. If not, the system will run with the old Task strategy which we did set when we start Schedule automated aggregation before.

Best regards,

Tran Chau


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Thu, Feb 26, 2015 at 10:31 PM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Tran

The schedule was changed from “12 months” to “6 months” but we are testing aggregation outcomes using the “Execute” command (most of the time it just hangs with “504 (Gateway Time-out)” and we also noticed the same for “Manual Aggregation”, preview & save options). Our basic formulas use [Visited selected program stage] criteria while we have a set using more complex DateDiff() formulas. We know we have tracker data starting in Aug-2014 up till a few minutes ago:

Complex Query:

Basic Query:

I hope this is what you were asking for…?

Best,

Greg

On Thu, Feb 26, 2015 at 3:05 PM, Tran Chau (HISP Vietnam) tran.hispvietnam@gmail.com wrote:

Hi Greg,

Can you give me more information about snapshots, your formulas, your event cases, what the Task strategy is selected in Schedule automated aggregation … ?

Best regards,

Tran Chau


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles

On Thu, Feb 26, 2015 at 5:26 AM, Greg Rowles greg.rowles@gmail.com wrote:

Hi Devs

We’ve noticed our Aggregation-Queries are only loading values for the last month regardless of the selected time frame.

Is there a known bug or known cause for this problem? Perhaps its a data-quality issue (we’re still refining our data quality kinks, i.e. there may be programstageinstance.executiondate dates that violate expected values, e.g. date value “0013-02-13” and “0022-02-06” is present). Is this the likely cause? We cannot aggregate data before 24 Jan 2015…

Greg


Health Information Systems Program - South Africa

**- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - - - ****- - - - - **

Mobile : 073 246 2992
Landline: 021 554 3130
Fax: 086 733 8432
Skype: gregory_rowles


Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp