Controlling datamart scheduling

Support - Assistance technique
1

Hi there Devs.

I have two separate instances of DHIS2 (version 2.8) on the same
server. I would like to be able to control the times at which the data
mart executes, so that the processes are not competing for resources.
Is there anyway to do this, short of a recompile?

Best regards,
Jason

2

Hi Jason,

sorry there is no proper way of doing this through the system at the
moment. I think we can include this functionality. As a work-around
you can set the server clock a few hours forward, start/stop
scheduling on your second server, then set the server clock back.

Lars

···

On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering <jason.p.pickering@gmail.com> wrote:

Hi there Devs.

I have two separate instances of DHIS2 (version 2.8) on the same
server. I would like to be able to control the times at which the data
mart executes, so that the processes are not competing for resources.
Is there anyway to do this, short of a recompile?

Best regards,
Jason

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

3

Hmm. Sounds messy as there are a number of other scheduled jobs which I normally run after the data mart. Another possibility would be be to trigger this though the WebAPI.

Would this be possible with a custom version and if so could you point me to what I need to modify?

···

–

Sent from my mobile

On Jun 5, 2012 7:48 PM, “Lars Helge Øverland” larshelge@gmail.com wrote:

Hi Jason,

sorry there is no proper way of doing this through the system at the

moment. I think we can include this functionality. As a work-around

you can set the server clock a few hours forward, start/stop

scheduling on your second server, then set the server clock back.

Lars

On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering > > jason.p.pickering@gmail.com wrote:

Hi there Devs.

I have two separate instances of DHIS2 (version 2.8) on the same

server. I would like to be able to control the times at which the data

mart executes, so that the processes are not competing for resources.

Is there anyway to do this, short of a recompile?

Best regards,

Jason

Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

4

Expose triggering of data mart exports through the web api sounds
useful. What kind of interface (input params) to the process would be
most useful?

···

On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering <jason.p.pickering@gmail.com> wrote:

Hmm. Sounds messy as there are a number of other scheduled jobs which I
normally run after the data mart. Another possibility would be be to trigger
this though the WebAPI.

Would this be possible with a custom version and if so could you point me to
what I need to modify?

--
Sent from my mobile

On Jun 5, 2012 7:48 PM, "Lars Helge Øverland" <larshelge@gmail.com> wrote:

Hi Jason,

sorry there is no proper way of doing this through the system at the
moment. I think we can include this functionality. As a work-around
you can set the server clock a few hours forward, start/stop
scheduling on your second server, then set the server clock back.

Lars

On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering >> <jason.p.pickering@gmail.com> wrote:
> Hi there Devs.
>
> I have two separate instances of DHIS2 (version 2.8) on the same
> server. I would like to be able to control the times at which the data
> mart executes, so that the processes are not competing for resources.
> Is there anyway to do this, short of a recompile?
>
> Best regards,
> Jason
>
> _______________________________________________
> Mailing list: DHIS 2 developers in Launchpad
> Post to : dhis2-devs@lists.launchpad.net
> Unsubscribe : DHIS 2 developers in Launchpad
> More help : ListHelp - Launchpad Help

5

Just thinking aloud, but since the introduction of 2.8,there is not much to parameterize. Would just like to be able to trigger the set data mart task with a cron job based on a particular circumstance, for instance a time or particular event . This could be extended to the resource tables as well which often need to be regenerated by for instance the addition of a new organization unit.

···

–

Sent from my mobile

On Jun 5, 2012 8:26 PM, “Lars Helge Øverland” larshelge@gmail.com wrote:

Expose triggering of data mart exports through the web api sounds

useful. What kind of interface (input params) to the process would be

most useful?

On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering > > jason.p.pickering@gmail.com wrote:

Hmm. Sounds messy as there are a number of other scheduled jobs which I

normally run after the data mart. Another possibility would be be to trigger

this though the WebAPI.

Would this be possible with a custom version and if so could you point me to

what I need to modify?

–

Sent from my mobile

On Jun 5, 2012 7:48 PM, “Lars Helge Øverland” larshelge@gmail.com wrote:

Hi Jason,

sorry there is no proper way of doing this through the system at the

moment. I think we can include this functionality. As a work-around

you can set the server clock a few hours forward, start/stop

scheduling on your second server, then set the server clock back.

Lars

On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering > > >> jason.p.pickering@gmail.com wrote:

Hi there Devs.

I have two separate instances of DHIS2 (version 2.8) on the same

server. I would like to be able to control the times at which the data

mart executes, so that the processes are not competing for resources.

Is there anyway to do this, short of a recompile?

Best regards,

Jason

Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

6

Okay. Problem is the scheduling implementation does not support custom
time setups / cron expressiosn well.. so it will be a bit of work.
Feel free to write a blueprint.

···

On Tue, Jun 5, 2012 at 8:47 PM, Jason Pickering <jason.p.pickering@gmail.com> wrote:

Just thinking aloud, but since the introduction of 2.8,there is not much to
parameterize. Would just like to be able to trigger the set data mart task
with a cron job based on a particular circumstance, for instance a time or
particular event . This could be extended to the resource tables as well
which often need to be regenerated by for instance the addition of a new
organization unit.

--
Sent from my mobile

On Jun 5, 2012 8:26 PM, "Lars Helge Øverland" <larshelge@gmail.com> wrote:

Expose triggering of data mart exports through the web api sounds
useful. What kind of interface (input params) to the process would be
most useful?

On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering >> <jason.p.pickering@gmail.com> wrote:
> Hmm. Sounds messy as there are a number of other scheduled jobs which I
> normally run after the data mart. Another possibility would be be to
> trigger
> this though the WebAPI.
>
> Would this be possible with a custom version and if so could you point
> me to
> what I need to modify?
>
> --
> Sent from my mobile
>
> On Jun 5, 2012 7:48 PM, "Lars Helge Øverland" <larshelge@gmail.com> >> > wrote:
>>
>> Hi Jason,
>>
>> sorry there is no proper way of doing this through the system at the
>> moment. I think we can include this functionality. As a work-around
>> you can set the server clock a few hours forward, start/stop
>> scheduling on your second server, then set the server clock back.
>>
>> Lars
>>
>>
>> On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering >> >> <jason.p.pickering@gmail.com> wrote:
>> > Hi there Devs.
>> >
>> > I have two separate instances of DHIS2 (version 2.8) on the same
>> > server. I would like to be able to control the times at which the
>> > data
>> > mart executes, so that the processes are not competing for resources.
>> > Is there anyway to do this, short of a recompile?
>> >
>> > Best regards,
>> > Jason
>> >
>> > _______________________________________________
>> > Mailing list: DHIS 2 developers in Launchpad
>> > Post to : dhis2-devs@lists.launchpad.net
>> > Unsubscribe : DHIS 2 developers in Launchpad
>> > More help : ListHelp - Launchpad Help

7

It may be too obvious to point this out, but if this is "manually"
triggerable from the outside, the cron/time management part could be
in an external script which makes use of the WebAPI.

Since you are already running several other services on the server in
conjunction with the datamart generation, that might be quite a good
way to do it?

Knut

···

On Wed, Jun 6, 2012 at 11:12 AM, Lars Helge Øverland <larshelge@gmail.com> wrote:

Okay. Problem is the scheduling implementation does not support custom
time setups / cron expressiosn well.. so it will be a bit of work.
Feel free to write a blueprint.

On Tue, Jun 5, 2012 at 8:47 PM, Jason Pickering > <jason.p.pickering@gmail.com> wrote:

Just thinking aloud, but since the introduction of 2.8,there is not much to
parameterize. Would just like to be able to trigger the set data mart task
with a cron job based on a particular circumstance, for instance a time or
particular event . This could be extended to the resource tables as well
which often need to be regenerated by for instance the addition of a new
organization unit.

--
Sent from my mobile

On Jun 5, 2012 8:26 PM, "Lars Helge Øverland" <larshelge@gmail.com> wrote:

Expose triggering of data mart exports through the web api sounds
useful. What kind of interface (input params) to the process would be
most useful?

On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering >>> <jason.p.pickering@gmail.com> wrote:
> Hmm. Sounds messy as there are a number of other scheduled jobs which I
> normally run after the data mart. Another possibility would be be to
> trigger
> this though the WebAPI.
>
> Would this be possible with a custom version and if so could you point
> me to
> what I need to modify?
>
> --
> Sent from my mobile
>
> On Jun 5, 2012 7:48 PM, "Lars Helge Øverland" <larshelge@gmail.com> >>> > wrote:
>>
>> Hi Jason,
>>
>> sorry there is no proper way of doing this through the system at the
>> moment. I think we can include this functionality. As a work-around
>> you can set the server clock a few hours forward, start/stop
>> scheduling on your second server, then set the server clock back.
>>
>> Lars
>>
>>
>> On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering >>> >> <jason.p.pickering@gmail.com> wrote:
>> > Hi there Devs.
>> >
>> > I have two separate instances of DHIS2 (version 2.8) on the same
>> > server. I would like to be able to control the times at which the
>> > data
>> > mart executes, so that the processes are not competing for resources.
>> > Is there anyway to do this, short of a recompile?
>> >
>> > Best regards,
>> > Jason
>> >
>> > _______________________________________________
>> > Mailing list: DHIS 2 developers in Launchpad
>> > Post to : dhis2-devs@lists.launchpad.net
>> > Unsubscribe : DHIS 2 developers in Launchpad
>> > More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

--
Knut Staring
Dept. of Informatics, University of Oslo
+4791880522

8

(just got Knut’s email, sending anyway…)

For a shorter term solution, wouldn’t it be possible to trigger the manual datamart job with two dates (and possibly a list of period types) through the web-api?

Time setup/cron jobs would be handled outside DHIS in this case.

Ola

···

Ola Hodne Titlestad (Mr)

HISP
Department of Informatics
University of Oslo

Mobile: +47 48069736
Home address: Vetlandsvn. 95B, 0685 Oslo, Norway. Googlemaps link

On 6 June 2012 11:12, Lars Helge Øverland larshelge@gmail.com wrote:

Okay. Problem is the scheduling implementation does not support custom

time setups / cron expressiosn well… so it will be a bit of work.

Feel free to write a blueprint.

On Tue, Jun 5, 2012 at 8:47 PM, Jason Pickering > jason.p.pickering@gmail.com wrote:

Just thinking aloud, but since the introduction of 2.8,there is not much to

parameterize. Would just like to be able to trigger the set data mart task

with a cron job based on a particular circumstance, for instance a time or

particular event . This could be extended to the resource tables as well

which often need to be regenerated by for instance the addition of a new

organization unit.

–

Sent from my mobile

On Jun 5, 2012 8:26 PM, “Lars Helge Øverland” larshelge@gmail.com wrote:

Expose triggering of data mart exports through the web api sounds

useful. What kind of interface (input params) to the process would be

most useful?

On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering > > >> jason.p.pickering@gmail.com wrote:

Hmm. Sounds messy as there are a number of other scheduled jobs which I

normally run after the data mart. Another possibility would be be to

trigger

this though the WebAPI.

Would this be possible with a custom version and if so could you point

me to

what I need to modify?

–

Sent from my mobile

On Jun 5, 2012 7:48 PM, “Lars Helge Øverland” larshelge@gmail.com > > >> > wrote:

Hi Jason,

sorry there is no proper way of doing this through the system at the

moment. I think we can include this functionality. As a work-around

you can set the server clock a few hours forward, start/stop

scheduling on your second server, then set the server clock back.

Lars

On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering > > >> >> jason.p.pickering@gmail.com wrote:

Hi there Devs.

I have two separate instances of DHIS2 (version 2.8) on the same

server. I would like to be able to control the times at which the

data

mart executes, so that the processes are not competing for resources.

Is there anyway to do this, short of a recompile?

Best regards,

Jason

Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

Mailing list: https://launchpad.net/~dhis2-devs

Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs

More help : https://help.launchpad.net/ListHelp

9

I guess there are two separate issues here really.

1) Some sort of UI to enable the scheduled process to be adjusted. The
specific use case here (possibly common) is that we have two instances
on a single server. It would be better to try and schedule these jobs
at different times, so that they are not both competing for CPU/Memory
at the same time.

2) The ability to trigger the datamart through a call to the WebAPI.
You seem to hint that this is possible, but I am not sure how to do
it. If it is, then it solves my problem, as I can use use a simple
script to start Server 1 at a certain time and Server 2 at another
time. There may be other needs for external systems to request a data
mart job however.

I will try and work this into at least one blueprint (UI for Datamart
scheduling). Not sure about the second point. Maybe it is already
possible?

Regards,
Jason

···

On Wed, Jun 6, 2012 at 11:29 AM, Ola Hodne Titlestad <olati@ifi.uio.no> wrote:

(just got Knut's email, sending anyway...)

For a shorter term solution, wouldn't it be possible to trigger the manual
datamart job with two dates (and possibly a list of period types) through
the web-api?

Time setup/cron jobs would be handled outside DHIS in this case.

Ola
-----

----------------------------------
Ola Hodne Titlestad (Mr)
HISP
Department of Informatics
University of Oslo

Mobile: +47 48069736
Home address: Vetlandsvn. 95B, 0685 Oslo, Norway. Googlemaps link

On 6 June 2012 11:12, Lars Helge Øverland <larshelge@gmail.com> wrote:

Okay. Problem is the scheduling implementation does not support custom
time setups / cron expressiosn well.. so it will be a bit of work.
Feel free to write a blueprint.

On Tue, Jun 5, 2012 at 8:47 PM, Jason Pickering >> <jason.p.pickering@gmail.com> wrote:
> Just thinking aloud, but since the introduction of 2.8,there is not much
> to
> parameterize. Would just like to be able to trigger the set data mart
> task
> with a cron job based on a particular circumstance, for instance a time
> or
> particular event . This could be extended to the resource tables as well
> which often need to be regenerated by for instance the addition of a new
> organization unit.
>
> --
> Sent from my mobile
>
> On Jun 5, 2012 8:26 PM, "Lars Helge Øverland" <larshelge@gmail.com> >> > wrote:
>>
>> Expose triggering of data mart exports through the web api sounds
>> useful. What kind of interface (input params) to the process would be
>> most useful?
>>
>> On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering >> >> <jason.p.pickering@gmail.com> wrote:
>> > Hmm. Sounds messy as there are a number of other scheduled jobs which
>> > I
>> > normally run after the data mart. Another possibility would be be to
>> > trigger
>> > this though the WebAPI.
>> >
>> > Would this be possible with a custom version and if so could you
>> > point
>> > me to
>> > what I need to modify?
>> >
>> > --
>> > Sent from my mobile
>> >
>> > On Jun 5, 2012 7:48 PM, "Lars Helge Øverland" <larshelge@gmail.com> >> >> > wrote:
>> >>
>> >> Hi Jason,
>> >>
>> >> sorry there is no proper way of doing this through the system at the
>> >> moment. I think we can include this functionality. As a work-around
>> >> you can set the server clock a few hours forward, start/stop
>> >> scheduling on your second server, then set the server clock back.
>> >>
>> >> Lars
>> >>
>> >>
>> >> On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering >> >> >> <jason.p.pickering@gmail.com> wrote:
>> >> > Hi there Devs.
>> >> >
>> >> > I have two separate instances of DHIS2 (version 2.8) on the same
>> >> > server. I would like to be able to control the times at which the
>> >> > data
>> >> > mart executes, so that the processes are not competing for
>> >> > resources.
>> >> > Is there anyway to do this, short of a recompile?
>> >> >
>> >> > Best regards,
>> >> > Jason
>> >> >
>> >> > _______________________________________________
>> >> > Mailing list: DHIS 2 developers in Launchpad
>> >> > Post to : dhis2-devs@lists.launchpad.net
>> >> > Unsubscribe : DHIS 2 developers in Launchpad
>> >> > More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

10

2) The ability to trigger the datamart through a call to the WebAPI.
You seem to hint that this is possible, but I am not sure how to do
it. If it is, then it solves my problem, as I can use use a simple
script to start Server 1 at a certain time and Server 2 at another
time. There may be other needs for external systems to request a data
mart job however.

This is currently not possible.

···

--
Morten

I will try and work this into at least one blueprint (UI for Datamart
scheduling). Not sure about the second point. Maybe it is already
possible?

Regards,
Jason

On Wed, Jun 6, 2012 at 11:29 AM, Ola Hodne Titlestad <olati@ifi.uio.no> wrote:

(just got Knut's email, sending anyway...)

For a shorter term solution, wouldn't it be possible to trigger the manual
datamart job with two dates (and possibly a list of period types) through
the web-api?

Time setup/cron jobs would be handled outside DHIS in this case.

Ola
-----

----------------------------------
Ola Hodne Titlestad (Mr)
HISP
Department of Informatics
University of Oslo

Mobile: +47 48069736
Home address: Vetlandsvn. 95B, 0685 Oslo, Norway. Googlemaps link

On 6 June 2012 11:12, Lars Helge Øverland <larshelge@gmail.com> wrote:

Okay. Problem is the scheduling implementation does not support custom
time setups / cron expressiosn well.. so it will be a bit of work.
Feel free to write a blueprint.

On Tue, Jun 5, 2012 at 8:47 PM, Jason Pickering >>> <jason.p.pickering@gmail.com> wrote:
> Just thinking aloud, but since the introduction of 2.8,there is not much
> to
> parameterize. Would just like to be able to trigger the set data mart
> task
> with a cron job based on a particular circumstance, for instance a time
> or
> particular event . This could be extended to the resource tables as well
> which often need to be regenerated by for instance the addition of a new
> organization unit.
>
> --
> Sent from my mobile
>
> On Jun 5, 2012 8:26 PM, "Lars Helge Øverland" <larshelge@gmail.com> >>> > wrote:
>>
>> Expose triggering of data mart exports through the web api sounds
>> useful. What kind of interface (input params) to the process would be
>> most useful?
>>
>> On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering >>> >> <jason.p.pickering@gmail.com> wrote:
>> > Hmm. Sounds messy as there are a number of other scheduled jobs which
>> > I
>> > normally run after the data mart. Another possibility would be be to
>> > trigger
>> > this though the WebAPI.
>> >
>> > Would this be possible with a custom version and if so could you
>> > point
>> > me to
>> > what I need to modify?
>> >
>> > --
>> > Sent from my mobile
>> >
>> > On Jun 5, 2012 7:48 PM, "Lars Helge Øverland" <larshelge@gmail.com> >>> >> > wrote:
>> >>
>> >> Hi Jason,
>> >>
>> >> sorry there is no proper way of doing this through the system at the
>> >> moment. I think we can include this functionality. As a work-around
>> >> you can set the server clock a few hours forward, start/stop
>> >> scheduling on your second server, then set the server clock back.
>> >>
>> >> Lars
>> >>
>> >>
>> >> On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering >>> >> >> <jason.p.pickering@gmail.com> wrote:
>> >> > Hi there Devs.
>> >> >
>> >> > I have two separate instances of DHIS2 (version 2.8) on the same
>> >> > server. I would like to be able to control the times at which the
>> >> > data
>> >> > mart executes, so that the processes are not competing for
>> >> > resources.
>> >> > Is there anyway to do this, short of a recompile?
>> >> >
>> >> > Best regards,
>> >> > Jason
>> >> >
>> >> > _______________________________________________
>> >> > Mailing list: DHIS 2 developers in Launchpad
>> >> > Post to : dhis2-devs@lists.launchpad.net
>> >> > Unsubscribe : DHIS 2 developers in Launchpad
>> >> > More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

11

2) The ability to trigger the datamart through a call to the WebAPI.
You seem to hint that this is possible, but I am not sure how to do
it. If it is, then it solves my problem, as I can use use a simple
script to start Server 1 at a certain time and Server 2 at another
time. There may be other needs for external systems to request a data
mart job however.

This is currently not possible.

I am quite sure there used to be a url which did this, but not part of
the new web api stuff,

···

On 10 June 2012 21:38, Morten Olav Hansen <mortenoh@gmail.com> wrote:

--
Morten

I will try and work this into at least one blueprint (UI for Datamart
scheduling). Not sure about the second point. Maybe it is already
possible?

Regards,
Jason

On Wed, Jun 6, 2012 at 11:29 AM, Ola Hodne Titlestad <olati@ifi.uio.no> wrote:

(just got Knut's email, sending anyway...)

For a shorter term solution, wouldn't it be possible to trigger the manual
datamart job with two dates (and possibly a list of period types) through
the web-api?

Time setup/cron jobs would be handled outside DHIS in this case.

Ola
-----

----------------------------------
Ola Hodne Titlestad (Mr)
HISP
Department of Informatics
University of Oslo

Mobile: +47 48069736
Home address: Vetlandsvn. 95B, 0685 Oslo, Norway. Googlemaps link

On 6 June 2012 11:12, Lars Helge Øverland <larshelge@gmail.com> wrote:

Okay. Problem is the scheduling implementation does not support custom
time setups / cron expressiosn well.. so it will be a bit of work.
Feel free to write a blueprint.

On Tue, Jun 5, 2012 at 8:47 PM, Jason Pickering >>>> <jason.p.pickering@gmail.com> wrote:
> Just thinking aloud, but since the introduction of 2.8,there is not much
> to
> parameterize. Would just like to be able to trigger the set data mart
> task
> with a cron job based on a particular circumstance, for instance a time
> or
> particular event . This could be extended to the resource tables as well
> which often need to be regenerated by for instance the addition of a new
> organization unit.
>
> --
> Sent from my mobile
>
> On Jun 5, 2012 8:26 PM, "Lars Helge Øverland" <larshelge@gmail.com> >>>> > wrote:
>>
>> Expose triggering of data mart exports through the web api sounds
>> useful. What kind of interface (input params) to the process would be
>> most useful?
>>
>> On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering >>>> >> <jason.p.pickering@gmail.com> wrote:
>> > Hmm. Sounds messy as there are a number of other scheduled jobs which
>> > I
>> > normally run after the data mart. Another possibility would be be to
>> > trigger
>> > this though the WebAPI.
>> >
>> > Would this be possible with a custom version and if so could you
>> > point
>> > me to
>> > what I need to modify?
>> >
>> > --
>> > Sent from my mobile
>> >
>> > On Jun 5, 2012 7:48 PM, "Lars Helge Øverland" <larshelge@gmail.com> >>>> >> > wrote:
>> >>
>> >> Hi Jason,
>> >>
>> >> sorry there is no proper way of doing this through the system at the
>> >> moment. I think we can include this functionality. As a work-around
>> >> you can set the server clock a few hours forward, start/stop
>> >> scheduling on your second server, then set the server clock back.
>> >>
>> >> Lars
>> >>
>> >>
>> >> On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering >>>> >> >> <jason.p.pickering@gmail.com> wrote:
>> >> > Hi there Devs.
>> >> >
>> >> > I have two separate instances of DHIS2 (version 2.8) on the same
>> >> > server. I would like to be able to control the times at which the
>> >> > data
>> >> > mart executes, so that the processes are not competing for
>> >> > resources.
>> >> > Is there anyway to do this, short of a recompile?
>> >> >
>> >> > Best regards,
>> >> > Jason
>> >> >
>> >> > _______________________________________________
>> >> > Mailing list: DHIS 2 developers in Launchpad
>> >> > Post to : dhis2-devs@lists.launchpad.net
>> >> > Unsubscribe : DHIS 2 developers in Launchpad
>> >> > More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

12

I suppose we could do this with CURL fairly easily?

Here is the request I think

"GET /dhis/dhis-web-reporting/startExport.action?startDate=2011-01-01&endDate=2012-06-11&periodType=Weekly&periodType=Monthly&periodType=Yearly
HTTP/1.1" 200

Any thoughts?

Regards,
Jason

···

On Sun, Jun 10, 2012 at 11:28 PM, Bob Jolliffe <bobjolliffe@gmail.com> wrote:

On 10 June 2012 21:38, Morten Olav Hansen <mortenoh@gmail.com> wrote:

2) The ability to trigger the datamart through a call to the WebAPI.
You seem to hint that this is possible, but I am not sure how to do
it. If it is, then it solves my problem, as I can use use a simple
script to start Server 1 at a certain time and Server 2 at another
time. There may be other needs for external systems to request a data
mart job however.

This is currently not possible.

I am quite sure there used to be a url which did this, but not part of
the new web api stuff,

--
Morten

I will try and work this into at least one blueprint (UI for Datamart
scheduling). Not sure about the second point. Maybe it is already
possible?

Regards,
Jason

On Wed, Jun 6, 2012 at 11:29 AM, Ola Hodne Titlestad <olati@ifi.uio.no> wrote:

(just got Knut's email, sending anyway...)

For a shorter term solution, wouldn't it be possible to trigger the manual
datamart job with two dates (and possibly a list of period types) through
the web-api?

Time setup/cron jobs would be handled outside DHIS in this case.

Ola
-----

----------------------------------
Ola Hodne Titlestad (Mr)
HISP
Department of Informatics
University of Oslo

Mobile: +47 48069736
Home address: Vetlandsvn. 95B, 0685 Oslo, Norway. Googlemaps link

On 6 June 2012 11:12, Lars Helge Øverland <larshelge@gmail.com> wrote:

Okay. Problem is the scheduling implementation does not support custom
time setups / cron expressiosn well.. so it will be a bit of work.
Feel free to write a blueprint.

On Tue, Jun 5, 2012 at 8:47 PM, Jason Pickering >>>>> <jason.p.pickering@gmail.com> wrote:
> Just thinking aloud, but since the introduction of 2.8,there is not much
> to
> parameterize. Would just like to be able to trigger the set data mart
> task
> with a cron job based on a particular circumstance, for instance a time
> or
> particular event . This could be extended to the resource tables as well
> which often need to be regenerated by for instance the addition of a new
> organization unit.
>
> --
> Sent from my mobile
>
> On Jun 5, 2012 8:26 PM, "Lars Helge Øverland" <larshelge@gmail.com> >>>>> > wrote:
>>
>> Expose triggering of data mart exports through the web api sounds
>> useful. What kind of interface (input params) to the process would be
>> most useful?
>>
>> On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering >>>>> >> <jason.p.pickering@gmail.com> wrote:
>> > Hmm. Sounds messy as there are a number of other scheduled jobs which
>> > I
>> > normally run after the data mart. Another possibility would be be to
>> > trigger
>> > this though the WebAPI.
>> >
>> > Would this be possible with a custom version and if so could you
>> > point
>> > me to
>> > what I need to modify?
>> >
>> > --
>> > Sent from my mobile
>> >
>> > On Jun 5, 2012 7:48 PM, "Lars Helge Øverland" <larshelge@gmail.com> >>>>> >> > wrote:
>> >>
>> >> Hi Jason,
>> >>
>> >> sorry there is no proper way of doing this through the system at the
>> >> moment. I think we can include this functionality. As a work-around
>> >> you can set the server clock a few hours forward, start/stop
>> >> scheduling on your second server, then set the server clock back.
>> >>
>> >> Lars
>> >>
>> >>
>> >> On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering >>>>> >> >> <jason.p.pickering@gmail.com> wrote:
>> >> > Hi there Devs.
>> >> >
>> >> > I have two separate instances of DHIS2 (version 2.8) on the same
>> >> > server. I would like to be able to control the times at which the
>> >> > data
>> >> > mart executes, so that the processes are not competing for
>> >> > resources.
>> >> > Is there anyway to do this, short of a recompile?
>> >> >
>> >> > Best regards,
>> >> > Jason
>> >> >
>> >> > _______________________________________________
>> >> > Mailing list: DHIS 2 developers in Launchpad
>> >> > Post to : dhis2-devs@lists.launchpad.net
>> >> > Unsubscribe : DHIS 2 developers in Launchpad
>> >> > More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

13

Triggering of the datamart can be accomplished using Curl pretty
simply in fact with something like

curl "DHIS2 App Hub;
-u admin:district -v

What is a bit perplexing is the AJAX requests which happen after the
process starts.

Every second something like

GET /dhis/dhis-web-commons-ajax-json/getNotifications.action?category=DATAMART&lastUid=lnRDYj19kNI

gets triggered to update the AJAX window which displays the progress
of the datamart, as of course you know. What is a bit puzzling is
where these UID come from? Of course, it would be nice to parse all of
the data which comes back from the server, just a bit unsure how to
start to parse it from the command line.

Anyway, this solves the immediate problem of how to trigger the data
mart process at a time other than what the scheduler can do at the
moment.

Regards,
Jason

···

On Mon, Jun 11, 2012 at 9:26 AM, Jason Pickering <jason.p.pickering@gmail.com> wrote:

I suppose we could do this with CURL fairly easily?

Here is the request I think

"GET /dhis/dhis-web-reporting/startExport.action?startDate=2011-01-01&endDate=2012-06-11&periodType=Weekly&periodType=Monthly&periodType=Yearly
HTTP/1.1" 200

Any thoughts?

Regards,
Jason

On Sun, Jun 10, 2012 at 11:28 PM, Bob Jolliffe <bobjolliffe@gmail.com> wrote:

On 10 June 2012 21:38, Morten Olav Hansen <mortenoh@gmail.com> wrote:

2) The ability to trigger the datamart through a call to the WebAPI.
You seem to hint that this is possible, but I am not sure how to do
it. If it is, then it solves my problem, as I can use use a simple
script to start Server 1 at a certain time and Server 2 at another
time. There may be other needs for external systems to request a data
mart job however.

This is currently not possible.

I am quite sure there used to be a url which did this, but not part of
the new web api stuff,

--
Morten

I will try and work this into at least one blueprint (UI for Datamart
scheduling). Not sure about the second point. Maybe it is already
possible?

Regards,
Jason

On Wed, Jun 6, 2012 at 11:29 AM, Ola Hodne Titlestad <olati@ifi.uio.no> wrote:

(just got Knut's email, sending anyway...)

For a shorter term solution, wouldn't it be possible to trigger the manual
datamart job with two dates (and possibly a list of period types) through
the web-api?

Time setup/cron jobs would be handled outside DHIS in this case.

Ola
-----

----------------------------------
Ola Hodne Titlestad (Mr)
HISP
Department of Informatics
University of Oslo

Mobile: +47 48069736
Home address: Vetlandsvn. 95B, 0685 Oslo, Norway. Googlemaps link

On 6 June 2012 11:12, Lars Helge Øverland <larshelge@gmail.com> wrote:

Okay. Problem is the scheduling implementation does not support custom
time setups / cron expressiosn well.. so it will be a bit of work.
Feel free to write a blueprint.

On Tue, Jun 5, 2012 at 8:47 PM, Jason Pickering >>>>>> <jason.p.pickering@gmail.com> wrote:
> Just thinking aloud, but since the introduction of 2.8,there is not much
> to
> parameterize. Would just like to be able to trigger the set data mart
> task
> with a cron job based on a particular circumstance, for instance a time
> or
> particular event . This could be extended to the resource tables as well
> which often need to be regenerated by for instance the addition of a new
> organization unit.
>
> --
> Sent from my mobile
>
> On Jun 5, 2012 8:26 PM, "Lars Helge Øverland" <larshelge@gmail.com> >>>>>> > wrote:
>>
>> Expose triggering of data mart exports through the web api sounds
>> useful. What kind of interface (input params) to the process would be
>> most useful?
>>
>> On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering >>>>>> >> <jason.p.pickering@gmail.com> wrote:
>> > Hmm. Sounds messy as there are a number of other scheduled jobs which
>> > I
>> > normally run after the data mart. Another possibility would be be to
>> > trigger
>> > this though the WebAPI.
>> >
>> > Would this be possible with a custom version and if so could you
>> > point
>> > me to
>> > what I need to modify?
>> >
>> > --
>> > Sent from my mobile
>> >
>> > On Jun 5, 2012 7:48 PM, "Lars Helge Øverland" <larshelge@gmail.com> >>>>>> >> > wrote:
>> >>
>> >> Hi Jason,
>> >>
>> >> sorry there is no proper way of doing this through the system at the
>> >> moment. I think we can include this functionality. As a work-around
>> >> you can set the server clock a few hours forward, start/stop
>> >> scheduling on your second server, then set the server clock back.
>> >>
>> >> Lars
>> >>
>> >>
>> >> On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering >>>>>> >> >> <jason.p.pickering@gmail.com> wrote:
>> >> > Hi there Devs.
>> >> >
>> >> > I have two separate instances of DHIS2 (version 2.8) on the same
>> >> > server. I would like to be able to control the times at which the
>> >> > data
>> >> > mart executes, so that the processes are not competing for
>> >> > resources.
>> >> > Is there anyway to do this, short of a recompile?
>> >> >
>> >> > Best regards,
>> >> > Jason
>> >> >
>> >> > _______________________________________________
>> >> > Mailing list: DHIS 2 developers in Launchpad
>> >> > Post to : dhis2-devs@lists.launchpad.net
>> >> > Unsubscribe : DHIS 2 developers in Launchpad
>> >> > More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help

_______________________________________________
Mailing list: DHIS 2 developers in Launchpad
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : DHIS 2 developers in Launchpad
More help : ListHelp - Launchpad Help