Upgrade from 2.10 to 2.12 failing

Using the latest 2.12 build from Jenkins.

Looks like something is failing on the startup, but not sure what?

This DB runs fine on 2.10. The first time around, a bunch of timestamps were updated. I killed the server, restarted, but still getting stuck at step 4 /10.

Any tips?

Regards,

Jason

  • INFO 2013-09-24 11:21:23,080 Found the following message senders: [org.hisp.dhis.message.EmailMessageSender@17a220d7, org.hisp.dhis.sms.outbound.SmsSender@151a0f60] (DefaultMessageService.java [main])

  • INFO 2013-09-24 11:21:39,093 Camel context started (DHIS2LifecycleStrategy.java [main])

  • INFO 2013-09-24 11:21:39,094 Searching for routes in directory: /home/testinstance/dhis_home/routes (DHIS2LifecycleStrategy.java [main])

  • INFO 2013-09-24 11:21:40,242 Executing startup routine [1 of 10, runlevel 1]: TableAlteror (DefaultStartupRoutineExecutor.java [main])

  • INFO 2013-09-24 11:21:46,749 Tables updated (TableAlteror.java [main])

  • INFO 2013-09-24 11:21:46,750 Executing startup routine [2 of 10, runlevel 1]: MapViewUpgrader (DefaultStartupRoutineExecutor.java [main])

  • INFO 2013-09-24 11:21:47,012 Executing startup routine [3 of 10, runlevel 2]: IdentityPopulator (DefaultStartupRoutineExecutor.java [main])

Sep 24, 2013 11:21:48 AM org.apache.catalina.core.StandardContext start

SEVERE: Error listenerStart

Sep 24, 2013 11:21:48 AM org.apache.catalina.core.StandardContext start

SEVERE: Context [/testinstance] startup failed due to previous errors

  • INFO 2013-09-24 11:21:48,017 De-registering jdbc driver: org.h2.Driver@65b8b5cd (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: org.hsqldb.jdbc.JDBCDriver@2830803a (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: com.mysql.jdbc.Driver@1ccdf3c2 (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: org.postgresql.Driver@2f1261b1 (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,186 Camel context stopped (DHIS2LifecycleStrategy.java [main])

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads

SEVERE: A web application appears to have started a thread named [Resource Destroyer in BasicResourcePool.close()] but has failed to stop it. This is very likely to create a memory leak.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Transactional resources]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Transaction synchronizations]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Prototype beans currently in creation]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@9db900f]) and a value of type [org.springframework.security.core.context.SecurityContextImpl] (value [org.springframework.security.core.context.SecurityContextImpl@ffffffff: Null authentication]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction name]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current aspect-driven transaction]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Prototype beans currently in creation]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction read-only status]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction isolation level]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Actual transaction active]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [null] (value [com.sun.xml.bind.v2.ClassFactory$1@642bf5bf]) and a value of type [java.util.WeakHashMap] (value [{class org.apache.camel.spring.CamelProducerTemplateFactoryBean=java.lang.ref.WeakReference@32b7e05f, class org.apache.camel.model.PackageScanDefinition=java.lang.ref.WeakReference@45eb96fc, class javax.xml.bind.annotation.adapters.CollapsedStringAdapter=java.lang.ref.WeakReference@6e059e40, class java.util.ArrayList=java.lang.ref.WeakReference@32d8b42e, class org.apache.camel.spring.CamelContextFactoryBean=java.lang.ref.WeakReference@311d5216}]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedInheritableThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedInheritableThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:49 AM org.apache.coyote.http11.Http11AprProtocol start

INFO: Starting Coyote HTTP/1.1 on http-8082

Sep 24, 2013 11:21:49 AM org.apache.catalina.startup.Catalina start

INFO: Server startup in 77181 ms

Hi Jason,

I just upgraded our demo server from 2.10 to 2.12 today. This is what I did to avoid all the troubles.

Steps

  1. service tomcat stop
  2. back up database “pg_dump dhis2 -U dhis | gzip > db.gz” Our database is large so I had to compress it with gzip.
  3. restart postgres
  4. su postgres
  5. psql
  6. DROP DATABASE db;
  7. CREATE DATABASE “db” WITH OWNER “owner” ENCODING ‘UTF8’;
  8. \q
  9. exit
  10. Restore database “gunzip -c db.gz | psql db”
  11. service tomcat start

Its working superb Emoji

Gomez.

···

Date: Tue, 24 Sep 2013 12:26:56 +0200
From: jason.p.pickering@gmail.com
To: dhis2-devs@lists.launchpad.net
Subject: [Dhis2-devs] Upgrade from 2.10 to 2.12 failing

Using the latest 2.12 build from Jenkins.

Looks like something is failing on the startup, but not sure what?

This DB runs fine on 2.10. The first time around, a bunch of timestamps were updated. I killed the server, restarted, but still getting stuck at step 4 /10.

Any tips?

Regards,

Jason

  • INFO 2013-09-24 11:21:23,080 Found the following message senders: [org.hisp.dhis.message.EmailMessageSender@17a220d7, org.hisp.dhis.sms.outbound.SmsSender@151a0f60] (DefaultMessageService.java [main])

  • INFO 2013-09-24 11:21:39,093 Camel context started (DHIS2LifecycleStrategy.java [main])

  • INFO 2013-09-24 11:21:39,094 Searching for routes in directory: /home/testinstance/dhis_home/routes (DHIS2LifecycleStrategy.java [main])

  • INFO 2013-09-24 11:21:40,242 Executing startup routine [1 of 10, runlevel 1]: TableAlteror (DefaultStartupRoutineExecutor.java [main])

  • INFO 2013-09-24 11:21:46,749 Tables updated (TableAlteror.java [main])

  • INFO 2013-09-24 11:21:46,750 Executing startup routine [2 of 10, runlevel 1]: MapViewUpgrader (DefaultStartupRoutineExecutor.java [main])

  • INFO 2013-09-24 11:21:47,012 Executing startup routine [3 of 10, runlevel 2]: IdentityPopulator (DefaultStartupRoutineExecutor.java [main])

Sep 24, 2013 11:21:48 AM org.apache.catalina.core.StandardContext start

SEVERE: Error listenerStart

Sep 24, 2013 11:21:48 AM org.apache.catalina.core.StandardContext start

SEVERE: Context [/testinstance] startup failed due to previous errors

  • INFO 2013-09-24 11:21:48,017 De-registering jdbc driver: org.h2.Driver@65b8b5cd (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: org.hsqldb.jdbc.JDBCDriver@2830803a (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: com.mysql.jdbc.Driver@1ccdf3c2 (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: org.postgresql.Driver@2f1261b1 (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,186 Camel context stopped (DHIS2LifecycleStrategy.java [main])

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads

SEVERE: A web application appears to have started a thread named [Resource Destroyer in BasicResourcePool.close()] but has failed to stop it. This is very likely to create a memory leak.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Transactional resources]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Transaction synchronizations]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Prototype beans currently in creation]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@9db900f]) and a value of type [org.springframework.security.core.context.SecurityContextImpl] (value [org.springframework.security.core.context.SecurityContextImpl@ffffffff: Null authentication]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction name]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current aspect-driven transaction]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Prototype beans currently in creation]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction read-only status]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction isolation level]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Actual transaction active]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [null] (value [com.sun.xml.bind.v2.ClassFactory$1@642bf5bf]) and a value of type [java.util.WeakHashMap] (value [{class org.apache.camel.spring.CamelProducerTemplateFactoryBean=java.lang.ref.WeakReference@32b7e05f, class org.apache.camel.model.PackageScanDefinition=java.lang.ref.WeakReference@45eb96fc, class javax.xml.bind.annotation.adapters.CollapsedStringAdapter=java.lang.ref.WeakReference@6e059e40, class java.util.ArrayList=java.lang.ref.WeakReference@32d8b42e, class org.apache.camel.spring.CamelContextFactoryBean=java.lang.ref.WeakReference@311d5216}]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedInheritableThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedInheritableThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:49 AM org.apache.coyote.http11.Http11AprProtocol start

INFO: Starting Coyote HTTP/1.1 on http-8082

Sep 24, 2013 11:21:49 AM org.apache.catalina.startup.Catalina start

INFO: Server startup in 77181 ms


Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help : https://help.launchpad.net/ListHelp

OOoops!

I forgot the most important part, replacing the war file. It should be step 2 Emoji

···

From: gomezphiri@hotmail.com
To: jason.p.pickering@gmail.com; dhis2-devs@lists.launchpad.net
Date: Tue, 24 Sep 2013 13:51:57 +0200
Subject: Re: [Dhis2-devs] Upgrade from 2.10 to 2.12 failing

Hi Jason,

I just upgraded our demo server from 2.10 to 2.12 today. This is what I did to avoid all the troubles.

Steps

  1. service tomcat stop
  2. back up database “pg_dump dhis2 -U dhis | gzip > db.gz” Our database is large so I had to compress it with gzip.
  3. restart postgres
  4. su postgres
  5. psql
  6. DROP DATABASE db;
  7. CREATE DATABASE “db” WITH OWNER “owner” ENCODING ‘UTF8’;
  8. \q
  9. exit
  10. Restore database “gunzip -c db.gz | psql db”
  11. service tomcat start

Its working superb Emoji

Gomez.


Date: Tue, 24 Sep 2013 12:26:56 +0200
From: jason.p.pickering@gmail.com
To: dhis2-devs@lists.launchpad.net
Subject: [Dhis2-devs] Upgrade from 2.10 to 2.12 failing

Using the latest 2.12 build from Jenkins.

Looks like something is failing on the startup, but not sure what?

This DB runs fine on 2.10. The first time around, a bunch of timestamps were updated. I killed the server, restarted, but still getting stuck at step 4 /10.

Any tips?

Regards,

Jason

  • INFO 2013-09-24 11:21:23,080 Found the following message senders: [org.hisp.dhis.message.EmailMessageSender@17a220d7, org.hisp.dhis.sms.outbound.SmsSender@151a0f60] (DefaultMessageService.java [main])

  • INFO 2013-09-24 11:21:39,093 Camel context started (DHIS2LifecycleStrategy.java [main])

  • INFO 2013-09-24 11:21:39,094 Searching for routes in directory: /home/testinstance/dhis_home/routes (DHIS2LifecycleStrategy.java [main])

  • INFO 2013-09-24 11:21:40,242 Executing startup routine [1 of 10, runlevel 1]: TableAlteror (DefaultStartupRoutineExecutor.java [main])

  • INFO 2013-09-24 11:21:46,749 Tables updated (TableAlteror.java [main])

  • INFO 2013-09-24 11:21:46,750 Executing startup routine [2 of 10, runlevel 1]: MapViewUpgrader (DefaultStartupRoutineExecutor.java [main])

  • INFO 2013-09-24 11:21:47,012 Executing startup routine [3 of 10, runlevel 2]: IdentityPopulator (DefaultStartupRoutineExecutor.java [main])

Sep 24, 2013 11:21:48 AM org.apache.catalina.core.StandardContext start

SEVERE: Error listenerStart

Sep 24, 2013 11:21:48 AM org.apache.catalina.core.StandardContext start

SEVERE: Context [/testinstance] startup failed due to previous errors

  • INFO 2013-09-24 11:21:48,017 De-registering jdbc driver: org.h2.Driver@65b8b5cd (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: org.hsqldb.jdbc.JDBCDriver@2830803a (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: com.mysql.jdbc.Driver@1ccdf3c2 (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: org.postgresql.Driver@2f1261b1 (StartupListener.java [main])

  • INFO 2013-09-24 11:21:48,186 Camel context stopped (DHIS2LifecycleStrategy.java [main])

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads

SEVERE: A web application appears to have started a thread named [Resource Destroyer in BasicResourcePool.close()] but has failed to stop it. This is very likely to create a memory leak.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Transactional resources]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Transaction synchronizations]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Prototype beans currently in creation]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@9db900f]) and a value of type [org.springframework.security.core.context.SecurityContextImpl] (value [org.springframework.security.core.context.SecurityContextImpl@ffffffff: Null authentication]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction name]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current aspect-driven transaction]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Prototype beans currently in creation]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction read-only status]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction isolation level]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Actual transaction active]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [null] (value [com.sun.xml.bind.v2.ClassFactory$1@642bf5bf]) and a value of type [java.util.WeakHashMap] (value [{class org.apache.camel.spring.CamelProducerTemplateFactoryBean=java.lang.ref.WeakReference@32b7e05f, class org.apache.camel.model.PackageScanDefinition=java.lang.ref.WeakReference@45eb96fc, class javax.xml.bind.annotation.adapters.CollapsedStringAdapter=java.lang.ref.WeakReference@6e059e40, class java.util.ArrayList=java.lang.ref.WeakReference@32d8b42e, class org.apache.camel.spring.CamelContextFactoryBean=java.lang.ref.WeakReference@311d5216}]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedInheritableThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedInheritableThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:49 AM org.apache.coyote.http11.Http11AprProtocol start

INFO: Starting Coyote HTTP/1.1 on http-8082

Sep 24, 2013 11:21:49 AM org.apache.catalina.startup.Catalina start

INFO: Server startup in 77181 ms


Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help : https://help.launchpad.net/ListHelp


Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help : https://help.launchpad.net/ListHelp

Hi Gomez,
Thanks, as I mentioned before. This is something related to this particular database. This has been an issue in the past with some database, but may not be a general problem.

I was seeking advice from the developers about what the potential metadata issue could be, as the logs are not very clear exactly what the cause of the error might be.

Regards,

Jason

···

On Tue, Sep 24, 2013 at 1:51 PM, Gomez Phiri gomezphiri@hotmail.com wrote:

Hi Jason,

I just upgraded our demo server from 2.10 to 2.12 today. This is what I did to avoid all the troubles.

Steps

  1. service tomcat stop
  2. back up database “pg_dump dhis2 -U dhis | gzip > db.gz” Our database is large so I had to compress it with gzip.
  3. restart postgres
  4. su postgres
  5. psql
  6. DROP DATABASE db;
  7. CREATE DATABASE “db” WITH OWNER “owner” ENCODING ‘UTF8’;
  8. \q
  9. exit
  10. Restore database “gunzip -c db.gz | psql db”
  11. service tomcat start

Its working superb

Gomez.


Date: Tue, 24 Sep 2013 12:26:56 +0200
From: jason.p.pickering@gmail.com
To: dhis2-devs@lists.launchpad.net

Subject: [Dhis2-devs] Upgrade from 2.10 to 2.12 failing

Using the latest 2.12 build from Jenkins.

Looks like something is failing on the startup, but not sure what?

This DB runs fine on 2.10. The first time around, a bunch of timestamps were updated. I killed the server, restarted, but still getting stuck at step 4 /10.

Any tips?

Regards,

Jason

  • INFO 2013-09-24 11:21:23,080 Found the following message senders: [org.hisp.dhis.message.EmailMessageSender@17a220d7, org.hisp.dhis.sms.outbound.SmsSender@151a0f60] (DefaultMessageService.java [main])
  • INFO 2013-09-24 11:21:39,093 Camel context started (DHIS2LifecycleStrategy.java [main])
  • INFO 2013-09-24 11:21:39,094 Searching for routes in directory: /home/testinstance/dhis_home/routes (DHIS2LifecycleStrategy.java [main])
  • INFO 2013-09-24 11:21:40,242 Executing startup routine [1 of 10, runlevel 1]: TableAlteror (DefaultStartupRoutineExecutor.java [main])
  • INFO 2013-09-24 11:21:46,749 Tables updated (TableAlteror.java [main])
  • INFO 2013-09-24 11:21:46,750 Executing startup routine [2 of 10, runlevel 1]: MapViewUpgrader (DefaultStartupRoutineExecutor.java [main])
  • INFO 2013-09-24 11:21:47,012 Executing startup routine [3 of 10, runlevel 2]: IdentityPopulator (DefaultStartupRoutineExecutor.java [main])

Sep 24, 2013 11:21:48 AM org.apache.catalina.core.StandardContext start

SEVERE: Error listenerStart

Sep 24, 2013 11:21:48 AM org.apache.catalina.core.StandardContext start

SEVERE: Context [/testinstance] startup failed due to previous errors

  • INFO 2013-09-24 11:21:48,017 De-registering jdbc driver: org.h2.Driver@65b8b5cd (StartupListener.java [main])
  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: org.hsqldb.jdbc.JDBCDriver@2830803a (StartupListener.java [main])
  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: com.mysql.jdbc.Driver@1ccdf3c2 (StartupListener.java [main])
  • INFO 2013-09-24 11:21:48,018 De-registering jdbc driver: org.postgresql.Driver@2f1261b1 (StartupListener.java [main])
  • INFO 2013-09-24 11:21:48,186 Camel context stopped (DHIS2LifecycleStrategy.java [main])

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads

SEVERE: A web application appears to have started a thread named [Resource Destroyer in BasicResourcePool.close()] but has failed to stop it. This is very likely to create a memory leak.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Transactional resources]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Transaction synchronizations]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Prototype beans currently in creation]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@9db900f]) and a value of type [org.springframework.security.core.context.SecurityContextImpl] (value [org.springframework.security.core.context.SecurityContextImpl@ffffffff: Null authentication]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction name]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current aspect-driven transaction]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Prototype beans currently in creation]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction read-only status]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Current transaction isolation level]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedThreadLocal] (value [Actual transaction active]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [null] (value [com.sun.xml.bind.v2.ClassFactory$1@642bf5bf]) and a value of type [java.util.WeakHashMap] (value [{class org.apache.camel.spring.CamelProducerTemplateFactoryBean=java.lang.ref.WeakReference@32b7e05f, class org.apache.camel.model.PackageScanDefinition=java.lang.ref.WeakReference@45eb96fc, class javax.xml.bind.annotation.adapters.CollapsedStringAdapter=java.lang.ref.WeakReference@6e059e40, class java.util.ArrayList=java.lang.ref.WeakReference@32d8b42e, class org.apache.camel.spring.CamelContextFactoryBean=java.lang.ref.WeakReference@311d5216}]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedInheritableThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:48 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

SEVERE: A web application created a ThreadLocal with key of type [org.springframework.core.NamedInheritableThreadLocal] (value [Locale context]) and a value of type [null] (value [null]) but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.

Sep 24, 2013 11:21:49 AM org.apache.coyote.http11.Http11AprProtocol start

INFO: Starting Coyote HTTP/1.1 on http-8082

Sep 24, 2013 11:21:49 AM org.apache.catalina.startup.Catalina start

INFO: Server startup in 77181 ms

_______________________________________________ Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help : https://help.launchpad.net/ListHelp

I see, all the best then.