Import dxf failed...

Support - Assistance technique
1

I’m trying to import a large data set into the dhis-live so I can review the data and run some reports.
I encounter an error processing the dxf file (about line 10,000 of the import file):

(null,‘Buni’,null,‘Buni’,‘020302’,‘1990-01-01’,null,true,‘Buni Health Facility’,null,null,null,‘2010-06-07’,false),(null,‘Lokuru’,null,‘Lokuru’,‘020309’,‘1990-01-01’,null,true,‘Lokuru Health Facility’,null,null,null,‘2010-06-07’,false),(null,‘Jella’,null,‘Jella’,‘020313’,‘1990-01-01’,null,true,‘Jella Health Facility’,null,null,null,‘2010-06-07’,false) [23505-154]

at org.h2.message.DbException.getJdbcSQLException(DbException.java:327)
at org.h2.message.DbException.get(DbException.java:167)
at org.h2.message.DbException.get(DbException.java:144)
at org.h2.index.BaseIndex.getDuplicateKeyException(BaseIndex.java:80)

at org.h2.index.PageBtree.find(PageBtree.java:121)
at org.h2.index.PageBtreeLeaf.addRow(PageBtreeLeaf.java:146)
at org.h2.index.PageBtreeLeaf.addRowTry(PageBtreeLeaf.java:100)
at org.h2.index.PageBtreeIndex.addRow(PageBtreeIndex.java:93)

at org.h2.index.PageBtreeIndex.add(PageBtreeIndex.java:84)
at org.h2.table.RegularTable.addRow(RegularTable.java:127)
at org.h2.command.dml.Insert.insertRows(Insert.java:126)
at org.h2.command.dml.Insert.update(Insert.java:86)

at org.h2.command.CommandContainer.update(CommandContainer.java:69)
at org.h2.command.Command.executeUpdate(Command.java:212)
at org.h2.jdbc.JdbcStatement.executeUpdateInternal(JdbcStatement.java:125)

at org.h2.jdbc.JdbcStatement.executeUpdate(JdbcStatement.java:110)
at org.amplecode.quick.batchhandler.AbstractBatchHandler.flush(AbstractBatchHandler.java:295)
... 7 more

The dxf import file (created from dhis 2.5) looks like this:

9952BDB6-18CD-4DFB-BFF7-16B907DA2715
Buni
Buni
020302
1990-01-01


true
Buni Health Facility


2010-06-07


562
9828E889-C99F-4B62-BBD6-C608040E89D8
Lokuru

Lokuru
020309
1990-01-01

true
Lokuru Health Facility




2010-06-07


566

C258A163-CB4E-42AD-AD76-FD6EC5DBA10F
Jella
Jella
020313
1990-01-01


true
Jella Health Facility


2010-06-07




879

495


879
683

879 538 879

739

Note: Jella appears to be the last facility before the transition to the organisationUnitRelationship set of data (which goes on for several thousand lines).

Any ideas on the problem here?
Is this just too much data to try to import?

.Mark

···

–
Mark Spohr, MD

2

Thanks for the suggestions…
I’ve been playing with this today trying to get it to import and it always gets the same error message at the start of the section. I’ve removed the last of the facilities and it goes through the end of them and then errors at the same place. I haven’t found any duplicate orgunitrelationships so don’t know why it’s complaining.

I’ll try to deconstruct it further tomorrow.

Kind regards,
Mark

···

On Mon, Feb 27, 2012 at 12:35 AM, Nathan H. Omukwenyi nathan.omukwenyi@gmail.com wrote:

From the error message I could hazard a guess that there is a duplicate entry in the DXF file for the “Bun” OrgUnit. Organization Unit names and internal IDs need to be unique.

You could search through the file to find if that is true or check any already imported data for the presence of OrgUnits that are in the DXF file.

I don’t think your problem has anything to do with the amount of data you are importing.

Regards,

Nathan H. Omukwenyi,

+250 7830 10 981

From: dhis2-users-bounces+nathan.omukwenyi=gmail.com@lists.launchpad.net [mailto:dhis2-users-bounces+nathan.omukwenyi=gmail.com@lists.launchpad.net] On Behalf Of Mark Spohr

Sent: Saturday, February 25, 2012 10:59 PM
To: dhis2-users@lists.launchpad.net
Subject: [Dhis2-users] Import dxf failed…

I’m trying to import a large data set into the dhis-live so I can review the data and run some reports.

I encounter an error processing the dxf file (about line 10,000 of the import file):

(null,‘Buni’,null,‘Buni’,‘020302’,‘1990-01-01’,null,true,‘Buni Health Facility’,null,null,null,‘2010-06-07’,false),(null,‘Lokuru’,null,‘Lokuru’,‘020309’,‘1990-01-01’,null,true,‘Lokuru Health Facility’,null,null,null,‘2010-06-07’,false),(null,‘Jella’,null,‘Jella’,‘020313’,‘1990-01-01’,null,true,‘Jella Health Facility’,null,null,null,‘2010-06-07’,false) [23505-154]

at org.h2.message.DbException.getJdbcSQLException(DbException.java:327)
at org.h2.message.DbException.get(DbException.java:167)
at org.h2.message.DbException.get(DbException.java:144)
at org.h2.index.BaseIndex.getDuplicateKeyException(BaseIndex.java:80)

at org.h2.index.PageBtree.find(PageBtree.java:121)
at org.h2.index.PageBtreeLeaf.addRow(PageBtreeLeaf.java:146)
at org.h2.index.PageBtreeLeaf.addRowTry(PageBtreeLeaf.java:100)
at org.h2.index.PageBtreeIndex.addRow(PageBtreeIndex.java:93)

at org.h2.index.PageBtreeIndex.add(PageBtreeIndex.java:84)
at org.h2.table.RegularTable.addRow(RegularTable.java:127)
at org.h2.command.dml.Insert.insertRows(Insert.java:126)
at org.h2.command.dml.Insert.update(Insert.java:86)

at org.h2.command.CommandContainer.update(CommandContainer.java:69)
at org.h2.command.Command.executeUpdate(Command.java:212)
at org.h2.jdbc.JdbcStatement.executeUpdateInternal(JdbcStatement.java:125)

at org.h2.jdbc.JdbcStatement.executeUpdate(JdbcStatement.java:110)
at org.amplecode.quick.batchhandler.AbstractBatchHandler.flush(AbstractBatchHandler.java:295)
... 7 more

The dxf import file (created from dhis 2.5) looks like this:

9952BDB6-18CD-4DFB-BFF7-16B907DA2715
Buni
Buni
020302
1990-01-01


true
Buni Health Facility


2010-06-07


562
9828E889-C99F-4B62-BBD6-C608040E89D8
Lokuru

Lokuru
020309
1990-01-01

true
Lokuru Health Facility




2010-06-07


566

C258A163-CB4E-42AD-AD76-FD6EC5DBA10F
Jella
Jella
020313
1990-01-01


true
Jella Health Facility


2010-06-07




879

495


879
683

879 538 879

739

Note: Jella appears to be the last facility before the transition to the organisationUnitRelationship set of data (which goes on for several thousand lines).

Any ideas on the problem here?
Is this just too much data to try to import?

.Mark

–
Mark Spohr, MD

–
Mark Spohr, MD

3

AFAIK, ALL version of DHIS require the name and shortname to be unique.

SOME versions require the code to be unique.

Are you certain that all of these fields are unique and there is no
mismatch between versions?

You can try these three statements from the source database separately
to see if this problem might exist.

SELECT name, COUNT(*) FROM organisationunit GROUP BY name HAVING COUNT(*) > 1
SELECT shortname, COUNT(*) FROM organisationunit GROUP BY shortname
HAVING COUNT(*) > 1
SELECT code, COUNT(*) FROM organisationunit GROUP BY code HAVING COUNT(*) > 1

···

On Tue, Feb 28, 2012 at 3:22 AM, Mark Spohr <mhspohr@gmail.com> wrote:

Thanks for the suggestions...
I've been playing with this today trying to get it to import and it always
gets the same error message at the start of the <orgunitrelationships>
section. I've removed the last of the facilities and it goes through the
end of them and then errors at the same place. I haven't found any
duplicate orgunitrelationships so don't know why it's complaining.
I'll try to deconstruct it further tomorrow.

Kind regards,
Mark

On Mon, Feb 27, 2012 at 12:35 AM, Nathan H. Omukwenyi > <nathan.omukwenyi@gmail.com> wrote:

From the error message I could hazard a guess that there is a duplicate
entry in the DXF file for the “Bun” OrgUnit. Organization Unit names and
internal IDs need to be unique.

You could search through the file to find if that is true or check any
already imported data for the presence of OrgUnits that are in the DXF file.

I don’t think your problem has anything to do with the amount of data you
are importing.

Regards,

Nathan H. Omukwenyi,

+250 7830 10 981

From: dhis2-users-bounces+nathan.omukwenyi=gmail.com@lists.launchpad.net
[mailto:dhis2-users-bounces+nathan.omukwenyi=gmail.com@lists.launchpad.net]
On Behalf Of Mark Spohr
Sent: Saturday, February 25, 2012 10:59 PM
To: dhis2-users@lists.launchpad.net
Subject: [Dhis2-users] Import dxf failed...

I'm trying to import a large data set into the dhis-live so I can review
the data and run some reports.
I encounter an error processing the dxf file (about line 10,000 of the
import file):

(null,'Buni',null,'Buni','020302','1990-01-01',null,true,'Buni Health
Facility',null,null,null,'2010-06-07',false),(null,'Lokuru',null,'Lokuru','020309','1990-01-01',null,true,'Lokuru
Health
Facility',null,null,null,'2010-06-07',false),(null,'Jella',null,'Jella','020313','1990-01-01',null,true,'Jella
Health Facility',null,null,null,'2010-06-07',false) [23505-154]
at
org.h2.message.DbException.getJdbcSQLException(DbException.java:327)
at org.h2.message.DbException.get(DbException.java:167)
at org.h2.message.DbException.get(DbException.java:144)
at org.h2.index.BaseIndex.getDuplicateKeyException(BaseIndex.java:80)
at org.h2.index.PageBtree.find(PageBtree.java:121)
at org.h2.index.PageBtreeLeaf.addRow(PageBtreeLeaf.java:146)
at org.h2.index.PageBtreeLeaf.addRowTry(PageBtreeLeaf.java:100)
at org.h2.index.PageBtreeIndex.addRow(PageBtreeIndex.java:93)
at org.h2.index.PageBtreeIndex.add(PageBtreeIndex.java:84)
at org.h2.table.RegularTable.addRow(RegularTable.java:127)
at org.h2.command.dml.Insert.insertRows(Insert.java:126)
at org.h2.command.dml.Insert.update(Insert.java:86)
at org.h2.command.CommandContainer.update(CommandContainer.java:69)
at org.h2.command.Command.executeUpdate(Command.java:212)
at
org.h2.jdbc.JdbcStatement.executeUpdateInternal(JdbcStatement.java:125)
at org.h2.jdbc.JdbcStatement.executeUpdate(JdbcStatement.java:110)
at
org.amplecode.quick.batchhandler.AbstractBatchHandler.flush(AbstractBatchHandler.java:295)
... 7 more

The dxf import file (created from dhis 2.5) looks like this:

<uuid>9952BDB6-18CD-4DFB-BFF7-16B907DA2715</uuid>
<name>Buni</name>
<shortName>Buni</shortName>
<code>020302</code>
<openingDate>1990-01-01</openingDate>
<closedDate></closedDate>
<active>true</active>
<comment>Buni Health Facility</comment>
<geoCode></geoCode>
<feature type="">
</feature>
<lastUpdated>2010-06-07</lastUpdated>
</organisationUnit>
<organisationUnit>
<id>562</id>
<uuid>9828E889-C99F-4B62-BBD6-C608040E89D8</uuid>
<name>Lokuru</name>
<shortName>Lokuru</shortName>
<code>020309</code>
<openingDate>1990-01-01</openingDate>
<closedDate></closedDate>
<active>true</active>
<comment>Lokuru Health Facility</comment>
<geoCode></geoCode>
<feature type="">
</feature>
<lastUpdated>2010-06-07</lastUpdated>
</organisationUnit>
<organisationUnit>
<id>566</id>
<uuid>C258A163-CB4E-42AD-AD76-FD6EC5DBA10F</uuid>
<name>Jella</name>
<shortName>Jella</shortName>
<code>020313</code>
<openingDate>1990-01-01</openingDate>
<closedDate></closedDate>
<active>true</active>
<comment>Jella Health Facility</comment>
<geoCode></geoCode>
<feature type="">
</feature>
<lastUpdated>2010-06-07</lastUpdated>
</organisationUnit>
</organisationUnits>
<organisationUnitRelationships>
<organisationUnitRelationship>
<parent>879</parent>
<child>495</child>
</organisationUnitRelationship>
<organisationUnitRelationship>
<parent>879</parent>
<child>683</child>
</organisationUnitRelationship>
<organisationUnitRelationship>
<parent>879</parent>
<child>538</child>
</organisationUnitRelationship>
<organisationUnitRelationship>
<parent>879</parent>
<child>739</child>
</organisationUnitRelationship>

Note: Jella appears to be the last facility before the transition to the
organisationUnitRelationship set of data (which goes on for several thousand
lines).

Any ideas on the problem here?
Is this just too much data to try to import?

.Mark

--
Mark Spohr, MD

--
Mark Spohr, MD

_______________________________________________
Mailing list: DHIS 2 Users in Launchpad
Post to : dhis2-users@lists.launchpad.net
Unsubscribe : DHIS 2 Users in Launchpad
More help : ListHelp - Launchpad Help