#2204
  • Created on
    2017-07-19 14:39
  • Reported by
    jeffloun2
  • Status
    Fixed (Completed)
  • Priority
    Normal (3)
  • Assigned to
    darrinc
  • Milestone
    6.0.0
  • Plan Level
    -
  • Estimate
    0.0
  • Due Date
    -

Attachments

Related Tickets

Add new subtask or bug

Improved Import/Export of Entities and Relationship Types

Revision 1.8
Currently the default is export as csv then a laborious attribute mapping process to bring the entity into the database. This doesn’t work well when you have entities being made on one database and exported across to a second, particularly as you lose the attachments. The logic behind this is fine if you are bringing in one entity from a different team who have been using a different set of attributes, but not if it is someone in the same team updating the data entry staff’s computer for instance.
User picture
  on 2017-08-09 15:54 *
By egouge
Assigned to set to egouge
Add Export/Import Options for: Entity Types & Relationship Types. [This is going to need to include: attribute, entity types, relationship types, relationship groups, birt templates, record types.]
Main goal is to be able to export your “model” for intelligence to another CA easily.

We should offer options to export to xml file or ConservationArea.

Also require associated import options.
User picture
  on 2017-08-11 11:23 *
By egouge
Status changed from New to In-Progress
New menu items for exporting & importing data:
Image not found...

Export option allows you to export to xml or another Conservation Area, and pick the items of interest
Image not found...
User picture
  on 2017-08-11 11:25 *
By egouge
Status changed from In-Progress to Test
User picture
  on 2017-08-11 12:59 *
By egouge
Status changed from Test to In-Progress
User picture
  on 2017-08-14 11:12 *
By egouge
Component set to Advanced Intelligence
User picture
  on 2017-08-15 17:38 *
By egouge
Status changed from In-Progress to Test
New Option to export "selected" or "all" entities.

Image not found...

Export format options include CSV or XML:
Image not found...

Now also have a import from XML option for entities:
Image not found...


If transferring records and entities to another conservation area (or computer), it is best to first import the entities then the records. This should preserve all links between the records and entities.
User picture
  on 2017-09-07 10:23 *
By rsapickles
This looks good. Will this exporting also preserve links between entities?

Very good to see the ability to export the 'model'. As we've restricted SMART Intel to a separate machine, an eventual merger into the same conservation area as the patrols is on the cards. This would allow it.
User picture
  on 2017-09-07 10:58 *
By egouge
Yes - it will attempt to import relationships (and attributes) between entities. It searches by entity type & id. If an entity cannot be found or multiple possibilities are found (ie multiple entities with the same id) then the relationship is not imported.
User picture
  on 2017-11-21 13:13 *
By egouge
Assigned to changed from egouge to darrinc
User picture
  on 2017-11-29 15:46 *
By darrinc
Assigned to changed from darrinc to egouge
Status changed from Test to In-Progress
In 6.0.a5, this error happened when exporting Model Elements from the Example CA to a clone.

=========================

Image not found...

Image not found...

!ENTRY org.wcs.smart.i2 4 0 2017-11-29 13:42:30.469
!MESSAGE C:\Users\REFRAC~1\AppData\Local\Temp\smart.1898482556242036243725502737782062\record.rptdesign
!STACK 0
java.nio.file.NoSuchFileException: C:\Users\REFRAC~1\AppData\Local\Temp\smart.1898482556242036243725502737782062\record.rptdesign
at sun.nio.fs.WindowsException.translateToIOException(Unknown Source)
at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
at sun.nio.fs.WindowsFileCopy.copy(Unknown Source)
at sun.nio.fs.WindowsFileSystemProvider.copy(Unknown Source)
at java.nio.file.Files.copy(Unknown Source)
at org.wcs.smart.i2.xml.XmlToIntelData.toIntelData(XmlToIntelData.java:241)
at org.wcs.smart.i2.xml.XmlToIntelData.importXmlData(XmlToIntelData.java:120)
at org.wcs.smart.i2.ui.dialogs.ExportModelElementsDialog$2.run(ExportModelElementsDialog.java:198)
at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:119)
User picture
  on 2017-11-29 16:23 *
By darrinc
Another issue found in version 6.0.a5 is with the Entity CSV export/import.

1. Select an entity and right-click to bring up "Export - All Entities"

Image not found...

2. Select format "CSV" and export entities.
3. Import the Entities CSV into a new Conservation Area

Image not found...

Users are required to select a specific Entity Type which upon import will overwrite the Entity Types that are stored in the CSV.

Another issue is with importing coordinates. Parsing of XY coordinates contained in a single field isn't working properly.

entities.csv
User picture
  on 2017-12-13 14:40 *
By egouge
Status changed from In-Progress to Test
Model Elements from the Example CA to a clone - Unable to Reproduce this

Importing Entities - I'm not changing the way CSV entities are imported. You need to export entities of a given type if you want to import them using the CSV format. Otherwise you should use the xml format which allows you to import/export entities of different types. Same for X,Y coordinates - for what you are doing here you should be using the XML format.
User picture
  on 2017-12-14 18:27 *
By egouge
Assigned to changed from egouge to darrinc
User picture
  on 2018-01-16 13:46 *
By darrinc
Status changed from Test to Fixed (Completed)
Working as expected in 6.0.a7