How can I import CSV file incrementally in IBM Content Analytics?
I add documents into a collection by importing CSV files in the Administration console. I want to import CSV file having new or updated records only. However, existing but un-updated records in the collection disappear after I import the CSV file. I do not want to remove existing records. How can I import new or updated records only?
To import CSV file incrementally:
- Open ES_NODE_ROOT/master_config/importer/config.properties with a text editor
- Locate the following line
- Change it from true to false and save changes
- Restart ICA server with the following command
esadmin system stop
esadmin system start
- Ensure that you specify the same Import Space ID whenever importing CSV file with Administration console
Note: Once you set removeOldSpaceBeforeImport=false, the existing documents in the index will not be deleted automatically. Therefore, you need to delete the unnecessary documents manually if needed. To remove it, you can use CSV File Import History or Remove URIs from the Index on Administration console.