CEHCIG 870

• functionally similar as before
• now a catalogue document
• added a concept that documents can be validated
• now compensates for manual intervention e.g. if you deleted a file, it would say missing file and if you put it back it would say unknown file but now it would be back to normal
• can now support nested folders and nested zips and if the folder already has zip files it will add those to the list of files, this was a major bug before where it would delete subfolder and sub zips

There is a lot of code and it might be better to review it in the bubble

The tests here are from TDD but was mostly tested manually as such I am writing more tests now

There are some parts which I would like to make more generic, e.g. zipping currently will only zip the datastore but I think this will come through when writing more unit tests