Hello.
Up to the last version of Smartermail there was an issue with the Message Archive funcion. On some high volume Smartermail installations, some messages would not get correctly indexed.
While all messages did get on the archive folder, some of them were missing from the index, so they were not searchable. This issue was fixed with the new "Reindex" function.
The problem is that the new "Reindex" function deletes the current index file and recreates it by reading all files that are in the archive folder.
That becomes a problem on servers that have a huge amount of archive storage. In my case, I do have more than 8Tb of archive data which cannot be lost and must searchable (must be present on the index).
These amount of data can get very expensive, especially on cloud environments (which is my case), so a solution is to move old archive data to a cold storage.
So when the "Reindex" function runs, all messages that are not physically on the archive folder gets erased from the index, so they basically disapear from the search. This also causes another issue: this breaks some auditing standards.
A solution is to improve the Reindex function. Instead of erasing the index file and recreating it from scratch, only add extra messages that are not already on the index, without deleting any old entry.
This solution would solve the problem described above and would also make the archive search a trusted tool for auditing purposes (like it was before).
Please vote if you agree.
Regards,
Rafael