This is an example of the INDEXING LOG for a mailbox (not the whole day, only latest entries...):

[2018.11.19] 13:21:11.221 [xxx@yyyyyy.com] Marking user as not being indexed.
[2018.11.19] 13:24:00.022 [xxx@yyyyyy.com] Adding user to indexing queue.
[2018.11.19] 13:24:00.022 [xxx@yyyyyy.com] Adding user to indexing queue.
[2018.11.19] 13:31:12.785 [xxx@yyyyyy.com] Retreived from queue
[2018.11.19] 13:31:12.785 [xxx@yyyyyy.com] Marking user as being indexed.
[2018.11.19] 13:31:12.832 [xxx@yyyyyy.com] Reindex - All indexed items removed
[2018.11.19] 13:31:12.848 [xxx@yyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.19] 13:33:13.065 [xxx@yyyyyy.com] Index committed to disk
[2018.11.19] 13:33:13.080 [xxx@yyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.19] 13:33:13.080 [xxx@yyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.19] 13:33:13.080 [xxx@yyyyyy.com] Unindexed remaining: 1978 / 4478 (45%)
[2018.11.19] 13:33:13.080 [xxx@yyyyyy.com] User Indexed
[2018.11.19] 13:33:13.080 [xxx@yyyyyy.com] Marking user as not being indexed.
[2018.11.19] 13:56:21.532 [xxx@yyyyyy.com] Adding user to indexing queue.
[2018.11.19] 13:56:21.532 [xxx@yyyyyy.com] Adding user to indexing queue.
[2018.11.19] 13:56:23.101 [xxx@yyyyyy.com] Retreived from queue
[2018.11.19] 13:56:23.101 [xxx@yyyyyy.com] Marking user as being indexed.
[2018.11.19] 13:56:23.148 [xxx@yyyyyy.com] Reindex - All indexed items removed
[2018.11.19] 13:56:23.148 [xxx@yyyyyy.com] Found 1 pending deletes.
[2018.11.19] 13:56:23.148 [xxx@yyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.19] 13:58:20.396 [xxx@yyyyyy.com] Index committed to disk
[2018.11.19] 13:58:20.412 [xxx@yyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.19] 13:58:20.412 [xxx@yyyyyy.com] Unindexed remaining: 1978 / 4478 (45%)
[2018.11.19] 13:58:20.412 [xxx@yyyyyy.com] User Indexed
[2018.11.19] 13:58:20.412 [xxx@yyyyyy.com] Marking user as not being indexed.
[2018.11.19] 16:08:23.935 [xxx@yyyyyy.com] Adding user to indexing queue.
[2018.11.19] 16:08:23.935 [xxx@yyyyyy.com] Not yet in queue, added to queue.
[2018.11.19] 16:08:23.935 [xxx@yyyyyy.com] Adding user to indexing queue.
[2018.11.19] 16:08:29.051 [xxx@yyyyyy.com] Retreived from queue
[2018.11.19] 16:08:29.051 [xxx@yyyyyy.com] Marking user as being indexed.
[2018.11.19] 16:08:29.113 [xxx@yyyyyy.com] Reindex - All indexed items removed
[2018.11.19] 16:08:29.113 [xxx@yyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.19] 16:10:27.048 [xxx@yyyyyy.com] Index committed to disk
[2018.11.19] 16:10:27.048 [xxx@yyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.19] 16:10:27.048 [xxx@yyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.19] 16:10:27.048 [xxx@yyyyyy.com] Unindexed remaining: 1980 / 4480 (45%)
[2018.11.19] 16:10:27.048 [xxx@yyyyyy.com] User Indexed
[2018.11.19] 16:10:27.048 [xxx@yyyyyy.com] Marking user as not being indexed.

This seems to happen on ALL server mailboxes

Hello, 

I've started looking at whats happening here. This issue isn't the same issue that SmarterMail 16 is currently having (referring to other nearby threads). This issue is specific to 17's conversion from one index to the other. 

So in other words, this is supposed to settle down after some time?

No, I'm investigating the code right now and I'm seeing a potential for new conversions to repeatedly execute the conversion on some users. It is looking like a recurring issue.

SmarterMail 17 does do a reindex of users, but it should only be once for each user, the case demonstrated above and from my short investigation it's looking like some users repeat this index-conversion infinitely.

We are pushing a build more than likely tonight for 17 that includes a fix for this issue.

Hi Matt, in my experience is not "for some users", it is for ALL users...

And... reading the log it seems that the reindexing jobs does not reindex all:

18.11.19] 16:10:27.048 [xxx@yyyyyy.com] Unindexed remaining: 1980 / 4480 (45%)

Today at 12.35 CET I have installaed the latest 6897, but the issue seems to be there again.

This is the INDEXING LOG of a single mailbox after the update:

[2018.11.20] 12:39:48.352 Indexing service started12:39:53.133 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:39:53.133 [xxx@yyyyyyy.com] Not yet in queue, added to queue.
[2018.11.20] 12:39:53.150 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:40:27.999 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:40:27.999 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:40:54.873 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:40:54.873 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:41:07.732 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:41:07.922 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:41:07.732 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:41:07.922 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:41:39.513 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 12:41:39.513 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 12:41:39.763 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 12:41:39.763 [xxx@yyyyyyy.com] Found 6 pending deletes.
[2018.11.20] 12:41:39.779 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 12:43:00.423 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 12:43:00.438 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 12:43:00.438 [xxx@yyyyyyy.com] Unindexed remaining: 82615 / 85115 (98%)
[2018.11.20] 12:43:00.438 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 12:47:51.637 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:47:51.637 [xxx@yyyyyyy.com] Not yet in queue, added to queue.
[2018.11.20] 12:47:51.637 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:47:57.777 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:47:57.777 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:50:33.686 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 12:50:33.686 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 12:50:34.264 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 12:50:34.264 [xxx@yyyyyyy.com] Found 5 pending deletes.
[2018.11.20] 12:50:34.264 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 12:51:44.404 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:51:44.404 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 12:52:16.732 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 12:52:16.732 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 12:52:16.732 [xxx@yyyyyyy.com] Unindexed remaining: 82617 / 85117 (98%)
[2018.11.20] 12:52:16.732 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 12:52:16.732 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 13:09:02.663 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:09:02.663 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:09:24.189 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 13:09:24.189 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 13:09:24.517 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 13:09:24.517 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 13:11:09.498 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 13:11:09.498 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 13:11:09.498 [xxx@yyyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.20] 13:11:09.498 [xxx@yyyyyyy.com] Unindexed remaining: 82619 / 85119 (98%)
[2018.11.20] 13:11:09.498 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 13:11:09.498 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 13:17:55.298 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:17:55.298 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:21:38.614 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 13:21:38.614 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 13:21:38.911 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 13:21:38.927 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 13:23:23.082 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 13:23:23.082 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 13:23:23.082 [xxx@yyyyyyy.com] Unindexed remaining: 82620 / 85120 (98%)
[2018.11.20] 13:23:23.082 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 13:23:23.082 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 13:31:57.617 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:31:57.617 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:33:12.880 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:33:12.880 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:34:54.644 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 13:34:54.644 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 13:34:54.909 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 13:34:54.909 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 13:36:38.064 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 13:36:38.080 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 13:36:38.080 [xxx@yyyyyyy.com] Unindexed remaining: 82622 / 85122 (98%)
[2018.11.20] 13:36:38.080 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 13:36:38.080 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 13:38:52.913 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:38:52.913 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:43:36.002 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 13:43:36.002 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 13:43:36.299 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 13:43:36.299 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 13:45:21.271 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 13:45:21.271 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 13:45:21.286 [xxx@yyyyyyy.com] Unindexed remaining: 82623 / 85123 (98%)
[2018.11.20] 13:45:21.286 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 13:45:21.286 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 13:46:06.309 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:46:06.309 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:47:46.196 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:47:46.196 [xxx@yyyyyyy.com] Not yet in queue, added to queue.
[2018.11.20] 13:47:46.196 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:47:51.399 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 13:47:51.399 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 13:47:51.915 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 13:47:51.915 [xxx@yyyyyyy.com] Found 2 pending deletes.
[2018.11.20] 13:47:51.915 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 13:49:25.617 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 13:49:25.633 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 13:49:25.633 [xxx@yyyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.20] 13:49:25.633 [xxx@yyyyyyy.com] Unindexed remaining: 82626 / 85126 (98%)
[2018.11.20] 13:49:25.633 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 13:49:25.633 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 13:50:52.334 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 13:50:52.334 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 13:50:52.537 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 13:50:52.537 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 13:52:25.880 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 13:52:25.895 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 13:52:25.895 [xxx@yyyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.20] 13:52:25.895 [xxx@yyyyyyy.com] Unindexed remaining: 82626 / 85126 (98%)
[2018.11.20] 13:52:25.895 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 13:52:25.895 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 13:57:04.530 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:57:04.530 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:57:32.514 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 13:57:32.514 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 13:57:32.779 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 13:57:32.779 [xxx@yyyyyyy.com] Found 1 pending deletes.
[2018.11.20] 13:57:32.779 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 13:58:31.090 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:58:31.090 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:58:33.278 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:58:33.278 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 13:59:15.918 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 13:59:15.933 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 13:59:15.933 [xxx@yyyyyyy.com] Unindexed remaining: 82627 / 85127 (98%)
[2018.11.20] 13:59:15.933 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 13:59:15.933 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 14:03:00.728 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:03:00.728 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:03:52.136 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 14:03:52.136 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 14:03:52.449 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 14:03:52.449 [xxx@yyyyyyy.com] Found 3 pending deletes.
[2018.11.20] 14:03:52.464 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 14:05:35.359 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 14:05:35.359 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 14:05:35.359 [xxx@yyyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.20] 14:05:35.359 [xxx@yyyyyyy.com] Unindexed remaining: 82628 / 85128 (98%)
[2018.11.20] 14:05:35.359 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 14:05:35.359 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 14:06:52.848 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:06:52.848 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:08:32.711 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:08:32.711 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:09:25.507 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:09:25.507 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:11:58.856 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:11:58.856 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:16:04.543 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 14:16:04.543 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 14:16:04.840 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 14:16:04.840 [xxx@yyyyyyy.com] Found 2 pending deletes.
[2018.11.20] 14:16:04.856 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 14:16:11.653 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:16:11.653 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:17:50.231 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 14:17:50.247 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 14:17:50.247 [xxx@yyyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.20] 14:17:50.247 [xxx@yyyyyyy.com] Unindexed remaining: 82632 / 85132 (98%)
[2018.11.20] 14:17:50.247 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 14:17:50.247 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 14:22:24.322 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:22:24.322 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:23:18.696 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 14:23:18.696 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 14:23:19.102 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 14:23:19.102 [xxx@yyyyyyy.com] Found 1 pending deletes.
[2018.11.20] 14:23:19.102 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 14:23:31.508 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:23:31.508 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:24:25.616 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:24:25.616 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:24:38.944 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:24:38.944 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:24:52.757 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:24:52.757 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:25:06.928 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 14:25:06.944 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 14:25:06.944 [xxx@yyyyyyy.com] Unindexed remaining: 82634 / 85134 (98%)
[2018.11.20] 14:25:06.944 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 14:25:06.944 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 14:26:10.536 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:26:10.536 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:26:23.708 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:26:23.708 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:26:25.349 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:26:27.411 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:26:25.349 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:26:27.411 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:26:32.255 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:26:32.255 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:29:07.529 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 14:29:07.529 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 14:29:07.810 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 14:29:07.810 [xxx@yyyyyyy.com] Found 40 pending deletes.
[2018.11.20] 14:29:07.826 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 14:29:49.076 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:29:49.076 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:30:23.856 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:30:23.856 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:30:56.512 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 14:30:56.512 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 14:30:56.512 [xxx@yyyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.20] 14:30:56.512 [xxx@yyyyyyy.com] Unindexed remaining: 82636 / 85136 (98%)
[2018.11.20] 14:30:56.512 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 14:30:56.512 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 14:31:56.314 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:31:56.314 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:32:58.005 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:32:58.005 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:33:27.582 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:33:27.582 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:33:39.059 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 14:33:39.059 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 14:33:39.294 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 14:33:39.294 [xxx@yyyyyyy.com] Found 36 pending deletes.
[2018.11.20] 14:33:39.310 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 14:33:59.668 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:33:59.668 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:34:33.793 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:34:33.793 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:35:18.480 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 14:35:18.496 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 14:35:18.496 [xxx@yyyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.20] 14:35:18.496 [xxx@yyyyyyy.com] Unindexed remaining: 82639 / 85139 (98%)
[2018.11.20] 14:35:18.496 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 14:35:18.496 [xxx@yyyyyyy.com] Marking user as not being indexed.
[2018.11.20] 14:39:48.324 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:39:48.340 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:40:35.915 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:40:35.915 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:40:37.204 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:40:37.204 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:41:02.631 [xxx@yyyyyyy.com] Retreived from queue
[2018.11.20] 14:41:02.631 [xxx@yyyyyyy.com] Marking user as being indexed.
[2018.11.20] 14:41:02.912 [xxx@yyyyyyy.com] Reindex - All indexed items removed
[2018.11.20] 14:41:02.912 [xxx@yyyyyyy.com] Found 34 pending deletes.
[2018.11.20] 14:41:02.928 [xxx@yyyyyyy.com] Found 2500 items to index. (Max is 2500)
[2018.11.20] 14:41:37.599 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:41:37.599 [xxx@yyyyyyy.com] Adding user to indexing queue.
[2018.11.20] 14:42:57.097 [xxx@yyyyyyy.com] Index committed to disk
[2018.11.20] 14:42:57.097 [xxx@yyyyyyy.com] Index segment counts is greater than 20, optimizing index.
[2018.11.20] 14:42:57.097 [xxx@yyyyyyy.com] Globally Indexed Items > 5000, freeing memory
[2018.11.20] 14:42:57.097 [xxx@yyyyyyy.com] Unindexed remaining: 82642 / 85142 (98%)
[2018.11.20] 14:42:57.097 [xxx@yyyyyyy.com] User Indexed
[2018.11.20] 14:42:57.097 [xxx@yyyyyyy.com] Marking user as not being indexed.

Investigating more today and it appears we have an issue with counting unindexed items. It appears this might only be a visual artifact. If you notice the user is indexing a couple items each iteration. We are counting the amount of items in contacts+notes+tasks but we are not accounting for the contacts+notes+tasks that have already been indexed. So even though we've indexed the last 2500+ of (contacts+notes+tasks) it always thinks it has indexed 0. I will get this fixed today and we might have another release of 17 out.

Thanks for posting more information back to the thread and I wanna make sure this is solid, thanks :)

Thanks Matt, I am looking forward to SmarterMail because I think it will be the best altenative to MS Exchange out here.

I already know ad use Kerio, Mailenable, Merak and IceWarp, but I think that SamrterMail will be the only one we will use in the near future...

I have more news, I found the issue and produced a fix. Interesting that this particular issue spans all the way back into SmarterMail 15, so I'll be putting this fix in our entire current line of supported mail, 15+16+17.

I'll provide a technical note on what the cause was. Users that experience this issue would have a high amount of Contacts + Notes + Calendar events. Due to the way we inaccurately counted these numbers, if the total of the above is greater than the default chunk size of 2500, SmarterMail would think that the user isn't finished and keep queuing the user up even though they technically were done. This didn't necessarily cause any issues besides constantly being indexed, the user would still be able to search and all their items would be indexed (even though it says they aren't).

Still looking at a potential release for 17 again tonight, we're gonna keep rifling off these 17 fixes as they come up as we are in the period of time now where we take input and try to have all known issues fixed. Thanks again for sticking around and helping out with the BETA. :D

I still hope that you'll continue to support V15 for some time. Management is not comfortable going past that version at this point. 

I 2nd the point that Paul mentioned. Our company is still not comfortable moving to a newer version yet and hope V15 still gets support.

Seeing the same thing on a newly(last night) upgraded (from v16) install of v17.

-Elazar

Are you (SmarterTools) really dropping support for v16 3rd december and talking about v17 as a BETA ?

Whatever we wanna call it, it's not released yet and are pumping out fixes based on feedback, so call it what you will. We have an active thread about our pricing and licensing changes, take relevant discussions there so we can have some constructive communication in regards to our future version here, Thanks.

For anyone reading this thread, just so we are clear since it got a bit off topic.
This issue (and another) were fixed in 15, 16, and 17. One of the issues was specific to 17. We are planning a release of 17 tonight that includes this fix among other requests, clamav update, etc.

Hello Matt,

I don't get it why you are talking about princing and licensing changes here. The question was about the drop for support and fixes for v16 from 3rd december.

We still have open tickets about issues we have with our current SM16 install and no indication updating to SM17 will adress them.

To look forward migrating to SM17, we attempted to upgrade a clone of our v16 (5k domains) install to v17 and are having some issues. We would like to share with you what are the results , but as we still have open tickets about these SM16  unresolved issues we can't open a new one.

Nothing here about pricing/licensing...

Best regards,

Sébastien

I will open an outgoing ticket with you, we might request a shallow clone (everything minus indexing, stats, and GRPS) to run some tests ourselves. You can also send us your "conversion.log" found in your C:\SmarterMail\Logs directory. Any further discussion on this specific topic should be moved to another thread if you'd like, otherwise we will be in communication through ticket.

Heads up I'm going to be sending the outgoing ticket to your account you have attached to your community profile, if you'd like another added DM me any other email addresses you'd like attached to the ticket.

If anyone has issues with 17 we wanna make sure you are heard and your issues get evaluated and fixed. We have no problem giving out tickets for reporting issues in 17. Tickets are gonna be free with "Maintenance and Support" soon anyways.