2
Poll: SmarterMail process memory usage on big installations
Question asked by Sébastien Riccio - 2/18/2021 at 3:47 PM
Unanswered
Hello SmarterMail users,

I would like to know if there are some big SM installation users that could share some stats about their SmarterMail process memory usage.

Since a few months we're seeing a big memory usage increase (lastly 60GB, 80% of system memory) for an installation with around 5k domains when this was previously more around something like 20-25GB at peak times.
We've not determined yet if it started after updating to a specific build.

Is that something that you've noticed too, maybe we have some memory leak issue here?

I would be grateful if some of you would share the installation size (number of domains) and average memory usage by the process.

Thanks a lot in advance.

Kind regards
Sébastien Riccio
System & Network Admin

24 Replies

Reply to Thread
1
JerseyConnect Team Replied
We don't have nearly as many domains (about 110), but over the last 2 months we've had to increase memory a few times. SM is installed as a VM so it's easy for us to add memory. For the longest time it had 20Gb allocated with between 6-10Gb in use. Then starting since December we've gotten a few down alerts for the system and check to see that memory is fully consumed. The system is now up to 30Gb with 20-25Gb in use during peak times. We've also been doing regular updates to try and resolve various issues, so yeah it's hard to say which build brought this on.
0
I have a SmarterMail server with about 150 domains and about 750 users.
No issue with memory or CPU usage
0
This is my normal CPU and RAM activity (please note that this is a Hyper-V VM and I use Dynamic Memory with max 16GB of RAM):


0
Thisis the RAM used by processes:

0
Sébastien Riccio Replied
Hello,

Thanks to all for the feedbacks.

It is strange, it seems some users have the same issue (memory usage growth since december) that we have and some other have very low memory footprint on their process.


Process memory usage shows it started changing a bit in december so probably some changes in memory management since a particular build of december.

It's not really a big problem if everything runs smooth as we can easily add ram, but we would like to avoid the process eating all system memory to leave a bit of ram for system cache and other processes.

Thanks again for the feedbacks.
Sébastien Riccio
System & Network Admin

0
Webio Replied
On my end: 50GB in ram in Task Manager (96GB RAM available)
Environment: virtualized in ESXi
Recently I had to move VM from 2x4core CPU to 2x6core CPU because there was situations when SM service and IIS process needed more CPU resources.

When it comes to number of domains and users this is not so easy information to get from SM admin section. Domains section is not showing summarized numbers. 226 pages with 25 results per page which gives about 5650 domains configured in SmarterMail instance.

EDIT: I didn't had any issues with RAM actually (more CPU like I've mentioned) but yes I remember that few months ago SM process was using less RAM but for me this is not a problem (for now at least).
0
Jade D Replied
Hope this helps

755 Domains

523 Domains

610 Domains

512 Domains


0
Sébastien Riccio Replied
Thanks a lot for your feedbacks
Sébastien Riccio
System & Network Admin

0
echoDreamz Replied

Ours normally uses 40 - 50GB of RAM. Highest I have seen is 56GB.
0
Webio Replied
Just a small update on my end. Today (build 7699) I see 76GB of RAM (SM process, w3wp is using aboug 1.8GB)
0
Chris Replied
Build 7719 Today:

60/128 (47%)
57/128 (44%)
59/128 (46%)
43/128 (33%)
93/192 (49%)
30/64 (47%)
1
Sébastien Riccio Replied
Hello all, thanks again for the feedback.

So I guess SmarterMail is allowed to make use of the memory to keep things in cache and that the memory usage increase is something normal.

At least until it eats all system memory and leave nothing to the system that I hope will not happen.

Kind regards.

Sébastien Riccio
System & Network Admin

2
Chris Replied
I don't mind giving it all the memory it needs as long as the software is stable.
1
I think SM has a fair memory use. Have you ever tried to use MS Exchange? It eats up every drop of RAM you have! Far worst than SM...
3
echoDreamz Replied
Chris, same. I will toss RAM at SM all day, if it increases performance and stability, SM can eat all the RAM it likes lol.
1
Sébastien Riccio Replied
I think we all agree on this. As long as it it is stable, it can eat whatever memory it wants :)

Sébastien Riccio
System & Network Admin

0
echoDreamz Replied
Our shared SQL Server instance eats nearly a full TB of RAM, it never stalls, crashes or even sneezes, it's a rock. So, SmarterMail, if you want 64GB, 128GB, 512GB of RAM, you have it :). If it helps, we will give it.
1
Chris Danks Replied
I just upgraded Smarter mail from 7699 to 7719 and my CPU & RAM usage has gone insane.

We typically use around 8-11GB Ram and now its using 80GB ram and CPU really high, normally the fix to reduce cpu/ram is to disable greylistings (or delete the greylistings file and restart service) on this occasion that hasn't helped and our SM service crashes several times an hour!

I opened a ticket a few hours ago and awaiting smartertools support to open to hopefully help me.
0
Patrick Mattson Replied
My server crashed last night the service just stopped, I submitted a ticket. I may need to add more RAM to my server., noticed I am using 92% of 16GB Here are a couple of the interesting events just before the crash.

Log Name:      Application
Source:        .NET Runtime
Date:          2/25/2021 12:34:30 AM
Event ID:      1026
Task Category: None
Level:         Error
Keywords:      Classic
User:          N/A
Computer:      XXXXX
Description:
Application: MailService.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.OutOfMemoryException
   at System.Threading.Tasks.Task.AddException(System.Object, Boolean)
   at System.Threading.Tasks.Task`1

This was another
Log Name:      System
Source:        Microsoft-Windows-Resource-Exhaustion-Detector
Date:          2/25/2021 12:27:41 AM
Event ID:      2004
Task Category: Resource Exhaustion Diagnosis Events
Level:         Warning
Keywords:      Events related to exhaustion of system commit limit (virtual memory).
User:          SYSTEM
Computer:      xxxxxx
Description:
Windows successfully diagnosed a low virtual memory condition. The following programs consumed the most virtual memory: MailService.exe (5268) consumed 41058426880 bytes, clamd.exe (5780) consumed 1765343232 bytes, and tomcat8.exe (2184) consumed 693596160 bytes.


0
Chris Danks Replied
HI

Do you use greylistings? if so try disabling them and restart SM Service and see if this fixes it for you.

0
Chris Replied
You are going to need more memory Patrick. With latest builds, I'd say at least 64GB. We are running 128GB all the way up to 192GB.
1
Patrick Mattson Replied
Thanks now I need to be new hardware. I do not make enough money off of SmarterMail to keep this business model going. I currently have one user who keeps having a folder fill up with files. He use to have a 3GB mail file, now it jumped to 30GB. I am at the mercy of the developers with no word all day.
0
Jade D Replied
Patrick, you need to move mail services to a new server or limit the amount of resources that other services can use.

Exception Info: System.OutOfMemoryException is typical of of a 32bit process that exceeded the amount of memory available to it of 4GB or .net garbage collector hitting its max
0
echoDreamz Replied
Jade, SmarterMail isnt a 32-bit process, so the 4GB limit doesnt apply here. 16GB of RAM though is a pretty small amount of RAM in today's world.

Reply to Thread