Both of these behaviors (spam check delays and Outbox delays) can stem from delays incurred by the RBL/URIBL lists as Steve pointed out above. I recommend resolving or disabling any of these lists which are introducing a response time of 1000+ ms.
Kyle Kerst
Lead Internal Network/System Administrator
SmarterTools Inc.
smartertools.com