Both of these behaviors (spam check delays and Outbox delays) can stem from delays incurred by the RBL/URIBL lists as Steve pointed out above. I recommend resolving or disabling any of these lists which are introducing a response time of 1000+ ms.
Kyle Kerst
IT Coordinator
SmarterTools Inc.
www.smartertools.com