Spamlists are only used for spam filtering. Technically the server sending out is your server ip. SmarterMail does have a blacklist for inbound connections but this manually modified by system administrators and automated systems like intrusion detection. This is the only system that would prevent an IP from connecting to POP.
Do you see a log entry for their IP in the POP logs?
Matt Petty
Senior Software Developer
SmarterTools Inc.
www.smartertools.com