Clean up contacts when we are marked as spam