Deleting a contact from the Conversations List

I followed the FAQ instructions to delete a contact, and indeed, they are no longer on my Contacts List. HOWEVER, I still see their number (no name) and picture on my WhatsApp conversations (though the conversation itself was deleted, and is now empty)