Who can see my whatsapp?

If someone has my phone number but i deleted his, can he still see my whatsapp? Or we both have to have each other's in order to be a contact on whatsapp?