Harrassing calls.

The fact you know the voice is male or female indicates you've continued to answer.  As long as you pick up, they'll continue to call.  Until you're able to block the calls, just stop answering the phone when you receive a call from someone you don't know when you aren't expecting a call.  Activate Voice Mail and check for a message.  If the call was important, the caller will leave a message and you can call them back.  That's what I do.  When I'm not expecting a call, I have Voice Tools settings set to ring twice and go to Voice Mail so that I don't have to hear the phone ring more than necessary.  Another option is the "Do Not Disturb" Voice Tools setting.  It will send calls directly to Voice Mail without ringing your phone at all.