when a girl responds negatively to double meanings

i don't see edit button so one more thing - i am thinking about real life contact. not messages.

You should be treating her as if she's acting a bit weird if she reacts like that. She's basically trying to say you're a chode and shouldn't be operating on that level. She's trying to rebuke/repress you back down into chode/orbiter/provider status. 

could you give an example of what would you say as a reaction?

Sure give me an example. 

this girl has a nickname (her friends call her that) which is just a combination of letters from her first name and surname. in my language it's close to something like smash it. so when we played pool and it was her turn, i jokingly told her to smash it in. and she's like: "stop it" but in irritated voice, definitely not that playful: "oh stop it you". she really meant it.

Why are you even tripping over something like that. 

i am not but this happened a couple of times and i am wondering how to handle it. if you always ignore it, and just keep doing it...

It's not the real issue here obviously, there's something else going on where she just doesn't see you as "worthy" of calling her by a sexual nickname. As far as a response, you could literally say anything, as long as you have the right tonality you're fine. But yeah just come up with another nickname for her.