There's no reason behind it tbh aside from knowing the game mechanics.
Most boys do get annoyed if matched up with girls, it could be based on their experience playing with girls or it could be the girl's performance throughout the game. It doesn't really point out that all boys are irritated playing with girls, I can say those are most likely immature.
I'm a man you might ask, I do play either with girl friend or random ones but I barely get mad at them, same goes to my fellow unless they did something that's worthy of getting annoyed.