<human>: I went to my boyfriends house today and right away I could tell something was bugging him. I made the mistake of not asking him what the problem was, so I ignored it and we were mostly silent for the remainder of my time there. He asked what we should do, suggested a geocache, and he went on his computer to look for one. The whole time it was dead silent. Then I ask if he's seen a necklace I haven't worn in a while and he hands me the bag of stuff I usually keep at his house. 

While going through it I notice a pair of underwear that were in no way shape or form mine. Now I have no reason to think he's cheating on me, but this is the second time I've found another woman's underwear in his things. He says they're his sisters, which I believe. But since things are weird between us, I get into a bad mood about the underwear thing and I mumble something under my breath, which makes him angry. He asks me to leave, so I do. He called me about 10 times after that, and I answer 2 times. He asks me to come back. I say no. Thats the end of it.
 
Then I go hang out with my friend so I can get my mind off of it. He texts me and says I love you, but my phone was on silent as it usually is when I'm hanging out with a friend. The second text he sends me 10 minutes later I see, and it says "That's fucked up..but whatever. I can play that game too." I explain to him I didn't see the other text, and he replies "K." Wtf? Does he have a right to be mad at me too? Can someone give me some insight on what you think he's feeling? Cause right now I think he's in the wrong here.

Provide a brief overview of the text.
<bot>: Boyfriend asks me to leave his house. I do. He calls and asks me to come back after. I refuse and ignore a text that says "I love you" and now he's mad at me.