<human>: Can you give me the gist of the text in a nutshell?

My boyfriend has a friend (long story) - female - who hangs out with him on his graveyard shift job on the weekends. I'm not exactly happy about it, and the worst part is I know she has a crush on him. I've obviously expressed that she has a crush, and he shrugs it off since *he's* not interested.

His job is extraordinarily boring, and mostly just watches TV until the early morning. I get why he wants people to stop by and say hi, but this particular chick I don't want visiting him. So I finally got the balls and told him "You said to tell you if I feel this way so.. I don't really feel comfortable with her visiting you at work anymore. I'm sorry."

His response was, "Really?"

This lead to him calling me unreasonable, and ridiculous. But then follows it up with that he's not mad at me, and all that crap. Because I felt so stupid and hurt, I backpedaled and now have said it's OK for her to visit, but he has to kick her out after a certain time - he said he'd text me when she came to visit and I could dictate how long she could be there for.

I trust him, I don't trust her. But why say "tell me if you're uncomfortable" then basically mock me for it? I feel fucking terrible, and I feel like I shouldn't have backed down. What say you? Did I fold too easy? :/
<bot>: Boyfriend said to come with him with problems, reacted negatively when I did. Don't really want to tell him if I have problems now.