<human>: Give me the gist of the text in a nutshell

This requires a little background. Sorry! I have known the fellow I am seeing [28 M] for around four years. Initially as the odd date and more recently as something more, although it has never been really a relationship. We see each other once or twice a week. Occasionally once a fortnight. It depends on our schedules with work and family. I'm fairly happy with this - I can't give any more time to a relationship than a couple of days a week and I can happily cope with not seeing someone of a week.

The problem I have is that if I have been busy then I will make an effort to be available to see this chap, but he never seems to reciprocate. When we do get to spend time together he is often distracted by other people. Today, as an example, he said he would be here for lunch, but got here at three. We went for a walk and to the pub and chatted. We got back and I cooked what was going to be our lunch for dinner. He took a phonecall (he is always distracted by the phone) and said, "I'm really sorry, but I need to leave by 9". So he ate and rushed off. 

This bothers me. I'm a little terrified that I am being a fool. He explained his reasons why, but I just didn't buy it. It was almost a little like he'd lost interest and needed to get away. If this was a one off, I would brush it off, but it happens frequently. My question is - am I being a mug? This is making me really quite miserable and whilst I can be patient if someone is genuinely busy or distracted I am not prepared to endure misery and feelings of being used.
<bot>: Other half rarely prioritises seeing me. When he does there is always a reason to rush off. Am I being a mug? Wondering if he likes the idea of having a girlfriend rather than me as an individual.