Boyfriend always wants to hang out during meal times?

So my boyfriend always wants to hang out all the time whenever he can and he usually gets off work around 2 and then wants to spend the rest of the night together. I usually telly him I have to be home for dinner but he gets upset and says why cant we just have dinner together whats the big deal. I don't like eating around people and whenever he wants to go out we would have to go to a restaurant and I can never find anything I like and I don't like doing that what can I tell him or what should I do so I can avoid being with him around meal times.