I've played over 400 games and only ever rematched once. It was because the guy asked me to right before I left the table. I was happy to oblige because I had the time, but I don't always. I usually leave right after the game, and usually, so does the other person.
To me this is normal, and rematches are the outlier.