I sort of have the reverse problem.
Because of my job I know many people & recognize them when I'm away from work. Many of them seem to have no idea who I am when I talk to them. This even happened at my family reunion this week. I saw someone I recognized & even after telling her how I knew her there was no recognition from her. I had no idea we were related, this is the first time I remember seeing her at the reunion.