1. Things about the person that are legitimately unique and special to you
2. Things that affect how much you know or infer about the person, such as how much you interact with or think about the person

Being aware of the second factor could help you try to know more people and reduce the chance of hallucinated differentness or specialness of people.

I did not think about this at all before today.