I feel like it could be a joke about Klan robes (which is also meant to look like a ghost, so I guess it's what you said).

I have a hunch that racist people would be hard to haunt because they’d just see you as a white person.

But they would never be entirely sure since they can't caliper ghost's skull.