Relativity

In the grand George Carlinian tradition of Things That Are Pissing me Off:
I live in New York City.
My friend lives in Boston, Massachusetts.
My friend wants me to come and visit him, so as we’re talking on the phone he says, “Hey, you really have to come down and visit one of these days…”
Has this happened to you?
Why don’t people understand their locations in relation to other places?