There's an element of truth to this. I'd be extremely cautious of asking a visitor if they were American without being sure, because, yes, many people will take offense if mistaken for an American.