Yes, its generally thought of as rude by human beings in America to call somebody by their last name only when you aren’t friends.
if you are introduced to somebody named Tom Smith and then said “smith, what are you up to” they’d look at you sideways. It’s not weird, it’s basic human interaction.
it’s a condescending tone a boss or coach would take with an underling. And really poor form with an elder.