Let's say this squatter never stayed in the house. Wouldn't the owner arguably be worse off?

What would happen to an unoccupied, unwatched home in this neighborhood in the course of a year? At the least, it would be stripped clean.