The house also has to be deemed habitable. Squatters are evicted from vacant homes on a regular basis because there are holes in the roof, fire damage, etc.

The only reason a squatter would get removed from a vacant house is:

1. If they become a nuisance to the neighborhood
2. The home is purchased and the new owners want them out.
3. Property is deemed unsafe
4. Property is up for demolition.