I would think there would be a difference between owning a home and "letting" your family, servants, whatever, live @ there, and buying a house, in an area deemed residential, with the expressed purpose of chopping it up into rental units, and charging people to live there. That's where I think the legal battle is. Not denying someone the right to live in that neighborhood, but turning a residential house into a commercial venture.