A word from experience: terrible neighbors pretty much are gone in a year or two. Mostly they are renters and I find they move on, or their kids grow up and move away. What seems intolerable passes. Even homeowners are often gone because bad, nasty people don't pay their taxes or pay utility bills and they have to move on.

The only exception is a mentally ill neighbor hunkered down - that might be intolerable over the long term.

Not to say that you shouldn't evaluate the trajectory of your neighborhood over the last few years and try to determine if there is no hope overall of improvement.