Facing protests from both sides of the political spectrum, ABC has decided to pull its unscripted series “Welcome to the Neighborhood.”

The show, which was scheduled to premiere Sunday, was to follow seven families competing to win title to a 3,300-square-foot home in a development near Austin, Texas. Their judges would be three families already living there – families with particular ideas about what they want in a neighbor.

In order to make the choice more difficult, the seven competing families included a gay couple with an adopted son, a Hispanic couple with four kids, a heavily tattooed couple and a family that practices Wicca.

And that’s where the trouble came in. Groups ranging from the Gay and Lesbian Alliance Against Defamation to the conservative Family Research Council lodged complaints about the series, saying that while they understood the goal of the show was to challenge people’s beliefs and foster acceptance of differences, early episodes could have sent the opposite message to viewers. Fair housing groups also expressed concern about the show.

All that led ABC to reconsider the show, which it had touted at May’s upfront presentation to advertisers and in press materials as recently as Monday.

The Family Research Council was concerned that one of the families, described by ABC as “devoted Christians,” would be portrayed as close-minded and judgmental. GLAAD, for its part, says the show was treading on dangerous ground by letting “intolerance and bigotry go unchallenged for weeks at a time.”