When the Neighbors come Knocking but you Don’t Wanna Answer