Locals in a ritzy Sydney suburb have been given a scare after a major police operation shut down a residential street.