Objectors accuse it of being “a stealth project” and say the money could be spent on "regeneration, more police and cleaning"