Police today rebuffed suggestions that they are not acting firmly enough to expel a group of armed intruders in Lahad Datu, stressing "we know what we are doing".