Despite a stern warning from Philippine President Benigno Aquino, the followers of Sulu sultan Jamalul Kiram, who have holed up in a village in Lahad Datu, will not leave Sabah.