Prime Minister Abdullah Ahmad Badawi has been urged to relinquish his internal security minister post if he is unable to stop the rising crime rate.