Former Gerakan president Dr Lim Keng Yaik should quit his position as advisor and stop interfering in party matters, said seven leaders in the Federal Territories.