It was narrated from ‘Aishah that the Prophet (ﷺ) said: “If a man stays among a people, he should not fast without their permission.”