In this Hadīth, the custodians of the Sacred House during the Prophet's time, namely Banu ‘Abd Manāf, are addressed, saying: You may not prevent anyone from circumambulating the House or praying in it at any time of the day or night as they wish. The prayer, here, is the two Rak‘ahs of circumambulation. The instruction applies to all times, including the times during which prayer is forbidden.