For this, you'll want to enter this as a non-working day in the Calendar employees are assigned to.
Head to Settings > Calendars there select the calendar in question by clicking on it.
+ Add Event to add the office closure details. It will allow you to select the Employee Activity as non-working.

