I suggest setting up a holiday calendar and having the public holidays set as working days. This way it will be deducted when requested.
To do so head to Settings > Company > Calendars > + new calendar. Select the template then edit the public holidays like so.

Once created you are free to assign the employees who need to use this calendar in their employment tables.