Thank you for the response.
The timezone for both the calendar event and my account is set to Eastern Time (US).? The event in question is an all day event.
I have two other events for that day which are also all-day event and their reminders were sent out correctly.