When all the lights are out on the charge port, that means charging is complete (though the green light stays on constantly for a few minutes right when the charging finishes, but then it turns off), so that doesn't tell us much, other than there was no error, so charging completed as it was instructed. Are you sure you set off peak from 21:00 to 16:00? Did you mean 21:00 to 06:00 the next day? Maybe you set this up wrong? Did you set your departure time after the end of the off peak time?
When you say EVSE charging light is off, that also just means it is not charging. Again, this points to some programming that told the EVSE to stop charging.
Maybe someone who uses the off peak times can comment. I don't ever use that setting and I have not had issues with charging stopping prematurely.