For anyone else that stumbles on here, I was not getting any agent alerts for power failures until I setup and enabled the email settings and checked those for notification as well. Now I get email and agent alerts (PushOver) when UPS goes on battery.