Configure mailer_from in runtime config and update UserNotifier and AlertNotifier to use the configured from address.