A way to setup simple push notifications to both iOS and macOS apps without setting up my own server?

Firebase has always been a straightforward and lovely experience for me when using any of their technologies, but as far as I read just now their push notification service only works for iOS, not macOS. My experience with AWS and anything backend is very limited, so forgive the potentially obvious question - is it possible to use for example AWS to reduce the burden of setting up push notification delivery to iOS and macOS? If so, does anyone have any links or resources related to this topic?