AmazonSQS will not work for cache invalidation, as that doesn't support a one producer to multiple consumer broadcast. AmazonMQ will work, however.
https://aws.amazon.com/amazon-mq/For AmazonMQ, although there is no additional documentation on how this might be configured, on a high level the steps should be same as that discussed in documentation for ActiveMQ.
https://docs.sdl.com/LiveContent/content/en-US/SDL%20Web-v5/GUID-7E728735-073B-4827-AABE-B45592CFF36D
For additional commentary on AmazonSQS, see below blog post
https://www.schibsted.pl/blog/choosing-best-aws-messaging-service/