Having to work hands-on in a project that was designed to go to production using a service in preview mode, specifically the one you mentioned: Redshift serverless, I can let you know of the stories that I had to go through.
It is correct that these services do not have the SLAs of regular service, you can check Beta and Preview service terms here: aws service-terms
These include scary things like:
"(a) you will not have any further right to access or use the applicable Beta Service or Beta Region, and (b) Your Content used in the applicable Beta Service or Beta Region may be deleted or inaccessible."
In my experience I got very prompt from support when I faced the many issues that appeared.
For most of the part the biggest issue so far was that AWS kept modifying the service, sometimes weekly. This ment that the console changed, the parameters changed, the options changed. It also meant that a cluster that was working stopped been available because an option that did not exist before was now mandatory.
We planned to mitigate this by moving the serverless cluster to a provisioned cluster. At first the option did not exist, even if it was documented. Support could not give us a date and actually removed that part of the documentation.
Then, in a new release, the option appeared and we did some successfull tests. The following week when we planned to migrate everything, the option was still there but it did not work. The response from support was that it was no longer available and no date planned.
At the time of writing it is still in preview mode and cannot create a provisioned cluster from a serveless snapshot. So we are planning to recreate in a provisioned cluster and move the data.
So, the take on this is not to use or plan to use a service in preview mode for production.