I am currently trying to set up the AWS Glue Connector for Elasticsearch
I am having difficulty understanding the proper format for the output schema. There is no good documentation on setting up the output schema that I can find.
Can anyone help me with understand what format the output schema should be in?
Is the schema based on the full response from elasticsearch or just the data returned?
Currently I have the schema set up as the entire response from elasticsearch when you hit the _search endpoint as shown in the attached image.
However this is throwing long overflow errors as if the format is incorrect.
Any help with this matter would be greatly appreciated.
I am not sure how to set up the schema properly specifically for the connector as I can find no documentation on the topic anywhere online.
