1

Our application is using Serilog's Application Insights sink to log to the Application Insights traces table. The app calls out to an API and we'd like to log the body of the request sent to the API, and the body of the response coming back.

Sometimes the request or response bodies are larger than the 32 kB maximum limit for the message column in the traces table. In that case the JSON request or response body is truncated.

Does Application Insights have the equivalent of the SQL Server FILESTREAM data type, where large objects are saved to a backing store but appear to be stored in the same table as other data? With a SQL Server FILESTREAM column the data in the column appears to be saved in the database table, along with the data in the other columns, but behind the scenes SQL Server is storing that data in the file system and not in the database. Does Application Insights have equivalent functionality to get around the 32 kB message limit?

I understand the Azure Data Explorer doesn't suffer from the same 32 kB limit and could be used to query Application Insights logs. If we could just store data larger than 32 kB we wouldn't need to be able to query it via Application Insights. We could use Azure Data Explorer to query it. So I'm wondering whether there is a simple way to break through the 32 kB limit for storing log messages, or whether we would need to develop something from scratch.

Simon Elms
  • 17,832
  • 21
  • 87
  • 103
  • 1
    As of now Azure Application insights has a limit of 32 kB of telemetry. The overall max telemetry of 64 kB. so, we cannot extend the limit. For [reference](https://learn.microsoft.com/en-us/azure/azure-monitor/service-limits#application-insights) – Delliganesh Sevanesan Sep 07 '22 at 13:02
  • Thanks @DelliganeshSevanesan. I won't spend any more time trying to work around the limitation with Application Insights. We'll find some other way of logging the data. – Simon Elms Sep 07 '22 at 21:42
  • 1
    Refer my one of the related [answer](https://stackoverflow.com/a/73546760/15997690) – Delliganesh Sevanesan Sep 08 '22 at 03:18
  • Have you found any alternative way ? – Delliganesh Sevanesan Sep 27 '22 at 00:40
  • @DelliganeshSevanesan: We haven't found any easy way. One of the guys on the project created a new Serilog sink that wraps the existing Application Insights sink. It can write large payloads to Blob Storage and then writes a log message to Application Insights with the URL of the newly stored blob. Ordinary messages are written straight to Application Insights. It works for logging but I'm not sure how easy it will be to write queries that follow the URLs in the Application Insights logs to extract the request bodies from Blob Storage. – Simon Elms Sep 29 '22 at 00:04

0 Answers0