Benthos is an open source data streaming engine written entirely in Go and packaged as a static single-binary command line tool. Through an embedded DSL called Bloblang, it allows users to express complex transformations of structured data, such as schema migrations and validations. Its Go API allows users to import Benthos as a library and extend it through custom plugins.
Benthos is a stateless data streaming engine which implements transaction based resiliency with back pressure, so when connecting to at-least-once sources and sinks it's able to guarantee at-least-once delivery without needing to persist messages during transit.
Data transformations can be expressed using a high-level DSL called Bloblang, or blobl for short, which is a language designed for mapping data of a wide variety of forms. It's a safe, fast, and powerful way to perform document mapping within Benthos. It also has a Go API for writing your own functions and methods as plugins.
Benthos Studio is an application that provides visual editing capabilities to the Benthos stream processor. You can also use it to test your pipelines using mocked input.
