Buffer Output tuning - and consistency with fluentd BufferedOutput

[ericdahl]

This plugin doesn't inherit from BufferedOutput so the typical fluentd configuration options around tuning buffers are not available (e.g,. memory vs file, flush interval, etc)

Is this intentional? It seems like it would be easier to use if it was consistent with other buffered output plugins, using the standard <buffer> type config

I noticed this when converting from the Splunk output plugin to this output plugin, and specifically seeing that the flush interval was much higher, without an apparent way to tune it.

[perk-sumo]

Hello Eric, thank you for submitting!

Let us take a look and prioritise it.

One thing though - can you share your use case? Maybe you could consider using our https://github.com/SumoLogic/sumologic-otel-collector distro instead?

[ericdahl]

Hi, thanks for checking.

We've been using fluentd for years for log collection, processing and buffering/aggregation across hundreds of ephemeral docker hosts. We also have some custom plugins for log filtering and processing. Fluentd has been great for us and this plugin also was an easy integration to output logs to Sumo.

This plugin seems to work fine, but was just interested in whether it could be improved via the BufferedOutput alignment, allowing for more tuning as needed.