-
Notifications
You must be signed in to change notification settings - Fork 711
Closed
Labels
Description
Which OpenObserve functionalities are relevant/related to the feature request?
No response
Description
We have fixed the usage ingestion channel buffer to 2x of batch_size and only use one thread to ingest data to ingester.
let batch_size = cfg.common.usage_batch_size;
let (msg_sender, msg_receiver) = mpsc::channel::<UsageMessage>(batch_size * 2);
tokio::task::spawn(async move { ingest_usage_job(msg_receiver, batch_size, timeout).await });As user suggestion, we can set this to be a option, then user can configure how many threads and the buffer size to improve the case.