Remote Read Meets Streaming
Prometheus Blog

Remote Read Meets Streaming


Summary

Prometheus 2.13.0 introduces a streamed version of the Remote Read API, addressing significant memory usage issues with the previous implementation. The new API utilizes a chunked, iterative approach—similar to how Prometheus processes queries internally—allowing clients to receive data series by series without buffering the entire response in memory. This improvement enables more efficient querying of Prometheus data, especially for large datasets and use cases like seamless upgrades and integration with long-term storage systems like Thanos.
Read the Original Article

This article originally appeared on Prometheus Blog.

Read Full Article on Original Site

Popular from Prometheus Blog

1
When (not) to use varbit chunks
When (not) to use varbit chunks

Björn “Beorn” Rabenstein May 8, 2016 61 views

2
Announcing Prometheus 3.0
Announcing Prometheus 3.0

The Prometheus Team Nov 14, 2024 25 views

3
Interview with Hostinger
Interview with Hostinger

Brian Brazil Feb 6, 2019 25 views

4
Practical Anomaly Detection
Practical Anomaly Detection

Brian Brazil Jun 18, 2015 25 views

5
Interview with Weaveworks
Interview with Weaveworks

Brian Brazil Feb 20, 2017 24 views