Advancing OpenSearch with gRPC and Protocol Buffers

OpenSearch is adopting gRPC as a high-performance alternative to its traditional REST APIs, addressing limitations with JSON's parsing overhead and payload size for data-intensive applications. They've developed an automated pipeline to generate Protobuf schemas from OpenAPI specifications, ensuring consistency between the two APIs and simplifying maintenance. Benchmarks show gRPC delivers significant performance improvements – up to 17% increased throughput and 22% reduced latency – particularly for workloads like vector search and bulk ingestion, and can be further enhanced with binary document formats like SMILE and CBOR.