Hardware-Accelerated Architecture Brings Enterprise RAG to New Scale and Efficiency

Zilliz, the company behind Milvus, the world’s most advanced open-source vector database, announced a strategic collaboration with Pliops to revolutionize large-scale Retrieval-Augmented Generation (RAG) deployments. By integrating Pliops’ LightningAI architecture with Milvus, enterprises can now achieve multi-billion-scale vector search at storage-level costs, breaking through traditional memory constraints that have limited GenAI applications.

As enterprises scale their AI initiatives, vector databases must handle billions of embeddings while maintaining performance and managing costs. This collaboration addresses these challenges head-on by combining Milvus’s industry-leading vector search capabilities with Pliops’ hardware-accelerated storage technology, enabling efficient large-scale context retrieval and inference for enterprise AI workloads.

Marketing Technology News: MarTech Interview with Miguel Lopes, CPO @ TrafficGuard

Advancing Milvus for Next-Generation AI Infrastructure

Milvus powers mission-critical AI applications across various industries, including semantic search and recommendation systems, as well as agentic AI and RAG. Its distributed, cloud-native architecture is designed for massive scale, and this collaboration takes that capability even further.

Through this partnership, Zilliz will introduce several key enhancements to Milvus in collaboration with Pliops:

• Storage APIs and Tiering: Support for multi-tier storage to optimize cost and performance.
• KV Mapping: Adding a key-value abstraction layer on top of file offsets for efficient caching and retrieval.
• Dual-Tier Architecture:
  • Flash Tier (Hot): Ultra-low latency and high-density access.
  • S3 Tier (Cold): Reliable, globally distributed backup for cost efficiency.

Marketing Technology News: Disrupt or Be Disrupted: The AI Wake-Up Call for B2B Marketers

These enhancements allow enterprises to significantly expand context windows, improve inference efficiency, and reduce infrastructure overhead—while maintaining the performance and reliability that Milvus users expect in production environments.

“This collaboration represents a significant leap forward in making enterprise-scale vector search economically viable,” said Charles Xie, Founder and CEO of Zilliz. “Pliops’ LightningAI introduces a breakthrough approach to scaling GenAI inference, and integrating it with Milvus unlocks truly massive context retrieval at a fraction of the traditional cost. As the creators of Milvus, we’re committed to advancing what’s possible in vector search. This collaboration gives enterprises a clear path to run larger models, access more knowledge, and deliver faster AI experiences—all without the memory limitations that have constrained GenAI until now.”

Ido Bukspan, CEO of Pliops, added, “LightningAI is designed to make AI inference scalable and affordable. Partnering with Zilliz brings the best of storage and retrieval intelligence together.”