Back to news
Hardware & infrastructure

Exa boosts embedding throughput by 50% to index billions of documents on AWS AI chips

Amazon Web ServicesFirst-party source

Feed metadata only. Open the publisher page for full context.

Exa's neural search engine is backed by an in-house vector database, so the unit economics of embedding tens of billions of web documents drive the business. This post shares how Exa optimized embedding inference on AWS Neuron hardware (Inferentia2 and Trainium2) with custom NKI kernels, reaching a 47% gain in performance and cost per million documents.

Read original source Ask AI about this story

Feed descriptions may be incomplete. When a description conflicts with the headline, it is withheld; read the original publisher for full context.