Exa boosts embedding throughput by 50% to index billions of documents on AWS AI chips
Amazon Web ServicesFirst-party source
Feed metadata only. Open the publisher page for full context.
Exa's neural search engine is backed by an in-house vector database, so the unit economics of embedding tens of billions of web documents drive the business. This post shares how Exa optimized embedding inference on AWS Neuron hardware (Inferentia2 and Trainium2) with custom NKI kernels, reaching a 47% gain in performance and cost per million documents.
Feed descriptions may be incomplete. When a description conflicts with the headline, it is withheld; read the original publisher for full context.