The Wealthsimple LLM Gateway is an internal tool developed by Wealthsimple to securely and reliably manage interactions with Large Language Models (LLMs) like OpenAI and Cohere.
Since its internal launch in April 2023, the Wealthsimple LLM Gateway has facilitated over 72,000 requests for various use cases, including code generation, content editing, and general inquiries, allowing Wealthsimple employees to explore LLM technology responsibly.
Additionally, the gateway helps mitigate issues of accuracy at the application level, such as reducing the occurrence of "hallucinations" where LLMs generate incorrect or nonsensical outputs. The gateway consists of two main components: a recreated chat frontend that restricts data sharing to the API, and an API wrapper that interfaces with LLM endpoints, with plans to support more providers in the future.
(Perfect for making buy/build decisions or internal reviews.)
