Datadog is a popular infrastructure & application monitoring platform which has extended some of it’s integrations within the space of LLMs and related tooling. It’s interesting to see it’s out of the box dashboards for LLM Observability, yet it’s clear that there’s a lot more to be aspired from a brand like Datadog here.
Only supports OpenAI integrations currently with depth. There is only cloud option like the normal Datadog offering.
Details on how the setup works - https://docs.datadoghq.com/integrations/openai/
