Traceloop is another YC W23 batch startup that helps monitoring LLM models. Their SDK OpenLLMetry helps teams forward LLM Observability logs to 10+ different tools instead of staying locked to any one tool.

Pricing

It offers a backend for receiving these traces as well. Free-tier offering includes 10K monthly traces. It is also open source with Apache 2.0 License.

Things To Consider

Benefits

Its a tracing tool that collects traces directly from an LLM provider or framework like Langchain & LLamaIndex and publishes them in OTel format.
Being in OpenTelemetry format makes them compatible with multiple tools for visualisation and tracing. It is available for multiple languages.

‍