llms.txt snapshot

# Opik Documentation

> Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

## Instructions for AI Agents

- For clean Markdown of any page, append `.md` to the page URL
- For section-specific indexes, append `/llms.txt` to any section URL
- For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://www.comet.com/_mcp/server

## Docs

- [Home](https://www.comet.com/docs/opik.md): Build, test, and optimize GenAI apps from prototype to production. Comprehensive tracing, evaluation, and prompt optimization for RAG, agents, and more.
- [Quickstart](https://www.comet.com/docs/opik/quickstart.md): Integrate Opik with your LLM application to log calls and chains efficiently. Get started with our step-by-step guide.
- [Opik's MCP server](https://www.comet.com/docs/opik/mcp-server.md): One command connects your AI coding assistant to Opik — it instruments your code, verifies the traces itself, and keeps working with your real data as you build.
- [Ollie](https://www.comet.com/docs/opik/ollie.md): Meet Ollie — the AI assistant built into Opik that doesn't just analyze your traces, it helps you improve your agent's code directly from the Opik platform.
- [FAQ](https://www.comet.com/docs/opik/faq.md): Explore common questions about Opik, learn how to get started, and find assistance to enhance your experience with our powerful tool.
- [Changelog](https://www.comet.com/docs/opik/changelog/llms.txt)
- [Upgrading to Opik 2.0](https://www.comet.com/docs/opik/opik-v2-upgrade.md): What changed in Opik 2.0 — everything is now organized around projects — how to update your SDK code, where your existing data was moved, and how to relocate it if needed.
- [Observability Overview](https://www.comet.com/docs/opik/tracing/overview.md): Monitor, debug, and optimize your LLM applications with Opik's observability platform for traces, spans, and conversations
- [Getting started with Observability](https://www.comet.com/docs/opik/tracing/getting-started.md): Add observability to your LLM application with Opik tracing using AI-powered skills or manual SDK integration
- [Tracing Core Concepts](https://www.comet.com/docs/opik/tracing/concepts.md): Learn about the core concepts of Opik's tracing system, including traces, spans, and threads, and how they work together to provide comprehensive observability for your LLM applications.
- [Debugging agents with Ollie](https://www.comet.com/docs/opik/tracing/debug-agents.md): Use Ollie and Opik Connect to investigate failing traces, identify root causes in your code, and verify fixes with test suites — all from the Opik dashboard
- [Diagnostics](https://www.comet.com/docs/opik/tracing/diagnostics.md): Opik Diagnostics automatically scans your project's traces with Ollie and surfaces recurring agent issues, complete with root cause, a suggested fix, and affected traces.
- [Log traces](https://www.comet.com/docs/opik/tracing/advanced/log_traces.md): Monitor the flow of your LLM applications with tracing to identify issues and optimize performance using Opik's powerful tools.
- [Log conversations](https://www.comet.com/docs/opik/tracing/advanced/log_chat_conversations.md): Capture and analyze chat conversations on Opik, enabling better tracking of user interactions and improving chatbot performance.
- [Log media & attachments](https://www.comet.com/docs/opik/tracing/advanced/log_multimodal_traces.md): Capture multimodal traces in Opik by logging images, videos, and audio files using the Python SDK's Attachment type.
- [Log Agent Graphs](https://www.comet.com/docs/opik/tracing/advanced/log_agent_graphs.md): Learn to log agent execution graphs in Opik for enhanced debugging and flow visualization across frameworks like LangGraph and Google ADK.
- [Log distributed traces](https://www.comet.com/docs/opik/tracing/advanced/log_distributed_traces.md): Learn to track distributed traces in complex LLM applications using Opik's built-in support for multi-service tracing.
- [Log user feedback](https://www.comet.com/docs/opik/tracing/advanced/annotate_traces.md): Capture user feedback and track performance metrics to enhance your agent's effectiveness with Opik's logging capabilities.
- [Cost tracking](https://www.comet.com/docs/opik/tracing/advanced/cost_tracking.md): Monitor and analyze cost patterns in your LLM apps using Opik's dashboard to identify anomalies and optimize spending.
- [Export data](https://www.comet.com/docs/opik/tracing/advanced/export-data.md): Export traces, spans, threads, datasets, and experiments from Opik using the SDK, REST API, UI, or command-line tools
- [Migrate data](https://www.comet.com/docs/opik/tracing/advanced/migrate-data.md): Move datasets and prompts — with their full version history and attached data — between projects with the opik migrate CLI command.
- [SDK configuration](https://www.comet.com/docs/opik/tracing/advanced/sdk_configuration.md): Configure Python and TypeScript SDKs effectively. Set up your API key and instance URL for seamless routing and authentication.
- [Offline fallback and message replay](https://www.comet.com/docs/opik/tracing/advanced/offline_fallback.md): Keep your tracing data intact during network outages with Opik's offline fallback. Learn how failed messages are automatically stored and replayed when connectivity is restored.
- [Dashboards](https://www.comet.com/docs/opik/tracing/dashboards/dashboards.md): Create customizable dashboards to monitor quality, cost, and performance of your LLM projects and visualize experiment results.
- [Production monitoring](https://www.comet.com/docs/opik/tracing/dashboards/production_monitoring.md): Monitor your production LLM applications with Opik. Evaluate feedback scores, trace counts, and token usage daily and hourly for optimal insights.
- [Development Overview](https://www.comet.com/docs/opik/development/overview.md): Configure, test, and deploy your AI agents with Opik — manage prompt versions, run your agent in the playground, and deploy new configurations from the UI
- [Agent playground](https://www.comet.com/docs/opik/development/agent-playground.md): Run agents locally while connected to Opik for full tracing, debugging, and observability
- [Prompt Playground](https://www.comet.com/docs/opik/development/prompt-playground.md): Test and compare prompt variants across models, then validate them against test suites — all without writing code
- [Prompt Library Overview](https://www.comet.com/docs/opik/development/prompt-library/overview.md): An overview of Opik's Prompt Library for versioning and managing the prompts behind your AI applications
- [Getting started with the Prompt Library](https://www.comet.com/docs/opik/development/prompt-library/getting-started.md): Learn how to push, fetch, and version prompts using Opik's Prompt Library
- [Text and chat prompts](https://www.comet.com/docs/opik/development/prompt-library/prompt-types.md): The two prompt structures supported by Opik's Prompt Library — when to use a text prompt vs. a chat prompt, multimodal content, and template engines
- [Version control](https://www.comet.com/docs/opik/development/prompt-library/version-control.md): Create, fetch, and compare Prompt Library versions using the Opik UI and SDK
- [Agent Optimization](https://www.comet.com/docs/opik/development/optimization-runs/overview.md): Learn about Opik's automated LLM prompt and agent optimization SDK. Discover MetaPrompt, Few-shot Bayesian, and Evolutionary optimization algorithms for enhanced performance.
- [Optimization Studio](https://www.comet.com/docs/opik/development/optimization-runs/optimization_studio.md): Run prompt optimizations from the Opik UI with datasets, metrics, and visual progress tracking.
- [Quickstart](https://www.comet.com/docs/opik/development/optimization-runs/quickstart.md): Install the Agent Optimizer SDK, run your first optimization, and inspect the results in under 10 minutes.
- [Optimizer Introduction Cookbook](https://www.comet.com/docs/opik/development/optimization-runs/quickstart_notebook.md): Learn how to use Opik Agent Optimizer with the HotPotQA dataset through an interactive notebook, covering setup, configuration, and optimization techniques.
- [Optimizer Frequently Asked Questions](https://www.comet.com/docs/opik/development/optimization-runs/faq.md): Find answers to common questions about Opik Agent Optimizer, including optimizer selection, configuration, usage, and best practices.
- [Changelog](https://www.comet.com/docs/opik/development/optimization-runs/changelog.md): Release notes focused on Agent Optimizer features.
- [Known Issues](https://www.comet.com/docs/opik/development/optimization-runs/known_issues.md): Known runtime issues when running Opik Optimizer with current dependencies.
- [Opik Agent Optimizer Core Concepts](https://www.comet.com/docs/opik/development/optimization-runs/optimization/concepts.md): Learn about the core concepts of Opik Agent Optimizer, including key terms, evaluation processes, optimization workflows, and best practices for effective LLM optimization.
- [Configuring LLM Providers](https://www.comet.com/docs/opik/development/optimization-runs/optimization/configure_models.md): Learn how to configure different LLM providers like OpenAI, Anthropic, Gemini, Azure, and Ollama for use with the Opik Agent Optimizer.
- [Define datasets](https://www.comet.com/docs/opik/development/optimization-runs/optimization/define_datasets.md): Design, version, and validate datasets used for optimization runs.
- [Define metrics](https://www.comet.com/docs/opik/development/optimization-runs/optimization/define_metrics.md): Create reliable metrics and composite objectives for Agent Optimizer runs.
- [Optimize prompts](https://www.comet.com/docs/opik/development/optimization-runs/optimization/optimize_prompts.md): Pick the right optimizer, run experiments, and ship better prompts.
- [Optimize tools (MCP)](https://www.comet.com/docs/opik/development/optimization-runs/optimization/optimize_tools.md): Improve MCP tool and parameter descriptions without changing prompt text.
- [Optimize agents](https://www.comet.com/docs/opik/development/optimization-runs/optimization/optimize_agents.md): Connect the Agent Optimizer to Agent Frameworks.
- [Optimize multimodal prompts](https://www.comet.com/docs/opik/development/optimization-runs/optimization/optimize_multimodal.md): Run optimizations for prompts that combine text, images, and other modalities.
- [Dashboard results](https://www.comet.com/docs/opik/development/optimization-runs/optimization/dashboard_results.md): Analyze optimization trials, failure modes, and improvements inside Opik.
- [Optimization algorithms overview](https://www.comet.com/docs/opik/development/optimization-runs/algorithms/overview.md): Compare Agent Optimizer algorithms and pick the right one for your workload.
- [Optimizer benchmarks](https://www.comet.com/docs/opik/development/optimization-runs/algorithms/benchmarks.md): Compare algorithm performance across common datasets and learn how to run the benchmark suite locally.
- [MetaPrompt Optimizer](https://www.comet.com/docs/opik/development/optimization-runs/algorithms/metaprompt_optimizer.md): Learn how to use the MetaPrompt Optimizer to refine and improve your LLM prompts through systematic analysis and iterative refinement.
- [HRPO (Hierarchical Reflective Prompt Optimizer)](https://www.comet.com/docs/opik/development/optimization-runs/algorithms/hierarchical_adaptive_optimizer.md): Learn how to use HRPO (Hierarchical Reflective Prompt Optimizer) to improve prompts through systematic root cause analysis of failure modes and targeted refinement.
- [Few-Shot Bayesian Optimizer](https://www.comet.com/docs/opik/development/optimization-runs/algorithms/fewshot_bayesian_optimizer.md): Learn how to use the Few-Shot Bayesian Optimizer to find optimal few-shot examples for your chat-based prompts using Bayesian optimization techniques.
- [Evolutionary Optimizer: Genetic Algorithms](https://www.comet.com/docs/opik/development/optimization-runs/algorithms/evolutionary_optimizer.md): Learn how to use the Evolutionary Optimizer to discover optimal prompts through genetic algorithms, with support for multi-objective optimization and LLM-driven genetic operations.
- [GEPA Optimizer](https://www.comet.com/docs/opik/development/optimization-runs/algorithms/gepa_optimizer.md): Use the external GEPA package through Opik's `GepaOptimizer` to optimize a single system prompt for single-turn tasks with a reflection model.
- [Parameter Optimizer: Bayesian Parameter Tuning](https://www.comet.com/docs/opik/development/optimization-runs/algorithms/parameter_optimizer.md): Learn how to use the Parameter Optimizer to find optimal LLM call parameters (temperature, top_p, etc.) using Bayesian optimization without changing your prompt.
- [Tool Optimization (MCP & Function Calling)](https://www.comet.com/docs/opik/development/optimization-runs/algorithms/tool_optimization.md): Learn how to optimize prompts that leverage MCP (Model Context Protocol) tools and function calling capabilities across supported optimizers.
- [Synthetic Data Optimizer Cookbook](https://www.comet.com/docs/opik/development/optimization-runs/cookbooks/synthetic_data_optimizer_cookbook.md): Learn how to generate synthetic Q&A data from Opik traces and optimize prompts using the MetaPromptOptimizer through an interactive notebook.
- [ARC-AGI Optimization Tutorial](https://www.comet.com/docs/opik/development/optimization-runs/cookbooks/arc_agi_optimizer_cookbook.md): End-to-end ARC-AGI optimization walkthrough with Opik Agent Optimizer.
- [Multimodal Agent Optimization Tutorial](https://www.comet.com/docs/opik/development/optimization-runs/cookbooks/multimodal_agent_optimizer_cookbook.md): Multimodal agent optimization tutorial inspired by a self-driving car example.
- [Extending Optimizers](https://www.comet.com/docs/opik/development/optimization-runs/advanced/extending_optimizers.md): Learn how to extend Opik's optimization framework with custom algorithms and contribute to the project's development.
- [Custom metrics](https://www.comet.com/docs/opik/development/optimization-runs/advanced/custom_metrics.md): Build specialized metrics, integrate external models, and reuse them across optimizations.
- [Custom Optimizer Prompts](https://www.comet.com/docs/opik/development/optimization-runs/advanced/prompt_customization.md): Learn how to override and customize the internal prompt templates used by Opik optimizers to add domain constraints, safety requirements, or custom formatting.
- [Sampling controls](https://www.comet.com/docs/opik/development/optimization-runs/advanced/n_samples.md): Use n_samples, n_samples_minibatch, and the n parameter to trade cost for stability and exploration.
- [Multiple Completions (n parameter)](https://www.comet.com/docs/opik/development/optimization-runs/advanced/multiple_completions.md): Learn how to use the n parameter to generate multiple candidate outputs per evaluation, reducing variance and improving optimization results through best-of-k selection.
- [Chaining optimizers](https://www.comet.com/docs/opik/development/optimization-runs/advanced/chaining_optimizers.md): Run multiple optimizers in sequence to balance exploration and fine-tuning.
- [Opik Agent Optimizer API Reference](https://www.comet.com/docs/opik/development/optimization-runs/advanced/api_reference.md): Technical SDK reference guide
- [Evaluation Overview](https://www.comet.com/docs/opik/evaluation/overview.md): Evaluate your LLM applications with Opik using assertion-based Test Suites or dataset-driven metric scoring
- [Getting started with Evaluation](https://www.comet.com/docs/opik/evaluation/getting-started.md): Get started evaluating your LLM application with Opik using Test Suites or dataset-driven metrics
- [Evaluation Concepts](https://www.comet.com/docs/opik/evaluation/concepts.md): Understand the two evaluation approaches in Opik — Test Suites with assertions and Datasets with metrics
- [Building Test Suites](https://www.comet.com/docs/opik/evaluation/advanced/building-test-suites.md): Create and manage Test Suites using the SDK, UI, or Ollie to build regression tests from real production failures
- [Evaluate your agent](https://www.comet.com/docs/opik/evaluation/advanced/evaluate_your_llm.md): Evaluate your LLM applications confidently. Learn the five steps to assess complex LLM chains or agents effectively.
- [Resume an interrupted evaluation](https://www.comet.com/docs/opik/evaluation/advanced/resume_evaluations.md): Continue a long-running Opik evaluation after a crash, network blip, or Ctrl-C — replaying only the runs that didn't finish.
- [Manage datasets](https://www.comet.com/docs/opik/evaluation/advanced/manage_datasets.md): Evaluate your LLM using datasets. Learn to create and manage them via Python SDK, TypeScript SDK, or the Traces table.
- [Evaluate agent trajectories](https://www.comet.com/docs/opik/evaluation/advanced/evaluate_agent_trajectory.md): Evaluate agent trajectories to optimize tool selection and reasoning paths, ensuring efficient agent behavior before production with Opik.
- [Evaluate multi-turn agents](https://www.comet.com/docs/opik/evaluation/advanced/evaluate_multi_turn_agents.md): Learn to evaluate multi-turn agents using simulation techniques to enhance chatbot performance and improve user interactions.
- [Annotation Queues](https://www.comet.com/docs/opik/evaluation/advanced/annotation_queues.md): Optimize your AI projects by enabling SMEs to efficiently review and annotate outputs using Opik's intuitive Annotation Queues feature.
- [Manually logging experiments](https://www.comet.com/docs/opik/evaluation/advanced/log_experiments_with_rest_api.md): Evaluate your LLM application by logging pre-computed experiments and boosting confidence in performance with this detailed guide.
- [Overview](https://www.comet.com/docs/opik/evaluation/metrics/overview.md): Describes all the built-in evaluation metrics provided by Opik
- [Heuristic metrics](https://www.comet.com/docs/opik/evaluation/metrics/heuristic_metrics.md): Describes all the built-in heuristic metrics provided by Opik
- [Hallucination](https://www.comet.com/docs/opik/evaluation/metrics/hallucination.md): Describes the Hallucination metric
- [LLM Juries](https://www.comet.com/docs/opik/evaluation/metrics/llm_juries.md): Combine multiple judges into an ensemble with LLMJuriesJudge
- [G-Eval](https://www.comet.com/docs/opik/evaluation/metrics/g_eval.md): Describes Opik's built-in G-Eval metric which is a task agnostic LLM as a Judge metric
- [Conversation-level GEval Metrics](https://www.comet.com/docs/opik/evaluation/metrics/g_eval_conversation_metrics.md): How to run GEval-based judges on full conversations
- [Compliance risk](https://www.comet.com/docs/opik/evaluation/metrics/compliance_risk.md): Flag non-compliant or high-risk assistant replies with ComplianceRiskJudge
- [Prompt uncertainty](https://www.comet.com/docs/opik/evaluation/metrics/prompt_diagnostics.md): Estimate prompt ambiguity with PromptUncertaintyJudge
- [Moderation](https://www.comet.com/docs/opik/evaluation/metrics/moderation.md): Describes the Moderation metric
- [Meaning Match](https://www.comet.com/docs/opik/evaluation/metrics/meaning_match.md): Describes the Meaning Match metric
- [Usefulness](https://www.comet.com/docs/opik/evaluation/metrics/usefulness.md): Describes the Usefulness metric
- [Summarization consistency](https://www.comet.com/docs/opik/evaluation/metrics/summarization_consistency.md): Ensure autogenerated summaries stay faithful to the source content
- [Summarization coherence](https://www.comet.com/docs/opik/evaluation/metrics/summarization_coherence.md): Rate how readable and well-structured a summary is with SummarizationCoherenceJudge
- [Dialogue helpfulness](https://www.comet.com/docs/opik/evaluation/metrics/dialogue_helpfulness.md): Measure how helpful an assistant reply is within a dialogue
- [Answer relevance](https://www.comet.com/docs/opik/evaluation/metrics/answer_relevance.md): Describes the Answer Relevance metric
- [Context precision](https://www.comet.com/docs/opik/evaluation/metrics/context_precision.md): Describes the Context Precision metric
- [Context recall](https://www.comet.com/docs/opik/evaluation/metrics/context_recall.md): Describes the Context Recall metric
- [Trajectory accuracy](https://www.comet.com/docs/opik/evaluation/metrics/trajectory_accuracy.md): Score whether an agent followed the expected action path
- [Agent task completion](https://www.comet.com/docs/opik/evaluation/metrics/agent_task_completion.md): Verify whether an agent fulfilled its assigned objective
- [Agent tool correctness](https://www.comet.com/docs/opik/evaluation/metrics/agent_tool_correctness.md): Evaluate whether an agent invoked and interpreted tools correctly
- [Conversational metrics](https://www.comet.com/docs/opik/evaluation/metrics/conversation_threads_metrics.md): Describes metrics related to scoring the conversational threads
- [Custom model](https://www.comet.com/docs/opik/evaluation/metrics/custom_model.md): Describes how to use a custom model for Opik's built-in LLM as a Judge metrics
- [Advanced configuration](https://www.comet.com/docs/opik/evaluation/metrics/advanced_configuration.md): Fine-tune Opik metrics with async scoring, evaluator temperatures, and logprob handling
- [Custom metric](https://www.comet.com/docs/opik/evaluation/metrics/custom_metric.md): Describes how to create your own metric to use with Opik's evaluation platform
- [Custom conversation metric](https://www.comet.com/docs/opik/evaluation/metrics/custom_conversation_metric.md): Learn how to create custom metrics for evaluating multi-turn conversations
- [Structured Output Compliance](https://www.comet.com/docs/opik/evaluation/metrics/structure_output_compliance.md): Describes the StructuredOutputCompliance metric
- [Task span metrics](https://www.comet.com/docs/opik/evaluation/metrics/task_span_metrics.md): Learn how to create task span metrics for evaluating the detailed execution information of your LLM tasks
- [Best practices for evaluating agents](https://www.comet.com/docs/opik/evaluation/evaluate_agents.md): Learn best practices for evaluating AI agents, ensuring reliability and scalability throughout their lifecycle with Opik's guidance.
- [Evaluate threads](https://www.comet.com/docs/opik/evaluation/evaluate_threads.md): Evaluate and optimize conversation threads in Opik using the evaluate_threads function in the Python SDK for enhanced multi-turn conversations.
- [Cookbook - Evaluate hallucination metric](https://www.comet.com/docs/opik/evaluation/evaluate_hallucination_metric.md): Learn to evaluate the Hallucination metric using the LLM Evaluation SDK and improve your model's performance with Opik.
- [Cookbook - Evaluate moderation metric](https://www.comet.com/docs/opik/evaluation/evaluate_moderation_metric.md): Evaluate the Moderation metric in the LLM Evaluation SDK to enhance your moderation capabilities using Opik's platform.
- [Guardrails overview](https://www.comet.com/docs/opik/guardrails/overview.md): Learn what guardrails are, why they matter, and when to use guardrails versus online evaluation to protect your LLM application.
- [Policies](https://www.comet.com/docs/opik/guardrails/policies.md): Create and manage named guardrail policies in the Opik UI, then build a guardrail from them with Guardrail.from_stored_policies.
- [Guards](https://www.comet.com/docs/opik/guardrails/guardrails.md): The five guard types available in Opik guardrails — PII, topic, prompt injection, LLM judge, and custom classifier — what each one checks and what you configure.
- [Prompt injection model](https://www.comet.com/docs/opik/guardrails/prompt-injection-model.md): Opik Guard is Opik's custom-trained model behind the prompt injection guardrail, built on real attacks and evaluated out-of-distribution for honest generalization.
- [Custom models](https://www.comet.com/docs/opik/guardrails/custom-guardrails.md): Fine-tune a language model on your own labeled examples to create a custom guardrail in Opik, then run it from a policy. Opik hosts the training and serves the model for you.
- [Guardrails server](https://www.comet.com/docs/opik/guardrails/server.md): How to install, configure, start, and call the Opik guardrails backend that runs the PII, Topic, prompt injection, and custom classifier models.
- [Online Evaluation rules](https://www.comet.com/docs/opik/production/online-evaluation/rules.md): Evaluate production LLM performance with Opik's automated metrics to efficiently score traces and identify issues.
- [Gateway](https://www.comet.com/docs/opik/production/gateway-guardrails/gateway.md): Build a centralized LLM gateway with Opik to streamline access to multiple LLM providers using a consistent API format.
- [Anonymizers](https://www.comet.com/docs/opik/production/gateway-guardrails/anonymizers.md): Protect sensitive information in your LLM applications with Opik's Anonymizers, ensuring compliance and preventing accidental data exposure.
- [Alerts](https://www.comet.com/docs/opik/production/alerts/alerts.md): Configure automated webhook notifications to stay informed about events in your Opik workspace, from trace errors to feedback scores and prompt changes.
- [Overview](https://www.comet.com/docs/opik/administration/overview.md): Learn how to manage users, workspaces, roles, and authentication settings in Opik for your organization.
- [Roles and Permissions](https://www.comet.com/docs/opik/administration/roles_and_permissions.md): Learn how to configure workspace roles and permissions in Opik for fine-grained access control.
- [Overview](https://www.comet.com/docs/opik/administration/workspace-settings/overview.md): Configure workspace-level settings including feedback definitions, AI providers, preferences, and member management in Opik.
- [Feedback Definitions](https://www.comet.com/docs/opik/administration/workspace-settings/feedback_definitions.md): Configure custom feedback types for evaluating LLM outputs
- [AI Providers](https://www.comet.com/docs/opik/administration/workspace-settings/ai_providers.md): Configure connections to Large Language Model providers
- [Workspace Preferences](https://www.comet.com/docs/opik/administration/workspace-settings/workspace_preferences.md): Configure workspace-wide preferences including thread timeout and data truncation settings in Opik.
- [Workspace Members](https://www.comet.com/docs/opik/administration/workspace-settings/workspace_members.md): Manage workspace members, invite users, and control workspace access in Opik.
- [Admin Dashboard](https://www.comet.com/docs/opik/administration/admin-dashboard/overview.md): Learn how to access and navigate the Opik admin dashboard to manage your organization settings.
- [Workspaces](https://www.comet.com/docs/opik/administration/admin-dashboard/workspaces.md): Learn how to create, manage, and configure workspaces within your Opik organization.
- [Users](https://www.comet.com/docs/opik/administration/admin-dashboard/users.md): Learn how to manage users and organization roles in your Opik organization.
- [Organization Settings](https://www.comet.com/docs/opik/administration/admin-dashboard/organization_settings.md): Configure organization-wide settings in Opik.
- [Service Accounts](https://www.comet.com/docs/opik/administration/admin-dashboard/service_accounts.md): Learn how to create and manage service accounts for programmatic API access to your Opik organization.
- [Authentication Overview](https://www.comet.com/docs/opik/administration/authentication/overview.md): Learn about the authentication options available in Opik, including SAML, OIDC, and JWT, and choose the right one for your organization.
- [SAML SSO](https://www.comet.com/docs/opik/administration/authentication/saml.md): Learn how to configure SAML-based single sign-on for your Opik organization with enterprise identity providers.
- [OIDC SSO](https://www.comet.com/docs/opik/administration/authentication/oidc.md): Learn how to configure OpenID Connect (OIDC) single sign-on for your Opik organization.
- [JWT Authentication](https://www.comet.com/docs/opik/administration/authentication/jwt.md): Learn how to configure JWT-based authentication for programmatic access to your Opik organization.
- [Contribution Overview](https://www.comet.com/docs/opik/contributing/overview.md): Contribute to Opik by submitting bug reports, suggesting features, or improving documentation to enhance the project for everyone.
- [Documentation](https://www.comet.com/docs/opik/contributing/guides/documentation.md): Learn how to contribute effectively to Opik's documentation, including guidelines and structure for seamless collaboration.
- [Local Development Setup](https://www.comet.com/docs/opik/contributing/guides/local-development.md): Comprehensive guide for setting up and running Opik locally for development
- [Python SDK](https://www.comet.com/docs/opik/contributing/guides/python-sdk.md): Learn how to contribute to the Opik Python SDK, enabling seamless integration for developers in their Python applications.
- [TypeScript SDK](https://www.comet.com/docs/opik/contributing/guides/typescript-sdk.md): Learn how to contribute effectively to the Opik TypeScript SDK by reviewing guidelines and project structure.
- [Opik Optimizer](https://www.comet.com/docs/opik/contributing/guides/agent-optimizer-sdk.md): Contribute effectively to the Agent Optimizer SDK and enhance model performance. Start optimizing prompts with our detailed guide.
- [Frontend](https://www.comet.com/docs/opik/contributing/guides/frontend.md): Learn how to contribute to the Opik frontend project by reviewing guidelines and project structure for effective collaboration.
- [Backend](https://www.comet.com/docs/opik/contributing/guides/backend.md): Learn how to contribute to the Opik backend, enhancing data handling and API functionality in this Java application.
- [Bounty Program](https://www.comet.com/docs/opik/contributing/developer-programs/bounties.md): Participate in the Opik Bounty Program to enhance the platform, showcase your skills, and earn rewards for your contributions.
- [Overview](https://www.comet.com/docs/opik/integrations/overview.md): Explore how to log, visualize, and evaluate LLM calls and RAG pipelines using Opik's robust integrations with popular frameworks.
- [Observability for BeeAI (TypeScript) with Opik](https://www.comet.com/docs/opik/integrations/beeai-typescript.md): Start here to integrate Opik into your BeeAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for LangChain (JavaScript) with Opik](https://www.comet.com/docs/opik/integrations/langchainjs.md): Start here to integrate Opik into your LangChain-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Mastra with Opik](https://www.comet.com/docs/opik/integrations/mastra.md): Start here to integrate Opik into your Mastra-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Vercel AI SDK with Opik](https://www.comet.com/docs/opik/integrations/vercel-ai-sdk.md): Start here to integrate Opik into your Vercel AI SDK-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Cloudflare Workers AI with Opik](https://www.comet.com/docs/opik/integrations/cloudflare-workers-ai.md): Start here to integrate Opik into your Cloudflare Workers AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Google Gemini (TypeScript) with Opik](https://www.comet.com/docs/opik/integrations/gemini-typescript.md): Start here to integrate Opik into your Google Gemini-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for OpenAI (TypeScript) with Opik](https://www.comet.com/docs/opik/integrations/openai-typescript.md): Start here to integrate Opik into your OpenAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Opik TypeScript SDK](https://www.comet.com/docs/opik/integrations/typescript-sdk.md): Monitor and debug your JavaScript/TypeScript apps with Opik's SDK, enabling seamless integration for LLM applications and AI workflows.
- [Observability for AG2 with Opik](https://www.comet.com/docs/opik/integrations/ag2.md): Start here to integrate Opik into your AG2-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Agent Spec with Opik](https://www.comet.com/docs/opik/integrations/agentspec.md): Start here to integrate Opik into your Agent Spec-based application for end-to-end observability, unit testing, and optimization.
- [Observability for Agno with Opik](https://www.comet.com/docs/opik/integrations/agno.md): Start here to integrate Opik into your Agno-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for BeeAI (Python) with Opik](https://www.comet.com/docs/opik/integrations/beeai.md): Start here to integrate Opik into your BeeAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Claude Agent SDK with Opik](https://www.comet.com/docs/opik/integrations/claude-agent-sdk.md): Configure Claude Code telemetry and OTLP export settings with clear signal and compatibility expectations for Opik.
- [Observability for AutoGen with Opik](https://www.comet.com/docs/opik/integrations/autogen.md): Start here to integrate Opik into your AutoGen-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for CrewAI with Opik](https://www.comet.com/docs/opik/integrations/crewai.md): Start here to integrate Opik into your CrewAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for DSPy with Opik](https://www.comet.com/docs/opik/integrations/dspy.md): Start here to integrate Opik into your DSPy-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Google Agent Development Kit (Python) with Opik](https://www.comet.com/docs/opik/integrations/adk.md): Start here to integrate Opik into your Google Agent Development Kit-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Haystack with Opik](https://www.comet.com/docs/opik/integrations/haystack.md): Start here to integrate Opik into your Haystack-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Harbor with Opik](https://www.comet.com/docs/opik/integrations/harbor.md): Start here to integrate Opik into your Harbor benchmark evaluation runs for end-to-end agent observability and analysis.
- [Structured Output Tracking for Instructor with Opik](https://www.comet.com/docs/opik/integrations/instructor.md): Start here to integrate Opik into your Instructor-based genai application for structured output tracking, schema validation monitoring, and LLM call observability.
- [Observability for LangChain (Python) with Opik](https://www.comet.com/docs/opik/integrations/langchain.md): Start here to integrate Opik into your LangChain-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for LangGraph with Opik](https://www.comet.com/docs/opik/integrations/langgraph.md): Start here to integrate Opik into your LangGraph-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for LangServe with Opik](https://www.comet.com/docs/opik/integrations/langserve.md): Configure LangServe host-level OpenTelemetry export for Opik with clear applicability and minimal setup guidance.
- [Observability for LiveKit with Opik](https://www.comet.com/docs/opik/integrations/livekit.md): Start here to integrate Opik into your LiveKit-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for LlamaIndex with Opik](https://www.comet.com/docs/opik/integrations/llama_index.md): Start here to integrate Opik into your LlamaIndex-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Microsoft Agent Framework (Python) with Opik](https://www.comet.com/docs/opik/integrations/microsoft-agent-framework.md): Start here to integrate Opik into your Microsoft Agent Framework-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for OpenAI Agents with Opik](https://www.comet.com/docs/opik/integrations/openai_agents.md): Start here to integrate Opik into your OpenAI Agents-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Pipecat with Opik](https://www.comet.com/docs/opik/integrations/pipecat.md): Start here to integrate Opik into your Pipecat-based real-time voice agent application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Pydantic AI with Opik](https://www.comet.com/docs/opik/integrations/pydantic-ai.md): Start here to integrate Opik into your Pydantic AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Semantic Kernel (Python) with Opik](https://www.comet.com/docs/opik/integrations/semantic-kernel.md): Start here to integrate Opik into your Semantic Kernel-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Smolagents with Opik](https://www.comet.com/docs/opik/integrations/smolagents.md): Start here to integrate Opik into your Smolagents-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Strands Agents with Opik](https://www.comet.com/docs/opik/integrations/strands-agents.md): Start here to integrate Opik into your Strands Agents-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Temporal with Opik](https://www.comet.com/docs/opik/integrations/temporal.md): Configure Temporal Python OpenTelemetry tracing and export to Opik.
- [Observability for Twilio Agent Connect with Opik](https://www.comet.com/docs/opik/integrations/twilio-agent-connect.md): Start here to integrate Opik into your Twilio Agent Connect voice agent for end-to-end LLM observability, unit testing, and optimization.
- [Observability for VoltAgent with Opik](https://www.comet.com/docs/opik/integrations/voltagent.md): Start here to integrate Opik into your VoltAgent-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Anthropic with Opik](https://www.comet.com/docs/opik/integrations/anthropic.md): Start here to integrate Opik into your Anthropic-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for AWS Bedrock with Opik](https://www.comet.com/docs/opik/integrations/bedrock.md): Start here to integrate Opik into your AWS Bedrock-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for BytePlus with Opik](https://www.comet.com/docs/opik/integrations/byteplus.md): Start here to integrate Opik into your BytePlus-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Cohere with Opik](https://www.comet.com/docs/opik/integrations/cohere.md): Start here to integrate Opik into your Cohere-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for DeepSeek with Opik](https://www.comet.com/docs/opik/integrations/deepseek.md): Start here to integrate Opik into your DeepSeek-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Fireworks AI with Opik](https://www.comet.com/docs/opik/integrations/fireworks-ai.md): Start here to integrate Opik into your Fireworks AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Google Gemini (Python) with Opik](https://www.comet.com/docs/opik/integrations/gemini.md): Start here to integrate Opik into your Google Gemini-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Groq with Opik](https://www.comet.com/docs/opik/integrations/groq.md): Start here to integrate Opik into your Groq-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for MiniMax with Opik](https://www.comet.com/docs/opik/integrations/minimax.md): Track MiniMax model calls with Opik through the OpenAI-compatible or Anthropic-compatible API.
- [Observability for Mistral AI (Python) with Opik](https://www.comet.com/docs/opik/integrations/mistral.md): Start here to integrate Opik into your Mistral AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Novita AI with Opik](https://www.comet.com/docs/opik/integrations/novita-ai.md): Start here to integrate Opik into your Novita AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Ollama with Opik](https://www.comet.com/docs/opik/integrations/ollama.md): Start here to integrate Opik into your Ollama-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for OpenAI (Python) with Opik](https://www.comet.com/docs/opik/integrations/openai.md): Start here to integrate Opik into your OpenAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Qianfan with Opik](https://www.comet.com/docs/opik/integrations/qianfan.md): Start here to integrate Opik into your Qianfan-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Predibase with Opik](https://www.comet.com/docs/opik/integrations/predibase.md): Start here to integrate Opik into your Predibase-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Together AI with Opik](https://www.comet.com/docs/opik/integrations/together-ai.md): Start here to integrate Opik into your Together AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for IBM watsonx with Opik](https://www.comet.com/docs/opik/integrations/watsonx.md): Start here to integrate Opik into your IBM watsonx-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for xAI Grok with Opik](https://www.comet.com/docs/opik/integrations/xai-grok.md): Start here to integrate Opik into your xAI Grok-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Hugging Face Datasets with Opik](https://www.comet.com/docs/opik/integrations/huggingface-datasets.md): Start here to integrate Opik with Hugging Face Datasets for end-to-end LLM observability, unit testing, and optimization.
- [Evaluate LLM Applications with Ragas Metrics in Opik](https://www.comet.com/docs/opik/integrations/ragas.md): Use Ragas evaluation metrics to assess your LLM application quality and automatically track results in Opik for comprehensive performance monitoring.
- [Observability for Opik LLM Gateway with Opik](https://www.comet.com/docs/opik/integrations/opik-llm-gateway.md): Start here to integrate Opik LLM Gateway into your genai application for centralized LLM provider access using a consistent API format.
- [Observability for Kong AI Gateway with Opik](https://www.comet.com/docs/opik/integrations/kong-ai-gateway.md): Start here to integrate Kong AI Gateway with Opik for production-ready LLM gateway capabilities with enterprise features.
- [Observability for AISuite with Opik](https://www.comet.com/docs/opik/integrations/aisuite.md): Start here to integrate Opik into your AISuite-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Helicone with Opik](https://www.comet.com/docs/opik/integrations/helicone.md): Learn how to integrate Helicone with Opik to log and monitor your LLM traffic using the standard Helicone integration setup.
- [Observability for LiteLLM with Opik](https://www.comet.com/docs/opik/integrations/litellm.md): Start here to integrate Opik into your LiteLLM-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for OpenRouter with Opik](https://www.comet.com/docs/opik/integrations/openrouter.md): Start here to integrate Opik into your OpenRouter-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Portkey with Opik](https://www.comet.com/docs/opik/integrations/portkey.md): Start here to integrate Portkey with Opik for enterprise-grade LLM gateway capabilities with advanced routing and fallback features.
- [Observability for TrueFoundry with Opik](https://www.comet.com/docs/opik/integrations/truefoundry.md): Start here to integrate the TrueFoundry AI Gateway with Opik and trace every LLM and MCP call that passes through the gateway.
- [Observability for Vercel AI Gateway with Opik](https://www.comet.com/docs/opik/integrations/vercel-ai-gateway.md): Start here to integrate Vercel AI Gateway with Opik for unified access to multiple AI providers with edge-optimized performance.
- [Validation Tracking for Guardrails AI with Opik](https://www.comet.com/docs/opik/integrations/guardrails-ai.md): Start here to integrate Opik into your Guardrails AI-based genai application for validation tracking, compliance monitoring, and guard evaluation.
- [Overview](https://www.comet.com/docs/opik/integrations/python-sdk.md): Build powerful applications with Opik's Python SDK, enabling seamless integration and functionality for your projects.
- [OpenTelemetry Python SDK](https://www.comet.com/docs/opik/integrations/opentelemetry-python-sdk.md): Learn to instrument your Python applications with OpenTelemetry SDK to effectively send trace data to Opik for better observability.
- [Observability for Spring AI (Java) with Opik](https://www.comet.com/docs/opik/integrations/spring-ai.md): Start here to integrate Opik into your Spring AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Quarkus LangChain4j with Opik](https://www.comet.com/docs/opik/integrations/quarkus-langchain4j.md): Configure Quarkus LangChain4j OpenTelemetry export to send traces to Opik.
- [Observability for Microsoft Agent Framework (.NET) with Opik](https://www.comet.com/docs/opik/integrations/microsoft-agent-framework-dotnet.md): Start here to integrate Opik into your Microsoft Agent Framework-based .NET application for end-to-end LLM observability, unit testing, and optimization.
- [OpenTelemetry Ruby SDK](https://www.comet.com/docs/opik/integrations/opentelemetry-ruby-sdk.md): Configure OpenTelemetry SDK in your Ruby app to send telemetry data to Opik efficiently and enhance your observability.
- [Observability for Cursor with Opik](https://www.comet.com/docs/opik/integrations/cursor.md): Start here to integrate Opik into your Cursor-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Dify with Opik](https://www.comet.com/docs/opik/integrations/dify.md): Start here to integrate Opik into your Dify-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Flowise with Opik](https://www.comet.com/docs/opik/integrations/flowise.md): Start here to integrate Opik into your Flowise-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Hermes with Opik](https://www.comet.com/docs/opik/integrations/hermes.md): Install and configure the opik-hermes plugin to export LLM, tool, and agent traces to Opik.
- [Observability for Langflow with Opik](https://www.comet.com/docs/opik/integrations/langflow.md): Start here to integrate Opik into your Langflow applications for end-to-end LLM observability.
- [Observability for n8n with Opik](https://www.comet.com/docs/opik/integrations/n8n.md): Start here to integrate Opik into your n8n-based workflow automation for end-to-end LLM observability.
- [Observability for OpenClaw with Opik](https://www.comet.com/docs/opik/integrations/openclaw.md): Install and configure the OpenClaw community plugin to export LLM, tool, and agent traces to Opik.
- [Observability for OpenAI Codex with Opik](https://www.comet.com/docs/opik/integrations/openai-codex.md): Configure OpenAI Codex OpenTelemetry export to send trace telemetry to Opik.
- [Observability for OpenWebUI with Opik](https://www.comet.com/docs/opik/integrations/openwebui.md): Start here to integrate Opik into your OpenWebUI-based AI application for end-to-end LLM observability and monitoring.
- [Observability for Prompt Flow with Opik](https://www.comet.com/docs/opik/integrations/prompt-flow.md): Configure Prompt Flow tracing with OpenTelemetry endpoint settings compatible with Opik deployment modes.
- [OpenTelemetry](https://www.comet.com/docs/opik/integrations/opentelemetry.md): Integrate OpenTelemetry SDKs with Opik to enhance your ML/AI apps with distributed tracing and streamline monitoring.
- [Cost Intelligence](https://www.comet.com/docs/opik/cost-intelligence/overview.md): See where your coding-agent spend actually goes, with exact token totals attributed to system prompts, tools, MCP servers, skills, memory and user input, then reduce it with org and per-user policies.
- [Reduce coding agent spend](https://www.comet.com/docs/opik/cost-intelligence/reduce-agent-spend.md): How to cut coding agent spend with Cost Intelligence, from finding where the money goes to applying priced savings recommendations as org and per-user policy.
- [Roll out cost policies](https://www.comet.com/docs/opik/cost-intelligence/roll-out-cost-policies.md): How organization and user cost policies work together — the org baseline, per-user overrides and locks, how changes reach developer devices, and what happens when a setting is edited locally or cleared.
- [Installation overview](https://www.comet.com/docs/opik/cost-intelligence/install/overview.md): Choose a rollout path for Cost Intelligence (Claude Code managed settings, MDM-delivered configuration, or the macOS capture app), plus the full inventory of data collected.
- [Plugin with MDM](https://www.comet.com/docs/opik/cost-intelligence/install/mdm.md): Deploy Cost Intelligence to a fleet with Jamf, Kandji, Intune or JumpCloud by pushing a Claude Code managed-settings drop-in to each device.
- [Plugin with managed settings](https://www.comet.com/docs/opik/cost-intelligence/install/managed-settings.md): Roll out Cost Intelligence to your whole team from the Claude admin console with one JSON configuration, delivered to every authenticated user, no device management required.
- [macOS app with MDM](https://www.comet.com/docs/opik/cost-intelligence/install/macos-app.md): Deploy Cost Intelligence as a macOS menu-bar app and network extension for transparent capture of every Claude Code user, including the desktop app, delivered through the MDM you already run.
- [Data, privacy and security](https://www.comet.com/docs/opik/cost-intelligence/data-privacy-security.md): Exactly what Cost Intelligence collects and what it never collects, the opt-in content capture control, where data goes, and how it is protected in transit and on disk.
- [Overview](https://www.comet.com/docs/opik/self-host/overview.md): Explore how to self-host Opik on your infrastructure with full feature access, including tracing and evaluation, without user management.
- [Migrating to Opik 2.0](https://www.comet.com/docs/opik/self-host/v1-to-v2-migration.md): Step-by-step guide for self-hosted Opik operators to run the background migration jobs that scope existing 1.x data to projects in Opik 2.0.
- [Local deployment](https://www.comet.com/docs/opik/self-host/local_deployment.md): Configure your local Opik deployment using Docker Compose for quick setup. Ideal for testing but not for production environments.
- [Kubernetes deployment](https://www.comet.com/docs/opik/self-host/kubernetes.md): Learn to configure and deploy Opik on Kubernetes using our Helm chart for robust, production-ready environments.
- [Migrating from Bitnami Charts and Images](https://www.comet.com/docs/opik/self-host/helm.md): Learn how to migrate from Bitnami charts and images to Opik's official Helm chart
- [Platform Architecture](https://www.comet.com/docs/opik/self-host/architecture.md): Learn how Opik's architecture utilizes multiple services for backend, frontend, and data management, optimizing performance and scalability.
- [Scaling Opik](https://www.comet.com/docs/opik/self-host/scaling.md): Learn best practices and configurations for running Opik in production, ensuring resilience and scalability for mission-critical workloads.
- [Advanced clickhouse backup](https://www.comet.com/docs/opik/self-host/backup.md): Learn to implement SQL-based and dedicated backup tools for ClickHouse in Opik's Kubernetes setup to ensure data protection and recovery.
- [Troubleshooting](https://www.comet.com/docs/opik/self-host/troubleshooting.md): Troubleshooting guide for common issues when running self-hosted Opik deployments.
- [Self-host changelog](https://www.comet.com/docs/opik/self-host/changelog.md): Breaking and critical changes for self-hosted Opik deployments
- [Anonymous usage statistics](https://www.comet.com/docs/opik/self-host/configure/anonymous_usage_statistics.md): Learn how to enable or disable anonymous usage statistics reporting in Opik to improve platform performance and user experience.
- [Large CSV uploads](https://www.comet.com/docs/opik/self-host/configure/large_csv_uploads.md): Configure Opik to accept CSV uploads up to 2GB, enabling efficient dataset creation and asynchronous processing.
- [Dataset versioning migration](https://www.comet.com/docs/opik/self-host/configure/dataset_versioning_migration.md): Learn about the automated dataset versioning migration process when upgrading to Opik 1.9.92 or higher, including configuration, monitoring, and recovery steps.
- [LLM model registry](https://www.comet.com/docs/opik/self-host/configure/llm-model-registry.md)
- [Overview](https://www.comet.com/docs/opik/reference/overview.md): Explore comprehensive SDK reference documentation with Opik to effectively implement and utilize all available methods.
- [REST API Client](https://www.comet.com/docs/opik/reference/python-sdk/rest-api.md): Access all Opik platform functionality with the Python SDK's REST API client for advanced operations and custom integrations.
- [Batching and update operations](https://www.comet.com/docs/opik/reference/python-sdk/troubleshooting/batching-and-updates.md): Understand how batching affects update operations and how to avoid data loss when using the Opik Python SDK.
- [Opik TS - Interactive Setup Tool](https://www.comet.com/docs/opik/reference/typescript-sdk/opik-ts.md): A guided CLI tool for quickly integrating Opik SDK into your Node.js/TypeScript projects with automatic configuration and setup.
- [Prompts](https://www.comet.com/docs/opik/reference/typescript-sdk/prompts.md): Learn to version, store, and format LLM prompt templates using the Opik TypeScript SDK for seamless integration with your codebase.
- [Opik Query Language (OQL)](https://www.comet.com/docs/opik/reference/typescript-sdk/opik-query-language.md): Learn to use OQL for powerful data filtering in Opik with SQL-like syntax and expressive conditions for precise data retrieval.
- [Evaluation](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/overview.md): Evaluate your LLM applications effectively using Opik's TypeScript SDK and the powerful evaluate function for diverse evaluation scenarios.
- [Quick Start](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/quick-start.md): Evaluate your AI models effectively. Learn to create datasets and analyze results with Opik's TypeScript SDK in just 15 minutes.
- [Datasets](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/datasets.md): Learn to create and manage datasets in Opik for effective evaluation, leveraging TypeScript's type safety and deduplication features.
- [Evaluate Function](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/evaluate_function.md): Evaluate LLM tasks against datasets using customizable metrics with the evaluate function in Opik for precise assessments.
- [evaluatePrompt Function](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/evaluate_prompt_function.md): Evaluate prompt templates against datasets effortlessly with Opik. Streamline formatting, generate responses, and assess results using key metrics.
- [Models](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/models.md): Configure models for evaluation using the TypeScript SDK with Opik, enabling seamless integration with various providers and custom settings.
- [Evaluation Metrics](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/metrics.md): Evaluate AI model performance with Opik metrics to ensure accurate assessments and informed decisions.
- [Experiments](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/experiments.md): Evaluate and compare LLM applications with Opik by linking execution data to datasets for structured analysis and performance tracking.
- [Test Suites](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/test_suites.md): Create and run regression test suites against your LLM application using the Opik TypeScript SDK, with assertions and configurable execution policies.
- [Overview](https://www.comet.com/docs/opik/reference/rest-api/overview.md): Explore the Opik REST API to integrate seamlessly with Open-Source and Opik Cloud platforms. Engage with our community for support.

## API Docs

- API Reference > Mcp O Auth [OAuth Authorization Endpoint](https://www.comet.com/docs/opik/reference/rest-api/mcp-o-auth/authorize.md)
- API Reference > Mcp O Auth [Submit Authorization Consent](https://www.comet.com/docs/opik/reference/rest-api/mcp-o-auth/consent.md)
- API Reference > Mcp O Auth [Get Authorization Consent Context](https://www.comet.com/docs/opik/reference/rest-api/mcp-o-auth/get-authorize-context.md)
- API Reference > Mcp O Auth [Get OAuth Authorization Server Metadata](https://www.comet.com/docs/opik/reference/rest-api/mcp-o-auth/get-o-auth-authorization-server-metadata.md)
- API Reference > Mcp O Auth [OAuth Dynamic Client Registration Endpoint](https://www.comet.com/docs/opik/reference/rest-api/mcp-o-auth/register-o-auth-client.md)
- API Reference > Mcp O Auth [OAuth Token Revocation Endpoint](https://www.comet.com/docs/opik/reference/rest-api/mcp-o-auth/revoke.md)
- API Reference > Mcp O Auth [OAuth Token Endpoint](https://www.comet.com/docs/opik/reference/rest-api/mcp-o-auth/token.md)
- API Reference > Mcp O Auth [Validate OAuth Access Token](https://www.comet.com/docs/opik/reference/rest-api/mcp-o-auth/validate-o-auth-token.md)
- API Reference > System Analytics Queries [Execute Agent Insights free-form SQL](https://www.comet.com/docs/opik/reference/rest-api/system-analytics-queries/execute-analytics-query.md)
- API Reference > System Usage [Get datasets information for BI events](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-dataset-bi-info.md)
- API Reference > System Usage [Get experiments information for BI events](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-experiment-bi-info.md)
- API Reference > System Usage [Get spans information for BI events](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-spans-bi-info.md)
- API Reference > System Usage [Get spans count on previous day grouped by workspace, project and user](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-spans-count-breakdown-for-workspaces.md)
- API Reference > System Usage [Get spans count on previous day for all available workspaces](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-spans-count-for-workspaces.md)
- API Reference > System Usage [Get traces information for BI events](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-traces-bi-info.md)
- API Reference > System Usage [Get traces count on previous day for all available workspaces](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-traces-count-for-workspaces.md)
- API Reference > Agent Configs [Create optimizer config with initial blueprint](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/create-agent-config.md)
- API Reference > Agent Configs [Add blueprint to existing config](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/update-agent-config.md)
- API Reference > Agent Configs [Create blueprint from mask](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/create-blueprint-from-mask.md)
- API Reference > Agent Configs [Create or update environments](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/create-or-update-envs.md)
- API Reference > Agent Configs [Retrieve blueprint by environment](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-blueprint-by-env.md)
- API Reference > Agent Configs [Set environment by blueprint name](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/set-env-by-blueprint-name.md)
- API Reference > Agent Configs [Delete environment](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/delete-env.md)
- API Reference > Agent Configs [Retrieve blueprint by ID](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-blueprint-by-id.md)
- API Reference > Agent Configs [Retrieve blueprint by name](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-blueprint-by-name.md)
- API Reference > Agent Configs [Get blueprint history](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-blueprint-history.md)
- API Reference > Agent Configs [Retrieve delta by blueprint ID](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-delta-by-id.md)
- API Reference > Agent Configs [Retrieve latest blueprint](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-latest-blueprint.md)
- API Reference > Agent Configs [Remove configuration parameters](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/remove-config-keys.md)
- API Reference > Agent Insights Jobs [Get Agent Insights job](https://www.comet.com/docs/opik/reference/rest-api/agent-insights-jobs/get-agent-insights-job.md)
- API Reference > Agent Insights Jobs [Create Agent Insights job](https://www.comet.com/docs/opik/reference/rest-api/agent-insights-jobs/create-agent-insights-job.md)
- API Reference > Agent Insights Jobs [Update Agent Insights job](https://www.comet.com/docs/opik/reference/rest-api/agent-insights-jobs/update-agent-insights-job.md)
- API Reference > Agent Insights Jobs [Trigger Agent Insights job](https://www.comet.com/docs/opik/reference/rest-api/agent-insights-jobs/trigger-agent-insights-job.md)
- API Reference > Agent Insights [Find agent insights issues](https://www.comet.com/docs/opik/reference/rest-api/agent-insights/find-agent-insights-issues.md)
- API Reference > Agent Insights [Store agent insights report results](https://www.comet.com/docs/opik/reference/rest-api/agent-insights/report-agent-insights-issues.md)
- API Reference > Agent Insights [Get agent insights issue by id](https://www.comet.com/docs/opik/reference/rest-api/agent-insights/get-agent-insights-issue-by-id.md)
- API Reference > Agent Insights [Update agent insights issue status](https://www.comet.com/docs/opik/reference/rest-api/agent-insights/update-agent-insights-issue.md)
- API Reference > Alerts [Find alerts](https://www.comet.com/docs/opik/reference/rest-api/alerts/find-alerts.md)
- API Reference > Alerts [Create alert](https://www.comet.com/docs/opik/reference/rest-api/alerts/create-alert.md)
- API Reference > Alerts [Delete alert batch](https://www.comet.com/docs/opik/reference/rest-api/alerts/delete-alert-batch.md)
- API Reference > Alerts [Get Alert by id](https://www.comet.com/docs/opik/reference/rest-api/alerts/get-alert-by-id.md)
- API Reference > Alerts [Update alert](https://www.comet.com/docs/opik/reference/rest-api/alerts/update-alert.md)
- API Reference > Alerts [Get webhook payload examples](https://www.comet.com/docs/opik/reference/rest-api/alerts/get-webhook-examples.md)
- API Reference > Alerts [Test alert webhook](https://www.comet.com/docs/opik/reference/rest-api/alerts/test-webhook.md)
- API Reference > Annotation Queues [Add items to annotation queue](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/add-items-to-annotation-queue.md)
- API Reference > Annotation Queues [Find annotation queues](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/find-annotation-queues.md)
- API Reference > Annotation Queues [Create annotation queue](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/create-annotation-queue.md)
- API Reference > Annotation Queues [Create annotation queue batch](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/create-annotation-queue-batch.md)
- API Reference > Annotation Queues [Delete annotation queue batch](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/delete-annotation-queue-batch.md)
- API Reference > Annotation Queues [Get annotation queue by id](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/get-annotation-queue-by-id.md)
- API Reference > Annotation Queues [Update annotation queue](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/update-annotation-queue.md)
- API Reference > Annotation Queues [Get all active locks for an annotation queue](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/get-annotation-queue-locks.md)
- API Reference > Annotation Queues [Create or extend annotation queue item lock](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/lock-annotation-queue-item.md)
- API Reference > Annotation Queues [Remove items from annotation queue](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/remove-items-from-annotation-queue.md)
- API Reference > Assertion Results [Batch ingestion of assertion results](https://www.comet.com/docs/opik/reference/rest-api/assertion-results/store-assertions-batch.md)
- API Reference > Attachments [Attachments list for entity](https://www.comet.com/docs/opik/reference/rest-api/attachments/attachment-list.md)
- API Reference > Attachments [Complete multipart attachment upload](https://www.comet.com/docs/opik/reference/rest-api/attachments/complete-multi-part-upload.md)
- API Reference > Attachments [Delete attachments](https://www.comet.com/docs/opik/reference/rest-api/attachments/delete-attachments.md)
- API Reference > Attachments [Download attachment from MinIO](https://www.comet.com/docs/opik/reference/rest-api/attachments/download-attachment.md)
- API Reference > Attachments [Start multipart attachment upload](https://www.comet.com/docs/opik/reference/rest-api/attachments/start-multi-part-upload.md)
- API Reference > Attachments [Upload attachment to MinIO](https://www.comet.com/docs/opik/reference/rest-api/attachments/upload-attachment.md)
- API Reference > Check [Check user access to workspace](https://www.comet.com/docs/opik/reference/rest-api/check/access.md)
- API Reference > Check [User's default workspace name](https://www.comet.com/docs/opik/reference/rest-api/check/get-workspace-name.md)
- API Reference > Automation Rule Evaluators [Find project Evaluators](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/find-evaluators.md)
- API Reference > Automation Rule Evaluators [Create automation rule evaluator](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/create-automation-rule-evaluator.md)
- API Reference > Automation Rule Evaluators [Delete automation rule evaluators](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/delete-automation-rule-evaluator-batch.md)
- API Reference > Automation Rule Evaluators [Get automation rule evaluator by id](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/get-evaluator-by-id.md)
- API Reference > Automation Rule Evaluators [Update Automation Rule Evaluator by id](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/update-automation-rule-evaluator.md)
- API Reference > Automation Rule Evaluators [Get automation rule evaluator logs by id](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/get-evaluator-logs-by-id.md)
- API Reference > Chat Completions [Create chat completions](https://www.comet.com/docs/opik/reference/rest-api/chat-completions/create-chat-completions.md)
- API Reference > Dashboards [Find dashboards](https://www.comet.com/docs/opik/reference/rest-api/dashboards/find-dashboards.md)
- API Reference > Dashboards [Create dashboard](https://www.comet.com/docs/opik/reference/rest-api/dashboards/create-dashboard.md)
- API Reference > Dashboards [Get dashboard by id](https://www.comet.com/docs/opik/reference/rest-api/dashboards/get-dashboard-by-id.md)
- API Reference > Dashboards [Delete dashboard](https://www.comet.com/docs/opik/reference/rest-api/dashboards/delete-dashboard.md)
- API Reference > Dashboards [Update dashboard](https://www.comet.com/docs/opik/reference/rest-api/dashboards/update-dashboard.md)
- API Reference > Dashboards [Delete dashboards](https://www.comet.com/docs/opik/reference/rest-api/dashboards/delete-dashboards-batch.md)
- API Reference > Datasets [Apply changes to dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/apply-dataset-item-changes.md)
- API Reference > Datasets [Batch update dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/batch-update-dataset-items.md)
- API Reference > Datasets [Find datasets](https://www.comet.com/docs/opik/reference/rest-api/datasets/find-datasets.md)
- API Reference > Datasets [Create dataset](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-dataset.md)
- API Reference > Datasets [Create/update dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-or-update-dataset-items.md)
- API Reference > Datasets [Create dataset items from CSV file](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-dataset-items-from-csv.md)
- API Reference > Datasets [Create dataset items from JSON file](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-dataset-items-from-json.md)
- API Reference > Datasets [Create dataset items from spans](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-dataset-items-from-spans.md)
- API Reference > Datasets [Create dataset items from traces](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-dataset-items-from-traces.md)
- API Reference > Datasets [Get dataset by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-by-id.md)
- API Reference > Datasets [Update dataset by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/update-dataset.md)
- API Reference > Datasets [Delete dataset by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-dataset.md)
- API Reference > Datasets [Delete dataset by name](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-dataset-by-name.md)
- API Reference > Datasets [Delete dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-dataset-items.md)
- API Reference > Datasets [Delete datasets](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-datasets-batch.md)
- API Reference > Datasets [Download dataset export file](https://www.comet.com/docs/opik/reference/rest-api/datasets/download-dataset-export.md)
- API Reference > Datasets [Expand dataset with synthetic samples](https://www.comet.com/docs/opik/reference/rest-api/datasets/expand-dataset.md)
- API Reference > Datasets [Find dataset items with experiment items](https://www.comet.com/docs/opik/reference/rest-api/datasets/find-dataset-items-with-experiment-items.md)
- API Reference > Datasets [Get dataset by name](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-by-identifier.md)
- API Reference > Datasets [Get experiment items stats for dataset](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-experiment-items-stats.md)
- API Reference > Datasets [Get dataset export job status](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-export-job.md)
- API Reference > Datasets [Get all dataset export jobs](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-export-jobs.md)
- API Reference > Datasets [Get dataset item by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-item-by-id.md)
- API Reference > Datasets [Partially update dataset item by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/patch-dataset-item.md)
- API Reference > Datasets [Get dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-items.md)
- API Reference > Datasets [Get dataset items output columns](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-items-output-columns.md)
- API Reference > Datasets [Mark dataset export job as viewed](https://www.comet.com/docs/opik/reference/rest-api/datasets/mark-dataset-export-job-viewed.md)
- API Reference > Datasets [Start dataset CSV export](https://www.comet.com/docs/opik/reference/rest-api/datasets/start-dataset-export.md)
- API Reference > Datasets [Stream dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/stream-dataset-items.md)
- API Reference > Datasets [Compare latest version with draft](https://www.comet.com/docs/opik/reference/rest-api/datasets/compare-dataset-versions.md)
- API Reference > Datasets [Create version tag](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-version-tag.md)
- API Reference > Datasets [Delete version tag](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-version-tag.md)
- API Reference > Datasets [List dataset versions](https://www.comet.com/docs/opik/reference/rest-api/datasets/list-dataset-versions.md)
- API Reference > Datasets [Restore dataset to a previous version](https://www.comet.com/docs/opik/reference/rest-api/datasets/restore-dataset-version.md)
- API Reference > Datasets [Retrieve dataset version by name](https://www.comet.com/docs/opik/reference/rest-api/datasets/retrieve-dataset-version.md)
- API Reference > Datasets [Update dataset version](https://www.comet.com/docs/opik/reference/rest-api/datasets/update-dataset-version.md)
- API Reference > Environments [Find environments](https://www.comet.com/docs/opik/reference/rest-api/environments/find-environments.md)
- API Reference > Environments [Create environment](https://www.comet.com/docs/opik/reference/rest-api/environments/create-environment.md)
- API Reference > Environments [Delete environments](https://www.comet.com/docs/opik/reference/rest-api/environments/delete-environments-batch.md)
- API Reference > Environments [Get environment by id](https://www.comet.com/docs/opik/reference/rest-api/environments/get-environment-by-id.md)
- API Reference > Environments [Update environment by id](https://www.comet.com/docs/opik/reference/rest-api/environments/update-environment.md)
- API Reference > Experiments [Batch update experiments](https://www.comet.com/docs/opik/reference/rest-api/experiments/batch-update-experiments.md)
- API Reference > Experiments [Find experiments](https://www.comet.com/docs/opik/reference/rest-api/experiments/find-experiments.md)
- API Reference > Experiments [Create experiment](https://www.comet.com/docs/opik/reference/rest-api/experiments/create-experiment.md)
- API Reference > Experiments [Create experiment items](https://www.comet.com/docs/opik/reference/rest-api/experiments/create-experiment-items.md)
- API Reference > Experiments [Delete experiment items](https://www.comet.com/docs/opik/reference/rest-api/experiments/delete-experiment-items.md)
- API Reference > Experiments [Delete experiments by id](https://www.comet.com/docs/opik/reference/rest-api/experiments/delete-experiments-by-id.md)
- API Reference > Experiments [Create and execute experiment](https://www.comet.com/docs/opik/reference/rest-api/experiments/execute-experiment.md)
- API Reference > Experiments [Record experiment items in bulk](https://www.comet.com/docs/opik/reference/rest-api/experiments/experiment-items-bulk.md)
- API Reference > Experiments [Find Feedback Score names](https://www.comet.com/docs/opik/reference/rest-api/experiments/find-feedback-score-names.md)
- API Reference > Experiments [Find experiment groups](https://www.comet.com/docs/opik/reference/rest-api/experiments/find-experiment-groups.md)
- API Reference > Experiments [Find experiment groups with aggregations](https://www.comet.com/docs/opik/reference/rest-api/experiments/find-experiment-groups-aggregations.md)
- API Reference > Experiments [Finish experiments](https://www.comet.com/docs/opik/reference/rest-api/experiments/finish-experiments.md)
- API Reference > Experiments [Get experiment by id](https://www.comet.com/docs/opik/reference/rest-api/experiments/get-experiment-by-id.md)
- API Reference > Experiments [Update experiment by id](https://www.comet.com/docs/opik/reference/rest-api/experiments/update-experiment.md)
- API Reference > Experiments [Get experiment item by id](https://www.comet.com/docs/opik/reference/rest-api/experiments/get-experiment-item-by-id.md)
- API Reference > Experiments [Stream experiment items](https://www.comet.com/docs/opik/reference/rest-api/experiments/stream-experiment-items.md)
- API Reference > Experiments [Stream experiments](https://www.comet.com/docs/opik/reference/rest-api/experiments/stream-experiments.md)
- API Reference > Feedback Definitions [Find Feedback definitions](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/find-feedback-definitions.md)
- API Reference > Feedback Definitions [Create feedback definition](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/create-feedback-definition.md)
- API Reference > Feedback Definitions [Get feedback definition by id](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/get-feedback-definition-by-id.md)
- API Reference > Feedback Definitions [Update feedback definition by id](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/update-feedback-definition.md)
- API Reference > Feedback Definitions [Delete feedback definition by id](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/delete-feedback-definition-by-id.md)
- API Reference > Feedback Definitions [Delete feedback definitions](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/delete-feedback-definitions-batch.md)
- API Reference > Guardrails [Create guardrails for traces in a batch](https://www.comet.com/docs/opik/reference/rest-api/guardrails/create-guardrails.md)
- API Reference > Insights Views [Find insights views](https://www.comet.com/docs/opik/reference/rest-api/insights-views/find-insights-views.md)
- API Reference > Insights Views [Create insights view](https://www.comet.com/docs/opik/reference/rest-api/insights-views/create-insights-view.md)
- API Reference > Insights Views [Get insights view by id](https://www.comet.com/docs/opik/reference/rest-api/insights-views/get-insights-view-by-id.md)
- API Reference > Insights Views [Delete insights view](https://www.comet.com/docs/opik/reference/rest-api/insights-views/delete-insights-view.md)
- API Reference > Insights Views [Update insights view](https://www.comet.com/docs/opik/reference/rest-api/insights-views/update-insights-view.md)
- API Reference > Insights Views [Delete insights views](https://www.comet.com/docs/opik/reference/rest-api/insights-views/delete-insights-views-batch.md)
- API Reference > Llm Models [Get LLM models](https://www.comet.com/docs/opik/reference/rest-api/llm-models/get-llm-models.md)
- API Reference > Llm Provider Key [Delete LLM Provider's ApiKeys](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/delete-llm-provider-api-keys-batch.md)
- API Reference > Llm Provider Key [Find LLM Provider's ApiKeys](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/find-llm-provider-keys.md)
- API Reference > Llm Provider Key [Store LLM Provider's ApiKey](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/store-llm-provider-api-key.md)
- API Reference > Llm Provider Key [Get LLM Provider's ApiKey by id](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/get-llm-provider-api-key-by-id.md)
- API Reference > Llm Provider Key [Update LLM Provider's ApiKey](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/update-llm-provider-api-key.md)
- API Reference > Llm Provider Key [Test a provider's dynamic token auth](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/test-llm-provider-auth-config.md)
- API Reference > Runners [Get local runner job logs](https://www.comet.com/docs/opik/reference/rest-api/runners/get-job-logs.md)
- API Reference > Runners [Append local runner job logs](https://www.comet.com/docs/opik/reference/rest-api/runners/append-job-logs.md)
- API Reference > Runners [Cancel local runner job](https://www.comet.com/docs/opik/reference/rest-api/runners/cancel-job.md)
- API Reference > Runners [Submit bridge command](https://www.comet.com/docs/opik/reference/rest-api/runners/create-bridge-command.md)
- API Reference > Runners [Create local runner job](https://www.comet.com/docs/opik/reference/rest-api/runners/create-job.md)
- API Reference > Runners [Get local runner](https://www.comet.com/docs/opik/reference/rest-api/runners/get-runner.md)
- API Reference > Runners [Disconnect local runner](https://www.comet.com/docs/opik/reference/rest-api/runners/disconnect-runner.md)
- API Reference > Runners [Get bridge command](https://www.comet.com/docs/opik/reference/rest-api/runners/get-bridge-command.md)
- API Reference > Runners [Get local runner job](https://www.comet.com/docs/opik/reference/rest-api/runners/get-job.md)
- API Reference > Runners [Local runner heartbeat](https://www.comet.com/docs/opik/reference/rest-api/runners/heartbeat.md)
- API Reference > Runners [List local runner jobs](https://www.comet.com/docs/opik/reference/rest-api/runners/list-jobs.md)
- API Reference > Runners [List local runners](https://www.comet.com/docs/opik/reference/rest-api/runners/list-runners.md)
- API Reference > Runners [Poll next bridge commands](https://www.comet.com/docs/opik/reference/rest-api/runners/next-bridge-commands.md)
- API Reference > Runners [Next local runner job](https://www.comet.com/docs/opik/reference/rest-api/runners/next-job.md)
- API Reference > Runners [Patch runner checklist](https://www.comet.com/docs/opik/reference/rest-api/runners/patch-checklist.md)
- API Reference > Runners [Register local runner agents](https://www.comet.com/docs/opik/reference/rest-api/runners/register-agents.md)
- API Reference > Runners [Report bridge command result](https://www.comet.com/docs/opik/reference/rest-api/runners/report-bridge-result.md)
- API Reference > Runners [Report local runner job result](https://www.comet.com/docs/opik/reference/rest-api/runners/report-job-result.md)
- API Reference > Manual Evaluation [Manually evaluate spans](https://www.comet.com/docs/opik/reference/rest-api/manual-evaluation/evaluate-spans.md)
- API Reference > Manual Evaluation [Manually evaluate threads](https://www.comet.com/docs/opik/reference/rest-api/manual-evaluation/evaluate-threads.md)
- API Reference > Manual Evaluation [Manually evaluate traces](https://www.comet.com/docs/opik/reference/rest-api/manual-evaluation/evaluate-traces.md)
- API Reference > Ollama [List available Ollama models](https://www.comet.com/docs/opik/reference/rest-api/ollama/list-models.md)
- API Reference > Ollama [Test connection to Ollama instance](https://www.comet.com/docs/opik/reference/rest-api/ollama/test-connection.md)
- API Reference > Ollie State [Download ollie state](https://www.comet.com/docs/opik/reference/rest-api/ollie-state/download-ollie-state.md)
- API Reference > Ollie State [Replace ollie state](https://www.comet.com/docs/opik/reference/rest-api/ollie-state/replace-ollie-state.md)
- API Reference > Ollie State [Delete ollie state](https://www.comet.com/docs/opik/reference/rest-api/ollie-state/delete-ollie-state.md)
- API Reference > Open Telemetry Ingestion [Receive Protobuf Traces](https://www.comet.com/docs/opik/reference/rest-api/open-telemetry-ingestion/receive-protobuf-traces.md)
- API Reference > Optimizations [Find optimizations](https://www.comet.com/docs/opik/reference/rest-api/optimizations/find-optimizations.md)
- API Reference > Optimizations [Create optimization](https://www.comet.com/docs/opik/reference/rest-api/optimizations/create-optimization.md)
- API Reference > Optimizations [Upsert optimization](https://www.comet.com/docs/opik/reference/rest-api/optimizations/upsert-optimization.md)
- API Reference > Optimizations [Delete optimizations by id](https://www.comet.com/docs/opik/reference/rest-api/optimizations/delete-optimizations-by-id.md)
- API Reference > Optimizations [Get optimization by id](https://www.comet.com/docs/opik/reference/rest-api/optimizations/get-optimization-by-id.md)
- API Reference > Optimizations [Update optimization by id](https://www.comet.com/docs/opik/reference/rest-api/optimizations/update-optimizations-by-id.md)
- API Reference > Optimizations [Get Studio optimization logs](https://www.comet.com/docs/opik/reference/rest-api/optimizations/get-studio-optimization-logs.md)
- API Reference > Pairing [Activate a pairing session](https://www.comet.com/docs/opik/reference/rest-api/pairing/activate-pairing-session.md)
- API Reference > Pairing [Create a pairing session](https://www.comet.com/docs/opik/reference/rest-api/pairing/create-pairing-session.md)
- API Reference > Projects [Find alerts by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-alerts-by-project.md)
- API Reference > Projects [Find dashboards by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-dashboards-by-project.md)
- API Reference > Projects [Find datasets by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-datasets-by-project.md)
- API Reference > Projects [Find experiments by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-experiments-by-project.md)
- API Reference > Projects [Find optimizations by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-optimizations-by-project.md)
- API Reference > Projects [Get prompts by project](https://www.comet.com/docs/opik/reference/rest-api/projects/get-prompts-by-project.md)
- API Reference > Projects [Find projects](https://www.comet.com/docs/opik/reference/rest-api/projects/find-projects.md)
- API Reference > Projects [Create project](https://www.comet.com/docs/opik/reference/rest-api/projects/create-project.md)
- API Reference > Projects [Get project by id](https://www.comet.com/docs/opik/reference/rest-api/projects/get-project-by-id.md)
- API Reference > Projects [Delete project by id](https://www.comet.com/docs/opik/reference/rest-api/projects/delete-project-by-id.md)
- API Reference > Projects [Update project by id](https://www.comet.com/docs/opik/reference/rest-api/projects/update-project.md)
- API Reference > Projects [Delete projects](https://www.comet.com/docs/opik/reference/rest-api/projects/delete-projects-batch.md)
- API Reference > Projects [Find Feedback Score names By Project Ids](https://www.comet.com/docs/opik/reference/rest-api/projects/find-feedback-score-names-by-project-ids.md)
- API Reference > Projects [Find Token Usage names](https://www.comet.com/docs/opik/reference/rest-api/projects/find-token-usage-names.md)
- API Reference > Projects [Get Project KPI Cards](https://www.comet.com/docs/opik/reference/rest-api/projects/get-project-kpi-cards.md)
- API Reference > Projects [Get Project Metrics](https://www.comet.com/docs/opik/reference/rest-api/projects/get-project-metrics.md)
- API Reference > Projects [Get Project Stats](https://www.comet.com/docs/opik/reference/rest-api/projects/get-project-stats.md)
- API Reference > Projects [Retrieve project](https://www.comet.com/docs/opik/reference/rest-api/projects/retrieve-project.md)
- API Reference > Projects [Get recent activity for a project](https://www.comet.com/docs/opik/reference/rest-api/projects/get-recent-activity.md)
- API Reference > Prompts [Get prompts](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompts.md)
- API Reference > Prompts [Create prompt](https://www.comet.com/docs/opik/reference/rest-api/prompts/create-prompt.md)
- API Reference > Prompts [Create prompt version](https://www.comet.com/docs/opik/reference/rest-api/prompts/create-prompt-version.md)
- API Reference > Prompts [Update prompt versions](https://www.comet.com/docs/opik/reference/rest-api/prompts/update-prompt-versions.md)
- API Reference > Prompts [Get prompt by id](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompt-by-id.md)
- API Reference > Prompts [Update prompt](https://www.comet.com/docs/opik/reference/rest-api/prompts/update-prompt.md)
- API Reference > Prompts [Delete prompt](https://www.comet.com/docs/opik/reference/rest-api/prompts/delete-prompt.md)
- API Reference > Prompts [Delete prompts](https://www.comet.com/docs/opik/reference/rest-api/prompts/delete-prompts-batch.md)
- API Reference > Prompts [Get prompt by commit](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompt-by-commit.md)
- API Reference > Prompts [Get prompt version by id](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompt-version-by-id.md)
- API Reference > Prompts [Get prompt version by sequential number](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompt-version-by-number.md)
- API Reference > Prompts [Get prompt versions](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompt-versions.md)
- API Reference > Prompts [Get prompts by commits](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompts-by-commits.md)
- API Reference > Prompts [Restore prompt version](https://www.comet.com/docs/opik/reference/rest-api/prompts/restore-prompt-version.md)
- API Reference > Prompts [Retrieve prompt version](https://www.comet.com/docs/opik/reference/rest-api/prompts/retrieve-prompt-version.md)
- API Reference > Prompts [Retrieve prompt versions by ids](https://www.comet.com/docs/opik/reference/rest-api/prompts/retrieve-prompt-versions-by-ids.md)
- API Reference > Prompts [Set prompt version environment](https://www.comet.com/docs/opik/reference/rest-api/prompts/set-prompt-version-environment.md)
- API Reference > Report Failures [List failures for a project](https://www.comet.com/docs/opik/reference/rest-api/report-failures/find-report-failures.md)
- API Reference > Report Failures [Record a report/job failure](https://www.comet.com/docs/opik/reference/rest-api/report-failures/create-report-failure.md)
- API Reference > Reports [Complete report generation](https://www.comet.com/docs/opik/reference/rest-api/reports/complete-report.md)
- API Reference > Reports [Trigger report generation](https://www.comet.com/docs/opik/reference/rest-api/reports/generate-report.md)
- API Reference > Reports [Get report preferences](https://www.comet.com/docs/opik/reference/rest-api/reports/get-report-preference.md)
- API Reference > Reports [Update report preferences](https://www.comet.com/docs/opik/reference/rest-api/reports/update-report-preference.md)
- API Reference > Reports [Get reports for a project](https://www.comet.com/docs/opik/reference/rest-api/reports/get-reports.md)
- API Reference > Retention Rules [Find retention rules](https://www.comet.com/docs/opik/reference/rest-api/retention-rules/find-retention-rules.md)
- API Reference > Retention Rules [Create retention rule](https://www.comet.com/docs/opik/reference/rest-api/retention-rules/create-retention-rule.md)
- API Reference > Retention Rules [Get retention rule by id](https://www.comet.com/docs/opik/reference/rest-api/retention-rules/get-retention-rule-by-id.md)
- API Reference > Retention Rules [Deactivate retention rule](https://www.comet.com/docs/opik/reference/rest-api/retention-rules/deactivate-retention-rule.md)
- API Reference > Service Toggles [Get Service Toggles](https://www.comet.com/docs/opik/reference/rest-api/service-toggles/get-service-toggles.md)
- API Reference > Spans [Add span comment](https://www.comet.com/docs/opik/reference/rest-api/spans/add-span-comment.md)
- API Reference > Spans [Add span feedback score](https://www.comet.com/docs/opik/reference/rest-api/spans/add-span-feedback-score.md)
- API Reference > Spans [Create spans](https://www.comet.com/docs/opik/reference/rest-api/spans/create-spans.md)
- API Reference > Spans [Batch update spans](https://www.comet.com/docs/opik/reference/rest-api/spans/batch-update-spans.md)
- API Reference > Spans [Get spans by project_name or project_id and optionally by trace_id and/or type](https://www.comet.com/docs/opik/reference/rest-api/spans/get-spans-by-project.md)
- API Reference > Spans [Create span](https://www.comet.com/docs/opik/reference/rest-api/spans/create-span.md)
- API Reference > Spans [Get span by id](https://www.comet.com/docs/opik/reference/rest-api/spans/get-span-by-id.md)
- API Reference > Spans [Delete span by id](https://www.comet.com/docs/opik/reference/rest-api/spans/delete-span-by-id.md)
- API Reference > Spans [Update span by id](https://www.comet.com/docs/opik/reference/rest-api/spans/update-span.md)
- API Reference > Spans [Delete span comments](https://www.comet.com/docs/opik/reference/rest-api/spans/delete-span-comments.md)
- API Reference > Spans [Delete span feedback score](https://www.comet.com/docs/opik/reference/rest-api/spans/delete-span-feedback-score.md)
- API Reference > Spans [Find Feedback Score names](https://www.comet.com/docs/opik/reference/rest-api/spans/find-feedback-score-names-1.md)
- API Reference > Spans [Get span comment](https://www.comet.com/docs/opik/reference/rest-api/spans/get-span-comment.md)
- API Reference > Spans [Get span stats](https://www.comet.com/docs/opik/reference/rest-api/spans/get-span-stats.md)
- API Reference > Spans [Batch feedback scoring for spans](https://www.comet.com/docs/opik/reference/rest-api/spans/score-batch-of-spans.md)
- API Reference > Spans [Search spans](https://www.comet.com/docs/opik/reference/rest-api/spans/search-spans.md)
- API Reference > Spans [Check whether a project has spans](https://www.comet.com/docs/opik/reference/rest-api/spans/exist.md)
- API Reference > Spans [Update span comment by id](https://www.comet.com/docs/opik/reference/rest-api/spans/update-span-comment.md)
- API Reference > Traces [Add thread comment](https://www.comet.com/docs/opik/reference/rest-api/traces/add-thread-comment.md)
- API Reference > Traces [Add trace comment](https://www.comet.com/docs/opik/reference/rest-api/traces/add-trace-comment.md)
- API Reference > Traces [Add trace feedback score](https://www.comet.com/docs/opik/reference/rest-api/traces/add-trace-feedback-score.md)
- API Reference > Traces [Create traces](https://www.comet.com/docs/opik/reference/rest-api/traces/create-traces.md)
- API Reference > Traces [Batch update traces](https://www.comet.com/docs/opik/reference/rest-api/traces/batch-update-traces.md)
- API Reference > Traces [Batch update threads](https://www.comet.com/docs/opik/reference/rest-api/traces/batch-update-threads.md)
- API Reference > Traces [Close trace thread(s)](https://www.comet.com/docs/opik/reference/rest-api/traces/close-trace-thread.md)
- API Reference > Traces [Get traces by project_name or project_id](https://www.comet.com/docs/opik/reference/rest-api/traces/get-traces-by-project.md)
- API Reference > Traces [Create trace](https://www.comet.com/docs/opik/reference/rest-api/traces/create-trace.md)
- API Reference > Traces [Get trace by id](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-by-id.md)
- API Reference > Traces [Delete trace by id](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-trace-by-id.md)
- API Reference > Traces [Update trace by id](https://www.comet.com/docs/opik/reference/rest-api/traces/update-trace.md)
- API Reference > Traces [Delete thread comments](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-thread-comments.md)
- API Reference > Traces [Delete thread feedback scores](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-thread-feedback-scores.md)
- API Reference > Traces [Delete trace comments](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-trace-comments.md)
- API Reference > Traces [Delete trace feedback score](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-trace-feedback-score.md)
- API Reference > Traces [Delete trace threads](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-trace-threads.md)
- API Reference > Traces [Delete traces](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-traces.md)
- API Reference > Traces [Find Feedback Score names](https://www.comet.com/docs/opik/reference/rest-api/traces/find-feedback-score-names-2.md)
- API Reference > Traces [Find Trace Threads Feedback Score names](https://www.comet.com/docs/opik/reference/rest-api/traces/find-trace-threads-feedback-score-names.md)
- API Reference > Traces [Get trace stats](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-stats.md)
- API Reference > Traces [Get thread comment](https://www.comet.com/docs/opik/reference/rest-api/traces/get-thread-comment.md)
- API Reference > Traces [Get trace thread stats](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-thread-stats.md)
- API Reference > Traces [Get trace comment](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-comment.md)
- API Reference > Traces [Get trace thread](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-thread.md)
- API Reference > Traces [Get trace threads](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-threads.md)
- API Reference > Traces [Open trace thread](https://www.comet.com/docs/opik/reference/rest-api/traces/open-trace-thread.md)
- API Reference > Traces [Batch feedback scoring for threads](https://www.comet.com/docs/opik/reference/rest-api/traces/score-batch-of-threads.md)
- API Reference > Traces [Batch feedback scoring for traces](https://www.comet.com/docs/opik/reference/rest-api/traces/score-batch-of-traces.md)
- API Reference > Traces [Search trace threads](https://www.comet.com/docs/opik/reference/rest-api/traces/search-trace-threads.md)
- API Reference > Traces [Search traces](https://www.comet.com/docs/opik/reference/rest-api/traces/search-traces.md)
- API Reference > Traces [Check whether a project has traces](https://www.comet.com/docs/opik/reference/rest-api/traces/exist.md)
- API Reference > Traces [Update thread](https://www.comet.com/docs/opik/reference/rest-api/traces/update-thread.md)
- API Reference > Traces [Update thread comment by id](https://www.comet.com/docs/opik/reference/rest-api/traces/update-thread-comment.md)
- API Reference > Traces [Update trace comment by id](https://www.comet.com/docs/opik/reference/rest-api/traces/update-trace-comment.md)
- API Reference > Welcome Wizard [Get welcome wizard tracking status](https://www.comet.com/docs/opik/reference/rest-api/welcome-wizard/get-welcome-wizard-status.md)
- API Reference > Welcome Wizard [Submit welcome wizard](https://www.comet.com/docs/opik/reference/rest-api/welcome-wizard/submit-welcome-wizard.md)
- API Reference > Workspace Permissions [Get workspace permissions for the authenticated user](https://www.comet.com/docs/opik/reference/rest-api/workspace-permissions/get-workspace-user-permissions.md)
- API Reference > Workspaces [Get costs summary](https://www.comet.com/docs/opik/reference/rest-api/workspaces/costs-summary.md)
- API Reference > Workspaces [Get workspace configuration](https://www.comet.com/docs/opik/reference/rest-api/workspaces/get-workspace-configuration.md)
- API Reference > Workspaces [Upsert workspace configuration](https://www.comet.com/docs/opik/reference/rest-api/workspaces/upsert-workspace-configuration.md)
- API Reference > Workspaces [Delete workspace configuration](https://www.comet.com/docs/opik/reference/rest-api/workspaces/delete-workspace-configuration.md)
- API Reference > Workspaces [Get cost daily data](https://www.comet.com/docs/opik/reference/rest-api/workspaces/get-cost.md)
- API Reference > Workspaces [Get metric daily data](https://www.comet.com/docs/opik/reference/rest-api/workspaces/get-metric.md)
- API Reference > Workspaces [Get workspace span metric](https://www.comet.com/docs/opik/reference/rest-api/workspaces/get-workspace-span-metric.md)
- API Reference > Workspaces [Get workspace token usage names](https://www.comet.com/docs/opik/reference/rest-api/workspaces/get-workspace-token-usage-names.md)
- API Reference > Workspaces [Get metrics summary](https://www.comet.com/docs/opik/reference/rest-api/workspaces/metrics-summary.md)
- API Reference > Redirect [Create dataset redirect url](https://www.comet.com/docs/opik/reference/rest-api/redirect/datasets-redirect.md)
- API Reference > Redirect [Create experiment redirect url](https://www.comet.com/docs/opik/reference/rest-api/redirect/experiments-redirect.md)
- API Reference > Redirect [Create optimization redirect url](https://www.comet.com/docs/opik/reference/rest-api/redirect/optimizations-redirect.md)
- API Reference > Redirect [Create project redirect url](https://www.comet.com/docs/opik/reference/rest-api/redirect/projects-redirect.md)

## OpenAPI Specification

The raw OpenAPI 3.1 specification for this API is available at:
- [OpenAPI JSON](https://www.comet.com/docs/opik/openapi.json)
- [OpenAPI YAML](https://www.comet.com/docs/opik/openapi.yaml)