This product is not supported for your selected
Datadog site. (
).
Data Access Control
Data Access Control is in Limited Availability.
LLM Observability allows you to restrict access to potentially sensitive data associated with your ML applications to only certain teams and roles in your organization. This is particularly important when your LLM applications process sensitive information such as personal data, proprietary business information, or confidential user interactions.
Access controls in LLM Observability are built on Datadog’s Data Access Control feature, which enables you to regulate access to data deemed sensitive. You can use the ml_app tag to identify and restrict access to specific LLM applications within your organization.
Redacting data with span processors
You can redact or modify sensitive data at the application level before it is sent to Datadog. Use span processors in the LLM Observability SDK to conditionally modify input and output data on spans, or prevent spans from being emitted entirely.
This is useful for:
- Removing sensitive information from prompts or responses
- Filtering out internal workflows or test data
- Conditionally redacting data based on tags or other criteria
For detailed implementation examples and usage patterns, see the Span Processing section in the SDK Reference.
Sensitive Data Scanner integration
LLM Observability integrates with Sensitive Data Scanner, which helps prevent data leakage by identifying and redacting any sensitive information (such as personal data, financial details, or proprietary information) that may be present in any step of your LLM application.
By proactively scanning for sensitive data, LLM Observability ensures that conversations remain secure and compliant with data protection regulations. This additional layer of security reinforces Datadog’s commitment to maintaining the confidentiality and integration of user interactions with LLMs.
Further reading
Additional helpful documentation, links, and articles:
