Skip to content

Investigate & possible fix metering for gemini models search and caching #3132

@Salazareo

Description

@Salazareo
Image

Newer gemini models support things like grounded searches and timed caching. However openai compatible api might not expose these costs in the input/output tokens the way claude api does.

verify that metering for this is valid, and fix if not

Metadata

Metadata

Labels

AIAI related tasksBackendTasks dealing with backend codeTypeScriptenhancementNew feature or requesthelp wantedExtra attention is needed

Type

No fields configured for Task.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions