1670 Commits

Author SHA1 Message Date
yuneng-jiang
cb18af542e Merge pull request #17498 from BerriAI/litellm_customer_usage_backend
[Feature] Customer (end user) Usage
2025-12-05 15:31:08 -08:00
yuneng-jiang
a750f5ca69 bump: version 0.1.22 → 0.1.23 2025-12-05 11:08:04 -08:00
yuneng-jiang
5439f03bfc bump: version 0.4.9 → 0.4.10 2025-12-04 12:56:43 -08:00
Ishaan Jaffer
1fca4a9fa5 bump: version 1.80.6 → 1.80.7 2025-11-27 13:08:24 -08:00
Yannay Hammer
d7ad2913be Upgrade websockets to v15 (#16734) 2025-11-27 10:08:16 -08:00
yuneng-jiang
f1789a5fa9 bump: version 0.4.8 → 0.4.9 2025-11-26 14:12:15 -08:00
Ishaan Jaffer
5a60a8ab3b bump: version 1.80.5 → 1.80.6 2025-11-26 13:20:25 -08:00
Ishaan Jaffer
0437be13d3 bump pyproject extras 2025-11-26 13:10:57 -08:00
Ishaan Jaffer
c7746eb58f bump proxy extras 2025-11-26 11:40:06 -08:00
Alexsander Hamir
7c09187daf downgrade grpcio (#17090) 2025-11-25 19:33:24 -08:00
Ishaan Jaffer
c7fefcc717 bump v 2025-11-22 13:37:44 -08:00
Ishaan Jaffer
37460b6aee bump: version 1.80.4 → 1.80.5 2025-11-22 13:37:12 -08:00
Ishaan Jaffer
4f707ed323 bump: version 1.80.3 → 1.80.4 2025-11-22 11:09:32 -08:00
YutaSaito
93affcb732 [Feat] mcp resources support (#16800)
* feat: mcp prompts support

* feat: mcp resources support
2025-11-20 14:53:44 -08:00
Ishaan Jaffer
d389b9dd66 bump litellm enterprise 2025-11-19 16:56:50 -08:00
Ishaan Jaffer
6477740b8c bump proxy extras 2025-11-19 13:23:16 -08:00
Cesar Garcia
4167a64853 fix: Support GPT-5.1 reasoning.effort='none' in proxy (#16745)
* fix: Add support for GPT-5.1 reasoning.effort='none' parameter

- Override Reasoning type to include 'none' effort value
- Maintains compatibility with semantic-router (requires openai <2.0.0)
- GPT-5.1 defaults to reasoning.effort='none' as of OpenAI SDK 2.8.0
- Override can be removed once semantic-router supports OpenAI SDK 2.x

Fixes #16741

* feat: Update to OpenAI SDK 2.8+ and Python 3.9+

- Update minimum Python version from 3.8.1 to 3.9 (3.8 EOL Oct 2024)
- Update OpenAI SDK requirement from >=1.99.5 to >=2.8.0
- Update semantic-router to >=0.1.12 with Python >=3.9,<3.14 constraint
- Update resend to >=0.8.0 (allows 2.x versions)
- Revert custom Reasoning TypedDict - now using native type from OpenAI SDK 2.8+

OpenAI SDK 2.8.0 natively supports reasoning.effort='none' for GPT-5.1,
eliminating the need for our custom type override.

* chore: Update poetry.lock with OpenAI SDK 2.8.1 and dependencies
2025-11-18 20:06:50 -08:00
Krrish Dholakia
dd02310b30 bump: version 1.80.2 → 1.80.3 2025-11-15 18:26:36 -08:00
Krish Dholakia
586f126395 Prometheus - make OSS (#16689)
* refactor: remove enterprise license from prometheus metrics

* refactor: complete refactoring imports

* refactor: complete prometheus refactoring

* bump: version 1.80.0 → 1.80.1

* bump: version 1.80.1 → 1.80.2

* build: update litellm lock file

* docs(enterprise.md): cleanup enterprise docs

* docs: more docs cleanup

* docs: doc cleanup

* fix: fix imports

* fix: fix linting error
2025-11-15 11:06:34 -08:00
Krrish Dholakia
70b8641822 build: bump migration 2025-11-15 09:34:50 -08:00
Ishaan Jaffer
a029c88cb9 bump litellm-proxy-extras 2025-11-15 09:11:47 -08:00
Ishaan Jaffer
f8c022c8f5 bump new schema 2025-11-14 17:39:54 -08:00
Ishaan Jaffer
6b532b31a6 bump: version 1.79.3 → 1.79.4 2025-11-14 17:38:46 -08:00
Ishaan Jaffer
3d9dcead8e bump: version 1.79.2 → 1.79.3 2025-11-08 16:30:35 -08:00
Krish Dholakia
06906534b3 feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks

* fix: fix aembedding

* fix: fix ruff errors

* fix: modify to catch errors

* fix: test

* fix: loosen test to handle openai lib out of sync

* fix: fix base models

* fix: fix usage object
2025-11-08 16:24:31 -08:00
Ishaan Jaffer
5299a97d2c bump: version 1.79.1 → 1.79.2 2025-11-08 16:06:54 -08:00
Krish Dholakia
202eaeb1a2 Revert "(feat) Audio transcription - cost tracking + (feat) image generation …" (#16409)
This reverts commit c96da44265.
2025-11-08 15:38:16 -08:00
Krish Dholakia
c96da44265 (feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks

* fix: fix aembedding

* fix: fix ruff errors

* fix: modify to catch errors

* fix: test

* fix: loosen test to handle openai lib out of sync
2025-11-08 15:30:46 -08:00
Krish Dholakia
bce8a5d6b7 Revert "(feat) audio transcriptions cost tracking (for azure/other non-openai…" (#16402)
This reverts commit 9a88fe0861.
2025-11-08 14:24:51 -08:00
Krish Dholakia
9a88fe0861 (feat) audio transcriptions cost tracking (for azure/other non-openai models) + (fix) image generations - accurate cost tracking for dalle3/gpt-image-1 - uses the correct max image quality (#16076)
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks
2025-11-08 13:54:37 -08:00
Ishaan Jaffer
9b6a4c2650 bump pyproject 2025-11-08 10:24:23 -08:00
Ishaan Jaffer
9c59d42fc1 bump extras pkg 2025-11-06 19:17:03 -08:00
Krish Dholakia
80440e11a7 Revert "Update MCP version from 1.10.1 to 1.20.0 (#16281)" (#16300)
This reverts commit 34c12d0131.
2025-11-05 18:42:34 -08:00
Guan Zheng Huang
34c12d0131 Update MCP version from 1.10.1 to 1.20.0 (#16281)
* Update MCP version from 1.10.1 to 1.20.0

- Update mcp dependency: 1.10.1 -> 1.20.0 in requirements.txt, pyproject.toml, and CI config
- Update uvicorn dependency: 0.29.0 -> 0.31.1 (required by MCP 1.20.0)
- Update PyJWT constraint to support newer versions required by MCP
- Update all CI pipeline references to MCP 1.20.0
- Add test to verify MCP version and import compatibility

MCP 1.20.0 requires uvicorn >=0.31.1 and PyJWT >=2.10.1.
MCP package remains Python >=3.10 only (no change to version constraint).

* Update poetry.lock for MCP 1.20.0
2025-11-05 18:34:28 -08:00
Krrish Dholakia
6637beb247 fix: minor fixes + dep updates 2025-11-01 13:45:42 -07:00
Krrish Dholakia
ef7d81865b build: update dependencies 2025-11-01 12:58:39 -07:00
RoniGurvichCycode
eeda5ab84e requirements update (#16054)
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-10-31 19:18:03 -07:00
Ishaan Jaffer
bd52cb2983 bump proxy extras 2025-10-31 18:19:28 -07:00
Ishaan Jaffer
de6fffe743 bump: version 1.79.0 → 1.79.1 2025-10-27 17:22:54 -07:00
Ishaan Jaffer
869ff086f0 bump: version 1.78.9 → 1.79.0 2025-10-25 17:11:48 -07:00
Ishaan Jaffer
3ef6ff8696 bump: version 1.78.8 → 1.78.9 2025-10-25 17:11:41 -07:00
Shadi
8a5ff84e49 fixed lasso import config, redis cluster hash tags for test keys (#15917) 2025-10-24 14:31:59 -07:00
Ishaan Jaff
d8ea1665c7 [Feat] - [Backend] Search APIs - Allow storing configured Search APIs in DB (#15862)
* add LiteLLM_SearchToolsTable

* init SearchToolRegistry

* fix add SearchToolRegistry

* fix add SearchToolRegistry

* fix handling search tool management

* fix search imports

* fix registry

* init search tools in memory

* fix init tools in mem

* fix TypedDict def

* add new SCHEMA

* bump proxy extras

* add LiteLLM_SearchToolsTable_search_tool_name_key

* bump extras with migration

* fix working CRUD Ops

* fix: _init_search_tools_in_db
2025-10-23 17:57:49 -07:00
Ishaan Jaffer
bfe4167183 bump: version 1.78.7 → 1.78.8 2025-10-23 08:42:03 -07:00
Ishaan Jaffer
adc503c091 bump: version 1.78.6 → 1.78.7 2025-10-21 19:06:05 -07:00
Ishaan Jaffer
c9152003bd bump V 2025-10-20 16:55:03 -07:00
Ishaan Jaffer
c9875bfd52 bump: version 1.78.4 → 1.78.5 2025-10-18 13:31:39 -07:00
Ishaan Jaffer
c72bbd0f06 bump: version 1.78.3 → 1.78.4 2025-10-17 18:08:16 -07:00
Ishaan Jaffer
00e6ec4985 bump: version 1.78.2 → 1.78.3 2025-10-16 16:57:04 -07:00
Ishaan Jaffer
8ab720409c bump v 2025-10-15 17:44:29 -07:00