Sap gen ai hub #16053

vasilisazayka · 2025-10-29T09:59:03Z

Title

Add SAP AI gen hub as a new provider

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
I have added a screenshot of my new test passing locally
My PR passes all unit tests on make test-unit
My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🆕 New Feature
✅ Test

Changes

Added SAP Generative AI Hub as an LLM provider (provider key: "sap"), supporting chat and embeddings.
Registered SAP models under the sap/* namespace (e.g., sap/gpt-4o) in the model registry.
Updated provider enum to include SAP; introduced handler and transformation layers for chat completions and embeddings.
Added tests for sup chat and embedding

…patibility - sap/embed/transformation: add api_key and litellm_params to get_complete_url to align with core flow and prevent failures - sap/chat/handler: wrap async/sync streaming iterators to safely handle Stop(Async)Iteration and errors - sap/chat/transformation: remove unused imports and dead code

…Error with install hint if missing.

Add sap models to model_prices_and_context_window.json and model_prices_and_context_window_backup.json

- add support of list and dict content

…d auth handling without sap sdk.

…e clean up

- reimplement stream creator - improve request transformation

Signed-off-by: Vasilisa Parshikova <vasilisa.parshikova@sap.com>

…/litellm into sap_gen_ai_hub

# Conflicts: # litellm/litellm_core_utils/get_llm_provider_logic.py # litellm/main.py # litellm/model_prices_and_context_window_backup.json # litellm/types/utils.py # model_prices_and_context_window.json

…/litellm into sap_gen_ai_hub

vercel · 2025-10-29T09:59:19Z

@vasilisazayka is attempting to deploy a commit to the CLERKIEAI Team on Vercel.

A member of the Team first needs to authorize it.

karimmohraz · 2025-10-30T07:24:20Z

Dear LiteLLM team, dear @krrishdholakia,
this PR adds the SAP Provider, which enables a huge customer base to access various LLMs from OpenAI, Google, and Amazon.
SAP is Europe's largest business software vendor.
Next week there is an important conference - SAP TechEd - where we would be happy to announce LiteLLM to our customers as an important centerpiece for successful AI projects.
Please let us know what is still missing to merge this PR possibly today or tomorrow.
We have followed all steps in your Contribution guide and think we adhered to the requirements.
Thank you very much for your support!

- change get_supported_openai_params in chat transformation

…_hub

…n_ai_hub

mbrnersap and others added 30 commits October 16, 2025 15:38

add sap gen ai hub

ffb363b

add async tests

51ef064

add async and streaming support

fb07a77

add embedding model support

d591c09

add embedding support

7724526

remove unused import

8096157

fix structured output

2d8b525

clean-up

4cc2e69

remove timeout and add tool support

4dc7ee8

remove unused code

ee18e6b

fix(sap): linter fix

ef77243

fix(sap): made gen_ai_hub optional: import check + OptionalDependency…

7307628

…Error with install hint if missing.

test(sap): add chat/stream/async tests and OptionalDependencyError check

2f6f6d5

Fix tool call handling in SAP GenAI Hub transformation

ffce496

Add sap models to model_prices_and_context_window.json and model_prices_and_context_window_backup.json

fix(sap): delete unnecessary code, linter fix

a5987fc

fix(sap): - refactor chat transformation

7f9340d

- add support of list and dict content

fix(sap): - fix tests

d2e25d9

fix(sap): - fix lint

b557342

Update transformation.py

980118e

fix(sap): fix model description and fix after rebase

58bfa50

change(sap): - http calls in chat handler, response transformation an…

fe6be37

…d auth handling without sap sdk.

change(sap): switching to v2 (chat handler, chat transformation), cod…

22e9eec

…e clean up

add deployment discovery and improved crendentials handling

4dc4233

add deployment discovery and improved crendentials handling

b232fdc

change(sap): - fix sync stream

7adfada

change(sap): - fix sync stream

2ac8ed2

fix(sap): - fix response format

db7b6ce

fix(sap): - switch embedding to v2 and http request

136b4b6

- reimplement stream creator - improve request transformation

fix async streaming

697dbfe

vasilisazayka and others added 14 commits October 24, 2025 15:24

fix(sap): linters, transformation models, remove sap dependency test

570989f

fix(sap): code clean up

7ad773c

add unit test for sap chat completion

5f96c96

linters fix

5bf6f75

move token, rg and base_url to properties

6e8f89d

(sap): add embedding unit test

0dfb3ab

Signed-off-by: Vasilisa Parshikova <vasilisa.parshikova@sap.com>

fix(sap): bypass response format for some models

fbb3bdf

Signed-off-by: Vasilisa Parshikova <vasilisa.parshikova@sap.com>

fix(sap): fix chat transformation and list of supported params

86ea471

Signed-off-by: Vasilisa Parshikova <vasilisa.parshikova@sap.com>

Merge branch 'sap_gen_ai_hub' of https://github.com/sap-contributions…

e56d508

…/litellm into sap_gen_ai_hub

Merge remote-tracking branch 'origin/main' into sap_gen_ai_hub

65832ec

# Conflicts: # litellm/litellm_core_utils/get_llm_provider_logic.py # litellm/main.py # litellm/model_prices_and_context_window_backup.json # litellm/types/utils.py # model_prices_and_context_window.json

fix(sap): fix lint

dc7ca7a

add sap service key module parameter

3f97d41

Merge branch 'sap_gen_ai_hub' of https://github.com/sap-contributions…

46a536c

…/litellm into sap_gen_ai_hub

fix(sap): remove unused code

b8a456b

vasilisazayka added 3 commits October 29, 2025 14:28

fix(sap): remove prices

34c678c

Merge remote-tracking branch 'origin/main' into sap_gen_ai_hub

8af9cb4

Merge branch 'BerriAI:main' into sap_gen_ai_hub

f555e7e

mbrnersap and others added 9 commits October 31, 2025 17:32

add service key support

fa2a29d

fix(sap): - add message content validations

822c2df

- change get_supported_openai_params in chat transformation

typo in mock

c1a9a10

fix(sap): - fix in supported params map

96e3244

Merge remote-tracking branch 'origin/add_validations' into sap_gen_ai…

30ae420

…_hub

Merge remote-tracking branch 'origin/main' into sap_gen_ai_hub

7edf57a

fix(sap): - fix in message content validation

4f6aa10

Merge remote-tracking branch 'origin/service-key-support' into sap_ge…

1e6cf42

…n_ai_hub

fix(sap): - fix in message content validation

c75fb88

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Sap gen ai hub #16053

Sap gen ai hub #16053

vasilisazayka commented Oct 29, 2025 •

edited

Loading

Uh oh!

vercel bot commented Oct 29, 2025

Uh oh!

karimmohraz commented Oct 30, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Sap gen ai hub #16053

Are you sure you want to change the base?

Sap gen ai hub #16053

Conversation

vasilisazayka commented Oct 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Title

Pre-Submission checklist

Type

Changes

Uh oh!

vercel bot commented Oct 29, 2025

Uh oh!

karimmohraz commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

vasilisazayka commented Oct 29, 2025 •

edited

Loading

karimmohraz commented Oct 30, 2025 •

edited

Loading