^hq@ SrSSKrSSKJrJrJr SSKJrJrJ r J r J r SSK 7 SSK Jr SSKJrJr SSKJr \"5r\R+S S /\"\5/\S 9\"\54S \S \4Sjj5r\R+SS /\"\5/S9S5r\R+SS /\"\5/S9S5r\R9SS /\"\5/S9\"\54S \4Sjj5r\R+SS /\"\5/S9S \4Sj5r\R+SS /\"\5/\ S 9\\"\54S \!S\ S \S\ 4Sjj55r"S\#S\$S\S\\%\&44Sjr'g) z Endpoints for /organization operations /organization/new /organization/update /organization/delete /organization/info /organization/list N)ListOptionalTuple) APIRouterDepends HTTPExceptionRequeststatus)*)user_api_key_auth)get_new_internal_user_defaultsmanagement_endpoint_wrapper) PrismaClientz/organization/newzorganization management)tags dependenciesresponse_modeldatauser_api_key_dictc # SSKJnJn Uc [SSS0S9eURbUR[ R :wa[SSS UR30S9eURc[RR5nURS S 9nUR5VVs0sHupgXd;dM Xg_M nnn[S0UD6n URU RS S 95n URRR!0U EUR"=(d UUR"=(d US .ES 9IShvN n U RUl[%UR&5S:XaOc[%UR&5S:Xa [SSS0S9eUR&H.n XR&;dM[SSSU SUR&30S9e [)S0URS S 9DUR"=(d UUR"=(d US .D6n URU RS S 95nURR*R!0UES 9IShvN nU$s snnfGN*N7f)a Allow orgs to own teams Set org level budgets + model access. Only admins can create orgs. # Parameters - organization_alias: *str* - The name of the organization. - models: *List* - The models the organization has access to. - budget_id: *Optional[str]* - The id for a budget (tpm/rpm/max budget) for the organization. ### IF NO BUDGET ID - CREATE ONE WITH THESE PARAMS ### - max_budget: *Optional[float]* - Max budget for org - tpm_limit: *Optional[int]* - Max tpm limit for org - rpm_limit: *Optional[int]* - Max rpm limit for org - max_parallel_requests: *Optional[int]* - [Not Implemented Yet] Max parallel requests for org - soft_budget: *Optional[float]* - [Not Implemented Yet] Get a slack alert when this soft budget is reached. Don't block requests. - model_max_budget: *Optional[dict]* - Max budget for a specific model - budget_duration: *Optional[str]* - Frequency of reseting org budget - metadata: *Optional[dict]* - Metadata for team, store information for team. Example metadata - {"extra_info": "some info"} - blocked: *bool* - Flag indicating if the org is blocked or not - will stop all calls from keys with this org_id. - tags: *Optional[List[str]]* - Tags for [tracking spend](https://litellm.vercel.app/docs/proxy/enterprise#tracking-spend-for-custom-tags) and/or doing [tag-based routing](https://litellm.vercel.app/docs/proxy/tag_routing). - organization_id: *Optional[str]* - The organization id of the team. Default is None. Create via `/organization/new`. - model_aliases: Optional[dict] - Model aliases for the team. [Docs](https://docs.litellm.ai/docs/proxy/team_based_routing#create-team-with-model-alias) Case 1: Create new org **without** a budget_id ```bash curl --location 'http://0.0.0.0:4000/organization/new' --header 'Authorization: Bearer sk-1234' --header 'Content-Type: application/json' --data '{ "organization_alias": "my-secret-org", "models": ["model1", "model2"], "max_budget": 100 }' ``` Case 2: Create new org **with** a budget_id ```bash curl --location 'http://0.0.0.0:4000/organization/new' --header 'Authorization: Bearer sk-1234' --header 'Content-Type: application/json' --data '{ "organization_alias": "my-secret-org", "models": ["model1", "model2"], "budget_id": "428eeaa8-f3ac-4e85-a8fb-7dc8d7aa8689" }' ``` r)litellm_proxy_admin_name prisma_clientNerrorNo db connected status_codedetailz,Only admins can create orgs. Your role is = T) exclude_none) created_by updated_byrz\User not allowed to give access to all models. Select models you want org to have access to.z)User not allowed to give access to model=z. Models you have access to = )litellm.proxy.proxy_serverrrr user_roleLitellmUserRoles PROXY_ADMIN budget_idLiteLLM_BudgetTable model_fieldskeysjsonitemsjsonify_objectdblitellm_budgettablecreateuser_idlenmodelsLiteLLM_OrganizationTablelitellm_organizationtable)rrrr budget_params _json_datakv _budget_data budget_row new_budget_budgetmorganization_rownew_organization_rowresponses s/home/james-whalen/.local/lib/python3.13/site-packages/litellm/proxy/management_endpoints/organization_endpoints.pynew_organizationrEsNSW>O4PQQ ##+  & &*:*F*F FGHYHcHcGde   ~~ ,88==? YYDY1 )3)9)9);R);q?Q); R(8<8 "11*//t/2TU %((<<CC/77S;S/77S;SD  !**  # #$) t{{ q {  A000# ##LQCOmnoGoGnH"I1 ))) &$,,H0H$,,H0H )7740#%%??FF " GH OeS  Ns?B*I/, I$;I$A?I/I*A1I/6B'I/I- I/-I/z/organization/update)rrc # [S5e7fzd[TODO] Not Implemented yet. Let us know if you need this - https://github.com/BerriAI/litellm/issueszNot Implemented YetNotImplementedErrorr$rDupdate_organizationrK 3 44 z/organization/deletec # [S5e7frGrHr$rJrDdelete_organizationrOrLrMz/organization/listcj# SSKJn Uc [SSS0S9eURbUR[R :wa[SSS UR30S9eUc$[S S[ RR0S9eURRR5IShvN nU$N7f) z ``` curl --location --request GET 'http://0.0.0.0:4000/organization/list' --header 'Authorization: Bearer sk-1234' ``` rrNrrrrrz*Only admins can list orgs. Your role is = r#) r%rrr&r'r(CommonProxyErrorsdb_not_connected_errorvaluer0r7 find_many)rrrCs rDlist_organizationrVs9W>O4PQQ ##+  & &*:*F*F FEFWFaFaEbc  .EEKKL  #%%??IIKKH OLsB(B3*B1+B3z/organization/infoc# SSKJn Uc [SSS0S9e[UR5S:Xa[SSS UR30S9eUR R RS S UR00S S 0S9IShvN nU$N7f)z" Get the org specific information rrQNrrrrr#z6Specify list of organization id's to query. Passed in=organization_idinlitellm_budget_tableT)whereinclude)r%rrr4 organizationsr0r7rU)rrrCs rDinfo_organizationr^s9W>O4PQQ 4  !#QRVRdRdQef  #%%??II 4););"<='.JH O sA?B BB z/organization/member_add http_requestreturnc # SSKJn Uc [SSS0S9eURRR SUR 0S 9IShvN nUc[S SS [USS530S9e[UR[5(a URnO UR/n/n/nUHDn[UUR US 9IShvN upURU 5 URU 5 MF [UR UUS 9$NNC![an [U [5(aV[[U SS[!U 5S35["R$[U SS5[U S[&R(5S9e[U [5(aU e[S[!U 5-["R$[U SS5[&R(S9eSn A ff=f7f)a_ [BETA] Add new members (either via user_email or user_id) to an organization If user doesn't exist, new user row will also be added to User Table Only proxy_admin or org_admin of organization, allowed to access this endpoint. # Parameters: - organization_id: str (required) - member: Union[List[Member], Member] (required) - role: Literal[LitellmUserRoles] (required) - user_id: Optional[str] - user_email: Optional[str] Note: Either user_id or user_email must be provided for each member. Example: ``` curl -X POST 'http://0.0.0.0:4000/organization/member_add' -H 'Authorization: Bearer sk-1234' -H 'Content-Type: application/json' -d '{ "organization_id": "45e3e396-ee08-4a61-a88e-16b3ce7e0849", "member": { "role": "internal_user", "user_id": "krrish247652@berri.ai" }, "max_budget_in_organization": 100.0 }' ``` The following is executed in this function: 1. Check if organization exists 2. Creates a new Internal User if the user_id or user_email is not found in LiteLLM_UserTable 3. Add Internal User to the `LiteLLM_OrganizationMembership` table rrQNrrrrrXr[z+Organization not found for organization_id=)memberrXr)rX updated_users updated_organization_membershipsrzAuthentication Error()paramNoner)messagetyperhcodezAuthentication Error, )r%rrr0r7 find_uniquerXgetattr isinstancerdradd_member_to_organizationappendOrganizationAddMemberResponse ExceptionProxyExceptionstrProxyErrorTypes auth_errorr HTTP_500_INTERNAL_SERVER_ERROR) rr_rrexisting_organization_rowmembersrerfrd updated_userupdated_organization_membershipes rDorganization_member_addr~ sh= <  CBS8TU U ""<<HH($*>*>?I  " % ,J7SWYjlpKqJrs  dkk4 ( (kkG{{mG13 VX(F0!$($8$8"/ :L   . , 3 34S T- 00'-M  C .  a ' ' 8/DSVHA-NO$//a&1Q v/T/TU   > * *G,s1v5 ++!Wf-66    sPG AD D  A;D D AD G  D D GCGGG rdrXrc# SnSnSnURb7URRRSUR0S9IShvN nURb7URRRSUR0S9IShvN nUc}UczUR=(d [ [ R"55n[UURS9nURUSS9IShvN nUb[S0UR5D6nO~Ub[U5S:a [S S S 0S 9eUb[S0UR5D6nOCUb[S0UR5D6nO&[S S SURSUR30S 9eUc%[SURSUR35eURRR!UURUR"S.S9IShvN n [%S0U R5D6n X:4$GNGNGN-N)![&an [SU 35eSn A ff=f7f)z Add a member to an organization - Checks if member.user_id or member.user_email is in LiteLLM_UserTable - If not found, create a new user in LiteLLM_UserTable - Add user to organization in LiteLLM_OrganizationMembership Nr3rb user_email)r3ruser)r table_namer#rzIMultiple users with this email found in db. Please use 'user_id' instead.rrczUser not found for user_id=z and user_email=z2User does not exist in LiteLLM_UserTable. user_id=)rXr3r&r"z%Error adding member to organization: r$)r3r0litellm_usertablermrruuuiduuid4r insert_dataLiteLLM_UserTable model_dumpr4r ValueErrorlitellm_organizationmembershipr2role#LiteLLM_OrganizationMembershipTablers) rdrXr user_objectexisting_user_id_rowexisting_user_email_rowr3new_user_defaults_returned_user_organization_membershiporganization_membershipr}s rDrprpsEF37 #"& >> %)6)9)9)K)K)W)W &..1*X*$     (#&&88DD'):):;E $ ',C,K!>>>S->G >!,,!  $1#<#>:JJZ[a[l[lZmn   DV^^DTTdekevevdwx   ""AAHH'6*22!'I  !#F# &113# 33y$ h:  F@DEEFstIAH" H AH" HA"H"0H1DH"6H 7H"IH"H"H" H"" H?,H::H??I)(__doc__rtypingrrrfastapirrrr r litellm.proxy._types$litellm.proxy.auth.user_api_key_authr &litellm.proxy.management_helpers.utilsr rlitellm.proxy.utilsrrouterpostNewOrganizationResponseNewOrganizationRequestUserAPIKeyAuthrErKrOgetrVOrganizationRequestr^rrOrganizationMemberAddRequestr~ OrgMemberrurrrpr$rJrDrs= ((FF"B-  # $+,-*  )00A(BM M%M  M` # $+,-  5  5  # $+,-  5  5  # $+,-  )00A(B%  D # $+,-  "5  0 # $+,-0   )00A(Bj &j j &j # j  j ZRF RFRF RF A AB RFrJ