^hQ SrSSKrSSKJrJr SSKrSSKJrJrJrJ r J r SSK r SSK J r SSK7 SSKJr \"5r\R%SS /\"\5/S S 9\R%S S /\"\5/S 9S\4Sj55r\R%SS /\"\5/S S 9\R%SS /\"\5/S 9S\4Sj55rS\S\\4Sjr\R%SS /S \"\5/S9\R%SS /\"\5/S 9\"\54S\S\4Sjj55r\R7SS /\"\5/\S9\R7SS /S \"\5/S9\R:"SS94S\4S jj55r\R%S!S /\"\5/S 9\R%S"S /S \"\5/S9\"\54S\ S\4S#jj55r!\R%S$S /\"\5/S 9\R%S%S /S \"\5/S9\"\54S\"S\4S&jj55r#\R7S'S /\"\5/\\S9\R7S(S /S \"\5/S9\"\54S)\ S\4S*jj55r$g)+z} CUSTOMER MANAGEMENT All /customer management endpoints /customer/new /customer/info /customer/update /customer/delete N)ListOptional) APIRouterDepends HTTPExceptionRequeststatus)verbose_proxy_logger)*)user_api_key_authz/end_user/blockzCustomer ManagementF)tags dependenciesinclude_in_schemaz/customer/block)r rdatac# SSKJn /nUb[URHJnURRR SU0USS.SS0S.S 9IShvN nUR U5 ML O [S S S 0S 9eSU0$N*![a<n[R"S[U535 [S S [U50S 9eSnAff=f7f)az [BETA] Reject calls with this end-user id Parameters: - user_ids (List[str], required): The unique `user_id`s for the users to block (any /chat/completion call with this user={end-user-id} param, will be rejected.) ``` curl -X POST "http://0.0.0.0:8000/user/block" -H "Authorization: Bearer sk-1234" -d '{ "user_ids": [, ...] }' ``` r prisma_clientNuser_idT)rblockedr)createupdatewherererrorzPostgres DB Not connected status_codedetail blocked_userszAn error occurred - ) litellm.proxy.proxy_serverruser_idsdblitellm_endusertableupsertappendr Exceptionr rstr)rrrecordsidrecordes o/home/james-whalen/.local/lib/python3.13/site-packages/litellm/proxy/management_endpoints/customer_endpoints.py block_userr-s89G  $mm,//DDKK$b/.0T"B#,d"3 L v&$ !<=   )) G""%9#a&#BCWc!f4EFFGs;CAA<A:)A<9C:A<< C7B==CCz/end_user/unblockz/customer/unblockc^# SSKJm [U4Sj[R55(a[R c [ SSS0S9e[[R [5(a3URH"n[R RU5 M$ O [ SSS 0S9eS [R 0$7f) z [BETA] Unblock calls with this user id Example ``` curl -X POST "http://0.0.0.0:8000/user/unblock" -H "Authorization: Bearer sk-1234" -d '{ "user_ids": [, ...] }' ``` r)_ENTERPRISE_BlockedUserListc3<># UHn[UT5v M g7f)N) isinstance).0xr/s r, unblock_user..nsVDUq 19::DUsrz:Blocked user check was never set. This call has no effect.rrzF`blocked_user_list` must be set as a list. Filepaths can't be updated.r) -enterprise.enterprise_hooks.blocked_user_listr/anylitellm callbacksblocked_user_listrr1listr!remove)rr)r/s @r, unblock_userr>Qs0 VGDUDUV V V  $ $ ,U  '++T22--B  % % , ,R 0 a   W66 77sCCreturnc[RR5n0nUH nUS:XaM [XS5nUcMXBU'M" U(a [S0UD6$g)z= Return a new budget object if new budget params are passed. budget_idN) BudgetNew model_fieldskeysgetattr)r budget_paramsbudget_kv_pairs field_namevalues r,new_budget_requestrKsd**//1MO$  $ $/  */J ' $+?++ z /end_user/new)r rrz /customer/newuser_api_key_dictc F# SSKJnJnJn Uc$[ SS[ R R0S9eURbUc$[ SS[ RR0S9eURUR5;a=[ SSSRUR[UR5550S9e0n[U5nUbvURRR!0UR#S S 9EUR$=(d UUR$=(d US .ES 9IShvN nUR*US 'OUR*bUR*US 'UR-S S9n U R/5H-upU [0R2R55;dM)XU 'M/ URR6R!USS 0S9IShvN n U $N![&an[ SS[)U50S9eSnAff=fN/![&Gan[8R:"SR[)U555 S[)U5;a[=SUR$S3SSSS9e[?U[5(aH[=[AUSS[)U5S35S[AUSS5[AUS[BRD5S 9e[?U[<5(aUe[=S![)U5-S[AUSS5[BRDS 9eSnAff=f7f)"a Allow creating a new Customer Parameters: - user_id: str - The unique identifier for the user. - alias: Optional[str] - A human-friendly alias for the user. - blocked: bool - Flag to allow or disallow requests for this end-user. Default is False. - max_budget: Optional[float] - The maximum budget allocated to the user. Either 'max_budget' or 'budget_id' should be provided, not both. - budget_id: Optional[str] - The identifier for an existing budget allocated to the user. Either 'max_budget' or 'budget_id' should be provided, not both. - allowed_model_region: Optional[Union[Literal["eu"], Literal["us"]]] - Require all user requests to use models in this specific region. - default_model: Optional[str] - If no equivalent model in the allowed region, default all requests to this model. - metadata: Optional[dict] = Metadata for customer, store information for customer. Example metadata = {"data_training_opt_out": True} - budget_duration: Optional[str] - Budget is reset at the end of specified duration. If not set, budget is never reset. You can set duration as seconds ("30s"), minutes ("30m"), hours ("30h"), days ("30d"). - tpm_limit: Optional[int] - [Not Implemented Yet] Specify tpm limit for a given customer (Tokens per minute) - rpm_limit: Optional[int] - [Not Implemented Yet] Specify rpm limit for a given customer (Requests per minute) - max_parallel_requests: Optional[int] - [Not Implemented Yet] Specify max parallel requests for a given customer. - soft_budget: Optional[float] - [Not Implemented Yet] Get alerts when customer crosses given budget, doesn't block requests. - Allow specifying allowed regions - Allow specifying default model Example curl: ``` curl --location 'http://0.0.0.0:4000/customer/new' --header 'Authorization: Bearer sk-1234' --header 'Content-Type: application/json' --data '{ "user_id" : "ishaan-jaff-3", "allowed_region": "eu", "budget_id": "free_tier", "default_model": "azure/gpt-3.5-turbo-eu" <- all calls from this user, use this model? }' # return end-user object ``` NOTE: This used to be called `/end_user/new`, we will still be maintaining compatibility for /end_user/XXX for these endpoints r)litellm_proxy_admin_name llm_routerrNrrrizmDefault Model not on proxy. Configure via `/model/new` or config.yaml. Default_model={}, proxy_model_names={}T) exclude_unset) created_by updated_by)rrA exclude_nonelitellm_budget_table)rincludez\litellm.proxy.management_endpoints.customer_endpoints.new_end_user(): Exception occured - {}z3Unique constraint failed on the fields: (`user_id`)z(Customer already exists, passed user_id=z. Please pass a new user_id. bad_requestr6r)messagetypecodeparamrInternal Server Error()internal_errorr\NonerrYrZr\r[Internal Server Error, )#r rOrPrrCommonProxyErrorsdb_not_connected_errorrJ default_model no_llm_routerget_model_namesformatsetrKr"litellm_budgettabler model_dumprr&r'rAdictitemsrCrDrEr#r exceptionProxyExceptionr1rFr HTTP_500_INTERNAL_SERVER_ERROR) rrMrOrPrnew_end_user_obj _new_budget budget_recordr+ _user_datakvend_user_records r, new_end_userrxsOn  .EEKKL  Q     )!# ##%6%D%D%J%JK##:+E+E+GG# #"Q"X"X ..J4N4N4P0Q""$).  " O&3&6&6&J&J&Q&Q%00t0D&7&?&?&[C[&7&?&?'43 'R'! -:,C,C [ ) ^^ ',0NN [ )YYDY1 $$&DA ..3355&'#' !. 0 0 E E L L!+T2!M!   7! O#Wc!f * *G-A6!!Wf-66   / st3L!BHA G)6G'7G);A0H/1H H!H&L!'G)) H 3HH  H LC * *G-A6!!Wf-66   ! sHI6EEBE,D?-9E&I'E I  C * *G-A6!!Wf-66   ! s=I1BE")E *BE"I1E"" I.-CNewCustomerRequestrCrKUserAPIKeyAuthrxgetrQueryr'rUpdateCustomerRequestrDeleteCustomerRequestrrrBrLr,rs !FF1"B   +,-     +,-  (G:(G  (GV  +,-     +,-  '8Z'8  '8T/HY4G(  +,-     +,- )00A(BS S %S  S l  +,-'     +,-  }};"3"3  "3J  +,-    +,-  )00A(B^ ^ %^  ^ B  +,-    +,-  )00A(BO O %O  O d  +,-,-     +,-  )00A(B**%*  *rL