^hPl.SSKrSSKrSSKJrJrJrJrJr SSKJ r SSK J r SSK r SSK JrJr SSKJr SSKJrJrJrJrJrJr SSKJr SS KJrJr \"5r\(a SS KJ r! \!r O\r S r"S \ S \#4Sjr$S\%S \ 4Sjr&S\S\\S \4Sjr'S\S \\4Sjr(S&S\ S\\#S \%4Sjjr)"SS5r*S'S\%S \ S\S\ S\\\#\4S\\#4 Sjjr+S\\%S\S \\,4Sjr-S\%S\\%S\S \.S \.4 S!jr/S\%S"\#S\4S#jr0S\%S\%4S$jr1S\%S \ 4S%jr2g)(N) TYPE_CHECKINGAnyDictOptionalUnion)Request)Headers)verbose_loggerverbose_proxy_logger)ServiceLogging)AddTeamCallbackCommonProxyErrorsLitellmDataForBackendLLMCallSpecialHeadersTeamCallbackMetadataUserAPIKeyAuth) ServiceTypes)!StandardLoggingUserAPIKeyMetadataSupportedCacheControls) ProxyConfigc0nURS5nUH&nSU;aURS5upEXQU'M"SX'M( U$)Nz, =T)split) cache_control cache_dict directives directivekeyvalues ^/home/james-whalen/.local/lib/python3.13/site-packages/litellm/proxy/litellm_pre_call_utils.pyparse_cache_controlr!$sPJ$$T*J ) "-JC#sO$(J !   requestreturncSURR;dSURR;agSURR;agSURR;agg)z Helper to return what the "metadata" field should be called in the request data For all /thread or /assistant endpoints we need to call this "litellm_metadata" For ALL other endpoints we call this "metadata thread assistantlitellm_metadatabatchesz /v1/messagesmetadata)urlpathr#s r _get_metadata_variable_namer.2sW7;;###{gkk6F6F'F!GKK$$$!)))!r"datac[US5(a%[UR5nSU;a USUS'ggg![a g[a*n[ R "S[U55 SnAgSnAff=f)N query_params api-version api_versionz.error checking api version in query params: %s)hasattrdictr1KeyError Exceptionr exceptionstr)r/r#r1es r &safe_add_api_version_from_query_paramsr;Es~  7N + + 4 45L ,&2=&A]#- ,      :< & 7   %?%P%P P & 7 7 > >t?Q?Q R  y ( % 6 6 >:< & 7   %?%P%P P & 7 7 > >t?Q?Q R  4 4 % 6 6 >:< & 7 % 6 6 >:< & 7   %?%P%P P & 7 7 > >t?Q?Q R   %?%P%P P & 7 7 > >t?Q?Q R((..0  % 3 3 ;79 & 48; MM $ $U $ @ IE9 "0051 &%r"user_api_key_dictcTSnURb;SUR;a+URSHn[[S0UD6US9nM U$URbPURnSU;a>UR SS5=(d 0n[ S0UD6n[ R"SU5 U$)Nlogging)r/r<callback_settingsz$Team callback settings activated: %s)r*rMr team_metadatagetrr debug)rNcallback_settings_objitemrSrQs r _get_dynamic_logging_metadatarXzs=A"". *33 3%..y9D$L$,t,+@% !:. ! %  ( ( 4)77 - / - 1 12Et L RPR $8$M;L$M ! & &68M   ! r"headerslitellm_key_header_namecL[RR5Vs/sHo"RR 5PM nnUnUbUR UR 55 0nUR 5HupVUR 5U;dMXdU'M! U$s snf)z& Removes litellm api key from headers )r _member_map_valuesrlowerrErH)rYrZvspecial_headers clean_headersheaderrs r raras 1?0K0K0R0R0TU0T1ww}}0TOU%O*6<<>?M   <<> 0$)& !) Vs#B!c ,\rSrSr\S\\\44Sj5r\SS\S\ \ S\ \ 4Sjj5r \S\S\ S\4S j5r\SS .S\S\ S\ \ \ \4S\4S jj5r\S\ S\4S j5r\S \S\S\ 4Sj5r\S\ \S\ \S\4Sj5rSrg)LiteLLMProxyRequestSetuprYc0nUR5HUup#UR5RS5(dM+UR5RS5(aMQX1U'MW U$)z Get the headers that should be forwarded to the LLM Provider. Looks for any `x-` headers and sends them to the LLM Provider. zx-z x-stainless)rHr^ startswith)rYforwarded_headersrbrs r _get_forwardable_headers1LiteLLMProxyRequestSetup._get_forwardable_headerss`$]]_MF||~((..v||~7P7P88-2&) - ! r"Ngeneral_settingsr$cUbURS5SLagUR5Hup#UR5S:XdMUs $ g)z) Get the OpenAI Org ID from the headers. Nforward_openai_org_idTzopenai-organization)rTrHr^)rYrkrbrs r get_openai_org_id_from_headers7LiteLLMProxyRequestSetup.get_openai_org_id_from_headerssL  ( $$%<=TI$]]_MF||~!66 -r"rNc[RU5n[RSLaD[R US9nUR 5HupEUcM XRSR U5'M U$)z Add headers to the LLM call - Checks request headers for forwardable headers - Checks if user information should be added to the headers TrNz x-litellm-{})rdrirI#add_user_information_to_llm_headers'get_sanitized_user_information_from_keyrHformat)rYrNreturned_headers litellm_logging_metadata_headerskr_s r add_headers_to_llm_call0LiteLLMProxyRequestSetup.add_headers_to_llm_callsw4LLWU  6 6$ >(PP&7Q - 9>>@=AB^%:%:1%=>A r")rkc[5nU(a3URS5SLa[RX5nU0:waXCS'[R X5nUbXSS'U$)z* - Adds forwardable headers - Adds org id !forward_client_headers_to_llm_apiTrY organization)rrTrdrxrn)rYrNrkr/_headers _organizations r %add_litellm_data_for_backend_llm_call>LiteLLMProxyRequestSetup.add_litellm_data_for_backend_llm_callsn,-  $$%HITQ/GGH2~"*Y0OO    $#0  r"c [URURURURUR UR URS9nU$)N)user_api_key_hashuser_api_key_aliasuser_api_key_team_iduser_api_key_user_iduser_api_key_org_iduser_api_key_team_aliasuser_api_key_end_user_id)rapi_key key_aliasteam_iduser_idorg_id team_alias end_user_id)rNuser_api_key_logged_metadatas r rs@LiteLLMProxyRequestSetup.get_sanitized_user_information_from_keysW(I/770::!2!:!:!2!:!: 1 8 8$5$@$@%6%B%B( $,+r" key_metadatar/_metadata_variable_namecUR5nSU;aL0US'[US[5(a/USR5Hup4U[;dMXASU'M SU;a3USb-[ R XRS5USS9XS'SU;ax[US[5(a`SX;aN[XS[5(a4USR5HupVXQUS;dMUXSU'M O USXS'SU;a [US[5(aUSUS'U$)Ncachetags request_tags tags_to_addspend_logs_metadatadisable_fallbacks) copy isinstancer5rHrrd _merge_tagsrTbool)rr/rrwr_rrs r add_key_level_controls/LiteLLMProxyRequestSetup.add_key_level_controlssyy{ l "DM,w/66(1779DA22+,W a(: \ !l6&:&F(44!%!>!B!B6!J ,V 45  )& 1 !L 0Z . /6 6 %(EE*-.CDdKK#//D"E"K"K"MJC(?#@AV#WW"56KL #NHT)H-.CD , .: , -t4 4 )55H(ID$ % r"rrc/nU(a&[U[5(aURU5 U(a6[U[5(a!UHnX2;dM URU5 M U$)z Helper function to merge two lists of tags, ensuring no duplicates. Args: request_tags (Optional[list]): List of tags from the original request tags_to_add (Optional[list]): List of tags to add Returns: list: Combined list of unique tags )rlistextendrE)rr final_tagstags r r$LiteLLMProxyRequestSetup._merge_tagsBs[ J|T::   l + :k488"(%%c*#r"rRN)__name__ __module__ __qualname____firstlineno__ staticmethodrr r5rirrr9rnrrxrrrrrsrrr__static_attributes__rRr"r rdrdsW!w}%!!":>)1$ #   *8   0 6: *#4S>2  & 6 ,) , * , ,**"&*AD**X(4.x~RVr"rd proxy_configrkversionc  # SSKJnJn [X5 [ UR UbUR S5OSS9nUR[RUUUS95 [UR5URU[R"U5S.US'URn [U 5n U R S 5n U bXS '[#XS 9 UR n [$R&"S U 5 U R S S5n U (a[)U 5nUR S5US'[$R&"SU5 [+U5nX;a0X'SU;a$USb[R,"US5XS'[R/US9nXRU5 UR0XS'[3USS5XS'XPUS'UbUR SS5XS'UR4n[R7UUUS9nUR8=(d 0nSU;a3USb-[R;XR S5USS9XS'SU;ay[=US[5(aaSX;aO[=XS[5(a5USR?5HunnUXS;dMUXSU'M O USXS'UR@XS'URBXS'URDXS'URFXS 'URHXS!'UR4XS"'[UR 5nURKS#S5 XUS$'[UR5XS%'URLXS&'[OXS'9 URPbURPUS('[RRR"5nS)nUS*LaUbHUR S+5S*La4Ub1[UUS$5(a S,UR ;aUR S,nORUbO[UUS-5(a>[UURVS.5(a#URVbURVRXnUXS/'U(aURZS*LaSU;a USXS'UR\bPUR_UR\S09IShvN n[aU5S:XaOURKS1S5nUXS1'0UEUEn[cUS9nUbTURdUS2'URfUS3'URhb)URhR?5H unnUUU'M [kUUUS49 [$R&"S5U35 [mUUUUS69 [RRR"5n[nRq[rRtUU- S7UUURLS89IShvN U$![ a 0n GNAf=fGN)N7f)9a Adds LiteLLM-specific data to the request. Args: data (dict): The data dictionary to be modified. request (Request): The incoming request. user_api_key_dict (UserAPIKeyAuth): The user API key dictionary. general_settings (Optional[Dict[str, Any]], optional): General settings. Defaults to None. version (Optional[str], optional): Version. Defaults to None. Returns: dict: The modified data dictionary. r) llm_router premium_userNrZ)rZ)rYrNrk)r+methodrYbodyproxy_server_requestr2r3)r/rYzRequest Headers: %sz Cache-Controlzs-maxagettlzreceiving data: %sr*requester_metadatarq user_api_keyend_user_max_budgetuser_api_end_user_max_budgetlitellm_api_versionglobal_max_parallel_requests)rr/rrrruser_api_key_team_max_budgetuser_api_key_team_spenduser_api_key_spenduser_api_key_max_budgetuser_api_key_model_max_budgetuser_api_key_metadata authorizationrYendpointlitellm_parent_otel_spanr-allowed_model_regionTuse_x_forwarded_forzx-forwarded-forclienthostrequester_ip_address)rrrCrF)r/rrNz2[PROXY]returned data from litellm_pre_call_utils: ) request_bodyrkrNradd_litellm_data_to_request)serviceduration call_type start_timeend_timeparent_otel_span);litellm.proxy.proxy_serverrrr;rarYrTupdaterdrr9r+rrr1r5r6(add_provider_specific_headers_to_requestr rUr!r.deepcopyrsrgetattrr*rrSrrrHteam_max_budget team_spendspend max_budgetmodel_max_budgetpopr_add_otel_traceparent_to_datartimer4rrenable_tag_filteringrload_team_configlenrXrCrFrGmove_guardrails_to_metadata_enforced_params_checkservice_logger_objasync_service_success_hookrPROXY_PRE_CALL)r/r#rNrrkrrrr}r1 query_dictdynamic_api_versionrYcache_control_headerrrrrrSrrrr team_configrrVrwr_rs r rr[s,D*49 +  !: ; H KK FF/- G 7;;.. $ $D  ++ ,' *4 )F&1]-$IooG4g>";;=()=>  nnZ0U 3T:9'B*(*%Td:.:>Bmm  ? %&:; !HH/ I !  !(()EF !! ! EL0$ED!"@AO=W=WD!"9:GOO$H LL08 !),03GKK0@D!*- ** !""$8--9'8'M'M #$Jt  ( $$%:;tC#++!W__4#*??3D#E  **//*#*>>#6#6 48LD )& 1  ,(99%--:   { q !ooi6G7>D )) 4D :+(#8#I#I  #8#I#I  . . :-;;AAC1QD  7+  J  " O099:KLM r"rrc[XS9nUcgUb.USLa)[SUS[RR35eUHnUR S5n[ U5S:XaUSU;a[SUSS 35eM@[ U5S :XdMQUSU;a[SUSS 35eUSXS;dM|[S USS USS 35e g)zU If enforced params are set, check if the request body contains the enforced params. )rkrNTz;Enforced Params is an Enterprise feature. Enforced Params: z. .rzBadRequest please pass param=z* in request body. This is a required paramzBadRequest please pass param=[z][z+] in request body. This is a required param)r ValueErrorrnot_premium_userrrr)rrkrNrrenforced_param_enforced_paramss r rrzsS';)'O"|4'?I/IZZ\]n]]^F^F]G H  *)//4  A %",6 34DQ4G3HHrs7! "a '",6 34DQ4G3HHrs ",7J*KK 45Ea5H4IL\]^L_K`aLM*" r"rc UR(aLSUR;a<SSKJn USLa[S[R 35eURSXS'gSU;a USXS'US SU;aUSXS'US gg)z Heper to add guardrails from request to metadata - If guardrails set on API Key metadata then sets guardrails on request metadata - If guardrails not set on API key, then checks request metadata guardrailsr)rTzUsing Guardrails on API Key Nguardrail_config)r*rrrrr)r/rrNrs r rrs!! ,55 5 ?4' 23D3U3U2VW;L:T:T;D ), 7 t6:<6H%l3  T!<@ASrs <<,A20 $%FKK S&      $& $&7?@T7U$&$&N!%! "#!F@D /7} "kkf26! I I I&I I tCH~. I c] IXtn9G d^&$$tn$&$ $  $N %  %  %& %F   2RRwRr"