^hpS0SSKrSSKrSSKrSSKrSSKJrJr SSKJrJrJ r SSK r SSK J r J r J r JrJrJr SSKrSSKJr SSKJrJrJrJrJrJr SSKJr SSKJr \ "5r\RAS S /\ "\5/S 9S \4S j5r!\RASS /\ "\5/SS9\ "\5\ RD"SS94S\S\ \S\#44Sjj5r$\RASS /\ "\5/S 9\ "\5\ RD"SSS94S\S\\#4Sjj5r%S\RL"5S.q'Sr(\RASS /\ "\5/S 9\RASS /\ "\5/S 9S 55r)S!r*\RAS"S /\ "\5/S 9S#5r+\RAS$S /\ "\5/S 9\RAS%S /\ "\5/S 9S&55r,\R[S"S /\ "\5/S 9S'5r.\R[S$S /\ "\5/S 9\R[S%S /\ "\5/S 9S(55r/g))N)datetime timedelta)LiteralOptionalUnion) APIRouterDepends HTTPExceptionRequestResponsestatus)verbose_proxy_logger) AlertTypeCallInfoProxyErrorTypesProxyExceptionUserAPIKeyAuth WebhookEvent)user_api_key_auth)perform_health_checkz/testhealth)tags dependenciesrequestc:# SURR0$7f)z [DEPRECATED] use `/health/liveliness` instead. A test endpoint that pings the proxy server to check if it's healthy. Parameters: request (Request): The incoming request. Returns: dict: A dictionary containing the route of the request URL. route)urlpath)rs j/home/james-whalen/.local/lib/python3.13/site-packages/litellm/proxy/health_endpoints/_health_endpoints.py test_endpointr s$ W[[%% &&sz/health/servicesF)rrinclude_in_schemazSpecify the service being hit.) descriptionuser_api_key_dictservice)slack_budget_alertslangfuseslack openmeterwebhookemail braintrustc # SSKJnJnJn Uc [ SSS0S9eUS;a[ SSS US S /30S9eUS :Xd US :XdU[ R ;a=US:wa7[ R"SSSS./SSS9IShvN nSSRU5S.$US:XaGSSK J n U"5nURR5 [ R"SSSS./SSS9nSSS.$US:XaW[UR=(d SSSUR UR"UR$S9nUR'SUS 9IShvN US!:XdUS :XGaS!UR)S"/5;GaUR*R,GbUR*R,Hn UR*R.bU UR*R.;aM7S#n U [0R2:XaS$n OU [0R4:XaS%n OuU [0R6:XaS&n O^U [0R&:XaS'n OGU [0R8:XaS(n O0U [0R::XaS)n OU [0R<:XaS*n OS'n UR?U S+U S,9IShvN M O'UR?S-S+[0R&S,9IShvN Ub\[@RB"UR*RE55 [@RB"UR*RG55 UR*R.=(d /n [IU 5n SU S.S/.$[ S0SS1RU50S9eUS2:Xas[KS3S4S5UR=(d SS6SSUR [LRN"S75UR$S89 n UR*RQU S99IShvN SS:S.$gGN[GNGN[GN2N![RGan [TRV"S;R[YU 555 [TRZ"[\R^"55 [aU [5(aV[c[eU S35[fRh[eU S?S@5[eU SA[jRl5SB9e[aU [b5(aU e[cSC[YU 5-[fRh[eU S?S@5[jRlSB9eSn A ff=f7f)Dz^ Hidden endpoint. Used by the UI to let user check if slack alerting is working as expected. r)general_settings prisma_clientproxy_logging_objNierrorzService must be specified. status_codedetail) r%r*r&r'r(r)r+otelcustom_callback_api langsmithz!Service must be in list. Service=z. List=r%r(r+r&z"openai/litellm-mock-response-modeluserzHey, how's it going?)rolecontentzlitellm:/health/serviceszThis is a mock response)modelmessagesr7 mock_responsesuccessz!Mock LLM request made - check {}.)r message)LangFuseLoggerz'Mock LLM request made - check langfuse.r))tokenspend max_budgetuser_id key_aliasteam_id user_budget)type user_infor'alertingzdefault test messagezLLM Exception test alertzLLM Too Slow test alertzLLM Requests Hanging test alertzBudget Alert test alertzDB Exception test alertz!Outage Alert Exception test alertzDaily Reports test alertLow)r>level alert_typez"This is a test slack alert messagezBMock Slack Alert sent, verify Slack Alert Received on your channel)r alert_typesr>iz@"{}" not in proxy config: general_settings. Unable to test this.r* key_createdkeyzTest Email AlertzNEmail Test key (This is only a test alert key. DO NOT USE THIS IN PRODUCTION.)TEST_EMAIL_ADDRESS) event event_group event_messagerBrFrCrDrE user_emailrG) webhook_eventz2Mock Email Alert sent, verify Email Alert ReceivedzMlitellm.proxy.proxy_server.health_services_endpoint(): Exception occured - {}r3zAuthentication Error()paramNoner2)r>rIrYcodezAuthentication Error, )7litellm.proxy.proxy_serverr-r.r/r litellmsuccess_callback acompletionformat&litellm.integrations.langfuse.langfuser?Langfuse auth_check completionrrBrErFrG budget_alertsgetslack_alerting_instancealert_to_webhook_urlrOrllm_exceptions llm_too_slowllm_requests_hanging db_exceptions outage_alerts daily_reportsalerting_handlerasyncio create_tasksend_monthly_spend_reportsend_weekly_spend_reportlistrosgetenv&send_key_created_or_user_invited_email Exceptionrr0strdebug traceback format_exc isinstancergetattrr auth_errorr HTTP_500_INTERNAL_SERVER_ERROR)r#r$r-r.r/_r?langfuse_loggerrJrN test_messagerOrWes rhealth_services_endpointr2sn4C   ?2N(O     @ RgQhPij  { ",&7333:8M)):#)6LMN/7 A$>EEgN  j M,.O  $ $ / / 1"":#)6LMN/7 A$D  i  '--3)11+55)11 I$11"#2   g ,A!A*..z2>>&==RR +BBWW#.EEQQ#'( *#4#L#L#X#X!Y%'= %)A)AA+EL'9+A+AA+DL'9+I+II+LL'9+B+BB+DL'9+B+BB+DL'9+B+BB+NL'9+B+BB+EL+DL/@@$0*A9X@,<< D##,#:#:= !,'')AA[[]'')AAZZ\ &==IIOR#;/ '#.c $ #!c!j!j#" g (#!0'--3j)1199%9:)11 M$;;bb+c   $O ' gH V^   "" [ b bA  ""9#7#7#9: a ' ' 8/DSVHA-NO$//a&1Q v/T/TU   > * *G,s1v5 ++!Wf-66   ! sTA6O#:O;O#TA O#T AO#8O9EO#O+O#,O-BO#?TB O# O! O#TO#O#O#O#!O## T .DTT  Tz/healthz!Specify the model name (optional)r:cn# SSKJnJnJnJnJn UcJUb-[ /XbS9IShvN upxUU[U5[U5S.$[[RSS0S9e[R"U5n [UR5S:aOU(aU$[ XUS 9IShvN upxUU[U5[U5S.$NN!![a^n [R "S R#[%U 555 [R&"[(R*"55 U eSn A ff=f7f) u 🚨 USE `/health/liveliness` to health check the proxy 🚨 See more 👉 https://docs.litellm.ai/docs/proxy/health Check the health of all the endpoints in config.yaml To run health checks in the background, add this to config.yaml: ``` general_settings: # ... other settings background_health_checks: True ``` else, the health checks will be run on models when /health is called. r)health_check_detailshealth_check_resultsllm_model_listuse_background_health_checks user_modelN) model_list cli_modeldetails)healthy_endpointsunhealthy_endpoints healthy_countunhealthy_countr0zModel list not initializedr1)rzHlitellm.proxy.proxy_server.py::health_endpoint(): Exception occured - {})r\rrrrrrlenr r rcopydeepcopymodelsrxrr0r`ryrzr{r|) r#r:rrrrrrr_llm_model_listrs rhealth_endpointrsJ.+  !%?S!Z@:6!*;+>%():%;'*+>'?   "AA!=> --7  '' (1 ,   '' ';O0D<6 2  &7':!$%6!7#&':#;  5:,6 "" V ] ]A  ""9#7#7#9:sdD5C CC D5AC D5 C &C'C D5C C D2AD--D22D5unknownr last_updatedcF# SSKJn [R"5[S- n[SS:waU[ SS9:a[$UcS[R"5S .q[$UR 5IShvN S [R"5S .q[$N"7f) Nr)r.rr r)minutes disconnectedr connected)r\r.rnowdb_health_cacher health_check)r. time_diffs r_db_health_readiness_checkrbs8 !@@Ix I-)iPQ>R2R%3X\\^T  $ $ &&&!,hllnMO 'sA:B!<B=#B!z /settingsz/active/callbacksc # SSKJnJn [UR S55n[ R Vs/sHn[U5PM nn[ RVs/sHn[U5PM nn[ RVs/sHn[U5PM nn[ RVs/sHn[U5PM nn[ RVs/sHn[U5PM nn[ RVs/sHn[U5PM n n[ RVs/sHn[U5PM n nUU-U-U-U-U -U -n URn Sn U (a [U [5(a [!U 5n UUUUUUU U U [!U 5U [ R"S. $s snfs snfs snfs snfs snfs snfs snf7f)a% Returns a list of litellm level settings This is useful for debugging and ensuring the proxy server is configured correctly. Response schema: ``` { "alerting": _alerting, "litellm.callbacks": litellm_callbacks, "litellm.input_callback": litellm_input_callbacks, "litellm.failure_callback": litellm_failure_callbacks, "litellm.success_callback": litellm_success_callbacks, "litellm._async_success_callback": litellm_async_success_callbacks, "litellm._async_failure_callback": litellm_async_failure_callbacks, "litellm._async_input_callback": litellm_async_input_callbacks, "all_litellm_callbacks": all_litellm_callbacks, "num_callbacks": len(all_litellm_callbacks), "num_alerting": _num_alerting, "litellm.request_timeout": litellm.request_timeout, } ``` r)r-r/rK) rKzlitellm.callbackszlitellm.input_callbackzlitellm.failure_callbackzlitellm.success_callbackzlitellm._async_success_callbackzlitellm._async_failure_callbackzlitellm._async_input_callbackall_litellm_callbacks num_callbacks num_alertingzlitellm.request_timeout)r\r-r/ryrfr] callbacksinput_callbackfailure_callbackr^_async_success_callback_async_failure_callback_async_input_callbackrKr}rtrrequest_timeout)r-r/ _alertingxlitellm_callbackslitellm_input_callbackslitellm_failure_callbackslitellm_success_callbackslitellm_async_success_callbackslitellm_async_failure_callbackslitellm_async_input_callbacksrrK _num_alertings ractive_callbacksrwsFO$((45I*1):):;):AQ):;/6/E/EF/E!s1v/EF181I1I J1IAQ1I J181I1I J1IAQ1I J7>7V7V&W7V!s1v7V#&W7>7V7V&W7V!s1v7V#&W5<5R5R$S5RSV5R!$S  ! " # $ $ $ *  * *  * (  (!))HMJx..H ."9$=$=+J+J)F!623%#*#:#:  /<F J J&W&W$SsY5GF3 G F85G F=G2GGG0GG G-GBGc[U[5(aU$UR$![a7 URRs$![a [U5ss$f=ff=f)N)r}ry__name__AttributeError __class__)callbacks r callback_namersd(C  !   ! !%%.. . !x=  !!s, % A&AA&A"A&!A""A&z/health/readinessc# SSKJnJn /n[RVs/sHn[ U5PM nnSn[Rb~SSKJ n [RRn[[RRU5(a5[RRR5IShvN nXFS.nUb[5IShvN nSSUUUS .UE$SS UUUS .$s snf![ a [RnNf=fNT![anS[U5-nSnANoSnAff=fNb![an[!S S [U5S 3S9eSnAff=f7f)zB Unprotected endpoint for checking if worker can receive requests r)r.versionN)RedisSemanticCachezindex does not exist - error: )rI index_infohealthyr)r dbcachelitellm_versionsuccess_callbacksz Not connectedizService Unhealthy (rXr1)r\r.rr]r^rrrlitellm.caching.cachingrrIr} _index_inforxryrr ) r.rsuccess_callback_namesr cache_typerrrdb_health_statuss rhealth_readinessrs|B2U!# >+2*B*B&*BQ a *B #& == $ B ++J'----/ABBK'.}}':':'F'F'H!HJ'1K   $%?%AA #!##*%;  #  $%##*%;  G& >%,%=%= " >"I K!ACF!JJK B" U6I#a&QR4STTUs E'D>C5C0C5AD>+DDDD>D< D>'E'(D>/E'0C55DD>DD>D D9!D4/D>4D99D>> E$EE$$E'z/health/livelinessz/health/livenessc # g7f)z6 Unprotected endpoint for checking if worker is alive z I'm alive!rrhealth_livelinessrs  sc*# SSSS.n[USS9$7f)z. Options endpoint for health/readiness check. GET, OPTIONS*AllowzAccess-Control-Allow-MethodszAccess-Control-Allow-Headersheadersr2r response_headerss rhealth_readiness_optionsr$s( (6(+ ,# >>c*# SSSS.n[USS9$7f)z/ Options endpoint for health/liveliness check. rrrrrrrs rhealth_liveliness_optionsr5s( (6(+ ,# >>r)0rprrur{rrtypingrrrfastapirr r r r r r]litellm._loggingrlitellm.proxy._typesrrrrrr$litellm.proxy.auth.user_api_key_authrlitellm.proxy.health_checkrrouterrfr Queryryrrrrrrrrroptionsrrrrrrs (++PP1C;  +,-  ' '  '  +,-  )00A(B  "BCW %W      W  W tIXJg>O6P5QR(/0A(B"== =I%I C=ISIX' G* +,-   +,-  B  BJ ! +,-  8U  8Uv +,-   +,-     +,- ?  ? +,-  +,- ?   ?r