^hA0%SSKJr SSKJrJrJrJrJrJr SSK J r SSK J r SSK JrJr SSKJr SSKJrJrJr \R,"\5r00000000000000S.r\\\\\ 44\S '\S \\\4S \\\44S j5r\S \\S \\4S j5rS \\\\4\\4S \\\\4\\44Sjr"SS5r"SS\5r"SS\5r\"SS9S\S \S4Sj5r S\S\S \4Sjr!g)) lru_cache)AnyDictListOptionalUnionoverload) constants)InferenceProviderMapping) MimeBytesRequestParameters)ChatCompletionInputMessage)build_hf_headers get_tokenlogging)cerebrascoherezfal-aiz fireworks-aigroqz hf-inference hyperbolicnebiusnscale replicate sambanovascalewaytogetherzzai-org!HARDCODED_MODEL_INFERENCE_MAPPINGobjreturncgNrs f/home/james-whalen/.local/lib/python3.13/site-packages/huggingface_hub/inference/_providers/_common.py filter_noner$*s8;cgr r!r"s r#r$r$,s.1r%c[U[5(aL0nUR5H4up#UcM [U[[45(a [ U5nX1U'M6 U$[U[5(a9UVs/sH+n[U[[45(a [ U5OUPM- sn$[ S[ U535es snf)NzExpected dict or list, got ) isinstancedictitemslistr$ ValueErrortype)rcleanedkvs r#r$r$0s#t"$IIKDAy!dD\**NAJ  #tNQRc*Qt "="= A1DcRR 249+> ??Ss;2Cc\rSrSrSrS\S\S\SS4SjrSS .S \S \\\4S \S \ \S\ \S\ \\\4S\ 4Sjjr S"S\ \ \4S\ \ S\4SjjrS\ \S\4SjrS \ \S\4SjrS \\\4S\ \\\4S\ \S\\\44SjrS \S\S\\\44SjrS\S\S\4SjrS\S\4SjrS\S\S\4SjrS \S \S\S\ \4SjrS \S \S\S\ \S\ \4 S jrS!rg)#TaskProviderHelperAz.Base class for task-specific provider helpers.providerbase_urltaskrNc(XlX0lX lgr )r4r6r5)selfr4r5r6s r#__init__TaskProviderHelper.__init__Ds   r%) extra_payloadinputs parametersheadersmodelapi_keyr;c URU5nURU5nURX55nURXWR5nUR XUS9n U b[ U [U=(d 055n URXXv5n U bU b [S5eU cU c [S5eURX9U 5n [UURURU U U S9$)z Prepare the request to be sent to the provider. Each step (api_key, model, headers, url, payload) can be customized in subclasses. )provider_mapping_infoz8Both payload and data cannot be set in the same request.z2Either payload or data must be set in the request.)urlr6r?jsondatar>) _prepare_api_key_prepare_mapping_info_prepare_headers _prepare_url provider_id_prepare_payload_as_dictrecursive_merger$_prepare_payload_as_bytesr,_normalize_headersr r6) r8r<r=r>r?r@r;rBrCpayloadrEnormalized_headerss r#prepare_request"TaskProviderHelper.prepare_requestIs ''0!% : :5 A''9)J)JK//Zo/p  %g{=;NB/OPG--fBWg  4#3WX X ?t|QR R"44WtL '33&   r%responserequest_paramscU$)zr Return the response in the expected format. Override this method in subclasses for customized response handling.r!)r8rSrTs r# get_responseTaskProviderHelper.get_response~s r%cXUc [5nUc[SURS35eU$)zRReturn the API key to use for the request. Usually not overwritten in subclasses.z)You must provide an api_key to work with z$ API or log in with `hf auth login`.)rr,r4r8r@s r#rF#TaskProviderHelper._prepare_api_keys: ?kG ?;DMM?Jno r%c Uc[SURS35e[RUR05RU5(a[URU$Sn[ U5H!nURUR:XdMUn O Uc[SUSURS35eUR UR :wa6[SUSUR SURSUR S3 5eUR S :Xa&[RSUS URS 35 UR S :Xa&[RS USURS35 U$)zZReturn the mapped model ID to use for the request. Usually not overwritten in subclasses.Nz+Please provide an HF model ID supported by .zModel z is not supported by provider z is not supported for task z and provider z. Supported task: stagingz! is in staging mode for provider z. Meant for test purposes only.errorz,Our latest automated health check on model 'z' for provider 'z<' did not complete successfully. Inference call might fail.) r,r4rget!_fetch_inference_provider_mappingr6statusloggerwarning)r8r?provider_mappingmappings r#rG(TaskProviderHelper._prepare_mapping_infos =J4==/YZ[\ \ - 0 0 C G G N N4T]]CEJ J8?G4==0#* @  #veW,J4==/YZ[\ \  DII -:499+^TXTaTaSbc##3#8#8"9<   " "i / NN@Ono   " "g - NN>ugEUVZVcVcUde--  r%rOrEcUR5VVs0sHupEUcM UR5U_M nnnURS5c)UbURbURUS'U$UbSUS'U$s snnf)zjNormalize the headers to use for the request. Override this method in subclasses for customized headers. z content-typezapplication/json)r*lowerr_ mime_type)r8r>rOrEkeyvaluerPs r#rN%TaskProviderHelper._normalize_headerssDK==?h?ZSV[0ciik50?h  ! !. 1 9DNN$>59^^">2"!$5G">2!! is A6A6c0[US9EUE$)zgReturn the headers to use for the request. Override this method in subclasses for customized headers. )token)r)r8r>r@s r#rH#TaskProviderHelper._prepare_headerss >"1=W==r% mapped_modelcURU5nURX!5nURS5SURS53$)zNReturn the URL to use for the request. Usually not overwritten in subclasses./)_prepare_base_url_prepare_routerstriplstrip)r8r@rpr5routes r#rITaskProviderHelper._prepare_urlsI))'2##L://#&'qc):(;<>s>tCH~>=C=s=s= ! ! !3'+D\ $    8   ~  )  r%r2c ~^\rSrSrSrS\S\4U4SjjrS\S\S\4S jrS \\ \ \ 4S \ S \ S\ \ 4S jrSrU=r$)BaseConversationalTaskiz Base class for conversational (chat completion) tasks. The schema follows the OpenAI API format defined here: https://platform.openai.com/docs/api-reference/chat r4r5c">[TU]XSS9 g)Nconversationalr4r5r6superr9r8r4r5 __class__s r#r9BaseConversationalTask.__init__ s (DTUr%rpr@rcg)Nz/v1/chat/completionsr!rs r#rt%BaseConversationalTask._prepare_route s%r%r<r=rBc<[SU0UESUR0E5$)Nmessagesr?r$rJrs r#rK/BaseConversationalTask._prepare_payload_as_dicts' Ji*igG\GhGhijjr%r!)rrrrrrr9rtrrrrr rrKr __classcell__rs@r#rrs VVV&3&&&kU4!;;<=kk 8 k $ kkr%rc n^\rSrSrSrS\S\4U4SjjrS\S\S\4S jrS \S \ S \ S\ \ 4S jr Sr U=r$)BaseTextGenerationTaskiz Base class for text-generation (completion) tasks. The schema follows the OpenAI API format defined here: https://platform.openai.com/docs/api-reference/completions r4r5c">[TU]XSS9 g)Nztext-generationrrrs r#r9BaseTextGenerationTask.__init__s (DUVr%rpr@rcg)Nz/v1/completionsr!rs r#rt%BaseTextGenerationTask._prepare_route"s r%r<r=rBc<[SU0UESUR0E5$)Npromptr?rrs r#rK/BaseTextGenerationTask._prepare_payload_as_dict%s'Hfg gGEZEfEfghhr%r!)rrrrrrr9rtrrr rrKrrrs@r#rrsl WWW!3!!!ii'+iD\i $iir%rN)maxsizer?r cxSSKJn U"5RUS/S9nURnUc[ SU35eU$)z3 Fetch provider mappings for a model from the Hub. r)HfApiinferenceProviderMapping)expandz$No provider mapping found for model )huggingface_hub.hf_apir model_infoinference_provider_mappingr,)r?rr|rds r#r`r`+sM - 7  e-G,H  ID66?wGHH r%dict1dict2c 0UEUR5VVs0sHGup#UX ;a:[X[5(a#[U[5(a[XU5OU_MI snnE$s snnfr )r*r(r)rL)rrrjrks r#rLrL9s}    $kkm  ,   EJ!=!=*UTXBYBY!U3 ,    sAA*)" functoolsrtypingrrrrrr huggingface_hubr rr !huggingface_hub.inference._commonr r :huggingface_hub.inference._generated.types.chat_completionrhuggingface_hub.utilsrrr get_loggerrrbrr__annotations__r$r2rrr`rLr!r%r#rs==%;JaFF   H % +U!4T#7O2O-P(P#Q2 ;T#s(^;S#X; ; 1T#Y1491 1@U4S>4945@%S#XPTUXPY@Y:Z@"@@Fk/k*i/i$ 4 S T:T5U   4   r%