^h7"|SrSSKrSSKrSSKJr SSKJrJrJrJr SSK J r SSK J r "SS5r "S S 5rg) zA Class to handle llm wildcard routing and regex pattern matching N)Match)DictListOptionalTuple)get_llm_provider)verbose_router_loggerc |\rSrSr\S\S\\\44Sj5r\S\ \\ \ 4S\ \\\ \ 44Sj5r Sr g) PatternUtilspatternreturncP^/SQn[T5[U4SjU554nU$)z Calculate pattern specificity based on length and complexity. Args: pattern: Regex pattern to analyze Returns: Tuple of (length, complexity) for sorting ) *+?\^$|()c3F># UHnTRU5v M g7fN)count).0charr s h/home/james-whalen/.local/lib/python3.13/site-packages/litellm/router_utils/pattern_match_deployments.py =PatternUtils.calculate_pattern_specificity..s!0@ d##0@s!)lensum)r complexity_charsret_vals` rcalculate_pattern_specificity*PatternUtils.calculate_pattern_specificitys6J L 0@   patternsc6[UR5SSS9$)zl Cached property for patterns sorted by specificity. Returns: Sorted list of pattern-deployment tuples c2[RUS5$)Nr)r r%)xs r.PatternUtils.sorted_patterns../s,DDQqTJr'T)keyreverse)sorteditemsr(s rsorted_patternsPatternUtils.sorted_patterns#s! NN J  r'N) __name__ __module__ __qualname____firstlineno__ staticmethodstrrintr%rrr3__static_attributes__r5r'rr r smsuS#X&  sDJ'  eCdO$ %    r'r c \rSrSrSrSrS\S\4SjrS\S\4Sjr S \ S \ \S\ \4S jr SS \ \S\ \ \S\ \ \4Sjjr\S \ S\S\4Sj5rSS\S\ \S\ \ \4SjjrSS\S\ \S\ \4SjjrSrg )PatternMatchRouter4z Class to handle llm wildcard routing and regex pattern matching doc: https://docs.litellm.ai/docs/proxy/configs#provider-specific-wildcard-routing This class will store a mapping for regex pattern: List[Deployments] c0Ulgrr2)selfs r__init__PatternMatchRouter.__init__=s )+ r'r llm_deploymentcURU5nX0R;a/URU'URURU5 g)z Add a regex pattern and the corresponding llm deployments to the patterns Args: pattern: str llm_deployment: str or List[str] N)_pattern_to_regexr(append)rBr rEregexs r add_patternPatternMatchRouter.add_pattern@sC&&w/  %#%DMM%  e##N3r'rcN[R"U5RSS5$)z Convert a wildcard pattern to a regex pattern example: pattern: openai/* regex: openai/.* pattern: openai/fo::*::static::* regex: openai/fo::.*::static::.* Args: pattern: str Returns: str: regex pattern z\*z(.*))reescapereplace)rBr s rrG$PatternMatchRouter._pattern_to_regexNs ,yy!))%88r'matched_pattern deploymentsc/nUHJn[R"U5n[RUUSSS9USS'UR U5 ML U$)Nlitellm_paramsmodel)rQ litellm_deployment_litellm_model)copydeepcopyr?set_deployment_model_namerH)rBrQrRnew_deployments deploymentnew_deployments r#_return_pattern_matched_deployments6PatternMatchRouter._return_pattern_matched_deploymentsfsp%J!]]:6N"<<$35?@P5Q6= + ,W 5  " "> 2&r'Nrequestfiltered_model_namescUcg[RUR5nUb!UVs/sHo@RU5PM snO/nUH=upgUbXe;aM[R "Xa5nU(dM.UR XS9s $ gs snf![a,n [R"S[U 535 Sn A gSn A ff=f)a Route a requested model to the corresponding llm deployments based on the regex pattern loop through all the patterns and find the matching pattern if a pattern is found, return the corresponding llm deployments if no pattern is found, return None Args: request: Optional[str] filtered_model_names: Optional[List[str]] - if provided, only return deployments that match the filtered_model_names Returns: Optional[List[Deployment]]: llm deployments N)rQrRz#Error in PatternMatchRouter.route: ) r r3r(rGrMmatchr] Exceptionr debugr;) rBr_r`r3mregex_filtered_model_namesr llm_deployments pattern_matches rroutePatternMatchRouter.routexs  X*::4==IO(35II4Hq''*4HI ' -<((4A " :  =CC(5D-<%J X ! ' '*McRSfX(V W W Xs9B&BB1B;B BB C "CC rVcSU;aU$URS5nUR5n[U5U:a UR$UHnUR SUS5nM U$)aV Set the model name for the matched pattern llm deployment E.g.: Case 1: model_name: llmengine/* (can be any regex pattern or wildcard pattern) litellm_params: model: openai/* if model_name = "llmengine/foo" -> model = "openai/foo" Case 2: model_name: llmengine/fo::*::static::* litellm_params: model: openai/fo::*::static::* if model_name = "llmengine/foo::bar::static::baz" -> model = "openai/foo::bar::static::baz" Case 3: model_name: *meta.llama3* litellm_params: model: bedrock/meta.llama3* if model_name = "hello-world-meta.llama3-70b" -> model = "bedrock/meta.llama3-70b" r)rgroupsr!stringrO)rQrVwildcard_countdynamic_segmentssegments rrY,PatternMatchRouter.set_deployment_model_names}B 6 63 39??D+113  > 1&& (G/O/W/WWa0 ,( 0/r'rUcustom_llm_providercUc[US9unnnnURU5=(d URUSU35$![a N:f=f)z Check if a pattern exists for the given model and custom llm provider Args: model: str custom_llm_provider: Optional[str] Returns: bool: True if pattern exists, False otherwise )rU/)rrcrj)rBrUrt_s r get_patternPatternMatchRouter.get_patternsj  &  %51 ' zz% PDJJ2E1Faw/O$PP  sA A Ac:URX5nU(aU$/$)z Get the deployments by pattern Args: model: str custom_llm_provider: Optional[str] Returns: List[Dict]: llm deployments matching the pattern )rx)rBrUrtrhs rget_deployments_by_pattern-PatternMatchRouter.get_deployments_by_patterns"((D   r'r2r)r6r7r8r9__doc__rCr;rrJrGrrr]rrjr:rYrxr{r=r5r'rr?r?4s', 43 4 49990$37: d&SW(}(rs8 ..$2# # LMMr'