+h SSKrSSKrSSKJr SSKJr SSKJrJrJ r J r J r SSK r SSK Jr SSKJrJr \"5(a SSKJrJr SS KJr SS KJr SS KJr SS KJr \R:"\5r"S S\5r "SS5r!SS\"S\ RFRHS\ \"\%\ RL4S\ S4Sjjr'"SS5r(S\\"\4S\\"\44Sjr)"SS5r*g)N) OrderedDict) combinations)AnyDictListOptionalUnion) ModelHook)is_accelerate_availablelogging)add_hook_to_moduleremove_hook_from_module) PartialState)send_to_device)clear_device_cache)convert_file_size_to_intc\rSrSrSrSrSS\\\\ \ R4S\\ SS\S 4S jjr SS jrSS jrS rSrSrg)CustomOffloadHook(a A hook that offloads a model on the CPU until its forward pass is called. It ensures the model and its inputs are on the given device. Optionally offloads other models to the CPU before the forward pass is called. Args: execution_device(`str`, `int` or `torch.device`, *optional*): The device on which the model should be executed. Will default to the MPS device if it's available, then GPU 0 if there is a GPU, and finally to the CPU. FNexecution_device other_hooksUserCustomOffloadHookoffload_strategyAutoOffloadStrategycfUbUO[5RUlX lX0lSUlgN)rdefault_devicerrrmodel_id)selfrrrs h/home/james-whalen/.local/lib/python3.13/site-packages/diffusers/modular_pipelines/components_manager.py__init__CustomOffloadHook.__init__5s2 5E4P 0VbVdVsVs& 0 cXlgrr)r rs r! set_strategyCustomOffloadHook.set_strategy@s 0r$cbURc/UlURRU5 g)z= Add a hook to the list of hooks to consider for offloading. N)rappendr hooks r!add_other_hook CustomOffloadHook.add_other_hookCs,    #!D  %r$c$URS5$)Ncpu)to)r modules r! init_hookCustomOffloadHook.init_hookKsyyr$c DURUR:wGaWURGb.URVs/sH*oDRRUR:XdM(UPM, nn[R "5nUR b&UR UURUURS9n[R "5n[RSURSXv- SS35 UHPn[RSURSURSURS 35 UR5 MR U(a [5 URUR5 [X R5[X0R54$s snf) N)hooksrmodelrz* time taken to apply offload strategy for : .2fz secondszmoving z to z , offloading z to cpu)devicerrr7time perf_counterrrloggerinfooffloadrr1r)r r2argskwargsr,hooks_to_offload start_timeend_times r! pre_forwardCustomOffloadHook.pre_forwardNsg ==D11 1+595E5E#t5ETIZIZ^b^s^sIsD5E #t!..0 ((4'+'<'<.!%$)-)>)> (=($  ,,. @rS[ShjmQnnvw-DKK!$--T5J5J4K=Y]YfYfXggnoLLN - $&( IId++ ,d$9$9:N6ShSh bD%x4PI  r$c(\rSrSrSrSSjrSrSrg)rz Offload strategy that should be used with `CustomOffloadHook` to automatically offload models to the CPU based on the available memory on the device. c$[U5Ulgr)rmemory_reserve_margin)r ris r!r"AutoOffloadStrategy.__init__s%=>S%T"r$c `[U5S:Xa/$UR5n[RR UR 5SnX`R - nXV:a/$XV- n[RSUS- SS35 [[UVs0sH'oRURR5_M) snR5SSS95n S n U "X5n U c[RS 5 Un U $UVs/sHoRU ;dMUPM n nU $s snfs snf) Nrz2 search for models to offload in order to free up @r9z GB memoryc US$)NrR)xs r!.AutoOffloadStrategy.__call__..sadr$T)keyreversec ^[TR55nSn[S5n[S[ U5S-5H?n[ X%5H-n[ U4SjU55nXq:aMUbXt:dM)UnUnM/ MA U$)z search the optimal combination of models to offload to cpu, given a dictionary of module sizes and a minimum memory offload size. the combination of models should add up to the smallest modulesize that is larger than `min_memory_offload` Ninfrnc3.># UH nTUv M g7frrR).0candidate_model_id module_sizess r! NAutoOffloadStrategy.__call__..search_best_candidate..s)Sf=O %78Sf)listkeysfloatrangelenrsum)rymin_memory_offload model_idsbest_candidate best_sizercandidate_model_idscandidate_sizes` r!search_best_candidate;AutoOffloadStrategy.__call__..search_best_candidates \..01I!Ne I1c)nq01+7 +E'%()Sf)&N&: )1^5O-@N(6I,F2" !r$zJno combination of models to offload to cpu is found, offloading all models)rget_memory_footprintrPcuda mem_get_infoindexrir=r>dictsortedrr7itemswarning) r r6rr7rcurrent_module_size mem_on_devicerr,ryrbest_offload_model_idsrBs r!__call__AutoOffloadStrategy.__call__s6 u:?I#88: //0@0F0FGJ %(B(BB  .I0@ HI[^eIefiHjjtuv NSTed ? ? AAeTZZ\"   "."7|!X ! ) NNg h$  27b--Ka:a bOUJ cs.D& D+D+riN)3GB)rHrIrJrKrLr"rrQrRr$r!rrsU8 r$dreturnc0nUR5HCup#[U[5(a [U5OUnXA;a/X'XR U5 ME S[ [ S[ 4Sjn0nUR5HFupGU"U5nU(a-[XS[5(a [U5OUnX6U'MAWUS'MH U$)aSummarizes a dictionary by finding common prefixes that share the same value. For a dictionary with dot-separated keys like: { 'down_blocks.1.attentions.1.transformer_blocks.0.attn2.processor': [0.6], 'down_blocks.1.attentions.1.transformer_blocks.1.attn2.processor': [0.6], 'up_blocks.1.attentions.0.transformer_blocks.0.attn2.processor': [0.3], } Returns a dictionary where keys are the shortest common prefixes and values are their shared values: { 'down_blocks': [0.6], 'up_blocks': [0.3] } r~rc U(dg[U5S:XaUS$UVs/sHoRS5PM nnSn[U6H"n[[U55S:XaUS- nM" O US:XagSR USSU5$s snf)zCFind the shortest common prefix among a list of dot-separated keys.rnr.N)rsplitzipsetjoin)r~k key_parts common_lengthpartss r!find_common_prefix=summarize_dict_by_value_and_parts..find_common_prefixs t9>7N,004aWWS\4 0 )_E3u:!#"  % A xx ! ^m4551sB rr)r isinstancer}tupler*rrN) r value_to_keysrrvalue value_tuplersummaryr~prefixs r!!summarize_dict_by_value_and_partsrsMggi &0&=&=eEl5  +)+M &"))#.  6c6s62G*002 #D) )3A1gJ)E)ED%;E#FOGBK3 Nr$c *\rSrSrSr/SQrSrS!S\\S\\S\\S \\ 4S jjr \ S \4S j5r S"S\S \ S\\4SjjrS \S\4SjrS"S \4SjjrS#S\\S\\S\\S\4SjjrS$S\\\\R,44SjjrSrS"S \S\\\\\4S\\\\ 44SjjrSrS!S \\S\\S\\S\\S\ 4 SjjrS%S\\\\4S\\4SjjrS&S\\S\\4SjjrS"S\\S\\4Sjjr S r!g)'ComponentsManageriai A central registry and management system for model components across multiple pipelines. [`ComponentsManager`] provides a unified way to register, track, and reuse model components (like UNet, VAE, text encoders, etc.) across different modular pipelines. It includes features for duplicate detection, memory management, and component organization. This is an experimental feature and is likely to change in the future. Example: ```python from diffusers import ComponentsManager # Create a components manager cm = ComponentsManager() # Add components cm.add("unet", unet_model, collection="sdxl") cm.add("vae", vae_model, collection="sdxl") # Enable auto offloading cm.enable_auto_cpu_offload(device="cuda") # Retrieve components unet = cm.get_one(name="unet", collection="sdxl") ``` ) r added_time collection class_namesize_gbadaptershas_hookr ip_adaptercz[5Ul[5Ul[5UlSUlSUlg)NF)r componentsr collections model_hooks_auto_offload_enabledrYs r!r"ComponentsManager.__init__Cs.%-%-&=%*"r$Nnamerload_idrcUc URnU(aM[5nUR5H.upgURU5nX:XdMUR U5 M0 O[UR 55nU(aI[5n UR5H*upgX`R U;dMU R U5 M, O[UR 55n U(aZ[5n UR5H;up[US5(dMURU:XdM*U R U5 M= O[UR 55n URU 5RU 5n U $)zy Lookup component_ids by name, collection, or load_id. Does not support pattern matching. Returns a set of component_ids _diffusers_load_id) rrr _id_to_nameaddr~rhasattrr intersection) r rrrr ids_by_name component_id component comp_nameids_by_collectionids_by_load_ididss r! _lookup_idsComponentsManager._lookup_idsKs9  J %K+5+;+;+='  ,,\: $OOL1,> joo/0K  # +5+;+;+=' #3#3J#??%)),7,>!$JOO$5 6   UN#-#3#3#59&:;; @\@\`g@g"&&t,$6!!23N&&'89FF~V r$rcHSRURS5SS5$)N_)rr)rs r!rComponentsManager._id_to_namess#xx **3/455r$rc US[U53nSnURR5HcupgXr:XdM URU5nX:Xa"[R SUSUS35 UnSn O#[R SUSUS US 35 Me [ US 5(aURS :wasURURS 9n U V s/sH oU:wdM U PM n n U (a:SRU 5n [R SUSURSU S35 X RU'[R"5URU'U(aX0R;a[5URU'X@RU;aURXS9n U H2n[R SUSUSU35 URXc5 M4 URURU5 [R!SUSUSU35 O[R!SUSUS35 UR"(a"U(aUR%UR&5 U$s sn f)a{ Add a component to the ComponentsManager. Args: name (str): The name of the component component (Any): The component to add collection (Optional[str]): The collection to add the component to Returns: str: The unique component ID, which is generated as "{name}_{id(component)}" where id(component) is Python's built-in unique identifier for the object rTzComponentsManager: component 'z' already exists as ''Fz%ComponentsManager: adding component 'z' as 'z', but it is duplicate of 'zK'To remove a duplicate, call `components_manager.remove('')`.rnull)r, z!', but it has duplicate load_id 'z' with existing components: zL. To remove a duplicate, call `components_manager.remove('')`.rrz%ComponentsManager: removing existing z from collection '': z$ComponentsManager: added component 'z' in collection ')idrrrr=rrrrrr;rrrremove_from_collectionrr>renable_auto_cpu_offload_auto_offload_device) r rrrris_new_componentcomp_idcomprcomponents_with_same_load_idrexistingcomp_ids_in_collections r!rComponentsManager.addwsqI0 "__224MG  ,,W5 $NN%CD6I^_f^ggh#ij#*L',$NN?vVL>Ytu|t}~ef5 92 3 3 8T8TX^8^+/+;+;ID`D`+;+a (9U+l9U2_kYkB9U (+l+99%AB;L>IjktlHlHkIIefneooab )2 %(,  % !1!11/2u  ,#3#3J#??)-)9)9t)9)[&5GNN?vEWXbWccfgnfop//D 6  ,00> :4&@QR\Q]]`am`no KK>tfF<.XYZ [  % %*:  ( ()B)B CG,ms  I,I,cX R;a[RSUS35 gXRU;a[RSUSUS35 gURURU5 URR 5VVs/sHup4X;dM UPM nnnU(d+[RSUS35 URU5 ggs snnf) z' Remove a component from a collection. z Collection ' ' not found in ComponentsManagerN Component 'z' not found in collection 'rz'ComponentsManager: removing component 'z' from ComponentsManager)rr=rr_r)r rrcollcomps comp_collss r!r(ComponentsManager.remove_from_collections -- - NN\*5UV W  // ; ; NN[6QR\Q]]^_ `  $++L9.2.>.>.D.D.F`.F{t,J_d.F ` NND\NRjk l KK %as  C#CcXR;a[RSUS35 gURRU5nURRU5 UR H5nXR U;dMUR UR U5 M7 UR(aURUR5 g[U[RR5(aURS5 ASSKnUR!5 [R"R%5(a[R"R'5 gg)zq Remove a component from the ComponentsManager. Args: component_id (str): The ID of the component to remove rrNr0r)rr=rpoprrr_rrrrrPnnModuler1gccollectr is_available empty_cache)r rrrrs r!r_ComponentsManager.removes  . NN[6VW X OO'' 5  L)**J// ;;  ,33LA+  % %  ( ()B)B C)UXX__55 U#  JJLzz&&(( &&()r$namesreturn_dict_with_namesc  ^^^ ^^^TRX#S9nUVs0sHofTRU_M nnU4SjnTcU"Xt5$[T[5(d[ S[ T5S35eUR 5V s0sHoTRU 5_M sn mS"U4SjjmTRS5n U (aTSSmS T;aTRS 5n 0n UR5HJum n [S U 55m[U UU4S jU 55nU (aU(+nU(dMFXT 'ML U (aS OS nT(aSOSn[RSUUSU S[U R 5535 GO=[U4SjTR!555(aUR5V V s0sHupTU T:HU :wdMX_M n n n U (a4[RSTS[U R 5535 GO[RSTS[U R 5535 GOtTR#S5(aTSSnUR5V V s0sH!upTU RU5U :wdMX_M# n n n U (a4[RSUS[U R 5535 GO[RSUS[U R 5535 GOTRS5(aTR#S5(aTSSOTSSnUR5V V s0sHupUTU ;U :wdMX_M n n n U (a4[RSUS[U R 5535 GO [RSUS[U R 5535 O[U4SjTR!555(aUR5V V s0sHupTTU ;U :wdMX_M n n n U (a3[RSTS[U R 5535 OB[RSTS[U R 5535 O[ STS35eU (d[ S TS!35eU"X5$s snfs sn fs sn n fs sn n fs sn n fs sn n f)#a Search components by name with simple pattern matching. Optionally filter by collection or load_id. Args: names: Component name(s) or pattern(s) Patterns: - "unet" : match any component with base name "unet" (e.g., unet_123abc) - "!unet" : everything except components with base name "unet" - "unet*" : anything with base name starting with "unet" - "!unet*" : anything with base name NOT starting with "unet" - "*unet*" : anything with base name containing "unet" - "!*unet*" : anything with base name NOT containing "unet" - "refiner|vae|unet" : anything with base name exactly matching "refiner", "vae", or "unet" - "!refiner|vae|unet" : anything with base name NOT exactly matching "refiner", "vae", or "unet" - "unet*|vae*" : anything with base name starting with "unet" OR starting with "vae" collection: Optional collection to filter by load_id: Optional load_id to filter by return_dict_with_names: If True, returns a dictionary with component names as keys, throw an error if multiple components with the same name are found If False, returns a dictionary with component IDs as keys Returns: Dictionary mapping component names to components if return_dict_with_names=True, or a dictionary mapping component IDs to components if return_dict_with_names=False )rrc>U(aF0nUR5H.up4TRU5nXR;a[SUS35eXBU'M0 U$U$)a Create a dictionary mapping component names to components if return_dict_with_names=True, or a dictionary mapping component IDs to components if return_dict_with_names=False, throw an error if duplicate component names are found when return_dict_with_names=True 7Duplicate component names found in the search results: ], please set `return_dict_with_names=False` to return a dictionary with component IDs as keys)rr ValueError)rrdict_to_returnrrrr s r!get_return_dict.get_return_dictss &!#%/%5%5%7MG $ 0 0 9I 2(UV_U`a~159- &8&%!!r$NzInvalid type for `names: z, only support stringc>TUnU(aX:H$URS5(aUSSnURU5$URS5(a$URS5(aUSSOUSSnXS;$X:H$)z Helper function to check if a component matches a pattern based on its base name. Args: component_id: The component ID to check pattern: The pattern to match against exact_match: If True, only exact matches to base_name are considered *Nrrn)endswith startswith)rpattern exact_match base_namersearch base_namess r!matches_pattern.matches_pattern4s#<0I++!!#&& " ++F33##C((*1*:*:3*?*?2WQR[**++r$!rn|c3|# UH2oRS5=(d URS5(+v M4 g7f)rN)rr)rwterms r!rz6ComponentsManager.search_components..]s.!e_dW[s';'Qt}}S?Q"R"R_ds:<c38># UHnT"TUT5v M g7frrR)rwrrrr s r!rzr`s $c]bUY_WdK%P%P]bszNOT rzexactly matchingzmatching any of patternszGetting components  r8c3.># UH nTU:Hv M g7frrRrwrrs r!rzrnI5H )#5Hr|z4Getting all components except those with base name 'rz#Getting components with base name 'rrz&Getting components NOT starting with 'z"Getting components starting with 'z#Getting components NOT containing 'zGetting components containing 'c3.># UH nTU;v M g7frrRrs r!rzrrr|zComponent or pattern 'rz&No components found matching pattern 'r)F)rrrrNrtyper~rrrrallanyr=r>r}valuesr)r rrrr selected_idsrrrris_not_patterntermsmatchesrshould_includelog_msg match_typerr r rr s`` ` @@@r!search_components#ComponentsManager.search_componentssF'':'O 5AB\++\ B "( =":F FE3''8e EZ[\ \ISHYZHYWt//88HYZ  ,<))#. !"IE %<KK$EG!+!1!1!3 !!e_d!ee "%$c]b$c!c")7%7N!>'+G$"4!/fBG/:+@ZJ KK-gYzl!E7"TRYR^R^R`MaLbc dIZ5F5F5HI I I&0%5%5%7%7MGw'50^C %7   RSXRYY\]abibnbnbp]q\rst A%DQXQ]Q]Q_L`Kabc^^C 3BZF&0%5%5%7%7MGg&11&9^K %7   DVHCPTU\UaUaUcPdOefg @DQXQ]Q]Q_L`Kabc  c " "$)NN3$7$7U1R[U12YF&0%5%5%7%7MGj11nD %7   A&TRYR^R^R`MaLbcd =fXSgllnI]H^_`IZ5F5F5HI I I&0%5%5%7%7MGZ00^C %7   A%DQXQ]Q]Q_L`Kabc =eWCW\\^H\G]^_5eW<\]^ ^EeWANO Ow??iC<[~s;S)S. S3S3S9'S9(S?>S?0TTr:c[5(d [S5eURR5HMup4[ U[ R R5(dM0[US5(dMC[USS9 MO UR5 [US9n[ R"U5nURc%[ R"URSS35n/nURR5HKup4[ U[ R R5(dM0[X4XS 9nUR!U5 MM UHenUVs/sH oULdM UPM n nU HDn U R"R$UR"R$:XdM3UR'U 5 MF Mg X`lSUlXlgs snf) a} Enable automatic CPU offloading for all components. The algorithm works as follows: 1. All models start on CPU by default 2. When a model's forward pass is called, it's moved to the execution device 3. If there's insufficient memory, other models on the device are moved back to CPU 4. The system tries to offload the smallest combination of models that frees enough memory 5. Models stay on the execution device until another model needs memory and forces them off Args: device (Union[str, int, torch.device]): The execution device where models are moved for forward passes memory_reserve_margin (str): The memory reserve margin to use, default is 3GB. This is the amount of memory to keep free on the device to avoid running out of memory during model execution (e.g., for intermediate activations, gradients, etc.) z7Make sure to install accelerate to use auto_cpu_offload_hf_hookT)recurserN:rr&)r ImportErrorrrrrPrrrrdisable_auto_cpu_offloadrr:rrrer*r,rr-rrr) r r:rirrr all_hooksr,hr other_hooks r!r)ComponentsManager.enable_auto_cpu_offloadsm"'((WX X#446OD)UXX__55')Z:X:X' 4@ 7 %%'.EZ[f% << \\V[[M1#"67F #446OD)UXX__55/k  & 7 D&/AiD=1iKA) ??33tyy7Q7QQ'' 3* %%)"$*!Bs G'GcURcSUlgURH#nUR5 UR5 M% UR(a [ 5 SUlSUlg)z6 Disable automatic CPU offloading for all components. NF)rrr?r_rr+s r!r**ComponentsManager.disable_auto_cpu_offloads^    #).D & $$D LLN KKM%     %*"r$fieldsrc XR;a[SUS35eURUnUb?[U[5(aU/nUH!nX@R;dM[SUS35e UUR USR URR5VVs/sHupVX;dM UPM snn5=(d SS.n[U[RR5(Ga[US5nSn U(a1[URS 5(aURRn URUR R"UR%5S - SUU S .5 [US 5(a&['UR(R+55US '[US5(a[US5(a[,R."UR05n U R35V s/sHoR R"PM n n [5SU 55(arU R5V V s0sH@up[U S5(dMSU R R";dM4XR6_MB nn n U(a[9U5US'Ub,UR5V V s0sHupX;dM X_M sn n $U$s snnfs sn fs sn n fs sn n f)aGet comprehensive information about a component. Args: component_id (str): Name of the component to get info for fields (Optional[Union[str, List[str]]]): Field(s) to return. Can be a string for single field or list of fields. If None, uses the available_info_fields setting. Returns: Dictionary containing requested component metadata. If fields is specified, returns only those fields. Otherwise, returns all fields. rrNzField 'z$' not found in available_info_fieldsr)rrrr&rrl)rrrrr peft_configr_load_ip_adapter_weightsattn_processorsc3,# UH nSU;v M g7f) IPAdapterNrR)rwptypes r!rz3ComponentsManager.get_model_info..(sI{e+sscaler7r)rrrrN_available_info_fieldsrrrrrPrrrr&rupdate __class__rHrr}r3r~copydeepcopyr5rrr:r)r rr1rfieldrrr>rr processorsvprocessor_typesrscaless r!get_model_info ComponentsManager.get_model_infos"  .{<.8XYZ ZOOL1   &#&&  ; ;;$wug5Y%Z[[ %//,7))T=M=M=S=S=U$o=UkdYeYnT=U$op   i 1 1y*5H# GI$6$68JKK#,#5#5#F#F KK"+"5"5">">(==?7K $ ((8  y-00#' (=(=(B(B(D#EZ y"<==')UfBgBg!]]9+D+DE AKARARAT"UATA;;#7#7AT"UIIII%/$4$4$6$6DA"1g.#3>!++BVBV3V#77 $6 -Nv-V\*  %)ZZ\A\TQQ[DAD\A AK[%p<#VBs0' K!6K!K'K,,K,K, K2K2c  UR(dgSnSnURR5Vs/sHIn[U[RR 5(dM.[ US5(dMAU"U5PMK nnU(a2[S/UVs/sHn[[U55PM sn-5OSn0nURR5HTn/Xx'URR5HupX;dM XxRU 5 M! Xx(aMOS/Xx'MV UR5V V s/sH oHoPM M n n n U (a[S[SU 555OSn [S[S URR5555[S [S URR5555S SSUU S .nS[UR55[U5S--S- -S-nS[UR55[U5S--S- -S-nSU-nURR5VVs0sH4unn[U[RR 5(dM1UU_M6 nnnURR5VVs0sH4unn[U[RR 5(aM1UU_M6 nnnU(GaUSU-- nUSSUS3SSSUS3S3- nUSSUS3SSSUS3S3- nUSSUS 3SS!SUS"3S#3- nUU- nUR5GH*upURU5nU"UU5n[ US5(a[UR 5OSnU"U5nXx(aXxS$OSnUUSUS3SUS%SUS3S3- nUUSUS3SUSUS3S3- nUUS&SUS S'3SUSUS"3SUS3- n[#S[Xx55HXnXxUnUS(SUS3SS(SUS3S3- nUS(SUS3SS(SUS3S3- nUS(SUS 3SS(SUS"3SUS3- nMZ GM- UU- nU(aU(aUS- nUS)U-- nUS*SUS3SSSUS3S#3- nUU- nUR5HupURU5nXx(aXxS$OSnUUSUS3SUR$R&SUS3SUS3- n[#S[Xx55H&nXxUnUS(SUS3SS(SUS3SUS3- nM( M UU- nUS+- nURHnURU5nUcMUR)S,5cUR)S-5(dMCUSUS.3- nUR)S,5b US/US,S3- nUR)S-5(dMUS0- nM U$s snfs snfs sn n fs snnfs snnf)1NzComponents: ================================================== No components registered. ==================================================c>[US5(a UR$g)NrN/A)rr)rs r! get_load_id/ComponentsManager.__repr__..get_load_id?sy"677 333r$cUS(d[[USS55$[[USS55n[US=(d S5nUSUS3$)Nrr:rIr())rNgetattr)rr>r: exec_devices r! format_device1ComponentsManager.__repr__..format_deviceEsY #79h>??WY%@A!$'9":"CeD  ;-q11r$rrI c3J# UHn[[U55v M g7fr)rrN)rwcs r!rz-ComponentsManager.__repr__..as(NoSVos!#c38# UHn[U5v M g7fr)r)rwrs r!rzrWdsK4JDc$ii4Jsc3`# UH$n[URR5v M& g7fr)rr=rH)rwrs r!rzrWes& mTlyY%8%8%A%A!B!BTls,.)rclassr:dtypesizerr=rn -z Components: zModels: Name_ID device_strr]rfirst_collectionirs r!__repr__ComponentsManager.__repr__9sZ   2"__335 5 )UXX__5 #:A)Ma:b #K "5  NV#rdx%Hxc#c(mx%HHI[]!#OO((*D*, ! '#//557 =)/66t< 8)../4g%+ +.C-I-I-K^-KEX]PT4X]4-K^SbSS(No(N%NOhjb#KDOO4H4H4JKKLS mTXTcTcTjTjTl mmn&, #j//12S_q5HH1LMPTT3z0023c*o6IIAMNQUU  8+$(??#8#8#:]#:41ajEHHOO>\$!Q$#:]#'??#8#8#:a#:41a*QPUPXPXP_P_B`$!Q$#:a  kI- -F 1Z%5$6"67s71ZPWEXDYBY:ZZ]^ ^F ,Qz(/C.D,DESQRS]^eSfRgPgHhhkl lF Qz&'9&:$:;3y:V_K`JaHa>bbqr rF i F$*<<>**40*9d; 07 70K0KIOO,QV%i0F[E`#8#>q#Afk T!Jt$4#5!56c$|:LQzZaObNcLc9ddghhZ*X*>)?'?@E!JW^L_K`I`CaadeeT)_Qz&/A.B#,EFc'RST^_hTiSjQjIkknooAACDDq#&;&A"BCA!6!U;VVYZZFAj&:%;#; **40F[E`#8#>q#Afk T!Jt$4#5!56c):M:M:V:VWXYcdkYlXmVm9nnqsCrDDFGGq#&;&A"BCA!6!U;VVYZdYeeghhFD$2 i F DDOOD&&t,DTXXj%9%ER^I_I_BtfC.(88J'3 T*-=,>bAAF88L))77F$ [ &I_(^as5-X=&X=9 X=Y Y70Y +Y 0YYc UbUcUcUb [S5eUb-XR;a[SUS35eURU$URX#U5nU(d[SUS35e[U5S:a([SUS[ UR 5535e[ [UR555$) a  Get a single component by either: - searching name (pattern matching), collection, or load_id. - passing in a component_id Raises an error if multiple components match or none are found. Args: component_id (Optional[str]): Optional component ID to get name (Optional[str]): Component name or pattern collection (Optional[str]): Optional collection to filter by load_id (Optional[str]): Optional load_id to filter by Returns: A single component Raises: ValueError: If no components match or multiple components match zFIf searching by component_id, do not pass name, collection, or load_idrrzNo components found matching 'rrnz$Multiple components found matching 'r) rrr#rr}r~nextiterr)r rrrrresultss r!get_oneComponentsManager.get_ones4  #)9Z=SW^Wjef f  #??2 ;|n<\!]^^??<0 0((7C=dV1EF F w2xPS}$cHUYNB/T#Y/HSM//r$rr)+r>r;rr itertoolsrtypingrrrrr rPr6r utilsr r accelerate.hooksrraccelerate.stateraccelerate.utilsraccelerate.utils.memoryraccelerate.utils.modelingr get_loggerrHr=rrrNrrrOr:rerrrrRr$r!rs #"33  L-/:B   H %Aj AjH'':7;8<   88?? Cell23 45 C C P8c3h8DcN8vV /V /r$