oi`!SSKrSSKJrJrJr SSKrSSKJr SSKJs J r SSK J r SSK JrJr "SS\5r"SS\R"\5rg) N)AnyOptionalUnion)Conv1D)BaseTunerLayercheck_adapters_to_mergec\rSrSrSrSrS\RSS4SjrS S\ 4S jjr \ R"5S 5r S\ R4S jrS rg)FourierFTLayer)fourierft_spectrum)fourierft_n_frequencyfourierft_scalingfourierft_random_loc_seed base_layerreturnNc LXl0Ul0Ul[R"05Ul0Ul0UlSUl/Ul X l UR5n[U[R5(a$URURsUlUlg[U[ 5(aU[#UR$S5(aUR$R&OUR$R(uUlUlg[+S[-U535e)NFds_shapezUnsupported layer type )rr rnn ParameterDictr indicesr_disable_adaptersmerged_adapterskwargsget_base_layer isinstanceLinear in_features out_featuresrhasattrweightrshape ValueErrortype)selfrrs U/home/james-whalen/.local/lib/python3.13/site-packages/peft/tuners/fourierft/layer.py__init__FourierFTLayer.__init__ s$%'"!#"$"2"22"6 )+&!&! ((* j")) , ,2<2H2H*JaJa /D d/  F + +.5j6G6G.T.T !!**ZdZkZkZqZq 0D d/6tJ7G6HIJ Jinference_modec US::a[SU35eX RUR-:a([SUSURUR-35eX RU'XPRU'[ R "URUR-[ R"5RURU5S9SUURU'[ R"URUUR-URUUR-/SS9URU'X0RU'[R"[ R"U5SS9URU'U(aUR!U5 UR#U5 UR%UR&US 9 g) NrzI`n_frequency` should be a positive integer value but the value passed is zu`n_frequency` should be less than or equal to the product of the input and output dimensions but the value passed is z and the product is ) generator)dimT) requires_grad)r))r"rrr rtorchrandperm Generator manual_seedrstackrr Parameterrandnr reset_fourier_parameters%_move_adapter_to_device_of_base_layer set_adapteractive_adapters)r$ adapter_name n_frequencyscaling init_weightsrandom_loc_seedr)rs r% update_layerFourierFTLayer.update_layer6s ! hithuvw w ))D,=,== =++6-7KDL\L\_c_p_pLpKqs 4?""<07F&&|4%*^^    0 0 0oo'33D4R4RS_4`a&  ;& \"&+[[ \\, '4+;+; ;T\\,=WZ^ZjZj=j kqr&  \"07|,02 U[[=Uei0j -   ) ), 7 22<@ --nMr(cXRR5;a-[RR URU5 ggN)r keysrinitzeros_)r$r9s r%r5'FourierFTLayer.reset_fourier_parametersSs7 22779 9 GGNN422<@ A :r(cURUnURURUR5n[R "UR URURS9nUR5XCSSS24USSS244'[RRU5RURU-nURUR5$)N)devicer)r rtorGr.zerosrrfloatfftifft2realrdtype)r$adapterspectrumrdense_spectrum delta_weights r%get_delta_weightFourierFTLayer.get_delta_weightXs**73,,w'**8??;T%6%68H8HQYQ`Q`a7?~~7Gq!t}gadm34yy~6;;d>T>TU\>]] x~~..r() rrr rrr rrrrr)F)__name__ __module__ __qualname____firstlineno__adapter_layer_namesother_param_namesrModuler&boolr>r.no_gradr5TensorrT__static_attributes__r(r%r r sj1cK299K4K.inNaeN: ]]_BB/5<</r(r c^\rSrSrSS\S\S\S\S\\\4S\SS 4U4S jjjr SS \S \ \ \SS 4S jjr SSjr S\R4U4SjjrS\RS\S\S\R4SjrS\4U4SjjrSrU=r$)FourierFTLinearbr9r:r;fan_in_fan_outr<r=rNc >[T U]5 [R"X40UD6 XPlX lUR X#XFU5 grA)superr&r re_active_adapterr>) r$rr9r:r;rer<r=r __class__s r%r&FourierFTLinear.__init__dsA ;F;,+ ,WO\r( safe_merge adapter_namesc>[X5nU(dgUGHnX0RR5;dM#UR5nU(aURR R 5nXPRU5- n[R"U5R5(d[SUS35eXTRlO.UR=R URU5- slURRU5 GM g)a Merge the active adapter weights into the base weights Args: safe_merge (`bool`, *optional*): If True, the merge operation will be performed in a copy of the original weights and check for NaNs before merging the weights. This is useful if you want to check if the merge operation will produce NaNs. Defaults to `False`. adapter_names (`List[str]`, *optional*): The list of adapter names that should be merged. If None, all active adapters will be merged. Defaults to `None`. Nz1NaNs detected in the merged weights. The adapter z seems to be broken)rr rBrr dataclonerTr.isfiniteallr"rappend)r$rkrlactive_adapterr orig_weightss r%mergeFourierFTLinear.mergeus0D  +N!8!8!=!=!??!002 $.#4#4#9#9#?#?#AL $9$9.$IIL >>,7;;==(OP^O__rs.:%%*%%**d.C.CN.SS*$$++N;#,r(cUR(d[R"S5 g[UR5S:aURR 5nXR R5;a<UR5R=RURU5-sl [UR5S:aMgg)zG This method unmerges all merged adapter layers from the base weights. z Already unmerged. Nothing to do.Nr) mergedwarningswarnlenrpopr rBrr rnrT)r$rss r%unmergeFourierFTLinear.unmerges{{ MM< = $&&'!+!11557N!8!8!=!=!??##%,,11T5J5J>5ZZ1$&&'!+r(c">[TU]U5$rA)rgrT)r$rPris r%rT FourierFTLinear.get_delta_weightsw'00r(xargsrc<URnUR(a8UR(aUR5 UR"U/UQ70UD6nOUR(aUR"U/UQ70UD6nOUR"U/UQ70UD6nUR HgnX`R R5;aM"URU5nURUR5nU[R"X5-nMi URU5nU$rA) rOdisable_adaptersrxr}rr8r rBrTrIFlinear)r$rrrprevious_dtyperesultrsdelta_ws r%forwardFourierFTLinear.forwards  {{ __Q888F [[__Q888F__Q888F"&"6"6!)@)@)E)E)GG//?DD'!((1"66 #7>* r(c*>[TU]5nSU-$)Nz fourierft.)rg__repr__)r$repris r%rFourierFTLinear.__repr__sg c!!r()rhre)igb@FFi )FN)rN)rVrWrXrYstrintrKr]rr&rlistrur}r.r_rTrrrr` __classcell__)ris@r%rcrcbs  $)."]] ]  ]  ]D#I&]] ]]"#<#rsE'' -LE/^E/P_"bii_"r(