C1iaSrSSKrSSKrSSKrSSKrSSKrSSKrSSKJrJ r J r SSK r SSK r SrSrSrSrS rS rS rS rS+S jrSr"SS\5r"SS5r"SS\\S9rSr"SS\\S9r"SS\5rSr "SS\5r!"SS\5r""S S!\5r#"S"S#\5r$S$r%"S%S&\RL5r'"S'S(\'5r("S)S*\'5r)g!\a SrNf=f),zSpecifications declare the expected variables layout of CTranslate2 models that do not load a computation graph. The model converter should make sure that each required variable of the specification is set. N)DictListOptionalTF __optional)int8 int8_float32 int8_float16 int8_bfloat16int16float16bfloat16float32)rotary_scaling_long_factorrotary_scaling_short_factorc&U(dU$U<SU<3$N/)scopenames V/home/james-whalen/.local/lib/python3.13/site-packages/ctranslate2/specs/model_spec.py _join_scoper)s  T ""c$URS5$r)splitrs r _split_scoper/s ;;s rcP[U5nUSSUSp SRU5U4$)Nr)rjoin)rkeysattrs r _parent_scoper$3s0  Ds)T"X4 88E?D  rc [URR55Hup4URS5(aM[ U[5(a.[ U5HupV[ Xa[USX54-5S9 M M`[ U[5(a[ XA[X#5S9 MU"U[X#5U5 M g)z Recursively visits a layer spec._%s_%drN) list__dict__items startswith isinstance enumerate visit_specr LayerSpec)specfnrrvalueielems rr.r.9sDMM//12  ??3    eT " "$U+4;ug >Q+RS, y ) ) u E(@ A t[-u 53rcU(dU$[U5nUHn[X5nM U$![a/ URSS5upA[X5[ U5nMMf=f)Nr&)rgetattrAttributeErrorrsplitint)r0indexr"keyr#s r index_specr=Gsj   D 34%D K 3**S!,KD4&s5z2D 3s ,5A%$A%c(^\rSrSrU4SjrSrU=r$) FrozenMetaTc6>[TU]"U0UD6nSUlU$)NT)super__call___frozen)selfargskwargsinstance __class__s rrCFrozenMeta.__call__Us$7#T4V4rr)__name__ __module__ __qualname____firstlineno__rC__static_attributes__ __classcell__rIs@rr?r?Ts rr?c(^\rSrSrU4SjrSrU=r$) FrozenAttr[c>[US5(a[X5(d[SU-5e[TU] X5 g)NrDzAttribute %s does not exist)hasattrr8rB __setattr__)rEr<r2rIs rrWFrozenAttr.__setattr__\s8 4 # #GD,>,> !>!DE E C'rr)rKrLrMrNrWrOrPrQs@rrSrS[s ((rrSc \rSrSrSrSSjrSS\S\S\\\ R44Sjjr S r S r SS \\SS4S jjrS rSrg)r/bzPA layer specification declares the weights that should be set by the converters.returnNc^/mU4SjnURU5 T(a[SSRT5-5eg)zwVerify that the required weights are set. Raises: ValueError: If a required weight is not set in the specification. c>UcTRU5 g[U[R5(a>UR[R :XaUR [R5nO[U[5(a&[R"S5RU5nO[U[5(a&[R"S5RU5nOQ[U[5(a<U[:wa2[R"URS5[RS9n[U[R5(d[U[R 5(a [#U5nO5[$(a*[U[&R(5(a [+U5n[-U5Sn[/XU5 g)Nrrutf-8)dtyper )appendr,npndarrayr_float64astyperfloattypeboolstrOPTIONAL frombufferencodergeneric NumpyVariabletorch_is_availabletorchTensorPyTorchVariablersetattr)r0rr2 attr_nameunset_attributess r_check"LayerSpec.validate.._checkms/} ''-%,,;;"**,!LL4EE5))+007E4(((--e4E3''H$MM%,,w*?rwwOE%,, 5"**0M0M%e,## 5%,,(G(G'.$T*2.I DU +rz/Some required model attributes are not set: %s N)_visit ValueErrorr!)rErurts @rvalidateLayerSpec.validateesH  ,4 F C)),-.  rprefixorderedc^^0mUU4SjnURU5 U(a"[[TR5SS95$T$)zRecursively returns the weights from this layer and its children. Arguments: prefix: Prefix to prepend to all variable names. ordered: If set, an ordered list is returned instead. Returns: Dictionary mapping variables name to value. cd>[U[5(a U[:XagUT[TU5'gN)r,rhrir)r0rr2r|vars r _register_var*LayerSpec.variables.._register_vars+%%%%8*;-2C FD) *rc US$Nrr)xs r%LayerSpec.variables..s!A$r)r<)rxr(sortedr*)rEr|r}rrs ` @r variablesLayerSpec.variabless= 3 M" syy{?@ @ rc0URSS9n[U5Hxup#UHmupEX$:Xa M[U5upgUR5(aM1UR U5(dMIU[ ;dMU[ X5n[XU5 Mv Mz g)z4Find duplicate variables in spec and create aliases.Tr}N)rreversedr$ is_scalarequalSKIP_CREATING_ALIASr=rr) rErrr2 other_name other_valuerrsr0s r_alias_variablesLayerSpec._alias_variablessNN4N0 #I.KD+4' %$1#6 )) K00!)<<&d2DDZ8,5/rc^Tb/T[;a%[T<SSR[5<35eU4SjnURU5 g)z-Possibly quantizes the variable of the layer.Nz7 is not a valid quantization type. Accepted types are: , cb>[U[5(aUR5(ag[U5SnSn[ USU-5nUR S;nU(Ga_T S:XGa!UR S5R5n[R"S[R"[R"U55- 5nX$-n[R"U5n[R"U[R"[R5R [R"[R5R"5nUR%[R5n['U5n['U5nGOT S;GaUR S5R5nSn[)UR*5S:Xa+UR*nUR-UR*S S5n[R"[R"U5S S 9nS XS :H'S U- nU[R."US 5-n[R"U5nUR%[R05nU(aUR-U5n['U5n['U5nOfT S ;aUR T 5nONU(aGT S;aUR S5nO/T S;aUR S5nOT S;aUR S5n[3XU5 Ub[3USU-U5 gg)Nr z%s_scale)rr rr ri)rr r r rr6)axisg_@)r rr)r r r )rr r)rr r )r,VariablerrrVr_tonumpyraramaxabsoluterintclipiinfor minmaxrdrmlenshapereshape expand_dimsrrr) r0rr2r<scaleis_quantizableis_convertible old_shaper quantizations r _quantize&LayerSpec._quantize.._quantizes|eX..%//2C2Ct$R(CE$T:+;D&+DO!DLER^^E155EGGENE!LL1E % i 8)%0E)%0E!%GG!HH\2E#>>!HHY/E!%BB!HHZ0E!%II!HHY/E Du % j3.6!r)ACCEPTED_MODEL_TYPESryr!rx)rErrs ` rrLayerSpec._quantizesG  # >#& CJ3   s AAc X RU'gr)r)rs r add_attributeModelConfig.add_attribute4s" crc[USSS9n[R"UR5USSS9 UR S5 SSS5 g!,(df  g=f) z'Saves the configuration as a JSON file.wr^encodingT)indent sort_keysrwN)openjsondumprwrite)rEpath config_files r save_as_jsonModelConfig.save_as_json7sJ $g .+ II      d #/ . .s 7A  ArN) rKrLrMrNrrrrrrOrrrrr$s.&  # $rrc\rSrSrSrSr\S5r\S5r\S5r Sr SS \ S \ \ S S4S jjr S \ S S4SjrSrSrg) ModelSpeciCz"The top level layer specification.c<UR5Ul0Ulg)z$Initializes the model specification.N)get_default_config_config_filesrEs rrModelSpec.__init__Fs..0  rc[5e)z$The name of the model specification.NotImplementedErrorrs rrModelSpec.nameK "##rcg)zThe model specification revision. This value is incremented each time the weights layout of the model is changed (e.g. a weight is renamed). r6rrs rrevisionModelSpec.revisionPsrcUR$)zThe model configuration.)rrs rconfigModelSpec.configYs||rcg)z5Returns the default configuration used by this model.Nrrs rrModelSpec.get_default_config^srNrfilenamer[c[RRU5(d[SU-5eUc[RR U5nX R ;a[SU-5eXR U'g)z4Registers a file to be saved in the model directory.zFile %s does not existNz*A file with name %s was already registered)osrisfilerybasenamer)rErrs r register_fileModelSpec.register_filebsgww~~d##5<= =  ww''-H {{ "IHTU U $ Hr output_dircUR[RRUS55 URb9URR [RRUS55 UR R5Hlup#[RRX5n[RRU5(a[SU-5e[R"X45 Mn g)z_Saves this model on disk. Arguments: output_dir: Output directory where the model is saved. z model.binNz config.jsonz-File %s already exists in the model directory) _serializerrr!rrrr*exists RuntimeErrorshutilcopy)rErrr destinations rsaveModelSpec.savels  Z=> << # LL % %bggll:}&M N"kk//1NH'',,zTR[R"S[U5S-55 TRUR S55 TR[R"SS55 g)NHr6r^Br)rstructpackrrk)stringmodels r _write_string+ModelSpec._serialize.._write_stringsN FKKS[1_=> FMM'23 FKKQ/0rIrN)rr,rhr`rrrrCURRENT_BINARY_VERSIONrrrrrr_ num_bytesto_bytes) rErraliasesvariabler rr2dimalias variable_namer s @rrModelSpec._serialize~s t4H(1+s++x(  * 5 $  1 KK C)?@ A $)) $ KK C7 8 KK CY8 9( d# FKKS-=>? ;;CKK C 56' FKK->u{{-KLM FKKU__->?@ ENN,- ) KK CW6 7(/$e$m,)0)  s $G?I,, I:)rrr)rKrLrMrNrrpropertyrrrrrhrrrrrOrrrrrCs, $$%#%#%$%+s+t+$ -rrc## UR5H?up[U5S:Xa XS4v M[U5Hup4SXS-4-U4v M MA g7f)Nr6rr')r*rr-) vocabulariesr vocabularyr3vocabs r_flatten_vocabulariesrs[(..0 z?a 1 % %%j11u -u442 1sAAc ^^\rSrSrSrS S\S\S\S\\S\S\4 U4S jjjrS r U=r $) SequenceToSequenceModelConfigiz.Configuration for sequence-to-sequence models. unk_token bos_token eos_tokendecoder_start_tokenadd_source_bosadd_source_eosc 4>[TU]"SUUUUUUS.UD6 g)a Initializes the configuration for sequence-to-sequence models. Args: unk_token: The unknown token. bos_token: The start of sentence token. eos_token: The end of sentence token. decoder_start_token: The decoder start token. If ``None``, the token should be passed by the user in the target prefix. add_source_bos: If ``True``, ``bos_token`` will be automatically added to the source input. add_source_eos: If ``True``, ``eos_token`` will be automatically added to the source input. **kwargs: Additional configuration. )rrr r!r"r#NrrBr) rErrr r!r"r#rGrIs rr&SequenceToSequenceModelConfig.__init__s30   3))   rr)r(FF) rKrLrMrNrrhrrgrrOrPrQs@rrrsb8!-2$$        &c]       rrc^\rSrSrSrU4SjrSr\RS5r \RS5r S\ \ SS 4S jr S\ \ SS 4S jrS \ SS 4S jrSU4SjjrS\ SS 4U4SjjrSrU=r$)SequenceToSequenceModelSpeciz3Base specification for sequence to sequence models.c6>[TU]5 //S.Ulg)z7Initializes a sequence to sequence model specification.sourcetargetN)rBr _vocabulariesrErIs rr$SequenceToSequenceModelSpec.__init__s  rc[5$r)rrs rr.SequenceToSequenceModelSpec.get_default_configs ,..rc[5e)z9Returns the source vocabulary size expected by the model.rrs rget_source_vocabulary_size6SequenceToSequenceModelSpec.get_source_vocabulary_sizerrc[5e)z9Returns the target vocabulary size expected by the model.rrs rget_target_vocabulary_size6SequenceToSequenceModelSpec.get_target_vocabulary_sizerrtokensr[Nc@URSRU5 g)zVRegisters a source vocabulary of tokens. Arguments: tokens: List of source tokens. r.Nr0r`rEr;s rregister_source_vocabulary6SequenceToSequenceModelSpec.register_source_vocabulary 8$++F3rc@URSRU5 g)zVRegisters a target vocabulary of tokens. Arguments: tokens: List of target tokens. r/Nr=r>s rregister_target_vocabulary6SequenceToSequenceModelSpec.register_target_vocabularyrArrc(URUS5 g)z^Registers a vocabulary mapping file. Arguments: path: Path to the vocabulary mapping file. zvmap.txtN)r)rErs rregister_vocabulary_mapping7SequenceToSequenceModelSpec.register_vocabulary_mappings 4,rc  >[TU]5 UR5UR5S.nUR 5Hup#[ U[ 5(dU/nURUn[U5[U5:wa#[SU[U5[U54-5e[[XC55H@unupg[U5U:wdM[SUR5U[U5U4-5e M g)Nr-zCIncorrect number of %s vocabularies: %d registered, but expected %dzK%s vocabulary %d has size %d but the model expected a vocabulary of size %d) rBrzr6r9r*r,r(r0rryr-zip capitalize) rEvocabulary_sizesrsizesrr3r expected_sizerIs rrz$SequenceToSequenceModelSpec.validates 557557  ,113KDeT**--d3L< CJ. YS.E ;<3^[[UR55n[UR 55m[ U4SjT55(aSTS0nUR 5Hup4[USU-U5 M [TU]%U5 g)Nc32># UH oTS:Hv M g7f)rNr).0rall_vocabulariess r 3SequenceToSequenceModelSpec.save..sTCSZ-a00CSssharedrz %s_vocabulary) dictrr0r(valuesallr*_save_vocabularyrBr)rErrrr;rRrIs @rr SequenceToSequenceModelSpec.saves1$2D2DEF  3 3 56 TCST T T$&6q&9:L(..0LD Z4)? H1  Z r)r0r)rKrLrMrNrrrabcabstractmethodr6r9rrhr?rCrFrzrrOrPrQs@rr+r+s= / $$ $$4c4t44c4t4---4 !s !t ! !rr+cF^\rSrSrSrSS\S\S\4U4SjjjrSrU=r$) LanguageModelConfigi(z"Configuration for language models.rrr c .>[TU]"SUUUS.UD6 g)zInitializes the configuration for language models. Args: unk_token: The unknown token. bos_token: The start of sentence token. eos_token: The end of sentence token. **kwargs: Additional configuration. )rrr Nrr%)rErrr rGrIs rrLanguageModelConfig.__init__+s*     rr)r'r(r)) rKrLrMrNrrhrrOrPrQs@rr^r^(s7,!       rr^c^\rSrSrSrU4SjrSr\RS5r S\ \ SS4S jr SU4S jjr S \ SS4U4S jjrS rU=r$)LanguageModelSpeciBz'Base specification for language models.c0>[TU]5 /Ulg)z+Initializes a language model specification.N)rBr _vocabularyr1s rrLanguageModelSpec.__init__Es rc[5$r)r^rs rr$LanguageModelSpec.get_default_configJs "$$rc[5e)z2Returns the vocabulary size expected by the model.rrs rget_vocabulary_size%LanguageModelSpec.get_vocabulary_sizeMrrr;r[Nc$[U5Ulg)zJRegisters the vocabulary of tokens. Arguments: tokens: List of tokens. N)r(rdr>s rregister_vocabulary%LanguageModelSpec.register_vocabularyRs  <rc>[TU]5 UR5n[UR5U:wa#[ S[UR5U4-5eg)NzEVocabulary has size %d but the model expected a vocabulary of size %d)rBrzrirrdry)rEexpected_vocabulary_sizerIs rrzLanguageModelSpec.validateZs` #'#;#;#= t $< <Wt''(*BCD  =rrcR>[USUR5 [TU] U5 g)Nr)rYrdrBr)rErrIs rrLanguageModelSpec.saveds#\43C3CD  Z r)rdr)rKrLrMrNrrrr[r\rirrhrlrzrrOrPrQs@rrbrbBs^1 % $$($s)((!s!t!!rrbc[RRUSU-5n[USSS9n[R "X$SS9 SSS5 g!,(df  g=f)Nz%s.jsonrr^rr)r)rrr!rrr)rrr;vocabulary_pathvocabulary_files rrYrYlsCggll:y4/?@O osW 5 &!4 6 5 5s A Ac\rSrSrSr\\RS\\ 4Sj55r S\ 4Sjr \\RS\ 4Sj55rS\ SS4Sjr\RS\R"4S j5rS\ 4S jr\RS\ 4S j5r\RS\4S j5r\RS\ SS4S j5r\RS\ 4Sj5rSrg)risz(Abstract base class for model variables.r[c[5errrs rrVariable.shapevrrc2[UR5S:H$r)rrrs rrVariable.is_scalar{s4::!##rc[5errrs rr_Variable.dtype~rrr_cFXR:XaU$URU5$r)r__torEr_s rr Variable.tos JJ Kxxrc[5errrs rrVariable.numpy !##rc^[U5[U5L=(a URU5$r)rf_equalrEothers rrVariable.equals#DzT%[(?T[[-??rc[5errrs rrVariable.num_bytesrrc[5errrs rrVariable.to_bytesrrc[5errrs rr~ Variable._torrc[5errrs rrVariable._equalrrrN)rKrLrMrNrrr[r\rr:rrgrrhr_rrarbrrrbytesrr~rrOrrrrrss62 $tCy$$$4$$s$$   $rzz$$@d@ $3$$ $%$$ $$$$ $t$$rrc\rSrSrSrSr\S\\4Sj5r \S\ 4Sj5r S\ R4SjrS\4SjrS\4S jrS \ S\4S jrS\4S jrS rg)rmiz Model variable as a Numpy array.cXlgrarray)rErs rrNumpyVariable.__init__s rr[c.URR$r)rrrs rrNumpyVariable.shapeszzrcBURRR$r)rr_rrs rr_NumpyVariable.dtypeszz$$$rcUR$rrrs rrNumpyVariable.numpys zzrc.URR$r)rnbytesrs rrNumpyVariable.num_bytesszz   rc6URR5$r)rtobytesrs rrNumpyVariable.to_bytesszz!!##rr_cUS:XaD[(d [S5e[RUR5R U5$[ R"U5nURRU5UlU$)Nrz5Converting to bfloat16 requires torch to be installed) rnrrq from_numpyrrrar_rdrs rr~NumpyVariable._tosj J %%"K#--djj9<URnURnX#L=(d| URUR:H=(a\ URUR:H=(a< URSURS:H=(a [R "X#5$r)rr_rflatra array_equalrErabs rrNumpyVariable._equalsx JJ KKv GGqww  %177" %q QVVAY& %q$  rrN)rKrLrMrNrrrrr:rrhr_rarbrrrrrr~rgrrOrrrrmrms* tCy  %s%%rzz!3!$%$    t rrmc\rSrSrSrSr\S5r\S\ \ 4Sj5r \S\ 4Sj5r S\R4SjrS\ 4S jrS\4S jrS \ S\4S jrS\4S jrSrg)rqiz#Model variable as a PyTorch tensor.c[U[RR5(a URnUR 5Ulgr)r,ronn Parameterdata contiguoustensor)rErs rrPyTorchVariable.__init__s2 fehh00 1 1[[F'') rc>[R"U5nU"U5$r)ror)clsrrs rrPyTorchVariable.from_numpys!!%(6{rr[c@[URR5$r)r(rrrs rrPyTorchVariable.shapesDKK%%&&rc`[URR5RSS5$)Nztorch.r)rhrr_replacers rr_PyTorchVariable.dtypes$4;;$$%--h;;rcRURR5R5$r)rdetachrrs rrPyTorchVariable.numpys{{!!#))++rclURR5URR5-$r)rnumel element_sizers rrPyTorchVariable.num_bytess'{{  "T[[%=%=%???rcSnUR5nSnSnUS:aOX!:aUOUn[R"URR 5U-U5nX6- nXE- nX%-nUS:aMOU$)Nirr)rctypes string_atrdata_ptr)rEmax_sizeroutputoffset chunk_sizechunks rrPyTorchVariable.to_bytess{NN$ !m%.%9yJ$$T[[%9%9%;f%DjQE OF  F  #I !m  rr_cf[[U5nURRU5UlU$r)r7rorrrs rr~PyTorchVariable._tos'u%kknnU+  rcURnURnX#L=(d6 URUR:H=(a [R"X#5$r)rr_rorrs rrPyTorchVariable._equals< KK LLvC!''QWW,BQ1BCr)rN)rKrLrMrNrr classmethodrrrr:rrhr_rarbrrrrrr~rgrrOrrrrqrqs-* 'tCy''rs8  ''  T# ! 6 ((s jsl  $* $>[- [-|5# K# LU!)U!p + 4'! '!T5*$sww*$Z+ H+ \1Dh1DssCC)(C)