5h+SSKJr SSKJr SSKJr SSKrSSKrS SjrSSSjjr SSjr SSSjjr \"S S 55r "S S 5r g)) annotations) dataclass)LiteralNcxUbUR5OSnUbUR5OSnURUX"X3S9$)N)outtypeftypeOUTTYPEFTYPE)lowerupperformat)filename output_typeftype_lowercaseftype_uppercases 4/home/james-whalen/llama.cpp/gguf-py/gguf/utility.pyfill_templated_filenamer sL2=2I;,,.rO2=2I;,,.rO ???#2#2  KKc US:aUS-nSnO#US:aUS-nSnOUS:aUS-nS nOUS -nS n[U[[[U55R S 55- S 5nUSUS3U3$)NgmBg-q=TgeAg& .>Bg.Agư>MgMbP?K0r.f)maxlenstrroundlstrip)model_params_count min_digitsscaled_model_params scale_suffixfixs r#model_weight_count_rounded_notationr(sD 058 c !047 c !047 147 j3s5)<#=>EEcJKKQ OC!!C5 *<. 99rcUS:a([[U5[U5-SS9nUSU3nU$[[U5SS9nU$)Nr)r$x)r(abs) total_params shared_params expert_params expert_count pretty_size size_classs r size_labelr3*sYa9#m:LsS`Oa:anop $~Q{m4  9\9JWXY rcbUb1UR5RSS5RSS5nO6Ub1UR5RSS5RSS5nOSnUbSU3OSnUb#SUR5RSS53OSn Ub#SUR5RSS53OSn Ub1SUR5RSS5R53OSn Ub#SUR5RSS53OSn UUU U U U 3$)N -/z ggml-modelr)stripreplacer ) model_name base_namefinetune_stringversion_stringr3r model_typename parametersfinetuneversionencodingkinds rnaming_conventionrE5sJ ((c2::3D  !))#s3;;CE%/%;1ZL!JBQB]?((*223<=>ceH@N@Z.&&(00c:;<`bGFQF];$$&..sC8>>@ABceH9C9OQz!))#s34 5UWDVJ<z'8*TF CCrcR\rSrSr%S\S'S\S'S\S'S\S'S\S 'S S jrS rg ) RemoteTensorLr dtypeztuple[int, ...]shapeint offset_startsizeurlc~[[RURURUR S95nU$)N)rNstartrM) bytearraySafetensorRemoteget_data_by_rangerNrLrM)selfdatas rrURemoteTensor.dataTs8);;PTPaPahlhqhq;rs rN)returnrQ)__name__ __module__ __qualname____firstlineno____annotations__rU__static_attributes__rWrrrGrGLs" J  I HrrGc\rSrSrSrSrSr\S Sj5r\SSj5r \SSj5r \SSSjj5r \SS j5r \SS j5r S rg )rR[a Uility class to handle remote safetensor files. This class is designed to work with Hugging Face model repositories. Example (one model has single safetensor file, the other has multiple): for model_id in ["ngxson/TEST-Tiny-Llama4", "Qwen/Qwen2.5-7B-Instruct"]: tensors = SafetensorRemote.get_list_tensors_hf_model(model_id) print(tensors) Example reading tensor data: tensors = SafetensorRemote.get_list_tensors_hf_model(model_id) for name, meta in tensors.items(): dtype, shape, offset_start, size, remote_safetensor_url = meta # read the tensor data data = SafetensorRemote.get_data_by_range(remote_safetensor_url, offset_start, size) print(data) zhttps://huggingface.cocURURSUS35nU(a#URSUS3nURU5$URSUS3nURU5nU(aURUS5nUR S5n[ R "U5nURS5cS5eUSn [[U R555n U R5 0n U HCn URSUSU 3nURU5R5H upXU 'M ME U $[S US 35e) z Get list of tensors from a Hugging Face model repository. Returns a dictionary of tensor names and their metadata. Each tensor is represented as a tuple of (dtype, shape, offset_start, size, remote_safetensor_url) r7z/resolve/main/model.safetensorsz*/resolve/main/model.safetensors.index.jsonrutf-8 weight_mapz"weight_map not found in index filez/resolve/main/z,No safetensor file has been found for model z.If the repo has safetensor files, make sure the model is public or you have a valid Hugging Face token set in the environment variable HF_TOKEN.)check_file_exist BASE_DOMAINget_list_tensorsrSdecodejsonloadsgetlistsetvaluessortitems ValueError)clsmodel_idis_single_filerN index_urlis_multiple_files index_data index_str index_jsonrd all_filestensorsfilekeyvals rget_list_tensors_hf_model*SafetensorRemote.get_list_tensors_hf_modelqsr--0A8*Lk.lm __%Qxj0OPC'', ,'q 2\] 00; ..y!>,/; a=a a;#L1JS!2!2!456I NN /1G!)8*N4&I # 4 4S 9 ? ? AHC#&CL!B"N:8*EQ Q  rc lURU5up#0nUR5HdupVUS:XaM [U[5(d[ SUSU35eUSnUSnUSupX- n X9-n [ U[ U5XUS9XE'Mf U$![an [ SUSU S U35eS n A ff=f) z Get list of tensors from a remote safetensor file. Returns a dictionary of tensor names and their metadata. Each tensor is represented as a tuple of (dtype, shape, offset_start, size) __metadata__zInvalid metadata for tensor 'z': rIrJ data_offsets)rIrJrLrMrNz$Missing key in metadata for tensor 'z , meta = N) get_metadatarp isinstancedictrqrGtupleKeyError)rrrNmetadatadata_start_offsetresr?metarIrJoffset_start_relativeoffset_end_relativerMrLes rrg!SafetensorRemote.get_list_tensorss'*&6&6s&;#')"..*JD~%dD)) #@c$!PQQ eW W =A.=Q:%*B0H (uE%LWctwx +  e #GvSQRPSS\]a\b!cdd es0B B3B..B3cSnURUSU5n[U5S:a [S5e[R USSSS9nSU-n[ R nXV-S:wa XVXV-- - n[U5SU-:a[SSU-S [U535eUSSU-nURS 5n[R"U5n X4$![Ran [S U 35eSn A ff=f) zb Get JSON metadata from a remote safetensor file. Returns tuple of (metadata, data_start_offset) iPrraz%Not enough data to read metadata sizeNlittle) byteorderz'Could not read complete metadata. Need z bytes, got rcz-Failed to parse safetensor metadata as JSON: ) rSrrqrK from_bytesrR ALIGNMENTrhrirjJSONDecodeError) rrrN read_sizeraw_datametadata_lengthr alignmentmetadata_bytes metadata_strrrs rrSafetensorRemote.get_metadatas*$ ((a; x=1 DE E.."1.J/$..  (A - .?.K!L L  x=1. .Fq?GZF[[ghklthugvwx x"!A$78%,,W5  Rzz,/H. .## RLQCPQ Q Rs6CC6#C11C6cZSSKnSSKJn U"U5nUR(aUR(d[ SU35eUR 5nUS:a SUSX#-3US'URUS US 9nUR5 UR[US:aU5$S5$) zh Get raw byte data from a remote file by range. If size is not specified, it will read the entire file. rNurlparse Invalid URL: zbytes=r6RangeTallow_redirectsheaders) requests urllib.parserschemenetlocrq_get_request_headersrkraise_for_statuscontentslice) rrrNrPrMrr parsed_urlrresponses rrS"SafetensorRemote.get_data_by_ranges )c]   (9(9}SE23 3**, "9!'wa ~>GG <<T7<K!!#dRid BCCT BCCrc>SSKnSSKJn U"U5nUR(aUR(d[ SU35eUR 5nSUS'URUSUS9nS URs=:*=(a S :$s $!URa g f=f) z\ Check if a file exists at the given URL. Returns True if the file exists, False otherwise. rNrrz bytes=0-0rTriF) rrrrrrqrhead status_codeRequestException)rrrNrrrrrs rre!SafetensorRemote.check_file_exists )c]   (9(9}SE23 3 ..0G*GG }}S$}PH(..444 44 4((  sAB B BBcSS0n[RRS5(aS[RS3US'U$)z$Prepare common headers for requests.z User-Agentconvert_hf_to_ggufHF_TOKENzBearer Authorization)osenvironrk)rrrs rr%SafetensorRemote._get_request_headerssB !56 ::>>* % %)0J1G0H'IGO $rrWN)rsr rXdict[str, RemoteTensor])rNr rXr)rNr rXztuple[dict, int])r)rNr rPrKrMrKrXbytes)rNr rXbool)rXzdict[str, str])rYrZr[r\__doc__rfr classmethodrrgrrSrerr^rWrrrRrR[s$+KI& & P6!R!RFDD**rrR)rr r str | NonerXr )r*)r#rKr$rKrXr ) r-rKr.rKr/rKr0rKrXr )N)r:rr;rr<rr=rr3rrrr>zLiteral['vocab', 'LoRA'] | NonerXr ) __future__r dataclassesrtypingrrrirr(r3rErGrRrWrrrsO"! K:.D.     qqr