hc* SSKJr SSKJr SSKJrJrJrJrJ r SSK r SSK J r SSK Jr SSKJr SS KJrJrJrJr \"5rSS \S \\S \S S4Sjjr"SS\5r"SS5rg)) OrderedDict)Path)AnyDictListOptionalUnionN) BloomFilter)Errors) get_string_id)SimpleFrozenDict ensure_pathload_language_dataregistrylangtablesstrictreturnLookupsc[5nU[R;aNU(aE[U5S:a6[ [ R RSRU5US95eU$[RRU5nUHVnXT;a0U(a&[ [ R RXPS95e0nO [XE5nURXV5 MX U$)aLoad the data from the spacy-lookups-data package for a given language, if available. Returns an empty `Lookups` container if there's no data or if the package is not installed. lang (str): The language code (corresponds to entry point exposed by the spacy-lookups-data package). tables (List[str]): Name of tables to load, e.g. ["lemma_lookup", "lemma_exc"] strict (bool): Whether to raise an error if a table doesn't exist. RETURNS (Lookups): The lookups container containing the loaded tables. rz, )tabler) rrlookupslen ValueErrorr E955formatjoingetr add_table)rrrrdatar language_datas G/home/james-whalen/.local/lib/python3.13/site-packages/spacy/lookups.py load_lookupsr$siG 8### c&kAoV[[//dii6Gd/ST T      %D   !3!3%!3!KLLM.t{;M%/ Nc*\rSrSrSr\SS\S\\SS4Sjj5r SS\\S\\SS4Sjjr S \ \\ 4S \ SS4S jrS \ \\ 4S \ SS4S jrS \ \\ 4S\ 4S jrSS \ \\ 4S\\ S\ 4SjjrS \ \\ 4S\4SjrS\4SjrS\SS4SjrSrg)Table,zA table in the lookups. Subclass of builtin dict that implements a slightly more consistent and unified API. Includes a Bloom filter to speed up missed lookups. Nr!namerc4U"US9nURU5 U$)zInitialize a new table from a dict. data (dict): The dictionary. name (str): Optional table name for reference. DOCS: https://spacy.io/api/lookups#table.from_dict r))update)clsr!r)selfs r# from_dictTable.from_dict3s~ D r%c[R"U5 XlSUlUb[ [ U5S5O URn[ R"U5UlU(aURU5 gg)zInitialize a new table. name (str): Optional table name for reference. data (dict): Initial data, used to hint Bloom Filter. DOCS: https://spacy.io/api/lookups#table.init g.ANr ) r__init__r) default_sizemaxrr from_error_ratebloomr,)r.r)r!sizes r#r2Table.__init__@sb T" $($4s3t9a $:K:K 006  KK  r%keyvaluec~[U5n[R"XU5 URR U5 g)zoSet new key/value pair. String keys will be hashed. key (str / int): The key to set. value: The value to set. N)r r __setitem__r6addr.r9r:s r#r<Table.__setitem__Qs. C 51 sr%c X U'g)zSet new key/value pair. String keys will be hashed. Same as table[key] = value. key (str / int): The key to set. value: The value to set. Nr>s r#set Table.set[s S r%cD[U5n[R"X5$)zqGet the value for a given key. String keys will be hashed. key (str / int): The key to get. RETURNS: The value. )r r __getitem__r.r9s r#rETable.__getitem__ds C &&t11r%defaultcF[U5n[R"XU5$)zGet the value for a given key. String keys will be hashed. key (str / int): The key to get. default: The default value to return. RETURNS: The value. )r rr)r.r9rHs r#r Table.getmsC t'22r%cd[U5nXR;ag[R"X5$)zCheck whether a key is in the table. String keys will be hashed. key (str / int): The key to check. RETURNS (bool): Whether the key is in the table. F)r r6r __contains__rFs r#rLTable.__contains__ws, C  jj ''22r%cUR[UR55URR 5S.n[ R "U5$)z|Serialize table to a bytestring. RETURNS (bytes): The serialized table. DOCS: https://spacy.io/api/lookups#table.to_bytes )r)dictr6)r)rOitemsr6to_bytessrsly msgpack_dumps)r.r!s r#rQTable.to_bytessCII&ZZ((*  ""4((r% bytes_datac[R"U5nURS05nUSUl[ 5R US5UlUR5 URU5 U$)zLoad a table from a bytestring. bytes_data (bytes): The data to load. RETURNS (Table): The loaded table. DOCS: https://spacy.io/api/lookups#table.from_bytes rOr)r6) rR msgpack_loadsrr)r from_bytesr6clearr,)r.rUloadedr!s r#rXTable.from_bytessa$$Z0zz&"%6N  ]--fWo>   D r%)r6r3r))N)NN)__name__ __module__ __qualname____firstlineno____doc__ classmethodrOrstrr/r2r intrr<rBrErboolrLbytesrQrX__static_attributes__rAr%r#r'r',s  T # '  Xc]$SW"uS#XstuS#Xst2uS#X2323uS#X3#3#3 3c3h 3D 3 )% )Uwr%r'cH\rSrSrSrSSjrS\S\4SjrS\ 4Sjr \ S\ \4S j5r \"54S\S \S\4S jjrS\S \SS4S jr\4S\S\S\4SjjrS\S\4SjrS\S\4SjrS\4SjrS\SS4SjrSS\\\4S\SS4SjjrSS\\\4S\SS4SjjrSrg)ra?Container for large lookup tables and dictionaries, e.g. lemmatization data or tokenizer exception lists. Lookups are available via vocab.lookups, so they can be accessed before the pipeline components are applied (e.g. in the tokenizer and lemmatizer), as well as within the pipeline components via doc.vocab.lookups. rNc0Ulg)zHInitialize the Lookups object. DOCS: https://spacy.io/api/lookups#init N_tablesr.s r#r2Lookups.__init__s *, r%r)c$URU5$)zCheck if the lookups contain a table of a given name. Delegates to Lookups.has_table. name (str): Name of the table. RETURNS (bool): Whether a table of that name is in the lookups. ) has_tabler.r)s r#rLLookups.__contains__s~~d##r%c,[UR5$)z3RETURNS (int): The number of tables in the lookups.)rrkrls r#__len__Lookups.__len__s4<<  r%cH[URR55$)z8RETURNS (List[str]): Names of all tables in the lookups.)listrkkeysrls r#rLookups.tablessDLL%%'((r%r!cXR;a&[[RR US95e[ XS9nX0R U'U$)zAdd a new table to the lookups. Raises an error if the table exists. name (str): Unique name of table. data (dict): Optional data to add to the table. RETURNS (Table): The newly added table. DOCS: https://spacy.io/api/lookups#add_table r+)r)r!)rrr E158rr'rk)r.r)r!rs r#r Lookups.add_tablesF ;; V[[//T/:; ;4+" T r%rc X RU'g)zSet a table. name (str): Name of the table to set. table (Table): The Table to set. DOCS: https://spacy.io/api/lookups#set_table Nrj)r.r)rs r# set_tableLookups.set_tables# Tr%rHcXR;a<U[:Xa0[[RR XR S95eU$URU$)a Get a table. Raises an error if the table doesn't exist and no default value is provided. name (str): Name of the table. default (Any): Optional default value to return if table doesn't exist. RETURNS (Table): The table. DOCS: https://spacy.io/api/lookups#get_table r)r)rkUNSETKeyErrorr E159rr)r.r)rHs r# get_tableLookups.get_tablesK || #%v{{11tKK1PQQN||D!!r%cXR;a0[[RR XR S95eURR U5$)zRemove a table. Raises an error if the table doesn't exist. name (str): Name of the table to remove. RETURNS (Table): The removed table. DOCS: https://spacy.io/api/lookups#remove_table r)rkrr rrrpoprps r# remove_tableLookups.remove_tablesD || #6;;--4 -LM M||%%r%cXR;$)zCheck if the lookups contain a table of a given name. name (str): Name of the table. RETURNS (bool): Whether a table of that name exists. DOCS: https://spacy.io/api/lookups#has_table rjrps r#roLookups.has_tables||##r%c B[R"UR5$)z~Serialize the lookups to a bytestring. RETURNS (bytes): The serialized Lookups. DOCS: https://spacy.io/api/lookups#to_bytes )rRrSrk)r.kwargss r#rQLookups.to_bytess""4<<00r%rUc 0Ul[R"U5R5Hup4[ X45URU'M U$)zLoad the lookups from a bytestring. bytes_data (bytes): The data to load. RETURNS (Lookups): The loaded Lookups. DOCS: https://spacy.io/api/lookups#from_bytes )rkrRrWrPr')r.rUrr9r:s r#rXLookups.from_bytes sD --j9??AJC %c 1DLL B r%pathfilenamec [U5nUR5(dUR5 X- nURS5nUR UR 55 SSS5 g!,(df  g=f)zSave the lookups to a directory as lookups.bin. Expects a path to a directory, which will be created if it doesn't exist. path (str / Path): The file path. DOCS: https://spacy.io/api/lookups#to_disk wbN)rexistsmkdiropenwriterQ)r.rrrfilepathfile_s r#to_diskLookups.to_disksU4 {{}} JJL? ]]4 E KK  (! s  A// A=c [U5nX- nUR5(a;URS5nUR5nSSS5 UR W5$U$!,(df  N!=f)zLoad lookups from a directory containing a lookups.bin. Will skip loading if the file doesn't exist. path (str / Path): The directory path. RETURNS (Lookups): The loaded lookups. DOCS: https://spacy.io/api/lookups#from_disk rbN)rrrreadrX)r.rrrrrr!s r# from_diskLookups.from_disk)s]4 ? ??  t$zz|%??4( ( %$s A"" A0rj)rN)z lookups.bin) r\r]r^r_r`r2rbrdrLrcrspropertyrrrrOr'r r}rrrrrorerQrXr rrrrfrAr%r#rrsH,$$$!!)S ))1A0B c  u #c#%#D#38"c"C"E" & & &$c$d$1E1 U  7D)#t)$)03) )$7D#t)$03 r%)T) collectionsrpathlibrtypingrrrrr rR preshed.bloomr errorsr stringsr utilrrrrobjectrrbrdr$r'rrAr%r#rsj#33 %"MMsDIty:sKslXXr%