h0SSKJr SSKJr SSKJrJrJrJrJ r SSK r SSK r SSK J r SSKJrJr SSKJrJr SS KJr S S KJrJrJrJrJrJr S rS rSrSr Sr!\\\"\\4r#S\S\S\\4Sjr$S\S\"S\\"4Sjr%S\\S\\"4Sjr&\RN"S5\"SSS9\"S\SS9\"S\SS 9\"SS!S"\S9\"S#S$S%S&S9\"SS'S(S)S9\"S*S+S,S-S9\"S S.S/S0S9\"S S1S2S3S94 S4\"S5\S6\S7\\S8\"S9\(S:\)S;\)S<\)4S=jj5r*S5\S6\S4\"S>\"S;\)S<\)4 S?jr+g)@)chain)Path)IterableListOptionalUnioncastN)msg)DocDocBin) ensure_path load_model)Vocab)ArgOptapp import_code setup_gpuwalk_directoryaLocation of the documents to predict on. Can be a single file in .spacy format or a .jsonl file. Files with other extensions are treated as single plain text documents. If a directory is provided it is traversed recursively to grab all files to be processed. The files can be a mixture of .spacy, .jsonl and text files. If .jsonl is provided the specified field is going to be grabbed ("text" by default).z&Path to save the resulting .spacy filezNPath to Python file with additional code (registered functions) to be importedz3Use gold preprocessing provided in the .spacy fileszjThe provided output file already exists. To force overwriting the output file, set the --force or -F flag.pathvocabreturnc#v# [5RU5nURU5HnUv M g7f)z! Stream Doc objects from DocBin. N)r from_diskget_docs)rrdocbindocs I/home/james-whalen/.local/lib/python3.13/site-packages/spacy/cli/apply.py_stream_docbinr!%s1X   %Fu% &s79fieldc## [R"U5H+nX;a[R"USUS3SS9 M%X!v M- g7f)zS Stream "text" field from JSONL. If the field "text" is not found it raises error. z does not contain the required 'z' field.rexitsN)srsly read_jsonlr fail)rr"entrys r _stream_jsonlr*.sG !!$'   HHv=eWHMUV W,  (sAA pathsc## UH,n[US5nUR5nUv SSS5 M. g!,(df  M@=f7f)z* Yields strings from text files in paths. rN)openread)r+rfintexts r _stream_textsr2:s8 $_88:DJ_ _sA6 A A Aapply.zModel name or path)helpT)r4existsF)r4dir_okayz--codez-cr1z --text-keyz-tkz$Key containing text string for JSONLz--forcez-Fz!Force overwriting the output filez--gpu-idz-gzGPU ID or -1 for CPU.z --batch-sizez-bz Batch size.z --n-processz-nznumber of processors to use.model data_path output_file code_pathtext_keyforce_overwriteuse_gpu batch_size n_processc P[U5n[U5n[U5nUR5(a U(d[R"[SS9 UR5(d[R"SU3SS9 [ U5 [ U5 [XXXx5 g)a Apply a trained pipeline to documents to get predictions. Expects a loadable spaCy pipeline and path to the data, which can be a directory or a file. The data files can be provided in multiple formats: 1. .spacy files 2. .jsonl files with a specified "field" to read the text from. 3. Files with any other extension are assumed to be containing a single document. DOCS: https://spacy.io/api/cli#apply rr$zCouldn't find data path: N)rr5r r( force_msgrrr3) r8r9r:r;r<r=r>r?r@s r apply_clirCDs0I&Ik*KI&IO !$      ,YK8B  g )%:I json_fieldcF[SS9n[U5n[U5S:Xa,URU5 [R "SUS35 g[ U5n[R"SU35 URn /n /n UHln U RS:XaU R[X55 M/U RS:XaU R[X55 M[U RU 5 Mn [U 5S:aU R[U 55 [[[!U 65n ["R""UR%XUS 9SS 9HnUR'U5 M URS :XaUR)S5nURU5 g) NT)store_user_datarzDid not find data to process, z seems to be an empty directory.z Loaded model z.spacyz.jsonl)r?r@)disable)r rlento_diskr warnrgoodrsuffixappendr!r*r2r DocOrStrStreamrtqdmpipeadd with_suffix)r9r:r8rEr?r@rr+nlprstreams text_filesrdatagenrs r r3r3hsaD )F 9 %E 5zQ{#  {: <   U CHH}UG $% IIE$&GJ ;;( " NN>$6 7 [[H $ NN=: ;   d #  :}Z01>5'?3Gyy 9Et  3R!--h7  NN;rD), itertoolsrpathlibrtypingrrrrr r&rQwasabir tokensr r utilrrrr_utilrrrrrr path_helpout_help code_help gold_helprBstrrPr!r*r2commandboolintrCr3rDr ris88  *HH &  4W  B H x}hsm34e   S Xc] $HSMWS34#Id;Ch? #D(Dy I e:`ay$=`ar:t2IJ!^T FM46TU J  J J J ~ J  J J J J J JF& & &  &  &  &  & rD