cCi$SSKJrJr SSKJr SSKJr SSKJrJ r J r SSK J r J r SSKJr \R "\5r"SS \S S 9r"S S \ 5rS /rg))OptionalUnion) BatchFeature) ImageInput)ProcessingKwargsProcessorMixinUnpack)PreTokenizedInput TextInput)loggingc"\rSrSrSS00S.rSrg)Ovis2ProcessorKwargspaddingF) text_kwargs image_kwargsN)__name__ __module__ __qualname____firstlineno__ _defaults__static_attributes__rd/home/james-whalen/.local/lib/python3.13/site-packages/transformers/models/ovis2/processing_ovis2.pyrrs u  IrrF)totalc ^\rSrSrSrSS/rSrSrSU4SjjrSS\ \ S \ \ \ \\ \\ 4S \\S \4S jjrS \\ S \\\4SjrSrSr\S5rSrU=r$)Ovis2Processor%a Constructs a Ovis2 processor which wraps Ovis2 image processor and a Qwen2 tokenizer into a single processor. [`Ovis2Processor`] offers all the functionalities of [`Ovis2VideoProcessor`], [`Ovis2ImageProcessor`] and [`Qwen2TokenizerFast`]. See the [`~Ovis2Processor.__call__`] and [`~Ovis2Processor.decode`] for more information. Args: image_processor ([`Ovis2ImageProcessor`], *optional*): The image processor is a required input. tokenizer ([`Qwen2TokenizerFast`], *optional*): The tokenizer is a required input. chat_template (`str`, *optional*): A Jinja template which will be used to convert lists of messages in a chat into a tokenizable string. image_token (`str`, *optional*, defaults to `""`): Special token used to denote image location. image_seq_length (`int`, *optional*, defaults to 256): The number of image tokens to be used for each image in the input. image_processor tokenizerAutoImageProcessor AutoTokenizerc >XPl[US5(a UROUUl[USS5(a UROUR UR5Ul[ TU]"X4SU0UD6 g)N image_tokenimage_token_id chat_template)image_seq_lengthhasattrr&getattrr'convert_tokens_to_idssuper__init__)selfr!r"r(r&r)kwargs __class__s rr.Ovis2Processor.__init__=s{!14;I}4U4U900[fy"2D99  $ $001A1AB  [=[TZ[rimagestextr0returnc UR"[4SURR0UD6n[ U[ 5(aU/nO8[ U[ 5(d#[ US[ 5(d [S5e0nUbFUR"U40USD6nURS5R5nURX&5nUR"U40USD6n[0UEUES9$)a Main method to prepare for the model one or several sequences(s) and image(s). This method forwards the `text` and `kwargs` arguments to Qwen2TokenizerFast's [`~Qwen2TokenizerFast.__call__`] if `text` is not `None` to encode the text. To prepare the image(s), this method forwards the `images` and `kwargs` arguments to Ovis2ImageProcessor's [`~Ovis2ImageProcessor.__call__`] if `images` is not `None`. Please refer to the docstring of the above two methods for more information. Args: images (`PIL.Image.Image`, `np.ndarray`, `torch.Tensor`, `List[PIL.Image.Image]`, `List[np.ndarray]`, `List[torch.Tensor]`): The image or batch of images to be prepared. Each image can be a PIL image, NumPy array or PyTorch tensor. Both channels-first and channels-last formats are supported. text (`str`, `List[str]`, `List[List[str]]`): The sequence or batch of sequences to be encoded. Each sequence can be a string or a list of strings (pretokenized string). If the sequences are provided as list of strings (pretokenized), you must set `is_split_into_words=True` (to lift the ambiguity with a batch of sequences). Returns: [`BatchFeature`]: A [`BatchFeature`] with the following fields: - **input_ids** -- List of token ids to be fed to a model. Returned when `text` is not `None`. - **attention_mask** -- List of indices specifying which tokens should be attended to by the model (when `return_attention_mask=True` or if *"attention_mask"* is in `self.model_input_names` and if `text` is not `None`). - **pixel_values** -- Pixel values to be fed to a model. Returned when `images` is not `None`. - **image_sizes** -- Size of each image that will be used to unpad an image. Returned when `images` is not `None`. tokenizer_init_kwargsrzAInvalid input text. Please provide a string, or a list of strings images_kwargsgridsr)data) _merge_kwargsrr" init_kwargs isinstancestrlist ValueErrorr!poptolist_expand_image_tokensr)r/r3r4r0 output_kwargs image_inputs image_grids text_inputss r__call__Ovis2Processor.__call__OsB**  "&.."<"<  dC 6DD$'' 47C0H0H`a a  //Y-:XYL&**73::z z z z z z )r)rangereplaceappend) r/r4r9processed_text grid_indexsamplegridrowcol placeholderrcs rrC#Ovis2Processor._expand_image_tokenss  Fv%(7DGS +L4;P;P,P+QQ[\ 9q="3Z!&sA'lT=R=R.R-STK 7{ +{ : ",Qw;';6K ({*  ;Ba v%  ! !& )#$rc:URR"U0UD6$)z This method forwards all its arguments to Qwen2TokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring of this method for more information. )r" batch_decoder/argsr0s rr[Ovis2Processor.batch_decodes ~~**D;F;;rc:URR"U0UD6$)z This method forwards all its arguments to Qwen2TokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring of this method for more information. )r"decoder\s rr`Ovis2Processor.decodes ~~$$d5f55rcURRnURRn[U5[U5-$)N)r"model_input_namesr!r?)r/tokenizer_input_namesimage_processor_input_namess rrc Ovis2Processor.model_input_namess; $ @ @&*&:&:&L&L#)*T2M-NNNr)r)r&r')NNNrK)NN)rrrr__doc__ attributesimage_processor_classtokenizer_classr.rrrr r r?r rrrHintrCr[r`propertyrcr __classcell__)r1s@rrr%s&$[1J0%O \((,^b4B$4BI0$y/4HYCZZ[4B-. 4B  4Bl9oDI6<6OOrrN)typingrrfeature_extraction_utilsr image_utilsrprocessing_utilsrr r tokenization_utils_baser r utilsr get_loggerrloggerrr__all__rrrrxsX #4%HHC   H %+5MO^MO`  r