:i BSSKrSSKrSSKJr SSKJr SSKJr SSKr SSK J r SSK J r Jr SSKJrJr SSKJrJr \R*"\5r\"5(aSSKr\"S S 55r\"S S 55rS \\-S\ 4SjrSrSr"SS\\5r\"SS55r S\ RS\ R4Sjr!S\ RDS\#\$\$\$4S\#\$\$\$4S\ RD4Sjr%S\ RS\#\&\&4S\ RD4Sjr'"SS5r(g) N) dataclass)Enum)BytesIO)Image)SerializableImagedownload_image)assert_opencv_installedis_opencv_installed) ImageChunk ImageURLChunkcH\rSrSr%Sr\\\S'\R\S'Sr g) ImageEncodingzA tokenized image. Attributes: tokens: The token ids. image: The image as a numpy array. Examples: >>> import numpy as np >>> image_encoding = ImageEncoding(tokens=[1, 2, 3], image=np.array([[0., 0.5, 1.]])) tokensimageN) __name__ __module__ __qualname____firstlineno____doc__listint__annotations__npndarray__static_attributes__r`/home/james-whalen/.local/lib/python3.13/site-packages/mistral_common/tokens/tokenizers/image.pyrrs  I ::rrc8\rSrSr%Sr\\S'\\S'\\S'Srg)SpecialImageIDs&zSpecial image tokens ids. Attributes: img: The image token id. img_break: The image break token id. img_end: The image end token id. Examples: >>> special_image_ids = SpecialImageIDs(img=1, img_break=2, img_end=3) img img_breakimg_endrN)rrrrrrrrrrrr!r!&s  HN Lrr!chunkreturnc[U[5(a UR$UR5R S5(aWUR5R S5Sn[ R"U5n[R"[U55$UR5R S5(a>[R"[UR5RSS5S55$UR5R S5(a[UR55$[S UR535e) zGet a serializable image from a chunk. Args: chunk: The chunk to get the image from. Returns: The image as a PIL Image object. z data:image,filezfile://rbhttpzUnsupported image url scheme ) isinstancer rget_url startswithsplitbase64 b64decoderopenrreplacer RuntimeError)r&data image_datas rimage_from_chunkr:8s%$${{ }}!!,//}}$$S)!,%%d+ zz'*-.. }}!!&))zz$u}}66y"EtLMM }}!!&))emmo.. 6u}}6GH IIr)g3<4'?gwg M?gy{ ?)gB91?gwt.?g U?c0\rSrSrSrSr\SSj5rSrg)MultiModalVersionTzVersion of the image tokenizer.m1cfURS:Xa [SS5$[UR5e)Nr>i)name ImageConfigNotImplementedErrorselfs rconfigMultiModalVersion.configYs, 99 r4( (!TYYK11rrN)r'rB) rrrrrr>propertyrFrrrrr<r<Ts* B 22rr<c<\rSrSr%Sr\\S'\\S'Sr\\S'Srg) rBaz'Configuration for the image tokenizers.image_patch_sizemax_image_sizer*spatial_merge_sizerN) rrrrrrrrMrrrrrBrBas2rrBrcURS:XaU$URS:waURS5n[R"SURS5nUR USU5 URS5$)zMConvert a PIL image to RGB. We ensure transparent background becomes white. RGBRGBAWHITE)rr)modeconvertrnewsizepaste)rwhite_bgs r_convert_to_rgbrXjsf  zzU  zzV f%!IIfejj'BH NN5&%(   E ""rnp_imagemeanstdc2US- n[UR5S:XdSUR<35eURS[U5s=:Xa[U5:XdO SUR<SU<SU<35eX- U- nURSSS5$) zNormalize a tensor image with mean and standard deviation. Args: np_image: Image to be normalized. mean: Mean for each channel. std: Standard deviation for each channel. Returns: Normalized image with shape (C, H, W). go@znp_image.shape=z, mean=z, std=rr*)lenshape transpose)rYrZr[s r normalizerbxs%H x~~ ! #9'8%99 # >>! D 5SX 5\/(..9J(TGSZVYU[7\\ 53&H   aA &&rnew_sizec[5 [R"[R"[ U5[R S9U[RS9n[U[[5$)zTransform an image to a numpy array with the given size. Args: image: Image to be transformed. new_size: New size of the image. Returns: Transformed image with shape (C, H, W). )dtype) interpolation) r cv2resizerarrayrXfloat32 INTER_CUBICrb DATASET_MEAN DATASET_STD)rrcrYs rtransform_imagernsFzz"((?5#9LhfifufuvH X|[ 99rc\rSrSrSrS\S\SS4Sjr\S\4Sj5r S \ RS\ \ \ 44S jr S \\-S\4S jr\S\ 4S j5rSrg) ImageEncoderz&Image encoder for the image tokenizer. image_config special_idsr'NcXlX lg)zInitialize the image encoder. Args: image_config: Configuration for the image tokenizer. special_ids: Special image tokens ids. Nrrrs)rErrrss r__init__ImageEncoder.__init__s)&rcUR$N)rrrDs r mm_configImageEncoder.mm_configs    rr#cURup#[X0RR- X RR- 5nUS:a[ X$- 5n[ X4- 5nUS- URR URR --S-nUS- URR URR --S-nXV4$)Nr*)rUmaxrrrLroundrKrM)rEr#whratio width_tokens height_tokenss r_image_to_num_tokens!ImageEncoder._image_to_num_tokenssxxA))888!>O>O>^>^:^_ 19ai Aai AA4#4#4#E#EHYHYHlHl#lmpqq QD$5$5$F$FIZIZImIm$mnqrr **rcontentc[U5nURU5up4US:deUS:deURR/U-URR/-U-nURR US'X0R R-UR R-X@R R-UR R-4n[X&5n[XWS9$)z}Converts an image chunk to an image encoding. Args: content: image chunk to be converted. Returns: Image encoding. r)rr) r:rrsr#r$r%rrrKrMrnr)rErrrr image_tokensnew_image_sizeprocessed_images r__call__ImageEncoder.__call__s!)((/1u u1u u))--.2d6F6F6P6P5QQUVV ++33 R !!22 2T5F5F5Y5Y Y !!22 2T5F5F5Y5Y Y *%@LHHrc.URR$ry)rsr#rDs r image_tokenImageEncoder.image_tokens###rru)rrrrrrBr!rvrHrzrtuplerrr r rrrrrrrrprps1'[''SW'!;!! + +c3h +I ] :I}I,$S$$rrp))r3logging dataclassesrenumriornumpyrPILrmistral_common.imagerrmistral_common.importsr r &mistral_common.protocol.instruct.chunkr r getLoggerrloggerrgrr!r:rlrmstrr<rBrXrrfloatrbrrnrprrrrsZ !BOL   8 $        "JMJ6J;LJ.3 2  2T 2      #5;; #5;; #'jj' ue# $' ueU" #'ZZ '2 :5;; :%S/ :bjj : ;$;$r