cCiTSrSSKJrJr SSKrSSKJrJr SSK J r J r J r SSK JrJr SSKJrJrJrJrJrJrJrJrJrJrJrJr SS KJrJrJ r \"5(aSSK!r!\"5(aSSK"r"SS K"J#r#J$r$ S S K%J&r& \RN"\(5r)SS \RTS\\\+\44Sjjr,SS \S\\\+\4S\4Sjjr-S\4Sjr."SS\ 5r/S/r0g)z%Image processor class for SuperPoint.)OptionalUnionN)is_torch_availableis_vision_available)BaseImageProcessor BatchFeature get_size_dict)resizeto_channel_dimension_format) ChannelDimension ImageInput ImageTypePILImageResamplingget_image_typeinfer_channel_dimension_format is_pil_imageis_scaled_imageis_valid_imageto_numpy_array valid_imagesvalidate_preprocess_arguments) TensorTypeloggingrequires_backends)Image ImageDraw)KeypointMatchingOutputimageinput_data_formatcU[R:XaYURSS:Xag[R"USUS:H5=(a [R"USUS:H5$U[R :XaYURSS:Xag[R"USUS :H5=(a [R"US US :H5$g) NrrTr.r...r.r.r&)r FIRSTshapenpallLAST)r r!s |/home/james-whalen/.local/lib/python3.13/site-packages/transformers/models/efficientloftr/image_processing_efficientloftr.py is_grayscaler15s,222 ;;q>Q vveFmuV}45`"&&vRWX^R_A_:`` .33 3 ;;r?a vveFmuV}45`"&&vRWX^R_A_:`` 4returnc"[[S/5 [U[R5(a[ XS9(aU$U[ R:Xa5USS-USS--USS--n[R"U/S -S S 9nU$U[ R:Xa3US S-US S--USS--n[R"U/S -SS 9nW$[U[RR5(dU$URS5nU$)aC Converts an image to grayscale format using the NTSC formula. Only support numpy and PIL Image. TODO support torch and tensorflow grayscale conversion This function is supposed to return a 1-channel image, but it returns a 3-channel image with the same value in each channel, because of an issue that is discussed in : https://github.com/huggingface/transformers/pull/25786#issuecomment-1730176446 Args: image (Image): The image to convert. input_data_format (`ChannelDimension` or `str`, *optional*): The channel dimension format for the input image. visionr!r#gŏ1w-!?r$gbX9?r%gv/?rr)axisr(r)r*r'L) rconvert_to_grayscale isinstancer-ndarrayr1r r+stackr/PILrconvert)r r! gray_images r0r9r9Ds$*XJ7%$$  CL  0 6 6 6v/%-&2HH5QW=[aKaaJ:,"2;J"2"7"7 7v/%-&2HH5QW=[aKaaJ:,"2._is_valid_imagetsGE" 5 ! fnU&;y}}&L fQTUZU`U`QaefQf r2r&c34># UH nT"U5v M g7fN.0r rDs r0 2validate_and_format_image_pairs..{s#Q&_U%;%;&c3># UHFn[U[5=(a* [U5S:H=(a [U4SjU55v MH g7f)r&c34># UH nT"U5v M g7frGrHrIs r0rK..sC uOE** rMN)r:listrCr.)rJ image_pairrDs r0rKrL}sO %  z4 ( DJ1$ DC CC D%sAA)r:rQrCr. ValueError)r@ error_messagerRr rDs @r0validate_and_format_image_pairsrUksM &$ v;! #Q&#Q Q QM  %    -3KFj uE EFK K ] ##Ls&B c*^\rSrSrSrS/rSS\RSSS4S\S\ \ \ \ 4S \S \S \ S \S S4U4SjjjrS S\R S\ \ \ 4S\ \\ \4S\ \\ \44SjjrSSSSSSS\R(S4 S\ \S\ \ \ \ 4S \ \S \ \S \ \ S \ \S\ \\ \4S\S\ \\ \4S \4SjjrS!SSS\\\\4S\ S \\ \ \R644SjjrS\S\\ \ \R64S \S4SjrSrSr U=r!$)"EfficientLoFTRImageProcessora) Constructs a EfficientLoFTR image processor. Args: do_resize (`bool`, *optional*, defaults to `True`): Controls whether to resize the image's (height, width) dimensions to the specified `size`. Can be overridden by `do_resize` in the `preprocess` method. size (`Dict[str, int]` *optional*, defaults to `{"height": 480, "width": 640}`): Resolution of the output image after `resize` is applied. Only has an effect if `do_resize` is set to `True`. Can be overridden by `size` in the `preprocess` method. resample (`PILImageResampling`, *optional*, defaults to `Resampling.BILINEAR`): Resampling filter to use if resizing the image. Can be overridden by `resample` in the `preprocess` method. do_rescale (`bool`, *optional*, defaults to `True`): Whether to rescale the image by the specified scale `rescale_factor`. Can be overridden by `do_rescale` in the `preprocess` method. rescale_factor (`int` or `float`, *optional*, defaults to `1/255`): Scale factor to use if rescaling the image. Can be overridden by `rescale_factor` in the `preprocess` method. do_grayscale (`bool`, *optional*, defaults to `True`): Whether to convert the image to grayscale. Can be overridden by `do_grayscale` in the `preprocess` method. pixel_valuesTNgp? do_resizesizeresample do_rescalerescale_factor do_grayscaler3c >[TU]"S0UD6 UbUOSSS.n[USS9nXlX lX0lX@lXPlX`lg)Nii)heightwidthFdefault_to_squarerH) super__init__r rZr[r\r]r^r_) selfrZr[r\r]r^r_kwargs __class__s r0rf%EfficientLoFTRImageProcessor.__init__sR "6"'tc-JTU;"  $,(r2r data_formatr!c F[USS9n[U4USUS4UUS.UD6$)a Resize an image. Args: image (`np.ndarray`): Image to resize. size (`dict[str, int]`): Dictionary of the form `{"height": int, "width": int}`, specifying the size of the output image. data_format (`ChannelDimension` or `str`, *optional*): The channel dimension format of the output image. If not provided, it will be inferred from the input image. Can be one of: - `"channels_first"` or `ChannelDimension.FIRST`: image in (num_channels, height, width) format. - `"channels_last"` or `ChannelDimension.LAST`: image in (height, width, num_channels) format. - `"none"` or `ChannelDimension.NONE`: image in (height, width) format. input_data_format (`ChannelDimension` or `str`, *optional*): The channel dimension format for the input image. If unset, the channel dimension format is inferred from the input image. Can be one of: - `"channels_first"` or `ChannelDimension.FIRST`: image in (num_channels, height, width) format. - `"channels_last"` or `ChannelDimension.LAST`: image in (height, width, num_channels) format. - `"none"` or `ChannelDimension.NONE`: image in (height, width) format. Frcrarb)r[rkr!)r r )rgr r[rkr!rhs r0r #EfficientLoFTRImageProcessor.resizesE:TU;  x.$w-0#/     r2return_tensorsc  JUbUO URnUbUO URnUbUO URnUbUO URnUbUO URnUbUO UR n[ USS9n[U5n[U5(d [S5e[UUUUUS9 UV s/sHn [U 5PM nn [US5(aU(a[RS5 U c[US5n /n UH\n U(aUR!XXJS9n U(aUR#XU S9n U(a [%XS 9n ['XU S 9n U R)U 5 M^ [+S[-U 5S 5Vs/sH oXS -PM nnS U0n[/UUS 9$s sn fs snf)a Preprocess an image or batch of images. Args: images (`ImageInput`): Image pairs to preprocess. Expects either a list of 2 images or a list of list of 2 images list with pixel values ranging from 0 to 255. If passing in images with pixel values between 0 and 1, set `do_rescale=False`. do_resize (`bool`, *optional*, defaults to `self.do_resize`): Whether to resize the image. size (`dict[str, int]`, *optional*, defaults to `self.size`): Size of the output image after `resize` has been applied. If `size["shortest_edge"]` >= 384, the image is resized to `(size["shortest_edge"], size["shortest_edge"])`. Otherwise, the smaller edge of the image will be matched to `int(size["shortest_edge"]/ crop_pct)`, after which the image is cropped to `(size["shortest_edge"], size["shortest_edge"])`. Only has an effect if `do_resize` is set to `True`. resample (`PILImageResampling`, *optional*, defaults to `self.resample`): Resampling filter to use if resizing the image. This can be one of `PILImageResampling`, filters. Only has an effect if `do_resize` is set to `True`. do_rescale (`bool`, *optional*, defaults to `self.do_rescale`): Whether to rescale the image values between [0 - 1]. rescale_factor (`float`, *optional*, defaults to `self.rescale_factor`): Rescale factor to rescale the image by if `do_rescale` is set to `True`. do_grayscale (`bool`, *optional*, defaults to `self.do_grayscale`): Whether to convert the image to grayscale. return_tensors (`str` or `TensorType`, *optional*): The type of tensors to return. Can be one of: - Unset: Return a list of `np.ndarray`. - `TensorType.TENSORFLOW` or `'tf'`: Return a batch of type `tf.Tensor`. - `TensorType.PYTORCH` or `'pt'`: Return a batch of type `torch.Tensor`. - `TensorType.NUMPY` or `'np'`: Return a batch of type `np.ndarray`. - `TensorType.JAX` or `'jax'`: Return a batch of type `jax.numpy.ndarray`. data_format (`ChannelDimension` or `str`, *optional*, defaults to `ChannelDimension.FIRST`): The channel dimension format for the output image. Can be one of: - `"channels_first"` or `ChannelDimension.FIRST`: image in (num_channels, height, width) format. - `"channels_last"` or `ChannelDimension.LAST`: image in (height, width, num_channels) format. - Unset: Use the channel dimension format of the input image. input_data_format (`ChannelDimension` or `str`, *optional*): The channel dimension format for the input image. If unset, the channel dimension format is inferred from the input image. Can be one of: - `"channels_first"` or `ChannelDimension.FIRST`: image in (num_channels, height, width) format. - `"channels_last"` or `ChannelDimension.LAST`: image in (height, width, num_channels) format. - `"none"` or `ChannelDimension.NONE`: image in (height, width) format. FrczkInvalid image type. Must be of type PIL.Image.Image, numpy.ndarray, torch.Tensor, tf.Tensor or jax.ndarray.)rZr[r\r]r^rzIt looks like you are trying to rescale already rescaled images. If the input images have pixel values between 0 and 1, set `do_rescale=False` to avoid rescaling them again.)r r[r\r!)r scaler!r6)input_channel_dimr&rY)data tensor_type)rZr\r]r^r_r[r rUrrSrrrlogger warning_oncerr rescaler9r appendrangerCr )rgr@rZr[r\r]r^r_rnrkr!rhr all_imagesi image_pairsrrs r0 preprocess'EfficientLoFTRImageProcessor.preprocessst"+!6IDNN '38#-#9Zt +9+E4K^K^'3'?|TEVEV 'tTYYTU;18F##:  &!)  6<vay I  E %X s 5Zk l,UX/VghE   e $7BB?=6Ts (F;F outputsr target_sizes thresholdcFURRS[U5:wa [S5e[ SU55(d [S5e[ U[ 5(a)[R"X!RRS9nO3URSS:wdURSS:wa [S5eUnURR5nXTRS5RSSSS5-nUR[R5n/n[!XQRUR"5HXupxn [R$"X:US:5n USU Sn USU Sn U SU Sn UR'U U U S .5 MZ U$) aa Converts the raw output of [`KeypointMatchingOutput`] into lists of keypoints, scores and descriptors with coordinates absolute to the original image sizes. Args: outputs ([`KeypointMatchingOutput`]): Raw outputs of the model. target_sizes (`torch.Tensor` or `List[Tuple[Tuple[int, int]]]`, *optional*): Tensor of shape `(batch_size, 2, 2)` or list of tuples of tuples (`Tuple[int, int]`) containing the target size `(height, width)` of each image in the batch. This must be the original image size (before any processing). threshold (`float`, *optional*, defaults to 0.0): Threshold to filter out the matches with low scores. Returns: `List[Dict]`: A list of dictionaries, each dictionary containing the keypoints in the first and second image of the pair, the matching scores and the matching indices. rzRMake sure that you pass in as many target sizes as the batch dimension of the maskc3># UHn[U5S:Hv M g7f)r&N)rC)rJ target_sizes r0rKNEfficientLoFTRImageProcessor.post_process_keypoint_matching..lsIL[3{#q(LszTEach element of target_sizes must contain the size (h, w) of each image of the batch)devicerr&r') keypoints0 keypoints1matching_scores)matchesr,rCrSr.r:rQtorchtensorr keypointscloneflipreshapetoint32zipr logical_andrw)rgr~rrimage_pair_sizesrresultskeypoints_pairrscores valid_matchesmatched_keypoints0matched_keypoints1rs r0post_process_keypoint_matching;EfficientLoFTRImageProcessor.post_process_keypoint_matchingTs, ??  #s<'8 8qr rILIIIst t lD ) )$||LAWAWX !!!$)\-?-?-Ba-G j , %%++-  5 5b 9 A A"aA NN LL- /29oowOfOf/g +NV!--f.@'B,OM!/!2=3C!D !/!2=3C!D $Qi a(89O NN"4"4'6 0h r2r@keypoint_matching_outputz Image.Imagec [U5nUVs/sHn[U5PM nn[S[U5S5Vs/sH oAXDS-PM nn/n[ XR5GHtupxUSR SSupUSR SSup[ R"[X5X-S4[ RS9n USU SU 2SU 24'USU SU 2U S24'[R"U 5n[R"U5nUSRS5unnUSRS5unn[ UUUUUS 5HxunnnnnURU5nUR!UUUU -U4USS 9 UR#US- US- US-US-4S S 9 UR#UU -S- US- UU -S-US-4S S 9 Mz UR%U5 GMw U$s snfs snf) ao Plots the image pairs side by side with the detected keypoints as well as the matching between them. Args: images (`ImageInput`): Image pairs to plot. Same as `EfficientLoFTRImageProcessor.preprocess`. Expects either a list of 2 images or a list of list of 2 images list with pixel values ranging from 0 to 255. keypoint_matching_output (List[Dict[str, torch.Tensor]]]): A post processed keypoint matching output Returns: `List[PIL.Image.Image]`: A list of PIL images, each containing the image pairs side by side with the detected keypoints as well as the matching between them. rr&Nrr)dtyperrr)fillrbblack)r)rUrrxrCrr,r-zerosmaxuint8r fromarrayrDrawunbind _get_colorlineellipserw)rgr@rr rzr{rrR pair_outputheight0width0height1width1 plot_imageplot_image_pildraw keypoints0_x keypoints0_y keypoints1_x keypoints1_y keypoint0_x keypoint0_y keypoint1_x keypoint1_ymatching_scorecolors r0visualize_keypoint_matching8EfficientLoFTRImageProcessor.visualize_keypoint_matchings4&185;>.1D)4\)B)I)I!)L &L,)4\)B)I)I!)L &L,VYlL, TeHfWR [+{N7  +{V/C[Q  kAo{Q aQ\_`Q`aho p  6)A-{Q f@TWX@XZehiZij W NN> *7(R8A=Ks GGcL[SSU- -5n[SU-5nSnX#U4$)zMaps a score to a color.rr)int)rgscorergbs r0r'EfficientLoFTRImageProcessor._get_colors2 q5y! " e  ayr2)r_r]rZr\r^r[)NN)g)"__name__ __module__ __qualname____firstlineno____doc__model_input_namesrBILINEARboolrdictstrrfloatrfr-r;rr r r+rr r|rQtuplerTensorrrrr__static_attributes__ __classcell__)ris@r0rWrWsc,(()-'9'B'B '!))tCH~&)% )  )  )) ))4?CDH % zz% 38n% eC)9$9:; % $E#/?*?$@A % V%))-15%)*.'+;?(8(>(>DHtCD>tCtCH~& tC -. tC TN tC!tCtntC!sJ!78tC&tC$E#/?*?$@AtC tCt 9)9JU 349 9 d3 $% & 9v44#'tC,='>"?4 m  4lr2rWrG)1rtypingrrnumpyr-rrimage_processing_utilsrr r image_transformsr r image_utilsr rrrrrrrrrrrutilsrrrrr=rrmodeling_efficientloftrr get_loggerrrtr;rr1r9rUrW__all__rHr2r0rs,"7UUC    <;$?   H % AE a :: ac+;&; <= a"AE# #c+;&; <=##N$J$8C#5CL * *r2