h6SSKrSSKrSSKJr SSKJrJr SSKrSSK r SSK J r SSK J r Sr SrS\ R4S jrS r"S S 5rS SS\ R&"S54SjrS SS\ R&"S54SjrS S\ R&"S54SjrSrSrS\\R2\ R44SjrS\\R2\ R4S\\\\\44Sjrg)N)Thread)TupleUnion)Image)tqdmc>[RR5(a[RRS5RS:n[RRS5RS:nU(d[ R "S[SS9 [S[RRS5SS55nUS :a,[ R "S [RS 3[SS9 US :=(d U(+nOS nS nS nXU4$)NrzSFlash Attention is disabled as it requires a GPU with Ampere (8.0) CUDA capability.category stacklevelc38# UHn[U5v M g7fN)int).0vs Y/home/james-whalen/.local/lib/python3.13/site-packages/torchao/_models/sam2/utils/misc.py $get_sdpa_settings..sQ0P1A0Ps.)r r zYou are using PyTorch zw without Flash Attention v2 support. Consider upgrading to PyTorch 2.2+ for Flash Attention v2 (which could be faster).TF) torchcuda is_availableget_device_propertiesmajorwarningswarn UserWarningtuple __version__split)old_gpuuse_flash_attnpytorch_versionmath_kernel_ons rget_sdpa_settingsr's zz  **2215;;a?99!<BBaG MMe$  Q0A0A0G0G0LRa0PQQ V # MM():):(;BGK r(c[R"U5n[R"UR S5R X455nUR [R:XaUS- nO[SUR SU35e[R"U5RSSS5nURupVXFU4$)NRGBo@zUnknown image dtype: z on r rr8) ropennparrayconvertresizer5r. RuntimeErrorr from_numpypermutesize)img_path image_sizeimg_pilimg_npimg video_width video_heights r_load_img_as_tensorrh]sjj"G XXgooe,33Z4LM NF ||rxx%26<<.XJOPP   6 " * *1a 3C ' K k ))r(c*\rSrSrSrSrSrSrSrg)AsyncVideoFrameLoaderizR A list of video frames to be load asynchronously without blocking session start. c,^UTlUTlUTlUTlUTlS/[ U5-TlSTlSTlSTl UTl TRS5 U4Sjn[USS9Tl TRR5 g)Nrc>[[[TR55SS9HnTR U5 M g![ anUTlSnAgSnAff=f)Nframe loading (JPEG)desc)rrangelenimages __getitem__ Exception exception)neselfs r _load_frames4AsyncVideoFrameLoader.__init__.._load_framessP #eC $45A A AAT)targetdaemon) img_pathsrboffload_video_to_cpuimg_meanimg_stdrrrsrvrgrfcompute_devicertrthreadstart)ryr~rbrrrrrzs` r__init__AsyncVideoFrameLoader.__init__ns#$$8!   fs9~-  ,  #L>  r(cURb[S5UReURUnUbU$[URUUR 5up#nX0lX@lX R-nX R-nUR(dURURSS9nX RU'U$)NzFailure in frame loading threadT) non_blocking) rvr]rsrhr~rbrgrfrrrr-r)ryindexrergrfs rrt!AsyncVideoFrameLoader.__getitem__s >> %@At~~ Ukk%  ?J)< NN5 !4??* &;)& }} ||((&&,,4&@C E r(c,[UR5$r)rrrs)rys r__len__AsyncVideoFrameLoader.__len__s4;;r() rrvrbrsrr~rrrrgrfN) __name__ __module__ __qualname____firstlineno____doc__rrtr__static_attributes__r(rrjrjis$L* r(rj)g ףp= ?gv/?gCl?)gZd;O?gy&1?g?Frc `[U[5n[U[5nU=(a% [RR U5SS;n U(dU (a[ UUUUUUS9$U(a3[RRU5(a[UUUUUUUS9$[S5e)z Load the video frames from video_path. The frames are resized to image_size as in the model and are loaded to GPU if offload_video_to_cpu=False. This is used by the demo. r:)z.mp4z.MP4) video_pathrbrrrr)rrbrrrasync_loading_framesrz;Only MP4 video and JPEG folder are supported at this moment) isinstancebytesstrospathsplitext!load_video_frames_from_video_fileisdir!load_video_frames_from_jpg_imagesNotImplementedError) rrbrrrrris_bytesis_str is_mp4_paths rload_video_framesrs*e,H  C (FQRWW--j9"=AQQK;0!!!5)    BGGMM*--0!!!5!5)  " I  r(c<[U[5(a'[RR U5(aUnO [ S5e[R "U5Vs/sH-n[RRU5SS;dM+UPM/ n nU RSS9 [U 5n U S:Xa[SU35eU V s/sH"n [RRX{5PM$ n n [R"U[RS9S S 2S S 4n[R"U[RS9S S 2S S 4nU(a([U UUUUU5n XR U R"4$[R$"U S X[RS9n['[)U S S 95Hunn[+UU5uX'nnM U(d3UR-U5nUR-U5nUR-U5nX-nX-nUWW4$s snfs sn f) aD Load the video frames from a directory of JPEG files (".jpg" format). The frames are resized to image_size x image_size and are loaded to GPU if `offload_video_to_cpu` is `False` and to CPU if `offload_video_to_cpu` is `True`. You can load a frame asynchronously by setting `async_loading_frames` to `True`. akOnly JPEG frames are supported at this moment. For video files, you may use ffmpeg (https://ffmpeg.org/) to extract frames into a folder of JPEG files, such as ``` ffmpeg -i .mp4 -q:v 2 -start_number 0 /'%05d.jpg' ``` where `-q:v` generates high-quality JPEG frames and `-start_number 0` asks ffmpeg to start the JPEG file from 00000.jpg.r:)z.jpgz.jpegz.JPGz.JPEGcX[[RRU5S5$)Nr)rrrr)ps r3load_video_frames_from_jpg_images..s3rww'7'7':1'=#>r()keyrzno images found in r5Nrnro)rrrrrrlistdirrsortrrr]joinrtensorfloat32rjrgrfzeros enumeraterrhr-)rrbrrrrr jpg_folderr frame_names num_frames frame_namer~ lazy_imagesrsrwrargrfs rrrs"*c""rww}}Z'@'@ ! <  J''A 77  A r "&H H ' >?[!JQ0 =>>HST *j5 IT||HEMM:1dD=IHll7%--8D$GG+       44k6M6MMM [[Q emm TF i6L!MN 8/B8Z/X, <O >*;;~.**^, F F < ,,EUs *HH )HcSSKn[R"U[RS9SS2SS4n[R"U[RS9SS2SS4nURR S5 UR U5R5Rupxn /n UR XUS9H%n U RU RSSS55 M' [R"U SS9R5S - n U(d3U RU5n URU5nURU5nX-n X-n XU4$) z(Load the video frames from a video file.rNrr)widthheightr r8r;rW)decordrrrbridge set_bridge VideoReadernextr=appendr_rFfloatr-) rrbrrrrrrgrfrHrsframes rrrs||HEMM:1dD=IHll7%--8D$GG MMW%#)#5#5j#A#F#F#H#N#N Lq F##J#T emmAq!,-U[[Q ' - - /% 7F >*;;~.**^, F F  ,,r(cUS:dS5eUn[US:*5up4US:XA:*-n[R"USU5nU$![a*n[R "US3[ SS9 UnSnAU$SnAff=f)zQ A post processor to fill small holes in mask scores with area under `max_area`. rzmax_area must be positiveg?a* Skipping the post-processing step due to the error above. You can still use SAM 2 and it's OK to ignore the error above, although some post-processing functionality may be limited (which doesn't affect the results in most cases; see https://github.com/facebookresearch/sam2/blob/main/INSTALL.md).r r N)r1rrCrurrr)r0max_area input_masklabelsareasis_holerxs rfill_holes_in_mask_scoresr9s a<444<J0; A:%"34{{7C. K   cN N!   K s2A A9A44A9c~UcXpCO4[R"USU/SS9n[R"USU/SS9nX4S.$)zDAdd new points and labels to previous point inputs (add at the end). point_coordsr8r; point_labels)rr)rcat)old_point_inputs new_points new_labelspointsrs r concat_pointsrVsL#,^rs  3<J&u||4 *A A P# !<<'& Z# !<<'@-N# !<<' -@:<  % ELL 89   U\\) * 6;Cc3