D_iSrSSKrSSKrSSKJr SSKJrJr \R"\ 5r Sr Sr SSR\ Vs/sHn\RU5S -PM sn5-S -rSSR\ Vs/sHn\RU5PM sn5-S -rS \S \S 3rSS.S\S\\R&-S-S\\4SjjrSSSSSS.S\S\S\S-S\\R&-S-S\S\\S\S\\4Sjjrgs snfs snf)z Utilities for working with HTML.N)Sequence)urljoinurlparse)z javascript:zmailto:#) z.cssz.jsz.icoz.pngz.jpgz.jpegz.gifz.svgz.csvz.bz2z.zipz.epubz(?!|z[\#'\"])z href=[\"']z((?:z .)*?)[\#'\"]patternraw_htmlr returncpU=(d [n[[[R"X555$)zExtract all links from a raw HTML string. Args: raw_html: original HTML. pattern: Regex to use for extracting links from raw HTML. Returns: all links )DEFAULT_LINK_REGEXlistsetrefindall)r r s S/home/james-whalen/.local/lib/python3.13/site-packages/langchain_core/utils/html.pyfind_all_linksr$s(++G BJJw12 33TF)base_urlr prevent_outsideexclude_prefixescontinue_on_failureurlrrrrc^UbUOUn[U5n[U5n [XS9n [5n U Hn [U 5n U RS;aU nO`U R S5(aU RSU 3nO8[ XR 5nU R(aUSU R3- nU RU5 M /nU Hvm[U4SjU55(aMU(a?[T5nURUR:waMMTR U5(dMeURT5 Mx U$![a*nU(a[RSX5 SnAGMEeSnAff=f) a[Extract all links from a raw HTML string and convert into absolute paths. Args: raw_html: original HTML. url: the url of the HTML. base_url: the base URL to check for outside links against. pattern: Regex to use for extracting links from raw HTML. prevent_outside: If `True`, ignore external links which are not children of the base URL. exclude_prefixes: Exclude any URLs that start with one of these prefixes. continue_on_failure: If `True`, continue if parsing a specific link raises an exception. Otherwise, raise the exception. Returns: sub links. Nr >httphttpsz//:?z-Unable to load link %s. Raised exception: %sc3F># UHnTRU5v M g7f)N) startswith).0exclude_prefixpaths r $extract_sub_links..ksVEU>t~..EUs!)rrrschemer"rr%queryadd Exceptionloggerwarninganynetlocappend)r rrr rrrbase_url_to_useparsed_base_url parsed_url all_linksabsolute_pathslink parsed_link absolute_patheresults parsed_pathr%s @rextract_sub_linksr<4sd4#+"6hCO/O#Jx9IUN "4.K!!%66 $ &&#-#4#4"5Qtf = '-=-= > $$!q):):(;%<rMs& $*   8 $4  CHH9KL9KAbiilZ/9KL MMPSS CHH,>?,>qbiil,>? @@3F*+40H/IV :> 4 4"RZZ/$6 4 #Y 4( '+ &( %FF FDj F 2::  $ F  FsmFF #YF5M@s D 9D