h! SrSSKrSSKrSSKrSSKrSSKJ r J r SSK J r \R"\5rSrSrSrSrS r\4S jrS rS r"S S\R25r"SS\R25r"SS\5rg!\a SrNxf=f)zyImplements reading and writing to/from WebHDFS. The main entry point is the :func:`~smart_open.webhdfs.open` function. NT)utils constantswebhdfs)zwebhdfs://host:port/path/filei c[[US9$)N)schemeuri)dictSCHEME) uri_as_strs L/home/james-whalen/.local/lib/python3.13/site-packages/smart_open/webhdfs.py parse_urir 's v: ..cP[R"[U5n[X40UD6$N)r check_kwargsopen)rmodetransport_paramskwargss r open_urir+s%   &6 7F  $V $$rcUR[5(a [U5nU[R:Xa [ U5nO,U[R :Xa [XS9nO[SU-5eURS5SUl U$)z Parameters ---------- http_uri: str webhdfs url converted to http REST url min_part_size: int, optional For writing only. ) min_part_sizez+webhdfs support for mode %r not implemented/) startswithr _convert_to_http_urir READ_BINARYBufferedInputBase WRITE_BINARYBufferedOutputBaseNotImplementedErrorsplitname)http_urirrfobjs r rr0s{6""'1 y$$$ * '' '!(H!"ORV"VWWs#B'DI Krc[RRU5nURnUR(aUSR UR5- nUR nUR(a;UU(aSOSS-[RRUR5-- n[RRSUSUR-US45$)z Convert webhdfs uri to http url and return it as text Parameters ---------- webhdfs_url: str A URL starting with webhdfs:// z:{}&z user.name=httpz /webhdfs/v1) urllibparseurlsplithostnameportformatqueryusernamequote urlunsplitpath) webhdfs_url split_urinetlocr0s r rrHs %%k2I   F~~%,,y~~.. OOE Sr\ 1FLL4F4FyGYGY4Z Z  << " " 7C rc,[UR5$r)rr) parsed_uris r convert_to_http_urir:cs   //rcf\rSrSrSrSrSr\S5rSr Sr Sr SS jr SS jr S rS rS rg)rgNcXlSSS.n[R"URUSS9UlURR[ R :wa[RUR5eSUl g)NOPENr)opoffsetT)paramsstreamr) _urirequestsget _response status_codehttplibOKWebHdfsException from_response_buf)selfrpayloads r __init__BufferedInputBase.__init__js[ 1-!diiM >> % % 3"00@ @ rc`[RS5 UR(dSUlgg)zFlush and close this stream.z close: calledN)loggerdebugclosedrLrMs r closeBufferedInputBase.closevs! _%{{DIrcURSL$r)rLrUs r rTBufferedInputBase.closed|syyD  rcg)z+Return True if the stream can be read from.TrUs r readableBufferedInputBase.readablercg)zqIf False, seek(), tell() and truncate() will raise IOError. We offer only seek support, and no truncate support.Fr[rUs r seekableBufferedInputBase.seekablesrc"[Re)z Unsupported.ioUnsupportedOperationrUs r detachBufferedInputBase.detachs%%%rcUc;SURURRR5-sUlnU$U[ UR5:a&URUSURSUsUlnU$UR/nSnXA:aiURRR[ R 5n[ U5S:XaO&U[ U5- nURU5 XA:aMiSRW5UlURUSURSUsUlnU$![a NHf=f)Nrr) rLrFrawreadlenrdDEFAULT_BUFFER_SIZEappend StopIterationjoin)rMsizeretvalbuffers total_readraw_datas r rjBufferedInputBase.reads, < #TYY1C1C1H1H1J%J DIvM C N " $ $% 0$))ET2B DIvM yykGJ#>>--2223I3IJx=A%c(m+ x(#HHW%  IIde,dii.> 6    s?AD8$D88 EEc URUS9$)zThis is the same as read().)rp)rj)rMrps r read1BufferedInputBase.read1syydy##rcvUR[U55nU(dgX!S[U5&[U5$)zDRead up to len(b) bytes into b, and return the number of bytes read.rN)rjrk)rMbdatas r readintoBufferedInputBase.readintos3yyQ *3t9 4yrcxSURURRR5-sUlnU$)Nr)rLrFrireadline)rMrqs r rBufferedInputBase.readlines1T^^-?-?-H-H-J!J 6 r)rLrFrCr)r)__name__ __module__ __qualname____firstlineno__rLrOrVpropertyrTr\r`rfrjrwr|r__static_attributes__r[rr rrgsH D !!&6$rrcN\rSrSr\4SjrSrSrSrSr Sr \ S5r S r g ) r cXlSUlX lSSS.n[R"URUSS9nUR [ R:Xd[RU5eURSn[R"USSS 0S 9nUR [ R:Xd[RU5e/Ul S Ul S UlS UlS Ulg ) zK Parameters ---------- min_part_size: int, optional For writing only. FCREATET)r? overwriterAallow_redirectslocationr( content-typeapplication/octet-streamr{headersrN)rC_closedrrDputrGrHTEMPORARY_REDIRECTrJrKrCREATEDlinesparts chunk_bytes total_sizeri)rMrrrN init_responseresponses r rOBufferedOutputBase.__init__s  *!5 TYYwPUV ((G,F,FF"00? ?##J/<<"~Ga6bc##w6"00: :   rcg)z+Return True if the stream supports writing.Tr[rUs r writableBufferedOutputBase.writabler^rc.[R"S5e)Nzdetach() not supportedrcrUs r rfBufferedOutputBase.detachs%%&>??rcdSS0n[R"URUSS9nUR[R :Xd[ RU5eURSn[R"XASS0S9nUR[R:Xd[ RU5eg) Nr?APPENDFrrrrr) rDpostrCrGrHrrJrKrrI)rMr{rNrrrs r _uploadBufferedOutputBase._uploads" diiQVW ((G,F,FF"00? ?##J/==*8:T)UW##wzz1"00: :2rcUR(a [S5e[U[5(d [ S5eUR R U5 U=R[U5- slU=R[U5- sl URUR:aSRUR 5n[RSUR[U5URS- 5 URU5 [R!SUR5 U=RS- sl/SsUlUlg g ) zP Write the given bytes (binary string) into the WebHDFS file from constructor. zI/O operation on closed filezinput must be a binary stringrz+uploading part #%i, %i bytes (total %.3fGB)Azupload of part #%i finishedrN)r ValueError isinstancebytes TypeErrorrrmrrkrrrorRinforrrS)rMrzbuffs r writeBufferedOutputBase.writes <<;< <!U##;< < ! CF" 3q6!   t11 188DJJ'D KK= CIt'D  LL  LL6 C JJ!OJ+-q (DJ( 2rc(SRUR5nU(ai[RSUR[ U5UR S- 5 URU5 [RSUR5 SUl g)Nrz0uploading last part #%i, %i bytes (total %.3fGB)rz upload of last part #%i finishedT) rorrRrrrkrrrSr)rMrs r rVBufferedOutputBase.closesfxx #  KKB CIt'D  LL  LL;TZZ H rcUR$r)rrUs r rTBufferedOutputBase.closeds ||r)rrCrrrrrirN)rrrr MIN_PART_SIZErOrrfrrrVrrTrr[rr r r s9*7B@ ;14 rr cB^\rSrSrSU4SjjrSr\S5rSrU=r $)rJicV>XlX l[[U][ U55 gr)msgrGsuperrJrOrepr)rMrrG __class__s r rOWebHdfsException.__init__ s"& .tDz:rcxSRURRURUR5$)Nz{}(status_code={}, msg={!r}))r/rrrGrrUs r __repr__WebHdfsException.__repr__%s0-44 NN # #T%5%5txx  rc8U"URURS9$)NrrG)textrG)clsrs r rKWebHdfsException.from_response*sx}}(2F2FGGrr)r(N) rrrrrOr classmethodrKr __classcell__)rs@r rJrJs#;  HHrrJ)__doc__rdlogging urllib.parser*rD ImportError MISSING_DEPS smart_openrr http.clientclientrH getLoggerrrRr URI_EXAMPLESrr rrrr:BufferedIOBaserr ExceptionrJr[rr rs  (   8 $   /% (5060T))Tn^**^B Hy HULsBB  B