Vi&SrSSKJr SSKrSSKrSSKrSrSS/r\SS4Sjr"S S\ 5r \ S :Xa S r \ "5 gg) z``jsonutils`` aims to provide various helpers for working with JSON. Currently it focuses on providing a reliable and intuitive means of working with `JSON Lines`_-formatted files. .. _JSON Lines: http://jsonlines.org/ )print_functionN JSONLIteratorreverse_iter_linesTc## U=(d URnSnUnUR5nSupVnU(a UR S[ R5 UnUR5n SU :a[X5n X-n UR U [ R5 URU 5n X-nUR5n [U 5S:d U SU:XaMtUSSU:Xa U(aUOUv U SSS2Hn U(aU RU5OU v M! U SnSU :aMU(aU(aURU5OUv gg![a SnGNGf=f![[R4a GNUf=f7f)aReturns an iterator over the lines from a file object, in reverse order, i.e., last line first, first line last. Uses the :meth:`file.seek` method of file objects, and is tested compatible with :class:`file` objects, as well as :class:`StringIO.StringIO`. Args: file_obj (file): An open file object. Note that ``reverse_iter_lines`` mutably reads from the file and other functions should not mutably interact with the file object after being passed. Files can be opened in bytes or text mode. blocksize (int): The block size to pass to :meth:`file.read()`. Warning: keep this a fairly large multiple of 2, defaults to 4096. preseek (bool): Tells the function whether or not to automatically seek to the end of the file. Defaults to ``True``. ``preseek=False`` is useful in cases when the file cursor is already in position, either at the end of the file or in the middle for relative reverse line generation. zutf-8N) r)encodingAttributeErrordetachioUnsupportedOperationseekosSEEK_ENDtellminSEEK_SETread splitlineslendecode)file_obj blocksizepreseekr orig_obj empty_bytes newline_bytes empty_textbuffcur_pos read_sizecurlineslines d/home/james-whalen/.local/share/pipx/venvs/semgrep/lib/python3.13/site-packages/boltons/jsonutils.pyrr6sq00x00 H ??$.=*K  a% DmmoG g+ +  gr{{+mmI&z! u:>U1X4  9 % (*k 9%1R%LD+3$++h' =!Qx g+ '/dkk(#T9 E  B33 4   sPFEFE&C>F.%F E#F"E##F&FFFFcP\rSrSrSrS Sjr\S5rSrSr Sr S r \ r S r g) r~aThe ``JSONLIterator`` is used to iterate over JSON-encoded objects stored in the `JSON Lines format`_ (one object per line). Most notably it has the ability to efficiently read from the bottom of files, making it very effective for reading in simple append-only JSONL use cases. It also has the ability to start from anywhere in the file and ignore corrupted lines. Args: file_obj (file): An open file object. ignore_errors (bool): Whether to skip over lines that raise an error on deserialization (:func:`json.loads`). reverse (bool): Controls the direction of the iteration. Defaults to ``False``. If set to ``True`` and *rel_seek* is unset, seeks to the end of the file before iteration begins. rel_seek (float): Used to preseek the start position of iteration. Set to 0.0 for the start of the file, 1.0 for the end, and anything in between. .. _JSON Lines format: http://jsonlines.org/ Nc[U5UlXlX lUc U(aSnO(SUs=:aS:dO [ SU-5eUS:aSU- nX@lSUlUbUR5 UR(a%[URUR SS9Ul g[UR5Ul g)N?gz8'rel_seek' expected a float between -1.0 and 1.0, not %rrrF)rr) bool_reverse _file_obj ignore_errors ValueError _rel_seek _blocksize_init_rel_seekr _line_iteriter)selfrr1reverserel_seeks r)__init__JSONLIterator.__init__sW  !*  &3&57?@A A \X~H!      ! ==0;???9>@DO#4>>2DOrc6URR5$)zBA property representing where in the file the iterator is reading.)r0rr8s r) cur_byte_posJSONLIterator.cur_byte_poss~~""$$rcURURp!Sup4UR5nSU;aURU5nXB- nSU;aMUR S5U-U- nUR XV-5 g![ a ef=f)z6Aligns the file object's position to the next newline.)r r N)r0r4rrindexr2r)r8fobsizer& total_readr$newline_offsets r)_align_to_newlineJSONLIterator._align_to_newlinesNNDOOE'')#o''%.C  J#o  YYt_z9EAN ()   s A;; BcURURp!US:Xa!URS[R5 gURS[R 5 UR 5nUS:XaX0lg[X1-5nURU[R5 UR5 UR 5Ulg)zCSets the file object's position to the relative location set above.grr-N) r3r0rrrrr_cur_posintrH)r8rsrDsizetargets r)r5JSONLIterator._init_rel_seeksB 9 GGAr{{ # GGAr{{ #779DSy $ TY ,&&( "  rcU$)Nr>s r)__iter__JSONLIterator.__iter__s rc[UR5R5nU(dM-[R"U5nU$![ a UR (deMef=f)zYields one :class:`dict` loaded with :func:`json.loads`, advancing the file object by one line. Raises :exc:`StopIteration` upon reaching the end of the file (or beginning, if ``reverse`` was set to ``True``. )nextr6lstripjsonloads Exceptionr1)r8r(objs r)rVJSONLIterator.nexts^ (//1D jj& J  )) sAA'&A')r4rKr0r6r3r/r1)FFN)__name__ __module__ __qualname____firstlineno____doc__r;propertyr?rHr5rSrV__next____static_attributes__rRrr)rr~sA.?C32%% ** "Hr__main__c &SSKnSUR;dSUR;a [S5 gSnSUR;dSUR;aSnS up#URS SnUHnUS ;aM US - n[US 5n[ U5nSn[ U5 US - nUS - nU(aSU(aLUS-S:XaCURRS5 US-(aURRSU-5 Mr U(a[SU-5 [SU-5 g![ a0 [S US -<SUR<SU<35 SSS5 g[a Of=fSSS5 GM!,(df  GM&=f)Nr-h--helpz7loads one or more JSON Line files for basic validation.F-v --verboseT)rr)rgrhrirjrbzerror reading object #z around byte z in d.i'z%s zfiles checked: %szobjects loaded: %s) sysargvprintopenrrVr2r? StopIterationstdoutwrite) roverbose file_count obj_count filenamesfilenameriterator cur_obj_counts r)_mainr}s 388 x3883 K L  388 {chh6G $ HHQRL !H>> !OJh%(2 ! XNI!Q&M9SA1E ((-$u,JJ,,Vi-?@",  % 2 3 &2 3&!.!2H4I4I8UV&%)&%%%s=F D-!A&F-.E2F& E2/F1E22F F ) ra __future__rrrrXDEFAULT_BLOCKSIZE__all__robjectrr]r}rRrr)rsoB&  0 1,=dUY=:BgFgT z#J GMr