hjSSKJrJr SSKJr SSKJr SSKJr SSK J r \"SS55r Sr \"S 5r \S :Xa\ "\ 5r\R!5Sr\"S S 5r\R'\ \R(/S QS9r\R*(a6\R+\R,5 \ R+\R,SS9 ggg)) dataclassfield)Optional) load_dataset) ModelCard)HfArgumentParserct\rSrSr%Sr\"SSS0S9r\\S'\"SSS 0S9r \ \S '\"S SS 0S9r \ \ \S 'Srg )ScriptArgumentsa Arguments for the script. Args: push_to_hub (`bool`, *optional*, defaults to `False`): Whether to push the dataset to the Hugging Face Hub. repo_id (`str`, *optional*, defaults to `"trl-lib/tldr-preference"`): Hugging Face repository ID to push the dataset to. dataset_num_proc (`int` or `None`, *optional*, defaults to `None`): Number of workers to use for dataset processing. Fhelpz4Whether to push the dataset to the Hugging Face Hub.)defaultmetadata push_to_hubztrl-lib/tldr-preferencez2Hugging Face repository ID to push the dataset to.repo_idNz0Number of workers to use for dataset processing.dataset_num_proc)__name__ __module__ __qualname____firstlineno____doc__rrbool__annotations__rstrrrint__static_attributes__r[/home/james-whalen/.local/lib/python3.13/site-packages/examples/datasets/tldr_preference.pyr r si PQK)NOGS',LM'hsmrr c~USnUSS;a"USRSS5nSUSSUS 3nOdUS[S S 5Vs/sHnSU3PM snS /-;a(US RSS5nSUSSUSSUS 3nO[SUS35eUSnSU- nUSUSnUSUSn X8U S.$s snf)Ninfobatch) batch0_cnndmcnndm0cnndm2articlez  zTITLE: titlez TL;DR:r edit_b2_eval_testpostz SUBREDDIT: r/ subredditz TITLE: z POST: zUnknown batch: choice summariestext)promptchosenrejected)replacerange ValueError) exampler r%r0ir* chosen_idx rejected_idxr1r2s r to_preferencer:3s 6?Dw??y/))&$74=/gYjA  5B<@>"Jz>L [ !* -f 5F{#L1&9HH EEAsB:a --- tags: [trl] --- # TL;DR Dataset for Preference Learning ## Summary The TL;DR dataset is a processed version of Reddit posts, specifically curated to train models using the [TRL library](https://github.com/huggingface/trl) for preference learning and Reinforcement Learning from Human Feedback (RLHF) tasks. It leverages the common practice on Reddit where users append "TL;DR" (Too Long; Didn't Read) summaries to lengthy posts, providing a rich source of paired text data for training models to understand and generate concise summaries. ## Data Structure - **Format**: [Standard](https://huggingface.co/docs/trl/main/dataset_formats#standard) - **Type**: [Preference](https://huggingface.co/docs/trl/main/dataset_formats#preference) Columns: - `"prompt"`: The unabridged Reddit post. - `"chosen"`: The concise "TL;DR" summary appended by the author. - `"rejected"`: An alternative summary or response that was not selected. This structure enables models to learn the relationship between detailed content and its abbreviated form, enhancing their summarization capabilities. ## Generation script The script used to generate this dataset can be found [here](https://github.com/huggingface/trl/blob/main/examples/datasets/tldr_preference.py). __main__zopenai/summarize_from_feedback comparisons)r r.r,workerr!splitextra)num_procremove_columnsdataset) repo_typeN) dataclassesrrtypingrdatasetsrhuggingface_hubr transformersrr r: model_cardrparserparse_args_into_dataclasses script_argsrBmaprrrrrrrNs)!%)  6F$ 8 z o .F446q9K;]KGkk--[G K//0{22iHr