h SSKJrJr SSKJr SSKJr SSKJr SSK J r \"SS55r Sr S r \"S 5r\S :Xa\ "\ 5r\R#5Sr\"S S S9r\R)\ /SQ\R*S9r\R-\ 5r\R/SSS9r\R0(a6\R1\R25 \R1\R2SS9 ggg)) dataclassfield)Optional) load_dataset) ModelCard)HfArgumentParserct\rSrSr%Sr\"SSS0S9r\\S'\"SSS 0S9r \ \S '\"S SS 0S9r \ \ \S 'Srg )ScriptArgumentsa Arguments for the script. Args: push_to_hub (`bool`, *optional*, defaults to `False`): Whether to push the dataset to the Hugging Face Hub. repo_id (`str`, *optional*, defaults to `"trl-lib/ultrafeedback-prompt"`): Hugging Face repository ID to push the dataset to. dataset_num_proc (`int` or `None`, *optional*, defaults to `None`): Number of workers to use for dataset processing. Fhelpz4Whether to push the dataset to the Hugging Face Hub.)defaultmetadata push_to_hubztrl-lib/ultrafeedback-promptz2Hugging Face repository ID to push the dataset to.repo_idNz0Number of workers to use for dataset processing.dataset_num_proc)__name__ __module__ __qualname____firstlineno____doc__rrbool__annotations__rstrrrint__static_attributes__r`/home/james-whalen/.local/lib/python3.13/site-packages/examples/datasets/ultrafeedback-prompt.pyr r si PQK.NOGS',LM'hsmrr cSUSS./nSU0$)Nuser instruction)rolecontentpromptr)exampler$s rto_unpaired_preferencer&3s'-*@A BF f rc6[USSS5S:agg)Nr$rr#iFT)len)r%s rdrop_long_promptr)8s$ 78 Q  *+c1ra --- tags: [trl] --- # UltraFeedback - Prompts Dataset ## Summary The UltraFeedback - Prompts dataset is a processed version of the [UltraFeedback](https://huggingface.co/datasets/openbmb/UltraFeedback) dataset for model evaluation on specific aspects like helpfulness, honesty, and instruction-following. ## Data Structure - **Format**: [Conversational](https://huggingface.co/docs/trl/main/dataset_formats#conversational) - **Type**: [Prompt-only](https://huggingface.co/docs/trl/main/dataset_formats#prompt-only) Column: - `"prompt"`: The input question or instruction provided to the model. ## Generation script The script used to generate this dataset can be found [here](https://github.com/huggingface/trl/blob/main/examples/datasets/ultrafeedback-prompt.py). __main__zopenbmb/UltraFeedbacktrain)split)sourcer!models completionscorrect_answersincorrect_answers)remove_columnsnum_procg?*) test_sizeseeddataset) repo_typeN) dataclassesrrtypingrdatasetsrhuggingface_hubr transformersrr r&r) model_cardrparserparse_args_into_dataclasses script_argsr7maprfiltertrain_test_splitrrrrrrEs)!%)  6  0 z o .F446q9K2'BGkkq--G nn-.G&&B&?GK//0{22iHr