ó 6êbiŠãóN•SrSSKJs Jr SSKJr \"S/S9"SS55rg)z&Input dataset creator for `model.fit`.éN)Ú keras_exportz'keras.utils.experimental.DatasetCreator)Úv1có(•\rSrSrSrSSjrSrSrg)ÚDatasetCreatoréa× Object that returns a `tf.data.Dataset` upon invoking. `tf.keras.utils.experimental.DatasetCreator` is designated as a supported type for `x`, or the input, in `tf.keras.Model.fit`. Pass an instance of this class to `fit` when using a callable (with a `input_context` argument) that returns a `tf.data.Dataset`. ```python model = tf.keras.Sequential([tf.keras.layers.Dense(10)]) model.compile(tf.keras.optimizers.SGD(), loss="mse") def dataset_fn(input_context): global_batch_size = 64 batch_size = input_context.get_per_replica_batch_size(global_batch_size) dataset = tf.data.Dataset.from_tensors(([1.], [1.])).repeat() dataset = dataset.shard( input_context.num_input_pipelines, input_context.input_pipeline_id) dataset = dataset.batch(batch_size) dataset = dataset.prefetch(2) return dataset input_options = tf.distribute.InputOptions( experimental_fetch_to_device=True, experimental_per_replica_buffer_size=2) model.fit(tf.keras.utils.experimental.DatasetCreator( dataset_fn, input_options=input_options), epochs=10, steps_per_epoch=10) ``` `Model.fit` usage with `DatasetCreator` is intended to work across all `tf.distribute.Strategy`s, as long as `Strategy.scope` is used at model creation: ```python strategy = tf.distribute.experimental.ParameterServerStrategy( cluster_resolver) with strategy.scope(): model = tf.keras.Sequential([tf.keras.layers.Dense(10)]) model.compile(tf.keras.optimizers.SGD(), loss="mse") def dataset_fn(input_context): ... input_options = ... model.fit(tf.keras.utils.experimental.DatasetCreator( dataset_fn, input_options=input_options), epochs=10, steps_per_epoch=10) ``` Note: When using `DatasetCreator`, `steps_per_epoch` argument in `Model.fit` must be provided as the cardinality of such input cannot be inferred. Args: dataset_fn: A callable that takes a single argument of type `tf.distribute.InputContext`, which is used for batch size calculation and cross-worker input pipeline sharding (if neither is needed, the `InputContext` parameter can be ignored in the `dataset_fn`), and returns a `tf.data.Dataset`. input_options: Optional `tf.distribute.InputOptions`, used for specific options when used with distribution, for example, whether to prefetch dataset elements to accelerator device memory or host device memory, and prefetch buffer size in the replica device memory. No effect if not used with distributed training. See `tf.distribute.InputOptions` for more information. NcóÔ•[U5(d[SU35eU(a7[U[RR 5(d[SU35eXlX lg)NzB`dataset_fn` for `DatasetCreator` must be a `callable`. Received: zW`input_options` for `DatasetCreator` must be a `tf.distribute.InputOptions`. Received: )ÚcallableÚ TypeErrorÚ isinstanceÚtfÚ distributeÚ InputOptionsÚ dataset_fnÚ input_options)Úselfrrs Ú\/home/james-whalen/.local/lib/python3.13/site-packages/tf_keras/src/utils/dataset_creator.pyÚ__init__ÚDatasetCreator.__init__Zso€Ü˜ ×#Ñ#ÜðØ'˜Lð*óð ö ܘ=¬"¯-©-×*DÑ*D×EÑEäð;Ø;H¸/ðKóð ð %ŒØ*Õócóš•UR"U0UD6n[U[RR5(d[ SUS35eU$)NzOThe `callable` provided to `DatasetCreator` must return a Dataset. It returns "Ú")rr r ÚdataÚDatasetr )rÚargsÚkwargsÚdatasets rÚ__call__ÚDatasetCreator.__call__ksQ€ð—/’/ 4Ð2¨6Ñ2ˆÜ˜'¤2§7¡7§?¡?×3Ñ3Üð*Ø*1¨°!ð5óð ðˆr)rr)N)Ú__name__Ú __module__Ú __qualname__Ú__firstlineno__Ú__doc__rrÚ__static_attributes__©rrrrs†ñ>ô@+õ" rr)r#Útensorflow.compat.v2ÚcompatÚv2r Ú tensorflow.python.util.tf_exportrrr%rrÚr*s:ðñ -ç!Ð!õ:ñÐ7¸BÑ?÷[ð[ó@ñ[r