zoo.orca.data.tf package

Submodules

zoo.orca.data.tf.data module

class zoo.orca.data.tf.data.Dataset(xshards, create_dataset_fn)[source]

Bases: object

Represents a distributed set of elements backed by an RDD, which is created by applying tensorflow dataset transformations on each partitions.

as_graph_rdd(batch_per_shard, drop_remainder=True)[source]
static from_tensor_slices(xshards)[source]
map(map_func)[source]
class zoo.orca.data.tf.data.MapDataset(input_dataset, map_func)[source]

Bases: zoo.orca.data.tf.data.Dataset

class zoo.orca.data.tf.data.TFDataDataset2(dataset, batch_size, batch_per_thread, validation_dataset=None, intra_threads=None, inter_threads=None)[source]

Bases: zoo.tfpark.tf_dataset.TFDataset

get_num_partitions()[source]
Returns:the num of partitions of the underlying RDD
class zoo.orca.data.tf.data.TensorSliceDataset(xshards)[source]

Bases: zoo.orca.data.tf.data.Dataset

Module contents