Stack Overflow
Stack Overflow

Questions tagged [tfx]

TensorFlow Extended (TFX) is an end-to-end platform for deploying production ML pipelines

TFX is a Google-production-scale machine learning platform based on TensorFlow. It provides a configuration framework and shared libraries to integrate common components needed to define, launch, and monitor your machine learning system.

Resources

185 questions
0
votes
1 answer

TFX docker image is heavy

I was just wondering why tensorflow/tfx image is 8Gb while gpu tensorflow/tensorflow image is less than 3gB? At runtime, I expect tfx container to just load input artifacts, run some tensorflow code and then save output artifacts. So i can't figure…
Youcef Kacer
  • 11
  • 2
0
votes
0 answers

Tensorflow Transform Fails Converting Strings to Numbers

I am trying to fit a TensorFlow model and one my features comes in as a comma-separated string of ints (possibly empty string). The feature appears in the pretransform schema as feature { name: "csstring" type: BYTES presence { …
user1337
  • 87
  • 7
0
votes
1 answer

Impossible to get post transform statistics by split

I'm running a simple penguin pipeline in interactive mode with a split train/eval, the transform step run but i can't get post_transform_statistics artifacts. Inside the dedicated artifacts folder…
Youcef Kacer
  • 11
  • 2
0
votes
0 answers

need help compiling a folder named "build"

need help compiling the build folder Inside of the build folder is a bunch of json files and .tfx. Expecting a single file to come out that i can ./ the file
everything
  • 1
0
votes
1 answer

str() is not usable anymore to get true value of a Text tfx.data_types.RuntimeParameter during pipeline execution

how to get string as true value of tfx.orchestration.data_types.RuntimeParameter during execution pipeline? Hi, I'm defining a runtime parameter like data_root = tfx.orchestration.data_types.RuntimeParameter(name='data-root', ptype=str) for a base…
Youcef Kacer
  • 11
  • 2
0
votes
1 answer

tfx.components.StatisticsGen display train and eval in two different figures, is it possible to have them in a single figure as tfdv does?

a superimposed display for train/val splits using StatisticsGen Hi, I'm currently using tfx pipeline inside kubeflow. I struggle to have StatisticsGen showing a single graph with train and validation splits curves superimposed, allowing better…
Youcef Kacer
  • 11
  • 2
0
votes
0 answers

Having NoneType error in multiple pipeline build using TFX and Airflow

I am working with TFX and AIrflow to build the pipeline for image classification and segmentation. I am replicating the repo by Jan Marcel Kezmann (Link). While executing the classification_dag.py in dags/classification_pipeline and…
Bhargav Patel
  • 1
  • 1
0
votes
1 answer

Dealing with missing values in tensorflow

I need some guidance on the approach to imputation in tensorflow/deep learning. I am familiar with how scikit-learn handles imputation, and when I map it to the tensorflow ecosystem, I would expect to use preprocessing layers in keras or functions…
Pritam Dodeja
  • 177
  • 1
  • 8
0
votes
1 answer

How to visualize a saved statistics artifact?

I know of two ways to run a TFX pipeline. First, using a Jupyter notebook with InteractiveContext in a browser: from tfx import v1 as tfx from tfx.orchestration.experimental.interactive.interactive_context import InteractiveContext context =…
Mehran
  • 15,593
  • 27
  • 122
  • 221
0
votes
0 answers

I am struggling to write a transform python file for the tfx pipeline in transform component. I am working with object detection task

I am building a pipeline using tensorflow extended. The dataset is already conversted to the tfrecord for the ingestion. I want to do data preprocessing such as scalin, data augmentation along with bbox and prepare data for the object detection…
Bhargav Patel
  • 1
  • 1
0
votes
1 answer

How to get the uri of the current pipeline's artifact

Consider the following pipeline: example_gen = tfx.components.ImportExampleGen(input_base=_dataset_folder) statistics_gen = tfx.components.StatisticsGen(examples=example_gen.outputs['examples']) schema_gen = tfx.components.SchemaGen( …
Mehran
  • 15,593
  • 27
  • 122
  • 221
0
votes
0 answers

How to write a preprocessing_fn function that relies on an Artifact?

Let's consider a very straightforward pipeline like this: example_gen = tfx.components.ImportExampleGen(input_base=_dataset_folder) statistics_gen = tfx.components.StatisticsGen(examples=example_gen.outputs['examples']) schema_gen =…
Mehran
  • 15,593
  • 27
  • 122
  • 221
0
votes
2 answers

MLOps with TFX: How to ingest data when using Sequence from Keras?

I am using a class called DataGenerator, that returns a tuple (data_array, label_array), follows the code: from tensorflow.keras.utils import Sequence class DataGenerator(Sequence): """ path_data: the path of the csv files """ ... This…
Alexander Martins
  • 343
  • 1
  • 11
0
votes
1 answer

A TFX equivalent for Pytorch

I'v recently worked with TensorFlow Extended(TFX) platform. Since my development background is on Pytorch stack, I'm looking for well-compatible alternatives of TFX for Pytorch. While searching for this alternative, I came across torchx and…
Mohsen Mahmoodzadeh
  • 111
  • 1
  • 10
0
votes
0 answers

TFX custom config argument in trainer not working

This question is based on the TFX recommender tutorial. Please note that the code is being orchestrated by LocalDagRunner rather than run interactively in a notebook. In the Trainer, we pass in a custom_config with the transformed ratings and…
Ben
  • 1,561
  • 4
  • 21
  • 33
1 2 3
…
12 13