Stack Overflow
Stack Overflow

Questions tagged [tfx]

TensorFlow Extended (TFX) is an end-to-end platform for deploying production ML pipelines

TFX is a Google-production-scale machine learning platform based on TensorFlow. It provides a configuration framework and shared libraries to integrate common components needed to define, launch, and monitor your machine learning system.

Resources

185 questions
0
votes
1 answer

How to run a tensorflow/tfx container?

I am new to docker, and have downloaded the tfx image using docker pull tensorflow/tfx However, I am unable to find anywhere how to successfully launch a container for the same. here's a naive attempt
Rishabh Sood
  • 1
0
votes
0 answers

Tensorflow TFX pipeline in Windows machine is failing when trying to create a folder with Linux like folder naming structure

I am trying to run the simple TFX pipeline in Windows 10 machine. I am using the codes as given in Tensorflow website (https://www.tensorflow.org/tfx/tutorials/tfx/penguin_simple). While trying to run the pipeline, it is throwing below error. The…
Ayan Mullick
  • 1
0
votes
0 answers

Accessing S3 bucket object in TFX pipeline with S3FS

I'm building a TFX pipeline that contains images as input from an S3 bucket. At the TF Transform component step, I'm attempting to read in a series of images with their URLs stored in TFX's SparseTensor format. I'm trying to use the S3FS Python…
John Sukup
  • 303
  • 3
  • 11
0
votes
1 answer

Tensorflow Transform debug and iterative development best practices?

I've been using TFX for several projects now and have found that debuging tf.transform to be extremely challenging. My first few pipelines were composed in Airflow, which required me to commit code, push to Airflow, run Dag to get feedback on code.…
Jason Anderson
  • 93
  • 8
0
votes
1 answer

TFX Evaluator does not run in Dataflow so it fails due to lack of memory for the pod

I am running a pipeline in AI Platform pipelines based on TFX. All components run fine until the Evaluator. It just does not want to run on Dataflow, it runs in the Kubeflow pod, so it fails as there is no enough memory in there. Apache Beam config…
Gorjan Todorovski
  • 61
  • 4
0
votes
1 answer

TFX Pipeline stopped working due to Dataflow job workers getting stuck on startup

I have a TFX Pipeline running in GCP AI Platform Pipelines (managed Kubeflow). It was running fine for some time but suddenly stopped working properly during the BigQuery ExampleGen step. The BQ ExampleGen utilizes Dataflow to read the data from BQ…
Gorjan Todorovski
  • 61
  • 4
0
votes
1 answer

Tensorflow Serving Compiling Failure For CPU AVX AVX2

I use the method in the tfx official document to compile the tfx devel in docker file. The OS is MacOS, intel CPU. here is the docker build code for it #!/bin/bash USER=$1 TAG=$2 TF_SERVING_VERSION_GIT_BRANCH="2.4.1" git clone…
Roger_Yu
  • 11
  • 1
0
votes
1 answer

How to use StatisticsGen with RaggedTensor?

I am having a problem with the StatisticsGen component of TFX. I use TFRecords and as input data I use RaggedTensors (The TFrecord is created with SequenceExample) After using ExampleGen which splits the file correctly into train and val,…
GlassExplorer89
  • 61
  • 1
  • 11
0
votes
0 answers

ImportError: cannot import name 'execution_result_pb2'

I'm trying to execute the TFX-Airflow tutorial (https://www.tensorflow.org/tfx/tutorials/tfx/airflow_workshop). When I try to connect to the server using airflow webserver -p 8008 it gives me the following error Traceback (most recent call last): …
user42
  • 871
  • 1
  • 10
  • 28
0
votes
1 answer

TFX Evaluator seems it is not recognizing the baseline model output from the ResolverNode

I want to use the validation capabilities (model diff or model comparison) of the model Evaluator component in TFX, so I used the base code of taxi template in TFX to do so. The problem is that when the Evaluator component runs in Kubeflow on GCP…
alexis
  • 11
  • 1
0
votes
1 answer

How to add custom feature transformation logic before TensorFlow Serving?

According to my research, TFX does not provide support for custom feature transformation within the TFX Pipeline as my custom python functions cannot be serialized inside the graph. Therefore making said functions unavailable at serving/inference…
MachineLearner
  • 21
  • 2
0
votes
3 answers

Getting pip dependency error following TFX tutorial

I'm trying to follow the Tensorflow Extended tutorial from the official website: https://www.tensorflow.org/tfx/tutorials/tfx/components_keras When I try executing the line pip install -q -U --use-feature=2020-resolver tfx I get the following…
cooldecola
  • 118
  • 7
0
votes
1 answer

MultiOutput Classification with TensorFlow Extended (TFX)

I'm quite new to TFX (TensorFlow Extended), and have been going through the sample tutorial on the TensorFlow portal to understand a bit more to apply it to my dataset. In my scenario, instead of predicting a single label, the problem at hand…
Warren Lee
  • 31
  • 2
0
votes
1 answer

Migrating legacy ML pipeline to TFX

We are investigating transitioning our ML pipelines from a set of manual steps into a TFX pipeline. I do however have some questions for which I would like to have some additional insights. We typically perform the following steps (for an image…
Bart Diricx
  • 1
0
votes
1 answer

TensorFlow Extended Kubeflow Multiple Workers

I have an issue with TFX on Kubeflow DAG Runner. Issues is that I managed to start only one pod per run. I don't see any configuration for "workers" except on the Apache Beam arguments, which doesn't help. Running CSV load on one pod results in…
Milorad
  • 155
  • 14
1 2 3
…
12 13