Stack Overflow
Stack Overflow

Questions tagged [tfx]

TensorFlow Extended (TFX) is an end-to-end platform for deploying production ML pipelines

TFX is a Google-production-scale machine learning platform based on TensorFlow. It provides a configuration framework and shared libraries to integrate common components needed to define, launch, and monitor your machine learning system.

Resources

185 questions
1
vote
0 answers

TFX: Using Transformed data in the Evaluator

TLDR; i'm facing an issue with the Evaluator model. All examples of using the Evaluator component use the label from the original ExampleGen data as the source of labels. But I want to give it labels that I compute during the pipeline. Is there a…
Sultan Baghlaf
  • 11
  • 2
1
vote
0 answers

how to build Docker image for TFX+GPU support?

I am trying to train an ML Model on Cloud AI Platform's Training Job via TFX+Kubeflow(Pipeline service). Whenever the Trainer job is triggered, I see the log messages complaining something about CUDA. 2021-02-14 23:39:45.470214: W…
박찬성
  • 11
  • 1
1
vote
0 answers

"Create a TFX pipeline using templates" giving error "Build Failed. No push access to specified image repository."

My team and I are setting up a pipeline in GCP, and we are trying to learn by running a notebook tutorial https://www.tensorflow.org/tfx/tutorials/tfx/cloud-ai-platform-pipelines. However, when we get to the step where we are creating the pipeline,…
gruppe3
  • 11
  • 2
1
vote
0 answers

How to propagate mlpipeline-metrics from custom Python function TFX component?

Note: this is a copy of a GitHub issue I reported. It is re-posted in hope to get more attention, I will update any solutions on either site. Question I want to export mlpipeline-metrics from my custom Python function TFX component so that it is…
Axel Tidemann
  • 11
  • 4
1
vote
1 answer

In TFX, is it possible to infer Schema with dates?

I'm using TFX (more precisely TensorFlow Data Validation) with the infer_schema method documented there https://www.tensorflow.org/tfx/data_validation/api_docs/python/tfdv/infer_schema. It generates a schema from a csv file describing column…
Pixou
  • 1,719
  • 13
  • 23
1
vote
0 answers

Unable to use Sentence embeddings in Transform component (TFX)

I am working with a review dataset where the columns are numerical or categorical. The last column though, is a text review (paragraph of english sentences) so I used the Universal Sentence Encoder…
Raghuveer
  • 1,737
  • 20
  • 27
1
vote
1 answer

How to push a blessed model to S3 with TFX Pusher?

I would like to push a blessed model to an S3 bucket. The closest thing I could find is this which pushes a model to the google could ai platform. Is there a Pusher for S3 ? Thanks
JM Montanier
  • 78
  • 6
1
vote
1 answer

TensorFlow Extended: Specifying Valency Of Features In Schema

I am presently trying to feed a dataset with a few multivalent feature columns through a TensorFlow Extended (TFX) pipeline. Here is a row from my sample data: user_id 29601 product_id 28 touched_product_id …
Michael
  • 343
  • 3
  • 13
1
vote
1 answer

TFX component CsvExampleGen always yields Examples with empty outputs (and inputs)

I can run CsvExampleGen without an error message, but the outputs (and inputs) of the resulting Examples are always empty. I am using tfx==0.24.0. To use CsvExampleGen for reading CSV files, according to the docu & tutorials (incl.…
Felix
  • 11
  • 4
1
vote
1 answer

TFX. Properties for CsvCoder in CsvExampleGen: 'Columns do not match specified csv headers'

I am working with TensorFlow Extended and stack in a loading .csv file. This file has ; separation and can't be read by default TFX generator CsvExampleGen(). It throws out the following error: ValueError: Columns do not match specified csv…
Oleks
  • 31
  • 4
1
vote
1 answer

How do I call ExampleValidator to analyze split data sets?

Using: Tensorflow version: 2.3.1 TFX version: 0.23.1 TFDV version: 0.24.0 TFMA version: 0.24.0 with an interactive context like so: from tfx.orchestration.experimental.interactive.interactive_context import \ InteractiveContext context =…
Lorin S.
  • 754
  • 8
  • 29
1
vote
0 answers

TFX complains upstream components were not run in interactive mode

Please find notebook here https://colab.research.google.com/drive/1Qb-uv5JtyZhMl1BEVHplZmfULgV-BN45?usp=sharing The upstream components (transformed examples in this caser were executed succesfully with context.run() however trainer still complains…
physicist
  • 844
  • 1
  • 12
  • 24
1
vote
2 answers

What are the best practices for setting up machine learning pipelines with TFX?

In addition to what is covered by the TFX Guide, what are other best practices for setting up machine learning pipelines?
Jarek Wilkiewicz
  • 1,124
  • 11
  • 20
1
vote
0 answers

What would be best practice for placing pre-processing and augmentation of images in a TFX pipeline?

I have a semantic segmentation deep learning model which i want to deploy on kubeflow using TFX. As I am moving the standalone DL code to TFX components I was having some questions The input images and masks will be stored in a tf-record. Would it…
physicist
  • 844
  • 1
  • 12
  • 24
1
vote
0 answers

Unable to install tfx in conda virtual env

I am successfully able to install TFX on my conda root. But, when I am trying the same on conda virtual env, I am facing errors with the TFX dependencies like, ml_metadata, tfx-bsl. If I use TFX from root, then I am unable to use apache-beam. It…
Meghana Bandaru
  • 67
  • 1
  • 2
  • 6
1 2 3
…
12 13