Stack Overflow
Stack Overflow

Questions tagged [tfx]

TensorFlow Extended (TFX) is an end-to-end platform for deploying production ML pipelines

TFX is a Google-production-scale machine learning platform based on TensorFlow. It provides a configuration framework and shared libraries to integrate common components needed to define, launch, and monitor your machine learning system.

Resources

185 questions
0
votes
0 answers

TFX: Should there be an Attribution to record Input Artifact and Context?

In this guideline, we see: attribution = metadata_store_pb2.Attribution() attribution.artifact_id = model_artifact_id attribution.context_id = experiment_id (...) store.put_attributions_and_associations([attribution], [association]) An…
JoyfulPanda
  • 867
  • 6
  • 14
0
votes
1 answer

How to split the dataset into mutiple folds while keeping the ratio of an attribute fixed

Let's say that I have a dataset with multiple input features and one single output. For the sake of simplicity, let's say the output is binary. Either zero or one. I want to split this dataset into k parts and use a k-fold cross-validation model to…
Mehran
  • 15,593
  • 27
  • 122
  • 221
0
votes
0 answers

InfraValidator component not "blessing" my model

The InfraValidator TFX component is not blessing my model, and I'm having trouble finding out why it isn't getting "blessed". I'm not sure what part of my model would be causing it to not be "mechanically sound" enough to not get validated. This…
Jon
  • 1
  • 1
0
votes
1 answer

How to use the same code for machine learning "data transformations" before prediction in both reshearch & production

I wonder what is the best practice/s of taking for example a jupiyter notebook that contains the whole flow from eda to prediction and use the same code for "data transformations from the raw data" till using it for predictions, in case that…
george k
  • 1
  • 1
0
votes
2 answers

Why tfx.components.FnArgs does not have an "epochs" attribute?

tfx.components.FnArgs is the way to pass values to the run_fn function which will in turn train the model in Tensorflow Extended pipeline. Looking at the tfx.components.FnArgs' documentation, I cannot help but wonder why there's no attribute for the…
Mehran
  • 15,593
  • 27
  • 122
  • 221
0
votes
0 answers

How to parse an in-house TFRecords dataset when loading it using ImportExampleGen

Following the official tutorial, this is how I should load a TFRecord dataset: raw_image_dataset = tf.data.TFRecordDataset('images.tfrecords') # Create a dictionary describing the features. image_feature_description = { 'height':…
Mehran
  • 15,593
  • 27
  • 122
  • 221
0
votes
1 answer

Why ImportExampleGen reads TFRecords as SparseTensor instead of Tensor?

I'm converting a CSV file into a TFRecords file like this: File: ./dataset/csv/file.csv feature_1, feture_2, output 1, 1, 1 2, 2, 2 3, 3, 3 import tensorflow as tf import csv import os print(tf.__version__) def create_csv_iterator(csv_file_path,…
Mehran
  • 15,593
  • 27
  • 122
  • 221
0
votes
1 answer

RuntimeError: Split pattern data/* does not match any files

I'm currently trying to convert the TFX-TFRS tutorial into an Airflow pipeline. When I run this Pipeline with LocalDagRunner() it executes without error. When I use the AirflowDagRunner() it throws the following error (Airflow pipeline is triggered…
Sebastian Sätzler
  • 11
  • 2
0
votes
1 answer

TFX tutorial "penguin_tfdv.ipynb" issue TypeCheckError

I've got this problem. How could I solve this problem? This is part of the tutorial of TFX. link to the tutorial I changed nothing in the example code. TypeCheckError: Output type hint violation at WriteStatsOutput[train]: expected
Ovtchinnikov
  • 1
  • 1
0
votes
2 answers

TFX results in TypeCheckError: Output type hint violation at WriteStatsOutput[train]: expected , got

I tried running the tutorial provided in tfx documentation and I am facing a problem with the path to metadata. I have described the query in detail in this issue https://github.com/tensorflow/tfx/issues/4993. The documentation I am using is…
Pratyaksh Singh
  • 1
0
votes
1 answer

Vertex workbench - how to run BigQueryExampleGen in Jupyter notebook

Problem Tried to run BigQueryExampleGen in the InvalidUserInputError: Request missing required parameter projectId [while running…
mon
  • 18,789
  • 22
  • 112
  • 205
0
votes
1 answer

TF Serving Predict API Output Interpretation

Is the TensorFlow Serving (TFS) Predict API output the same as the tf.keras.model.predict method (i.e. the outputs of the model according to the compiled metrics)? For example, if we have a tf.keras.model compiled with BinaryAccuracy metric, will…
pedro malheiro
  • 33
  • 1
  • 4
0
votes
1 answer

Issue with `TransformFeatureLayer` when using `custom_config` in `preprocessing_fn`

System information Environment: Linux 5.13.0-41-generic #46~20.04.1-Ubuntu TensorFlow version: 2.8.0 TFX Version: 1.8.0 Python version: 3.8.13 Python dependencies: absl-py 1.0.0 alembic 1.7.7 anyio …
intrainepha
  • 1
0
votes
1 answer

TFX AutoML on local System

Is it possible to perform AutoML using TFX on local environment. I know with kubeflow and GCP we can perform AutoML on the cloud, but I want to do all of these steps locally and deploy the model to a local directory.
Shisui Otsutsuki
  • 296
  • 1
  • 9
0
votes
1 answer

is TFX (Tensorflow Extended) being used in big companies

I've recently stumbled upon tensorflow extended, and I've finally started to understand the need and uses of it. It makes the whole machine learning pipeline a lot easier and looks like it can be used to automate the tasks. I wanted to ask seniors…
Muhammad Ahmed
  • 318
  • 2
  • 8
1 2 3
…
12 13