Questions tagged [tfx]

TensorFlow Extended (TFX) is an end-to-end platform for deploying production ML pipelines

TFX is a Google-production-scale machine learning platform based on TensorFlow. It provides a configuration framework and shared libraries to integrate common components needed to define, launch, and monitor your machine learning system.

Resources

185 questions
0
votes
1 answer

TFX Evaluator problem with a keras multioutput model

I am using a very simple keras model in TFX, to solve a regression problem. It seems that TFX wants that you use a keras model with named outputs, so I made: output = {key: tf.keras.layers.Dense(1, name = key)(x) for key in…
0
votes
1 answer

TFX-CLI fails on "tfx extension create"

Background: Using AzureDevops Services as Ci/CD, there is a need to create a custom Service Endpoint, following these documentations. Followed after that by this publish, which is failing. Target: Create custom Service Endpoint. Issue: while running…
Ilya Gurenko
  • 545
  • 1
  • 5
  • 16
0
votes
1 answer

Best practices to use .tfrecord files for forecasting

What are the best practices to store/read data to/from TFRecord files to train a forecasting model? I want to build a model that can predict the health of individual machines (for example, an electric motor) based on their historical health data…
user2725109
  • 2,286
  • 4
  • 27
  • 46
0
votes
0 answers

How to use Tensorflow in local python project

I have a model created in Tensorflow that is already trained and accurate. How do I get this to run in a project? I can load the model but I can't figure out how to feed it a single image that my software is generating. Also if this was a transfer…
0
votes
1 answer

How to create model_config file for TFX Serving?

I have a bunch of custom defined model instances inheriting from tf.keras.layers.Layer that I save. I would like to serve them with TFX Serving, which requires me to have a model_config file. I am wondering how to create this according to the book.…
bonobo
  • 200
  • 1
  • 10
0
votes
1 answer

Tensorflow TextVectorization layer in model with TFX

I'm currently trying to implement a pipeline using TFX (I've followed this notebook: TFX - Chicago Taxi) in order to serve it with Tensorflow Serving. As I'm trying to implement my own pipeline to classify texts (comming from this dataset: Kaggle -…
Alexandre Pieroux
  • 219
  • 1
  • 2
  • 13
0
votes
0 answers

How to create a Post API call for Tensorflow saved model using Tensorflow Serving and Docker?

I ran the example tutorial (link below) for creating a tfx pipeline using native keras based on the iris data set. I was able to create and save a Tensorflow…
0
votes
1 answer

What exactly is Orchestrators in ML?

Actually, in ML pipeline components we are specifying inputs and outputs clearly . For example in TFX statisticgen take input from examplegen and outputs some statistics.so input and output is clear which is same in all components .so why we need…
BSP
  • 342
  • 2
  • 3
  • 14
0
votes
1 answer

TF model on Google AI Platform Models Error: "Expected serialized to be a scalar or vector, got shape:[1,12]"

As part of outputs from tfx trainer and pusher, the saved model/pre-trained model has been executed in Google AI Platform Jobs and Models through the following libraries. from tfx.extensions.google_cloud_ai_platform.pusher import executor as…
LLTeng
  • 385
  • 3
  • 4
  • 15
0
votes
1 answer

TFX running multiple trainers simultaneously

I'm new to tfx and learning to put together the pipeline. I've successfully built a pipeline in Kubeflow on GCP. I like to know how can I run multiple trainers that will generate different outputs/pushers in the pipeline using the same…
0
votes
0 answers

BeamDagRunner dependency packaging issues

I was attempting to run a TFX pipeline using BeamDagRunner where I was using Dataflow to both orchestrate pipeline and execute the tfx components. However I can't execute the components and my dataflow jobs fail saying setup.py not found. I believe…
redwan
  • 1
  • 1
0
votes
1 answer

Issue with TFX Trainer component not outputting model to filesystem

First of all, I am using TFX version 0.21.2 and Tensorflow version 2.1. I have constructed a pipeline largely following the Chigaco taxi example. When the Trainer component is executed I can see the following in the logs: INFO - Training complete. …
0
votes
1 answer

How to call tensorflow_model_server from Nodejs, with an image

This is the metadata of my serving model "metadata": {"signature_def": { "signature_def": { "serving_default": { "inputs": { "vgg16_input": { "dtype": "DT_FLOAT", "tensor_shape": { "dim": [ { "size": "-1", …
Laurent Debricon
  • 4,307
  • 2
  • 24
  • 26
0
votes
1 answer

tensorflow-model-analysis release 0.13.2 and 0.13.1 does not run in python2

I downloaded tfma source code 0.13.2 and ran it in jupyter notebook locally with python2, and it does not work Working code: import tensorflow as tf import third_party.tensorflow_model_analysis.tensorflow_model_analysis.version as v print('TFMA…
0
votes
1 answer

How to include hyperparameter tuning in a TFX pipeline?

TFX pipeline is a really good tool for quick end-to-end model development. However, I'd also like to include hyperparameter tuning before final model training and evaluation. My question is whether there exists a best practice to include tuning in…
1 2 3
12
13