Questions tagged [feature-store]

Feature store is a data management layer for machine learning with an aim to share & discover features and increase efficiency for machine learning (it is typically extended part for MLOps solutions). Use this tag for questions about the data management layer for machine learning (feature-store concept covers API, persistent layer, UI, etc.) on various platforms.

Feature store is a data management layer for machine learning with an aim to share & discover features and increase efficiency for machine learning (it is typically extended part for MLOps solutions). The Feature store has these three key parts, the meta repository, the on-line part and the off-line part.

The meta repository keeps definition of ML/AL models (view to feature sets, feature vectors, features, entities, etc.) The on-line part supports real-time responses (with support event and API centric views) and ML/AI executions and the off-line part supports procession of batch/big data (data centric view, e.g. an aggregation of long data, ML/AI experiments, etc.).

The Feature store extents MLOps solutions and support the mesh data concept.

More information

51 questions
3
votes
2 answers

How to delete Databricks feature tables through the Python API

The documentation explains how to delete feature tables through the UI. Is it possible to do the same using the Python FeatureStoreClient? I cannot find anything in the docs:…
burubum
  • 640
  • 1
  • 6
  • 18
2
votes
1 answer

Databricks Feature Store - Can I use native Python (instead of PySpark) to create features?

I would like to create a feature table with some popular time series features using out of the box feature transformations provided by popular python packages such as ta-lib or pandas-ta - these packages rely on numpy/pandas and not Spark…
kanimbla
  • 858
  • 1
  • 9
  • 23
2
votes
1 answer

Is it possible to fetch multiple features from feast feature-store in a single request?

In use-cases like search one might need to apply a model to multiple entries at runtime. Having a single query is much more resilient than one per product. Does feast support it?
Jean Carlo Machado
  • 1,480
  • 1
  • 15
  • 25
2
votes
2 answers

How to delete Feature Group from SageMaker Feature Store, by name

The way to delete a feature group using the SageMaker Python SDK is as follows: my_feature_group.delete() But this only deletes the feature group you are currently working on. How can one delete feature groups from prior sessions? I tried deleting…
1
vote
1 answer

Possible data Ingest count issue in FeatureStore

I see mistake, that count of values in FeatureStore Statistic do not fit with amount of ingested values, see sample ... project_name = 'test-load' project = mlrun.get_or_create_project(project_name, context='./', user_project=True) .. fset =…
user20531732
1
vote
2 answers

GCP vertex AI feature store Java client - ReadFeatureValues was not found on this server

Referring to the Documentation on Google Cloud Java, trying to access features using FeaturestoreOnlineServingServiceClient Service as per the document. Relevant bits of code try (FeaturestoreOnlineServingServiceClient…
Sniper
  • 1,428
  • 1
  • 12
  • 28
1
vote
1 answer

Ingest image to GCP Vertex AI Feature Store

I want to ingest images to Vertex AI Feature Store from Cloud Storage. In what format can I ingest images? As documentation says: For batch ingestion, Vertex AI Feature Store can ingest data from tables in BigQuery or files in Cloud Storage. For…
1
vote
1 answer

Error Message when creating a feature table in databricks

I am currently trying to create a feature table and write the data from a dataframe into it: from databricks import feature_store from databricks.feature_store import feature_table from databricks.feature_store import FeatureStoreClient pyspark_df…
SqHu
  • 99
  • 1
  • 5
1
vote
1 answer

Unable to create feature table on databricks

from pyspark.sql import SparkSession, Row from datetime import date spark = SparkSession.builder.getOrCreate() tempDf = spark.createDataFrame([ Row(date=date(2022,1,22), average=40.12), Row(date=date(2022,1,23), average=41.32), …
1
vote
0 answers

How to create partitioned Athena table with Sagemaker Feature Store

I'm using Sagemaker Feature Store and trying to create an Offline Feature Store. During the process, Sagemaker creates an Athena table. However, I notice that this table is not partitioned, and when I create a query, it takes forever. How can I use…
1
vote
1 answer

Can you import data from parquet or delta file format data sets into Vertex AI feature store

Just wondering if it is possible to not just import from CSV-based data sets for the Vertex AI feature store, but from parquet or delta file formats as well. When trying to import a dataset from within GCP, the only options it gives are from…
1
vote
0 answers

413 error in creating feature-group in AWS Feature Store

This page says the number of feature_definitions can be 2500 per feature group. Also I followed all the constraints including feature_definition constraint of length of names less than 64. When creating a feature group with 2100 features via the…
1
vote
1 answer

Is it possible to connect to a Postgres DB from SageMaker Data Wrangler?

I set up a regular Postgres DB in AWS using the Amazon Relational Database Service (RDS). I would like to ingest this data using data wrangler for inspection and further processing. Is this possible? I only see S3, Athena, Redshift and SnowFlake as…
1
vote
2 answers

Is there a REST API available for SageMaker, or is it possible to interact with SageMaker over the Amazon API Gateway?

SageMaker provides a full machine learning development environment on AWS. It works with the Amazon SageMaker Python SDK, which allows Jupyter Notebooks to interact with the functionality. This also provides the path to using the Amazon SageMaker…
0
votes
0 answers

Throtling in both sagemakerruntime and sagemakerfeaturestoreruntime

We have not set the rate limit values in both feature-store and sagemaker aws service but we are getting rate limit exceeded errors in very low RPS. Case :- Sagemaker : Current RPS to SageMaker service is 5 RPS. It goes to 12 RPS in fractions of…
1
2 3 4