Search code examples
google-cloud-platformgoogle-bigquerygoogle-cloud-vertex-aifeature-engineering

Vertex AI feature store vs BigQuery


I was trying to figure out key differences between using GCP Vertex AI feature store and Saving preprocessed features to BigQuery and loading whenever it gets necessary.

I still cannot understand why to choose the first option, rather than the second option, which seems to be easier and more accessible.

Is there any good reason to use feature store in Vertex AI, rather than storing features in BigQuery tables formats?


Solution

  • Vertex AI Feature Store and BigQuery, both can be used to store the features as mentioned by you. But Vertex AI Feature Store has several advantages over BigQuery that makes it favorable for storing features.

    Advantages of Vertex AI Feature Store over BigQuery :

    • Vertex AI Feature Store is designed to create and manage featurestores, entity types, and features whereas BigQuery is a data warehouse where you can perform analysis on data.
    • Vertex AI Feature Store can be used for batch and online storage but BigQuery is not a solution for storage.
    • Vertex AI Feature Store can be used for sharing the features across the organization from the central repository which BigQuery does not provide.
    • Vertex AI Feature Store is a managed solution for online feature serving which is not supported by BigQuery. For more information, you can check this link.