This article describes a step by step procedure to serve a model in production using Docker, TensorFlow Serving and Openshift.

Photo by Pero Kalimero on Unsplash

What is Universal Sentence Encoder (USE) ?

USE is a pre-trained model developed by Google that helps in converting textual data into fixed 512 sized vector, widely used in downstream…


This is a guide on how to deploy pre-trained HuggingFace sentence-transformers model in production using TorchServe, Docker and Openshift.

Photo by Katarzyna Pe on Unsplash

Background

In order to deploy any PyTorch model we need TorchServe. It caters to all the requirements of deploying a model in production while providing scalability and flexibility.
For deploying TensorFlow models use…

Yashna Shravani

Data science professional

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store