Getting started with TorchServe + Management Dashboard
Learn Torchserve with examples + Introducing the management dashboard
model-serving torchserve pytorch streamlit dashboard article code tutorial library

In my previous post I shared how to serve a 🤗 transformer model with TorchServe to have your own self-hosted token-classification inference widget.

This time I will go into more detail on TorchServe. And share the torchserve management dashboard for making life easier :tada:

  • What is Torchserve?
    • Requirements
  • Prepare your model
    • How to save a model
    • Package your model
    • Inbuilt handlers
    • Anatomy of a torchserve handler
    • Write your own handlers
  • Server Configuration
    • Start the server
  • Get predictions with HTTP requests
  • Some final thoughts
    • Notes
  • Q&A

Don't forget to tag @cceyda in your comment, otherwise they may not be notified.

Authors community post
AI researcher & engineer~ ♥ all things NLP 🤖 generative models ★ like trying out new libraries & tools Python ♥
Share this project
Similar projects
How to Deploy PyTorch Lightning Models to Production
Different ways to export PyTorch Lightning model for serving using Cortex.
Top collections