TorchServe Model Serving
· Batch Import
Description
Production-ready PyTorch model serving engine that handles MAR packaging, custom handlers for preprocessing/inference, multi-GPU worker scaling, and model version management via REST/gRPC API.
Repository
https://github.com/majiayu000/claude-skill-registry/tree/main/skills/development/torchserve
View on GitHub