Summarization, translation, Q&A, text generation and more at blazing speed using a T5 version implemented in ONNX. This package is still in alpha stage, therefore some functionalities such as beam searches are still in development.

Don't forget to tag @abelriboulot in your comment, otherwise they may not be notified.

Authors community post
Repentant portfolio manager, turned data scientist. I'm one Vonnegut quote away from figuring out this whole life thing.
Share this project
Similar projects
Efficient Serverless Deployment of PyTorch Models on Azure
A tutorial for serving models cost-effectively at scale using Azure Functions and ONNX Runtime.
Advbox Family
Advbox Family is a series of AI model security tools set of Baidu Open Source,including the generation, detection and protection of adversarial examples.
Volksdep
An open-source toolbox for deploying and accelerating PyTorch, Onnx and Tensorflow models with TensorRT.
ONNX
Open standard for machine learning interoperability.
Top collections