Inference Time of a CamemBERT Deep Learning Model for Sentiment Analysis of COVID Vaccines on Twitter
In previous work, we implemented a deep learning model with CamemBERT and PyTorch, and built a microservices architecture using the TorchServe serving library. Without TorchServe, inference time was three times faster when the model was loaded once in memory compared when the model was loaded each t...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
NLM (Medline)
2022
|
Subjects: | |
Online Access: | View Fulltext in Publisher |