Full Stack Transformer
Pytorch library for end-to-end transformer models training, inference and serving. Powered by a list of great libraries.
Features
Automatic LM dataset preparation
End-to-end transformer LM training
Unlikelihood loss training
Text generation tricks (top-k, nucleus, repetition penalty, etc)
Text generation as a service
Telegram bot client
github地址：https://github.com/alexeykarnachev/full_stack_transformer