Full Stack Transformer

Pytorch library for end-to-end transformer models training, inference and serving. Powered by a list of great libraries.

Features

• Automatic LM dataset preparation

• End-to-end transformer LM training

• Unlikelihood loss training

• Text generation tricks (top-k, nucleus, repetition penalty, etc)

• Text generation as a service

• Telegram bot client

github地址：https://github.com/alexeykarnachev/full_stack_transformer