I have a question... What would be the logistics of running a small local language model in my simple 2d game that returns strings which are commentaries of various game events? (could be stuff like dialogue) I'm very new to this, so please forgive the broadness of the question, but how feasible would this be? Where would be a good place to start regarding training my own small scale models?
You won't be able to train anything that is anything like what most people think language models are, unfortunately.