Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It only takes a minute to sign up.
Anybody can ask a question
Anybody can answer
The best answers are voted up and rise to the top
Asked
Viewed
12 times
I need a general purpose large language model which I would like to implement on my own. The issue is that I have one 32 GB GPU. Clearly I cannot use very large (10B+ parameters) models. Can someone suggest any such open source models? I know of a few like LaMma2 and Fairseq but I want to do a through capability analysis on differnet such LLMs and find out which will work best with my GPU.
$\endgroup$