Nice! Do they have plans to bring even bigger models down to ~16GB VRAM so that ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

Luker88 72 days ago | parent | context | favorite | on: Bonsai 27B: A 27B-Class model that runs on a phone

Nice!

Do they have plans to bring even bigger models down to ~16GB VRAM so that more consumer hardware might be useful?

verdverm 72 days ago [–]

bigger quant'd harder is not always better than a model of more modest size and quant

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact