Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

ahh gotcha. that speed sounds about right. i am running qwen 3.6 35bA3B(group-32 int4) on my m3 air (16gb) and get about 8 tokens per sec. i have not yet tried the 3.6 27B.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: