Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Was hoping to see Apple break the 128GB barrier in a laptop that they previously set, though 128GB is still pretty sweet for local LLM inference on consumer hardware. My 128GB M3 Max is still shredding tokens pretty well (with that annoying slow initial prompt processing), so no major complaints there. I guess the question is, given access to the same amount of RAM, does the M5 really do an order-of-magnitude better than 128GB on a M3 or M4?


The new tensor cores significantly speed up prompt processing. Up to 3x faster per the marketing information.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: