I know there's some overhead, it's not my calculation. https://www.tweaktown.com... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

Tepix on April 14, 2024 | parent | context | favorite | on: Hacked Nvidia 4090 GPU driver to enable P2P

I know there's some overhead, it's not my calculation.

https://www.tweaktown.com/news/97110/tinycorps-new-tinybox-a...

Quote: "Runs 70B FP16 LLaMA-2 out of the box using tinygrad"

Related: https://github.com/tinygrad/tinygrad/issues/3791

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact