News:

Willkommen im Notebookcheck.com Forum! Hier können sie über alle unsere Artikel und allgemein über Notebook relevante Dinge disuktieren. Viel Spass!

Main Menu

Way to run DeepSeek's 671B AI model without expensive GPUs discovered

Started by Redaktion, February 04, 2025, 00:50:08

Previous topic - Next topic

Redaktion

Hugging Face engineer Matthew Carrigan recently revealed on X a method to locally run DeepSeek's advanced R1 model with 8-bit quantization, eliminating the need for expensive GPUs, for a reported cost of $6,000. The key? Having a lot of memory as opposed to vast computing power reserves.

https://www.notebookcheck.net/Way-to-run-DeepSeek-s-671B-AI-model-without-expensive-GPUs-discovered.956421.0.html

Quick Reply

Name:
Email:
Verification:
Please leave this box empty:

Shortcuts: ALT+S post or ALT+P preview