Recent posts
#73
Last post by davidm - Today at 16:03:07
You can't say "of course" without any signs of in depth analysis. There are many different types of models, including sparse and MoE, some models run decently with "only" lots of fast VRAM. Prompt processing is a main factor. Apple has added matmul operations to the M5 so it can't be directly compared to previous generations.
#75
IIRC, It didn't have the processing power to effectively run those massive models, even if it supported them. So this move makes sense.
#78
Last post by Friedemann - Today at 15:50:38
Schön und gut,ist aber ein Hersteller...von dem man nichts in Deutschland kaufen kann!