The model is running at 16 tokens / second (120b) on the GMKTEC EVO-X2. Cost for the computer is 2000€, consumption is less than 200W and no noise. This is really cool for little companies who are ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results