Open Source DeepSeek R1 Runs at 200 Tokens Per Second on Raspberry Pi | NextBigFuture.com
www.nextbigfuture.com
Experimenters have had overnight tests confirming they have OPEN SOURCE DeepSeek R1 running at 200 tokens per second on a NON-INTERNET connected Raspberry Pi.
  • secret300English
    2·
    1 year ago

    I was using their 7B model and it was kinda poop. Gonna try the 14B one next when I get home

    • Deckweiss@lemmy.worldEnglish
      2·
      1 year ago

      Just tried some of them today and they failed at trivial (for a human junior programmer) code modifications.