• @quoll
    link
    430 days ago

    I’ve been using https://tabby.tabbyml.com/

    It’s useful maybe 5-10% of the time, more so if you write comments so basic they are pointless for humans. Seems pretty dumb about the project context.

    • Sickday
      link
      fedilink
      329 days ago

      Just want to chime in that I’ve seen TabbyML used a fair bit at work. Tabby in particular can run locally on M1/M2/M3 and uses the Neural Engine via CoreML. The performance hit isn’t noticeable at all and most of what we use it for (large autocompletes in serialized formats) it excels at.