SDF Chatter
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
lidd1ejimmy@lemmy.ml to Memes@lemmy.mlEnglish · 2 年前

Offline version of Chat GPT

lemmy.ml

message-square
26
link
fedilink
496

Offline version of Chat GPT

lemmy.ml

lidd1ejimmy@lemmy.ml to Memes@lemmy.mlEnglish · 2 年前
message-square
26
link
fedilink
alert-triangle
You must log in or register to comment.
  • neidu2@feddit.nl
    link
    fedilink
    arrow-up
    47
    ·
    edit-2
    2 年前

    Technically possible with a small enough model to work from. It’s going to be pretty shit, but “working”.

    Now, if we were to go further down in scale, I’m curious how/if a 700MB CD version would work.

    Or how many 1.44MB floppies you would need for the actual program and smallest viable model.

    • Naz@sh.itjust.works
      link
      fedilink
      arrow-up
      16
      ·
      2 年前

      squints

      That says , “PHILLIPS DVD+R”

      So we’re looking at a 4.7GB model, or just a hair under the tiniest, most incredibly optimized implementation of <INSERT_MODEL_NAME_HERE>

      • curbstickle@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        13
        ·
        2 年前

        llama 3 8b, phi 3 mini, Mistral, moondream 2, neural chat, starling, code llama, llama 2 uncensored, and llava would fit.

        • BudgetBandit@sh.itjust.works
          link
          fedilink
          arrow-up
          1
          ·
          2 年前

          Just interested in the topic did you 🔨 offline privately?

          • curbstickle@lemmy.dbzer0.com
            link
            fedilink
            arrow-up
            1
            ·
            2 年前

            I’m not an expert on them or anything, but feel free

    • NoiseColor @lemmy.worldBanned from community
      link
      fedilink
      arrow-up
      14
      arrow-down
      2
      ·
      2 年前

      Removed by mod

      • Ignotum@lemmy.world
        link
        fedilink
        arrow-up
        8
        ·
        2 年前

        70b model taking 1.5GB? So 0.02 bit per parameter?

        Are you sure you’re not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that’s a lot of DVDs

        • NoiseColor @lemmy.worldBanned from community
          link
          fedilink
          arrow-up
          9
          ·
          2 年前

          Ah yes probably the Smaler version, your right. Still, a very good llm better than gpt 3

        • 9point6@lemmy.world
          link
          fedilink
          arrow-up
          7
          ·
          2 年前

          Less than half of a BDXL though! The dream still breathes

        • Steve@startrek.website
          link
          fedilink
          arrow-up
          5
          ·
          2 年前

          For some reason, triple layer writable blu-ray exists. 100GB each

          https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/

      • errer@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        ·
        2 年前

        It is a DVD, can faintly see DVD+R on the left side

      • DannyBoy@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        5
        ·
        2 年前

        It does have the label DVD-R

    • kindenough@kbin.earth
      link
      fedilink
      arrow-up
      8
      ·
      2 年前

      Maybe not all that LLM, https://en.wikipedia.org/wiki/ELIZA

    • Num10ck@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      2 年前

      ELIZA was pretty impressive for the 1960s, as a chatbot for psychology.

    • lidd1ejimmy@lemmy.mlOP
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 年前

      yes i guess it would be a funny experiment for just a local model

    • veroxii@aussie.zone
      link
      fedilink
      arrow-up
      3
      ·
      2 年前

      pkzip c:\chatgpt*.* a:\chatgpt.zip -&

  • Lucidlethargy@sh.itjust.works
    link
    fedilink
    arrow-up
    33
    ·
    2 年前

    Not needed, I’ve got this gem. Encarta 99

    Y’all can look, but don’t touch.

    • black0ut@pawb.social
      link
      fedilink
      arrow-up
      3
      ·
      2 年前

      Wow, I’ve actually never seen this disc. However, funnily enough, I have another disc with that program burned into it. Someone didn’t read the notice, it seems.

    • amenji@programming.dev
      link
      fedilink
      arrow-up
      3
      ·
      2 年前

      Mummified corpse killed by Wikipedia

    • InFerNo@lemmy.ml
      link
      fedilink
      arrow-up
      1
      ·
      2 年前

      Do you also have a Route99 disc?

  • Sparky@lemmy.blahaj.zone
    link
    fedilink
    arrow-up
    10
    ·
    edit-2
    2 年前

    Fun fact: you can download llama3, an llm model made by meta (which is surprisingly good for its size), and it’s only 4.7gb. A dvd can store 4.7 gb of data, meaning you could in theory have an llm on a DVD.

    Model link

    CC BY-NC-SA 4.0

  • Master@lemm.ee
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    2
    ·
    2 年前

    Thought that said cbatGPT

    • blandfordforever@lemm.ee
      link
      fedilink
      arrow-up
      13
      arrow-down
      2
      ·
      2 年前

      Please keep us updated with all future inconsequential misinterpretations.

      -Management

      • Facebones@reddthat.com
        link
        fedilink
        arrow-up
        3
        ·
        2 年前

        Dear Management,

        I was just brushing my teeth without my glasses on, anf out of the corner of my eye it sorta looked like Versace.

        Hope this helps, Facebones

  • JimVanDeventer@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    2 年前

    GPT4All

  • Steamymoomilk@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 年前

    Seems legit

  • dch82@lemmy.zipdeleted by creator
    link
    fedilink
    arrow-up
    1
    ·
    2 年前

    …disc 1 of 150

Memes@lemmy.ml

memes@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !memes@lemmy.ml

Rules:

  1. Be civil and nice.
  2. Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 267 users / day
  • 1.87K users / week
  • 4.78K users / month
  • 10.3K users / 6 months
  • 422 local subscribers
  • 57K subscribers
  • 15.4K Posts
  • 328K Comments
  • Modlog
  • mods:
  • ghost_laptop@lemmy.ml
  • Cyclohexane@lemmy.ml
  • Arthur Besse@lemmy.ml
  • BE: 0.19.20
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org