• sebastiancarlosOP
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    edit-2
    2 天前

    Hey, absolute props for replying to my code by making a counter-code of your own!

    I don’t have the time to look into this right now, but wanted to say that this is the best I could hope of posting my random projects here: Having someone else tell you what they would do instead.

    And for context, this was a weekend experiment. I wanted to try building “agentic stuff,” and exploring the not-so-promising intersection of information theory, LLMs, and code quality.

    Will edit later after I read yours.

    • MagicShel@lemmy.zip
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 天前

      This is how RAG pipelines work. You chunk up text and then embed it, which gives you a vector representation of the text. You store that in a database keys in the vector Then when you want to inject relevant information for a prompt, you embed the prompt to get a vector, and then dump the a handful of most similar chunks into context to provide additional information.

      So this semantic similarity question has been in my mind for a while to answer the question of what names would be the most “intuitive” for an LLM.

      Does it work? shrug I guess we’ll find out.