Hey, absolute props for replying to my code by making a counter-code of your own!
I don’t have the time to look into this right now, but wanted to say that this is the best I could hope of posting my random projects here: Having someone else tell you what they would do instead.
And for context, this was a weekend experiment. I wanted to try building “agentic stuff,” and exploring the not-so-promising intersection of information theory, LLMs, and code quality.
This is how RAG pipelines work. You chunk up text and then embed it, which gives you a vector representation of the text. You store that in a database keys in the vector Then when you want to inject relevant information for a prompt, you embed the prompt to get a vector, and then dump the a handful of most similar chunks into context to provide additional information.
So this semantic similarity question has been in my mind for a while to answer the question of what names would be the most “intuitive” for an LLM.
Hey, absolute props for replying to my code by making a counter-code of your own!
I don’t have the time to look into this right now, but wanted to say that this is the best I could hope of posting my random projects here: Having someone else tell you what they would do instead.
And for context, this was a weekend experiment. I wanted to try building “agentic stuff,” and exploring the not-so-promising intersection of information theory, LLMs, and code quality.
Will edit later after I read yours.
This is how RAG pipelines work. You chunk up text and then embed it, which gives you a vector representation of the text. You store that in a database keys in the vector Then when you want to inject relevant information for a prompt, you embed the prompt to get a vector, and then dump the a handful of most similar chunks into context to provide additional information.
So this semantic similarity question has been in my mind for a while to answer the question of what names would be the most “intuitive” for an LLM.
Does it work? shrug I guess we’ll find out.