I’m a climate scientist by trade. Interested in interesting things. Ecology, complexity, politics, social change, music.

  • 41 Posts
  • 1.44K Comments
Joined 2 年前
cake
Cake day: 2024年5月8日

help-circle



  • This one? https://www.youtube.com/watch?v=ZJ8KThKAfbs

    Edit: Huh, interesting. So there’s a few things going on:

    1. In some cases, LLMs have pulled together pre-existing knowledge that had not been connected before (sometimes across languages).
    2. Brute-forcing is sometimes part-of it (with searches informed by existing research)
    3. There are languages like LEAN that allow formal proofs to be written out and then tested logically. I guess this means that LLMs now have access to testing the logical validity of statements, which is helping to make a bunch of these most recent breakthroughs.

    That last one is particularly interesting, I think, because it expands LLM capability from being language-focused (with interfaces for agentic work) to something that can actually understand (in a way) the validity of logical statements. I think it doesn’t get it to an understanding of truths in general, because logic is always built from axioms, and it can’t know the validity of the axioms (except by assumption). If I’m understanding things correctly)