• 874 Posts
  • 455 Comments
Joined 2 years ago
cake
Cake day: June 12th, 2023

help-circle











  • OK, it just spits predicted tokens, but in answer to what you asked and sensitive to the context you provided and its predictions are arranged such that when you decode them into language they present evidence or arguments used in thinking or argumentation. It also forms conclusions, inferences and produces results to problems, if you allow me to recycle from a dictionary definition of “reasoning”. It’s not perfect and obviously you can’t cram a huge amount into a 16b distillation and it certainly can get things wrong, but you have to squint to not see reasoning when you ask it to guesstimate something or solve a mathematical problem. It is an LLM but there’s reasoning coming out?



  • I use a 16b reduction of deepseek-r1 on my pc at home and it’s definitely not total bullshit. It’s 10gb of local model that can solve mathematics and physics problems for you or program in python or bash. It doesn’t hallucinate (or I haven’t been able to elicit it), it’s aware of the extents of its knowledge. It works incredibly fast on an old ryzen 1600 with 6600xt. Having an open source reasoning AI that takes 10gb of SSD and about 13 gb of ram is so weird that the only thing weirder is seeing smart people dismiss it as bullshit out of hand.



















  • I made the mistake of reading the books first and now I’m really bothered by how stupid all the changes are. I managed through season 2, barely (in my defense the really stupid comes at the end) and I’m clicking no magnets about the next one.

    spoiler

    The story’s pivot to AI is the stupidest shit ever. One of those things that no one needed to spell is that there are no secret tunnels or doors that haven’t been explored by idle teenagers, yet there’s a magic tunnel at the bottom accessible by a ladder, with a higher-grade whirrr doors and more pleasant lighting where magical computers know people by name?

    spoiler

    Even in the first season, but especially after Solo and kids in Silo 17 are found, it’s INCREDIBLY GRATING how clean and well groomed everyone is. Solo has a combed and perfectly trimmed beard and is never unshampooed. The fucking vault, where the book explicitly notes decades of shit in mounds looks like some fucking Dr. Who living room. The water at the bottom is crystal clear. It all looks like a tv set from the 70s.

    spoiler

    The Quinn code is stupid and it would be much better if we saw less of how they’re solving it. The additional layer of eavesdropping (but it’s listening by AI, whoa) that prevents judge Meadows from disclosing it to anyone is stupid. The character of Camille is stupid, the motivation is horribly half-baked.

    I’d recommend reading Howey’s trilogy, it’s good SF, and skipping the series alltogether. They certainly won’t tempt me to watch the third one.