Basically a deer with a human face. Despite probably being some sort of magical nature spirit, his interests are primarily in technology and politics and science fiction.

Spent many years on Reddit before joining the Threadiverse as well.

  • 0 Posts
  • 2.83K Comments
Joined 2 years ago
cake
Cake day: March 3rd, 2024

help-circle













  • While the current splashy “state of the art” models in terms of cognitive ability are American, IMO the real foundation for future AI is coming out of China these days. It’s not quite as smart but they’re focusing heavily on making AI training and inference cheaper in terms of compute (and therefore more efficient in terms of energy usage). It’s a mother-of-invention situation, sure - they’ve been cut off from the latest and greatest NVIDIA cards so they’re having to find ways to make do with less powerful hardware. But that’s going to be super important once AI is “good enough” for various real world tasks and the most powerful models aren’t needed for most activities.







  • Yeah, I wouldn’t use a framework that didn’t let you select the basic model. I’m just thinking about having it automatically switch to a different one during the review “phase”. It’s not as popular a coding agent these days but I like using Google’s Antigravity and it’s capable of being told to go through the sequence of steps “plan - > write documentation -> implement the plan -> run unit tests -> do a code review” automatically without needing to be prompted at each step. That’s where it would be nice to have it automatically switch for the review.

    “Wear the reviewer hat now” does seem to work quite well with the same model, but if more models from different lineages are available it just seems like the right thing to do to switch to another one.