• LughM
    link
    fedilink
    English
    24 months ago

    I really suspect this is how the plateau of productivity will look for machine learning.

    It seems finding more data to scale up LLMs is a bottleneck too.

    • @CanadaPlusOP
      link
      English
      24 months ago

      Yeah, that’s part of why I think that. There’s also just the alignment issue that no amount of training will fix. At the end of the day, an LLM is a very smart internet simulator, you treat it like something else at your peril, and training it to be something else is very much an open problem.