It’s a good article but it completely obscures the role of RLHF contractors. Many of these people are Kenyan or from other African countries, and are highly trained English writers. They work for pennies and train the models to produce English, including by writing prose. There are armies of these people and they go invisible, even when it would make SO MUCH sense to mention them, because people simply don’t know they exist.