• 0 Posts
  • 103 Comments
Joined 1 year ago
cake
Cake day: August 7th, 2023

help-circle





  • All signs point to this being a finetune of gpt4o with additional chain of thought steps before the final answer. It has exactly the same pitfalls as the existing model (9.11>9.8 tokenization error, failing simple riddles, being unable to assert that the user is wrong, etc.). It’s still a transformer and it’s still next token prediction. They hide the thought steps to mask this fact and to prevent others from benefiting from all of the finetuning data they paid for.











  • Today, a simple google search will tell them the correct answer for the quiz question, why bother with discussing the actual answer, the lore and the facts behind it, etc! This is just one example of a creative skill which is rapidly degrading among humans and already taken over by Turing machines.

    Or you could acquire more general knowledge than ever before. It’s devalued knowledge economically but it hasn’t stopped anyone from pursuing it.

    Machine learning is the same. It has the ability to eliminate many jobs, but that’s not the fault of the tool, it’s the fault of the economic system it exists in.