The current chaos in WordPress caused by Matt seems like a good time to remind folks that the Mastodon “community” websites and trademarks are 100% owned by one man, despite pleas from current and former project members to make Mastodon a foundation with a board.
sometimes the answer is not "have you tried turning it off and on again" but "have you tried using the physical power switch while sacrificing a goat"
I’m glad we wrote that paper. However LLMs “still lack basic reasoning skills” makes me cringe.
Information theory tells me that because an LLM is a finite set that is not able to grow itself, once it is trained has a finite capability. And that capability is driven by statistics and numbers.
intuitively (to me at least) if you present an LLM with a prompt that’s weird enough it will “hallucinate” answers because it has no critical thinking, it’s just a big probability machine that tries to find the most likely answer to your question. As a result, present an LLM with a chess problem brain teaser unique setup, chances is the LLM will make up rules because what it trained against isn’t chess rules but “in general chess problems end with a checkmate” and it will interpolate the movements from where you are to a checkmate.
https://mastodon.social/@appleinsider/113295305642702643
Oh yes we have our new “you wouldn’t download a car”