

I think you’re misunderstanding the point the author is making. He is arguing that even the current state is not intelligent, it is merely a fancy autocorrect, it doesn’t know or understand anything about the prompts it receives. As the author stated, it can only guess at the next statistically most likely piece of information based on the data that has been fed into it. That’s not intelligence.
I have to disagree that a calculator has intelligence. The calculator has the mathematical functions programmed into it, but it couldn’t use those on its own. The intelligence in your example is that of the operator of the calculator and the programmer who designed the calculator’s software.
I agree with you that the ability to pass an exam isn’t a great test for this situation. In my opinion, the major factor that would point to current state AI not being intelligent is that it doesn’t know why a given answer is correct, beyond that it is statistically likely to be correct.
Again, I think this points to the idea that knowing why an answer is correct is important. A person can know something by rote, which is what current AI does, but that doesn’t mean that person knows why that is the correct answer. The ability to extrapolate from existing knowledge and apply that to other situations that may not seem directly applicable is an important aspect of intelligence.
As an example, image generation AI knows that a lot of the artwork that it has been fed contains watermarks or artist signatures, so it would often include things that look like those in the generated piece. It knew that it was statistically likely for that object to be there in a piece of art, but not why it was there, so it could not make a decision not to include them. Maybe that issue has been removed from the code of image generation AI by now, it has been a long time since I’ve messed around with that kind of tool, but even if it has been fixed, it is not because the AI knew it was wrong and self-corrected, it is because a programmer had to fix a bug in the code that the AI model had no awareness of.