It's more like if the horse was lazily moving in the general direction of the wide open barn door and we are all sitting around discussing if we should close the door or just gamble that it's just going to lay down on the hay pile.

People are specifically talking about the engine itself and not the tools used.

We wouldn't call humans creating a calculator "recursive self improvement".

I wouldn't call the harness an AI, but I might call a tool that plays a major role in creating another one like it "recursive self improvement." For instance in the industrial revolution a metal lathe and a milling machine were instrumental in creating the next generation of themselves. Same thing with a robot that is fabricated by similar (i.e. older model of the same) robots. All of them lead to exponential improvement.

With the US showing that it will elect mentally disabled people such as Trump, this doesn't seem such a wise decision.

>The solution? I'm not sure

The solution is extremely obvious, just stop using it on 2 days out of the week or something like that.

You need to go to the gym, but for your brain.

If what you are building is too complex for you to meaningfully contribute to in the absence of LLM assistance then that should tell you something important.

>People used to memorize log and trig tables, and no one would say that's part of being a competent mathematician at this point.

That would be closer to engineering or accounting than mathematics. I don't think mathematicians do much arithmetic at all.

Go read the story that Richard Feynman tells of betting an abacus user. He used his knowledge of some strange numbers. It's in _Surely You Must Be Joking_.

I suspect his facility with numbers and his knowledge of tables like this really helped him do physics research.

See also his stories on approximation.

For every 1 child that uses AI to learn, there are 10 that will use it to bypass learning. It isn't worth it.

It will just be similar to physical fitness. Some people go to the gym, the vast majority do not. Humans are wired to take the path of least resistance.

No technology has attempted to supplant human cognition on this scale before. Pretending its the same thing as going from sticks to a lighter is just silly.

It seems pretty clear that LLMs are going to be extremely corrosive to culture in general.

Unfortunately it's already time to remove the "going to be" part of this.

No more corrosive than introduction of internet

Oh, so only extremely corrosive, cool