Something I don’t quite know, maybe someone closer to math can answer this question
It seems we’re making tremendous progress on the back of existing abstractions and concepts with the brute force ability to generate language and verify proofs.
For example, Tao says about the Riemann proof:
> appears to use the full power of modern developments on the Langlands program and arithmetic geometry
What I wonder: how do we create new abstractions and concepts? Like whatever “Langlands program” is? That then feedback into the system, and allow for even more sophisticated mathematics.
Are we assuming AI will do this? Or does this still need to be something at least agreed-upon by a mathematics community - in the same way programmers talk about a “linked list” without having an hour long conversation to define it axiomatically? And without that social aspect, without breaking down long proofs into Lego block common abstractions, math may plateau? In part because we lose the ability to ask meaningful questions?
Langlands program[0] was proposed by the Canadian mathematician Robert Langlands (1967, 1970) seeking to relate the structure of Galois groups in algebraic number theory to automorphic forms and, more generally...
A lot of people have raised the possibility of math may plateau because humans no longer have the insights for new abstractions, but the truth is nobody knows.
Langlands is interesting because it is most conjectural (and not completely clear what the precise statements are -- hence "program" and not "conjecture"), but proving special cases turn out to be tremendously powerful. One special case implied Fermat's Last Theorem, for example.
Nobody knows the answer to that question, we are discovering in real-time what frontier mathematicians and frontier AI are able to do to solve previously unsolved problems.
That being said, its probably going something akin to how experimental and theoretical physics have an interplay with each other.
Can we develop more and more all encompassing abstractions (theories) that explain and verify experimental results; translates to, can we come up with more and more theorems/abstractions that explain formal proofs (and perhaps provide explanations for other known proofs)? Probably yes, and likely will also be accelerated by AI.
How this fits into the discipline of mathematics is something we are currently finding out.
This has been ambiguous so far. Most people guessed "the AI can't build new theory yet, but can do insane brute-force, which turns out to be surprisingly powerful, and probably the theory building will get there eventually". I think that in the next 14 days, as this gets processed and understood, there's a good chance we finally settle this.
Compare Elliot Glazer a month-ish ago:
> I occasionally talk to experts on all the MP's. Their rough summaries on what is needed to solve them usually go:
So if we're in "not a clue" territory, maybe that's that.
I fear that it gets muddled again with e.g. the concurrent human announcement and that in retrospect RH turns out to be easier than expected, like many other problems before.
Math is hard, but how hard math is is also hard...
Is anyone else struggling with feelings of both excitement and terror? I haven't felt this much personal uncertainty about my career/life since I was an L1 MLE (10 years ago).
Some context for non-mathematicians (like me): the Four Color Theorem was the first major theorem to be proved with extensive computer assistance, which caused a major kerfluffle when it happened back in the 1970’s.
Personally, a little less excited and feeling a bit left out, a lot of the more interesting stuff is being done with massive investments I could only dream of.
9-10 years ago I was in a smaller structure and basically doing close to SOTA work in the field of NLP: contributions to `spacy`, some of the best word2vec models models for our language (french) and good english ones, at least models that crushed other word2vec models of the time on our large corporate benchmarks (both french and english), and were on par (english) and sometimes better (french) than the official benchmarks of the time. Mostly through minor model tweaks but major data sanitation and preparation work. And then custom transformer-based architecture for other NLP tasks that were also better than all off-the-shelf NLP solutions of the time. And even on my free time I could do some cool ML/NLP stuff no one else was really doing.
Now I am in a larger structure with more resources, yet I know that both in terms or resources and honestly to a degree in terms of skill I feel left out of the current NLP/AI SOTA landscape.
I have a friend who is a great expert on rule-based machine translation and natural language understanding in the classical sense (intellectually describing, in detail, how individual natural languages work and are structured), and none of her techniques have achieved state-of-the-art results for some years. The famous bitter lesson.
It sounds like you were already doing statistical NLP (the thing that has been clobbering everything rule-based in performance) but have seen that field itself start to require much greater resources than what you were working with.
It feels increasingly hard to plan for the future. There's little choice but to assume the future will be enough like the past to be predictable from my experience and knowledge, but that seems less and less likely.
For now, same old stuff. Go to work, keep up with the latest changes, get the kids to school, plan to send them to college. Hard to say if that's the right move at the moment, but what else is there?
In my opinion it shows how broken our governance / political systems are. The way you feel like this reality imposed on you really is a kind of violence in my opinion.
I basically just try over in the moment if each day and hope we have many left.
mostly just depression, I feel little hope that this technology will positively impact my life, feel like my job is at risk and fear the consolidation of wealth and power at these freaks at the labs trying to build god and end the world.
I've been programming since I was 12 and working in the industry for 13 years, and honestly I think I'm done with it all.
I'm starting studies to be an electrician course next year. I want to work in an industry where I'm expected to do high quality work, made to last decades. I want to be as far away as possible from the slopfest.
I don’t know how you were raised but being an electrician is hard physical work. It’s very blue collar. Are you able to give up your office worker status and still feel satisfied? I wouldn’t. Being a blue collar worker changes your status in society and how people view you whether you want it to be true or not. Obviously, if there’s no other option, it makes sense and you don’t have a choice. As a software engineer, my peer groups and friends are doctors and lawyers, etc. Anecdotally it never includes anyone from the trades, including plumbers electricians roofers, and all of that. No one is consciously excluding these people. It just doesn’t seem to happen as naturally.
At a very baser level being a software engineer makes me feel like an important man in society being an electrician would not give me the same feeling. Obviously this is totally arbitrary, but I think the vast majority of software engineers think this way…
Not a software engineer or father sky, but I would take the status hit of leaving an office job in a heartbeat if something manual paid just as much and as stably (including secondary costs). I would dig holes and clean toilets.
I get moments I can only describe as lucidity, or a feeling of hyper-reality. Most of the day I just go with the flow of living, but every so often it’s as if the protective mechanisms in my brain switch off, and I’m hit with a weird mix of feelings that boils down to “holy shit, this is actually happening”. I remember having similar moments as a teenager, when I’d suddenly realize, on a really visceral level, that I am in fact going to die some day, as if my brain would stop hiding the "truth" from me for a brief moment. This feels similar.
I understand that Tao does not want to promote a result which could turn out to be incorrect, but I simply cannot imagine posting about a Riemann Hypothesis result and not commenting about the significance.
Maybe he understands that a proof that no one understands is not really useful, so the significance is fairly lessened until the result is boiled down and understood.
>Maybe he understands that a proof that no one understands is not really useful
Compared to the volumes of pure math proofs which are useful?
>so the significance is fairly lessened until the result is boiled down and understood
Significant enough to make a blog post about it the same day it occurs, but not significant enough to mention the significance of it within the blog post itself lol
I imagine Tao is just being careful and conservative with what he's saying it this point. His previous posts discussing AI in mathematics probably garnered way more attention (including negative attention) than he expected, so it'd be fair if he kept his perspective a bit more neutral and muted now. But it's pretty obtuse to assume that Tao doesn't consider this to be one of the most important events in his life. You don't need a PhD in mathematics to appreciate the significance of this.
What actually IS the significance of a proof? People on Reddit say "not much value in proof because operative assumption was it is true, so nothing changes". I know nothing about it.
Yes, this is correct. Every working number theorist assumes it is true. So this validates those assumptions and many theorems whose hypothesis is "if RH then X" will now be shortened to "X is true"
Yes, but sometimes it seems like almost everything "interesting" is contingent upon RH. So this proof proving valid would be like pouring concrete where there used to be a toothpick sculpture.
It's interesting to me that the ANT GRH proof appears to have been generated directly in Lean, whereas the OAI NS proof I believe was produced in natural language then formalized into Lean.
Maybe GRH was as well, I haven't seen much about how these were put together. But, it's a curious difference in approach if not.
It’s worth noting that this is a post from Terry himself rather than him reposting something from somebody else.
I find that a lot of the times that people see the post from Terrys site they attribute the authorship to him when he does a significant amount of reposting.
Something I don’t quite know, maybe someone closer to math can answer this question
It seems we’re making tremendous progress on the back of existing abstractions and concepts with the brute force ability to generate language and verify proofs.
For example, Tao says about the Riemann proof:
> appears to use the full power of modern developments on the Langlands program and arithmetic geometry
What I wonder: how do we create new abstractions and concepts? Like whatever “Langlands program” is? That then feedback into the system, and allow for even more sophisticated mathematics.
Are we assuming AI will do this? Or does this still need to be something at least agreed-upon by a mathematics community - in the same way programmers talk about a “linked list” without having an hour long conversation to define it axiomatically? And without that social aspect, without breaking down long proofs into Lego block common abstractions, math may plateau? In part because we lose the ability to ask meaningful questions?
Langlands program[0] was proposed by the Canadian mathematician Robert Langlands (1967, 1970) seeking to relate the structure of Galois groups in algebraic number theory to automorphic forms and, more generally...
[0] https://en.wikipedia.org/wiki/Langlands_program
A lot of people have raised the possibility of math may plateau because humans no longer have the insights for new abstractions, but the truth is nobody knows.
Langlands is interesting because it is most conjectural (and not completely clear what the precise statements are -- hence "program" and not "conjecture"), but proving special cases turn out to be tremendously powerful. One special case implied Fermat's Last Theorem, for example.
Nobody knows the answer to that question, we are discovering in real-time what frontier mathematicians and frontier AI are able to do to solve previously unsolved problems.
That being said, its probably going something akin to how experimental and theoretical physics have an interplay with each other.
Can we develop more and more all encompassing abstractions (theories) that explain and verify experimental results; translates to, can we come up with more and more theorems/abstractions that explain formal proofs (and perhaps provide explanations for other known proofs)? Probably yes, and likely will also be accelerated by AI.
How this fits into the discipline of mathematics is something we are currently finding out.
>Are we assuming AI will do this?
Yes.
Of Outsourcing the brute forcing the parts one struggles at leaves more space for exploring what’s left.
This has been ambiguous so far. Most people guessed "the AI can't build new theory yet, but can do insane brute-force, which turns out to be surprisingly powerful, and probably the theory building will get there eventually". I think that in the next 14 days, as this gets processed and understood, there's a good chance we finally settle this.
Compare Elliot Glazer a month-ish ago:
> I occasionally talk to experts on all the MP's. Their rough summaries on what is needed to solve them usually go:
> Hodge: not a clue
> BSD: not a clue
> RH: not a clue
> P vs NP: not a clue
> Yang-Mills: "Well..."
https://news.ycombinator.com/item?id=50252673
So if we're in "not a clue" territory, maybe that's that.
I fear that it gets muddled again with e.g. the concurrent human announcement and that in retrospect RH turns out to be easier than expected, like many other problems before.
Math is hard, but how hard math is is also hard...
Is anyone else struggling with feelings of both excitement and terror? I haven't felt this much personal uncertainty about my career/life since I was an L1 MLE (10 years ago).
I'm a mathematician and I feel neither. I feel apathy.
It's 4CT on speed.
Some context for non-mathematicians (like me): the Four Color Theorem was the first major theorem to be proved with extensive computer assistance, which caused a major kerfluffle when it happened back in the 1970’s.
Exactly! It spurred the discussion of what the purpose of mathematics and proofs are.
Is mathematics simply a list of true statements? Or is there some intrinsically human aspect?
It's so that we could build cool tangible reliable things in the real world.
There's a lot of math which has almost 0 chance of being applicable to building tangible reliable things in the real world.
Put your savings into ANT.
Personally, a little less excited and feeling a bit left out, a lot of the more interesting stuff is being done with massive investments I could only dream of.
Yeah I feel that.
9-10 years ago I was in a smaller structure and basically doing close to SOTA work in the field of NLP: contributions to `spacy`, some of the best word2vec models models for our language (french) and good english ones, at least models that crushed other word2vec models of the time on our large corporate benchmarks (both french and english), and were on par (english) and sometimes better (french) than the official benchmarks of the time. Mostly through minor model tweaks but major data sanitation and preparation work. And then custom transformer-based architecture for other NLP tasks that were also better than all off-the-shelf NLP solutions of the time. And even on my free time I could do some cool ML/NLP stuff no one else was really doing.
Now I am in a larger structure with more resources, yet I know that both in terms or resources and honestly to a degree in terms of skill I feel left out of the current NLP/AI SOTA landscape.
I have a friend who is a great expert on rule-based machine translation and natural language understanding in the classical sense (intellectually describing, in detail, how individual natural languages work and are structured), and none of her techniques have achieved state-of-the-art results for some years. The famous bitter lesson.
It sounds like you were already doing statistical NLP (the thing that has been clobbering everything rule-based in performance) but have seen that field itself start to require much greater resources than what you were working with.
Were you actively working on the Riemann Hypothesis? What are you being left out on?
It feels increasingly hard to plan for the future. There's little choice but to assume the future will be enough like the past to be predictable from my experience and knowledge, but that seems less and less likely.
For now, same old stuff. Go to work, keep up with the latest changes, get the kids to school, plan to send them to college. Hard to say if that's the right move at the moment, but what else is there?
In my opinion it shows how broken our governance / political systems are. The way you feel like this reality imposed on you really is a kind of violence in my opinion.
I basically just try over in the moment if each day and hope we have many left.
I can't stop thinking what happens the moment we get something like Claude working in a general purpose humanoid robot
When all this starts to extend to the physical world
mostly just depression, I feel little hope that this technology will positively impact my life, feel like my job is at risk and fear the consolidation of wealth and power at these freaks at the labs trying to build god and end the world.
I've been programming since I was 12 and working in the industry for 13 years, and honestly I think I'm done with it all.
I'm starting studies to be an electrician course next year. I want to work in an industry where I'm expected to do high quality work, made to last decades. I want to be as far away as possible from the slopfest.
I don’t know how you were raised but being an electrician is hard physical work. It’s very blue collar. Are you able to give up your office worker status and still feel satisfied? I wouldn’t. Being a blue collar worker changes your status in society and how people view you whether you want it to be true or not. Obviously, if there’s no other option, it makes sense and you don’t have a choice. As a software engineer, my peer groups and friends are doctors and lawyers, etc. Anecdotally it never includes anyone from the trades, including plumbers electricians roofers, and all of that. No one is consciously excluding these people. It just doesn’t seem to happen as naturally.
At a very baser level being a software engineer makes me feel like an important man in society being an electrician would not give me the same feeling. Obviously this is totally arbitrary, but I think the vast majority of software engineers think this way…
Not a software engineer or father sky, but I would take the status hit of leaving an office job in a heartbeat if something manual paid just as much and as stably (including secondary costs). I would dig holes and clean toilets.
Excitement only.
What a time to be alive!
I get moments I can only describe as lucidity, or a feeling of hyper-reality. Most of the day I just go with the flow of living, but every so often it’s as if the protective mechanisms in my brain switch off, and I’m hit with a weird mix of feelings that boils down to “holy shit, this is actually happening”. I remember having similar moments as a teenager, when I’d suddenly realize, on a really visceral level, that I am in fact going to die some day, as if my brain would stop hiding the "truth" from me for a brief moment. This feels similar.
AI has dominion over the digital world. Math, Go, Chess. They're all pure reason and verification is as fast as you can compute.
Room temperature superconductors are still a ways off imo.
I understand that Tao does not want to promote a result which could turn out to be incorrect, but I simply cannot imagine posting about a Riemann Hypothesis result and not commenting about the significance.
I would think that readers of his blog are already familiar with its significance.
The comments on the blog supply a measure of discussion of the significance, even if Terry is withholding comment for the moment.
Agree, I know I don't fully grasp how big a moment this could be....but If its actually solved I know it would be massive.
That said Just because something is solved doesn't mean we don't work on making the proof simplified and easier to understand.
Maybe he understands that a proof that no one understands is not really useful, so the significance is fairly lessened until the result is boiled down and understood.
>Maybe he understands that a proof that no one understands is not really useful
Compared to the volumes of pure math proofs which are useful?
>so the significance is fairly lessened until the result is boiled down and understood
Significant enough to make a blog post about it the same day it occurs, but not significant enough to mention the significance of it within the blog post itself lol
I imagine Tao is just being careful and conservative with what he's saying it this point. His previous posts discussing AI in mathematics probably garnered way more attention (including negative attention) than he expected, so it'd be fair if he kept his perspective a bit more neutral and muted now. But it's pretty obtuse to assume that Tao doesn't consider this to be one of the most important events in his life. You don't need a PhD in mathematics to appreciate the significance of this.
The Pope is forwarding reports that the sixth seal has broken, but not elucidating the significance.
What actually IS the significance of a proof? People on Reddit say "not much value in proof because operative assumption was it is true, so nothing changes". I know nothing about it.
Yes, this is correct. Every working number theorist assumes it is true. So this validates those assumptions and many theorems whose hypothesis is "if RH then X" will now be shortened to "X is true"
Yes, but sometimes it seems like almost everything "interesting" is contingent upon RH. So this proof proving valid would be like pouring concrete where there used to be a toothpick sculpture.
Of any proof? Of this proof?
The impact of the RH proof (assuming nothing torpedoes it) is any of the new machinery involved in the proof.
It's interesting to me that the ANT GRH proof appears to have been generated directly in Lean, whereas the OAI NS proof I believe was produced in natural language then formalized into Lean.
Maybe GRH was as well, I haven't seen much about how these were put together. But, it's a curious difference in approach if not.
It’s worth noting that this is a post from Terry himself rather than him reposting something from somebody else.
I find that a lot of the times that people see the post from Terrys site they attribute the authorship to him when he does a significant amount of reposting.
Usually invited/guest posts rather than reposts (which I usually take to mean linking to a post originally published elsewhere).