Discussion about this post

User's avatar
Antoine Poulin's avatar

Thank you for putting into words many anxieties I have with regards to the future of mathematics in the AI era. This is also brought to my attentions multiple facets I've not considered, in a very thoughtful way.

I've my own misgivings about using AI. I've tried (unsuccessfully so far) to use it in research and was thinking about delving deeper, motivated by the recent discovery of a non-sofic group, based on the work of Kun and Thom. Your post definitely cooled this fire, to my own relief.

My completely novel and original take is that there are good and bad ways to use this technology. I've not experimented much and thus have not drawn my own line of where the distinction lies. I think bad ways are the one which reduce our understanding, autonomy and agency in mathematics. This is your run-of-the-mill ''do my homework'' prompt.

I believe there are good ways to use it in teaching yourself and other known mathematics. An eye-opening example from a few years ago was (IIRC) Eric Hogle's talk'Peer-editing vs chatGPT' (I will put links in PS) at JMM2024. Going by memory, the speaker mentioned teaching an intro to proof course, and in one exercice, instead of asking students to write a proof and to judge the proof of a partner, they were asked to generate chatGPT proof and to correct them. The students gave sharper critique of the AI proof than they would to a peer, which I found very interesting. I would categorize this as a good use of AI for mathematics.

https://meetings.ams.org/math/jmm2024/meetingapp.cgi/Paper/31913

https://www.gonzaga.edu/news-events/stories/ai-around-campus?utm_source=chatgpt.com

(Ironically, I had to use chatgpt to refind the sources!)

I think it also makes sense to draw parallels with software engineering. This is a also a technical, but objective (in the sense that the code *must* compile) field, which fell victim to AI before mathematics. I think there is a cautionary tale there. The most scary thing is the ''lost generation'' of software engineer, a few years where there was virtually no hire, under the assumption they could be replaced with AI. This removed the bottom rung of the career ladder for many young people.

In retrospect, coding agents have taken much less place than expected, with the cost of attention for long projects overshadowing the price of an entry-level programmer. But the most adverse effect is that by not hiring a new generation, the ''talent'' pipeline has effectively been cut.

This may be a naive understanding of the situation from an outsider (and I would love to be corrected). I fear something similar may happen in mathematics, as you mention in your ''pipeline'' point.

As comedic relief, I'd like to drop some of my ''favorite'' AI shenanigans.

1. By manipulating headline and changing certain letters, for example to cyrillic letters, stock-trading AI can be mislead to misevalute certain companies: https://arxiv.org/html/2601.13082v1

(oh no, the poor algorithmic stock traders! :'( )

2. By fine-tuning an AI model to write insecure code, AI can just become evil (I believe the technical term is 'misaligned') https://arxiv.org/abs/2502.17424

3. AI fails very basic understanding on simple rephrasing of famous riddles : https://www.reddit.com/r/singularity/comments/1fqjaxy/contextual_training_and_overreliance_on_llms/

athina's avatar

lots of interesting ideas to take away from this; i'd like to focus on the question of why do we do mathematics in the first place. i agree with the answer you give, and i find comfort in Michael Harris' characterization of mathematics as 'a way of being human', instead of a theorem-proving industry. unfortunately, in practice, it is often degraded to the latter. even before this recent influx of AI-generated mathematical results, a lot of us have already been feeling disillusioned with the 'publish or perish' culture in academia. the emphasis on producing results (as opposed to playing freely with mathematical ideas) because your career depends on it can be stifling to mathematical creativity, and is one of many many reasons PhDs are leaving academia en masse. my hope is that these unprecedented times force us into some long overdue reflection on systemic questions about how mathematical research is done.

7 more comments...

No posts

Ready for more?