Discussion about this post

User's avatar
David Howard's avatar

I am not a mathematician.

I understand that professional weavers lost substantial income and position with the introduction of the mechanical loom. I also understand that this is the reason I've never been so poor that I could not afford underwear. Most people do not regard mathematics as an activity worth preserving in its own right, and won't be pleased to give up material gain for someone else's spiritual betterment. Especially when their own livelihoods are facing automation.

But we are all mostly in the same position now, so the question of what humans will do when a machine could do it better is almost universally relevant. I would encourage any mathematicians with whom this resonated to engage in a broader social conversation about how resources are allocated and what work gets done by people, and be prepared to compromise, as everyone else will. If you retreat to the ivory tower and bar the gates behind you, it's likely you won't survive the siege.

Antoine Poulin's avatar

Thank you for putting into words many anxieties I have with regards to the future of mathematics in the AI era. This is also brought to my attentions multiple facets I've not considered, in a very thoughtful way.

I've my own misgivings about using AI. I've tried (unsuccessfully so far) to use it in research and was thinking about delving deeper, motivated by the recent discovery of a non-sofic group, based on the work of Kun and Thom. Your post definitely cooled this fire, to my own relief.

My completely novel and original take is that there are good and bad ways to use this technology. I've not experimented much and thus have not drawn my own line of where the distinction lies. I think bad ways are the one which reduce our understanding, autonomy and agency in mathematics. This is your run-of-the-mill ''do my homework'' prompt.

I believe there are good ways to use it in teaching yourself and other known mathematics. An eye-opening example from a few years ago was (IIRC) Eric Hogle's talk'Peer-editing vs chatGPT' (I will put links in PS) at JMM2024. Going by memory, the speaker mentioned teaching an intro to proof course, and in one exercice, instead of asking students to write a proof and to judge the proof of a partner, they were asked to generate chatGPT proof and to correct them. The students gave sharper critique of the AI proof than they would to a peer, which I found very interesting. I would categorize this as a good use of AI for mathematics.

https://meetings.ams.org/math/jmm2024/meetingapp.cgi/Paper/31913

https://www.gonzaga.edu/news-events/stories/ai-around-campus?utm_source=chatgpt.com

(Ironically, I had to use chatgpt to refind the sources!)

I think it also makes sense to draw parallels with software engineering. This is a also a technical, but objective (in the sense that the code *must* compile) field, which fell victim to AI before mathematics. I think there is a cautionary tale there. The most scary thing is the ''lost generation'' of software engineer, a few years where there was virtually no hire, under the assumption they could be replaced with AI. This removed the bottom rung of the career ladder for many young people.

In retrospect, coding agents have taken much less place than expected, with the cost of attention for long projects overshadowing the price of an entry-level programmer. But the most adverse effect is that by not hiring a new generation, the ''talent'' pipeline has effectively been cut.

This may be a naive understanding of the situation from an outsider (and I would love to be corrected). I fear something similar may happen in mathematics, as you mention in your ''pipeline'' point.

As comedic relief, I'd like to drop some of my ''favorite'' AI shenanigans.

1. By manipulating headline and changing certain letters, for example to cyrillic letters, stock-trading AI can be mislead to misevalute certain companies: https://arxiv.org/html/2601.13082v1

(oh no, the poor algorithmic stock traders! :'( )

2. By fine-tuning an AI model to write insecure code, AI can just become evil (I believe the technical term is 'misaligned') https://arxiv.org/abs/2502.17424

3. AI fails very basic understanding on simple rephrasing of famous riddles : https://www.reddit.com/r/singularity/comments/1fqjaxy/contextual_training_and_overreliance_on_llms/

32 more comments...

No posts

Ready for more?