this post was submitted on 01 Aug 2026
408 points (97.4% liked)
memes
22160 readers
1830 users here now
Community rules
1. Be civil
No trolling, bigotry or other insulting / annoying behaviour
2. No politics
This is non-politics community. For political memes please go to !politicalmemes@lemmy.world
3. No recent reposts
Check for reposts when posting a meme, you can only repost after 1 month
4. No bots
No bots without the express approval of the mods or the admins
5. No Spam/Ads/AI Slop
No advertisements or spam. This is an instance rule and the only way to live. We also consider AI slop to be spam in this community and is subject to removal.
A collection of some classic Lemmy memes for your enjoyment
Sister communities
- !tenforward@lemmy.world : Star Trek memes, chat and shitposts
- !lemmyshitpost@lemmy.world : Lemmy Shitposts, anything and everything goes.
- !linuxmemes@lemmy.world : Linux themed memes
- !comicstrips@lemmy.world : for those who love comic stories.
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
For simple math that could work, and as long as the question is close enough to an exact match with plenty of published examples to copy.
A good rule of thumb is that the script it will come up with is about as likely to be correct as blindly taking the highest voted answer to the most similar question on Stack Overflow.
If the question is simple and common, the odds are quite good. If the question is nuanced or rare, the odds of a correct result drop off aggressively.
cannot confirm. have used chatgpt many times to check my physics homework (after doing it myself first) and it was basically correct about 90% of the time.
these were not standard exercises (i think)
Thanks. I think every data point helps people.
I can't say that particularly shocks me. I imagine that Chat GPT has probably swallowed dozens of Physics textbooks.
The bigger part of the problem is knowing where we are on the human knowledge novelty / training data available curve, or rather, when we need to get off of the ride.
Edit: Any chance your chosen AI has access to Wolfram Alpha as an MCP Tool? Because that would be very different, too.
If it's successful at math, there's likely much more than a learning model in play.
Which brings us back to the opacity problem. :(
If the answer machine has been cleverly rigged (and weighted) to pass off math questions to more capable software, things can be great.
But a person who just hears that AI can do math now can have a very bad time if they go blindly use a brute force pleasant answer machine on a math problem. :(