1326
you are viewing a single comment's thread
view the rest of the comments
[-] skullgiver@popplesburger.hilciferous.nl 91 points 2 weeks ago* (last edited 2 weeks ago)

Fifty million polygons processed by over 7 hundred ~~thousand~~ processing cores (Intel iGPU), versus 4 million tokens processed by a single execution unit (with some instruction reordering tricky).

[-] refalo@programming.dev 33 points 2 weeks ago

yea we need multithreaded json parsers

[-] HauntedCupcake@lemmy.world 2 points 2 weeks ago

CUDA accelerated JSON parser is sorely needed

[-] AdrianTheFrog@lemmy.world 4 points 2 weeks ago

Doesn’t a 3070 have less than 7k cores? A UHD 750 (relatively recent iGPU) only has 256.

And I don’t know the structure of JSON that well, but can’t tokens be made of multiple chars?

You're right, I looked up the highest Intel GPU count but forgot that they released desktop cards. Intel iGPUs "only" have 768 cores, it's the Ampere cards that have thousands of cores.

JSON is UTF-8 so it can be up to three bytes per token theoretically. Depends on the language you're processing, I guess.

this post was submitted on 14 May 2024
1326 points (99.0% liked)

Programmer Humor

30940 readers
282 users here now

Post funny things about programming here! (Or just rant about your favourite programming language.)

Rules:

founded 4 years ago
MODERATORS