I mean, maybe ask first, buy later next time?
If you really want to self host LLM's you'll need far more GPU memory than that.
Should have spent more time...you're right.
According to some articles, you can self host smaller parameter LLMs and/or quantized versions. For example the 7B models. Recommendations were 16GB+. Some even pulled off lower
There are used set ups that can take you to the range of 40 gb.
CPU is probably a i7-14700F https://www.cpubenchmark.net/cpu.php?cpu=Intel+Core+i7-14700F
Not sure about the GPU, yeah maybe.
Thanks for the response! That website says its good if it is indeed the i7-14700F 🤞 Maybe just a typo
"We have found 0 items that match "iBUYPOWER Gaming Desktop RTX 4070 Super 16GB, i7-47000F, 32GB DDR5, 2TB SSD, Windows 11 Home"."
Can you give us the link to look at it?
Weird thing is, the product page doesn't exist anymore. I was able to locate the Google cached version of it though (text-only version seems to work): https://webcache.googleusercontent.com/search?q=cache:cgLuNDy4rb0J:https://www.newegg.com/p/3D5-0007-00HV4
If it doesn't exist anymore, that's probably a good sign that there were mistakes in the post.
I'm primarily hoping whatever GPU does arrive has 16GB VRAM. That was a main requirement I was trying to satisfy
Personally, I would try to refund/cancel the order.
You don't really know what they are going to ship you, all you know is that what the shop listing said doesn't exist (unless the hardware companies are making announcements between now and when the product ships).
They responded to me. It is indeed the RTX 4070 SUPER 12GB (Not 16GB). Going to cancel order
The listing will appear correctly again on 1/24/2024
I am glad you found out now, hopefully your next find will suit your needs