I genuinely hope something else comes along soon. And no I don’t want Apple, they’re even worse than Google.
There are a few usable linux phones you can look into, but they do come with drawbacks.
I genuinely hope something else comes along soon. And no I don’t want Apple, they’re even worse than Google.
There are a few usable linux phones you can look into, but they do come with drawbacks.
How is this not a “won’t somebody please think of the children” thing?
Yes it is terrible this has happend, but there is a way to prevent children from accessing AI and its called parenting.
Kids shouldn’t be using AI if it harms them, kids can’t make this choice so it should be made for them. Same with alcohol, same with porn, same with the other things restricted to children.
But that doesn’t mean responsible adults shouldn’t be able to use it, but “won’t somebody please think of the children” litigation will make that impossible.
I don’t care if openai lose all their money but this ruling would also effect open source AI.
If somebody releases a AI why would they be liable for how people decide to use it? Its software and like any other program its the user’s choice on how to use it.
If i decide to run rm / --no-preserve-root is gnu then responsible to fix it?
AI is already very censored, and if makers become liable for what people do with their AI they will become hyper censored and performance will go down the drain.
Hitler sues Mussolini
I honestly prefer MK8 over world, the long straight “tracks” are really boring.
Ah yes because there is no other possible way to combat organized religion then executions. /s
Why do core counts and memory type matter when the table includes memory bandwith and tflop16?
The H200 has HBM and alot of tensor cores which is reflected in its high stats in the table and the amd gpus don’t have cuda cores.
I know a major deterioration is to be expected but how major? Even in extreme cases with only 10% efficiency of the total power then its still competitive against the H200 since you can get way more for the price, even if you can only use 10% of that.
Thanks! Ill go check it out.
My target model is Qwen/Qwen3-235B-A22B-FP8. Ideally its maxium context lenght of 131K but i’m willing to compromise. I find it hard to give an concrete t/s awnser, let’s put it around 50. At max load probably around 8 concurrent users, but these situations will be rare enough that oprimizing for single user is probably more worth it.
My current setup is already: Xeon w7-3465X 128gb DDR5 2x 4090
It gets nice enough peformance loading 32B models completely in vram, but i am skeptical that a simillar system can run a 671B at higher speeds then a snails space, i currently run vLLM because it has higher peformance with tensor parrelism then lama.cpp but i shall check out ik_lama.cpp.
While I would still say it’s excessive to respond with “😑” i was too quick in waving these issues away.
Another commenter explained that residential power physically does not suppply enough to match high end gpus is why even for selfhosters they could be worth it.
Thanks, While I still would like to know thr peformance scaling of a cheap cluster this does awnser the question, pay way more for high end cards like the H200 for greater efficiency, or pay less and have to deal with these issues.
FP8 Tensor Core
, the RTX pro 6000 datasheet keeps it vague with only mentioning AI TOPS
, which they define as Effective FP4 TOPS with sparsity
, and they didn’t even bother writing a datasheet for he 5090 only saying 3352 AI TOPS
, which i suppose is fp4 then. the AMD datasheets only list fp16 and int8 matrix, whether int8 matrix is equal to fp8 i don’t know. So FP16 was the common denominator for all the cards i could find without comparing apples with oranges.?
Well a scam for selfhosters, for datacenters it’s different ofcourse.
Im looking to upgrade to my first dedicated built server coming from only SBCs so I’m not sure how much of a concern heat will be, but space and power shouldn’t be an issue. (Within reason ofcourse)
As long as Russia is fighting China gets cheap oil
My banking app worked with waydroid on linux