One can’t offload “usable” LLMs without tons of memory bandwidth and plenty of RAM. It’s just not physically possible.
You can run small models like Phi pretty quick, but I don’t think people will be satisfied with that for copilot, even as basic autocomplete.
About 2x faster than Intel’s current IGPs is the threshold where the offloading can happen, IMO. And that’s exactly what AMD/Apple are producing.
The localllama crowd is supremely unimpressed with Intel, not just because of software issues but because they just don’t have beefy enough designs, like Apple does, and AMD will soon enough. Even the latest chips are simply not fast enough for a “smart” model, and the A770 doesn’t have enough VRAM to be worth the trouble.
They made some good contributions to runtimes, but seeing how they fired a bunch of engineers, I’m not sure that will continue.
I wouldn’t call that “large.”
Strix Halo (256 bit LPDDR5X, 40 AMD CUs) is where I’d start calling integrated graphics “large.” Intel is going to remain a laughing stock in the gaming world without bigger designs than their little 128-bit IGPs.
Bernie beating Trump is a nice fantasy, but it wouldn’t happen either.
This election was an information war, and the Democrats fought it like they’re in another century. And they’re going to lose again if they think sensible policy, however revolutionary and in-touch, and hopeful TV ads are how you win elections.
They need their own form of MAGA. And they need to flood and poison the internet and airwaves just like the Republicans did.
If they wanna abandon discrete GPUs… OK.
But they need graphics. They should make M Pro/Max-ish integrated GPUs like AMD is already planning on doing, with wide busses, instead of topping out at bottom-end configs.
They could turn around and sell them as GPU-accelerated servers too, like the market is begging for right now.
Honestly… yeah. Literally.
Make it even simpler, just send everyone a check with Trump’s face on it like during Covid.
Most Americans don’t really understand macroeconomics and are just looking at super-market prices for their next meal and trip. And those covid checks worked, people freaking loved Trump for that.
I mean, Covid-19? Our handling of that was a disaster, and it hardened support.
What would be enough of a shock, even theoretically?
WWIII? A US Tiananmen Square? I don’t think anything short of nuclear war would cut it, and even then his polls would only fall like 20%.
I think its half that. The Dems need a reckoning.
But the other half is that they don’t play dirty like Trump. They don’t understand that engagement is all that matters, lying does not, because us Americans have the critical thinking ability of an ant.
If they want to win, they need their own reality distortion field.
American here.
If Linus Torvalds bans Americans over something stupid we did, and my nationality gets insulted, this will be me:
(I am actually Central Texan, TYVM. Bring the insults.)
American here.
Americans are idiots. All of us are morons. I accept the insults on my nationality, even personally. Bring it. I don’t know how else to say/generalize it, because it’s true.
I’m gonna nod my head if something happens and Linus Torvalds bans us too.
2028 will likely be a Republican rout, at least.
Bingo.
I get downvoted for saying “there’s no such thing as bad attention,” and here we are. This is 2024, there is no such thing as bad engagement. Even the US presidency is a straight-up name recognition contest.
TBH I’m kinda bummed.
This feels like an inflection point for the open internet, the one everyone’s been fearing where it really is dying asymptotically.
Also bummed about a certain election, as much as I hate to leak it. About my niches going to Discord… feels like the world is around me is collapsing, and there’s little sanity left coming in over my network.
deleted by creator
You know who I blame?
Facebook.
They’ve abandoned cable, so where does all my conservative family live. Where do they get news and basically their entire world-view?
Facebook.
And they live in a totally different universe.
Meta made mega bucks electing Donald Trump because he’s so engaging. Trumpism is just too profitable. And I’m not sure I can forgive that in my lifetime.
“We have the Palestinians and we have everybody else rioting all over the place. You talk about Charlottesville. This is one hundred times Charlottesville,” Trump said during a presidential debate in July, equating pro-Palestinian activism with a 2017 attack by White supremacists in Virginia.
https://www.washingtonpost.com/politics/2024/05/27/trump-israel-gaza-policy-donors/
https://www.middleeasteye.net/news/donald-trump-middle-east-foreign-policy
https://www.nbcnews.com/news/trumps-plan-quell-protests-deport-hamas-radicals-rcna166168
I hope you enjoyed your high horse. Because this might be the last Palestine protest you can effectively make.
He’s already said he won’t run again. He probably physically can’t.
It’s not a political problem though, he’s all but god to so many people. Honestly I don’t know what’s gonna happen to a void he leaves behind when he passes away.
Oh, I forgot about that.
Why should he care? As long as he pushes Trump over the edge, he’s set for life. He’ll probably run for President.
They don’t care. It’s clearly not about the message, it’s the delivery, and Bernie would have used the same apparatus Harris used.