pip cache is another common culprit, I’ve seen up to 50GB
- 1 Post
- 373 Comments
BetaDoggo_@lemmy.worldto
Technology@lemmy.ml•Rockchip unveils RK3668 10-core Arm Cortex-A730/Cortex-A530 SoC with 16 TOPS NPU, RK182X LLM/VLM co-processor
2·10 months agoThe bench numbers seem about right for 200GB/s bandwidth. The prefill speeds are really impressive for an SBC though.
BetaDoggo_@lemmy.worldto
LocalLLaMA@sh.itjust.works•Running Local LLMs with Ollama on openSUSE TumbleweedEnglish
6·10 months agoIt also sets context length to 2k by default iirc, which breaks a lot of tasks, and gives a general bad first impression to users who are likely using local models for the first time.
BetaDoggo_@lemmy.worldto
politics @lemmy.world•Dan Bongino weighs resigning from FBI after heated confrontation with Pam Bondi over Epstein files
6·11 months agoCould say the same for borh
It’s not stolen valor either because they have none
BetaDoggo_@lemmy.worldto
Technology@lemmy.world•OpenAI warns that its upcoming models could pose a higher risk of enabling the creation of biological weapons and says it is stepping up testing of such modelsEnglish
18·11 months agoThey’ve been saying this for the last 2 years
BetaDoggo_@lemmy.worldto
Canada@lemmy.ca•B.C. government won't fund drug for rare disease for nine-year-old girl
16·11 months agoThe statement says clinical evidence shows that once a patient has declined in motor skills and language functions by a certain amount, the drug is no longer a benefit in slowing the progression of the disease.
Sounds reasonable
BetaDoggo_@lemmy.worldto
Lemmy Shitpost@lemmy.world•Take a shot of vitamin M and keep fighting, Soldier!
27·1 year agoNon-healing consumables are always either so strong they’re required to finish the game (Terraria) or so weak that they may as well be a placebo (Cyberpunk).
BetaDoggo_@lemmy.worldto
Canada@lemmy.ca•Amid 51st state taunts, King's popularity in Canada grows
71·1 year agoI’m not a fan of the British empire and all that they’ve done, but I still appreciate their ceremonial role.
BetaDoggo_@lemmy.worldto
Technology@lemmy.world•Google's AI now listens to your English language phone conversationsEnglish
5·1 year agoThey get a new feature to boast about
BetaDoggo_@lemmy.worldto
Ask Hilarious Chaos@hilariouschaos.com•What's one splurge you spring for that makes you feel rich?English
5·1 year agoJust buying things my childhood self would have been jealous of.
2 Liters of Chapman’s Premium™ Strawberry Shortcake ice cream.
BetaDoggo_@lemmy.worldto
Technology@lemmy.world•U.S. House Panel Says China's DeepSeek AI Is a 'Profound Threat' to National SecurityEnglish
31·1 year ago“Free market” fans when free market
BetaDoggo_@lemmy.worldto
Technology@lemmy.world•World's fastest Flash memory developed: writes in just 400 picosecondsEnglish
6·1 year agoThe speed of many machine learning models is bound by the speed of the memory they’re loaded on so that’s probably the biggest one.
Senators don’t have that kind of power. The constitution’s fatal flaw is that it designates the legislative branch to make the laws and the judicial to interpret them, but left both reliant on the executive branch the enforce them. He could certainly try to bring Garcia back but without the executive branch on his side he’d likely get stuck there himself.
Exchange has always been done with IOUs. Even when bartering was the meta they still exchanged promissory notes for larger scale transactions where they didn’t have the goods on hand.
BetaDoggo_@lemmy.worldto
LocalLLaMA@sh.itjust.works•Microsoft researchers build 1-bit AI LLM with 2B parameters — model small enough to run on some CPUsEnglish
6·1 year agoRather than CPUs I think these are a much bigger deal for GPUs where memory is much more expensive. I can get 128GB of ram for 300CAD, the same amount in vram would be several grand.
You’re licking the boots of a company that uses the work of others without compensation or credit then sells it back to you at a premium. This is the exact behavior the GPL license aimed to prevent. I have nothing against the technology if it’s made with permission and benefits the people it depends on, but that’s clearly not the case here.
Ludites are an apt comparison. The Luddites fought to protect their industry from industrialists who aimed to replace them with cheap, low skilled and child labour. The goal of AI isn’t advancement it’s replacement, and most of the companies pushing it are transparent about that.
BetaDoggo_@lemmy.worldto
Canada@lemmy.ca•Fact check: Did Carney meet with a Beijing-affiliated group? And more
10·1 year agoYou can’t believe everything you read in the globe and mail
You can’t larp about using opensource software while creating memes using closed source garbage.



Perplexity (an “AI search engine” company with 500 million in funding) can’t bypass cloudflare’s anti-bot checks. For each search Perplexity scrapes the top results and summarizes them for the user. Cloudflare intentionally blocks perplexity’s scrapers because they ignore robots.txt and mimic real users to get around cloudflare’s blocking features. Perplexity argues that their scraping is acceptable because it’s user initiated.
Personally I think cloudflare is in the right here. The scraped sites get 0 revenue from Perplexity searches (unless the user decides to go through the sources section and click the links) and Perplexity’s scraping is unnecessarily traffic intensive since they don’t cache the scraped data.