SDF Chatter
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
cm0002@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 3 months ago

'A virtual DPU within a GPU': Could clever hardware hack be behind DeepSeek's groundbreaking AI efficiency?

www.techradar.com

external-link
message-square
4
fedilink
7
external-link

'A virtual DPU within a GPU': Could clever hardware hack be behind DeepSeek's groundbreaking AI efficiency?

www.techradar.com

cm0002@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 3 months ago
message-square
4
fedilink
DualPipe reduces latency and optimizes data movement across GPUs
alert-triangle
You must log in or register to comment.
  • nesc@lemmy.cafe
    link
    fedilink
    English
    arrow-up
    8
    ·
    3 months ago

    Could it?

    • breadsmasher@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      3 months ago

      https://en.wikipedia.org/wiki/Betteridge’s_law_of_headlines

      • nesc@lemmy.cafe
        link
        fedilink
        English
        arrow-up
        4
        ·
        3 months ago

        🙃

  • Smorty [she/her]@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    6
    ·
    3 months ago

    Hmmm this sounds like a shitpost…

    a virtual DPU on a GPU sounds like download some RAM on this website to me.

    Like - aren’t NPUs just more tensor cores? More matrix multiplying machines? I can’t just simulate that and expect it to be faster…

Free Open-Source Artificial Intelligence@lemmy.world

fosai@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !fosai@lemmy.world

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

  • !localllama@sh.itjust.works
  • !models@lemmy.intai.tech
  • !artificial_intel@lemmy.ml
  • LocalLLaMA (Reddit)

LLM Leaderboards

  • HuggingFace Open LLM Leaderboard
  • LMSYS Chatbot Arena

Developer Resources

  • Replicate
  • vLLM
  • RunPod
  • Vast AI
  • Together AI
  • AI Horde

GitHub Projects

  • GitHub Stars

FOSAI Time Capsule

  • The Internet is Healing
  • General Resources
  • FOSAI Welcome Message
  • FOSAI Crash Course
  • FOSAI Nexus Resource Hub
  • FOSAI LLM Guide
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 12 users / day
  • 31 users / week
  • 92 users / month
  • 518 users / 6 months
  • 50 local subscribers
  • 3.39K subscribers
  • 275 Posts
  • 726 Comments
  • Modlog
  • mods:
  • Blaed@lemmy.world
  • fosai@lemmy.world
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org