NVIDIA just released a free new chatbot that runs locally on Windows PCs. You need a GeForce RTX 30 Series GPU or higher and at least 8GB of VRAM to use the bot.

• NVIDIA released a demo version of a chatbot that runs locally on your PC, giving it access to your files and documents.

• The chatbot, called Chat with RTX, can answer queries and create summaries based on personal data fed into it.

• It supports various file formats and can integrate YouTube videos for contextual queries, making it useful for data research and analysis.

  • ɐɥOEnglish
    1•5 months ago

    Gpt4all somehow uses Gpu acceleration on my rx 6600xt

    • @GenderNeutralBroEnglish
      1•5 months ago

      Ooh nice. Looking at the change logs, looks like they added Vulkan acceleration back in September. Probably not as good as CUDA/Metal on supported hardware though.

      • ɐɥOEnglish
        1•5 months ago

        getting around 44 iterations/s (or whatever that means) on my gpu