Im using Ollama on my server with the WebUI. It has no GPU so its not quick to reply but not too slow either.

Im thinking about removing the VM as i just dont use it, are there any good uses or integrations into other apps that might convince me to keep it?

  • RandomLegend [He/Him]@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    34
    arrow-down
    1
    ·
    5 months ago

    It’s a tool like any other. If you don’t have any usecase for it, just don’t use it.

    I use it to summarize release notes and generate some minor descriptions for generic stuff in my TTRPG campaigns.

    • DrinkMonkey@lemmy.ca
      link
      fedilink
      English
      arrow-up
      14
      ·
      5 months ago

      generate some minor descriptions for generic stuff in my TTRPG campaigns.

      Need a quick 200 word description of the interior of an apothecary? Or a band of marauding orcs? It’s been a huge time saver for me.