#nobridge

  • 1 Post
  • 470 Comments
Joined 1 year ago
cake
Cake day: March 14th, 2025

help-circle

  • Depending on the use and the size of your graphics card you might be better of trying Gemma 4 12B too.
    On my Nvidia 5060 Ti 16GB I can use either Gemma 4 A4B IQ3_M (larger model but highly compressed) or Gemma 4 12B Q8_0 (smaller model but much less compression) and after a night of testing with the Gemma 4 12B Q8_0 I’d say it’s a better helper when it comes to coding but a worse gm for my dnd inspired fantasy world roleplaying adventure.

    I imagine your “setup a selfhosted environment” is closer to the first.


  • Easy setup would be to use koboldcpp + SillyTavern + Gemma 4 26B A4B GGUF of the largest quant your graphics card can fit together with your context.
    Remember to setup SillyTavern to allow network connections and create a user and password, default installation is localhost only.
    Set the temperature to 0.3 if using IQ3_M, higher quants allow higher temperature, and make sure all the formatting templates inside Advanced Formatting are set to Gemma 4.

    Then use either Gemma 4 itself or the free google.com AI to create some “W++ Denze with Horizontal Lines summaries for Gemma 4” of the relevant documentation of the latest version of the home server apps your friends are gonna install.
    You should ensure the resulting lorebook entries are no more than 1k tokens each to leave some context for your friends chats, add it to a character card in SillyTavern and set some keywords to allow them to load dynamically and not stay in context memory all the time.

    Regarding the character card you can ask Gemma 4 to write that for you too, I find “Write a character card in W++ Denze with Horizontal Lines style for Gemma 4 with this name, personality, attitude and skillset” works well for that.
    Then ask it to write a “First message prompt that starts with X, continues with Y and ends with Z for that character card” and you get a first draft to rewrite and paste into the “First Message” of the character card. The first message works as a template that Gemma 4 will imitate when you chat with it. Then simply try the chatbot out before letting others use it.

    I find my own Gemma 4 26B A4B IQ3_M works well for practicing hiragana and katakana, discussing programming or troubleshoot existing code or writing a small function but it can’t be expected to write a correct DatabaseService.cs from scratch and stuff like that.

    Oh and forget about finding good cards and lorebooks for SillyTavern use online, most users use it for NSFW Roleplaying chats. It is a very easy UI to use to create harnesses for your local LLM though.





  • anamethatisnt@sopuli.xyztoGames@lemmy.worldI Hate Native Linux Games
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    1
    ·
    1 month ago

    I can agree that an old and buggy version of a game is no fun. But that is as true of Windows versions as Linux versions.

    You seem to have much worse luck when starting linux native games than I though. I have no problem with Factorio, Oxygen Not Included or Kingdoms and Castles which I think are the only linux native games I got installed at the moment.
    The thing I find much more frequently is that a game released on GOG doesn’t receive the patches and dlc that the developer release on Steam. I always have to verify that a developer actually support their GOG release as well as Steam before buying.



  • Honestly the thing I feel that kids have in their corner that is really great is a lack of experience.
    The kind of awe that I felt when I started up Starcraft or Diablo for the first time just isn’t there now, I have too many reference points from earlier games to get that “new and awesome”-feeling from most games anymore.












  • An easy first step is to check BIOS and see if you can simply increase your fan speeds there for an immediate gain.
    Another easy quick fix is to add a normal desktop fan placed so it pushes air towards your intake fans.
    Third cheap way is to check what fans your case has today and what fits in it. Even the cheap 120mm fans from Arctic or Thermalright can increase airflow and lower temperatures.