• 0 Posts
  • 4 Comments
Joined 11 months ago
cake
Cake day: August 9th, 2023

help-circle

  • To expand with my personal experience, I self host a synapse server partly for the reason that i want my children (aged 8-14 now) to have a communication platform they can access to get ahold of me with out requireing a sim card. I do not federate, and i do not allow account sign ups. That keeps a pretty isolated instance while still allowing everyone on that homeserver to be able to talk to each other.

    I help them get Element setup on each device. I dont think this is overly complicated, but i am sure i am a horrible judge of complexity… They have to enter the url of the server, then their password, then they need to scan a qr code/verify from an existing device. Or, they need to enter a second passcode to verify their identity. I help them keep those secrets in bitwarden, so imo, that complexity is an opportunity to explain some opsec and encryption!



  • I am using Mistral 7b Instruct for text summary and some light “assistant” type chatting for the last several months. I have been pleased at how accurate it is for my needs, especially given it’s size.

    I recall alot of trial and error to find models that were compatible with the version of llama-cpp-python that oobabooga uses (at any given time). GGUF should have made the model format (and therefore model selection) more simple, but i imagine there are still nuances that make it more difficult than it should be to find a working model for a noob.

    Best of luck, let us know how it goes