• GenderNeutralBro@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    0
    ·
    10 days ago

    Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance.

    Hmm.

    >locally hosted

    >Google Cloud

    Hmmmmmmmmmmmmmmmm.

    • NaN@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      10 days ago

      It’s a thing.

      Remember how the cloud is someone else’s server? Now you can buy it (or lease) and bring it home, and it becomes only sorta someone else’s.

      Amazon and Azure offer their own on-prem products.

      • GenderNeutralBro@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        0
        ·
        9 days ago

        “Locally hosted” means it’s running on the local host. In this case, that would mean on the same computer running Firefox.

        Calling something that is only accessible over the internet “locally hosted” is outrageous doublespeak.

    • SzethFriendOfNimi@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      10 days ago

      Sounds like they’re running their own LLM instance on googles cloud infrastructure vs using something like OpenAI via API.

      From a web dev parlance it makes sense but for marketing it is definitely confusing and they should do better.

      • sugar_in_your_tea@sh.itjust.works
        link
        fedilink
        arrow-up
        0
        ·
        8 days ago

        Yeah, we “self-host” our app at AWS at work, which means we configure everything ourselves. I “self-host” a VPS at Hetzner for personal projects, and my actual data is actually self-hosted on a machine on my LAN.