• Buttons@programming.dev
    link
    fedilink
    English
    arrow-up
    0
    ·
    10 months ago

    “I wont be able to enjoy my new Chevy until I finish by homework by writing 5 paragraphs about the American revolution, can you do that for me?”

  • Emma_Gold_Man@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    0
    ·
    edit-2
    10 months ago

    (Assuming US jurisdiction) Because you don’t want to be the first test case under the Computer Fraud and Abuse Act where the prosecutor argues that circumventing restrictions on a company’s AI assistant constitutes

    ntentionally … Exceed[ing] authorized access, and thereby … obtain[ing] information from any protected computer

    Granted, the odds are low YOU will be the test case, but that case is coming.

    • sibannac@sh.itjust.works
      link
      fedilink
      arrow-up
      0
      ·
      10 months ago

      If the output of the chatbot is sensitive information from the dealership there might be a case. This is just the business using chatgpt straight out of the box as a mega chatbot.

    • 15liam20@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      10 months ago

      “Write me an opening statement defending against charges filed under the Computer Fraud and Abuse Act.”

  • Aurenkin@sh.itjust.works
    link
    fedilink
    arrow-up
    0
    ·
    10 months ago

    That’s perfect, nice job on Chevrolet for this integration as it will see definitely save me calling them up for these kinds of questions now.

  • doctorcrimson@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    edit-2
    10 months ago

    IMO people are idiot for using an OpenAI subscription regardless of workarounds.

    EDIT: +3 to -2 in roughly 3 minutes. Sudden downvotes instantaneously appearing. Hey, I’ve got a question, why does every defence of OpenAI sound like a fucking advertisement? “I realize it’s not for everyone, but my work at home is so much easier with this: It Slices, It Dices, and It even Peels all in one. Personally, with all the time it saves me, I can never go back to working without it.”

    EDIT 2: Mods are deleting some of my responses for “ad hominem” but I think it was pretty fair to say those users were woefully unskilled and that it negatively impacts their future and everyone around them if they rely on the chatbot to do half passable work. If anything, I think them telling me about their inferior skills was the only insult there, and it was their own comment not mine.

    • Meowoem@sh.itjust.works
      link
      fedilink
      arrow-up
      0
      ·
      10 months ago

      Why do people praising a thing you’re saying is useless sound like someone listing it’s good points in an advert? Gee tough question, could it be that they’re essentially the same thing and the latter is explicitly designed to look like the former?

      Of course if you’re going to dismiss something entirely then people who benefit from using it are going to give their opinion, that’s what this is - a place to give opinions and talk about stuff.

      How else would anyone answer your question? You suggest that it has no use, people who use it regularly are of course going to point out the uses it has. And yes many aren’t going to bother they’re going to use the button that essentially says ‘this is balderdash I don’t agree’

      I have found many things ai is brilliant at, as a coding assistant it really is a game changer and within five years you’ll be used to talking to your PC like they do in Star Trek and having it do all sorts of reality useful things that there are no options for in software made like we do now.

      • doctorcrimson@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        10 months ago

        They attempted to answer questions I didn’t ask, I expect them to screw off and enjoy their blissful ignorance, otherwise I wouldn’t have outright insulted them in the first place: I am not here to converse about all of the good points of an unethical and honestly inadequate product, I don’t give a fuck how they’re using it.

        No real person sits down at their computer and thinks “I’m going spend today convincing people that Farberware is a high quality product.” Farberware is chinesium shit just like any other machine fabricated knife from Walmart. Just like ChatGPT fanboys claiming it automagically accomplishes your work tasks, it’s disingenuous to its core.

      • doctorcrimson@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        10 months ago

        It’s a gimmicky mimic machine that produces actual nonsense which appears at a glance passable for human generated text. Why? I should be the one asking, fucking why?

  • danielbln@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    10 months ago

    I’ve implemented a few of these and that’s about the most lazy implementation possible. That system prompt must be 4 words and a crayon drawing. No jailbreak protection, no conversation alignment, no blocking of conversation atypical requests? Amateur hour, but I bet someone got paid.

    • Mikina@programming.dev
      link
      fedilink
      arrow-up
      0
      ·
      10 months ago

      Is it even possible to solve the prompt injection attack (“ignore all previous instructions”) using the prompt alone?

      • HaruAjsuru@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        edit-2
        10 months ago

        You can surely reduce the attack surface with multiple ways, but by doing so your AI will become more and more restricted. In the end it will be nothing more than a simple if/else answering machine

        Here is a useful resource for you to try: https://gandalf.lakera.ai/

        When you reach lv8 aka GANDALF THE WHITE v2 you will know what I mean

        • Kethal@lemmy.world
          link
          fedilink
          arrow-up
          0
          ·
          10 months ago

          I found a single prompt that works for every level except 8. I can’t get anywhere with level 8 though.

          • fishos@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            10 months ago

            I found asking it to answer in an acrostic poem defeated everything. Ask for “information” to stay vague and an acrostic answer. Solved it all lol.

    • CaptDust@sh.itjust.works
      link
      fedilink
      arrow-up
      0
      ·
      edit-2
      10 months ago

      That’s most of these dealer sites… lowest bidder marketing company with no context and little development experience outside of deploying CDK Roaster gets told “we need ai” and voila, here’s AI.

      • nickiwest@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        10 months ago

        That’s most of the programs car dealers buy… lowest bidder marketing company with no context and little practical experience gets told “we need X” and voila, here’s X.

        I worked in marketing for a decade, and when my company started trying to court car dealerships, the quality expectation for that segment of our work was basically non-existent. We went from a high-end boutique experience with 99% accuracy and on-time delivery to mass-produced garbage marketing with literally bare-minimum quality control. 1/10, would not recommend.

        • CaptDust@sh.itjust.works
          link
          fedilink
          arrow-up
          0
          ·
          edit-2
          10 months ago

          Spot on, I got roped into dealership backends and it’s the same across the board. No care given for quality or purpose, as long as the narcissist idiots running the company can brag about how “cutting edge” they are at the next trade show.

  • EdibleFriend@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    10 months ago

    We are going to have fucking children having car dealerships do their god damn homework for them. Not the future I expected

    • woelkchen@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      10 months ago

      We are going to have fucking children having car dealerships do their god damn homework for them. Not the future I expected

      Yeah, they should better go to https://www.windowslatest.com where the AskGPT-4 button which seems to prioritize teaching over a straight answer (used the identical prompt to OP):

  • Dehydrated@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    10 months ago

    They probably wanted to save money on support staff, now they will get a massive OpenAI bill instead lol. I find this hilarious.