There’s no way for teachers to figure out if students are using ChatGPT to cheat, OpenAI says in new back-to-school guide::AI detectors used by educators to detect use of ChatGPT don’t work, says OpenAI.

  • Mane25@feddit.uk
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    9
    ·
    1 year ago

    Detecting whether a student used ChatGPT to write an assignment can be challenging, but there are some signs and strategies you can consider:

    • Unusual Language or Style: ChatGPT may produce content that is unusually advanced or complex for a student’s typical writing style or ability. Look for inconsistencies in language usage, vocabulary, and sentence structure.

    • Inconsistent Knowledge: ChatGPT’s knowledge is based on information up to its last training cut-off in September 2021. If the assignment contains information or references to events or developments that occurred after that date, it might indicate that they used an AI model.

    • Generic Information: If the content of the assignment seems to consist of general or widely available information without specific personal insights or original thought, it could be a sign that ChatGPT was used.

    • Inappropriate Sources: Check the sources cited in the assignment. If they cite sources that are unusual or not relevant to the topic, it may indicate that they generated the content using an AI model.

    • Plagiarism Detection Tools: Use plagiarism detection software, such as Turnitin or Copyscape, to check for similarities between the assignment and online sources. While these tools may not specifically detect AI-generated content, they can identify similarities between the assignment and publicly available text.

    • Interview or Discussion: Consider discussing the assignment topic with the student during a one-on-one interview or discussion. If they struggle to explain or elaborate on the content, it may indicate they didn’t personally generate it.

    It’s important to approach these situations with caution and avoid making accusations without concrete evidence. If you suspect that a student used an AI model to complete an assignment, consider discussing your concerns with the student and offering them the opportunity to explain or rewrite the assignment in their own words.

      • GenderNeutralBro@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        42
        ·
        1 year ago

        You can tell because it’s grammatically correct but logically incongruous. For example:

        ChatGPT’s knowledge is based on information up to its last training cut-off in September 2021. If the assignment contains information or references to events or developments that occurred after that date, it might indicate that they used an Al model.

        That is the exact opposite of the conclusion you could draw.

    • ribboo@lemm.ee
      link
      fedilink
      English
      arrow-up
      11
      ·
      1 year ago

      Best tip is to use chatgpt yourself and you learn to spot obvious stuff like this at literally the first sentence!

      • mind@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        That doesn’t work because a slight prompt change gives an entirely different result.

        Tell ChatGPT to use a casual voice, and avoid sounding clinical and neutral, and suddenly it doesn’t sound like AI at all.

        Meanwhile, some students will write in a very plain and straightforward way that will come across as “AI”.

        • ribboo@lemm.ee
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I’ve done that more than most. But it’s very hard to get it to lose its style.

    • GBU_28@lemm.ee
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      1 year ago

      It is tribal to circumvent gpt specific bullet

      Like:

      train it with snippets of your writing style.

      Tell it to use specific sources