Home Artificial Intelligence Latest AI classifier for indicating AI-written text

Latest AI classifier for indicating AI-written text

admin
-
95
Latest AI classifier for indicating AI-written text

We’re launching a classifier trained to differentiate between AI-written and human-written text.

We’ve trained a classifier to differentiate between text written by a human and text written by AIs from a wide range of providers. While it’s inconceivable to reliably detect all AI-written text, we consider good classifiers can inform mitigations for false claims that AI-generated text was written by a human: for instance, running automated misinformation campaigns, using AI tools for tutorial dishonesty, and positioning an AI chatbot as a human.

Our classifier just isn’t fully reliable. In our evaluations on a “challenge set” of English texts, our classifier accurately identifies 26% of AI-written text (true positives) as “likely AI-written,” while incorrectly labeling human-written text as AI-written 9% of the time (false positives). Our classifier’s reliability typically improves because the length of the input text increases. In comparison with our previously released classifier, this latest classifier is significantly more reliable on text from newer AI systems.

We’re making this classifier publicly available to get feedback on whether imperfect tools like this one are useful. Our work on the detection of AI-generated text will proceed, and we hope to share improved methods in the long run.

Try our free work-in-progress classifier yourself:

Limitations

Our classifier has quite a lot of vital limitations. It shouldn’t be used as a primary decision-making tool, but as an alternative as a complement to other methods of determining the source of a bit of text.

  1. The classifier could be very unreliable on short texts (below 1,000 characters). Even longer texts are sometimes incorrectly labeled by the classifier.
  2. Sometimes human-written text shall be incorrectly but confidently labeled as AI-written by our classifier.
  3. We recommend using the classifier just for English text. It performs significantly worse in other languages and it’s unreliable on code.
  4. Text that could be very predictable can’t be reliably identified. For instance, it’s inconceivable to predict whether an inventory of the primary 1,000 prime numbers was written by AI or humans, because the right answer is all the time the identical.
  5. AI-written text will be edited to evade the classifier. Classifiers like ours will be updated and retrained based on successful attacks, but it surely is unclear whether detection has a bonus within the long-term.
  6. Classifiers based on neural networks are known to be poorly calibrated outside of their training data. For inputs which are very different from text in our training set, the classifier is typically extremely confident in a fallacious prediction.

Training the classifier

Our classifier is a language model fine-tuned on a dataset of pairs of human-written text and AI-written text on the identical topic. We collected this dataset from a wide range of sources that we consider to be written by humans, similar to the pretraining data and human demonstrations on prompts submitted to InstructGPT. We divided each text right into a prompt and a response. On these prompts we generated responses from a wide range of different language models trained by us and other organizations. For our web app, we adjust the arrogance threshold to maintain the false positive rate low; in other words, we only mark text as likely AI-written if the classifier could be very confident.

Impact on educators and call for input

We recognize that identifying AI-written text has been a vital point of dialogue amongst educators, and equally vital is recognizing the boundaries and impacts of AI generated text classifiers within the classroom. Now we have developed a preliminary resource on the usage of ChatGPT for educators, which outlines among the uses and associated limitations and considerations. While this resource is targeted on educators, we expect our classifier and associated classifier tools to have an effect on journalists, mis/dis-information researchers, and other groups.

We’re engaging with educators within the US to learn what they’re seeing of their classrooms and to debate ChatGPT’s capabilities and limitations, and we are going to proceed to broaden our outreach as we learn. These are vital conversations to have as a part of our mission is to deploy large language models safely, in direct contact with affected communities.

In case you’re directly impacted by these issues (including but not limited to teachers, administrators, parents, students, and education service providers), please provide us with feedback using this type. Direct feedback on the preliminary resource is useful, and we also welcome any resources that educators are developing or have found helpful (e.g., course guidelines, honor code and policy updates, interactive tools, AI literacy programs).

95 COMMENTS

  1. … [Trackback]

    […] Informations on that Topic: bardai.ai/artificial-intelligence/latest-ai-classifier-for-indicating-ai-written-text/ […]

  6. … [Trackback]

    […] There you can find 30307 additional Information on that Topic: bardai.ai/artificial-intelligence/latest-ai-classifier-for-indicating-ai-written-text/ […]

  10. Today, I went to the beach front with my children. I found a sea
    shell and gave it to my 4 year old daughter and said “You can hear the ocean if you put this to your ear.” She put the shell
    to her ear and screamed. There was a hermit crab inside
    and it pinched her ear. She never wants to go back!
    LoL I know this is totally off topic but I had to tell someone!

  11. Hi there would you mind letting mme kknow which web host you’re utilizing?
    I’ve loaded your blog in 3 completely different
    internet browsers and I must saay this blog loads a lot quicker
    then most. Can you recommend a good internet hosting provider att a reasonable price?
    Cheers, I appreciate it!

    Also visit my web blog; 카지노사이트

  14. Thank you, I have just been searching for info about this topic for
    a while and yours is the best I have came upon till now.
    However, what concerning the bottom line? Are you certain concerning the source?

  17. Hi there! This post couldn’t be written any better!
    Going through this article reminds me of my previous roommate!
    He continually kept talking about this. I am going to forward this article to
    him. Fairly certain he’ll have a good read.
    Many thanks for sharing!

  18. Thanks for your marvelous posting! I really enjoyed reading it, you could be a great author.I will be sure to bookmark your blog and will come back in the future. I want to encourage you to definitely continue your great work, have a nice weekend!|

  26. This is the argument being made by the Moonlite Bunny Ranch sex worker, Summer Sebastian, who recently announced that she’s pregnant and that she plans to keep working until she’s due.

  31. I blog quite often and I really thank you for your
    content. This great article has truly peaked
    my interest. I will bookmark your site and keep
    checking for new details about once a week.

    I subscribed to your RSS feed too.

  33. Thanks for every other excellent post. The place else may just anyone get that kind of info in such an ideal manner of writing? I’ve a presentation subsequent week, and I am at the look for such information.sex 667

  35. Greetings I am so delighted I found your blog, I really found you by accident, while I was looking on Askjeeve for something else, Anyhow I am here now and would just like to say many thanks for a fantastic post and a all round thrilling blog (I also love the theme/design), I don’t have time to read it all at the moment but I have book-marked it and also included your RSS feeds, so when I have time I will be back to read more, Please do keep up the superb work.|

  40. I loved as much as you’ll receive carried out right here.
    The sketch is attractive, your authored subject matter stylish.
    nonetheless, you command get bought an edginess over that you
    wish be delivering the following. unwell unquestionably come further formerly again since exactly the same
    nearly a lot often inside case you shield this hike.

  42. Hey very cool site!! Man .. Beautiful .. Wonderful .. I will bookmark your blog and take the feeds also? I am happy to find a lot of useful information right here within the submit, we’d like develop more strategies in this regard, thank you for sharing. . . . . .|

  48. This design is wicked! You most certainly know how to keep a reader entertained.
    Between your wit and your videos, I was almost moved to start my
    own blog (well, almost…HaHa!) Wonderful job. I really enjoyed what you had to say, and more
    than that, how you presented it. Too cool!

  50. I feel this is among the most important info for me. And i am happy studying your article. But should statement on some basic things, The website style is ideal, the articles is in reality nice : D. Just right activity, cheers|

  53. Howdy! Do you know if they make any plugins to assist with Search Engine Optimization? I’m trying to get my blog to rank for some targeted keywords but I’m not seeing very good gains. If you know of any please share. Thanks!|

  56. Have you ever thought about writing an ebook or guest authoring on other blogs?
    I have a blog based upon on the same information you discuss and would love to have you share some stories/information. I
    know my visitors would value your work. If you’re even remotely interested,
    feel free to shoot me an e mail.

  57. I would like to thank you for the efforts you have put in writing this
    website. I’m hoping to view the same high-grade blog posts
    from you later on as well. In truth, your creative writing
    abilities has inspired me to get my own blog now 😉

  62. Hello very cool site!! Guy .. Excellent .. Wonderful ..
    I’ll bookmark your site and take the feeds additionally?
    I’m satisfied to seek out numerous useful information right here within the put up, we need
    work out more techniques on this regard, thanks for sharing.
    . . . . .

  66. I’m really enjoying the design and layout of your site. It’s a very easy on the eyes which makes it much more pleasant
    for me to come here and visit more often. Did you hire out a designer to
    create your theme? Fantastic work!

  76. Hey! I realize this is kind of off-topic however I had to ask. Does operating a well-established blog like yours take a large amount of work? I’m completely new to blogging but I do write in my diary every day. I’d like to start a blog so I will be able to share my own experience and feelings online. Please let me know if you have any kind of suggestions or tips for brand new aspiring blog owners. Appreciate it!|

  77. excellent publish, very informative. I’m wondering why the other specialists of this sector do not notice this. You must continue your writing. I’m confident, you’ve a huge readers’ base already!|

  85. Thanks , I have just been looking for info about this topic for a while and yours is the greatest I’ve discovered so far. However, what concerning the conclusion? Are you sure about the source?|

  86. Magnificent beat ! I would like to apprentice while you amend your website, how could i subscribe for a blog site? The account aided me a applicable deal. I have been a little bit familiar of this your broadcast offered bright transparent concept|

  90. Hello there I am so excited I found your blog page,
    I really found you by error, while I was browsing
    on Digg for something else, Anyhow I am here now and would
    just like to say cheers for a remarkable post and a all round entertaining blog (I also love
    the theme/design), I don’t have time to read
    through it all at the moment but I have book-marked it and also included your RSS feeds, so when I have
    time I will be back to read more, Please do keep up the great job.

  93. Do you mind if I quote a couple of your articles as long as I provide credit
    and sources back to your webpage? My blog is in the exact same niche as yours and my visitors would truly benefit
    from some of the information you present here. Please let me
    know if this alright with you. Cheers!

  95. An impressive share! I have just forwarded
    this onto a colleague who has been conducting a little
    research on this. And he actually bought me breakfast simply because I stumbled upon it for
    him… lol. So allow me to reword this…. Thanks for the meal!!
    But yeah, thanks for spending the time to talk about
    this topic here on your web page.

Leave a Reply to gay porn Cancel reply

Please enter your comment!
Please enter your name here

© Newspaper WordPress Theme by TagDiv