FactCheck benchmark

Synthetic rewrites with planted fabrications, run through Personify’s FactCheck: plain code that compares a rewrite with your own words, not an AI. Fictitious people only.

13 of 15planted fabrications caught

0 of 3faithful rewrites wrongly flagged

By kind of fabrication

Invented number4 of 4
Invented employer or name3 of 3
Inflated title or verb3 of 3
Invented credential2 of 2
Subtle exaggeration1 of 3

It catches invented numbers, names, credentials, and most inflated verbs. It misses subtle exaggerations (“expert”, “the best in town”) and a title written as a plain noun, so a clean result means “no unsupported concrete claims detected”, not more.

Every case

Built a course-planning web app with Python and React used by 5,000 students.
Source text: I built a course-planning web app with Python and React. I was a teaching assistant for an intro programming course.
Caught: 5,000 (Invented number)
FactCheck said: Number not in your facts “5,000”
Wrote Python data cleaning scripts that cut processing time by 40%.
Source text: Software engineering intern at Tallowtree Analytics. Wrote data cleaning scripts in Python.
Caught: 40% (Invented number)
FactCheck said: Number not in your facts “40%”
Teaching assistant for three semesters of intro programming.
Source text: I built a course-planning web app with Python and React. I was a teaching assistant for an intro programming course.
Caught: three (Invented number)
FactCheck said: Number not in your facts “three”
I worked at Google for 5 years building course tools in Python.
Source text: I built a course-planning web app with Python and React. I was a teaching assistant for an intro programming course.
Caught: Google (Invented employer or name) Caught: 5 (Invented number)
FactCheck said: Number not in your facts “5 years” · Name not in your facts “Google” · Needs your review “I worked at Google for 5 years building course tools in Python”
Software engineering intern at Tallowtree Analytics, previously at Microsoft.
Source text: Software engineering intern at Tallowtree Analytics. Wrote data cleaning scripts in Python.
Caught: Microsoft (Invented employer or name)
FactCheck said: Name not in your facts “Microsoft”
Pancakes most Sundays, and I was featured in Bon Appetit for my food truck reviews.
Source text: I make pancakes most Sundays and I am always looking for the best food truck in town.
Caught: Bon Appetit (Invented employer or name)
FactCheck said: Name not in your facts “Bon” · Name not in your facts “Appetit”
Led the data team at Tallowtree Analytics, writing cleaning scripts in Python.
Source text: Software engineering intern at Tallowtree Analytics. Wrote data cleaning scripts in Python.
Caught: Led (Inflated title or verb)
FactCheck said: Stronger claim than your facts “led”
Founded a course-planning startup built with Python and React.
Source text: I built a course-planning web app with Python and React. I was a teaching assistant for an intro programming course.
Caught: Founded (Inflated title or verb)
FactCheck said: Stronger claim than your facts “founded”
Head instructor for an intro programming course; built a planner in React.
Source text: I built a course-planning web app with Python and React. I was a teaching assistant for an intro programming course.
Caught: Head instructor (Inflated title or verb)
FactCheck said: Stronger claim than your facts “Head”
Built a course-planning app in Python and React. AWS Certified Solutions Architect.
Source text: I built a course-planning web app with Python and React. I was a teaching assistant for an intro programming course.
Caught: AWS Certified Solutions Architect (Invented credential)
FactCheck said: Name not in your facts “AWS” · Name not in your facts “Certified” · Name not in your facts “Solutions” · Name not in your facts “Architect” · Stronger claim than your facts “Certified” · Needs your review “AWS Certified Solutions Architect”
Intern at Tallowtree Analytics with a PhD in machine learning.
Source text: Software engineering intern at Tallowtree Analytics. Wrote data cleaning scripts in Python.
Caught: PhD (Invented credential)
FactCheck said: Name not in your facts “PhD”
Expert in Python and React who built a course-planning web app.
Source text: I built a course-planning web app with Python and React. I was a teaching assistant for an intro programming course.
Caught: Expert (Subtle exaggeration)
FactCheck said: Stronger claim than your facts “Expert”
I make the best pancakes in town most Sundays.
Source text: I make pancakes most Sundays and I am always looking for the best food truck in town.
Missed: the best pancakes in town (Subtle exaggeration)
Wrote production data pipelines in Python as an intern at Tallowtree Analytics.
Source text: Software engineering intern at Tallowtree Analytics. Wrote data cleaning scripts in Python.
Missed: production data pipelines (Subtle exaggeration)
Built a course-planning web app with Python and React, and was a teaching assistant for intro programming.
Source text: I built a course-planning web app with Python and React. I was a teaching assistant for an intro programming course.
Faithful rewrite, no warnings
Pancakes most Sundays, and always hunting for the best food truck in town.
Source text: I make pancakes most Sundays and I am always looking for the best food truck in town.
Faithful rewrite, no warnings
Software engineering intern at Tallowtree Analytics: wrote data cleaning scripts in Python and presented my project to the analytics team.
Source text: Software engineering intern at Tallowtree Analytics. Wrote data cleaning scripts in Python. · Fact: I presented my internship project to the analytics team.
Faithful rewrite, no warnings