ChatGPT wrote a fluent, well-structured cover letter almost instantly. It also invented a skill I never mentioned, opened with a line I'd already seen elsewhere, and echoed the job posting back at me instead of connecting it to my actual experience. Speed was never the issue. Substance was.
I gave ChatGPT one job posting and one instruction: write me a cover letter. Then I ran it six more times, tweaking the prompt each round. The first draft came back in seconds. It was also full of problems I didn't expect. Here is the full breakdown.
Key Takeaways
- ChatGPT can draft a cover letter in seconds. It can't verify facts about you.
- Vague prompts produce invented details. Forage's tests found ChatGPT claiming a QuickBooks skill the prompt never mentioned.
- In my test, every draft followed the same five-paragraph shape.
- A generic opening line and common buzzwords are the fastest way to blend in.
- The fix isn't avoiding AI. It's feeding it better, more specific input.
AI is now part of many job searches, and we collected the numbers separately in our cover letter and resume statistics roundup.
The Prompt I Used
I kept it simple on purpose, the way most people actually do it.
I pasted a real job posting for a marketing coordinator role, then added one line: "Write a cover letter for this job." No resume. No company research. No tone guidance.
That's the test most job seekers unknowingly run every day. It's also exactly the setup that produces the worst version of an AI cover letter.
Mistake #1: It Invented Things I Never Told It
The draft claimed I had "proven experience managing multi-channel campaigns." I hadn't given ChatGPT any campaign experience to describe.
This isn't a one-off glitch. Forage's tests, first published in December 2022 and updated in May 2024, found the same pattern. For an accounting internship letter, ChatGPT said the candidate was proficient in QuickBooks, a skill the prompt never mentioned. NKU's career services guide warns that ChatGPT may guess at your experience and may suggest numbers that don't reflect your actual results.
The model isn't lying on purpose. It's completing a pattern. A cover letter needs specific claims, so it generates specific-sounding ones, true or not. That's exactly the kind of detail that falls apart the moment an interviewer asks a follow-up question.
Mistake #2: Every Draft Read Like the Same Five Paragraphs
I regenerated the letter several times. The shape never changed. Intro, two body paragraphs, a values paragraph, a closing ask.
Forage's testers described the output in similar terms: well written but generic, and not something to submit without substantial editing. When thousands of candidates use the same tool with the same default settings, they tend to get the same shape back.
That sameness is invisible to the person sending one letter. It's obvious to a recruiter reading fifty.
Short on time? Enter the role, company, tone and your key skills in Cover Letter AI & Resume Maker to get a first draft, then rewrite it in your own voice.
Mistake #3: The Opening Line Felt Familiar
My draft opened with some version of "I am writing to express my strong interest in the Marketing Coordinator position." So does nearly every other AI-generated letter I've seen. It's the model's default fallback for a vague prompt.
The buzzwords weren't far behind: passionate, results-driven, dynamic, proven track record. None of these describe anything specific. They just fill space where a real example should sit.
As Neil Taylor, founder of the communications firm Schwa, told The Next Web in February 2023, "AIs are brilliant at being average." That's exactly why the output blends in instead of standing out.
Mistake #4: It Repeated the Job Posting Back at Me
When I pasted more of the job description into a later attempt, the letter improved, but not the way I'd hoped. It echoed phrases straight from the posting instead of connecting them to my background.
That matches what Forage found. In its business development test, the letter repeated the pasted job posting language without explaining how the candidate had used those skills. Repeating a phrase isn't the same as making a case for it.
What ChatGPT Actually Got Right
To be fair, not everything failed.
The grammar was clean. The structure, while repetitive across drafts, stayed logical within any single letter. And it solved the blank-page problem instantly, which matters more than people admit when a deadline is an hour away. Forage's testers also found the writing polished and the letters polite, even though they would likely not win an interview as written.
Treated as a rough first draft rather than a finished letter, it's a genuinely useful starting point.
The Fix That Actually Worked
All four mistakes trace back to one root cause. The model had almost nothing to work with.
Once I added my real resume, the target company's name, and two actual achievements, the fabrication disappeared. The tone sharpened. The letter started sounding like a candidate instead of a template.
That's the real lesson. AI cover letters don't fail because the model is bad. They fail because most people, myself included on that first try, give it almost nothing to build from. NKU's guide gives the same advice: give the tool as much specific detail as you can, and remove identifying details such as your name and contact information before you share your resume.
A tool that asks for the role, company, tone and key skills before it writes leaves less empty space for the model to fill with a guess. You still read it, edit it, and add your own voice.
For the edits worth making no matter which tool drafts the letter, our guide on personalizing AI-generated cover letters walks through each one. To see what a genuinely tailored letter looks like once those fixes are made, we collected real examples in winning cover letter examples that got jobs.
Related Reading
- How to Personalize an AI-Generated Cover Letter (5 Steps): make an AI draft sound like you in five steps.
- Cover Letter Examples: Entry-Level, Mid-Level, Career Change: tailored examples for entry-level, mid-level and career change.
- Can Employers Tell if a Cover Letter Was Written by AI?: whether employers can tell a letter came from AI.
- 10 Cover Letter Mistakes to Avoid (and How to Fix Them): 10 cover letter mistakes with fixes.
Sources: Forage, ChatGPT cover letter tests (published December 15, 2022; updated May 31, 2024); The Next Web, report on ChatGPT-written cover letters (February 14, 2023); Northern Kentucky University Career Services, guide to using ChatGPT to improve resumes and cover letters.
Applying to several jobs? Use Cover Letter AI & Resume Maker for each first draft, then tailor every letter to its job post. Free to download from the App Store for iPhone and iPad, with in-app purchases for some features. AI drafts can contain mistakes, so read and edit every line before you send it.
Frequently Asked Questions
Does ChatGPT make up fake experience in cover letters? Yes, when prompts are vague. Forage's tests found ChatGPT claiming a QuickBooks skill the prompt never mentioned, and NKU's career services warns it may guess at your experience or suggest numbers that don't reflect your real results. Check every claim before you send the letter.
Why do AI cover letters all sound the same? Default prompts produce default output. If you paste a job posting with no resume or context, ChatGPT falls back on a similar structure, tone and phrasing. In my test the shape never changed across drafts, and Forage's testers also found well-written but generic letters.
Is it bad to use ChatGPT for a cover letter? No, but treat it as a first draft. Forage's tests concluded you can't rely on the output alone to land an interview, and that it needs substantial editing. The problems above come from sending output unedited, not from using AI itself. Check facts, add real examples and rewrite the opening.
What should I add to my prompt to get a better result? Your actual resume, the full job description, the company name and at least two specific, real achievements. NKU's career services advises giving as much specific detail as you can, and removing identifying details such as your name and contact information before you share your resume.
How do I fix a generic AI-written cover letter? Remove buzzwords, add real numbers you can support, mention something true about the company, and rewrite the opening line so it isn't the one every other applicant sent. Then read it aloud and check each claim against your real record.
