AI startup hiring shifts to work trials

The trigger for the work-trial wave is that the entire top of the funnel went numb at once. Job applications are up roughly 45% with about 11,000 submissions hitting employers every minute, and almost every one of them is now AI-polished. Rising Team CEO Jennifer Dulski put the consequence bluntly: 'Hiring managers often can't tell the difference between people and AI bots.' That isn't a complaint about candidates being lazy — it's a structural failure of the signal. When ATS filters and human screeners are both reading text that another model wrote, the resume stops being a representation of the person.

The interview round broke at the same time. Reddit's r/cscareerquestions surfaced a now-canonical case in which a 'vibe coder' passed a traditional interview and joined a team only for colleagues to discover he didn't know what an epoch or a confusion matrix was — he had been routing every coding question through an AI tab. WorkTrial AI's Michael Guan summarizes the moment in product terms: 'Resumes lie. Interviews mislead.' That sentence is now the thesis behind a wave of startups rebuilding hiring around observed work, because the only thing AI hasn't degraded is what someone actually ships across several days of real conditions.

The economics of trials look expensive on a single line item and cheap on the spreadsheet. Average cost-per-hire sits around $4,700, but a bad hire — once you include lost productivity, re-recruiting, onboarding, and team disruption — runs anywhere from 30% to 150% of annual salary, with SHRM data putting full replacement cost at 50% to 200% of salary and some estimates climbing to 3-4x at the high end. Against those numbers, paying an engineer for three to five real working days is a rounding error.

The outcome data is starting to back up the math. Linear, the project-management startup whose hiring playbook is now widely copied, reports a 96% retention rate over four years tied directly to its 2-5 day work trial. That is the lever WorkTrial AI is pulling on commercially: the company has built a real-work simulation environment plus an AI 'Signal Engine' that scores commits, edits, and Slack threads, productizing the same observation-first model that Linear, PostHog, Gumroad, and 37signals built in-house. When the cost of a wrong hire is measured in salary multiples and the cost of the trial is measured in days, the trial is the cheap option.

What a trial looks like in practice is now fairly standardized across AI-native startups. Foxglove invites finalists to a paid three-to-five-day engagement after a short interview loop, and the team is explicit that 'work trial projects' must be 'real work, not hypothetical scenarios.' Crucially, candidates are encouraged to use any AI tools they want — the trial is designed to measure how they ship with AI, not whether they can resist using it. Crosby, the Sequoia-backed AI law firm, runs the same idea with a scheduling twist: it offers Sunday slots so employed candidates don't burn PTO. CEO Ryan Daniels recalls candidates' relief: 'When the company started offering Sundays as an option, a lot of people were just like, That would be a huge relief.' Harvey, on the legal-AI side, leans on take-home Google Docs problem sets as a lighter-weight version of the same instinct.

The new evaluation criterion is judgment, not memorization. BizTech Weekly's Aarav Patel captures the shift in one line: 'the question is no longer Can you code? but increasingly Can you ship with AI responsibly?' A thread in r/startups echoes the on-the-ground version — take-home tests are dead, live sessions are in, and the explicit setup is 'Here is a laptop with Cursor and Claude Code installed. Here is a problem.' Some teams have started 'poisoning' CLAUDE.md files with subtle anti-patterns to test whether candidates blindly accept AI suggestions or treat the model 'like a junior dev' and double-check it. That is the posture the trial format is built to detect, and resumes never could.

Not everyone is convinced the answer to AI-broken hiring is more software. On EO's channel, Paraform founder John Kim describes a market in which it now takes roughly 5,000 cold emails to make a single engineering hire, up from about 500 five years ago — a tenfold collapse in inbound signal. His response was to 10x revenue by paying out more than $50 million to human recruiters working with companies like Palantir, Rippling, and Decagon. The bet is that when AI floods both sides of the funnel, the scarce resource is a human who has met the candidate and can vouch.

The community is split along the same axis. A Reddit thread in r/webdev framed the preferred interview model as 'watch how they work with AI — not whether they can code from memory,' but vocal contrarians pushed for AI to be banned in interviews entirely so fundamentals can be tested. The Verge's recruiting segment landed in the middle, with hiring leaders at LinkedIn, Greenhouse, and Glassdoor confirming that AI-generated resumes are overwhelming AI-driven ATS filters and that the most consistent advice to candidates is to 'be more human.' Trials, human recruiters, and AI-banned whiteboards are three different answers to the same problem — and right now all three are growing.

There is a quiet cost to the trial model that the playbook posts don't dwell on: not everyone can do a five-day trial. A paid three-to-five-day engagement at Foxglove, a 2-5 day trial at Linear, or a 4-6 week paid contractor trial at Gumroad all assume the candidate can carve out that block of time. In practice, that selects sharply for the unemployed, students, and people willing to moonlight; employed senior candidates with families have the hardest time saying yes. Crosby's Sunday-slot innovation is a direct response to that — Ryan Daniels positioned weekend slots so candidates wouldn't have to burn PTO — but it also normalizes giving up a weekend to compete for a job.

The broader signal is that as trials become the default, the social contract of hiring shifts. A 2025 NACE survey found nearly two-thirds of employers now use skills-based hiring for entry-level roles, which is the bull case: people without elite credentials get a real shot to demonstrate work. The bear case is selection bias in the other direction — the candidates who can afford the time, accept the Sunday slot, and absorb the unpaid prep cost are not necessarily the best engineers, just the most available. Founders adopting trials should plan for both effects, because the same format that beats AI-resume noise can quietly narrow the pool it draws from.