FairAudit
Menu

FairAudit Audit Early access

An independent bias audit of your hiring AI.

We measure selection rates and impact ratios for every group the law names, using the method NYC’s bias-audit rule prescribes, on your real outcomes.

How it works

  1. Counts per group

    You share how many candidates in each group were considered and how many were selected. Never a person’s record.

  2. Impact ratios, by the NYC method

    Selection rates and impact ratios against the best-treated group, with intervals and significance.

  3. A signed report

    The report is signed. Anyone you hand it to can verify it without asking us.

You share counts. Never people.

At one decision point, the shortlist for example, over one period: how many candidates in each group were considered, and how many were selected. That is all. The intake refuses row-level data, so a file of individual records is turned away, not stored.

Counts are enough to measure a disparity. They are not enough to identify a person.

You get evidence, signed.

  • Selection rates for every group, with their 95% intervals.
  • Impact ratios against the best-treated group, the four-fifths benchmark used by NYC Local Law 144 and the EEOC.
  • Whether each gap is statistically significant, and how large it is.
  • How much the candidates who did not declare a group could change the answer.
  • Intersections and per-location slices, marked exploratory.
  • The legal citation behind every ground tested.

The report is signed. Your client’s DPO can verify it without asking us.

What a report contains

Audit has no screen to show you yet, so here is its output instead: the real engine, run on counts we invented.

Sample report, synthetic data Decision point: Shortlist · engine fairness/1.1.0
Gender 4,050 candidates
Group Considered Selected Selection rate Impact ratio p (Fisher)
man reference 2,180 427 19.6% (18.0% to 21.3%) 1.00
woman 1,820 295 16.2% (14.6% to 18.0%) 0.83 0.006
Engine proposes: magnitude none; the gap is statistically significant. The interval around the ratio includes 0.80. Undeclared candidates could change this result.
non-binary 50 7 14.0% (7.0% to 26.2%) 0.71 0.372
Engine proposes: magnitude moderate; the gap is not statistically significant. Under 2% of the sample: reported, never used as the reference. The interval around the ratio includes 0.80. Undeclared candidates could change this result.
Age band 4,050 candidates
Group Considered Selected Selection rate Impact ratio p (Fisher)
under 40 reference 2,638 516 19.6% (18.1% to 21.1%) 1.00
40 and over 1,412 213 15.1% (13.3% to 17.0%) 0.77 < 0.001
Engine proposes: magnitude moderate; the gap is statistically significant. The interval around the ratio includes 0.80. Undeclared candidates could change this result.
Impact ratio: a group's selection rate divided by the rate of the best-treated group. 0.80 is a benchmark, not a verdict. Magnitude: none at 0.80 or above, moderate from 0.70, high from 0.50, severe below. The engine proposes. A named person makes the determination.
Sample report, synthetic data. Counts invented for this page. Computed by the FairAudit fairness engine. Not any client and not a published audit.

The engine computes. A person decides.

The law’s test has two parts, and only one can be computed. Whether a practice puts a group at a disadvantage is arithmetic. Whether that is justified by a legitimate aim is an argument, and it belongs to a person. So the engine proposes a size for each gap and a named reviewer makes the determination.

It never outputs the word compliant.

Independent means independent.

An audit is only worth something if the auditor had no hand in the tool. We audit only where we have had no part in building it. A client can have Audit or Flow, not both.

The method was tested against the published tables of a real NYC Local Law 144 audit: same method, same reference group, same small-group exclusion rule.

Where it stands

What exists

The engine, the intake that accepts counts, and the signed report.

What does not, yet

The review and sign-off step, and the helper that turns an export from your applicant tracking system into counts on your own machine. The statistics are under external review.

Early access means it is not self-serve. Apply, and we will tell you plainly whether your case fits what exists today.

Your clients will ask how you know it is fair.

Have the answer on paper, signed, before they do.

The assistant: sign in with your email. We confirm access by email. The high-risk obligations for hiring systems, Article 14 included, apply from 2 December 2027. Regulatory information, not legal advice.