# CallAuditAI: rubric scoring for counseling and sales calls

> CallAuditAI is Mirai Minds' service for auditing recorded sales and counseling calls. Gemini listens to each recording and scores it against a weighted rubric covering opening and rapport, needs discovery, value and objection handling, and closing, then returns an Excel scorecard with zero scores flagged in red. An admissions counseling company uses it to review calls.

Client: Admissions counseling company (Education counseling) · Status: production · Year: 2026 · Written by Sneh Mehta

## Key facts

- **Rubric:** Opening 30%, discovery 30%, value and objections 20%, closing 20%
- **Model:** Gemini scores the audio directly
- **Output:** Excel scorecard or JSON, with red flags on zero scores
- **Transcript:** Optional, with representative and customer as separate speakers
- **Cost visibility:** Per-call model cost, shown only with a secret key
- **Deployed:** January 2026


## The problem

Sales and counseling teams record their calls, but managers can listen to only a few. The admissions counseling company wanted every recorded call scored the same way, against a fixed rubric, so coaching could start from the calls that most needed it.

## What we built

A small service with one job: take a recording and the counselor's name, and return a scorecard.

- **Scoring.** Gemini listens to the audio and scores each criterion of the rubric. The rubric has four categories: opening and rapport building (30%), needs discovery and information gathering (30%), value proposition and objection handling (20%), and closing (20%). Each criterion carries its own weight inside its category.
- **The scorecard.** An Excel sheet with section headers, the weight of every criterion, category totals and an overall score. Any criterion scored zero is highlighted as a red flag. The same result is available as JSON for teams that want to load it elsewhere.
- **Transcripts and costs on request.** A diarized transcript, labeling the company representative and the customer, comes from a separate, lighter Gemini call. Model cost per call is returned only when the request carries a secret key, so cost details stay out of everyday responses.
- **A log and an upload page.** Each processed call and its duration are logged, and a simple web page lets staff upload recordings without touching the API.

## How it works in production

The client's team uploads recordings, one per request, and downloads the scorecards. Scoring and transcription are separate calls, so the transcript can be skipped when only the score is needed. The service was deployed for the client in January 2026; in September 2026 the product gained JSON output, transcripts and cost reporting. For the broader pattern, see [custom LLM and document AI](/services/custom-llm-development); for the calls themselves, [voice AI agents](/services/voice-ai-agents).

## What we'd change

- **Calibrate against human scores.** Before trusting totals, we'd have managers score a sample of calls blind and compare with the model criterion by criterion. Subjective criteria, such as warmth and tone, need that check most.
- **Batch uploads and trends.** One file per request keeps the service simple. Teams with higher call volumes want batch uploads and per-counselor trends over time.

## Stack

- **AI:** Google Gemini for scoring, A lighter Gemini model for transcripts
- **API:** FastAPI, openpyxl, SQLite call log
- **Interface:** Upload page in HTML, CSS and JavaScript

## Frequently asked questions

### Does CallAuditAI need a transcript first?

No. Gemini scores the audio file directly. A transcript with the company representative and the customer as separate speakers is optional and comes from a separate call to a lighter model.

### Can the rubric be changed?

Yes. The rubric is four weighted categories, each with its own weighted criteria, such as active listening or warmth and tone. We set the categories, criteria and weights with each client; the current deployment uses 30/30/20/20 across opening, discovery, value and closing.

### How do managers use the scores?

They start with the red flags: any criterion scored zero is highlighted in the sheet. Category totals and an overall score make calls comparable, and the recording is always there to check the model's judgment.


---

Canonical: https://www.miraiminds.co/work/callauditai
Last updated: 2026-09-23
Publisher: Mirai Minds LLP, 906 Sarthana Business Hub, Nana Varachha, Surat, Gujarat 395013, India. hello@miraiminds.co