
Ambient AI Clinical Documentation for a Multi-Specialty Clinic Group
Let's Connect
Overview
What we built
Doctors at an 18-clinic physician group were spending close to two hours after every shift typing up visit notes. We built a system that listens to the consultation and drafts the note for them.
In plain terms: every patient visit generates a clinical note, and at this multi-specialty group in the US Midwest the notes were being written last, after the patients had gone home. Clinicians stayed behind for close to two hours per shift to finish their charting, billing waited on the backlog, note quality varied from one specialty to the next, and two physicians had cut their patient load simply to keep up with the paperwork. Burnout was climbing, and the group could see it in its own surveys.
We built an ambient documentation system. A consent-gated device in the consultation room listens to the visit, transcribes the conversation as it happens, and a language model drafts a structured note in the format that specialty already uses. The draft lands in the electronic health record for the physician to review, edit and sign off, with every suggestion auditable. Within 3 months, average after-hours charting fell from 118 to 31 minutes per clinician, same-day note closure rose from 46% to 88%, and clinician-reported burnout scores improved by 27% over two quarters.
The Problem
Two hours of after-shift charting
The group's 18 clinics span multiple specialties, and each one carried the same hidden shift at the end of the day. Documentation could not happen properly during the visit, because the clinician was, rightly, focused on the patient, so the notes queued up. Doctors then spent close to two hours after every shift reconstructing conversations from memory and shorthand, long after the details had begun to fade.
The costs compounded quietly. Documentation backlogs delayed billing, because a visit cannot be coded and invoiced until its note is closed. Note quality varied between specialties, with each department evolving its own habits and templates. And the human toll was becoming explicit: burnout was climbing across the group, and two physicians had reduced their patient load specifically to keep up with charting, trading clinical capacity for paperwork time.
Leadership faced an uncomfortable trade. Asking clinicians to chart faster risked thinner, less defensible notes. Hiring scribes for every room across 18 clinics would have been costly and hard to staff. And doing nothing meant watching the evenings of its clinicians disappear into documentation, one shift at a time, while the group's most constrained resource, clinician energy, kept eroding.
After-shift charting
Close to two hours of note-writing followed every shift, completed from memory and shorthand hours after the visits themselves had ended.
Billing held hostage
Visits cannot be billed until their notes are closed, so every documentation backlog flowed directly into delayed billing across the group's clinics.
Inconsistent note quality
Each specialty had drifted into its own documentation habits, so the depth and structure of notes varied widely between departments and between clinicians.
Careers reshaped by paperwork
Clinician burnout scores were climbing, and two physicians had already reduced their patient load specifically so they could keep up with their charting.
What it was costing them
Multiply close to two hours of after-shift charting by every clinician, every shift, across 18 clinics, and the group was losing an enormous quantity of skilled time to typing. Billing lagged behind care, note quality depended on which department a patient visited, and the physicians most affected were solving the problem the only way they could: by seeing fewer patients.
The Solution
Ambient listening, structured notes
We designed the system around a simple principle: the consultation itself already contains the note, if something trustworthy is listening. A consent-gated device in the room captures the visit only when the patient has agreed, and speech is transcribed in real time while the clinician stays focused on the person in front of them rather than on a keyboard.
From the transcript, a large language model drafts a structured clinical note mapped to the relevant specialty template, so each department receives drafts in the structure it already works with rather than a generic summary. Nothing publishes on its own: the draft lands in the EHR as a proposal, every AI suggestion is editable, and every change is auditable, keeping the physician as the author of record.
Review and sign-off stayed deliberately central to the workflow. Physicians read the draft, adjust anything the model has phrased imperfectly, and sign the note while the visit is still fresh, typically between patients rather than after the shift. The system's job is to remove the typing and the reconstruction from memory, never the clinical judgement.
Key decisions
Consent before capture
The room device records only consent-gated visits, so patients explicitly agree before any audio is captured and the practice keeps full control of when the system listens.
Specialty templates, not generic notes
Drafts map to each specialty's own note template, which is what made the output usable across a multi-specialty group instead of serving only one department.
The physician signs everything
No note reaches the record without physician review and sign-off: the model proposes, the clinician decides, and authorship stays exactly where it belongs.
Every suggestion auditable
Each AI suggestion and each human edit is tracked, so the group can always show precisely how a note came to say what it says.
Drafts inside the EHR
Notes arrive in the electronic health record clinicians already use, so reviewing a draft fits the existing workflow instead of adding another system to check.
Measurable Impact
What changed after launch
The numbers moved quickly. Within 3 months, average after-hours charting time fell from 118 to 31 minutes per clinician, and the same-day note closure rate climbed from 46% to 88% across all 18 clinics. By the final month of rollout, 92% of AI-drafted notes were being signed off with only minor edits, a sign that the drafts had earned clinical trust rather than mere tolerance.
The human result is the one the group cares most about. Clinician-reported burnout scores on internal surveys improved by 27% over two quarters, evenings returned to the people who had been spending them charting, and billing stopped waiting on a documentation backlog. Note structure is now consistent within each specialty, because every draft starts from the same template rather than from a tired memory.
After-hours charting
Close to two hours per clinician after every shift
An average of 31 minutes within 3 months
Note closure
46% of visit notes closed the same day
88% same-day closure across all 18 clinics
Draft quality
Note structure varied between specialties and clinicians
92% of AI drafts signed off with only minor edits
Clinician wellbeing
Burnout climbing, patient loads cut to cope
Burnout scores improved 27% over two quarters
Headline results
Average after-hours charting time reduced from 118 to 31 minutes per clinician within 3 months
92% of AI-drafted notes signed off with only minor edits by the final month of rollout
Same-day note closure rate improved from 46% to 88% across all 18 clinics
Clinician-reported burnout scores on internal surveys improved by 27% over two quarters
Tech & Tools Used
What powered the build
Every tool below earned its place in this engagement. Here is the part each one played.
Python (FastAPI)
Runs the core documentation service, receiving live transcripts, orchestrating note drafting and exposing the APIs the review workflow is built on.
Whisper ASR
Transcribes the consultation audio in real time, turning the natural back-and-forth of a clinical visit into accurate text ready for drafting.
Azure OpenAI Service
Hosts the large language model that drafts each structured note from the transcript, keeping patient data inside the group's governed cloud environment.
Node.js
Powers the integration services that move draft notes into the EHR review queue and relay sign-off and edit events back for auditing.
React
Builds the review interface where physicians read drafts, make edits and sign notes, with every AI suggestion clearly marked and editable.
PostgreSQL
Stores transcripts, draft versions, edits and audit trails, so the full history of how each note was produced remains queryable.
HL7 FHIR Integration
Carries signed-off notes and visit context between the documentation system and the group's EHR using standard clinical data interfaces.
WebRTC
Streams audio securely from the consent-gated room device to the transcription service with the low latency that real-time drafting depends on.
Docker
Packages every service into consistent containers, so the same documentation stack deploys identically across the group's clinic environments.
Ready to Build your Healthcare Business with Ambient Documentation AI
Ask Byte
Ask Byte
Typically replies instantly
just Now
Hi! I'm OrganByte's assistant. How can I help you today?
AI-generated content may be incorrect

