Ambient Nursing Guidance

Ambient Nursing Guidance

Ambient Nursing Guidance

Documentation VUI Design for Nurses

Documentation VUI Design for Nurses

Documentation VUI Design for Nurses

Internship

Internship

Internship

UX Research

UX Research

UX Research

UX/UI Design

UX/UI Design

UX/UI Design

Team

1 SWD

1 UXD

1 SWD Intern

1 UXD Intern

1 QM

Team

1 SWD

1 UXD

1 SWD Intern

1 UXD Intern

1 QM

Role

UXD Intern

UX Research

UX/UI Design

Role

UXD Intern

UX Research

UX/UI Design

Timeframe May 2025 -

Aug 2025

Timeframe May 2025 -

Aug 2025

Tools Used

Figma

FigJam

Tools Used

Figma

FigJam

Context

While Ambient supports documentation and patient engagement, nurses still struggle to recall requirements and avoid omissions without clear references.

Ambient records patient conversations directly into the chart, reducing workstation use, but limits nurses’ access to reference information during interactions.

Current Workflow of a General Nurse Performing a Head-to-toe Assessment

Primary Research

We conducted total 6 interviews with nurses, clinicians, stakeholders to gain in-depth insights into nurses' documentation needs, the usability of Ambient, and how they handle challenges in practice.

Research Questions
  • What information is most helpful for nurses when documenting during complex assessments?

  • How are challenges addressed in practice?

  • How is the usability of the current version of Ambient evaluated?

Secondary Research

Research Goals
  • Understanding nurses’ workflows during their shifts.

  • Identifying pain points and challenges in the current documentation process.

  • Reviewing existing feedback on the use of VUI in medical settings.

After the research process, I conducted an affinity diagram with my team to
  • Derive common insights

  • Prioritize actionable insights


Research Findings

Point #1

In the current workflow, it is difficult to recall all the required assessment items.

Point #2

Previous records and contextual information help nurses take appropriate actions and conduct further assessments.

Point #3

Subtle interactions are preferred, as it is important to appear confident in front of patients.

Define

How Might We?

How might we help nurses access key information effectively while documenting with Ambient away from workstations?

Ideation

Design Sprint & Lo-fi Wireframes

Through a design sprint, we developed features from key insights, selected the most relevant and feasible ideas, and I created multiple wireframe versions, comparing their strengths, weaknesses, and layout options.

Primary Research

We conducted total 6 interviews with nurses, clinicians, stakeholders to gain in-depth insights .

Research Questions
  • What information is most helpful for nurses when documenting during complex assessments?

  • How are challenges addressed in practice?

  • How is the usability of the current version of Ambient evaluated?

Secondary Research

Research Goals
  • Understanding nurses’ workflows during their shifts.

  • Identifying pain points and challenges in the current documentation process.

  • Reviewing existing feedback on the use of VUI in medical settings.

After the research process, I conducted an affinity diagram with my team to
  • Derive common insights

  • Prioritize actionable insights


Research Findings

Point #1

In the current workflow, it is difficult to recall all the required assessment items.

Point #2

Previous records and contextual information help nurses take appropriate actions and conduct further assessments.

Point #3

Subtle interactions are preferred, as it is important to appear confident in front of patients.

Define

How Might We?

How might we help nurses access key information effectively while documenting with Ambient away from workstations?

Ideation

Design Sprint & Lo-fi Wireframes

Through a design sprint, we developed features from key insights, selected the most relevant and feasible ideas, and I created multiple wireframe versions, comparing their strengths, weaknesses, and layout options.

Solutions

Due to confidentiality, original designs are replaced with simplified drawings.

Revised Workflow

Real-time AI based voice activated screen.

The AI understands which items the nurse is currently assessing and displays only the relevant information on the screen. This allows nurses to receive assessment support through displayed keywords, even when they are away from the workstation while interacting with patients.

Layout

Reinterpreting layouts that users are already familiar with.

By referencing the layout of Hyperspace, which nurses currently use for documentation, I designed the structure to align with their mental model and ensure that information could be easily understood even from a distance.

Contextual Data Display

Display contextual data most referenced in assessments.

By analyzing the speech between nurses and patients during assessments, the system identifies the context and displays last filed value along with other closely related assessments(items), which are most frequently referenced in assessments.

Timely Reminders

Prevents missed documentation in assessment.

Instead of having to recall them, essential documentation items to be assessed during the shift can be quickly identified through icons, helping nurses review them before leaving their station.

Iterations

User Testing & Modifications

After creating high-fidelity mockups and an interactive prototype, we conducted user testing with nurses. Based on their feedback, we refined the design and proceeded with development.

After creating high-fidelity mockups and an interactive prototype, we conducted user testing with nurses. Based on their feedback, we refined the design and proceeded with development.

Takeaways

  1. Design while adhering to the existing design system.

Followed the existing design system to maintain visual and interaction consistency, adapting components as needed to address unique requirements of the project while ensuring efficiency in design and development handoff.

  1. Break down complex problems with systematic research into actionable design solutions.

Led user research in a complex healthcare domain, actively engaging engineers and other team members throughout the process. Facilitated continuous discussions to build a shared understanding of user problems, systematically breaking down complex issues and turning insights into actionable design solutions that drove informed design decisions.

© 2025 Ellen Lee

kwellen@umich.edu

© 2025 Ellen Lee

kwellen@umich.edu

© 2025 Ellen Lee

kwellen@umich.edu