GenAI Storyboards
Conducting research through AI-generated branch narrative Storyboards
2024-2025
Human-AI interaction, Digital Health, Storyboarding, Figma, TORUS project
As part of EPSRC-funded TORUS project and while doing research within digital the health domain, I developed interactive storyboards using MidJourney and Figma as tools for conducting internal and external research within the project.
The TORUS project develops a smart home system for at-home monitoring of Parkinson’s disease, comprising vision-based cameras for posture recognition and a wearable band.
The purpose of the storyboard tool and the associated studies was to support internal collaboration - engaging with engineers within the project to discuss and coordinate product development - as well as external user research - investigating the acceptability and appropriateness of different interaction options with participants, and unpacking ethical concerns around privacy, use and development of AI algorithms and data collection, processing and use.
Storyboard early versions
The storyboard showed different potential interaction scenarios for the TORUS system to support decision making. These interaction scenarios include voice control, wearable feedback for reminders, data logging/journaling through smart phone apps etc. Using branching and interactive graphics (in Figma), the storyboard provided participants with different options to choose from - i.e. different options to control and interact with the system - and ways to select and comment on their preferred interactions - i.e. I used integrated survey tools and Maze to record user flows within the storyboards.
The first versions of the storyboard used one character and exesive branching to investigate potential interactions. Later, more characters were developed, while the amount of branching was reduced (due to decisions taking place).
Above: A diagram showing example of the branching in the storyboard.
Above: A diagram showing example of the branching in the storyboard.
Above: Example of interactive branching in the storyboard.
The final Storyboard
Through iterative engagements with internal and external stakeholders, the storyboard supported handling complexity of the decisions around the system’s design, consolidating feedback from engineers and patients/carers. The use of Gen-AI tool Midjourney made it possible to constantly update the storyboard effortlessly, from producing interaction alternatives worth exploring, to integrating new concepts and keeping everyone in the project up-to-date with the design requirements and the design progress of the TORUS system.
Above: Short video-clip showcasing part of one version of the storyboard
Above: A version of the interactive storyboard (Figma) used as a tool to conduct online studies, investigating interaction scenarios with the home monitoring system. The storyboard was essentially an online survey, whereby one can nagivate different interaction scenarios using buttons and leave feedback on an embedded survey.
In total, the storyboards supported the design of the TORUS project for a period of 6 months. In terms of conducting online studies with external users, we initially interviewed 10 participants using the storyboard tool, and later deployed it as an online survey capturing insights from another 20 participants. Results from these online studies formed design recommendations to guide the design of TORUS smart home health monitoring system.
Above: A PDF report with one of the most final versions of the storyboard, featuring the life-cycle of the TORUS system and accompanied survey questions.