
AI Report Generation for First Responders
AI Report Generation for First Responders
How might we use AI technology to assist in report generation?
Our research focuses on the exploration of AI technology, firefighting processes, and critical information capture necessary during wildfire incidents.
The original brief for this project focused on the exploration of AI Technology with voice input for the purposes of aiding EMS with report generation. However, after meeting with the client we realized that the project was an exploratory project.
Client: Indiana Crisis Technology Lab
ROLE: UX Researcher
We segmented the project into four chunks.
How do we approach this broad exploratory project?
Narrowing focus and targeting areas for exploratory research.
Focus versus exploration…
Methods
Desk Research: Literature Review_01
We split Desk Research into 5 areas
Desk Research_01:
Artificial Intelligence and how it works
Over simplified general AI process…
Desk Research_01
2. Past Firefighting Technology
Past Technology created for firefighters was:
costly
complicated
time-consuming to learn and use
not enough accuracy
extra equipment can get in the way
Focus on current equipment and technology and how we might repurpose as opposed to creating a new technology
What do fire fighters have on their uniform that we could repurpose?
Desk Research_01
3. Current Firefighting Technology
Take a minute to write an introduction that is short, sweet, and to the point. If you sell something, use this space to describe it in detail and tell us why we should make a purchase. Tap into your creativity. You’ve got this.
Desk Research_01
4. Current fire incident report processes and reports
Desk Research_01
5. Wildfire Incidents
A series of 16 tragic wildfires, occurring between 1937 and 1956 prompted the USDA Forest Service to create 10 Standard Firefighting orders, developed in 1957. These 10 Standard Firefighting Orders were developed to manage the unpredictable nature of wildfires and save the lives of personnel working under these conditions.
The Anatomy of a Wildfire
Wildfire Training Videos Source: South King County Fire Training Consortium: Wildland Urban Interface Awareness Videos 1, 2, 3, and 4
Anchor Points
Insights from Wildfire Research…
Situational awareness is key to managing wildfire incidents.
Need to know what the fire is doing at all times.
How does wind affect fire movement?
Where are safety zones?
Who is on site and where are they?
What resources are available?
New questions emerge.
What kinds of input data could we collect on situational awareness and environmental conditions that would benefit firefighters?
Could we capture satellite images of the wildfire and label the main components of the fire? (head, heel, fingers, etc.)
How might we capture and display constantly changing weather conditions?
Subject Matter Expert Interviews: Insights
Observation/Mini-Contextual Inquiry
What we learned…
Fire administration has strong reporting systems in place
While missing reports are an issue, there is a strong management system in place and automated notifications are sent to those who are missing reports
Reports are not time sensitive and Incident Commanders have up to 3 days to submit reports
Reporting done after the incident not during
Manual reporting did not seem to affect critical aspects of the ongoing incident
Reporting narratives are used as evidence in court cases and for insurance purposes
Data gathered from this method pushed us in a new direction:
Away from AI Report generation and towards a focus on non-traditional reporting of environmental factors like; wind-tracking, weather tracking, fire tracking, and how we might capture those elements.
Affinity Diagram
Insights from Affinity Diagram
Initial Goals Versus Results
Next Steps…
DESK RESEARCH: PHASE 2
Explore inputs for an AI algorithm that could track fire movement, location, and how wind might affect the direction of the fire.
Suggest researching AI and wind tracking, AI and location tracking, and AI and heat tracking.
Further exploration of heads-up displays for air-pack masks, smart glasses, and smart goggles format.
Initial prototypes and sketches
testing and validation with firefighters